-- Logs begin at Fri 2022-09-16 12:00:11 UTC, end at Fri 2022-09-16 13:13:23 UTC. -- Sep 16 12:34:37.566734 n-d-858094-4 systemd[1]: Starting Devstack devstack@n-api.service... Sep 16 12:34:37.576974 n-d-858094-4 devstack@n-api.service[112915]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 16 12:34:37.578219 n-d-858094-4 devstack@n-api.service[112915]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 16 12:34:37 2022] *** Sep 16 12:34:37.578219 n-d-858094-4 devstack@n-api.service[112915]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 16 12:34:37.578219 n-d-858094-4 devstack@n-api.service[112915]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 16 12:34:37.578219 n-d-858094-4 devstack@n-api.service[112915]: nodename: n-d-858094-4 Sep 16 12:34:37.578219 n-d-858094-4 devstack@n-api.service[112915]: machine: x86_64 Sep 16 12:34:37.578219 n-d-858094-4 devstack@n-api.service[112915]: clock source: unix Sep 16 12:34:37.578219 n-d-858094-4 devstack@n-api.service[112915]: pcre jit disabled Sep 16 12:34:37.578219 n-d-858094-4 devstack@n-api.service[112915]: detected number of CPU cores: 4 Sep 16 12:34:37.578219 n-d-858094-4 devstack@n-api.service[112915]: current working directory: / Sep 16 12:34:37.578219 n-d-858094-4 devstack@n-api.service[112915]: detected binary path: /usr/bin/uwsgi-core Sep 16 12:34:37.578219 n-d-858094-4 devstack@n-api.service[112915]: your processes number limit is 47680 Sep 16 12:34:37.578840 n-d-858094-4 devstack@n-api.service[112915]: your memory page size is 4096 bytes Sep 16 12:34:37.578840 n-d-858094-4 devstack@n-api.service[112915]: detected max file descriptor number: 2048 Sep 16 12:34:37.578840 n-d-858094-4 devstack@n-api.service[112915]: lock engine: pthread robust mutexes Sep 16 12:34:37.578840 n-d-858094-4 devstack@n-api.service[112915]: thunder lock: enabled Sep 16 12:34:37.578840 n-d-858094-4 devstack@n-api.service[112915]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 16 12:34:37.578840 n-d-858094-4 devstack@n-api.service[112915]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 16 12:34:37.618255 n-d-858094-4 devstack@n-api.service[112915]: Python main interpreter initialized at 0x563aaf72d9c0 Sep 16 12:34:37.618255 n-d-858094-4 devstack@n-api.service[112915]: python threads support enabled Sep 16 12:34:37.618255 n-d-858094-4 devstack@n-api.service[112915]: your server socket listen backlog is limited to 100 connections Sep 16 12:34:37.618255 n-d-858094-4 devstack@n-api.service[112915]: your mercy for graceful operations on workers is 90 seconds Sep 16 12:34:37.618650 n-d-858094-4 devstack@n-api.service[112915]: mapped 403077 bytes (393 KB) for 2 cores Sep 16 12:34:37.618650 n-d-858094-4 devstack@n-api.service[112915]: *** Operational MODE: preforking *** Sep 16 12:34:37.618931 n-d-858094-4 devstack@n-api.service[112915]: *** uWSGI is running in multiple interpreter mode *** Sep 16 12:34:37.618931 n-d-858094-4 devstack@n-api.service[112915]: spawned uWSGI master process (pid: 112915) Sep 16 12:34:37.619136 n-d-858094-4 systemd[1]: Started Devstack devstack@n-api.service. Sep 16 12:34:37.619697 n-d-858094-4 devstack@n-api.service[112915]: spawned uWSGI worker 1 (pid: 112916, cores: 1) Sep 16 12:34:37.620040 n-d-858094-4 devstack@n-api.service[112915]: spawned uWSGI worker 2 (pid: 112917, cores: 1) Sep 16 12:34:37.620221 n-d-858094-4 devstack@n-api.service[112915]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 16 12:34:38.289234 n-d-858094-4 devstack@n-api.service[112916]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 16 12:34:38.296556 n-d-858094-4 devstack@n-api.service[112917]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 16 12:34:39.377612 n-d-858094-4 devstack@n-api.service[112916]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 12:34:39.377612 n-d-858094-4 devstack@n-api.service[112916]: from cryptography.utils import int_from_bytes Sep 16 12:34:39.378201 n-d-858094-4 devstack@n-api.service[112916]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 12:34:39.378201 n-d-858094-4 devstack@n-api.service[112916]: from cryptography.utils import int_from_bytes Sep 16 12:34:39.411975 n-d-858094-4 devstack@n-api.service[112917]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 12:34:39.411975 n-d-858094-4 devstack@n-api.service[112917]: from cryptography.utils import int_from_bytes Sep 16 12:34:39.412527 n-d-858094-4 devstack@n-api.service[112917]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 12:34:39.412527 n-d-858094-4 devstack@n-api.service[112917]: from cryptography.utils import int_from_bytes Sep 16 12:34:41.914469 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 16 12:34:41.915068 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 16 12:34:41.915240 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 16 12:34:41.915592 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 16 12:34:41.915844 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 16 12:34:41.916249 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.916569 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.916669 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 16 12:34:41.917049 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.917141 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 16 12:34:41.917231 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.917406 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 16 12:34:41.917495 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.917787 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.918014 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 16 12:34:41.918112 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.918265 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 16 12:34:41.918396 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.918647 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.918743 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.918956 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.919060 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.919265 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.919351 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.919576 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.919679 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858094-4 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.919889 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.919976 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.920212 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.920325 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.920521 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.920644 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.920833 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.920933 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.921128 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.921233 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.921395 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.921497 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.921704 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.921801 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.922019 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858094-4 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.922208 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.922331 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.923501 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.923602 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.923682 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.923750 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.923816 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.923880 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.923955 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.924022 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.924096 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.924198 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.924266 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.924350 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.924431 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.924658 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.924825 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.924965 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.925091 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.925227 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.925351 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.925484 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.925698 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858094-4 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.925915 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.926030 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.926158 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.926298 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.926418 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.926604 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.926734 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.926984 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.927110 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.927294 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.927417 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.927592 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.927758 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.927893 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.928032 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858094-4 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.928258 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.928442 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.928578 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.928871 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.929013 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.929184 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.929319 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.929496 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.929675 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.929804 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.929987 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.930130 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.930295 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.930422 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.930648 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.930798 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.930923 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.931056 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.931218 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.931347 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.931532 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.931668 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.931793 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.931916 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.932072 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.932224 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.932411 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.932559 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.932724 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.932865 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.933039 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.933179 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.933316 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.933442 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.933564 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.933694 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.933818 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.933984 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.934122 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.934286 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.934421 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.934545 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.934737 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.934873 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.934998 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.935120 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.935242 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.935427 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.935553 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.935746 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.935877 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.936000 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.936176 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.936303 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.936429 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.936565 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.936717 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.936852 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.937025 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.937160 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.937338 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.937467 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.937637 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.937814 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.937941 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.938064 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.938290 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.938419 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.938581 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.938707 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.938998 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.939185 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.939322 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.939494 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.939630 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.939810 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.939945 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.940142 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.940285 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.940462 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.940591 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.940770 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.940900 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.941085 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.941201 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.941479 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.941580 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.941728 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.941815 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.942032 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.942121 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.942366 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.942468 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.942679 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.942776 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.942981 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.943079 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.943280 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.943369 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.943593 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.944282 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.944594 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.944693 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.944901 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.945147 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.945290 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.945462 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.945601 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.945774 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.945901 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.946238 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.946367 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.946545 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.946674 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.946847 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.946975 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.947152 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.947279 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.947455 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.947584 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.947756 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.947921 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.948045 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.948198 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.948389 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.948531 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.948721 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.948849 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.949153 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.949610 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.949738 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.950057 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.950333 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.950459 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.950644 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.950779 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.950953 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.951082 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.951259 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.951447 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.951591 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.951728 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.951854 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.951977 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.952184 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.952316 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.952469 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.952695 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.952823 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.952946 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.953078 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.953202 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.953363 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.953504 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.953676 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.953803 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.954157 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.954604 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.954770 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.955019 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.955146 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.955336 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.955472 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.955644 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.955771 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.955949 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.956077 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.956282 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.956420 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.956585 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.956712 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.956886 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.957020 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.957187 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.957324 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.957487 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.957614 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.957789 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.957957 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.958083 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.958206 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.958381 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.958559 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.958886 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.959307 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.959626 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.959768 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.959964 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.960089 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.961067 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.961200 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.961498 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.961627 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.961833 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.962005 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.962176 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.962313 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.962490 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.962620 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.962818 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.962962 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.963143 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.963271 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.963456 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.963586 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.963764 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.963893 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.964202 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.964676 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.964920 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.965049 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.965285 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.965415 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.965687 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.965839 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.965972 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.966097 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.966230 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.966355 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.966756 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.967036 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.967170 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.967305 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.967431 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.967555 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:34:41.967679 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.967804 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.968104 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.968295 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.968422 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.968644 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.968776 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.968901 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.969097 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.969292 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.969443 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.969789 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.969917 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.970111 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.970292 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.970439 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.970566 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.970741 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.970877 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.971041 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.971284 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.971424 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.971549 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.971672 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.971919 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.972064 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.972271 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.972474 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.972600 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.972731 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.972845 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.973017 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.973017 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.973328 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.973451 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.973581 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.973711 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.973843 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.974022 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.974213 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.974347 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.974471 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.974595 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.974718 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.974851 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.975019 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.975195 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.975368 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.975495 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.975607 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.975607 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.975850 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.975973 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.976097 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.976252 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.976390 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.976514 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.976702 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.976831 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.977014 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.977143 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.977352 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.977475 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.977609 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.977745 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.977915 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.978044 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.978220 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.978348 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.978500 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.978638 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.978799 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.978935 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.979103 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.979233 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.979400 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.979569 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.979708 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.979834 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.980022 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.980213 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.980340 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.980464 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.980652 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.980794 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.980949 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.981078 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.981254 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.981391 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.981559 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.981700 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.981867 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.982003 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.982166 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.982294 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.982471 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.982607 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.982771 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.982906 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.983069 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.983197 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.983371 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.983506 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.983676 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.983808 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.983975 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.984103 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.984354 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.984513 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.984653 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.984778 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.984944 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.985146 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.985281 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.985405 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.985529 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.985646 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.985837 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.985964 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.986137 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.986264 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.986438 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.986566 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.986750 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.986877 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.987053 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.987181 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.987355 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.987482 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.987662 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.987803 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.987962 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.988090 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.988306 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.988432 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.988568 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.988701 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.988869 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.988997 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.989186 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.989314 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.989491 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.989626 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.989788 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.989916 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.990084 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.990211 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.990383 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.990591 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.990786 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.990927 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.991053 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.991309 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.991446 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.991661 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.991790 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.991976 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.992105 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.992316 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.992460 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.992624 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.992752 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.992941 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.993070 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.993246 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.993382 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.993545 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.993681 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.993843 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.993978 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.994141 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.994278 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.994474 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.994601 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.994773 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.994900 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.995101 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.995228 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.995413 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.995540 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.995712 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.995839 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.996017 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.996272 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.996402 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.996526 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.996650 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.996774 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.996923 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.997124 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.997252 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.997375 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.997498 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.997620 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.997770 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.997899 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.998070 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.998207 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.998376 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.998511 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.998635 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.998758 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.998950 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.999087 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.999253 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.999391 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.999554 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.999690 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.999855 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:41.999983 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.000176 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.000322 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.000490 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.000617 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.000803 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.000929 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.001134 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.001270 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.001445 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.001574 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.001765 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.001998 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.002137 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.002261 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.002385 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.002508 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.002630 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.002753 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.002936 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.003065 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.003292 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.003421 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.003544 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.003666 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.003825 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.003953 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.004158 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.004289 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.004457 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.004598 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.004764 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.004894 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.005066 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.005192 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.005373 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.005499 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.005701 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.005826 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.005957 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.006081 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.006836 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.006979 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.007271 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.007427 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.007604 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.007834 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.007964 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.008193 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.008325 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.008501 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.008627 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.008822 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.008951 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.009124 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.009252 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.009431 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.009558 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.009731 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.009858 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.010032 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.010162 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.010335 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.010470 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.010642 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.010784 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.010950 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.011079 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.011252 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.011386 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.011550 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.011687 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.011854 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.011968 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.012173 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.012290 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.012478 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.012617 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.012777 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.012908 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.013073 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.013199 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.013384 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.013520 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.013687 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.013822 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.014003 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.014132 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.014309 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.014451 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.014606 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.014732 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.014905 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.015037 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.015211 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.015339 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.015533 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.015670 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.015796 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.015919 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.016086 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.016240 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.016408 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.016539 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.016713 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.016839 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.017024 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.017154 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.017323 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.017450 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.017626 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.017752 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.017929 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.018057 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.018234 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.018360 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.018547 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.018684 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.018810 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.018941 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.019105 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.019234 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.019412 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.019549 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.019716 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.019844 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.020019 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.020194 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.020333 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.020466 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.020640 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.020768 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.020944 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.021071 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.021241 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.021382 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.021594 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.021720 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.021918 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.022555 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.022717 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.022979 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.023106 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.023314 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.023555 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.023695 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.023918 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.024091 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.024520 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.024748 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.024877 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.025153 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.025294 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.025469 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.025813 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.025951 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.026131 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.026427 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.026609 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.026771 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.026968 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.027097 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.027298 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.027426 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.027627 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.027765 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.027926 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.028054 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.028250 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.028380 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.028558 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.028689 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.028841 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.028969 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.029142 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.029269 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.029440 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.029570 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.029743 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.029870 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.030042 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.030169 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.030341 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.030470 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.030640 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.030769 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.030938 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.031067 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.031248 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.031384 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.031545 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.031681 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.031849 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.031990 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.032172 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.032304 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.032492 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.032629 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.032793 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.033058 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.033187 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.033375 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.033502 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.033670 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.033798 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.034002 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.034127 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.034287 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.034415 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.034611 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.034752 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.034922 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.035064 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.035251 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.035384 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.035548 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.035676 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.035846 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.035993 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.036170 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.036299 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.036470 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.036597 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.036768 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.036915 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.037064 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.037193 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.037361 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.037526 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.037700 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.037837 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.038019 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.038300 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.038440 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.038638 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.038790 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.038924 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.039050 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.039196 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.039324 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.039492 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.039630 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.039795 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.039921 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.040091 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.040256 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.040422 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.040564 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.040726 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.040854 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.041023 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.041158 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.041318 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.041448 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.041621 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.041749 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.041918 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.042045 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.042213 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.042341 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.042509 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.042635 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.042806 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.042933 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.043115 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.043245 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.043411 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.043548 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.043709 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.043838 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.044079 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.044268 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.044407 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.044533 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.044641 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.044759 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.044938 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.045126 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.045261 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.045473 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.045608 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.045819 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.045947 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.046158 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.046286 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.046472 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.046599 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.046779 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.046902 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.047119 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.047246 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.047469 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.047596 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.047812 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.047947 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.048139 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.048273 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.048444 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.048580 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.048747 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.048872 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.049036 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.049167 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.049335 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.049470 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.049637 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.049765 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.049941 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.050069 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.050240 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.050380 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.050538 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.050674 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.050836 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.050963 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.051137 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.051274 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.051432 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.051639 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.051767 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.051890 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.052022 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.052184 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.052341 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.052470 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.052642 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.052781 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.052939 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.053608 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.053859 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.054004 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.054149 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.054424 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.054588 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.054746 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.054896 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.055050 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.055211 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.055373 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.055530 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.055682 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.055840 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.055969 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.056167 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.056313 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.056482 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.056619 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.056782 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.056919 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.057094 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.057230 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.057400 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.057527 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.057707 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.057836 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.058006 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.058143 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.058304 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.058433 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.058621 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.058750 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.058916 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.059055 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.059219 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.059348 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.059516 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.059650 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.059827 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.059964 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.060143 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.060287 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.060446 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.060575 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.060779 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.060913 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.061044 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.061184 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.061316 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.061440 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.061618 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.061747 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.061919 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.062053 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.062219 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.062347 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.062519 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.062657 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.062817 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.062945 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.063120 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.063260 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.063422 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.063551 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.063721 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.063856 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.064027 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.064191 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.064357 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.064486 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.064657 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.064792 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.064973 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.065113 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.065275 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.065403 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.065570 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.065697 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.065870 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.066008 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.066167 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.066294 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.066472 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.066599 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.066770 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.066899 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.067068 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.067203 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.067368 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.067504 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.067685 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.067814 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.067991 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.068154 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.068319 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.068457 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.068672 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.069370 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.069593 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.069753 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.069905 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.070206 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.070343 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.070561 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.070688 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.070874 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.071003 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.071187 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.071329 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.071499 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.071629 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.071798 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.071932 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.072096 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.072282 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.072429 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.072555 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.072740 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.072868 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.073036 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.073163 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.073334 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.073462 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.073633 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.073762 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.073936 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.074063 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.074235 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.074362 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.074539 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.074673 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.074840 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.074969 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.075159 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.075294 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.075465 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.075605 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.075765 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.075915 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.076070 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.076232 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.076395 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.076536 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.076703 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.076831 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.077002 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.077129 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.077428 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.077563 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.077728 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.077854 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.078030 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.078157 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.078332 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.078461 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.078637 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.078765 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.078943 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.079080 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.079248 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.079416 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.079550 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.079673 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.079842 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.079969 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.080176 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.080321 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.080493 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.080633 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.080800 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.080929 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.081115 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.081205 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.081456 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.081557 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.081755 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.081843 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.082063 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.082151 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.082381 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.082477 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.082681 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.082771 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.082980 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.083067 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.083278 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.083367 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.083601 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.083698 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.083890 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.083986 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.084210 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.084330 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.084550 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.084850 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.084977 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.085155 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.085502 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.085604 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.085761 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.086316 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.086414 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.086700 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.086930 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.087105 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.087229 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.087545 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.087673 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.087852 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.088195 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.088300 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.088517 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.088848 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.088945 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.089213 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.089459 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.089613 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.089779 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.089917 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.090166 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.090264 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.090543 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.090741 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.090879 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.091071 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.091167 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.091406 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.091493 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.091740 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.091827 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.092059 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.092184 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.092407 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.092504 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.092715 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.092803 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.093039 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.093128 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.093351 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.093437 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.093659 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.093755 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.093972 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.094060 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.094291 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.094378 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.094590 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.094680 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.094887 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.094976 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.095191 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.095280 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.095489 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.095590 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.095789 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.095901 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.096087 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.096232 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.096414 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.096544 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.096710 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.096846 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.097007 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.097149 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.097305 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.097469 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.097621 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.097775 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.097919 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.098084 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.098235 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.098377 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.098539 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.098676 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.098836 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.098972 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.099136 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.099265 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.099432 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.099594 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.099767 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.099923 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.100106 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.100391 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.100520 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.100804 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.100935 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.101128 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.101257 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.101441 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.101575 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.101743 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.101870 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.102052 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.102227 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.102353 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.102475 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.102650 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.102778 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.102952 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.103083 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.103253 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.103388 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.103555 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.103690 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.103867 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.103996 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.104227 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.104363 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.104486 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.104610 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.104837 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.105037 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.105175 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.105359 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.105488 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.105669 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.105807 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.105976 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.106106 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.106284 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.106420 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.106592 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.106721 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.106898 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.107026 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.107204 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.107334 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.107510 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.107647 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.107816 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.107944 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.108163 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.108296 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.108433 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.108560 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.108734 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.108864 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.109040 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.109169 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.109367 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.109495 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.109659 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.109785 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.109909 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.110045 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.110218 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.110361 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.110518 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.110647 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.110835 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.110976 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.111140 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.111268 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.111438 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.111567 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.111738 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.111866 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.112036 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.112182 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.112386 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.112523 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.112684 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.112812 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.112986 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.113113 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.113293 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.113422 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.113600 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.113737 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.113901 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.114030 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.114208 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.114346 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.114515 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.114644 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.114821 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.114946 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.115132 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.115274 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.115442 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.116071 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.116361 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.116482 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.116679 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.116915 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.117053 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.117235 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.117364 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.117551 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.117787 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.117929 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.118098 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.118400 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.118529 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.118725 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.118869 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.119037 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.119165 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.119346 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.119473 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.119651 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.119826 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.119952 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.120082 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.120280 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.120408 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.120577 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.120718 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.120883 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.121012 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.121187 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.121321 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.121483 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.121624 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.121832 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.121954 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.122093 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.122209 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.122481 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.122610 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.122719 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.122833 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.123003 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.123119 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.123320 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.123527 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.123650 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.123873 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.123995 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.124209 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.124343 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.124532 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.124660 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.124850 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.124966 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.125162 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.125276 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.125463 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.125585 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.125770 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.125882 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.126070 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.126186 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.126372 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.126494 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.126678 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.126792 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.126981 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.127110 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.127278 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.127415 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.127577 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.127715 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.127881 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.128016 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.128209 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.128336 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.128495 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.128641 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.128800 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.128936 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.129096 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.129224 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.129415 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.129552 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.129715 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.129881 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.130012 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.130138 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.130300 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.130531 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.130667 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.130846 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.130974 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.131790 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.131935 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.132207 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.132353 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.132519 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.132834 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.132964 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.133136 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.133265 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.133811 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.133933 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.134040 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.134146 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.134262 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.134410 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.134734 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.134856 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.135073 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.135326 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.135445 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.135689 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.135851 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.135989 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.138088 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.138852 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.138991 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.139122 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.139240 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.139365 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.139500 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.139628 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.139754 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.139927 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.140054 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.140199 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.140347 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.140474 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.140598 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.140722 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.140848 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.140980 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.141106 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.141230 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.141353 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.141478 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.141602 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.141734 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.141868 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.142001 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.142128 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.142252 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.142383 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.142516 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.142641 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.142766 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.142890 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.143022 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.143146 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.143284 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.143415 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.143541 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.143671 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.143796 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.143932 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.144065 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.144214 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.144340 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.144463 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.144587 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.144724 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.144858 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.144984 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.145108 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.145239 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.145364 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.145496 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.145621 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.145744 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.145875 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.146000 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.146134 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.146267 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.146392 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.146528 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.146654 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.146810 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.146942 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.147067 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.147191 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.147315 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.147440 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.147564 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.147767 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.147894 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.147894 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.148194 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.148334 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.148334 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.148579 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.148705 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.148705 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.149084 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.149211 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.149347 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.149474 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.149600 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.149723 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.149848 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.150060 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.150241 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.150373 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.150553 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.150682 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.150870 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.150999 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.151187 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.151318 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.151495 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.151623 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.151813 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.151944 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.152147 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.152280 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.152463 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.152592 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.152770 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.152910 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.153081 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.153209 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.153405 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.153543 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.153740 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.153930 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.154059 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.154258 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.154387 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.154574 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.154704 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.154904 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.155044 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.155229 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.155364 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.155531 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.155672 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.155833 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.155962 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.156205 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.156337 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.156475 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.156610 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.156741 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.156866 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.157023 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.157153 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.157322 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.157465 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.157623 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.157751 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.157922 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.158050 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.158219 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.158356 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.158524 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.158661 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.158821 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.158950 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.159121 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.159249 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.159418 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.159547 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.159716 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.159844 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.160040 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.160204 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.160330 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.160452 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.160635 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.160764 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.160933 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.161060 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.161234 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.161361 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.161532 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.161667 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.161831 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.161958 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.162126 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.162248 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.162474 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.162657 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.162823 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.163032 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.163161 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.163409 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.163536 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.163714 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.163852 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.164021 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.164181 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.164349 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.164520 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.164662 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.164788 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.164967 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.165110 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.165265 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.165401 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.165567 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.165893 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.166022 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.166197 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.166329 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.166500 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.166637 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.166806 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.166942 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.167111 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.167241 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.167416 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.167546 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.167720 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.167848 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.168040 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.168203 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.168394 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.168522 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.168692 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.168820 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.169009 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.169153 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.169318 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.169447 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.169633 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.169768 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.169942 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.170079 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.170255 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.170378 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.170535 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.170664 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.170837 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.170973 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.171140 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.171278 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.171445 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.171574 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.171750 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.171877 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.172048 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.172217 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.172369 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.172498 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.172676 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.172805 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.172976 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.173104 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.173277 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.173415 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.173577 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.173706 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.173875 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.174003 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.174178 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.174315 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.174475 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.174603 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.174774 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.174901 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.175072 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.175214 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.175371 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.175507 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.175668 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.175796 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.175965 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.176207 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.176337 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.176463 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.176586 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.176710 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.176842 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.176967 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.177213 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.177353 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.177479 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.177603 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 16 12:34:42.177738 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.178583 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.179144 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.179528 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.179854 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.180194 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.180520 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.180835 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.181153 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.181471 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.181786 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.182094 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.182423 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.182731 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.183037 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.183344 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.183651 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.183958 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.184290 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.184614 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.184935 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.185234 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.185552 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.185862 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.186176 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.186486 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.186792 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.187112 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.187416 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.187717 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.188020 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.188350 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.188658 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.188968 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.189273 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.189578 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.189888 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.190198 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.190517 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.190839 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.191144 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.191460 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.191779 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.192139 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.192446 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.192783 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.193103 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.193408 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.194360 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.194860 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:34:42.195246 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 16 12:34:42.332471 n-d-858094-4 devstack@n-api.service[112916]: INFO dbcounter [None req-f3e81c6c-8974-4c18-b729-8f6b00cd4fdf None None] Registered counter for database nova_api Sep 16 12:34:42.352179 n-d-858094-4 devstack@n-api.service[112917]: INFO dbcounter [None req-8ce80987-2e03-4f7f-960c-e33c0e74916f None None] Registered counter for database nova_api Sep 16 12:34:42.355036 n-d-858094-4 devstack@n-api.service[112916]: DEBUG oslo_db.sqlalchemy.engines [None req-f3e81c6c-8974-4c18-b729-8f6b00cd4fdf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112916) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 12:34:42.361675 n-d-858094-4 devstack@n-api.service[112916]: DEBUG dbcounter [-] [112916] Writer thread running {{(pid=112916) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 12:34:42.373235 n-d-858094-4 devstack@n-api.service[112917]: DEBUG oslo_db.sqlalchemy.engines [None req-8ce80987-2e03-4f7f-960c-e33c0e74916f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112917) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 12:34:42.379677 n-d-858094-4 devstack@n-api.service[112917]: DEBUG dbcounter [-] [112917] Writer thread running {{(pid=112917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 12:34:42.418909 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.context [None req-f3e81c6c-8974-4c18-b729-8f6b00cd4fdf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),19bb4c25-c68f-412b-8c46-4f5dc22c63ee(cell1) {{(pid=112916) load_cells /opt/stack/nova/nova/context.py:464}} Sep 16 12:34:42.422736 n-d-858094-4 devstack@n-api.service[112916]: DEBUG oslo_concurrency.lockutils [None req-f3e81c6c-8974-4c18-b729-8f6b00cd4fdf None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:34:42.423206 n-d-858094-4 devstack@n-api.service[112916]: DEBUG oslo_concurrency.lockutils [None req-f3e81c6c-8974-4c18-b729-8f6b00cd4fdf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:34:42.424777 n-d-858094-4 devstack@n-api.service[112916]: DEBUG oslo_concurrency.lockutils [None req-f3e81c6c-8974-4c18-b729-8f6b00cd4fdf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:34:42.425491 n-d-858094-4 devstack@n-api.service[112916]: DEBUG oslo_concurrency.lockutils [None req-f3e81c6c-8974-4c18-b729-8f6b00cd4fdf None None] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:34:42.425931 n-d-858094-4 devstack@n-api.service[112916]: DEBUG oslo_concurrency.lockutils [None req-f3e81c6c-8974-4c18-b729-8f6b00cd4fdf None None] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:34:42.427895 n-d-858094-4 devstack@n-api.service[112916]: DEBUG oslo_concurrency.lockutils [None req-f3e81c6c-8974-4c18-b729-8f6b00cd4fdf None None] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:34:42.430606 n-d-858094-4 devstack@n-api.service[112916]: INFO dbcounter [None req-f3e81c6c-8974-4c18-b729-8f6b00cd4fdf None None] Registered counter for database nova_cell0 Sep 16 12:34:42.434660 n-d-858094-4 devstack@n-api.service[112916]: INFO dbcounter [None req-f3e81c6c-8974-4c18-b729-8f6b00cd4fdf None None] Registered counter for database nova_cell1 Sep 16 12:34:42.438397 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.context [None req-8ce80987-2e03-4f7f-960c-e33c0e74916f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),19bb4c25-c68f-412b-8c46-4f5dc22c63ee(cell1) {{(pid=112917) load_cells /opt/stack/nova/nova/context.py:464}} Sep 16 12:34:42.441785 n-d-858094-4 devstack@n-api.service[112916]: DEBUG oslo_db.sqlalchemy.engines [None req-f3e81c6c-8974-4c18-b729-8f6b00cd4fdf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112916) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 12:34:42.442444 n-d-858094-4 devstack@n-api.service[112917]: DEBUG oslo_concurrency.lockutils [None req-8ce80987-2e03-4f7f-960c-e33c0e74916f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:34:42.442803 n-d-858094-4 devstack@n-api.service[112917]: DEBUG oslo_concurrency.lockutils [None req-8ce80987-2e03-4f7f-960c-e33c0e74916f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:34:42.443793 n-d-858094-4 devstack@n-api.service[112916]: DEBUG oslo_db.sqlalchemy.engines [None req-f3e81c6c-8974-4c18-b729-8f6b00cd4fdf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112916) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 12:34:42.444969 n-d-858094-4 devstack@n-api.service[112917]: DEBUG oslo_concurrency.lockutils [None req-8ce80987-2e03-4f7f-960c-e33c0e74916f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:34:42.445724 n-d-858094-4 devstack@n-api.service[112917]: DEBUG oslo_concurrency.lockutils [None req-8ce80987-2e03-4f7f-960c-e33c0e74916f None None] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:34:42.446169 n-d-858094-4 devstack@n-api.service[112917]: DEBUG oslo_concurrency.lockutils [None req-8ce80987-2e03-4f7f-960c-e33c0e74916f None None] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:34:42.448221 n-d-858094-4 devstack@n-api.service[112917]: DEBUG oslo_concurrency.lockutils [None req-8ce80987-2e03-4f7f-960c-e33c0e74916f None None] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:34:42.449826 n-d-858094-4 devstack@n-api.service[112916]: DEBUG dbcounter [-] [112916] Writer thread running {{(pid=112916) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 12:34:42.450219 n-d-858094-4 devstack@n-api.service[112917]: INFO dbcounter [None req-8ce80987-2e03-4f7f-960c-e33c0e74916f None None] Registered counter for database nova_cell0 Sep 16 12:34:42.452420 n-d-858094-4 devstack@n-api.service[112916]: DEBUG dbcounter [-] [112916] Writer thread running {{(pid=112916) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 12:34:42.454232 n-d-858094-4 devstack@n-api.service[112917]: INFO dbcounter [None req-8ce80987-2e03-4f7f-960c-e33c0e74916f None None] Registered counter for database nova_cell1 Sep 16 12:34:42.462020 n-d-858094-4 devstack@n-api.service[112917]: DEBUG oslo_db.sqlalchemy.engines [None req-8ce80987-2e03-4f7f-960c-e33c0e74916f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112917) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 12:34:42.463712 n-d-858094-4 devstack@n-api.service[112917]: DEBUG oslo_db.sqlalchemy.engines [None req-8ce80987-2e03-4f7f-960c-e33c0e74916f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112917) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 12:34:42.469083 n-d-858094-4 devstack@n-api.service[112917]: DEBUG dbcounter [-] [112917] Writer thread running {{(pid=112917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 12:34:42.474192 n-d-858094-4 devstack@n-api.service[112917]: DEBUG dbcounter [-] [112917] Writer thread running {{(pid=112917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 12:34:42.598900 n-d-858094-4 devstack@n-api.service[112916]: INFO dbcounter [None req-f3e81c6c-8974-4c18-b729-8f6b00cd4fdf None None] Registered counter for database nova_cell0 Sep 16 12:34:42.608381 n-d-858094-4 devstack@n-api.service[112916]: DEBUG oslo_db.sqlalchemy.engines [None req-f3e81c6c-8974-4c18-b729-8f6b00cd4fdf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112916) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 12:34:42.613594 n-d-858094-4 devstack@n-api.service[112916]: DEBUG dbcounter [-] [112916] Writer thread running {{(pid=112916) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 12:34:42.619342 n-d-858094-4 devstack@n-api.service[112917]: INFO dbcounter [None req-8ce80987-2e03-4f7f-960c-e33c0e74916f None None] Registered counter for database nova_cell0 Sep 16 12:34:42.628354 n-d-858094-4 devstack@n-api.service[112917]: DEBUG oslo_db.sqlalchemy.engines [None req-8ce80987-2e03-4f7f-960c-e33c0e74916f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112917) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 12:34:42.633680 n-d-858094-4 devstack@n-api.service[112917]: DEBUG dbcounter [-] [112917] Writer thread running {{(pid=112917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 12:34:42.953417 n-d-858094-4 devstack@n-api.service[112916]: WARNING keystonemiddleware.auth_token [None req-f3e81c6c-8974-4c18-b729-8f6b00cd4fdf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 12:34:42.955260 n-d-858094-4 devstack@n-api.service[112917]: WARNING keystonemiddleware.auth_token [None req-8ce80987-2e03-4f7f-960c-e33c0e74916f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 12:34:42.960754 n-d-858094-4 devstack@n-api.service[112916]: WARNING keystonemiddleware.auth_token [None req-f3e81c6c-8974-4c18-b729-8f6b00cd4fdf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 12:34:42.963202 n-d-858094-4 devstack@n-api.service[112917]: WARNING keystonemiddleware.auth_token [None req-8ce80987-2e03-4f7f-960c-e33c0e74916f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 12:34:43.303917 n-d-858094-4 devstack@n-api.service[112916]: WARNING keystonemiddleware.auth_token [None req-f3e81c6c-8974-4c18-b729-8f6b00cd4fdf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 12:34:43.309877 n-d-858094-4 devstack@n-api.service[112916]: WARNING keystonemiddleware.auth_token [None req-f3e81c6c-8974-4c18-b729-8f6b00cd4fdf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 12:34:43.314775 n-d-858094-4 devstack@n-api.service[112917]: WARNING keystonemiddleware.auth_token [None req-8ce80987-2e03-4f7f-960c-e33c0e74916f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 12:34:43.315414 n-d-858094-4 devstack@n-api.service[112916]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563aaf72d9c0 pid: 112916 (default app) Sep 16 12:34:43.317481 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-f3e81c6c-8974-4c18-b729-8f6b00cd4fdf None None] Calling method '>' {{(pid=112916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:34:43.318718 n-d-858094-4 devstack@n-api.service[112916]: INFO nova.api.openstack.requestlog [None req-f3e81c6c-8974-4c18-b729-8f6b00cd4fdf None None] 10.222.0.67 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001704 Sep 16 12:34:43.319125 n-d-858094-4 devstack@n-api.service[112916]: [pid: 112916|app: 0|req: 1/1] 10.222.0.67 () {50 vars in 788 bytes} [Fri Sep 16 12:34:43 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:34:43.321080 n-d-858094-4 devstack@n-api.service[112917]: WARNING keystonemiddleware.auth_token [None req-8ce80987-2e03-4f7f-960c-e33c0e74916f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 12:34:43.326166 n-d-858094-4 devstack@n-api.service[112917]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563aaf72d9c0 pid: 112917 (default app) Sep 16 12:36:06.245115 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-f3e81c6c-8974-4c18-b729-8f6b00cd4fdf None None] Calling method '>' {{(pid=112916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:36:06.246744 n-d-858094-4 devstack@n-api.service[112916]: INFO nova.api.openstack.requestlog [None req-f3e81c6c-8974-4c18-b729-8f6b00cd4fdf None None] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002059 Sep 16 12:36:06.247148 n-d-858094-4 devstack@n-api.service[112916]: [pid: 112916|app: 0|req: 2/2] 10.222.0.67 () {54 vars in 931 bytes} [Fri Sep 16 12:36:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:36:06.259493 n-d-858094-4 devstack@n-api.service[112917]: DEBUG dbcounter [-] [112917] Writing DB stats nova_api:SELECT=3 {{(pid=112917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:36:06.260754 n-d-858094-4 devstack@n-api.service[112917]: DEBUG dbcounter [-] [112917] Writing DB stats nova_cell1:SELECT=3 {{(pid=112917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:36:06.261573 n-d-858094-4 devstack@n-api.service[112917]: DEBUG dbcounter [-] [112917] Writing DB stats nova_cell0:SELECT=3 {{(pid=112917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:36:06.262512 n-d-858094-4 devstack@n-api.service[112917]: DEBUG dbcounter [-] [112917] Writing DB stats nova_cell0:SELECT=3 {{(pid=112917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:36:07.168519 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-21e96c03-502f-44eb-9ce9-53645fe16e31 admin admin] Calling method '>' {{(pid=112917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:36:07.204882 n-d-858094-4 devstack@n-api.service[112917]: INFO nova.api.openstack.requestlog [None req-21e96c03-502f-44eb-9ce9-53645fe16e31 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.950784 Sep 16 12:36:07.205744 n-d-858094-4 devstack@n-api.service[112917]: [pid: 112917|app: 0|req: 1/3] 10.222.0.67 () {60 vars in 1292 bytes} [Fri Sep 16 12:36:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:36:09.936603 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-f3e81c6c-8974-4c18-b729-8f6b00cd4fdf None None] Calling method '>' {{(pid=112916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:36:09.938452 n-d-858094-4 devstack@n-api.service[112916]: INFO nova.api.openstack.requestlog [None req-f3e81c6c-8974-4c18-b729-8f6b00cd4fdf None None] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002066 Sep 16 12:36:09.938977 n-d-858094-4 devstack@n-api.service[112916]: [pid: 112916|app: 0|req: 3/4] 10.222.0.67 () {54 vars in 931 bytes} [Fri Sep 16 12:36:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:36:10.430803 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-06ac04f8-49a1-4439-842d-8f5337fff761 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 1, "id": "c1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 256, "rxtx_factor": 1.0, "name": "cirros256"}} {{(pid=112917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:36:10.486768 n-d-858094-4 devstack@n-api.service[112917]: INFO nova.api.openstack.requestlog [None req-06ac04f8-49a1-4439-842d-8f5337fff761 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.541291 Sep 16 12:36:10.487769 n-d-858094-4 devstack@n-api.service[112917]: [pid: 112917|app: 0|req: 2/5] 10.222.0.67 () {64 vars in 1283 bytes} [Fri Sep 16 12:36:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 12:36:10.501190 n-d-858094-4 devstack@n-api.service[112916]: DEBUG dbcounter [-] [112916] Writing DB stats nova_api:SELECT=3 {{(pid=112916) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:36:10.502332 n-d-858094-4 devstack@n-api.service[112916]: DEBUG dbcounter [-] [112916] Writing DB stats nova_cell0:SELECT=3 {{(pid=112916) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:36:10.504273 n-d-858094-4 devstack@n-api.service[112916]: DEBUG dbcounter [-] [112916] Writing DB stats nova_cell1:SELECT=3 {{(pid=112916) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:36:10.505038 n-d-858094-4 devstack@n-api.service[112916]: DEBUG dbcounter [-] [112916] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112916) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:36:10.713260 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-22e1d41e-9d05-4533-9c83-4c39ffca3e6d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:36:10.786376 n-d-858094-4 devstack@n-api.service[112916]: INFO nova.api.openstack.requestlog [None req-22e1d41e-9d05-4533-9c83-4c39ffca3e6d admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.290176 Sep 16 12:36:10.786925 n-d-858094-4 devstack@n-api.service[112916]: [pid: 112916|app: 0|req: 4/6] 10.222.0.67 () {64 vars in 1336 bytes} [Fri Sep 16 12:36:10 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:36:13.487554 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-06ac04f8-49a1-4439-842d-8f5337fff761 admin admin] Calling method '>' {{(pid=112917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:36:13.488626 n-d-858094-4 devstack@n-api.service[112917]: INFO nova.api.openstack.requestlog [None req-06ac04f8-49a1-4439-842d-8f5337fff761 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Sep 16 12:36:13.489051 n-d-858094-4 devstack@n-api.service[112917]: [pid: 112917|app: 0|req: 3/7] 10.222.0.67 () {54 vars in 931 bytes} [Fri Sep 16 12:36:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:36:14.379723 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-3a04ec1a-2fc0-469d-882b-76b176cd75fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "swap": 0, "ram": 512, "disk": 5, "os-flavor-access:is_public": true}} {{(pid=112916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:36:14.436486 n-d-858094-4 devstack@n-api.service[112916]: INFO nova.api.openstack.requestlog [None req-3a04ec1a-2fc0-469d-882b-76b176cd75fa admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.940238 Sep 16 12:36:14.437962 n-d-858094-4 devstack@n-api.service[112916]: [pid: 112916|app: 0|req: 5/8] 10.222.0.67 () {64 vars in 1283 bytes} [Fri Sep 16 12:36:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:36:14.451524 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-3545a250-7045-49f1-9be2-9eca1f0c285a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:36:14.507016 n-d-858094-4 devstack@n-api.service[112917]: INFO nova.api.openstack.requestlog [None req-3545a250-7045-49f1-9be2-9eca1f0c285a admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.059074 Sep 16 12:36:14.508212 n-d-858094-4 devstack@n-api.service[112917]: [pid: 112917|app: 0|req: 4/9] 10.222.0.67 () {64 vars in 1336 bytes} [Fri Sep 16 12:36:14 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:36:17.362692 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-3a04ec1a-2fc0-469d-882b-76b176cd75fa admin admin] Calling method '>' {{(pid=112916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:36:17.363831 n-d-858094-4 devstack@n-api.service[112916]: INFO nova.api.openstack.requestlog [None req-3a04ec1a-2fc0-469d-882b-76b176cd75fa admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Sep 16 12:36:17.370056 n-d-858094-4 devstack@n-api.service[112916]: [pid: 112916|app: 0|req: 6/10] 10.222.0.67 () {54 vars in 931 bytes} [Fri Sep 16 12:36:17 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:36:17.991775 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-29e9cc8f-b089-474b-a064-1b3c74a80929 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "name": "ds1G", "id": "d2", "disk": 10, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:36:18.013284 n-d-858094-4 devstack@n-api.service[112917]: INFO nova.api.openstack.requestlog [None req-29e9cc8f-b089-474b-a064-1b3c74a80929 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.641862 Sep 16 12:36:18.014043 n-d-858094-4 devstack@n-api.service[112917]: [pid: 112917|app: 0|req: 5/11] 10.222.0.67 () {64 vars in 1283 bytes} [Fri Sep 16 12:36:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 12:36:18.026800 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-e4fc4be2-c2dd-4d35-a25f-9e60fdb4af72 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:36:18.059974 n-d-858094-4 devstack@n-api.service[112916]: INFO nova.api.openstack.requestlog [None req-e4fc4be2-c2dd-4d35-a25f-9e60fdb4af72 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036850 Sep 16 12:36:18.060498 n-d-858094-4 devstack@n-api.service[112916]: [pid: 112916|app: 0|req: 7/12] 10.222.0.67 () {64 vars in 1336 bytes} [Fri Sep 16 12:36:18 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:36:20.780430 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-29e9cc8f-b089-474b-a064-1b3c74a80929 admin admin] Calling method '>' {{(pid=112917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:36:20.781452 n-d-858094-4 devstack@n-api.service[112917]: INFO nova.api.openstack.requestlog [None req-29e9cc8f-b089-474b-a064-1b3c74a80929 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 Sep 16 12:36:20.782119 n-d-858094-4 devstack@n-api.service[112917]: [pid: 112917|app: 0|req: 6/13] 10.222.0.67 () {54 vars in 931 bytes} [Fri Sep 16 12:36:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:36:21.228306 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-9eb62911-8750-4789-bdbe-3a733a11552e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "disk": 10, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "ram": 2048, "swap": 0}} {{(pid=112916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:36:21.251961 n-d-858094-4 devstack@n-api.service[112916]: INFO nova.api.openstack.requestlog [None req-9eb62911-8750-4789-bdbe-3a733a11552e admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.461677 Sep 16 12:36:21.252623 n-d-858094-4 devstack@n-api.service[112916]: [pid: 112916|app: 0|req: 8/14] 10.222.0.67 () {64 vars in 1283 bytes} [Fri Sep 16 12:36:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:36:21.266920 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-9eb3c162-3907-4ce1-ad11-f89816d4ec9d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:36:21.296514 n-d-858094-4 devstack@n-api.service[112917]: INFO nova.api.openstack.requestlog [None req-9eb3c162-3907-4ce1-ad11-f89816d4ec9d admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033940 Sep 16 12:36:21.297132 n-d-858094-4 devstack@n-api.service[112917]: [pid: 112917|app: 0|req: 7/15] 10.222.0.67 () {64 vars in 1336 bytes} [Fri Sep 16 12:36:21 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:36:24.107507 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-9eb62911-8750-4789-bdbe-3a733a11552e admin admin] Calling method '>' {{(pid=112916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:36:24.109900 n-d-858094-4 devstack@n-api.service[112916]: INFO nova.api.openstack.requestlog [None req-9eb62911-8750-4789-bdbe-3a733a11552e admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002790 Sep 16 12:36:24.116281 n-d-858094-4 devstack@n-api.service[112916]: [pid: 112916|app: 0|req: 9/16] 10.222.0.67 () {54 vars in 931 bytes} [Fri Sep 16 12:36:24 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:36:24.611337 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-4f4196a6-07ff-4f55-a12a-ea9f8bccbeaa admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "name": "ds4G", "swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=112917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:36:24.633835 n-d-858094-4 devstack@n-api.service[112917]: INFO nova.api.openstack.requestlog [None req-4f4196a6-07ff-4f55-a12a-ea9f8bccbeaa admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.516505 Sep 16 12:36:24.634526 n-d-858094-4 devstack@n-api.service[112917]: [pid: 112917|app: 0|req: 8/17] 10.222.0.67 () {64 vars in 1283 bytes} [Fri Sep 16 12:36:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:36:24.648048 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-507d9f0f-0e54-4c5e-ab3b-f7a958f69348 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:36:24.673739 n-d-858094-4 devstack@n-api.service[112916]: INFO nova.api.openstack.requestlog [None req-507d9f0f-0e54-4c5e-ab3b-f7a958f69348 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029593 Sep 16 12:36:24.674915 n-d-858094-4 devstack@n-api.service[112916]: [pid: 112916|app: 0|req: 10/18] 10.222.0.67 () {64 vars in 1336 bytes} [Fri Sep 16 12:36:24 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:36:27.351102 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-4f4196a6-07ff-4f55-a12a-ea9f8bccbeaa admin admin] Calling method '>' {{(pid=112917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:36:27.352113 n-d-858094-4 devstack@n-api.service[112917]: INFO nova.api.openstack.requestlog [None req-4f4196a6-07ff-4f55-a12a-ea9f8bccbeaa admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001755 Sep 16 12:36:27.352574 n-d-858094-4 devstack@n-api.service[112917]: [pid: 112917|app: 0|req: 9/19] 10.222.0.67 () {54 vars in 931 bytes} [Fri Sep 16 12:36:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:36:27.824613 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-cd6247c9-b816-4c9a-af6c-a54d60278d12 admin admin] Calling method '>' {{(pid=112916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:36:27.851292 n-d-858094-4 devstack@n-api.service[112916]: INFO nova.api.openstack.requestlog [None req-cd6247c9-b816-4c9a-af6c-a54d60278d12 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.492394 Sep 16 12:36:27.851877 n-d-858094-4 devstack@n-api.service[112916]: [pid: 112916|app: 0|req: 11/20] 10.222.0.67 () {60 vars in 1292 bytes} [Fri Sep 16 12:36:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:36:30.871083 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-4f4196a6-07ff-4f55-a12a-ea9f8bccbeaa admin admin] Calling method '>' {{(pid=112917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:36:30.873875 n-d-858094-4 devstack@n-api.service[112917]: INFO nova.api.openstack.requestlog [None req-4f4196a6-07ff-4f55-a12a-ea9f8bccbeaa admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002780 Sep 16 12:36:30.874700 n-d-858094-4 devstack@n-api.service[112917]: [pid: 112917|app: 0|req: 10/21] 10.222.0.67 () {54 vars in 931 bytes} [Fri Sep 16 12:36:30 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:36:31.378614 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-3d490432-a0bd-4061-9bdd-40dcee28b7e0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "1", "ram": 512, "name": "m1.tiny"}} {{(pid=112916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:36:31.399499 n-d-858094-4 devstack@n-api.service[112916]: INFO nova.api.openstack.requestlog [None req-3d490432-a0bd-4061-9bdd-40dcee28b7e0 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.518325 Sep 16 12:36:31.399958 n-d-858094-4 devstack@n-api.service[112916]: [pid: 112916|app: 0|req: 12/22] 10.222.0.67 () {64 vars in 1283 bytes} [Fri Sep 16 12:36:30 2022] POST /compute/v2.1/flavors => generated 402 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 12:36:31.411995 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-73c4401b-c32b-47a2-8621-101be880be87 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:36:31.441400 n-d-858094-4 devstack@n-api.service[112917]: INFO nova.api.openstack.requestlog [None req-73c4401b-c32b-47a2-8621-101be880be87 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033019 Sep 16 12:36:31.442152 n-d-858094-4 devstack@n-api.service[112917]: [pid: 112917|app: 0|req: 11/23] 10.222.0.67 () {64 vars in 1333 bytes} [Fri Sep 16 12:36:31 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:36:34.326585 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-3d490432-a0bd-4061-9bdd-40dcee28b7e0 admin admin] Calling method '>' {{(pid=112916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:36:34.327608 n-d-858094-4 devstack@n-api.service[112916]: INFO nova.api.openstack.requestlog [None req-3d490432-a0bd-4061-9bdd-40dcee28b7e0 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Sep 16 12:36:34.328010 n-d-858094-4 devstack@n-api.service[112916]: [pid: 112916|app: 0|req: 13/24] 10.222.0.67 () {54 vars in 931 bytes} [Fri Sep 16 12:36:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:36:34.733877 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-92240984-a87e-45c7-8351-89f4433bcfb5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "rxtx_factor": 1.0, "swap": 0, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "vcpus": 1, "id": "2"}} {{(pid=112917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:36:34.753299 n-d-858094-4 devstack@n-api.service[112917]: INFO nova.api.openstack.requestlog [None req-92240984-a87e-45c7-8351-89f4433bcfb5 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.418682 Sep 16 12:36:34.753787 n-d-858094-4 devstack@n-api.service[112917]: [pid: 112917|app: 0|req: 12/25] 10.222.0.67 () {64 vars in 1283 bytes} [Fri Sep 16 12:36:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:36:34.766542 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-887c2e25-f27d-47e4-8f08-f9966bd56aca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:36:34.791181 n-d-858094-4 devstack@n-api.service[112916]: INFO nova.api.openstack.requestlog [None req-887c2e25-f27d-47e4-8f08-f9966bd56aca admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029062 Sep 16 12:36:34.800148 n-d-858094-4 devstack@n-api.service[112916]: [pid: 112916|app: 0|req: 14/26] 10.222.0.67 () {64 vars in 1333 bytes} [Fri Sep 16 12:36:34 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:36:37.437345 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-92240984-a87e-45c7-8351-89f4433bcfb5 admin admin] Calling method '>' {{(pid=112917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:36:37.438371 n-d-858094-4 devstack@n-api.service[112917]: INFO nova.api.openstack.requestlog [None req-92240984-a87e-45c7-8351-89f4433bcfb5 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Sep 16 12:36:37.438778 n-d-858094-4 devstack@n-api.service[112917]: [pid: 112917|app: 0|req: 13/27] 10.222.0.67 () {54 vars in 931 bytes} [Fri Sep 16 12:36:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:36:37.850435 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-aee9fd34-ee98-4718-abbe-9fe4127e7b1f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 40, "name": "m1.medium", "id": "3", "swap": 0}} {{(pid=112916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:36:37.874551 n-d-858094-4 devstack@n-api.service[112916]: INFO nova.api.openstack.requestlog [None req-aee9fd34-ee98-4718-abbe-9fe4127e7b1f admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.429523 Sep 16 12:36:37.875264 n-d-858094-4 devstack@n-api.service[112916]: [pid: 112916|app: 0|req: 15/28] 10.222.0.67 () {64 vars in 1283 bytes} [Fri Sep 16 12:36:37 2022] POST /compute/v2.1/flavors => generated 406 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 12:36:37.887489 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-fe9fe695-f421-4ccb-a68d-d8adfafbbc4e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:36:37.892684 n-d-858094-4 devstack@n-api.service[112917]: DEBUG dbcounter [-] [112917] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=112917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:36:37.915926 n-d-858094-4 devstack@n-api.service[112917]: INFO nova.api.openstack.requestlog [None req-fe9fe695-f421-4ccb-a68d-d8adfafbbc4e admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032064 Sep 16 12:36:37.916786 n-d-858094-4 devstack@n-api.service[112917]: [pid: 112917|app: 0|req: 14/29] 10.222.0.67 () {64 vars in 1333 bytes} [Fri Sep 16 12:36:37 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:36:40.626567 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-aee9fd34-ee98-4718-abbe-9fe4127e7b1f admin admin] Calling method '>' {{(pid=112916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:36:40.627756 n-d-858094-4 devstack@n-api.service[112916]: INFO nova.api.openstack.requestlog [None req-aee9fd34-ee98-4718-abbe-9fe4127e7b1f admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001630 Sep 16 12:36:40.628276 n-d-858094-4 devstack@n-api.service[112916]: [pid: 112916|app: 0|req: 16/30] 10.222.0.67 () {54 vars in 931 bytes} [Fri Sep 16 12:36:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:36:41.088000 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-c4de0dd8-c5a9-43aa-958a-2d04a9417a0b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "disk": 80, "vcpus": 4, "name": "m1.large", "swap": 0, "id": "4", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:36:41.107238 n-d-858094-4 devstack@n-api.service[112917]: INFO nova.api.openstack.requestlog [None req-c4de0dd8-c5a9-43aa-958a-2d04a9417a0b admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.472774 Sep 16 12:36:41.107903 n-d-858094-4 devstack@n-api.service[112917]: [pid: 112917|app: 0|req: 15/31] 10.222.0.67 () {64 vars in 1283 bytes} [Fri Sep 16 12:36:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:36:41.120429 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-120d40b1-a0ab-402f-8791-d76cdfcb8323 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:36:41.126144 n-d-858094-4 devstack@n-api.service[112916]: DEBUG dbcounter [-] [112916] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=112916) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:36:41.151297 n-d-858094-4 devstack@n-api.service[112916]: INFO nova.api.openstack.requestlog [None req-120d40b1-a0ab-402f-8791-d76cdfcb8323 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034904 Sep 16 12:36:41.152262 n-d-858094-4 devstack@n-api.service[112916]: [pid: 112916|app: 0|req: 17/32] 10.222.0.67 () {64 vars in 1333 bytes} [Fri Sep 16 12:36:41 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:36:43.816347 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-c4de0dd8-c5a9-43aa-958a-2d04a9417a0b admin admin] Calling method '>' {{(pid=112917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:36:43.817359 n-d-858094-4 devstack@n-api.service[112917]: INFO nova.api.openstack.requestlog [None req-c4de0dd8-c5a9-43aa-958a-2d04a9417a0b admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Sep 16 12:36:43.817757 n-d-858094-4 devstack@n-api.service[112917]: [pid: 112917|app: 0|req: 16/33] 10.222.0.67 () {54 vars in 931 bytes} [Fri Sep 16 12:36:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:36:44.285789 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-0387b2d4-7977-4220-acb8-9f65871952cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "vcpus": 8, "swap": 0, "rxtx_factor": 1.0, "id": "5", "os-flavor-access:is_public": true, "name": "m1.xlarge"}} {{(pid=112916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:36:44.308249 n-d-858094-4 devstack@n-api.service[112916]: INFO nova.api.openstack.requestlog [None req-0387b2d4-7977-4220-acb8-9f65871952cd admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.484217 Sep 16 12:36:44.309160 n-d-858094-4 devstack@n-api.service[112916]: [pid: 112916|app: 0|req: 18/34] 10.222.0.67 () {64 vars in 1283 bytes} [Fri Sep 16 12:36:43 2022] POST /compute/v2.1/flavors => generated 408 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:36:44.321711 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-f6e1049b-c78a-40c2-b4de-33ce5dd5532e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:36:44.358679 n-d-858094-4 devstack@n-api.service[112917]: INFO nova.api.openstack.requestlog [None req-f6e1049b-c78a-40c2-b4de-33ce5dd5532e admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040842 Sep 16 12:36:44.359647 n-d-858094-4 devstack@n-api.service[112917]: [pid: 112917|app: 0|req: 17/35] 10.222.0.67 () {64 vars in 1333 bytes} [Fri Sep 16 12:36:44 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:37:04.987934 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-0387b2d4-7977-4220-acb8-9f65871952cd admin admin] Calling method '>' {{(pid=112916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:37:04.989014 n-d-858094-4 devstack@n-api.service[112916]: INFO nova.api.openstack.requestlog [None req-0387b2d4-7977-4220-acb8-9f65871952cd admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Sep 16 12:37:04.989424 n-d-858094-4 devstack@n-api.service[112916]: [pid: 112916|app: 0|req: 19/36] 10.222.0.67 () {54 vars in 931 bytes} [Fri Sep 16 12:37:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:37:05.000806 n-d-858094-4 devstack@n-api.service[112917]: DEBUG dbcounter [-] [112917] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=112917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:37:05.391262 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-b3f4f97e-ecb9-4fbf-9a5e-b81663a07ccc admin admin] Calling method '>' {{(pid=112917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:37:05.409506 n-d-858094-4 devstack@n-api.service[112917]: INFO nova.api.openstack.requestlog [None req-b3f4f97e-ecb9-4fbf-9a5e-b81663a07ccc admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.413906 Sep 16 12:37:05.410043 n-d-858094-4 devstack@n-api.service[112917]: [pid: 112917|app: 0|req: 18/37] 10.222.0.67 () {60 vars in 1292 bytes} [Fri Sep 16 12:37:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:37:06.738303 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-0387b2d4-7977-4220-acb8-9f65871952cd admin admin] Calling method '>' {{(pid=112916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:37:06.739315 n-d-858094-4 devstack@n-api.service[112916]: INFO nova.api.openstack.requestlog [None req-0387b2d4-7977-4220-acb8-9f65871952cd admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Sep 16 12:37:06.739733 n-d-858094-4 devstack@n-api.service[112916]: [pid: 112916|app: 0|req: 20/38] 10.222.0.67 () {56 vars in 1074 bytes} [Fri Sep 16 12:37:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:37:07.312147 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-cbeda6e7-55a2-4010-9f38-6157ebac4d5e admin admin] Calling method '>' {{(pid=112917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:37:07.318297 n-d-858094-4 devstack@n-api.service[112917]: INFO nova.api.openstack.wsgi [None req-cbeda6e7-55a2-4010-9f38-6157ebac4d5e admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 16 12:37:07.321586 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-cbeda6e7-55a2-4010-9f38-6157ebac4d5e admin admin] Request method failure captured: Sep 16 12:37:07.321586 n-d-858094-4 devstack@n-api.service[112917]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 16 12:37:07.321586 n-d-858094-4 devstack@n-api.service[112917]: Accept: application/json Sep 16 12:37:07.321586 n-d-858094-4 devstack@n-api.service[112917]: Accept-Encoding: gzip, deflate Sep 16 12:37:07.321586 n-d-858094-4 devstack@n-api.service[112917]: Connection: keep-alive Sep 16 12:37:07.321586 n-d-858094-4 devstack@n-api.service[112917]: Content-Length: 0 Sep 16 12:37:07.321586 n-d-858094-4 devstack@n-api.service[112917]: Host: 10.222.0.67 Sep 16 12:37:07.321586 n-d-858094-4 devstack@n-api.service[112917]: Openstack-Api-Version: compute 2.92 Sep 16 12:37:07.321586 n-d-858094-4 devstack@n-api.service[112917]: Openstack-System-Scope: None Sep 16 12:37:07.321586 n-d-858094-4 devstack@n-api.service[112917]: User-Agent: python-novaclient Sep 16 12:37:07.321586 n-d-858094-4 devstack@n-api.service[112917]: X-Auth-Token: gAAAAABjJG3yacL5_r3X9LokB96uDWbrmTr1Fcc6Pf87d6SgyxSNlGnOwxE06jx3UDFnIvsH60BgsGZ0l4Fi4JpLgZnUVTXaXtUVtrLPbgWt5-F8m4aZJMIKMWtLJQH4rUGmmwYSsBs6WWCkuLdx6IuwW0YIraNT72FxhOnQGPvPE8dcHi3N8Io Sep 16 12:37:07.321586 n-d-858094-4 devstack@n-api.service[112917]: X-Domain-Id: None Sep 16 12:37:07.321586 n-d-858094-4 devstack@n-api.service[112917]: X-Domain-Name: None Sep 16 12:37:07.321586 n-d-858094-4 devstack@n-api.service[112917]: X-Identity-Status: Confirmed Sep 16 12:37:07.321586 n-d-858094-4 devstack@n-api.service[112917]: X-Is-Admin-Project: True Sep 16 12:37:07.321586 n-d-858094-4 devstack@n-api.service[112917]: X-Openstack-Nova-Api-Version: 2.92 Sep 16 12:37:07.321586 n-d-858094-4 devstack@n-api.service[112917]: X-Project-Domain-Id: default Sep 16 12:37:07.321586 n-d-858094-4 devstack@n-api.service[112917]: X-Project-Domain-Name: Default Sep 16 12:37:07.321586 n-d-858094-4 devstack@n-api.service[112917]: X-Project-Id: 66481a00acf6428ca239a961870b48ec Sep 16 12:37:07.321586 n-d-858094-4 devstack@n-api.service[112917]: X-Project-Name: admin Sep 16 12:37:07.321586 n-d-858094-4 devstack@n-api.service[112917]: X-Role: member,admin,reader Sep 16 12:37:07.321586 n-d-858094-4 devstack@n-api.service[112917]: X-Roles: member,admin,reader Sep 16 12:37:07.323350 n-d-858094-4 devstack@n-api.service[112917]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/66481a00acf6428ca239a961870b48ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/66481a00acf6428ca239a961870b48ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_66481a00acf6428ca239a961870b48ec", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/66481a00acf6428ca239a961870b48ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:37:07.323350 n-d-858094-4 devstack@n-api.service[112917]: X-Tenant: admin Sep 16 12:37:07.323350 n-d-858094-4 devstack@n-api.service[112917]: X-Tenant-Id: 66481a00acf6428ca239a961870b48ec Sep 16 12:37:07.323350 n-d-858094-4 devstack@n-api.service[112917]: X-Tenant-Name: admin Sep 16 12:37:07.323350 n-d-858094-4 devstack@n-api.service[112917]: X-User: admin Sep 16 12:37:07.323350 n-d-858094-4 devstack@n-api.service[112917]: X-User-Domain-Id: default Sep 16 12:37:07.323350 n-d-858094-4 devstack@n-api.service[112917]: X-User-Domain-Name: Default Sep 16 12:37:07.323350 n-d-858094-4 devstack@n-api.service[112917]: X-User-Id: e69c6d10ba9b49468808e6658fc6bdc2 Sep 16 12:37:07.323350 n-d-858094-4 devstack@n-api.service[112917]: X-User-Name: admin Sep 16 12:37:07.323350 n-d-858094-4 devstack@n-api.service[112917]: method: > Sep 16 12:37:07.323350 n-d-858094-4 devstack@n-api.service[112917]: exception: Flavor 42 could not be found. Sep 16 12:37:07.323350 n-d-858094-4 devstack@n-api.service[112917]: action_args: {'id': '42'} Sep 16 12:37:07.323350 n-d-858094-4 devstack@n-api.service[112917]: {{(pid=112917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:37:07.323350 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:37:07.324356 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 16 12:37:07.324356 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 16 12:37:07.324356 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 16 12:37:07.324356 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 16 12:37:07.324356 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 12:37:07.324356 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 12:37:07.324356 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 16 12:37:07.324356 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 16 12:37:07.324356 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 16 12:37:07.324356 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:37:07.324356 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 16 12:37:07.324356 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 16 12:37:07.324356 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 16 12:37:07.324356 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi Sep 16 12:37:07.324356 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:37:07.324356 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi Sep 16 12:37:07.324356 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:37:07.324356 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:37:07.324356 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:37:07.325587 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:37:07.325587 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:37:07.325587 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:37:07.325587 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:37:07.325587 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 16 12:37:07.325587 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:37:07.325587 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 16 12:37:07.325587 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi Sep 16 12:37:07.325587 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:37:07.325587 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi Sep 16 12:37:07.325587 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:37:07.325587 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:37:07.325587 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:37:07.325587 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:37:07.325587 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:37:07.325587 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 16 12:37:07.325587 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi Sep 16 12:37:07.325587 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-cbeda6e7-55a2-4010-9f38-6157ebac4d5e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:37:07.326720 n-d-858094-4 devstack@n-api.service[112917]: INFO nova.api.openstack.requestlog [None req-cbeda6e7-55a2-4010-9f38-6157ebac4d5e admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.407798 Sep 16 12:37:07.326720 n-d-858094-4 devstack@n-api.service[112917]: [pid: 112917|app: 0|req: 19/39] 10.222.0.67 () {60 vars in 1190 bytes} [Fri Sep 16 12:37:06 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 409 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 16 12:37:07.334388 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-c38cf2ac-7531-40b9-9b1e-f0618737c02a admin admin] Calling method '>' {{(pid=112916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:37:07.338538 n-d-858094-4 devstack@n-api.service[112916]: DEBUG dbcounter [-] [112916] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=112916) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:37:07.359896 n-d-858094-4 devstack@n-api.service[112916]: INFO nova.api.openstack.requestlog [None req-c38cf2ac-7531-40b9-9b1e-f0618737c02a admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.029726 Sep 16 12:37:07.360495 n-d-858094-4 devstack@n-api.service[112916]: [pid: 112916|app: 0|req: 21/40] 10.222.0.67 () {60 vars in 1210 bytes} [Fri Sep 16 12:37:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:37:07.375875 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-1a6940e0-e5d3-40a3-b539-e7ce5047c877 admin admin] Calling method '>' {{(pid=112917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:37:07.397806 n-d-858094-4 devstack@n-api.service[112917]: INFO nova.api.openstack.requestlog [None req-1a6940e0-e5d3-40a3-b539-e7ce5047c877 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026503 Sep 16 12:37:07.398348 n-d-858094-4 devstack@n-api.service[112917]: [pid: 112917|app: 0|req: 20/41] 10.222.0.67 () {60 vars in 1210 bytes} [Fri Sep 16 12:37:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:37:07.408323 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-a2e0d6c8-be0c-4983-9e2d-58ffd719acd7 admin admin] Calling method '>' {{(pid=112916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:37:07.415003 n-d-858094-4 devstack@n-api.service[112916]: INFO nova.api.openstack.wsgi [None req-a2e0d6c8-be0c-4983-9e2d-58ffd719acd7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 16 12:37:07.418271 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-a2e0d6c8-be0c-4983-9e2d-58ffd719acd7 admin admin] Request method failure captured: Sep 16 12:37:07.418271 n-d-858094-4 devstack@n-api.service[112916]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 16 12:37:07.418271 n-d-858094-4 devstack@n-api.service[112916]: Accept: application/json Sep 16 12:37:07.418271 n-d-858094-4 devstack@n-api.service[112916]: Accept-Encoding: gzip, deflate Sep 16 12:37:07.418271 n-d-858094-4 devstack@n-api.service[112916]: Connection: keep-alive Sep 16 12:37:07.418271 n-d-858094-4 devstack@n-api.service[112916]: Content-Length: 0 Sep 16 12:37:07.418271 n-d-858094-4 devstack@n-api.service[112916]: Host: 10.222.0.67 Sep 16 12:37:07.418271 n-d-858094-4 devstack@n-api.service[112916]: Openstack-Api-Version: compute 2.92 Sep 16 12:37:07.418271 n-d-858094-4 devstack@n-api.service[112916]: Openstack-System-Scope: None Sep 16 12:37:07.418271 n-d-858094-4 devstack@n-api.service[112916]: User-Agent: python-novaclient Sep 16 12:37:07.418271 n-d-858094-4 devstack@n-api.service[112916]: X-Auth-Token: gAAAAABjJG3yacL5_r3X9LokB96uDWbrmTr1Fcc6Pf87d6SgyxSNlGnOwxE06jx3UDFnIvsH60BgsGZ0l4Fi4JpLgZnUVTXaXtUVtrLPbgWt5-F8m4aZJMIKMWtLJQH4rUGmmwYSsBs6WWCkuLdx6IuwW0YIraNT72FxhOnQGPvPE8dcHi3N8Io Sep 16 12:37:07.418271 n-d-858094-4 devstack@n-api.service[112916]: X-Domain-Id: None Sep 16 12:37:07.418271 n-d-858094-4 devstack@n-api.service[112916]: X-Domain-Name: None Sep 16 12:37:07.418271 n-d-858094-4 devstack@n-api.service[112916]: X-Identity-Status: Confirmed Sep 16 12:37:07.418271 n-d-858094-4 devstack@n-api.service[112916]: X-Is-Admin-Project: True Sep 16 12:37:07.418271 n-d-858094-4 devstack@n-api.service[112916]: X-Openstack-Nova-Api-Version: 2.92 Sep 16 12:37:07.418271 n-d-858094-4 devstack@n-api.service[112916]: X-Project-Domain-Id: default Sep 16 12:37:07.418271 n-d-858094-4 devstack@n-api.service[112916]: X-Project-Domain-Name: Default Sep 16 12:37:07.418271 n-d-858094-4 devstack@n-api.service[112916]: X-Project-Id: 66481a00acf6428ca239a961870b48ec Sep 16 12:37:07.418271 n-d-858094-4 devstack@n-api.service[112916]: X-Project-Name: admin Sep 16 12:37:07.418271 n-d-858094-4 devstack@n-api.service[112916]: X-Role: member,admin,reader Sep 16 12:37:07.418271 n-d-858094-4 devstack@n-api.service[112916]: X-Roles: member,admin,reader Sep 16 12:37:07.419790 n-d-858094-4 devstack@n-api.service[112916]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/66481a00acf6428ca239a961870b48ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/66481a00acf6428ca239a961870b48ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_66481a00acf6428ca239a961870b48ec", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/66481a00acf6428ca239a961870b48ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:37:07.419790 n-d-858094-4 devstack@n-api.service[112916]: X-Tenant: admin Sep 16 12:37:07.419790 n-d-858094-4 devstack@n-api.service[112916]: X-Tenant-Id: 66481a00acf6428ca239a961870b48ec Sep 16 12:37:07.419790 n-d-858094-4 devstack@n-api.service[112916]: X-Tenant-Name: admin Sep 16 12:37:07.419790 n-d-858094-4 devstack@n-api.service[112916]: X-User: admin Sep 16 12:37:07.419790 n-d-858094-4 devstack@n-api.service[112916]: X-User-Domain-Id: default Sep 16 12:37:07.419790 n-d-858094-4 devstack@n-api.service[112916]: X-User-Domain-Name: Default Sep 16 12:37:07.419790 n-d-858094-4 devstack@n-api.service[112916]: X-User-Id: e69c6d10ba9b49468808e6658fc6bdc2 Sep 16 12:37:07.419790 n-d-858094-4 devstack@n-api.service[112916]: X-User-Name: admin Sep 16 12:37:07.419790 n-d-858094-4 devstack@n-api.service[112916]: method: > Sep 16 12:37:07.419790 n-d-858094-4 devstack@n-api.service[112916]: exception: Flavor 42 could not be found. Sep 16 12:37:07.419790 n-d-858094-4 devstack@n-api.service[112916]: action_args: {'id': '42'} Sep 16 12:37:07.419790 n-d-858094-4 devstack@n-api.service[112916]: {{(pid=112916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:37:07.419790 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:37:07.421707 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 16 12:37:07.421707 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 16 12:37:07.421707 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 16 12:37:07.421707 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 16 12:37:07.421707 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 12:37:07.421707 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 12:37:07.421707 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 16 12:37:07.421707 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 16 12:37:07.421707 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 16 12:37:07.421707 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:37:07.421707 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 16 12:37:07.421707 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 16 12:37:07.421707 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 16 12:37:07.421707 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi Sep 16 12:37:07.421707 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:37:07.421707 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi Sep 16 12:37:07.421707 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:37:07.421707 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:37:07.421707 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:37:07.423188 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:37:07.423188 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:37:07.423188 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:37:07.423188 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:37:07.423188 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 16 12:37:07.423188 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:37:07.423188 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 16 12:37:07.423188 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi Sep 16 12:37:07.423188 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:37:07.423188 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi Sep 16 12:37:07.423188 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:37:07.423188 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:37:07.423188 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:37:07.423188 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:37:07.423188 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:37:07.423188 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 16 12:37:07.423188 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi Sep 16 12:37:07.423188 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-a2e0d6c8-be0c-4983-9e2d-58ffd719acd7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:37:07.424475 n-d-858094-4 devstack@n-api.service[112916]: INFO nova.api.openstack.requestlog [None req-a2e0d6c8-be0c-4983-9e2d-58ffd719acd7 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015485 Sep 16 12:37:07.424475 n-d-858094-4 devstack@n-api.service[112916]: [pid: 112916|app: 0|req: 22/42] 10.222.0.67 () {60 vars in 1190 bytes} [Fri Sep 16 12:37:07 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 16 12:37:08.658825 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-1a6940e0-e5d3-40a3-b539-e7ce5047c877 admin admin] Calling method '>' {{(pid=112917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:37:08.659850 n-d-858094-4 devstack@n-api.service[112917]: INFO nova.api.openstack.requestlog [None req-1a6940e0-e5d3-40a3-b539-e7ce5047c877 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Sep 16 12:37:08.660341 n-d-858094-4 devstack@n-api.service[112917]: [pid: 112917|app: 0|req: 21/43] 10.222.0.67 () {56 vars in 1074 bytes} [Fri Sep 16 12:37:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:37:09.188410 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-eea27959-42f3-41b4-9377-a4a973faf53a admin admin] Calling method '>' {{(pid=112916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:37:09.193455 n-d-858094-4 devstack@n-api.service[112916]: INFO nova.api.openstack.wsgi [None req-eea27959-42f3-41b4-9377-a4a973faf53a admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 16 12:37:09.194969 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-eea27959-42f3-41b4-9377-a4a973faf53a admin admin] Request method failure captured: Sep 16 12:37:09.194969 n-d-858094-4 devstack@n-api.service[112916]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 16 12:37:09.194969 n-d-858094-4 devstack@n-api.service[112916]: Accept: application/json Sep 16 12:37:09.194969 n-d-858094-4 devstack@n-api.service[112916]: Accept-Encoding: gzip, deflate Sep 16 12:37:09.194969 n-d-858094-4 devstack@n-api.service[112916]: Connection: keep-alive Sep 16 12:37:09.194969 n-d-858094-4 devstack@n-api.service[112916]: Content-Length: 0 Sep 16 12:37:09.194969 n-d-858094-4 devstack@n-api.service[112916]: Host: 10.222.0.67 Sep 16 12:37:09.194969 n-d-858094-4 devstack@n-api.service[112916]: Openstack-Api-Version: compute 2.92 Sep 16 12:37:09.194969 n-d-858094-4 devstack@n-api.service[112916]: Openstack-System-Scope: None Sep 16 12:37:09.194969 n-d-858094-4 devstack@n-api.service[112916]: User-Agent: python-novaclient Sep 16 12:37:09.194969 n-d-858094-4 devstack@n-api.service[112916]: X-Auth-Token: gAAAAABjJG30FYEHLFB0iR5Wnu96lwH8VQPDFCkjHaZYqFi_LBfBGwWaWWLx-8eKWSNgBYXmic_fKVe3OhNJ-XLhqYdv2W63CLfJ9DbvwLRoWCBeHQGm-u7WJ1fk0_CIvNQxKpxvafz-a5e03Q4W6XVVMEvKRFRhZEamwRlyPwUFOSaU3tMyla8 Sep 16 12:37:09.194969 n-d-858094-4 devstack@n-api.service[112916]: X-Domain-Id: None Sep 16 12:37:09.194969 n-d-858094-4 devstack@n-api.service[112916]: X-Domain-Name: None Sep 16 12:37:09.194969 n-d-858094-4 devstack@n-api.service[112916]: X-Identity-Status: Confirmed Sep 16 12:37:09.194969 n-d-858094-4 devstack@n-api.service[112916]: X-Is-Admin-Project: True Sep 16 12:37:09.194969 n-d-858094-4 devstack@n-api.service[112916]: X-Openstack-Nova-Api-Version: 2.92 Sep 16 12:37:09.194969 n-d-858094-4 devstack@n-api.service[112916]: X-Project-Domain-Id: default Sep 16 12:37:09.194969 n-d-858094-4 devstack@n-api.service[112916]: X-Project-Domain-Name: Default Sep 16 12:37:09.194969 n-d-858094-4 devstack@n-api.service[112916]: X-Project-Id: 66481a00acf6428ca239a961870b48ec Sep 16 12:37:09.194969 n-d-858094-4 devstack@n-api.service[112916]: X-Project-Name: admin Sep 16 12:37:09.194969 n-d-858094-4 devstack@n-api.service[112916]: X-Role: member,admin,reader Sep 16 12:37:09.194969 n-d-858094-4 devstack@n-api.service[112916]: X-Roles: member,admin,reader Sep 16 12:37:09.196491 n-d-858094-4 devstack@n-api.service[112916]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/66481a00acf6428ca239a961870b48ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/66481a00acf6428ca239a961870b48ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_66481a00acf6428ca239a961870b48ec", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/66481a00acf6428ca239a961870b48ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:37:09.196491 n-d-858094-4 devstack@n-api.service[112916]: X-Tenant: admin Sep 16 12:37:09.196491 n-d-858094-4 devstack@n-api.service[112916]: X-Tenant-Id: 66481a00acf6428ca239a961870b48ec Sep 16 12:37:09.196491 n-d-858094-4 devstack@n-api.service[112916]: X-Tenant-Name: admin Sep 16 12:37:09.196491 n-d-858094-4 devstack@n-api.service[112916]: X-User: admin Sep 16 12:37:09.196491 n-d-858094-4 devstack@n-api.service[112916]: X-User-Domain-Id: default Sep 16 12:37:09.196491 n-d-858094-4 devstack@n-api.service[112916]: X-User-Domain-Name: Default Sep 16 12:37:09.196491 n-d-858094-4 devstack@n-api.service[112916]: X-User-Id: e69c6d10ba9b49468808e6658fc6bdc2 Sep 16 12:37:09.196491 n-d-858094-4 devstack@n-api.service[112916]: X-User-Name: admin Sep 16 12:37:09.196491 n-d-858094-4 devstack@n-api.service[112916]: method: > Sep 16 12:37:09.196491 n-d-858094-4 devstack@n-api.service[112916]: exception: Flavor 84 could not be found. Sep 16 12:37:09.196491 n-d-858094-4 devstack@n-api.service[112916]: action_args: {'id': '84'} Sep 16 12:37:09.196491 n-d-858094-4 devstack@n-api.service[112916]: {{(pid=112916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:37:09.196491 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:37:09.197463 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 16 12:37:09.197463 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 16 12:37:09.197463 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 16 12:37:09.197463 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 16 12:37:09.197463 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 12:37:09.197463 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 12:37:09.197463 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 16 12:37:09.197463 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 16 12:37:09.197463 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 16 12:37:09.197463 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:37:09.197463 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 16 12:37:09.197463 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 16 12:37:09.197463 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 16 12:37:09.197463 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi Sep 16 12:37:09.197463 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:37:09.197463 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi Sep 16 12:37:09.197463 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:37:09.197463 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:37:09.197463 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:37:09.198770 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:37:09.198770 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:37:09.198770 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:37:09.198770 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:37:09.198770 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 16 12:37:09.198770 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:37:09.198770 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 16 12:37:09.198770 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi Sep 16 12:37:09.198770 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:37:09.198770 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi Sep 16 12:37:09.198770 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:37:09.198770 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:37:09.198770 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:37:09.198770 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:37:09.198770 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:37:09.198770 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 16 12:37:09.198770 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi Sep 16 12:37:09.198770 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-eea27959-42f3-41b4-9377-a4a973faf53a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:37:09.200036 n-d-858094-4 devstack@n-api.service[112916]: INFO nova.api.openstack.requestlog [None req-eea27959-42f3-41b4-9377-a4a973faf53a admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.397139 Sep 16 12:37:09.200036 n-d-858094-4 devstack@n-api.service[112916]: [pid: 112916|app: 0|req: 23/44] 10.222.0.67 () {60 vars in 1190 bytes} [Fri Sep 16 12:37:08 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 16 12:37:09.207125 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-ddbe6171-783b-4a6f-8102-40f148a3ba1c admin admin] Calling method '>' {{(pid=112917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:37:09.223152 n-d-858094-4 devstack@n-api.service[112917]: INFO nova.api.openstack.requestlog [None req-ddbe6171-783b-4a6f-8102-40f148a3ba1c admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019900 Sep 16 12:37:09.223689 n-d-858094-4 devstack@n-api.service[112917]: [pid: 112917|app: 0|req: 22/45] 10.222.0.67 () {60 vars in 1210 bytes} [Fri Sep 16 12:37:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:37:09.233629 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-d120b719-8407-4ef3-ae58-75f138b1416c admin admin] Calling method '>' {{(pid=112916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:37:09.249521 n-d-858094-4 devstack@n-api.service[112916]: INFO nova.api.openstack.requestlog [None req-d120b719-8407-4ef3-ae58-75f138b1416c admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019824 Sep 16 12:37:09.250066 n-d-858094-4 devstack@n-api.service[112916]: [pid: 112916|app: 0|req: 24/46] 10.222.0.67 () {60 vars in 1210 bytes} [Fri Sep 16 12:37:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:37:09.259234 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-ae4e1e8d-0629-4407-8b68-8f1461246985 admin admin] Calling method '>' {{(pid=112917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:37:09.264839 n-d-858094-4 devstack@n-api.service[112917]: INFO nova.api.openstack.wsgi [None req-ae4e1e8d-0629-4407-8b68-8f1461246985 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 16 12:37:09.266395 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-ae4e1e8d-0629-4407-8b68-8f1461246985 admin admin] Request method failure captured: Sep 16 12:37:09.266395 n-d-858094-4 devstack@n-api.service[112917]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 16 12:37:09.266395 n-d-858094-4 devstack@n-api.service[112917]: Accept: application/json Sep 16 12:37:09.266395 n-d-858094-4 devstack@n-api.service[112917]: Accept-Encoding: gzip, deflate Sep 16 12:37:09.266395 n-d-858094-4 devstack@n-api.service[112917]: Connection: keep-alive Sep 16 12:37:09.266395 n-d-858094-4 devstack@n-api.service[112917]: Content-Length: 0 Sep 16 12:37:09.266395 n-d-858094-4 devstack@n-api.service[112917]: Host: 10.222.0.67 Sep 16 12:37:09.266395 n-d-858094-4 devstack@n-api.service[112917]: Openstack-Api-Version: compute 2.92 Sep 16 12:37:09.266395 n-d-858094-4 devstack@n-api.service[112917]: Openstack-System-Scope: None Sep 16 12:37:09.266395 n-d-858094-4 devstack@n-api.service[112917]: User-Agent: python-novaclient Sep 16 12:37:09.266395 n-d-858094-4 devstack@n-api.service[112917]: X-Auth-Token: gAAAAABjJG30FYEHLFB0iR5Wnu96lwH8VQPDFCkjHaZYqFi_LBfBGwWaWWLx-8eKWSNgBYXmic_fKVe3OhNJ-XLhqYdv2W63CLfJ9DbvwLRoWCBeHQGm-u7WJ1fk0_CIvNQxKpxvafz-a5e03Q4W6XVVMEvKRFRhZEamwRlyPwUFOSaU3tMyla8 Sep 16 12:37:09.266395 n-d-858094-4 devstack@n-api.service[112917]: X-Domain-Id: None Sep 16 12:37:09.266395 n-d-858094-4 devstack@n-api.service[112917]: X-Domain-Name: None Sep 16 12:37:09.266395 n-d-858094-4 devstack@n-api.service[112917]: X-Identity-Status: Confirmed Sep 16 12:37:09.266395 n-d-858094-4 devstack@n-api.service[112917]: X-Is-Admin-Project: True Sep 16 12:37:09.266395 n-d-858094-4 devstack@n-api.service[112917]: X-Openstack-Nova-Api-Version: 2.92 Sep 16 12:37:09.266395 n-d-858094-4 devstack@n-api.service[112917]: X-Project-Domain-Id: default Sep 16 12:37:09.266395 n-d-858094-4 devstack@n-api.service[112917]: X-Project-Domain-Name: Default Sep 16 12:37:09.266395 n-d-858094-4 devstack@n-api.service[112917]: X-Project-Id: 66481a00acf6428ca239a961870b48ec Sep 16 12:37:09.266395 n-d-858094-4 devstack@n-api.service[112917]: X-Project-Name: admin Sep 16 12:37:09.266395 n-d-858094-4 devstack@n-api.service[112917]: X-Role: member,admin,reader Sep 16 12:37:09.266395 n-d-858094-4 devstack@n-api.service[112917]: X-Roles: member,admin,reader Sep 16 12:37:09.267878 n-d-858094-4 devstack@n-api.service[112917]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/66481a00acf6428ca239a961870b48ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/66481a00acf6428ca239a961870b48ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_66481a00acf6428ca239a961870b48ec", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/66481a00acf6428ca239a961870b48ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:37:09.267878 n-d-858094-4 devstack@n-api.service[112917]: X-Tenant: admin Sep 16 12:37:09.267878 n-d-858094-4 devstack@n-api.service[112917]: X-Tenant-Id: 66481a00acf6428ca239a961870b48ec Sep 16 12:37:09.267878 n-d-858094-4 devstack@n-api.service[112917]: X-Tenant-Name: admin Sep 16 12:37:09.267878 n-d-858094-4 devstack@n-api.service[112917]: X-User: admin Sep 16 12:37:09.267878 n-d-858094-4 devstack@n-api.service[112917]: X-User-Domain-Id: default Sep 16 12:37:09.267878 n-d-858094-4 devstack@n-api.service[112917]: X-User-Domain-Name: Default Sep 16 12:37:09.267878 n-d-858094-4 devstack@n-api.service[112917]: X-User-Id: e69c6d10ba9b49468808e6658fc6bdc2 Sep 16 12:37:09.267878 n-d-858094-4 devstack@n-api.service[112917]: X-User-Name: admin Sep 16 12:37:09.267878 n-d-858094-4 devstack@n-api.service[112917]: method: > Sep 16 12:37:09.267878 n-d-858094-4 devstack@n-api.service[112917]: exception: Flavor 84 could not be found. Sep 16 12:37:09.267878 n-d-858094-4 devstack@n-api.service[112917]: action_args: {'id': '84'} Sep 16 12:37:09.267878 n-d-858094-4 devstack@n-api.service[112917]: {{(pid=112917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:37:09.267878 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:37:09.268810 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 16 12:37:09.268810 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 16 12:37:09.268810 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 16 12:37:09.268810 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 16 12:37:09.268810 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 12:37:09.268810 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 12:37:09.268810 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 16 12:37:09.268810 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 16 12:37:09.268810 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 16 12:37:09.268810 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:37:09.268810 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 16 12:37:09.268810 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 16 12:37:09.268810 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 16 12:37:09.268810 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi Sep 16 12:37:09.268810 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:37:09.268810 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi Sep 16 12:37:09.268810 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:37:09.268810 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:37:09.268810 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:37:09.270108 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:37:09.270108 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:37:09.270108 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:37:09.270108 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:37:09.270108 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 16 12:37:09.270108 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:37:09.270108 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 16 12:37:09.270108 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi Sep 16 12:37:09.270108 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:37:09.270108 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi Sep 16 12:37:09.270108 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:37:09.270108 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:37:09.270108 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:37:09.270108 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:37:09.270108 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:37:09.270108 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 16 12:37:09.270108 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi Sep 16 12:37:09.270108 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-ae4e1e8d-0629-4407-8b68-8f1461246985 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:37:09.271313 n-d-858094-4 devstack@n-api.service[112917]: INFO nova.api.openstack.requestlog [None req-ae4e1e8d-0629-4407-8b68-8f1461246985 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012079 Sep 16 12:37:09.271313 n-d-858094-4 devstack@n-api.service[112917]: [pid: 112917|app: 0|req: 23/47] 10.222.0.67 () {60 vars in 1190 bytes} [Fri Sep 16 12:37:09 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 16 12:37:10.494523 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-d120b719-8407-4ef3-ae58-75f138b1416c admin admin] Calling method '>' {{(pid=112916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:37:10.495527 n-d-858094-4 devstack@n-api.service[112916]: INFO nova.api.openstack.requestlog [None req-d120b719-8407-4ef3-ae58-75f138b1416c admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Sep 16 12:37:10.495922 n-d-858094-4 devstack@n-api.service[112916]: [pid: 112916|app: 0|req: 25/48] 10.222.0.67 () {56 vars in 1074 bytes} [Fri Sep 16 12:37:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:37:11.035405 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-f5febc03-c58c-4033-9de1-3cf39ae64d1b admin admin] Calling method '>' {{(pid=112917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:37:11.041619 n-d-858094-4 devstack@n-api.service[112917]: INFO nova.api.openstack.wsgi [None req-f5febc03-c58c-4033-9de1-3cf39ae64d1b admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 16 12:37:11.043194 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-f5febc03-c58c-4033-9de1-3cf39ae64d1b admin admin] Request method failure captured: Sep 16 12:37:11.043194 n-d-858094-4 devstack@n-api.service[112917]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 16 12:37:11.043194 n-d-858094-4 devstack@n-api.service[112917]: Accept: application/json Sep 16 12:37:11.043194 n-d-858094-4 devstack@n-api.service[112917]: Accept-Encoding: gzip, deflate Sep 16 12:37:11.043194 n-d-858094-4 devstack@n-api.service[112917]: Connection: keep-alive Sep 16 12:37:11.043194 n-d-858094-4 devstack@n-api.service[112917]: Content-Length: 0 Sep 16 12:37:11.043194 n-d-858094-4 devstack@n-api.service[112917]: Host: 10.222.0.67 Sep 16 12:37:11.043194 n-d-858094-4 devstack@n-api.service[112917]: Openstack-Api-Version: compute 2.92 Sep 16 12:37:11.043194 n-d-858094-4 devstack@n-api.service[112917]: Openstack-System-Scope: None Sep 16 12:37:11.043194 n-d-858094-4 devstack@n-api.service[112917]: User-Agent: python-novaclient Sep 16 12:37:11.043194 n-d-858094-4 devstack@n-api.service[112917]: X-Auth-Token: gAAAAABjJG32toOAwqYOqoaOkJn4U0MQ2yCsRwX-SEynrJGYlTo3eqRZZPVaSqV0ueHmNxU0PUJq8MyQAEosXEpiE2OWLGzXtp_TnFVZhXxX51ZifVqU-mWU7drsTyBraBs8Tv-l29NKKX7yjq0FFwhT0RK9npQ0fi3ReDOV-L3-So6AWnU1VJ0 Sep 16 12:37:11.043194 n-d-858094-4 devstack@n-api.service[112917]: X-Domain-Id: None Sep 16 12:37:11.043194 n-d-858094-4 devstack@n-api.service[112917]: X-Domain-Name: None Sep 16 12:37:11.043194 n-d-858094-4 devstack@n-api.service[112917]: X-Identity-Status: Confirmed Sep 16 12:37:11.043194 n-d-858094-4 devstack@n-api.service[112917]: X-Is-Admin-Project: True Sep 16 12:37:11.043194 n-d-858094-4 devstack@n-api.service[112917]: X-Openstack-Nova-Api-Version: 2.92 Sep 16 12:37:11.043194 n-d-858094-4 devstack@n-api.service[112917]: X-Project-Domain-Id: default Sep 16 12:37:11.043194 n-d-858094-4 devstack@n-api.service[112917]: X-Project-Domain-Name: Default Sep 16 12:37:11.043194 n-d-858094-4 devstack@n-api.service[112917]: X-Project-Id: 66481a00acf6428ca239a961870b48ec Sep 16 12:37:11.043194 n-d-858094-4 devstack@n-api.service[112917]: X-Project-Name: admin Sep 16 12:37:11.043194 n-d-858094-4 devstack@n-api.service[112917]: X-Role: member,admin,reader Sep 16 12:37:11.043194 n-d-858094-4 devstack@n-api.service[112917]: X-Roles: member,admin,reader Sep 16 12:37:11.044824 n-d-858094-4 devstack@n-api.service[112917]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/66481a00acf6428ca239a961870b48ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/66481a00acf6428ca239a961870b48ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_66481a00acf6428ca239a961870b48ec", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/66481a00acf6428ca239a961870b48ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:37:11.044824 n-d-858094-4 devstack@n-api.service[112917]: X-Tenant: admin Sep 16 12:37:11.044824 n-d-858094-4 devstack@n-api.service[112917]: X-Tenant-Id: 66481a00acf6428ca239a961870b48ec Sep 16 12:37:11.044824 n-d-858094-4 devstack@n-api.service[112917]: X-Tenant-Name: admin Sep 16 12:37:11.044824 n-d-858094-4 devstack@n-api.service[112917]: X-User: admin Sep 16 12:37:11.044824 n-d-858094-4 devstack@n-api.service[112917]: X-User-Domain-Id: default Sep 16 12:37:11.044824 n-d-858094-4 devstack@n-api.service[112917]: X-User-Domain-Name: Default Sep 16 12:37:11.044824 n-d-858094-4 devstack@n-api.service[112917]: X-User-Id: e69c6d10ba9b49468808e6658fc6bdc2 Sep 16 12:37:11.044824 n-d-858094-4 devstack@n-api.service[112917]: X-User-Name: admin Sep 16 12:37:11.044824 n-d-858094-4 devstack@n-api.service[112917]: method: > Sep 16 12:37:11.044824 n-d-858094-4 devstack@n-api.service[112917]: exception: Flavor 451 could not be found. Sep 16 12:37:11.044824 n-d-858094-4 devstack@n-api.service[112917]: action_args: {'id': '451'} Sep 16 12:37:11.044824 n-d-858094-4 devstack@n-api.service[112917]: {{(pid=112917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:37:11.044824 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:37:11.046350 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 16 12:37:11.046350 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 16 12:37:11.046350 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 16 12:37:11.046350 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 16 12:37:11.046350 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 12:37:11.046350 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 12:37:11.046350 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 16 12:37:11.046350 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 16 12:37:11.046350 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 16 12:37:11.046350 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:37:11.046350 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 16 12:37:11.046350 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 16 12:37:11.046350 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 16 12:37:11.046350 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi Sep 16 12:37:11.046350 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:37:11.046350 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi Sep 16 12:37:11.046350 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:37:11.046350 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:37:11.046350 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:37:11.047736 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:37:11.047736 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:37:11.047736 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:37:11.047736 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:37:11.047736 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 16 12:37:11.047736 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:37:11.047736 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 16 12:37:11.047736 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi Sep 16 12:37:11.047736 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:37:11.047736 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi Sep 16 12:37:11.047736 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:37:11.047736 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:37:11.047736 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:37:11.047736 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:37:11.047736 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:37:11.047736 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 16 12:37:11.047736 n-d-858094-4 devstack@n-api.service[112917]: ERROR nova.api.openstack.wsgi Sep 16 12:37:11.047736 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-f5febc03-c58c-4033-9de1-3cf39ae64d1b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:37:11.049091 n-d-858094-4 devstack@n-api.service[112917]: INFO nova.api.openstack.requestlog [None req-f5febc03-c58c-4033-9de1-3cf39ae64d1b admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.399794 Sep 16 12:37:11.049091 n-d-858094-4 devstack@n-api.service[112917]: [pid: 112917|app: 0|req: 24/49] 10.222.0.67 () {60 vars in 1193 bytes} [Fri Sep 16 12:37:10 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 16 12:37:11.057258 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-ef74a057-daef-42f8-ad6d-6394bb9052e1 admin admin] Calling method '>' {{(pid=112916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:37:11.074150 n-d-858094-4 devstack@n-api.service[112916]: INFO nova.api.openstack.requestlog [None req-ef74a057-daef-42f8-ad6d-6394bb9052e1 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021266 Sep 16 12:37:11.074719 n-d-858094-4 devstack@n-api.service[112916]: [pid: 112916|app: 0|req: 26/50] 10.222.0.67 () {60 vars in 1210 bytes} [Fri Sep 16 12:37:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:37:11.087139 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-defff277-3b2f-49cf-9784-152b1e7c17fe admin admin] Calling method '>' {{(pid=112917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:37:11.102954 n-d-858094-4 devstack@n-api.service[112917]: INFO nova.api.openstack.requestlog [None req-defff277-3b2f-49cf-9784-152b1e7c17fe admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021029 Sep 16 12:37:11.103513 n-d-858094-4 devstack@n-api.service[112917]: [pid: 112917|app: 0|req: 25/51] 10.222.0.67 () {60 vars in 1210 bytes} [Fri Sep 16 12:37:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:37:11.113740 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-7b12dd69-2bb1-40b5-afab-f1e9b3785aca admin admin] Calling method '>' {{(pid=112916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:37:11.118750 n-d-858094-4 devstack@n-api.service[112916]: INFO nova.api.openstack.wsgi [None req-7b12dd69-2bb1-40b5-afab-f1e9b3785aca admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 16 12:37:11.120313 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-7b12dd69-2bb1-40b5-afab-f1e9b3785aca admin admin] Request method failure captured: Sep 16 12:37:11.120313 n-d-858094-4 devstack@n-api.service[112916]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 16 12:37:11.120313 n-d-858094-4 devstack@n-api.service[112916]: Accept: application/json Sep 16 12:37:11.120313 n-d-858094-4 devstack@n-api.service[112916]: Accept-Encoding: gzip, deflate Sep 16 12:37:11.120313 n-d-858094-4 devstack@n-api.service[112916]: Connection: keep-alive Sep 16 12:37:11.120313 n-d-858094-4 devstack@n-api.service[112916]: Content-Length: 0 Sep 16 12:37:11.120313 n-d-858094-4 devstack@n-api.service[112916]: Host: 10.222.0.67 Sep 16 12:37:11.120313 n-d-858094-4 devstack@n-api.service[112916]: Openstack-Api-Version: compute 2.92 Sep 16 12:37:11.120313 n-d-858094-4 devstack@n-api.service[112916]: Openstack-System-Scope: None Sep 16 12:37:11.120313 n-d-858094-4 devstack@n-api.service[112916]: User-Agent: python-novaclient Sep 16 12:37:11.120313 n-d-858094-4 devstack@n-api.service[112916]: X-Auth-Token: gAAAAABjJG32toOAwqYOqoaOkJn4U0MQ2yCsRwX-SEynrJGYlTo3eqRZZPVaSqV0ueHmNxU0PUJq8MyQAEosXEpiE2OWLGzXtp_TnFVZhXxX51ZifVqU-mWU7drsTyBraBs8Tv-l29NKKX7yjq0FFwhT0RK9npQ0fi3ReDOV-L3-So6AWnU1VJ0 Sep 16 12:37:11.120313 n-d-858094-4 devstack@n-api.service[112916]: X-Domain-Id: None Sep 16 12:37:11.120313 n-d-858094-4 devstack@n-api.service[112916]: X-Domain-Name: None Sep 16 12:37:11.120313 n-d-858094-4 devstack@n-api.service[112916]: X-Identity-Status: Confirmed Sep 16 12:37:11.120313 n-d-858094-4 devstack@n-api.service[112916]: X-Is-Admin-Project: True Sep 16 12:37:11.120313 n-d-858094-4 devstack@n-api.service[112916]: X-Openstack-Nova-Api-Version: 2.92 Sep 16 12:37:11.120313 n-d-858094-4 devstack@n-api.service[112916]: X-Project-Domain-Id: default Sep 16 12:37:11.120313 n-d-858094-4 devstack@n-api.service[112916]: X-Project-Domain-Name: Default Sep 16 12:37:11.120313 n-d-858094-4 devstack@n-api.service[112916]: X-Project-Id: 66481a00acf6428ca239a961870b48ec Sep 16 12:37:11.120313 n-d-858094-4 devstack@n-api.service[112916]: X-Project-Name: admin Sep 16 12:37:11.120313 n-d-858094-4 devstack@n-api.service[112916]: X-Role: member,admin,reader Sep 16 12:37:11.120313 n-d-858094-4 devstack@n-api.service[112916]: X-Roles: member,admin,reader Sep 16 12:37:11.121844 n-d-858094-4 devstack@n-api.service[112916]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/66481a00acf6428ca239a961870b48ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/66481a00acf6428ca239a961870b48ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_66481a00acf6428ca239a961870b48ec", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/66481a00acf6428ca239a961870b48ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:37:11.121844 n-d-858094-4 devstack@n-api.service[112916]: X-Tenant: admin Sep 16 12:37:11.121844 n-d-858094-4 devstack@n-api.service[112916]: X-Tenant-Id: 66481a00acf6428ca239a961870b48ec Sep 16 12:37:11.121844 n-d-858094-4 devstack@n-api.service[112916]: X-Tenant-Name: admin Sep 16 12:37:11.121844 n-d-858094-4 devstack@n-api.service[112916]: X-User: admin Sep 16 12:37:11.121844 n-d-858094-4 devstack@n-api.service[112916]: X-User-Domain-Id: default Sep 16 12:37:11.121844 n-d-858094-4 devstack@n-api.service[112916]: X-User-Domain-Name: Default Sep 16 12:37:11.121844 n-d-858094-4 devstack@n-api.service[112916]: X-User-Id: e69c6d10ba9b49468808e6658fc6bdc2 Sep 16 12:37:11.121844 n-d-858094-4 devstack@n-api.service[112916]: X-User-Name: admin Sep 16 12:37:11.121844 n-d-858094-4 devstack@n-api.service[112916]: method: > Sep 16 12:37:11.121844 n-d-858094-4 devstack@n-api.service[112916]: exception: Flavor 451 could not be found. Sep 16 12:37:11.121844 n-d-858094-4 devstack@n-api.service[112916]: action_args: {'id': '451'} Sep 16 12:37:11.121844 n-d-858094-4 devstack@n-api.service[112916]: {{(pid=112916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:37:11.121844 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:37:11.123158 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 16 12:37:11.123158 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 16 12:37:11.123158 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 16 12:37:11.123158 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 16 12:37:11.123158 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 12:37:11.123158 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 12:37:11.123158 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 16 12:37:11.123158 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 16 12:37:11.123158 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 16 12:37:11.123158 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:37:11.123158 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 16 12:37:11.123158 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 16 12:37:11.123158 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 16 12:37:11.123158 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi Sep 16 12:37:11.123158 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:37:11.123158 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi Sep 16 12:37:11.123158 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:37:11.123158 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:37:11.123158 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:37:11.124316 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:37:11.124316 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:37:11.124316 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:37:11.124316 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:37:11.124316 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 16 12:37:11.124316 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:37:11.124316 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 16 12:37:11.124316 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi Sep 16 12:37:11.124316 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:37:11.124316 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi Sep 16 12:37:11.124316 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:37:11.124316 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:37:11.124316 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:37:11.124316 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:37:11.124316 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:37:11.124316 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 16 12:37:11.124316 n-d-858094-4 devstack@n-api.service[112916]: ERROR nova.api.openstack.wsgi Sep 16 12:37:11.124316 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-7b12dd69-2bb1-40b5-afab-f1e9b3785aca admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:37:11.125352 n-d-858094-4 devstack@n-api.service[112916]: INFO nova.api.openstack.requestlog [None req-7b12dd69-2bb1-40b5-afab-f1e9b3785aca admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011586 Sep 16 12:37:11.125352 n-d-858094-4 devstack@n-api.service[112916]: [pid: 112916|app: 0|req: 27/52] 10.222.0.67 () {60 vars in 1193 bytes} [Fri Sep 16 12:37:11 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 16 12:37:12.553975 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-defff277-3b2f-49cf-9784-152b1e7c17fe admin admin] Calling method '>' {{(pid=112917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:37:12.555017 n-d-858094-4 devstack@n-api.service[112917]: INFO nova.api.openstack.requestlog [None req-defff277-3b2f-49cf-9784-152b1e7c17fe admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Sep 16 12:37:12.555409 n-d-858094-4 devstack@n-api.service[112917]: [pid: 112917|app: 0|req: 26/53] 10.222.0.67 () {56 vars in 1074 bytes} [Fri Sep 16 12:37:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:37:13.081576 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-1d21c37d-f8fa-4b96-86d2-77555541b1ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:37:13.101264 n-d-858094-4 devstack@n-api.service[112916]: INFO nova.api.openstack.requestlog [None req-1d21c37d-f8fa-4b96-86d2-77555541b1ec admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.408581 Sep 16 12:37:13.101803 n-d-858094-4 devstack@n-api.service[112916]: [pid: 112916|app: 0|req: 28/54] 10.222.0.67 () {64 vars in 1235 bytes} [Fri Sep 16 12:37:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 12:37:14.328232 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-defff277-3b2f-49cf-9784-152b1e7c17fe admin admin] Calling method '>' {{(pid=112917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:37:14.329236 n-d-858094-4 devstack@n-api.service[112917]: INFO nova.api.openstack.requestlog [None req-defff277-3b2f-49cf-9784-152b1e7c17fe admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Sep 16 12:37:14.329889 n-d-858094-4 devstack@n-api.service[112917]: [pid: 112917|app: 0|req: 27/55] 10.222.0.67 () {56 vars in 1074 bytes} [Fri Sep 16 12:37:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:37:14.866406 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-26eb38c0-acfd-40af-8990-24baba02ed6c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:37:14.885458 n-d-858094-4 devstack@n-api.service[112916]: INFO nova.api.openstack.requestlog [None req-26eb38c0-acfd-40af-8990-24baba02ed6c admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.413179 Sep 16 12:37:14.886005 n-d-858094-4 devstack@n-api.service[112916]: [pid: 112916|app: 0|req: 29/56] 10.222.0.67 () {64 vars in 1235 bytes} [Fri Sep 16 12:37:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:37:16.123455 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-defff277-3b2f-49cf-9784-152b1e7c17fe admin admin] Calling method '>' {{(pid=112917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:37:16.124573 n-d-858094-4 devstack@n-api.service[112917]: INFO nova.api.openstack.requestlog [None req-defff277-3b2f-49cf-9784-152b1e7c17fe admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002186 Sep 16 12:37:16.124986 n-d-858094-4 devstack@n-api.service[112917]: [pid: 112917|app: 0|req: 28/57] 10.222.0.67 () {56 vars in 1074 bytes} [Fri Sep 16 12:37:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:37:16.687025 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-897d5ee5-c6d5-482b-959b-a478f1e2938d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:37:16.707137 n-d-858094-4 devstack@n-api.service[112916]: INFO nova.api.openstack.requestlog [None req-897d5ee5-c6d5-482b-959b-a478f1e2938d admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.440913 Sep 16 12:37:16.707682 n-d-858094-4 devstack@n-api.service[112916]: [pid: 112916|app: 0|req: 30/58] 10.222.0.67 () {64 vars in 1235 bytes} [Fri Sep 16 12:37:16 2022] POST /compute/v2.1/flavors => generated 407 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:37:17.927587 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-defff277-3b2f-49cf-9784-152b1e7c17fe admin admin] Calling method '>' {{(pid=112917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:37:17.928623 n-d-858094-4 devstack@n-api.service[112917]: INFO nova.api.openstack.requestlog [None req-defff277-3b2f-49cf-9784-152b1e7c17fe admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Sep 16 12:37:17.929021 n-d-858094-4 devstack@n-api.service[112917]: [pid: 112917|app: 0|req: 29/59] 10.222.0.67 () {56 vars in 1074 bytes} [Fri Sep 16 12:37:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:37:18.458262 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-d59e0b62-6df1-46ef-bd38-f1d784be97d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:37:18.476841 n-d-858094-4 devstack@n-api.service[112916]: INFO nova.api.openstack.requestlog [None req-d59e0b62-6df1-46ef-bd38-f1d784be97d3 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.409785 Sep 16 12:37:18.477413 n-d-858094-4 devstack@n-api.service[112916]: [pid: 112916|app: 0|req: 31/60] 10.222.0.67 () {64 vars in 1235 bytes} [Fri Sep 16 12:37:18 2022] POST /compute/v2.1/flavors => generated 409 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 12:37:19.710884 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-defff277-3b2f-49cf-9784-152b1e7c17fe admin admin] Calling method '>' {{(pid=112917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:37:19.711893 n-d-858094-4 devstack@n-api.service[112917]: INFO nova.api.openstack.requestlog [None req-defff277-3b2f-49cf-9784-152b1e7c17fe admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Sep 16 12:37:19.712328 n-d-858094-4 devstack@n-api.service[112917]: [pid: 112917|app: 0|req: 30/61] 10.222.0.67 () {56 vars in 1074 bytes} [Fri Sep 16 12:37:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:37:20.246644 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-ebec95fb-b9b6-4bda-98ef-d3786f96c118 admin admin] Calling method '>' {{(pid=112916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:37:20.267986 n-d-858094-4 devstack@n-api.service[112916]: INFO nova.api.openstack.requestlog [None req-ebec95fb-b9b6-4bda-98ef-d3786f96c118 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.418266 Sep 16 12:37:20.268561 n-d-858094-4 devstack@n-api.service[112916]: [pid: 112916|app: 0|req: 32/62] 10.222.0.67 () {60 vars in 1202 bytes} [Fri Sep 16 12:37:19 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:38:19.337853 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-defff277-3b2f-49cf-9784-152b1e7c17fe admin admin] Calling method '>' {{(pid=112917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:38:19.338883 n-d-858094-4 devstack@n-api.service[112917]: INFO nova.api.openstack.requestlog [None req-defff277-3b2f-49cf-9784-152b1e7c17fe admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002212 Sep 16 12:38:19.339291 n-d-858094-4 devstack@n-api.service[112917]: [pid: 112917|app: 0|req: 31/63] 10.222.0.67 () {54 vars in 931 bytes} [Fri Sep 16 12:38:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:38:19.349747 n-d-858094-4 devstack@n-api.service[112916]: DEBUG dbcounter [-] [112916] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=112916) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:38:19.734545 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-274e1a08-232f-43dc-8f9b-4e4c1c71bd76 admin admin] Calling method '>' {{(pid=112916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:38:19.754984 n-d-858094-4 devstack@n-api.service[112916]: INFO nova.api.openstack.requestlog [None req-274e1a08-232f-43dc-8f9b-4e4c1c71bd76 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.409682 Sep 16 12:38:19.755449 n-d-858094-4 devstack@n-api.service[112916]: [pid: 112916|app: 0|req: 33/64] 10.222.0.67 () {60 vars in 1292 bytes} [Fri Sep 16 12:38:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:38:19.777459 n-d-858094-4 devstack@n-api.service[112917]: DEBUG dbcounter [-] [112917] Writing DB stats nova_api:SELECT=14 {{(pid=112917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:38:19.781209 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-218cc699-dcd2-45fd-8c1d-268742e536af admin admin] Calling method '>' {{(pid=112917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:38:19.788505 n-d-858094-4 devstack@n-api.service[112917]: INFO nova.api.openstack.requestlog [None req-218cc699-dcd2-45fd-8c1d-268742e536af admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012587 Sep 16 12:38:19.789032 n-d-858094-4 devstack@n-api.service[112917]: [pid: 112917|app: 0|req: 32/65] 10.222.0.67 () {60 vars in 1283 bytes} [Fri Sep 16 12:38:19 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:38:19.802145 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-8a240c54-70dc-4c60-bbc4-a6d09723fbee admin admin] Calling method '>' {{(pid=112916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:38:19.810158 n-d-858094-4 devstack@n-api.service[112916]: INFO nova.api.openstack.requestlog [None req-8a240c54-70dc-4c60-bbc4-a6d09723fbee admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011884 Sep 16 12:38:19.810681 n-d-858094-4 devstack@n-api.service[112916]: [pid: 112916|app: 0|req: 34/66] 10.222.0.67 () {60 vars in 1286 bytes} [Fri Sep 16 12:38:19 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:38:19.822711 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-e0e8f82f-f461-4af0-9cd2-8dd13267e8e5 admin admin] Calling method '>' {{(pid=112917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:38:19.830176 n-d-858094-4 devstack@n-api.service[112917]: INFO nova.api.openstack.requestlog [None req-e0e8f82f-f461-4af0-9cd2-8dd13267e8e5 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011636 Sep 16 12:38:19.830690 n-d-858094-4 devstack@n-api.service[112917]: [pid: 112917|app: 0|req: 33/67] 10.222.0.67 () {60 vars in 1286 bytes} [Fri Sep 16 12:38:19 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:38:19.842283 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-612851c4-da16-4ac8-9584-83b202fd390d admin admin] Calling method '>' {{(pid=112916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:38:19.849361 n-d-858094-4 devstack@n-api.service[112916]: INFO nova.api.openstack.requestlog [None req-612851c4-da16-4ac8-9584-83b202fd390d admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010622 Sep 16 12:38:19.849863 n-d-858094-4 devstack@n-api.service[112916]: [pid: 112916|app: 0|req: 35/68] 10.222.0.67 () {60 vars in 1283 bytes} [Fri Sep 16 12:38:19 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:43:43.172859 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-e0e8f82f-f461-4af0-9cd2-8dd13267e8e5 admin admin] Calling method '>' {{(pid=112917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:43:43.174464 n-d-858094-4 devstack@n-api.service[112917]: INFO nova.api.openstack.requestlog [None req-e0e8f82f-f461-4af0-9cd2-8dd13267e8e5 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002084 Sep 16 12:43:43.174860 n-d-858094-4 devstack@n-api.service[112917]: [pid: 112917|app: 0|req: 34/69] 10.222.0.67 () {56 vars in 1074 bytes} [Fri Sep 16 12:43:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:43:43.313716 n-d-858094-4 devstack@n-api.service[112916]: DEBUG dbcounter [-] [112916] Writing DB stats nova_api:SELECT=6 {{(pid=112916) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:43:43.457234 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-923b3768-e1f1-4527-bbb3-5cf1275acfaf admin admin] Calling method '>' {{(pid=112916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:43:43.462065 n-d-858094-4 devstack@n-api.service[112916]: DEBUG oslo_concurrency.lockutils [None req-923b3768-e1f1-4527-bbb3-5cf1275acfaf admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:43:43.462540 n-d-858094-4 devstack@n-api.service[112916]: DEBUG oslo_concurrency.lockutils [None req-923b3768-e1f1-4527-bbb3-5cf1275acfaf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:43:43.462969 n-d-858094-4 devstack@n-api.service[112916]: DEBUG oslo_concurrency.lockutils [None req-923b3768-e1f1-4527-bbb3-5cf1275acfaf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:43:43.463682 n-d-858094-4 devstack@n-api.service[112916]: DEBUG oslo_concurrency.lockutils [None req-923b3768-e1f1-4527-bbb3-5cf1275acfaf admin admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:43:43.464146 n-d-858094-4 devstack@n-api.service[112916]: DEBUG oslo_concurrency.lockutils [None req-923b3768-e1f1-4527-bbb3-5cf1275acfaf admin admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:43:43.464568 n-d-858094-4 devstack@n-api.service[112916]: DEBUG oslo_concurrency.lockutils [None req-923b3768-e1f1-4527-bbb3-5cf1275acfaf admin admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:43:43.503387 n-d-858094-4 devstack@n-api.service[112916]: INFO nova.api.openstack.requestlog [None req-923b3768-e1f1-4527-bbb3-5cf1275acfaf admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.191184 Sep 16 12:43:43.503974 n-d-858094-4 devstack@n-api.service[112916]: [pid: 112916|app: 0|req: 36/70] 10.222.0.67 () {60 vars in 1193 bytes} [Fri Sep 16 12:43:43 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:43:44.588386 n-d-858094-4 devstack@n-api.service[112917]: DEBUG nova.api.openstack.wsgi [None req-e0e8f82f-f461-4af0-9cd2-8dd13267e8e5 admin admin] Calling method '>' {{(pid=112917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:43:44.589398 n-d-858094-4 devstack@n-api.service[112917]: INFO nova.api.openstack.requestlog [None req-e0e8f82f-f461-4af0-9cd2-8dd13267e8e5 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 16 12:43:44.589798 n-d-858094-4 devstack@n-api.service[112917]: [pid: 112917|app: 0|req: 35/71] 10.222.0.67 () {56 vars in 1074 bytes} [Fri Sep 16 12:43:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:43:44.782791 n-d-858094-4 devstack@n-api.service[112916]: DEBUG nova.api.openstack.wsgi [None req-e3ec3c97-900d-4391-aea1-d88fdd623252 admin admin] Calling method '>' {{(pid=112916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:43:44.785896 n-d-858094-4 devstack@n-api.service[112916]: DEBUG oslo_concurrency.lockutils [None req-e3ec3c97-900d-4391-aea1-d88fdd623252 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:43:44.786368 n-d-858094-4 devstack@n-api.service[112916]: DEBUG oslo_concurrency.lockutils [None req-e3ec3c97-900d-4391-aea1-d88fdd623252 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:43:44.786813 n-d-858094-4 devstack@n-api.service[112916]: DEBUG oslo_concurrency.lockutils [None req-e3ec3c97-900d-4391-aea1-d88fdd623252 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:43:44.787515 n-d-858094-4 devstack@n-api.service[112916]: DEBUG oslo_concurrency.lockutils [None req-e3ec3c97-900d-4391-aea1-d88fdd623252 admin admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:43:44.787952 n-d-858094-4 devstack@n-api.service[112916]: DEBUG oslo_concurrency.lockutils [None req-e3ec3c97-900d-4391-aea1-d88fdd623252 admin admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:43:44.788396 n-d-858094-4 devstack@n-api.service[112916]: DEBUG oslo_concurrency.lockutils [None req-e3ec3c97-900d-4391-aea1-d88fdd623252 admin admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:43:44.811562 n-d-858094-4 devstack@n-api.service[112916]: INFO nova.api.openstack.requestlog [None req-e3ec3c97-900d-4391-aea1-d88fdd623252 admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.082588 Sep 16 12:43:44.812025 n-d-858094-4 devstack@n-api.service[112916]: [pid: 112916|app: 0|req: 37/72] 10.222.0.67 () {60 vars in 1193 bytes} [Fri Sep 16 12:43:44 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:44:29.495583 n-d-858094-4 systemd[1]: Stopping Devstack devstack@n-api.service... Sep 16 12:44:29.496496 n-d-858094-4 devstack@n-api.service[112915]: Fri Sep 16 12:44:29 2022 - graceful shutdown triggered... Sep 16 12:44:29.497001 n-d-858094-4 devstack@n-api.service[112916]: Gracefully killing worker 1 (pid: 112916)... Sep 16 12:44:29.497360 n-d-858094-4 devstack@n-api.service[112917]: Gracefully killing worker 2 (pid: 112917)... Sep 16 12:44:29.626544 n-d-858094-4 devstack@n-api.service[112917]: DEBUG dbcounter [-] [112917] Writing DB stats nova_api:SELECT=4 {{(pid=112917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:44:30.497640 n-d-858094-4 devstack@n-api.service[112915]: worker 1 buried after 1 seconds Sep 16 12:44:30.497640 n-d-858094-4 devstack@n-api.service[112915]: worker 2 buried after 1 seconds Sep 16 12:44:30.498284 n-d-858094-4 devstack@n-api.service[112915]: goodbye to uWSGI. Sep 16 12:44:30.499468 n-d-858094-4 systemd[1]: devstack@n-api.service: Succeeded. Sep 16 12:44:30.500151 n-d-858094-4 systemd[1]: Stopped Devstack devstack@n-api.service. Sep 16 12:44:30.502962 n-d-858094-4 systemd[1]: Starting Devstack devstack@n-api.service... Sep 16 12:44:30.519689 n-d-858094-4 devstack@n-api.service[128762]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 16 12:44:30.533720 n-d-858094-4 devstack@n-api.service[128762]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 16 12:44:30 2022] *** Sep 16 12:44:30.533720 n-d-858094-4 devstack@n-api.service[128762]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 16 12:44:30.533720 n-d-858094-4 devstack@n-api.service[128762]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 16 12:44:30.533720 n-d-858094-4 devstack@n-api.service[128762]: nodename: n-d-858094-4 Sep 16 12:44:30.533720 n-d-858094-4 devstack@n-api.service[128762]: machine: x86_64 Sep 16 12:44:30.533720 n-d-858094-4 devstack@n-api.service[128762]: clock source: unix Sep 16 12:44:30.533720 n-d-858094-4 devstack@n-api.service[128762]: pcre jit disabled Sep 16 12:44:30.533720 n-d-858094-4 devstack@n-api.service[128762]: detected number of CPU cores: 4 Sep 16 12:44:30.533720 n-d-858094-4 devstack@n-api.service[128762]: current working directory: / Sep 16 12:44:30.533720 n-d-858094-4 devstack@n-api.service[128762]: detected binary path: /usr/bin/uwsgi-core Sep 16 12:44:30.533720 n-d-858094-4 devstack@n-api.service[128762]: your processes number limit is 47680 Sep 16 12:44:30.533720 n-d-858094-4 devstack@n-api.service[128762]: your memory page size is 4096 bytes Sep 16 12:44:30.533720 n-d-858094-4 devstack@n-api.service[128762]: detected max file descriptor number: 2048 Sep 16 12:44:30.533720 n-d-858094-4 devstack@n-api.service[128762]: lock engine: pthread robust mutexes Sep 16 12:44:30.534851 n-d-858094-4 devstack@n-api.service[128762]: thunder lock: enabled Sep 16 12:44:30.534851 n-d-858094-4 devstack@n-api.service[128762]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 16 12:44:30.534851 n-d-858094-4 devstack@n-api.service[128762]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 16 12:44:30.574823 n-d-858094-4 devstack@n-api.service[128762]: Python main interpreter initialized at 0x555774c229c0 Sep 16 12:44:30.574823 n-d-858094-4 devstack@n-api.service[128762]: python threads support enabled Sep 16 12:44:30.574823 n-d-858094-4 devstack@n-api.service[128762]: your server socket listen backlog is limited to 100 connections Sep 16 12:44:30.574823 n-d-858094-4 devstack@n-api.service[128762]: your mercy for graceful operations on workers is 90 seconds Sep 16 12:44:30.575270 n-d-858094-4 devstack@n-api.service[128762]: mapped 403077 bytes (393 KB) for 2 cores Sep 16 12:44:30.575270 n-d-858094-4 devstack@n-api.service[128762]: *** Operational MODE: preforking *** Sep 16 12:44:30.575532 n-d-858094-4 devstack@n-api.service[128762]: *** uWSGI is running in multiple interpreter mode *** Sep 16 12:44:30.575532 n-d-858094-4 devstack@n-api.service[128762]: spawned uWSGI master process (pid: 128762) Sep 16 12:44:30.575741 n-d-858094-4 systemd[1]: Started Devstack devstack@n-api.service. Sep 16 12:44:30.578973 n-d-858094-4 devstack@n-api.service[128762]: spawned uWSGI worker 1 (pid: 128779, cores: 1) Sep 16 12:44:30.578973 n-d-858094-4 devstack@n-api.service[128762]: spawned uWSGI worker 2 (pid: 128780, cores: 1) Sep 16 12:44:30.578973 n-d-858094-4 devstack@n-api.service[128762]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 16 12:44:31.250906 n-d-858094-4 devstack@n-api.service[128780]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 16 12:44:31.251574 n-d-858094-4 devstack@n-api.service[128779]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 16 12:44:32.441706 n-d-858094-4 devstack@n-api.service[128779]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 12:44:32.441706 n-d-858094-4 devstack@n-api.service[128779]: from cryptography.utils import int_from_bytes Sep 16 12:44:32.442407 n-d-858094-4 devstack@n-api.service[128779]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 12:44:32.442407 n-d-858094-4 devstack@n-api.service[128779]: from cryptography.utils import int_from_bytes Sep 16 12:44:32.457653 n-d-858094-4 devstack@n-api.service[128780]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 12:44:32.457653 n-d-858094-4 devstack@n-api.service[128780]: from cryptography.utils import int_from_bytes Sep 16 12:44:32.458256 n-d-858094-4 devstack@n-api.service[128780]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 12:44:32.458256 n-d-858094-4 devstack@n-api.service[128780]: from cryptography.utils import int_from_bytes Sep 16 12:44:34.890921 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 16 12:44:34.891486 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 16 12:44:34.891633 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 16 12:44:34.892008 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 16 12:44:34.892296 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 16 12:44:34.892692 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.893024 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.893350 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.893809 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.894017 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.894332 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.894666 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.894984 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.895319 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.895584 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.895905 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.896421 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858094-4 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.896757 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.897079 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.897397 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.897726 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.898043 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.898371 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.898683 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.899214 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.899645 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.899963 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.900303 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.900657 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.900982 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.901298 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.901625 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.901940 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.902277 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.902593 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.903013 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858094-4 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.903341 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.903685 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.904002 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.904673 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.905006 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.905321 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.905660 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.906009 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.906327 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.906667 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.906999 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.907333 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.907662 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.907976 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.908327 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.908646 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.908978 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.909300 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.909613 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.909869 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.910180 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.910512 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.910855 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.911172 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.911429 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.911684 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.912014 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.912373 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.912686 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.912999 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.913311 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.913627 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.913748 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 16 12:44:34.914158 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.914251 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 16 12:44:34.914326 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.914463 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 16 12:44:34.914582 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.914829 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.914930 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 16 12:44:34.915085 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 16 12:44:34.915176 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.915466 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.915571 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.915793 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.915901 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.916100 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.916227 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.916447 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.916548 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.916784 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.916890 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.917092 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.917188 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.917408 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.917512 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.917724 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.917824 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.918055 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.918157 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.918317 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.918409 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.918640 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.918761 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.918994 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.919093 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858094-4 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.919313 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.919419 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.919626 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.919769 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.920005 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.920210 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.920306 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.920547 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.920656 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.920870 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.920990 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.921187 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.921313 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.921492 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.921607 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.921802 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.922001 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.922117 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.922319 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.922427 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.922629 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.922721 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.922943 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.923033 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.923290 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.923430 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.923603 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.923705 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.923912 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.924022 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.924248 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.924362 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.924560 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.924654 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.924872 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.924959 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.925184 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.925285 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.925494 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.925626 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858094-4 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.925809 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.925951 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.926118 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.926266 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.926429 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.926586 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.926755 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.927009 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.927119 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.927318 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.927438 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.927639 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.927747 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.927968 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.928081 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.928305 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.928484 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.928630 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.928743 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.928942 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.929053 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.929257 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.929365 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.929582 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.929682 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.929891 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.929980 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.930202 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.930311 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.930511 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.930609 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.930823 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.930914 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.931134 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.931244 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.931447 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.931556 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.931751 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.931842 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.932001 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.932104 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.932337 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.932430 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.932663 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.932763 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.932989 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.933089 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.933292 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.933384 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.933602 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.933703 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.933865 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.934009 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.934195 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.934295 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.934501 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.934619 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.934810 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.934900 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.935116 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.935220 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.936051 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.936460 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.936615 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.936806 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.936935 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.937123 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.937251 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.937435 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.937563 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.937745 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.937892 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.938054 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.938238 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.938381 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.938578 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.938700 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.938934 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.939042 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.939263 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.939355 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.939606 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.939705 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.939948 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.940053 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.940287 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.940393 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.940601 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.940693 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.940919 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.941023 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.941258 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.941375 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.941572 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.941685 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.941887 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.941992 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.942205 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.942304 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.942511 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.942608 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.942818 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.942924 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.943127 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.943218 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.943450 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.943555 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.943782 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.943873 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.944085 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.944201 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.944360 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.944463 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.944662 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.944755 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.944969 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.945070 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.945290 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.945381 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.945598 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.945711 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.945910 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.946035 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.946220 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.946390 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.946501 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.946680 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.946791 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.947017 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.947110 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.947350 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.947456 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.947673 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.947775 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.947979 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.948080 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.948323 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.948423 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.948628 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.948733 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.948936 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.949036 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.949245 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.949355 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.949549 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.949643 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.949871 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.949970 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.950196 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.950298 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.950505 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.950603 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.950813 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.950904 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.951192 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.951852 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.952003 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.952248 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.952344 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.952631 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.952722 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.952944 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.953045 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.953268 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.953367 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.953576 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.953665 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.953883 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.953989 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.954204 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.954305 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.954512 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.954627 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.954820 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.954919 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.955141 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.955233 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.955445 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.955543 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.955752 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.955851 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.956062 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.956220 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.956403 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.956508 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.956719 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.956829 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.957022 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.957122 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.957327 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.957427 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.957633 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.957730 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.957937 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.958035 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.958247 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.958339 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.958551 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.958650 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.958852 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.958953 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.959170 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.959285 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.959493 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.959601 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.959805 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.959904 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.960112 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.960246 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.960439 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.960545 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.960749 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.960839 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 12:44:34.961080 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.961171 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.961399 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.961498 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.961710 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.961801 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.962040 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.962138 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.962353 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.962470 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.962672 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.962791 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.962999 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.963108 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.963997 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.964097 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.964435 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.964530 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.964631 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.964721 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.964796 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.964875 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.964954 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.965039 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.965130 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.965220 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.965300 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.965372 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.965443 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.965514 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.966171 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.966334 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.966417 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.966489 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.966560 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.966641 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.966724 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.967083 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.967187 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.967369 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.967467 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.967647 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.967754 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.968493 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.968576 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.968648 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.968719 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.968804 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.968887 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.968969 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.969047 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.969518 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.969627 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.969712 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.969810 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.969887 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.969967 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.970318 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.970426 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.970502 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.970574 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.970823 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.970917 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.971098 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.971204 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.972147 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.972273 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.972360 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.972434 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.972506 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.972587 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.972661 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.972741 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.972814 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.972885 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.972970 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.973044 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.973569 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.973673 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.973749 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.973828 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.973909 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.973991 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.974216 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.974334 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.974560 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.974655 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.974879 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.974963 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.975194 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.975276 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.975515 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.975620 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.975832 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.976179 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.976495 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.976811 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.977139 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.977458 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.977790 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.978012 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.978116 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.978382 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.978486 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.978719 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.978812 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.979040 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.979131 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.979366 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.979465 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.979692 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.979799 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.980014 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.980114 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.980361 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.980481 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.980676 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.980767 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.980991 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.981082 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.981305 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.981408 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.981621 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.981719 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.981936 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.982027 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.982277 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.982385 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.982614 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.982714 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.982929 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.983177 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.983296 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.983407 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.983549 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.983653 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.983862 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.983968 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.984201 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.984311 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.984517 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.984615 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.984826 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.984924 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.985142 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.985321 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.985458 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.985549 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.985769 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.985875 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.986097 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.986189 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.986410 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.986504 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.986723 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.986818 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.987093 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.987198 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.987348 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.987447 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.987660 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.987750 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.987972 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.988072 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.988314 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.988419 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.988635 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.988744 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.988952 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.989049 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.989267 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.989366 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.989583 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.989688 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.989894 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.989987 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.990215 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.990307 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.990533 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.990642 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.990843 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.990936 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.991152 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.991271 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.991466 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.991585 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.991777 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.991868 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.992085 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.992205 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.992417 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.992518 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.992726 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.992825 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.993072 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.993176 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.993346 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.993437 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.993656 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.993747 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.993962 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.994065 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.994270 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.994361 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.994573 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.994671 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.994879 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.994977 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.995196 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.995295 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.995504 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.995597 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.995812 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.995910 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.996116 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.996247 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.996484 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.996578 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.996794 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.996897 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.997112 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.997293 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.997493 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.997618 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.997814 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.998544 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.998721 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.998886 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.999044 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.999299 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.999406 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.999506 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.999591 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.999751 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:34.999909 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.000068 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.000253 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.000409 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.000573 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.000725 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.000909 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.001049 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.001221 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.001364 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.001539 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.001688 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.001857 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.002002 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.002167 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.002331 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.002483 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.002646 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.002807 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.002969 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.003279 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.003399 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.003597 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.003741 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.004064 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.004186 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.004420 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.004775 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.004868 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.005100 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.005376 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.005476 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.005760 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.006000 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.006089 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.006379 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.006597 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.006738 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.006994 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.007156 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.007291 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.007608 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.007751 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.007912 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.008245 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.008393 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.008556 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.008871 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.008991 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.009183 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.009490 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.009581 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.009804 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.010092 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.010371 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.010461 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.010545 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.010758 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.010857 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.011076 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.011167 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.011388 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.011488 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.011718 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.011823 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.012033 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.012140 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.012370 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.012461 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.012681 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.012788 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.012991 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.013091 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.013340 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.013448 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.014227 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.014401 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.014540 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.014751 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.014921 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.015094 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.015364 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.015469 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.015687 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.015787 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.016009 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.016109 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.016351 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.016455 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.016665 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.016757 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.016985 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.017075 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.017294 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.017427 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.017618 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.017755 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.017935 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.018048 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.018245 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.018345 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.018560 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.018661 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.018876 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.018985 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.019368 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.019505 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.019605 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.019699 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.019792 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.019890 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.020098 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.020209 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.020433 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.020537 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.020754 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.020847 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.021070 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.021161 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.021382 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.021480 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.021688 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.021787 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.022007 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.022098 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.022320 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.022411 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.022628 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.022719 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.022934 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.023027 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.023240 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.023330 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.023564 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.023665 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.023876 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.023969 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.024211 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.024319 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.024525 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.024623 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.024843 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.024944 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.025156 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.025260 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.025464 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.025555 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.025776 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.025864 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.026090 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.026195 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.026399 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.026490 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.026711 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.026810 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.027024 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.027168 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.027334 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.027458 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.027719 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.027834 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.027957 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.028063 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.028297 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.028411 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.028622 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.028720 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.028933 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.029045 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.029279 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.029445 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.029601 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.029759 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.029998 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.030100 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.030314 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.030413 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.030639 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.030730 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.030946 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.031226 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.031318 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.031551 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.031648 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.031862 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.031963 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.032197 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.032293 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.032530 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.032624 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.032845 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.032951 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.033154 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.033247 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.033468 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.033569 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.033777 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.033869 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.034091 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.034195 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.034407 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.034509 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.034717 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.034820 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.035026 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.035134 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.035341 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.035434 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.035648 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.035739 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.035956 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.036057 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.036289 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.036384 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.036602 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.036701 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.036910 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.037048 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.037218 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.037300 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.037525 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.037653 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.037840 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.037977 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.038161 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.038300 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.038464 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.038581 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.038782 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.038878 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.039092 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.039182 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.039404 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.039495 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.039723 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.039815 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.040031 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.040207 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.040368 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.040470 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.040674 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.040775 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.040992 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.041083 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.041307 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.041399 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.041622 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.041715 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.041939 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.042032 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.042253 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.042353 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.042567 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.042666 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.042884 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.042977 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.043199 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.043314 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.043505 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.043596 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.043814 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.043905 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.044142 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.044253 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.044460 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.044552 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.044797 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.044923 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.045255 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.045422 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.045695 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.045799 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.045989 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.046090 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.046304 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.046397 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.046621 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.046714 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.046940 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.047050 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.047264 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.047385 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.047540 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.047676 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.047875 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.048085 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.048239 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.048328 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.048497 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.048623 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.048813 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.048939 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.049128 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.049286 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.049440 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.049560 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.049751 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.049904 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.050061 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.050185 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.050366 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.050490 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.050687 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.050907 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.051039 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.051229 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.051359 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.051546 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.051683 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.051864 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.051994 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.052204 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.052350 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.052514 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.052666 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.052844 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.052979 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.053157 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.053288 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.053466 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.053600 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.053774 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.053908 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.054086 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.054228 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.054389 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.054646 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.054779 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.054906 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.055044 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.055176 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.055347 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.055454 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.055606 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.055740 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.055914 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.056056 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.056250 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.056512 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.056613 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.056833 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.056925 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.057146 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.057286 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.057458 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.057558 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.057766 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.057900 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.058120 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.058235 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.058373 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.058466 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.058687 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.058788 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.058994 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.059094 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.059320 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.059484 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.059618 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.059738 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.059928 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.060051 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.060261 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.060883 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.061129 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.061567 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.061721 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.061960 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.062097 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.062297 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.062489 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.062642 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.062785 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.062942 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.063109 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.063369 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.063495 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.063703 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.063836 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.064026 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.064197 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.064370 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.064513 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.064685 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.064829 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.065004 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.065266 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.065375 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.065460 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.065614 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.065709 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.065910 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.066003 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.066215 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.066307 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.066544 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.066638 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.066857 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.066948 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.067167 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.067310 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.067482 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.067604 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.067789 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.067924 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.068099 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.068331 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.068438 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.068526 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.068754 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.068852 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.069066 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.069199 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.069401 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.069589 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.069720 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.069848 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.070039 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.070206 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.070373 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.070505 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.070689 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.070887 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.071031 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.071206 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.071341 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.071522 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.071667 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.071837 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.071993 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.072168 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.072294 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.072485 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.072624 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.072800 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.072923 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.073109 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.073243 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.073442 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.073587 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.073757 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.073894 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.074069 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.074203 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.074383 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.074554 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.074681 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.074768 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.074993 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.075092 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.075305 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.075411 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.075703 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.075801 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.076690 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.076842 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.076995 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.077176 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.077333 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.077482 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.077574 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.077668 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.077885 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.078102 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.078194 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.078303 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.078515 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.078787 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.078934 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.079116 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.079244 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.079566 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.079881 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.080231 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.080536 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.080656 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.080849 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.081153 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.081263 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.081482 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.081633 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.081793 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.082102 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.082201 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.082413 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.082592 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.082746 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.083055 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.083161 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.083383 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.083526 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.083808 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.084008 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.084114 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.084562 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.084671 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.085547 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.085667 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.085747 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.085829 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.085829 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.085970 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.086043 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.086124 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.086293 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.086397 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.086578 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.086696 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.086894 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.087013 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.087216 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.087310 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.087536 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.087661 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.087873 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.087975 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.088248 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.088355 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.088576 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.088701 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.088832 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.088943 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.089152 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.089298 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.089480 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.089641 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.089808 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.089970 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.090128 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.090296 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.090464 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.090877 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.090982 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.091205 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.091297 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.091524 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.091665 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.091908 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.092017 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.092512 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.092763 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.092866 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.092945 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.093116 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.093382 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.093472 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.093558 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.093733 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.093863 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.094043 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.094181 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.094373 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.094497 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.094687 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.094831 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.095005 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.095158 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.095322 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.095489 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.095636 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.095831 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.095948 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.096200 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.096297 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.096526 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.096621 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.096847 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.096961 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.097163 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.097265 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.097511 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.097604 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.097832 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.097951 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.098140 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.098266 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.098449 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.098652 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.098745 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.098830 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.099061 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.099164 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.099372 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.099479 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.099676 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.099768 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.099983 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.100140 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.100319 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.100487 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.100630 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.100733 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.100939 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.101033 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.101253 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.101348 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.101568 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.101666 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.101892 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.101993 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.102227 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.102322 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.102547 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.102640 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.102863 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.103020 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.103166 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.103305 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.103481 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.103614 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.103806 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.104005 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.104172 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.104349 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.104460 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.104686 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.104789 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.105015 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.105118 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.105319 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.105419 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.105629 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.105719 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.105939 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.106061 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.106279 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.106586 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.108416 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.108678 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.108862 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.109019 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.109171 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.109171 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.109469 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.109630 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.109803 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.134970 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.135123 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.135196 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.135267 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.135335 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.135402 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.135459 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.135512 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.135565 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.135617 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.135682 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.135747 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.135803 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.135870 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.135928 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.135989 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.136046 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.136101 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.136180 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.136238 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.136293 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.136293 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.136406 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.136461 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.136516 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.136570 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.136755 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.136831 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.136889 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.136944 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.136999 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.137061 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.137118 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.137174 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.137228 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.137283 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.137336 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.137398 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.137455 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.137529 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.137588 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.137588 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.137688 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.137751 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.137809 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.137866 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.137921 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.137977 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.138039 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.138097 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.138154 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.138235 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.138293 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.138350 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.138413 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.138522 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.139286 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.139359 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.139417 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.139474 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.139608 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.139670 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.139727 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.139784 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.139841 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.139902 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.139968 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.140026 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.140082 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.140175 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.140239 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.140309 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.140369 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.140369 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.140469 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.140526 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.140526 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.140633 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.140692 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.140751 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.140815 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.140873 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.140976 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.141040 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.141105 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.141105 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.141105 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.141105 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.141105 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.141335 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.141400 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.141459 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.141515 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.141583 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.141641 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.141697 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.141761 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.141761 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.143415 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.143497 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.143569 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.143627 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.143707 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.143779 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.143849 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.143918 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.143988 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.144065 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.144166 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.144242 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.144242 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.144380 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.144380 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.144506 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.144578 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.144648 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.144717 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.144826 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.144899 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.144970 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.145048 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.145122 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.145192 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.145262 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.145333 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.145402 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.145469 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.145540 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.145616 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.145687 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.145757 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.145834 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.145907 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.145978 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.146049 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.146119 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.146189 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.146267 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.146339 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.146409 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.146479 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.146550 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.146620 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.146698 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.146770 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.150368 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.152346 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.152519 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.152695 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.153614 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.153730 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.153831 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.153831 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.154031 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.154154 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.154258 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.154356 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.156280 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.156447 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.156570 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.156654 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.156754 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.156837 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.156943 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.157035 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.157035 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.157208 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.157208 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.157358 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.157445 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.157526 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.157526 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.157637 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.157716 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.157792 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.157873 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.157950 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.158026 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.158107 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.158182 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.158182 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.158352 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.158440 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.158521 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.158606 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.158606 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.158863 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.158954 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.159033 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.159109 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.159185 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.159258 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.159347 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.159423 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.159501 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.159571 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.159630 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.159688 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.159753 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.159813 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.159888 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.159966 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.159966 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.160582 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.160582 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.160939 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.161216 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.161499 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.161739 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.161942 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.162103 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.162240 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.162389 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.162472 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.162638 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.162774 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.162895 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.163170 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.163305 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.163449 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.163590 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.163736 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.163872 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.164004 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.164004 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.164004 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.164259 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.164331 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.164331 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.164439 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.164496 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.164554 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.164611 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.164677 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.164677 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.164780 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.164780 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.164780 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.164780 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.164979 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.165037 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.165037 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.165037 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.165182 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.165247 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.165307 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.165364 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.165421 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.165477 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.165477 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.165641 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.165739 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.165739 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.165739 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.165993 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.166098 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.166098 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.166288 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.166360 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.166468 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.166553 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.166553 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.166689 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.166761 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.166761 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.166761 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.166943 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.167020 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.167020 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.167148 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.167217 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.167217 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.167217 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.167405 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.167477 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.167477 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.167477 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.167477 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.167667 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.167732 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.167732 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.167732 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.167732 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.167732 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.168068 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.168222 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.168340 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.168455 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.168530 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.168589 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.168660 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.168770 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.168866 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.169003 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.169105 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.169201 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.169306 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.169402 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.169480 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.169540 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.169540 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.169651 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.170240 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.170310 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.170368 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.170426 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.170483 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.170549 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.170626 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.170688 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.170745 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.170802 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.170859 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.170925 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.171152 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.171269 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.171374 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.171447 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.171516 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.171586 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.171647 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.171704 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.171762 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.171819 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.171885 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.171945 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.172003 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.172060 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.172188 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.172188 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.172324 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.172385 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.172385 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.172491 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.172549 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.172606 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.172671 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.172730 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.172789 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.172906 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.172988 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.173067 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.173140 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.173520 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.173647 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.173727 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.173787 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.173987 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.174104 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.174281 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.174417 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.174619 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.174752 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.174931 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.175146 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.175301 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.175583 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.175712 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.175902 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.176003 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.176255 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.176437 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.176665 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.176806 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.177007 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.177170 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.177333 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.177643 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.177741 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.177970 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.178173 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.178338 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.178418 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.178674 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.178753 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.178989 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.179068 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.179315 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.179393 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.179642 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.179721 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.179956 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.180036 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.180318 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.180406 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.180632 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.180726 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.180947 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.181027 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.181265 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.181358 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.181630 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.181801 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.181879 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.181950 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.182114 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 16 12:44:35.182193 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.182507 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.182836 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.183146 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.183481 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.183801 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.184826 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.184826 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.184826 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.185090 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.186100 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.186688 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.187009 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.187327 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.187643 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.187963 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.188312 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.188625 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.188944 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.189265 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.189597 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.189934 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.190247 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.190577 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.190907 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.191314 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.191573 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.191921 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.192281 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.192602 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.192915 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.193227 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 12:44:35.193471 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 16 12:44:35.245547 n-d-858094-4 devstack@n-api.service[128779]: INFO dbcounter [None req-d760d5ea-ba9c-4755-bbc4-45da98038dc2 None None] Registered counter for database nova_api Sep 16 12:44:35.257074 n-d-858094-4 devstack@n-api.service[128780]: INFO dbcounter [None req-ce763dc6-de14-4ae2-9a31-76e1cb2edd1a None None] Registered counter for database nova_api Sep 16 12:44:35.267605 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_db.sqlalchemy.engines [None req-d760d5ea-ba9c-4755-bbc4-45da98038dc2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 12:44:35.274718 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writer thread running {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 12:44:35.277555 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_db.sqlalchemy.engines [None req-ce763dc6-de14-4ae2-9a31-76e1cb2edd1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128780) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 12:44:35.286063 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writer thread running {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 12:44:35.346423 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.context [None req-d760d5ea-ba9c-4755-bbc4-45da98038dc2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),19bb4c25-c68f-412b-8c46-4f5dc22c63ee(cell1) {{(pid=128779) load_cells /opt/stack/nova/nova/context.py:464}} Sep 16 12:44:35.348064 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.context [None req-ce763dc6-de14-4ae2-9a31-76e1cb2edd1a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),19bb4c25-c68f-412b-8c46-4f5dc22c63ee(cell1) {{(pid=128780) load_cells /opt/stack/nova/nova/context.py:464}} Sep 16 12:44:35.350518 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d760d5ea-ba9c-4755-bbc4-45da98038dc2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:44:35.350990 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d760d5ea-ba9c-4755-bbc4-45da98038dc2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:44:35.352598 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d760d5ea-ba9c-4755-bbc4-45da98038dc2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:44:35.352708 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce763dc6-de14-4ae2-9a31-76e1cb2edd1a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:44:35.353303 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce763dc6-de14-4ae2-9a31-76e1cb2edd1a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:44:35.353423 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d760d5ea-ba9c-4755-bbc4-45da98038dc2 None None] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:44:35.353755 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d760d5ea-ba9c-4755-bbc4-45da98038dc2 None None] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:44:35.354871 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce763dc6-de14-4ae2-9a31-76e1cb2edd1a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:44:35.355614 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce763dc6-de14-4ae2-9a31-76e1cb2edd1a None None] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:44:35.355774 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d760d5ea-ba9c-4755-bbc4-45da98038dc2 None None] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:44:35.356070 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce763dc6-de14-4ae2-9a31-76e1cb2edd1a None None] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:44:35.358326 n-d-858094-4 devstack@n-api.service[128779]: INFO dbcounter [None req-d760d5ea-ba9c-4755-bbc4-45da98038dc2 None None] Registered counter for database nova_cell0 Sep 16 12:44:35.358975 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce763dc6-de14-4ae2-9a31-76e1cb2edd1a None None] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:44:35.361076 n-d-858094-4 devstack@n-api.service[128780]: INFO dbcounter [None req-ce763dc6-de14-4ae2-9a31-76e1cb2edd1a None None] Registered counter for database nova_cell0 Sep 16 12:44:35.362663 n-d-858094-4 devstack@n-api.service[128779]: INFO dbcounter [None req-d760d5ea-ba9c-4755-bbc4-45da98038dc2 None None] Registered counter for database nova_cell1 Sep 16 12:44:35.365437 n-d-858094-4 devstack@n-api.service[128780]: INFO dbcounter [None req-ce763dc6-de14-4ae2-9a31-76e1cb2edd1a None None] Registered counter for database nova_cell1 Sep 16 12:44:35.372521 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_db.sqlalchemy.engines [None req-d760d5ea-ba9c-4755-bbc4-45da98038dc2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 12:44:35.373891 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_db.sqlalchemy.engines [None req-ce763dc6-de14-4ae2-9a31-76e1cb2edd1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128780) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 12:44:35.376510 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_db.sqlalchemy.engines [None req-d760d5ea-ba9c-4755-bbc4-45da98038dc2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 12:44:35.376666 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_db.sqlalchemy.engines [None req-ce763dc6-de14-4ae2-9a31-76e1cb2edd1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128780) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 12:44:35.383095 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writer thread running {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 12:44:35.384275 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writer thread running {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 12:44:35.384394 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writer thread running {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 12:44:35.529636 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writer thread running {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 12:44:35.536416 n-d-858094-4 devstack@n-api.service[128780]: INFO dbcounter [None req-ce763dc6-de14-4ae2-9a31-76e1cb2edd1a None None] Registered counter for database nova_cell0 Sep 16 12:44:35.539495 n-d-858094-4 devstack@n-api.service[128779]: INFO dbcounter [None req-d760d5ea-ba9c-4755-bbc4-45da98038dc2 None None] Registered counter for database nova_cell0 Sep 16 12:44:35.543323 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_db.sqlalchemy.engines [None req-ce763dc6-de14-4ae2-9a31-76e1cb2edd1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128780) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 12:44:35.547302 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_db.sqlalchemy.engines [None req-d760d5ea-ba9c-4755-bbc4-45da98038dc2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 12:44:35.550968 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writer thread running {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 12:44:35.552628 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writer thread running {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 12:44:35.876170 n-d-858094-4 devstack@n-api.service[128779]: WARNING keystonemiddleware.auth_token [None req-d760d5ea-ba9c-4755-bbc4-45da98038dc2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 12:44:35.876529 n-d-858094-4 devstack@n-api.service[128780]: WARNING keystonemiddleware.auth_token [None req-ce763dc6-de14-4ae2-9a31-76e1cb2edd1a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 12:44:35.883419 n-d-858094-4 devstack@n-api.service[128779]: WARNING keystonemiddleware.auth_token [None req-d760d5ea-ba9c-4755-bbc4-45da98038dc2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 12:44:35.883716 n-d-858094-4 devstack@n-api.service[128780]: WARNING keystonemiddleware.auth_token [None req-ce763dc6-de14-4ae2-9a31-76e1cb2edd1a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 12:44:36.230684 n-d-858094-4 devstack@n-api.service[128780]: WARNING keystonemiddleware.auth_token [None req-ce763dc6-de14-4ae2-9a31-76e1cb2edd1a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 12:44:36.233360 n-d-858094-4 devstack@n-api.service[128779]: WARNING keystonemiddleware.auth_token [None req-d760d5ea-ba9c-4755-bbc4-45da98038dc2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 12:44:36.237594 n-d-858094-4 devstack@n-api.service[128780]: WARNING keystonemiddleware.auth_token [None req-ce763dc6-de14-4ae2-9a31-76e1cb2edd1a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 12:44:36.238350 n-d-858094-4 devstack@n-api.service[128779]: WARNING keystonemiddleware.auth_token [None req-d760d5ea-ba9c-4755-bbc4-45da98038dc2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 12:44:36.242956 n-d-858094-4 devstack@n-api.service[128780]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555774c229c0 pid: 128780 (default app) Sep 16 12:44:36.243615 n-d-858094-4 devstack@n-api.service[128779]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555774c229c0 pid: 128779 (default app) Sep 16 12:45:16.945436 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=3 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:45:16.946308 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=3 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:45:16.947386 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=3 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:45:16.949057 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=3 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:45:18.001454 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:45:18.002958 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:45:18.003839 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:45:18.005545 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:45:18.535054 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-21c02efb-3464-4188-ad41-086879124241 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1098810504", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:18.887696 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a312d408-444c-4d45-8cd4-418283c09780 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:18.892757 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a312d408-444c-4d45-8cd4-418283c09780 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:18.893259 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a312d408-444c-4d45-8cd4-418283c09780 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:18.893702 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a312d408-444c-4d45-8cd4-418283c09780 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:18.894837 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a312d408-444c-4d45-8cd4-418283c09780 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:18.894992 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a312d408-444c-4d45-8cd4-418283c09780 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:18.895295 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a312d408-444c-4d45-8cd4-418283c09780 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:18.940813 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a312d408-444c-4d45-8cd4-418283c09780 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.948616 Sep 16 12:45:18.941956 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1/1] 10.222.0.67 () {58 vars in 1176 bytes} [Fri Sep 16 12:45:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:19.173085 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-21c02efb-3464-4188-ad41-086879124241 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] validate_networks() for None {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:45:19.186554 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fb63e706-4cdb-4e3b-b159-f8540070eeaf tempest-FlavorMetadataValidation-1641162061 tempest-FlavorMetadataValidation-1641162061-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1567520972", "id": 1940851477, "os-flavor-access:is_public": "True"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:19.246249 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fb63e706-4cdb-4e3b-b159-f8540070eeaf tempest-FlavorMetadataValidation-1641162061 tempest-FlavorMetadataValidation-1641162061-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.302975 Sep 16 12:45:19.246926 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2/2] 10.222.0.67 () {62 vars in 1188 bytes} [Fri Sep 16 12:45:18 2022] POST /compute/v2.1/flavors => generated 471 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:45:19.408413 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1d8e666c-fee0-48c6-aec1-7b922cc5a78f tempest-AggregatesAdminTestV241-106167985 tempest-AggregatesAdminTestV241-106167985-project-admin] Calling method '.version_select at 0x7f1037134b80>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:19.420879 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1d8e666c-fee0-48c6-aec1-7b922cc5a78f tempest-AggregatesAdminTestV241-106167985 tempest-AggregatesAdminTestV241-106167985-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),19bb4c25-c68f-412b-8c46-4f5dc22c63ee(cell1) {{(pid=128779) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 16 12:45:19.422010 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d8e666c-fee0-48c6-aec1-7b922cc5a78f tempest-AggregatesAdminTestV241-106167985 tempest-AggregatesAdminTestV241-106167985-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:19.422561 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d8e666c-fee0-48c6-aec1-7b922cc5a78f tempest-AggregatesAdminTestV241-106167985 tempest-AggregatesAdminTestV241-106167985-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:19.423034 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d8e666c-fee0-48c6-aec1-7b922cc5a78f tempest-AggregatesAdminTestV241-106167985 tempest-AggregatesAdminTestV241-106167985-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:19.456739 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d8e666c-fee0-48c6-aec1-7b922cc5a78f tempest-AggregatesAdminTestV241-106167985 tempest-AggregatesAdminTestV241-106167985-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:19.457828 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d8e666c-fee0-48c6-aec1-7b922cc5a78f tempest-AggregatesAdminTestV241-106167985 tempest-AggregatesAdminTestV241-106167985-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:19.458492 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d8e666c-fee0-48c6-aec1-7b922cc5a78f tempest-AggregatesAdminTestV241-106167985 tempest-AggregatesAdminTestV241-106167985-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:19.478398 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d8e666c-fee0-48c6-aec1-7b922cc5a78f tempest-AggregatesAdminTestV241-106167985 tempest-AggregatesAdminTestV241-106167985-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:19.478949 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d8e666c-fee0-48c6-aec1-7b922cc5a78f tempest-AggregatesAdminTestV241-106167985 tempest-AggregatesAdminTestV241-106167985-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:19.479383 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d8e666c-fee0-48c6-aec1-7b922cc5a78f tempest-AggregatesAdminTestV241-106167985 tempest-AggregatesAdminTestV241-106167985-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:19.490144 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1d8e666c-fee0-48c6-aec1-7b922cc5a78f tempest-AggregatesAdminTestV241-106167985 tempest-AggregatesAdminTestV241-106167985-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.241483 Sep 16 12:45:19.491040 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3/3] 10.222.0.67 () {60 vars in 1208 bytes} [Fri Sep 16 12:45:19 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:45:19.562382 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-21c02efb-3464-4188-ad41-086879124241 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:45:19.562861 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-21c02efb-3464-4188-ad41-086879124241 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:45:19.563271 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-21c02efb-3464-4188-ad41-086879124241 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:45:19.563682 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-21c02efb-3464-4188-ad41-086879124241 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:45:19.564098 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-21c02efb-3464-4188-ad41-086879124241 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:45:19.586428 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-21c02efb-3464-4188-ad41-086879124241 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:19.586958 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-21c02efb-3464-4188-ad41-086879124241 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:19.587389 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-21c02efb-3464-4188-ad41-086879124241 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:19.588960 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-21c02efb-3464-4188-ad41-086879124241 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:19.589531 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-21c02efb-3464-4188-ad41-086879124241 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:19.589848 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-21c02efb-3464-4188-ad41-086879124241 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:19.624930 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-21c02efb-3464-4188-ad41-086879124241 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Getting quotas for project e1b6b2ef87ef4629941a0cc9942d7e4c. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:45:19.632756 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-21c02efb-3464-4188-ad41-086879124241 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Getting quotas for user da877221336e4e58859c207fca5e857c and project e1b6b2ef87ef4629941a0cc9942d7e4c. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:45:19.647854 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-21c02efb-3464-4188-ad41-086879124241 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:45:19.651571 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-21c02efb-3464-4188-ad41-086879124241 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: 3ab83a18-0e02-4082-a9f8-b7f93ad2e347] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:45:19.750093 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-21c02efb-3464-4188-ad41-086879124241 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.813290 Sep 16 12:45:19.751612 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1/4] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:45:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 12:45:19.889838 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4e5e22e1-ac7b-415b-bf50-7e7c27b9746e tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Calling method '.version_select at 0x7f10370efdc0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:19.892493 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e5e22e1-ac7b-415b-bf50-7e7c27b9746e tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:19.893161 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e5e22e1-ac7b-415b-bf50-7e7c27b9746e tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:19.893724 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e5e22e1-ac7b-415b-bf50-7e7c27b9746e tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:19.917536 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e5e22e1-ac7b-415b-bf50-7e7c27b9746e tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:19.918047 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e5e22e1-ac7b-415b-bf50-7e7c27b9746e tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:19.918713 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e5e22e1-ac7b-415b-bf50-7e7c27b9746e tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:19.936823 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e5e22e1-ac7b-415b-bf50-7e7c27b9746e tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:19.937325 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e5e22e1-ac7b-415b-bf50-7e7c27b9746e tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:19.938536 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e5e22e1-ac7b-415b-bf50-7e7c27b9746e tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:19.946638 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4e5e22e1-ac7b-415b-bf50-7e7c27b9746e tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.454542 Sep 16 12:45:19.948902 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4/5] 10.222.0.67 () {58 vars in 1167 bytes} [Fri Sep 16 12:45:19 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:20.149218 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-431ac0de-bf78-4563-a0c9-0c4e9a56defb tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-442169402", "id": 1264504589, "os-flavor-access:is_public": "True"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:20.184046 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-431ac0de-bf78-4563-a0c9-0c4e9a56defb tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.430903 Sep 16 12:45:20.185067 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 2/6] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:45:19 2022] POST /compute/v2.1/flavors => generated 429 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:20.196781 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5d8fcdd6-e729-4e71-b9fa-f3351d5ce7b7 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-503971395"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:20.201494 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.aggregate [None req-5d8fcdd6-e729-4e71-b9fa-f3351d5ce7b7 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Generated uuid 44108088-acde-44b8-affd-cc6c9e4ec352 for aggregate {{(pid=128780) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 16 12:45:20.261776 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5d8fcdd6-e729-4e71-b9fa-f3351d5ce7b7 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.075494 Sep 16 12:45:20.262392 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 3/7] 10.222.0.67 () {60 vars in 1164 bytes} [Fri Sep 16 12:45:20 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:20.273400 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f7c4e005-183c-4eda-9445-cab31a357db7 tempest-FlavorMetadataValidation-1641162061 tempest-FlavorMetadataValidation-1641162061-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:20.275009 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7db32da1-5610-46f8-bc48-790dbea9d25d tempest-InstanceUsageAuditLogNegativeTestJSON-123189943 tempest-InstanceUsageAuditLogNegativeTestJSON-123189943-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:20.278778 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-7db32da1-5610-46f8-bc48-790dbea9d25d tempest-InstanceUsageAuditLogNegativeTestJSON-123189943 tempest-InstanceUsageAuditLogNegativeTestJSON-123189943-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Sep 16 12:45:20.286307 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7db32da1-5610-46f8-bc48-790dbea9d25d tempest-InstanceUsageAuditLogNegativeTestJSON-123189943 tempest-InstanceUsageAuditLogNegativeTestJSON-123189943-project-admin] Request method failure captured: Sep 16 12:45:20.286307 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Sep 16 12:45:20.286307 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:45:20.286307 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:45:20.286307 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:45:20.286307 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:45:20.286307 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:45:20.286307 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:45:20.286307 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:45:20.286307 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:45:20.286307 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJG_ep4QW8deBOOMFgq-rAddSC1RHiOJ-FdXFm8cxWim2MTKaPghMBq62nSLbq50HFvyFf_-kFPUyj_URUVaEvuFWQ6Xoh9wjy8Lu9WJt7dpDx8DiMJLZmtD1vdWCJPyhAHPf6zcVqYdM9hAWA51blRGu2ySIjLbGiWCPujuhgxDx8f8 Sep 16 12:45:20.286307 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:45:20.286307 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:45:20.286307 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:45:20.286307 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:45:20.286307 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:45:20.286307 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:45:20.286307 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: b661409e8e5b4762846d86618e2e2480 Sep 16 12:45:20.286307 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-123189943 Sep 16 12:45:20.286307 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,admin,reader Sep 16 12:45:20.286307 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,admin,reader Sep 16 12:45:20.288106 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b661409e8e5b4762846d86618e2e2480"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b661409e8e5b4762846d86618e2e2480"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b661409e8e5b4762846d86618e2e2480", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b661409e8e5b4762846d86618e2e2480"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:45:20.288106 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-123189943 Sep 16 12:45:20.288106 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: b661409e8e5b4762846d86618e2e2480 Sep 16 12:45:20.288106 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-123189943 Sep 16 12:45:20.288106 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-123189943-project-admin Sep 16 12:45:20.288106 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:45:20.288106 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:45:20.288106 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: b0e63b9b38624706b241c9e84e835627 Sep 16 12:45:20.288106 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-123189943-project-admin Sep 16 12:45:20.288106 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:45:20.288106 n-d-858094-4 devstack@n-api.service[128779]: exception: Invalid timestamp for date invalid_time Sep 16 12:45:20.288942 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': 'invalid_time'} Sep 16 12:45:20.288942 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:45:20.288942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:20.288942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Sep 16 12:45:20.288942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Sep 16 12:45:20.288942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Sep 16 12:45:20.288942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Sep 16 12:45:20.288942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Sep 16 12:45:20.288942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Sep 16 12:45:20.288942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Sep 16 12:45:20.288942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:20.288942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:20.288942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:20.288942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:20.288942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:20.288942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:20.288942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:45:20.288942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:45:20.288942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:45:20.288942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:45:20.290237 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Sep 16 12:45:20.290237 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Sep 16 12:45:20.290237 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Sep 16 12:45:20.290237 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:20.290237 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:20.290237 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:20.290237 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:20.290237 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:20.290237 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:20.290237 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:45:20.290237 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:45:20.290237 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Sep 16 12:45:20.290237 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:20.291037 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7db32da1-5610-46f8-bc48-790dbea9d25d tempest-InstanceUsageAuditLogNegativeTestJSON-123189943 tempest-InstanceUsageAuditLogNegativeTestJSON-123189943-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:45:20.292620 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7db32da1-5610-46f8-bc48-790dbea9d25d tempest-InstanceUsageAuditLogNegativeTestJSON-123189943 tempest-InstanceUsageAuditLogNegativeTestJSON-123189943-project-admin] 10.222.0.67 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.342550 Sep 16 12:45:20.293423 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 5/8] 10.222.0.67 () {58 vars in 1224 bytes} [Fri Sep 16 12:45:19 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 344 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 16 12:45:20.303863 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fa9bfdce-2945-45a2-849f-3ecd03cb42eb tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:20.304863 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fa9bfdce-2945-45a2-849f-3ecd03cb42eb tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: 3ab83a18-0e02-4082-a9f8-b7f93ad2e347] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:20.507757 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f7c4e005-183c-4eda-9445-cab31a357db7 tempest-FlavorMetadataValidation-1641162061 tempest-FlavorMetadataValidation-1641162061-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/1940851477/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.244229 Sep 16 12:45:20.508323 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 4/9] 10.222.0.67 () {62 vars in 1265 bytes} [Fri Sep 16 12:45:20 2022] POST /compute/v2.1/flavors/1940851477/os-extra_specs => generated 62 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:20.621373 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fa9bfdce-2945-45a2-849f-3ecd03cb42eb tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da877221336e4e58859c207fca5e857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b6b2ef87ef4629941a0cc9942d7e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:20.644521 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fa9bfdce-2945-45a2-849f-3ecd03cb42eb tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347" status: 200 len: 1220 microversion: 2.1 time: 0.344214 Sep 16 12:45:20.645577 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 6/10] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:20 2022] GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347 => generated 1220 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:20.660270 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b602d3fe-7624-44e3-b21e-d76e56170019 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:20.670700 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7d9dd7d6-8b83-463e-b509-ca871b589e27 tempest-AZAdminNegativeTestJSON-1440348802 tempest-AZAdminNegativeTestJSON-1440348802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:20.673805 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7d9dd7d6-8b83-463e-b509-ca871b589e27 tempest-AZAdminNegativeTestJSON-1440348802 tempest-AZAdminNegativeTestJSON-1440348802-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '3c50bdcf16b1416b9b82ac58b6aec614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ae9152956345f79a449d101b1bd290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:20.677479 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7d9dd7d6-8b83-463e-b509-ca871b589e27 tempest-AZAdminNegativeTestJSON-1440348802 tempest-AZAdminNegativeTestJSON-1440348802-project] Request method failure captured: Sep 16 12:45:20.677479 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Sep 16 12:45:20.677479 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:45:20.677479 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:45:20.677479 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:45:20.677479 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:45:20.677479 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:45:20.677479 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:45:20.677479 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:45:20.677479 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:45:20.677479 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJG_eyB8_4Xl4DAdfQAy_BDsM2BwgoTAEhwWr2_KdtO26E-QnifPOOmObc3yipt85SIPC3HHNPilQXCsyWWU1srq23qYn0Hq0ClMtZbxdCvlporeSGaVVX6sZxEHd3WXHugb7bAKFhVzWImRsHiX8pXUTI_saU483-mdKZ0cWh6xcsoY Sep 16 12:45:20.677479 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:45:20.677479 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:45:20.677479 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:45:20.677479 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:45:20.677479 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:45:20.677479 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:45:20.677479 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: e7ae9152956345f79a449d101b1bd290 Sep 16 12:45:20.677479 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1440348802 Sep 16 12:45:20.677479 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:45:20.677479 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:45:20.678786 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e7ae9152956345f79a449d101b1bd290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e7ae9152956345f79a449d101b1bd290"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e7ae9152956345f79a449d101b1bd290", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e7ae9152956345f79a449d101b1bd290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:45:20.678786 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-AZAdminNegativeTestJSON-1440348802 Sep 16 12:45:20.678786 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: e7ae9152956345f79a449d101b1bd290 Sep 16 12:45:20.678786 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1440348802 Sep 16 12:45:20.678786 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-AZAdminNegativeTestJSON-1440348802-project Sep 16 12:45:20.678786 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:45:20.678786 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:45:20.678786 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 3c50bdcf16b1416b9b82ac58b6aec614 Sep 16 12:45:20.678786 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-AZAdminNegativeTestJSON-1440348802-project Sep 16 12:45:20.678786 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:45:20.678786 n-d-858094-4 devstack@n-api.service[128780]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 16 12:45:20.678786 n-d-858094-4 devstack@n-api.service[128780]: action_args: {} Sep 16 12:45:20.679545 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:45:20.679545 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:20.679545 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:20.679545 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:20.679545 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:45:20.679545 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:45:20.679545 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:45:20.679545 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:45:20.679545 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Sep 16 12:45:20.679545 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Sep 16 12:45:20.679545 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 12:45:20.679545 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 12:45:20.679545 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 12:45:20.679545 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 12:45:20.679545 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:45:20.679545 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:45:20.679545 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:45:20.679545 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:45:20.679545 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 12:45:20.680577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 12:45:20.680577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 12:45:20.680577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 12:45:20.680577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 12:45:20.680577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 12:45:20.680577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 16 12:45:20.680577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:20.680577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:20.680577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:20.680577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:20.680577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:20.680577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:20.680577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 12:45:20.680577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 12:45:20.680577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 16 12:45:20.680577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:20.680577 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7d9dd7d6-8b83-463e-b509-ca871b589e27 tempest-AZAdminNegativeTestJSON-1440348802 tempest-AZAdminNegativeTestJSON-1440348802-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:45:20.681388 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7d9dd7d6-8b83-463e-b509-ca871b589e27 tempest-AZAdminNegativeTestJSON-1440348802 tempest-AZAdminNegativeTestJSON-1440348802-project] 10.222.0.67 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.170226 Sep 16 12:45:20.681388 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 5/11] 10.222.0.67 () {58 vars in 1185 bytes} [Fri Sep 16 12:45:20 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 172 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:45:20.687150 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-cc228317-32b5-4516-aa80-755d0b435186 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858094-4"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:20.699860 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b602d3fe-7624-44e3-b21e-d76e56170019 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1264504589" status: 202 len: 0 microversion: 2.1 time: 0.050056 Sep 16 12:45:20.700617 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 7/12] 10.222.0.67 () {58 vars in 1161 bytes} [Fri Sep 16 12:45:20 2022] DELETE /compute/v2.1/flavors/1264504589 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:45:20.730022 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cc228317-32b5-4516-aa80-755d0b435186 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:20.730795 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cc228317-32b5-4516-aa80-755d0b435186 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:20.731245 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cc228317-32b5-4516-aa80-755d0b435186 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:20.873325 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-87dd3d38-0e04-44f5-8221-613f10a8872c tempest-InstanceUsageAuditLogNegativeTestJSON-948982784 tempest-InstanceUsageAuditLogNegativeTestJSON-948982784-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:20.875780 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-87dd3d38-0e04-44f5-8221-613f10a8872c tempest-InstanceUsageAuditLogNegativeTestJSON-948982784 tempest-InstanceUsageAuditLogNegativeTestJSON-948982784-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'c24553906b3d4a4980473e8880fce86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674e465a0ced4ef394512b853e1e70a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:20.879819 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-87dd3d38-0e04-44f5-8221-613f10a8872c tempest-InstanceUsageAuditLogNegativeTestJSON-948982784 tempest-InstanceUsageAuditLogNegativeTestJSON-948982784-project] Request method failure captured: Sep 16 12:45:20.879819 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Sep 16 12:45:20.879819 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:45:20.879819 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:45:20.879819 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:45:20.879819 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:45:20.879819 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:45:20.879819 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:45:20.879819 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:45:20.879819 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:45:20.879819 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJG_b8Dt1040qhbiRDTNUGtyfoLzaW8b972WT48yJUxoqQveWdZTU0miAI0HTOSebWRdIf46GciHXISa48zY6B3-9rhE9f2_uw095FS6EycDYT-69oDPETmKZeEuoq1xGQhKf-sANs8M4zaw6b_JaIUEgETR3t0rMNcI1mZuGW4hmH0M Sep 16 12:45:20.879819 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:45:20.879819 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:45:20.879819 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:45:20.879819 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:45:20.879819 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:45:20.879819 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:45:20.879819 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 674e465a0ced4ef394512b853e1e70a4 Sep 16 12:45:20.879819 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-948982784 Sep 16 12:45:20.879819 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:45:20.879819 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:45:20.880897 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/674e465a0ced4ef394512b853e1e70a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/674e465a0ced4ef394512b853e1e70a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_674e465a0ced4ef394512b853e1e70a4", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/674e465a0ced4ef394512b853e1e70a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:45:20.880897 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-948982784 Sep 16 12:45:20.880897 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 674e465a0ced4ef394512b853e1e70a4 Sep 16 12:45:20.880897 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-948982784 Sep 16 12:45:20.880897 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-948982784-project Sep 16 12:45:20.880897 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:45:20.880897 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:45:20.880897 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: c24553906b3d4a4980473e8880fce86f Sep 16 12:45:20.880897 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-948982784-project Sep 16 12:45:20.880897 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:45:20.881467 n-d-858094-4 devstack@n-api.service[128779]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 16 12:45:20.881467 n-d-858094-4 devstack@n-api.service[128779]: action_args: {} Sep 16 12:45:20.881467 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:45:20.881467 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:20.881467 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:20.881467 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:20.881467 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:45:20.881467 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:45:20.881467 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:45:20.881467 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:45:20.881467 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Sep 16 12:45:20.881467 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Sep 16 12:45:20.881467 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 12:45:20.881467 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 12:45:20.881467 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 12:45:20.881467 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 12:45:20.881467 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:45:20.881467 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:45:20.881467 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:45:20.881467 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:45:20.882410 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 12:45:20.882410 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 12:45:20.882410 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 12:45:20.882410 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 12:45:20.882410 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 12:45:20.882410 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 12:45:20.882410 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 16 12:45:20.882410 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:20.882410 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:20.882410 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:20.882410 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:20.882410 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:20.882410 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:20.882410 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 12:45:20.882410 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 12:45:20.882410 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 16 12:45:20.882410 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:20.885715 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-87dd3d38-0e04-44f5-8221-613f10a8872c tempest-InstanceUsageAuditLogNegativeTestJSON-948982784 tempest-InstanceUsageAuditLogNegativeTestJSON-948982784-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:45:20.886908 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-87dd3d38-0e04-44f5-8221-613f10a8872c tempest-InstanceUsageAuditLogNegativeTestJSON-948982784 tempest-InstanceUsageAuditLogNegativeTestJSON-948982784-project] 10.222.0.67 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.185063 Sep 16 12:45:20.888398 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 8/13] 10.222.0.67 () {58 vars in 1185 bytes} [Fri Sep 16 12:45:20 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 187 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:45:20.897176 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-75b2c3b9-b416-4ca2-84f5-ad322f28f6a7 tempest-FlavorMetadataValidation-1641162061 tempest-FlavorMetadataValidation-1641162061-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:20.923613 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-75b2c3b9-b416-4ca2-84f5-ad322f28f6a7 tempest-FlavorMetadataValidation-1641162061 tempest-FlavorMetadataValidation-1641162061-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1940851477" status: 202 len: 0 microversion: 2.86 time: 0.029971 Sep 16 12:45:20.928611 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 9/14] 10.222.0.67 () {60 vars in 1202 bytes} [Fri Sep 16 12:45:20 2022] DELETE /compute/v2.1/flavors/1940851477 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:45:20.936378 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-adc1168f-0c7a-4897-9e52-84e4686c6fad tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:20.979537 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-adc1168f-0c7a-4897-9e52-84e4686c6fad tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049023 Sep 16 12:45:20.980605 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 10/15] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:45:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:20.987548 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9aeee16b-8706-4327-ad93-00004b2a93d2 tempest-InstanceUsageAuditLogNegativeTestJSON-948982784 tempest-InstanceUsageAuditLogNegativeTestJSON-948982784-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:20.990463 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9aeee16b-8706-4327-ad93-00004b2a93d2 tempest-InstanceUsageAuditLogNegativeTestJSON-948982784 tempest-InstanceUsageAuditLogNegativeTestJSON-948982784-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'c24553906b3d4a4980473e8880fce86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674e465a0ced4ef394512b853e1e70a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:20.992698 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9aeee16b-8706-4327-ad93-00004b2a93d2 tempest-InstanceUsageAuditLogNegativeTestJSON-948982784 tempest-InstanceUsageAuditLogNegativeTestJSON-948982784-project] Request method failure captured: Sep 16 12:45:20.992698 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-09-16%2012:45:20 HTTP/1.1 Sep 16 12:45:20.992698 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:45:20.992698 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:45:20.992698 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:45:20.992698 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:45:20.992698 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:45:20.992698 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:45:20.992698 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:45:20.992698 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:45:20.992698 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJG_b8Dt1040qhbiRDTNUGtyfoLzaW8b972WT48yJUxoqQveWdZTU0miAI0HTOSebWRdIf46GciHXISa48zY6B3-9rhE9f2_uw095FS6EycDYT-69oDPETmKZeEuoq1xGQhKf-sANs8M4zaw6b_JaIUEgETR3t0rMNcI1mZuGW4hmH0M Sep 16 12:45:20.992698 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:45:20.992698 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:45:20.992698 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:45:20.992698 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:45:20.992698 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:45:20.992698 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:45:20.992698 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 674e465a0ced4ef394512b853e1e70a4 Sep 16 12:45:20.992698 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-948982784 Sep 16 12:45:20.992698 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:45:20.992698 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:45:20.993893 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/674e465a0ced4ef394512b853e1e70a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/674e465a0ced4ef394512b853e1e70a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_674e465a0ced4ef394512b853e1e70a4", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/674e465a0ced4ef394512b853e1e70a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:45:20.993893 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-948982784 Sep 16 12:45:20.993893 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 674e465a0ced4ef394512b853e1e70a4 Sep 16 12:45:20.993893 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-948982784 Sep 16 12:45:20.993893 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-948982784-project Sep 16 12:45:20.993893 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:45:20.993893 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:45:20.993893 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: c24553906b3d4a4980473e8880fce86f Sep 16 12:45:20.993893 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-948982784-project Sep 16 12:45:20.993893 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:45:20.994469 n-d-858094-4 devstack@n-api.service[128779]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 16 12:45:20.994469 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '2022-09-16 12:45:20'} Sep 16 12:45:20.994469 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:45:20.994469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:20.994469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:20.994469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:20.994469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:45:20.994469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:45:20.994469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:45:20.994469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:45:20.994469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Sep 16 12:45:20.994469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Sep 16 12:45:20.994469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 12:45:20.994469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 12:45:20.994469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 12:45:20.994469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 12:45:20.994469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:45:20.994469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:45:20.994469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:45:20.994469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:45:20.995554 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 12:45:20.995554 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 12:45:20.995554 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 12:45:20.995554 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 12:45:20.995554 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 12:45:20.995554 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 12:45:20.995554 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 16 12:45:20.995554 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:20.995554 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:20.995554 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:20.995554 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:20.995554 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:20.995554 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:20.995554 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 12:45:20.995554 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 12:45:20.995554 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 16 12:45:20.995554 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:20.997804 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9aeee16b-8706-4327-ad93-00004b2a93d2 tempest-InstanceUsageAuditLogNegativeTestJSON-948982784 tempest-InstanceUsageAuditLogNegativeTestJSON-948982784-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:45:20.999232 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9aeee16b-8706-4327-ad93-00004b2a93d2 tempest-InstanceUsageAuditLogNegativeTestJSON-948982784 tempest-InstanceUsageAuditLogNegativeTestJSON-948982784-project] 10.222.0.67 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-16 12:45:20" status: 403 len: 128 microversion: 2.1 time: 0.016899 Sep 16 12:45:20.999787 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 11/16] 10.222.0.67 () {58 vars in 1251 bytes} [Fri Sep 16 12:45:20 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-16%2012%3A45%3A20 => generated 128 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:45:21.005244 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b2f5026d-1a37-4e0e-9b15-2a28281cb9b8 tempest-FlavorMetadataValidation-1641162061 tempest-FlavorMetadataValidation-1641162061-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:21.032258 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b2f5026d-1a37-4e0e-9b15-2a28281cb9b8 tempest-FlavorMetadataValidation-1641162061 tempest-FlavorMetadataValidation-1641162061-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.030723 Sep 16 12:45:21.033182 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 12/17] 10.222.0.67 () {60 vars in 1187 bytes} [Fri Sep 16 12:45:20 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:45:21.050779 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f9583897-f003-4212-8b7b-7742cb3f4599 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-216364204", "id": 1075640909, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:21.073448 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f9583897-f003-4212-8b7b-7742cb3f4599 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.038366 Sep 16 12:45:21.074082 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 13/18] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:45:21 2022] POST /compute/v2.1/flavors => generated 416 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:21.094163 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9a47a5ba-d420-465e-a841-bd9e7986f36e tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:21.149055 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9a47a5ba-d420-465e-a841-bd9e7986f36e tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.066258 Sep 16 12:45:21.156272 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 14/19] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:45:21 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:45:21.169807 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3fb1875d-f316-4b7e-adaf-78c0205ba8ed tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:21.201959 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3fb1875d-f316-4b7e-adaf-78c0205ba8ed tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1075640909" status: 202 len: 0 microversion: 2.1 time: 0.037244 Sep 16 12:45:21.203128 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 15/20] 10.222.0.67 () {58 vars in 1161 bytes} [Fri Sep 16 12:45:21 2022] DELETE /compute/v2.1/flavors/1075640909 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:45:21.211818 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d8f50c71-3c97-4437-b4bc-0716321dddd1 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:21.237536 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d8f50c71-3c97-4437-b4bc-0716321dddd1 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030266 Sep 16 12:45:21.238388 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 16/21] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:45:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:45:21.259444 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-cc228317-32b5-4516-aa80-755d0b435186 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 241 microversion: 2.1 time: 0.576734 Sep 16 12:45:21.260758 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 6/22] 10.222.0.67 () {60 vars in 1191 bytes} [Fri Sep 16 12:45:20 2022] POST /compute/v2.1/os-aggregates/1/action => generated 241 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:21.263991 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cfd4aab9-95a0-4384-b8ea-73799eb482ef tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-855863191", "id": 1617004987, "os-flavor-access:is_public": "True"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:21.274552 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-96405705-94be-4aa7-b04a-73e6e38d544f tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858094-4"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:21.290854 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cfd4aab9-95a0-4384-b8ea-73799eb482ef tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.034880 Sep 16 12:45:21.292035 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 17/23] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:45:21 2022] POST /compute/v2.1/flavors => generated 428 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:21.292306 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-96405705-94be-4aa7-b04a-73e6e38d544f tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:21.293079 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-96405705-94be-4aa7-b04a-73e6e38d544f tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:21.293679 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-96405705-94be-4aa7-b04a-73e6e38d544f tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:21.306115 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1bf06b45-19f1-4165-9376-8417457d68a0 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:21.337724 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1bf06b45-19f1-4165-9376-8417457d68a0 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1617004987" status: 202 len: 0 microversion: 2.1 time: 0.036928 Sep 16 12:45:21.340539 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 18/24] 10.222.0.67 () {58 vars in 1161 bytes} [Fri Sep 16 12:45:21 2022] DELETE /compute/v2.1/flavors/1617004987 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:45:21.349867 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-742e8a3f-2e28-4585-b5f2-c3e7e5a78133 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:21.354665 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-96405705-94be-4aa7-b04a-73e6e38d544f tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h2-858094-4. Sep 16 12:45:21.369316 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-96405705-94be-4aa7-b04a-73e6e38d544f tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Request method failure captured: Sep 16 12:45:21.369316 n-d-858094-4 devstack@n-api.service[128780]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Sep 16 12:45:21.369316 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:45:21.369316 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:45:21.369316 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:45:21.369316 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 39 Sep 16 12:45:21.369316 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:45:21.369316 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:45:21.369316 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:45:21.369316 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:45:21.369316 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJG_dogbGgb8xPb05DjnyijiK6Mr5ivsrHcfgXpJUa34jPkjYsTAmPzS2w_1GHOLXXLpuUCQrAngDbVNIzH3-D3FbpbURcrAYTyYXsAQMtJEJacsiRRJYUkaU2OvpukdMHrDuG6MZ9VzYzuhgiA-Ul1SCOpHVGtsqhqKC8f4bB7P4AWQ Sep 16 12:45:21.369316 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:45:21.369316 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:45:21.369316 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:45:21.369316 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:45:21.369316 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:45:21.369316 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:45:21.369316 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 2e7ba092719d4ecbaa47b6772f68b391 Sep 16 12:45:21.369316 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1426247531 Sep 16 12:45:21.369316 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,admin,reader Sep 16 12:45:21.369316 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,admin,reader Sep 16 12:45:21.370655 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2e7ba092719d4ecbaa47b6772f68b391"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2e7ba092719d4ecbaa47b6772f68b391"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2e7ba092719d4ecbaa47b6772f68b391", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2e7ba092719d4ecbaa47b6772f68b391"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:45:21.370655 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1426247531 Sep 16 12:45:21.370655 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 2e7ba092719d4ecbaa47b6772f68b391 Sep 16 12:45:21.370655 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1426247531 Sep 16 12:45:21.370655 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin Sep 16 12:45:21.370655 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:45:21.370655 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:45:21.370655 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 5968b368bb7449988a1a2f55d2e9cea0 Sep 16 12:45:21.370655 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin Sep 16 12:45:21.370655 n-d-858094-4 devstack@n-api.service[128780]: Sep 16 12:45:21.370655 n-d-858094-4 devstack@n-api.service[128780]: {"add_host": {"host": "n-h2-858094-4"}} Sep 16 12:45:21.370655 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:45:21.370655 n-d-858094-4 devstack@n-api.service[128780]: exception: Aggregate 1 already has host n-h2-858094-4. Sep 16 12:45:21.371314 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h2-858094-4'}}} Sep 16 12:45:21.371314 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:45:21.371314 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:21.371314 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 12:45:21.371314 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 16 12:45:21.371314 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 12:45:21.371314 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 16 12:45:21.371314 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 12:45:21.371314 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 16 12:45:21.371314 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 12:45:21.371314 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 16 12:45:21.371314 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 12:45:21.371314 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 12:45:21.371314 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 12:45:21.371314 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result.read() Sep 16 12:45:21.371314 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 12:45:21.371314 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 16 12:45:21.371314 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 12:45:21.371314 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 16 12:45:21.372293 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 12:45:21.372293 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 16 12:45:21.372293 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 12:45:21.372293 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 16 12:45:21.372293 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-858094-4-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 16 12:45:21.372293 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:21.372293 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 16 12:45:21.372293 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:21.372293 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:21.372293 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Sep 16 12:45:21.372293 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Sep 16 12:45:21.372293 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 16 12:45:21.372293 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi session.flush() Sep 16 12:45:21.372293 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 16 12:45:21.372293 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 16 12:45:21.372293 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 16 12:45:21.372293 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 16 12:45:21.372293 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 16 12:45:21.372293 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 16 12:45:21.373219 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 12:45:21.373219 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception Sep 16 12:45:21.373219 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 16 12:45:21.373219 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 16 12:45:21.373219 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 16 12:45:21.373219 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 16 12:45:21.373219 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 16 12:45:21.373219 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 16 12:45:21.373219 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 16 12:45:21.373219 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 16 12:45:21.373219 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 16 12:45:21.373219 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 16 12:45:21.373219 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 16 12:45:21.373219 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 16 12:45:21.373219 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 16 12:45:21.373219 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 16 12:45:21.373219 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 16 12:45:21.373219 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 16 12:45:21.374144 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 16 12:45:21.374144 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 16 12:45:21.374144 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 16 12:45:21.374144 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 16 12:45:21.374144 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 12:45:21.374144 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception Sep 16 12:45:21.374144 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 12:45:21.374144 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 16 12:45:21.374144 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 12:45:21.374144 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 16 12:45:21.374144 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 12:45:21.374144 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 16 12:45:21.374144 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 12:45:21.374144 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 16 12:45:21.374144 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 12:45:21.374144 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 12:45:21.374144 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 12:45:21.374144 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result.read() Sep 16 12:45:21.374999 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 12:45:21.374999 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 16 12:45:21.374999 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 12:45:21.374999 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 16 12:45:21.374999 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 12:45:21.374999 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 16 12:45:21.374999 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 12:45:21.374999 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 16 12:45:21.374999 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-858094-4-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 16 12:45:21.374999 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Sep 16 12:45:21.374999 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 16, 12, 45, 21, 334419), 'updated_at': None, 'host': 'n-h2-858094-4', 'aggregate_id': 1}] Sep 16 12:45:21.374999 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 16 12:45:21.374999 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:21.374999 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:21.374999 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:21.374999 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:21.374999 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 16 12:45:21.375816 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 16 12:45:21.375816 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 16 12:45:21.375816 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 16 12:45:21.375816 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:45:21.375816 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:45:21.375816 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:45:21.375816 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:45:21.375816 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 16 12:45:21.375816 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 16 12:45:21.375816 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Sep 16 12:45:21.375816 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Sep 16 12:45:21.375816 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 16 12:45:21.375816 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 16 12:45:21.375816 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Sep 16 12:45:21.375816 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Sep 16 12:45:21.375816 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Sep 16 12:45:21.375816 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Sep 16 12:45:21.375816 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h2-858094-4. Sep 16 12:45:21.375816 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:21.375816 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:21.376884 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:21.376884 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:21.376884 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:21.376884 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:21.376884 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:45:21.376884 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:45:21.376884 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:45:21.376884 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:45:21.376884 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:45:21.376884 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:45:21.376884 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Sep 16 12:45:21.376884 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 16 12:45:21.376884 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h2-858094-4. Sep 16 12:45:21.376884 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:21.376884 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:21.376884 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:21.376884 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:21.376884 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:21.376884 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:21.376884 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:45:21.376884 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:45:21.378053 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h2-858094-4. Sep 16 12:45:21.378053 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:21.384498 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-96405705-94be-4aa7-b04a-73e6e38d544f tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Returning 409 to user: Aggregate 1 already has host n-h2-858094-4. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:45:21.384498 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-96405705-94be-4aa7-b04a-73e6e38d544f tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.112731 Sep 16 12:45:21.384498 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 7/25] 10.222.0.67 () {60 vars in 1191 bytes} [Fri Sep 16 12:45:21 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 114 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Sep 16 12:45:21.390965 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4636fc3c-4256-491f-9282-bea308d008fc tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858094-4"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:21.401959 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-742e8a3f-2e28-4585-b5f2-c3e7e5a78133 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.057394 Sep 16 12:45:21.402652 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4636fc3c-4256-491f-9282-bea308d008fc tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:21.403254 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4636fc3c-4256-491f-9282-bea308d008fc tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:21.403821 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4636fc3c-4256-491f-9282-bea308d008fc tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:21.417018 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 19/26] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:45:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:21.426262 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-933b5bc1-bb9c-492f-a1be-a8d16e5f5439 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1261845609", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:21.468471 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-933b5bc1-bb9c-492f-a1be-a8d16e5f5439 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.043962 Sep 16 12:45:21.469410 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 20/27] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:45:21 2022] POST /compute/v2.1/flavors => generated 507 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:21.483347 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5470fff5-90fb-4a65-abdb-3e0f83044f4b tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:21.530664 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5470fff5-90fb-4a65-abdb-3e0f83044f4b tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/f129117c-2f9d-4e6f-b64f-c88bc4214083" status: 202 len: 0 microversion: 2.1 time: 0.052921 Sep 16 12:45:21.531451 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 21/28] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:45:21 2022] DELETE /compute/v2.1/flavors/f129117c-2f9d-4e6f-b64f-c88bc4214083 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 12:45:21.542074 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a02a5e98-d3ea-40d8-b5fc-91d666e47cc6 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:21.565274 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a02a5e98-d3ea-40d8-b5fc-91d666e47cc6 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029292 Sep 16 12:45:21.565859 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 22/29] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:45:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:21.586574 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4636fc3c-4256-491f-9282-bea308d008fc tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 226 microversion: 2.1 time: 0.197929 Sep 16 12:45:21.586947 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bf35cad0-4cf2-4ceb-8674-ff40e3d44c76 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-842172878", "id": "2b3df17e-870d-4689-9e00-7ded003348a1", "os-flavor-access:is_public": "True"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:21.592313 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 8/30] 10.222.0.67 () {60 vars in 1191 bytes} [Fri Sep 16 12:45:21 2022] POST /compute/v2.1/os-aggregates/1/action => generated 226 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:45:21.605721 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f9690dfc-d8a7-4e63-8ff1-e5ade608003e tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:21.616047 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bf35cad0-4cf2-4ceb-8674-ff40e3d44c76 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.032957 Sep 16 12:45:21.628665 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 23/31] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:45:21 2022] POST /compute/v2.1/flavors => generated 506 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:21.637747 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7c7ed30b-9c3c-4097-bae3-b77671a90fc6 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:21.661416 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f9690dfc-d8a7-4e63-8ff1-e5ade608003e tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.061952 Sep 16 12:45:21.663070 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 9/32] 10.222.0.67 () {58 vars in 1152 bytes} [Fri Sep 16 12:45:21 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 16 12:45:21.675426 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-aa789d96-2474-4998-a371-1ab446da0f6f tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2091112470"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:21.691322 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7c7ed30b-9c3c-4097-bae3-b77671a90fc6 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/2b3df17e-870d-4689-9e00-7ded003348a1" status: 202 len: 0 microversion: 2.1 time: 0.061418 Sep 16 12:45:21.692294 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 24/33] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:45:21 2022] DELETE /compute/v2.1/flavors/2b3df17e-870d-4689-9e00-7ded003348a1 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:45:21.704176 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a3c5a734-d7a2-45ff-92e0-61415b5d8bdf tempest-AggregatesAdminTestV241-106167985 tempest-AggregatesAdminTestV241-106167985-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-393828213"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:21.714705 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.aggregate [None req-a3c5a734-d7a2-45ff-92e0-61415b5d8bdf tempest-AggregatesAdminTestV241-106167985 tempest-AggregatesAdminTestV241-106167985-project-admin] Generated uuid 065aa1c1-6840-4c12-801f-89e09a2c8c52 for aggregate {{(pid=128779) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 16 12:45:21.733266 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.aggregate [None req-aa789d96-2474-4998-a371-1ab446da0f6f tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Generated uuid 2b59d4c5-8d66-4c4d-afa9-7c74a5cfe9a0 for aggregate {{(pid=128780) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 16 12:45:21.765531 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-aa789d96-2474-4998-a371-1ab446da0f6f tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.094405 Sep 16 12:45:21.768043 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 10/34] 10.222.0.67 () {60 vars in 1164 bytes} [Fri Sep 16 12:45:21 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:21.774270 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-58fb4829-522a-48d3-9fbb-1fe6dfe5a0f5 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:21.775282 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-58fb4829-522a-48d3-9fbb-1fe6dfe5a0f5 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: 3ab83a18-0e02-4082-a9f8-b7f93ad2e347] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:21.790388 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-58fb4829-522a-48d3-9fbb-1fe6dfe5a0f5 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:21.790930 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-58fb4829-522a-48d3-9fbb-1fe6dfe5a0f5 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:21.791363 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-58fb4829-522a-48d3-9fbb-1fe6dfe5a0f5 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:21.792152 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-58fb4829-522a-48d3-9fbb-1fe6dfe5a0f5 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:21.792773 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-58fb4829-522a-48d3-9fbb-1fe6dfe5a0f5 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:21.793334 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-58fb4829-522a-48d3-9fbb-1fe6dfe5a0f5 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:21.817162 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a3c5a734-d7a2-45ff-92e0-61415b5d8bdf tempest-AggregatesAdminTestV241-106167985 tempest-AggregatesAdminTestV241-106167985-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.122611 Sep 16 12:45:21.818055 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 25/35] 10.222.0.67 () {62 vars in 1205 bytes} [Fri Sep 16 12:45:21 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:45:21.831375 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8b257dd0-5820-489f-8015-2685d0448687 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:21.858752 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8b257dd0-5820-489f-8015-2685d0448687 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039106 Sep 16 12:45:21.859643 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 26/36] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:45:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:22.069137 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-58fb4829-522a-48d3-9fbb-1fe6dfe5a0f5 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da877221336e4e58859c207fca5e857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b6b2ef87ef4629941a0cc9942d7e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:22.089035 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-58fb4829-522a-48d3-9fbb-1fe6dfe5a0f5 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347" status: 200 len: 1272 microversion: 2.1 time: 0.319835 Sep 16 12:45:22.089899 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 11/37] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:21 2022] GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347 => generated 1272 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:22.112058 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-522d0033-0fb7-4cce-924c-aed3fb430521 tempest-AggregatesAdminTestV241-106167985 tempest-AggregatesAdminTestV241-106167985-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-711392186"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:22.190667 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d4d5d8e7-9362-4e46-81d5-76fc011fd0fc tempest-AggregatesAdminNegativeTestJSON-544684390 tempest-AggregatesAdminNegativeTestJSON-544684390-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858094-4"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:22.198267 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d4d5d8e7-9362-4e46-81d5-76fc011fd0fc tempest-AggregatesAdminNegativeTestJSON-544684390 tempest-AggregatesAdminNegativeTestJSON-544684390-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '9eaa59a269b5458d811b4dbf79441e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6be22224574c009206f30e23b43b21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:22.204730 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d4d5d8e7-9362-4e46-81d5-76fc011fd0fc tempest-AggregatesAdminNegativeTestJSON-544684390 tempest-AggregatesAdminNegativeTestJSON-544684390-project] Request method failure captured: Sep 16 12:45:22.204730 n-d-858094-4 devstack@n-api.service[128779]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Sep 16 12:45:22.204730 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:45:22.204730 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:45:22.204730 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:45:22.204730 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 39 Sep 16 12:45:22.204730 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:45:22.204730 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:45:22.204730 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:45:22.204730 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:45:22.204730 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJG_bVMOHzDIswazZ9MfDkLIuM6hqut9iR_HdPuvuNzJ3OaMJU4v7qJVkw2N4Pq_29Alggv3ZD22jd8wYZXPFFnIaUBKSO0kTC1gg08bgOJ_f2NYnpe8bGI68mEVukHwq8TFFX_B9bMbTFdE7utHb4z7ixDnudhwpHYeL2KKBCXN8YBc Sep 16 12:45:22.204730 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:45:22.204730 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:45:22.204730 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:45:22.204730 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:45:22.204730 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:45:22.204730 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:45:22.204730 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 3e6be22224574c009206f30e23b43b21 Sep 16 12:45:22.204730 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-544684390 Sep 16 12:45:22.204730 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:45:22.204730 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:45:22.206093 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3e6be22224574c009206f30e23b43b21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3e6be22224574c009206f30e23b43b21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3e6be22224574c009206f30e23b43b21", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3e6be22224574c009206f30e23b43b21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:45:22.206093 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-544684390 Sep 16 12:45:22.206093 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 3e6be22224574c009206f30e23b43b21 Sep 16 12:45:22.206093 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-544684390 Sep 16 12:45:22.206093 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-AggregatesAdminNegativeTestJSON-544684390-project Sep 16 12:45:22.206093 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:45:22.206093 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:45:22.206093 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 9eaa59a269b5458d811b4dbf79441e1f Sep 16 12:45:22.206093 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-544684390-project Sep 16 12:45:22.206093 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 12:45:22.206093 n-d-858094-4 devstack@n-api.service[128779]: {"add_host": {"host": "n-h2-858094-4"}} Sep 16 12:45:22.206093 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:45:22.206093 n-d-858094-4 devstack@n-api.service[128779]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 16 12:45:22.206899 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h2-858094-4'}}} Sep 16 12:45:22.206899 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:45:22.206899 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:22.206899 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:22.206899 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:22.206899 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:45:22.206899 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:45:22.206899 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:45:22.206899 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:45:22.206899 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:45:22.206899 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:45:22.206899 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Sep 16 12:45:22.206899 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Sep 16 12:45:22.206899 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 12:45:22.206899 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 12:45:22.206899 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 12:45:22.206899 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 12:45:22.206899 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:45:22.206899 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:45:22.208014 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:45:22.208014 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:45:22.208014 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 12:45:22.208014 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 12:45:22.208014 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 12:45:22.208014 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 12:45:22.208014 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 12:45:22.208014 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 12:45:22.208014 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 16 12:45:22.208014 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:22.208014 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:22.208014 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:22.208014 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:22.208014 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:22.208014 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:22.208014 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 12:45:22.208014 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 12:45:22.208014 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 16 12:45:22.208014 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:22.210898 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d4d5d8e7-9362-4e46-81d5-76fc011fd0fc tempest-AggregatesAdminNegativeTestJSON-544684390 tempest-AggregatesAdminNegativeTestJSON-544684390-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:45:22.211897 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d4d5d8e7-9362-4e46-81d5-76fc011fd0fc tempest-AggregatesAdminNegativeTestJSON-544684390 tempest-AggregatesAdminNegativeTestJSON-544684390-project] 10.222.0.67 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.351194 Sep 16 12:45:22.215084 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 27/38] 10.222.0.67 () {60 vars in 1191 bytes} [Fri Sep 16 12:45:21 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 355 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:45:22.221819 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7becfc99-7b36-4529-b98e-cf0d252b2c5a tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-579197026", "id": 1297525649, "os-flavor-access:is_public": "True"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:22.240623 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6,nova_api:DELETE=18 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:45:22.254333 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-522d0033-0fb7-4cce-924c-aed3fb430521 tempest-AggregatesAdminTestV241-106167985 tempest-AggregatesAdminTestV241-106167985-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-aggregates/3" status: 200 len: 298 microversion: 2.41 time: 0.162891 Sep 16 12:45:22.254946 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 12/39] 10.222.0.67 () {62 vars in 1210 bytes} [Fri Sep 16 12:45:22 2022] PUT /compute/v2.1/os-aggregates/3 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:45:22.262553 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fe5abab0-0ede-4221-a15b-2f5a7a34c0d3 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:22.269954 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7becfc99-7b36-4529-b98e-cf0d252b2c5a tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.053623 Sep 16 12:45:22.270773 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 28/40] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:45:22 2022] POST /compute/v2.1/flavors => generated 413 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:22.284029 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-61d8d300-004c-42e4-b703-57e0260cef17 tempest-AggregatesAdminTestV241-106167985 tempest-AggregatesAdminTestV241-106167985-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:22.307988 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-61d8d300-004c-42e4-b703-57e0260cef17 tempest-AggregatesAdminTestV241-106167985 tempest-AggregatesAdminTestV241-106167985-project-admin] 10.222.0.67 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 298 microversion: 2.41 time: 0.028282 Sep 16 12:45:22.310524 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 29/41] 10.222.0.67 () {60 vars in 1190 bytes} [Fri Sep 16 12:45:22 2022] GET /compute/v2.1/os-aggregates/3 => generated 298 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:45:22.315151 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9db759ae-6e3c-4d5f-801a-545fd2422a25 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:22.331048 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-fe5abab0-0ede-4221-a15b-2f5a7a34c0d3 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.053609 Sep 16 12:45:22.337209 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 13/42] 10.222.0.67 () {58 vars in 1152 bytes} [Fri Sep 16 12:45:22 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 16 12:45:22.350363 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9db759ae-6e3c-4d5f-801a-545fd2422a25 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/1297525649" status: 200 len: 413 microversion: 2.1 time: 0.036685 Sep 16 12:45:22.354840 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b388169c-b068-4f4f-8e74-7caa023e14e4 tempest-AggregatesAdminTestV241-106167985 tempest-AggregatesAdminTestV241-106167985-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858094-4"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:22.363087 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 30/43] 10.222.0.67 () {58 vars in 1158 bytes} [Fri Sep 16 12:45:22 2022] GET /compute/v2.1/flavors/1297525649 => generated 413 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:22.376790 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7068b9e3-9022-4a72-a315-8f77e9c0f310 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1262913339"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:22.379086 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b388169c-b068-4f4f-8e74-7caa023e14e4 tempest-AggregatesAdminTestV241-106167985 tempest-AggregatesAdminTestV241-106167985-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:22.379776 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b388169c-b068-4f4f-8e74-7caa023e14e4 tempest-AggregatesAdminTestV241-106167985 tempest-AggregatesAdminTestV241-106167985-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:22.380494 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b388169c-b068-4f4f-8e74-7caa023e14e4 tempest-AggregatesAdminTestV241-106167985 tempest-AggregatesAdminTestV241-106167985-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:22.380640 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.aggregate [None req-7068b9e3-9022-4a72-a315-8f77e9c0f310 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Generated uuid 511adceb-c735-4e00-984b-5b66d14af24b for aggregate {{(pid=128779) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 16 12:45:22.408454 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7068b9e3-9022-4a72-a315-8f77e9c0f310 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.043755 Sep 16 12:45:22.411811 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 31/44] 10.222.0.67 () {60 vars in 1164 bytes} [Fri Sep 16 12:45:22 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:22.663584 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-443e3319-63f9-4f3b-9a59-782b112efd15 tempest-FlavorsAdminTestJSON-789456293 tempest-FlavorsAdminTestJSON-789456293-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:22.665907 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b388169c-b068-4f4f-8e74-7caa023e14e4 tempest-AggregatesAdminTestV241-106167985 tempest-AggregatesAdminTestV241-106167985-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 313 microversion: 2.41 time: 0.325634 Sep 16 12:45:22.667464 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 14/45] 10.222.0.67 () {62 vars in 1232 bytes} [Fri Sep 16 12:45:22 2022] POST /compute/v2.1/os-aggregates/3/action => generated 313 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:45:22.691689 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e1a7cf90-a7c6-4c97-8dda-90bc5f08dcf4 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1604314719"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:22.707987 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-443e3319-63f9-4f3b-9a59-782b112efd15 tempest-FlavorsAdminTestJSON-789456293 tempest-FlavorsAdminTestJSON-789456293-project] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.293823 Sep 16 12:45:22.709797 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 32/46] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:45:22 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:22.721812 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-baca1c43-9337-4a21-a36a-aaff4a577af9 tempest-AggregatesAdminTestV241-106167985 tempest-AggregatesAdminTestV241-106167985-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858094-4"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:22.765750 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-baca1c43-9337-4a21-a36a-aaff4a577af9 tempest-AggregatesAdminTestV241-106167985 tempest-AggregatesAdminTestV241-106167985-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:22.767171 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-baca1c43-9337-4a21-a36a-aaff4a577af9 tempest-AggregatesAdminTestV241-106167985 tempest-AggregatesAdminTestV241-106167985-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:22.767666 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-baca1c43-9337-4a21-a36a-aaff4a577af9 tempest-AggregatesAdminTestV241-106167985 tempest-AggregatesAdminTestV241-106167985-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:22.784169 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e1a7cf90-a7c6-4c97-8dda-90bc5f08dcf4 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),19bb4c25-c68f-412b-8c46-4f5dc22c63ee(cell1) {{(pid=128780) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 16 12:45:22.794041 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1a7cf90-a7c6-4c97-8dda-90bc5f08dcf4 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:22.794828 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1a7cf90-a7c6-4c97-8dda-90bc5f08dcf4 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:22.795519 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1a7cf90-a7c6-4c97-8dda-90bc5f08dcf4 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:22.807649 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1a7cf90-a7c6-4c97-8dda-90bc5f08dcf4 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:22.808298 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1a7cf90-a7c6-4c97-8dda-90bc5f08dcf4 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:22.809498 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1a7cf90-a7c6-4c97-8dda-90bc5f08dcf4 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:22.823527 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-e1a7cf90-a7c6-4c97-8dda-90bc5f08dcf4 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1604314719 could not be found. Sep 16 12:45:22.840014 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e1a7cf90-a7c6-4c97-8dda-90bc5f08dcf4 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Request method failure captured: Sep 16 12:45:22.840014 n-d-858094-4 devstack@n-api.service[128780]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Sep 16 12:45:22.840014 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:45:22.840014 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:45:22.840014 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:45:22.840014 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 58 Sep 16 12:45:22.840014 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:45:22.840014 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:45:22.840014 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:45:22.840014 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:45:22.840014 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJG_dogbGgb8xPb05DjnyijiK6Mr5ivsrHcfgXpJUa34jPkjYsTAmPzS2w_1GHOLXXLpuUCQrAngDbVNIzH3-D3FbpbURcrAYTyYXsAQMtJEJacsiRRJYUkaU2OvpukdMHrDuG6MZ9VzYzuhgiA-Ul1SCOpHVGtsqhqKC8f4bB7P4AWQ Sep 16 12:45:22.840014 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:45:22.840014 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:45:22.840014 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:45:22.840014 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:45:22.840014 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:45:22.840014 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:45:22.840014 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 2e7ba092719d4ecbaa47b6772f68b391 Sep 16 12:45:22.840014 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1426247531 Sep 16 12:45:22.840014 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,admin,reader Sep 16 12:45:22.840014 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,admin,reader Sep 16 12:45:22.841194 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2e7ba092719d4ecbaa47b6772f68b391"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2e7ba092719d4ecbaa47b6772f68b391"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2e7ba092719d4ecbaa47b6772f68b391", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2e7ba092719d4ecbaa47b6772f68b391"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:45:22.841194 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1426247531 Sep 16 12:45:22.841194 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 2e7ba092719d4ecbaa47b6772f68b391 Sep 16 12:45:22.841194 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1426247531 Sep 16 12:45:22.841194 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin Sep 16 12:45:22.841194 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:45:22.841194 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:45:22.841194 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 5968b368bb7449988a1a2f55d2e9cea0 Sep 16 12:45:22.841194 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin Sep 16 12:45:22.841194 n-d-858094-4 devstack@n-api.service[128780]: Sep 16 12:45:22.841194 n-d-858094-4 devstack@n-api.service[128780]: {"add_host": {"host": "tempest-nonexist_host-1604314719"}} Sep 16 12:45:22.841194 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:45:22.841793 n-d-858094-4 devstack@n-api.service[128780]: exception: Compute host tempest-nonexist_host-1604314719 could not be found. Sep 16 12:45:22.841793 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-1604314719'}}} Sep 16 12:45:22.841793 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:45:22.841793 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:22.841793 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 16 12:45:22.841793 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 16 12:45:22.841793 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 12:45:22.841793 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 12:45:22.841793 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 16 12:45:22.841793 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 16 12:45:22.841793 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 12:45:22.841793 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 12:45:22.841793 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 16 12:45:22.841793 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 16 12:45:22.841793 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1604314719' is not mapped to any cell Sep 16 12:45:22.841793 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:22.841793 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:22.841793 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:22.841793 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:22.841793 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 16 12:45:22.842803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 16 12:45:22.842803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 16 12:45:22.842803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 16 12:45:22.842803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 16 12:45:22.842803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:22.842803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:22.842803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:22.842803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:22.842803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 16 12:45:22.842803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 16 12:45:22.842803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 16 12:45:22.842803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 16 12:45:22.842803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:45:22.842803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:45:22.842803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:45:22.842803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:45:22.842803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 16 12:45:22.842803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 16 12:45:22.842803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Sep 16 12:45:22.842803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Sep 16 12:45:22.843801 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 16 12:45:22.843801 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 16 12:45:22.843801 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1604314719 could not be found. Sep 16 12:45:22.843801 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:22.843801 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:22.843801 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:22.843801 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:22.843801 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:22.843801 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:22.843801 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:45:22.843801 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:45:22.843801 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:45:22.843801 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:45:22.843801 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:45:22.843801 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:45:22.843801 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Sep 16 12:45:22.843801 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:45:22.843801 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1604314719 could not be found. Sep 16 12:45:22.843801 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:22.843801 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:22.843801 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:22.849399 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:22.849399 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:22.849399 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:22.849399 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:45:22.849399 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:45:22.849399 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1604314719 could not be found. Sep 16 12:45:22.849399 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:22.849399 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e1a7cf90-a7c6-4c97-8dda-90bc5f08dcf4 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1604314719 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:45:22.849399 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e1a7cf90-a7c6-4c97-8dda-90bc5f08dcf4 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 111 microversion: 2.1 time: 0.162345 Sep 16 12:45:22.849399 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 15/47] 10.222.0.67 () {60 vars in 1191 bytes} [Fri Sep 16 12:45:22 2022] POST /compute/v2.1/os-aggregates/4/action => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:45:22.850790 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-25cf19dd-5c22-4945-a24b-fde1e82c84f5 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:22.918084 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-25cf19dd-5c22-4945-a24b-fde1e82c84f5 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1297525649" status: 202 len: 0 microversion: 2.1 time: 0.084954 Sep 16 12:45:22.919431 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 16/48] 10.222.0.67 () {58 vars in 1161 bytes} [Fri Sep 16 12:45:22 2022] DELETE /compute/v2.1/flavors/1297525649 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:45:22.940554 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-88c5a98e-ce06-499a-98e5-c3d1cbadbf13 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:22.954548 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=11,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=8,nova_api:UPDATE=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:45:22.998208 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-88c5a98e-ce06-499a-98e5-c3d1cbadbf13 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.077601 Sep 16 12:45:23.002745 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 17/49] 10.222.0.67 () {58 vars in 1152 bytes} [Fri Sep 16 12:45:22 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 16 12:45:23.016587 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-12a14c53-0833-45d2-af2c-b943cd6a14d0 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:23.054872 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-12a14c53-0833-45d2-af2c-b943cd6a14d0 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050843 Sep 16 12:45:23.055478 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 18/50] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:45:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:23.073955 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-264b2b94-f665-4d1e-94bb-6d5c9aa0cc99 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:23.083672 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-264b2b94-f665-4d1e-94bb-6d5c9aa0cc99 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Request method failure captured: Sep 16 12:45:23.083672 n-d-858094-4 devstack@n-api.service[128780]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 16 12:45:23.083672 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:45:23.083672 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:45:23.083672 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:45:23.083672 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 283 Sep 16 12:45:23.083672 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:45:23.083672 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:45:23.083672 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:45:23.083672 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:45:23.083672 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJG_dogbGgb8xPb05DjnyijiK6Mr5ivsrHcfgXpJUa34jPkjYsTAmPzS2w_1GHOLXXLpuUCQrAngDbVNIzH3-D3FbpbURcrAYTyYXsAQMtJEJacsiRRJYUkaU2OvpukdMHrDuG6MZ9VzYzuhgiA-Ul1SCOpHVGtsqhqKC8f4bB7P4AWQ Sep 16 12:45:23.083672 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:45:23.083672 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:45:23.083672 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:45:23.083672 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:45:23.083672 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:45:23.083672 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:45:23.083672 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 2e7ba092719d4ecbaa47b6772f68b391 Sep 16 12:45:23.083672 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1426247531 Sep 16 12:45:23.083672 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,admin,reader Sep 16 12:45:23.083672 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,admin,reader Sep 16 12:45:23.084960 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2e7ba092719d4ecbaa47b6772f68b391"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2e7ba092719d4ecbaa47b6772f68b391"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2e7ba092719d4ecbaa47b6772f68b391", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2e7ba092719d4ecbaa47b6772f68b391"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:45:23.084960 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1426247531 Sep 16 12:45:23.084960 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 2e7ba092719d4ecbaa47b6772f68b391 Sep 16 12:45:23.084960 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1426247531 Sep 16 12:45:23.084960 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin Sep 16 12:45:23.084960 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:45:23.084960 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:45:23.084960 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 5968b368bb7449988a1a2f55d2e9cea0 Sep 16 12:45:23.084960 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin Sep 16 12:45:23.084960 n-d-858094-4 devstack@n-api.service[128780]: Sep 16 12:45:23.085610 n-d-858094-4 devstack@n-api.service[128780]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 16 12:45:23.085610 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:45:23.085610 n-d-858094-4 devstack@n-api.service[128780]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 16 12:45:23.085610 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 16 12:45:23.085610 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:45:23.085610 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:23.085610 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 12:45:23.085610 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 12:45:23.085610 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 12:45:23.085610 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise error Sep 16 12:45:23.086183 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 16 12:45:23.086183 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:23.086183 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Sep 16 12:45:23.086183 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 16 12:45:23.086183 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:23.086183 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 16 12:45:23.086183 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 16 12:45:23.086183 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:23.086183 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:23.086183 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:23.086183 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:23.086183 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:23.086183 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:23.086183 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:45:23.086183 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:45:23.086183 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:45:23.086183 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:45:23.087171 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:45:23.087171 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:45:23.087171 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 12:45:23.087171 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 12:45:23.087171 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 12:45:23.087171 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 12:45:23.087171 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 12:45:23.087171 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 12:45:23.087171 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 16 12:45:23.087171 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:23.087171 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:23.087171 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:23.087171 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:23.087171 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:23.087171 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:23.089830 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 12:45:23.089830 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 12:45:23.089830 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 16 12:45:23.089830 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:23.089830 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-264b2b94-f665-4d1e-94bb-6d5c9aa0cc99 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:45:23.090487 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-264b2b94-f665-4d1e-94bb-6d5c9aa0cc99 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.031366 Sep 16 12:45:23.095616 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 19/51] 10.222.0.67 () {60 vars in 1165 bytes} [Fri Sep 16 12:45:23 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 12:45:23.105572 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d8211196-414c-4212-b393-29100023ccce tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1641531490", "id": 1640724382, "os-flavor-access:is_public": "False"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:23.179431 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d8211196-414c-4212-b393-29100023ccce tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.085364 Sep 16 12:45:23.181244 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 20/52] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:45:23 2022] POST /compute/v2.1/flavors => generated 430 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:23.194801 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5a6d417e-7cba-4ef0-ae53-edbfeda82128 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:23.206035 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5a6d417e-7cba-4ef0-ae53-edbfeda82128 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Request method failure captured: Sep 16 12:45:23.206035 n-d-858094-4 devstack@n-api.service[128780]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 16 12:45:23.206035 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:45:23.206035 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:45:23.206035 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:45:23.206035 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 27 Sep 16 12:45:23.206035 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:45:23.206035 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:45:23.206035 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:45:23.206035 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:45:23.206035 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJG_dogbGgb8xPb05DjnyijiK6Mr5ivsrHcfgXpJUa34jPkjYsTAmPzS2w_1GHOLXXLpuUCQrAngDbVNIzH3-D3FbpbURcrAYTyYXsAQMtJEJacsiRRJYUkaU2OvpukdMHrDuG6MZ9VzYzuhgiA-Ul1SCOpHVGtsqhqKC8f4bB7P4AWQ Sep 16 12:45:23.206035 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:45:23.206035 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:45:23.206035 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:45:23.206035 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:45:23.206035 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:45:23.206035 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:45:23.206035 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 2e7ba092719d4ecbaa47b6772f68b391 Sep 16 12:45:23.206035 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1426247531 Sep 16 12:45:23.206035 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,admin,reader Sep 16 12:45:23.206035 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,admin,reader Sep 16 12:45:23.207330 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2e7ba092719d4ecbaa47b6772f68b391"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2e7ba092719d4ecbaa47b6772f68b391"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2e7ba092719d4ecbaa47b6772f68b391", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2e7ba092719d4ecbaa47b6772f68b391"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:45:23.207330 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1426247531 Sep 16 12:45:23.207330 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 2e7ba092719d4ecbaa47b6772f68b391 Sep 16 12:45:23.207330 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1426247531 Sep 16 12:45:23.207330 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin Sep 16 12:45:23.207330 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:45:23.207330 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:45:23.207330 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 5968b368bb7449988a1a2f55d2e9cea0 Sep 16 12:45:23.207330 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin Sep 16 12:45:23.207330 n-d-858094-4 devstack@n-api.service[128780]: Sep 16 12:45:23.207330 n-d-858094-4 devstack@n-api.service[128780]: {"aggregate": {"name": ""}} Sep 16 12:45:23.207330 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:45:23.207330 n-d-858094-4 devstack@n-api.service[128780]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 16 12:45:23.208140 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'body': {'aggregate': {'name': ''}}} Sep 16 12:45:23.208140 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:45:23.208140 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:23.208140 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 12:45:23.208140 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 12:45:23.208140 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 12:45:23.208140 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise error Sep 16 12:45:23.208140 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 16 12:45:23.208140 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:23.208140 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Sep 16 12:45:23.208140 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 16 12:45:23.208140 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:23.208140 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 16 12:45:23.208140 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi '' Sep 16 12:45:23.208140 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:23.208140 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:23.208140 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:23.208140 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:23.208140 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:23.208140 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:23.208140 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:45:23.208140 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:45:23.208140 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:45:23.209479 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:45:23.209479 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:45:23.209479 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:45:23.209479 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 12:45:23.209479 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 12:45:23.209479 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 12:45:23.209479 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 12:45:23.209479 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 12:45:23.209479 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 12:45:23.209479 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 16 12:45:23.209479 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:23.209479 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:23.209479 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:23.209479 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:23.209479 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:23.209479 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:23.209479 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 12:45:23.209479 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 12:45:23.209479 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 16 12:45:23.209479 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:23.214522 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5a6d417e-7cba-4ef0-ae53-edbfeda82128 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:45:23.217902 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5a6d417e-7cba-4ef0-ae53-edbfeda82128 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.032752 Sep 16 12:45:23.220310 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 21/53] 10.222.0.67 () {60 vars in 1164 bytes} [Fri Sep 16 12:45:23 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 12:45:23.232296 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-71c2d011-141c-454c-b8b2-00d3d1b3484c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:23.233479 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-71c2d011-141c-454c-b8b2-00d3d1b3484c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: 3ab83a18-0e02-4082-a9f8-b7f93ad2e347] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:23.246374 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-71c2d011-141c-454c-b8b2-00d3d1b3484c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:23.246893 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-71c2d011-141c-454c-b8b2-00d3d1b3484c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:23.247399 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-71c2d011-141c-454c-b8b2-00d3d1b3484c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:23.248116 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-71c2d011-141c-454c-b8b2-00d3d1b3484c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:23.248603 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-71c2d011-141c-454c-b8b2-00d3d1b3484c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:23.249036 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-71c2d011-141c-454c-b8b2-00d3d1b3484c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:23.323928 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-71c2d011-141c-454c-b8b2-00d3d1b3484c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da877221336e4e58859c207fca5e857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b6b2ef87ef4629941a0cc9942d7e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:23.335161 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-71c2d011-141c-454c-b8b2-00d3d1b3484c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347" status: 200 len: 1278 microversion: 2.1 time: 0.113244 Sep 16 12:45:23.336828 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 22/54] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:23 2022] GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347 => generated 1278 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:23.344048 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-59504a19-3339-4a27-87a9-25d9345a6feb tempest-FlavorsAdminTestJSON-789456293 tempest-FlavorsAdminTestJSON-789456293-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "1640724382"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:23.356517 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-59504a19-3339-4a27-87a9-25d9345a6feb tempest-FlavorsAdminTestJSON-789456293 tempest-FlavorsAdminTestJSON-789456293-project] HTTP exception thrown: Flavor 1640724382 could not be found. Sep 16 12:45:23.359746 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-59504a19-3339-4a27-87a9-25d9345a6feb tempest-FlavorsAdminTestJSON-789456293 tempest-FlavorsAdminTestJSON-789456293-project] Request method failure captured: Sep 16 12:45:23.359746 n-d-858094-4 devstack@n-api.service[128780]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 16 12:45:23.359746 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:45:23.359746 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:45:23.359746 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:45:23.359746 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 107 Sep 16 12:45:23.359746 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:45:23.359746 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:45:23.359746 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:45:23.359746 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:45:23.359746 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJG_bXoyJxYMVIcBT6vhmXZBFz43BJ7p2dw1qu5vYScvcuG5PjQoXHe96kCkvn-mHEHxpDG7Npl_8Ud7R2FKBXX59mnC37yGp-mE3A4Y60zVGkeA3-EUhBr_TsWVRzfoF9t2DX6LqA9OZzjYRpdLpS6if-2jj5bCNIZbmf7yNnOU_hBM Sep 16 12:45:23.359746 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:45:23.359746 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:45:23.359746 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:45:23.359746 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:45:23.359746 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:45:23.359746 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:45:23.359746 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 30e782d646d7424297d8217001408584 Sep 16 12:45:23.359746 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-FlavorsAdminTestJSON-789456293 Sep 16 12:45:23.359746 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:45:23.359746 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:45:23.361148 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/30e782d646d7424297d8217001408584"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/30e782d646d7424297d8217001408584"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_30e782d646d7424297d8217001408584", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/30e782d646d7424297d8217001408584"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:45:23.361148 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-FlavorsAdminTestJSON-789456293 Sep 16 12:45:23.361148 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 30e782d646d7424297d8217001408584 Sep 16 12:45:23.361148 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-789456293 Sep 16 12:45:23.361148 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-FlavorsAdminTestJSON-789456293-project Sep 16 12:45:23.361148 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:45:23.361148 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:45:23.361148 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 6d14d82021c5460a898b644199d21aae Sep 16 12:45:23.361148 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-FlavorsAdminTestJSON-789456293-project Sep 16 12:45:23.361148 n-d-858094-4 devstack@n-api.service[128780]: Sep 16 12:45:23.361148 n-d-858094-4 devstack@n-api.service[128780]: {"server": {"name": "test", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "1640724382"}} Sep 16 12:45:23.361148 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:45:23.361148 n-d-858094-4 devstack@n-api.service[128780]: exception: Flavor 1640724382 could not be found. Sep 16 12:45:23.361972 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '7df4548b-8809-4742-80bd-4e4e6dcafc91', 'flavorRef': '1640724382'}}} Sep 16 12:45:23.361972 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:45:23.361972 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:23.361972 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 16 12:45:23.361972 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 16 12:45:23.361972 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 16 12:45:23.361972 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 16 12:45:23.361972 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 12:45:23.361972 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 12:45:23.361972 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 16 12:45:23.361972 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 16 12:45:23.361972 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 16 12:45:23.361972 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:45:23.361972 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 16 12:45:23.361972 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 16 12:45:23.361972 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1640724382 could not be found. Sep 16 12:45:23.361972 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:23.361972 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:23.361972 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:23.361972 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:23.363206 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:23.363206 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:23.363206 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:45:23.363206 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:45:23.363206 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:45:23.363206 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:45:23.363206 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:45:23.363206 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:45:23.363206 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:45:23.363206 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:45:23.363206 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:45:23.363206 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:45:23.363206 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 16 12:45:23.363206 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 16 12:45:23.363206 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 16 12:45:23.363206 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1640724382 could not be found. Sep 16 12:45:23.363206 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:23.363206 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:23.363206 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:23.363206 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:23.363206 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:23.364496 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:23.364496 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:45:23.364496 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:45:23.364496 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1640724382 could not be found. Sep 16 12:45:23.364496 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:23.364496 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-59504a19-3339-4a27-87a9-25d9345a6feb tempest-FlavorsAdminTestJSON-789456293 tempest-FlavorsAdminTestJSON-789456293-project] Returning 400 to user: Flavor 1640724382 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:45:23.365015 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-59504a19-3339-4a27-87a9-25d9345a6feb tempest-FlavorsAdminTestJSON-789456293 tempest-FlavorsAdminTestJSON-789456293-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.025248 Sep 16 12:45:23.366339 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 23/55] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:45:23 2022] POST /compute/v2.1/servers => generated 81 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 16 12:45:23.373440 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-72c71c8d-4bf3-49ff-a772-177b09233969 tempest-AggregatesAdminNegativeTestJSON-544684390 tempest-AggregatesAdminNegativeTestJSON-544684390-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1373216816"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:23.377060 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-72c71c8d-4bf3-49ff-a772-177b09233969 tempest-AggregatesAdminNegativeTestJSON-544684390 tempest-AggregatesAdminNegativeTestJSON-544684390-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '9eaa59a269b5458d811b4dbf79441e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6be22224574c009206f30e23b43b21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:23.379047 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-72c71c8d-4bf3-49ff-a772-177b09233969 tempest-AggregatesAdminNegativeTestJSON-544684390 tempest-AggregatesAdminNegativeTestJSON-544684390-project] Request method failure captured: Sep 16 12:45:23.379047 n-d-858094-4 devstack@n-api.service[128780]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 16 12:45:23.379047 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:45:23.379047 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:45:23.379047 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:45:23.379047 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 60 Sep 16 12:45:23.379047 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:45:23.379047 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:45:23.379047 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:45:23.379047 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:45:23.379047 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJG_bVMOHzDIswazZ9MfDkLIuM6hqut9iR_HdPuvuNzJ3OaMJU4v7qJVkw2N4Pq_29Alggv3ZD22jd8wYZXPFFnIaUBKSO0kTC1gg08bgOJ_f2NYnpe8bGI68mEVukHwq8TFFX_B9bMbTFdE7utHb4z7ixDnudhwpHYeL2KKBCXN8YBc Sep 16 12:45:23.379047 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:45:23.379047 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:45:23.379047 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:45:23.379047 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:45:23.379047 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:45:23.379047 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:45:23.379047 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 3e6be22224574c009206f30e23b43b21 Sep 16 12:45:23.379047 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-544684390 Sep 16 12:45:23.379047 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:45:23.379047 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:45:23.380169 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3e6be22224574c009206f30e23b43b21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3e6be22224574c009206f30e23b43b21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3e6be22224574c009206f30e23b43b21", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3e6be22224574c009206f30e23b43b21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:45:23.380169 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-544684390 Sep 16 12:45:23.380169 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 3e6be22224574c009206f30e23b43b21 Sep 16 12:45:23.380169 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-544684390 Sep 16 12:45:23.380169 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-AggregatesAdminNegativeTestJSON-544684390-project Sep 16 12:45:23.380169 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:45:23.380169 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:45:23.380169 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 9eaa59a269b5458d811b4dbf79441e1f Sep 16 12:45:23.380169 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-544684390-project Sep 16 12:45:23.380169 n-d-858094-4 devstack@n-api.service[128780]: Sep 16 12:45:23.380169 n-d-858094-4 devstack@n-api.service[128780]: {"aggregate": {"name": "tempest-test_aggregate-1373216816"}} Sep 16 12:45:23.380169 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:45:23.380169 n-d-858094-4 devstack@n-api.service[128780]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 16 12:45:23.380827 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1373216816'}}} Sep 16 12:45:23.380827 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:45:23.380827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:23.380827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:23.380827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:23.380827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:45:23.380827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:45:23.380827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:45:23.380827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:45:23.380827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:45:23.380827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:45:23.380827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:45:23.380827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:45:23.380827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Sep 16 12:45:23.380827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Sep 16 12:45:23.380827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 12:45:23.380827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 12:45:23.380827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 12:45:23.380827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 12:45:23.381735 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:45:23.381735 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:45:23.381735 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:45:23.381735 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:45:23.381735 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 12:45:23.381735 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 12:45:23.381735 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 12:45:23.381735 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 12:45:23.381735 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 12:45:23.381735 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 12:45:23.381735 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 16 12:45:23.381735 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:23.381735 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:23.381735 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:23.381735 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:23.381735 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:23.381735 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:23.381735 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 12:45:23.381735 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 12:45:23.381735 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 16 12:45:23.382764 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:23.384552 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-72c71c8d-4bf3-49ff-a772-177b09233969 tempest-AggregatesAdminNegativeTestJSON-544684390 tempest-AggregatesAdminNegativeTestJSON-544684390-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:45:23.386162 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-72c71c8d-4bf3-49ff-a772-177b09233969 tempest-AggregatesAdminNegativeTestJSON-544684390 tempest-AggregatesAdminNegativeTestJSON-544684390-project] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.017092 Sep 16 12:45:23.387250 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 24/56] 10.222.0.67 () {60 vars in 1164 bytes} [Fri Sep 16 12:45:23 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:45:23.392718 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ce5bb66d-2ff9-41bc-b8de-c10254a93234 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:23.419930 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ce5bb66d-2ff9-41bc-b8de-c10254a93234 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1640724382" status: 202 len: 0 microversion: 2.1 time: 0.031250 Sep 16 12:45:23.420614 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 25/57] 10.222.0.67 () {58 vars in 1161 bytes} [Fri Sep 16 12:45:23 2022] DELETE /compute/v2.1/flavors/1640724382 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:45:23.436403 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-710cf17e-6dbf-4068-b5fc-587b976f2dd6 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1981117422"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:23.440488 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.aggregate [None req-710cf17e-6dbf-4068-b5fc-587b976f2dd6 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Generated uuid dd758101-a5cd-4569-b5fe-a60bb461e636 for aggregate {{(pid=128780) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 16 12:45:23.485376 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-710cf17e-6dbf-4068-b5fc-587b976f2dd6 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.063544 Sep 16 12:45:23.486588 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 26/58] 10.222.0.67 () {60 vars in 1164 bytes} [Fri Sep 16 12:45:23 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:23.504843 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c8269cb3-2391-4f62-98a4-93f19d73d3a1 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:23.537595 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c8269cb3-2391-4f62-98a4-93f19d73d3a1 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049337 Sep 16 12:45:23.539273 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 27/59] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:45:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:23.545339 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-803ce7d6-9e09-4455-8165-7e6ca1610e1e tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1981117422"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:23.552208 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.aggregate [None req-803ce7d6-9e09-4455-8165-7e6ca1610e1e tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Generated uuid a456702b-1c40-402a-95da-19f981da1d83 for aggregate {{(pid=128780) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 16 12:45:23.566766 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-803ce7d6-9e09-4455-8165-7e6ca1610e1e tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1981117422 already exists. Sep 16 12:45:23.569492 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-803ce7d6-9e09-4455-8165-7e6ca1610e1e tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Request method failure captured: Sep 16 12:45:23.569492 n-d-858094-4 devstack@n-api.service[128780]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 16 12:45:23.569492 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:45:23.569492 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:45:23.569492 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:45:23.569492 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 60 Sep 16 12:45:23.569492 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:45:23.569492 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:45:23.569492 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:45:23.569492 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:45:23.569492 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJG_dogbGgb8xPb05DjnyijiK6Mr5ivsrHcfgXpJUa34jPkjYsTAmPzS2w_1GHOLXXLpuUCQrAngDbVNIzH3-D3FbpbURcrAYTyYXsAQMtJEJacsiRRJYUkaU2OvpukdMHrDuG6MZ9VzYzuhgiA-Ul1SCOpHVGtsqhqKC8f4bB7P4AWQ Sep 16 12:45:23.569492 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:45:23.569492 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:45:23.569492 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:45:23.569492 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:45:23.569492 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:45:23.569492 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:45:23.569492 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 2e7ba092719d4ecbaa47b6772f68b391 Sep 16 12:45:23.569492 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1426247531 Sep 16 12:45:23.569492 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,admin,reader Sep 16 12:45:23.569492 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,admin,reader Sep 16 12:45:23.570648 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2e7ba092719d4ecbaa47b6772f68b391"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2e7ba092719d4ecbaa47b6772f68b391"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2e7ba092719d4ecbaa47b6772f68b391", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2e7ba092719d4ecbaa47b6772f68b391"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:45:23.570648 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1426247531 Sep 16 12:45:23.570648 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 2e7ba092719d4ecbaa47b6772f68b391 Sep 16 12:45:23.570648 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1426247531 Sep 16 12:45:23.570648 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin Sep 16 12:45:23.570648 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:45:23.570648 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:45:23.570648 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 5968b368bb7449988a1a2f55d2e9cea0 Sep 16 12:45:23.570648 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin Sep 16 12:45:23.570648 n-d-858094-4 devstack@n-api.service[128780]: Sep 16 12:45:23.570648 n-d-858094-4 devstack@n-api.service[128780]: {"aggregate": {"name": "tempest-test_aggregate-1981117422"}} Sep 16 12:45:23.570648 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:45:23.570648 n-d-858094-4 devstack@n-api.service[128780]: exception: Aggregate tempest-test_aggregate-1981117422 already exists. Sep 16 12:45:23.571292 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1981117422'}}} Sep 16 12:45:23.571292 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:45:23.571292 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:23.571292 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Sep 16 12:45:23.571292 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Sep 16 12:45:23.571292 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 16 12:45:23.571292 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 16 12:45:23.571292 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:45:23.571292 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:45:23.571292 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:45:23.571292 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:45:23.571292 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 16 12:45:23.571292 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 16 12:45:23.571292 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Sep 16 12:45:23.571292 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi aggregate.create() Sep 16 12:45:23.571292 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 16 12:45:23.571292 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 16 12:45:23.571292 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Sep 16 12:45:23.571292 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Sep 16 12:45:23.573242 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 12:45:23.573242 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 12:45:23.573242 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Sep 16 12:45:23.573242 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Sep 16 12:45:23.573242 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1981117422 already exists. Sep 16 12:45:23.573242 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:23.573242 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:23.573242 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:23.573242 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:23.573242 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:23.573242 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:23.573242 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:45:23.573242 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:45:23.573242 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:45:23.573242 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:45:23.573242 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:45:23.573242 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:45:23.573242 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:45:23.573242 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:45:23.573242 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Sep 16 12:45:23.574254 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 16 12:45:23.574254 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1981117422 already exists. Sep 16 12:45:23.574254 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:23.574254 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:23.574254 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:23.574254 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:23.574254 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:23.574254 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:23.574254 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:45:23.574254 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:45:23.574254 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1981117422 already exists. Sep 16 12:45:23.574254 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:23.574254 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-803ce7d6-9e09-4455-8165-7e6ca1610e1e tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1981117422 already exists. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:45:23.574254 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-803ce7d6-9e09-4455-8165-7e6ca1610e1e tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.031529 Sep 16 12:45:23.574957 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 28/60] 10.222.0.67 () {60 vars in 1164 bytes} [Fri Sep 16 12:45:23 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 34 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 16 12:45:23.585000 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0383edd6-ca9e-41c1-9b16-7185e796e407 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1647752928", "id": 1950587401, "os-flavor-access:is_public": "False"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:23.598445 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-baca1c43-9337-4a21-a36a-aaff4a577af9 tempest-AggregatesAdminTestV241-106167985 tempest-AggregatesAdminTestV241-106167985-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 298 microversion: 2.41 time: 0.884054 Sep 16 12:45:23.600637 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 33/61] 10.222.0.67 () {62 vars in 1232 bytes} [Fri Sep 16 12:45:22 2022] POST /compute/v2.1/os-aggregates/3/action => generated 298 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:45:23.614799 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e15e304c-1da1-428e-a4c7-89d36d1a6d9c tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:23.624560 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0383edd6-ca9e-41c1-9b16-7185e796e407 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.048408 Sep 16 12:45:23.625178 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 29/62] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:45:23 2022] POST /compute/v2.1/flavors => generated 415 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:23.631887 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fda5cbd9-e241-45cd-9b18-cbdb757c68d6 tempest-AggregatesAdminTestV241-106167985 tempest-AggregatesAdminTestV241-106167985-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:23.664184 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e15e304c-1da1-428e-a4c7-89d36d1a6d9c tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.053706 Sep 16 12:45:23.668248 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 34/63] 10.222.0.67 () {58 vars in 1152 bytes} [Fri Sep 16 12:45:23 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 16 12:45:23.668436 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-fda5cbd9-e241-45cd-9b18-cbdb757c68d6 tempest-AggregatesAdminTestV241-106167985 tempest-AggregatesAdminTestV241-106167985-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.41 time: 0.041321 Sep 16 12:45:23.669366 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 30/64] 10.222.0.67 () {60 vars in 1193 bytes} [Fri Sep 16 12:45:23 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:23.676105 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4e479c9d-d01f-4b22-8ba4-ae69ec66d236 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-326203094"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:23.682283 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.aggregate [None req-4e479c9d-d01f-4b22-8ba4-ae69ec66d236 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Generated uuid 508a1ad1-3a2e-4f31-a753-cc03ec2e031a for aggregate {{(pid=128780) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 16 12:45:23.685099 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d48ea733-58a3-42cf-b19e-2e190f81cba4 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-52769342", "id": 889368304, "os-flavor-access:is_public": "True"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:23.736516 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4e479c9d-d01f-4b22-8ba4-ae69ec66d236 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.061237 Sep 16 12:45:23.737181 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 31/65] 10.222.0.67 () {60 vars in 1164 bytes} [Fri Sep 16 12:45:23 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:23.747763 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d48ea733-58a3-42cf-b19e-2e190f81cba4 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.1 time: 0.077769 Sep 16 12:45:23.752202 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 35/66] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:45:23 2022] POST /compute/v2.1/flavors => generated 409 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:23.752356 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c23e4080-e731-4425-aa84-412dfc2c67bc tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-955207094", "name": "tempest-test_aggregate-765962100"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:23.762428 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b3597b2e-b414-4e8d-a004-a500a6aed232 tempest-AggregatesAdminNegativeTestJSON-544684390 tempest-AggregatesAdminNegativeTestJSON-544684390-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:23.764025 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b3597b2e-b414-4e8d-a004-a500a6aed232 tempest-AggregatesAdminNegativeTestJSON-544684390 tempest-AggregatesAdminNegativeTestJSON-544684390-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '9eaa59a269b5458d811b4dbf79441e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6be22224574c009206f30e23b43b21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:23.765723 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b3597b2e-b414-4e8d-a004-a500a6aed232 tempest-AggregatesAdminNegativeTestJSON-544684390 tempest-AggregatesAdminNegativeTestJSON-544684390-project] Request method failure captured: Sep 16 12:45:23.765723 n-d-858094-4 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Sep 16 12:45:23.765723 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:45:23.765723 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:45:23.765723 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:45:23.765723 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:45:23.765723 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:45:23.765723 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:45:23.765723 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:45:23.765723 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:45:23.765723 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJG_bVMOHzDIswazZ9MfDkLIuM6hqut9iR_HdPuvuNzJ3OaMJU4v7qJVkw2N4Pq_29Alggv3ZD22jd8wYZXPFFnIaUBKSO0kTC1gg08bgOJ_f2NYnpe8bGI68mEVukHwq8TFFX_B9bMbTFdE7utHb4z7ixDnudhwpHYeL2KKBCXN8YBc Sep 16 12:45:23.765723 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:45:23.765723 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:45:23.765723 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:45:23.765723 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:45:23.765723 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:45:23.765723 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:45:23.765723 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 3e6be22224574c009206f30e23b43b21 Sep 16 12:45:23.765723 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-544684390 Sep 16 12:45:23.765723 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:45:23.765723 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:45:23.766847 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3e6be22224574c009206f30e23b43b21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3e6be22224574c009206f30e23b43b21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3e6be22224574c009206f30e23b43b21", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3e6be22224574c009206f30e23b43b21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:45:23.766847 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-544684390 Sep 16 12:45:23.766847 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 3e6be22224574c009206f30e23b43b21 Sep 16 12:45:23.766847 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-544684390 Sep 16 12:45:23.766847 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-AggregatesAdminNegativeTestJSON-544684390-project Sep 16 12:45:23.766847 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:45:23.766847 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:45:23.766847 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 9eaa59a269b5458d811b4dbf79441e1f Sep 16 12:45:23.766847 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-544684390-project Sep 16 12:45:23.766847 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:45:23.766847 n-d-858094-4 devstack@n-api.service[128779]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 16 12:45:23.766847 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '6'} Sep 16 12:45:23.767451 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:45:23.767451 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:23.767451 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:23.767451 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:23.767451 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:45:23.767451 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:45:23.767451 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:45:23.767451 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:45:23.767451 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Sep 16 12:45:23.767451 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Sep 16 12:45:23.767451 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 12:45:23.767451 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 12:45:23.767451 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 12:45:23.767451 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 12:45:23.767451 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:45:23.767451 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:45:23.767451 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:45:23.767451 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:45:23.767451 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 12:45:23.768416 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 12:45:23.768416 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 12:45:23.768416 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 12:45:23.768416 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 12:45:23.768416 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 12:45:23.768416 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 16 12:45:23.768416 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:23.768416 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:23.768416 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:23.768416 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:23.768416 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:23.768416 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:23.768416 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 12:45:23.768416 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 12:45:23.768416 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 16 12:45:23.768416 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:23.768416 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b3597b2e-b414-4e8d-a004-a500a6aed232 tempest-AggregatesAdminNegativeTestJSON-544684390 tempest-AggregatesAdminNegativeTestJSON-544684390-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:45:23.772975 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b3597b2e-b414-4e8d-a004-a500a6aed232 tempest-AggregatesAdminNegativeTestJSON-544684390 tempest-AggregatesAdminNegativeTestJSON-544684390-project] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/6" status: 403 len: 116 microversion: 2.1 time: 0.010804 Sep 16 12:45:23.773739 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 36/67] 10.222.0.67 () {58 vars in 1152 bytes} [Fri Sep 16 12:45:23 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 116 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:45:23.779572 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f2d50f18-8b4c-47d3-ba8d-42b38b202bdf tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:23.784731 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.aggregate [None req-c23e4080-e731-4425-aa84-412dfc2c67bc tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Generated uuid 67f1dc80-c3cd-449e-a9e9-0dadf25cabc0 for aggregate {{(pid=128780) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 16 12:45:23.807940 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f2d50f18-8b4c-47d3-ba8d-42b38b202bdf tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.033276 Sep 16 12:45:23.809494 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 37/68] 10.222.0.67 () {58 vars in 1169 bytes} [Fri Sep 16 12:45:23 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:23.820220 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4eb3afdc-deef-4b7c-879d-2230331541b2 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:23.852210 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c23e4080-e731-4425-aa84-412dfc2c67bc tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.113859 Sep 16 12:45:23.854022 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 32/69] 10.222.0.67 () {60 vars in 1165 bytes} [Fri Sep 16 12:45:23 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:23.862321 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-43060de8-7718-409e-a8dd-c8b2b2416504 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:23.870408 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4eb3afdc-deef-4b7c-879d-2230331541b2 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.058615 Sep 16 12:45:23.871768 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 38/70] 10.222.0.67 () {58 vars in 1152 bytes} [Fri Sep 16 12:45:23 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 16 12:45:23.880817 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f5c3a033-c84f-400b-b227-bbeb8f818e1c tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:23.892760 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-43060de8-7718-409e-a8dd-c8b2b2416504 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.035658 Sep 16 12:45:23.903247 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 33/71] 10.222.0.67 () {58 vars in 1177 bytes} [Fri Sep 16 12:45:23 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:23.903589 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f5c3a033-c84f-400b-b227-bbeb8f818e1c tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "GET /compute/v2.1/os-aggregates" status: 200 len: 300 microversion: 2.1 time: 0.023659 Sep 16 12:45:23.905721 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e19f6707-c7ef-4cbf-9a9b-a12f854b727e tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:23.905920 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 39/72] 10.222.0.67 () {58 vars in 1143 bytes} [Fri Sep 16 12:45:23 2022] GET /compute/v2.1/os-aggregates => generated 300 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:23.911311 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1f471e68-e77f-4b5a-be17-5db729e1ea7f tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:23.922931 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1f471e68-e77f-4b5a-be17-5db729e1ea7f tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.015878 Sep 16 12:45:23.923510 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 40/73] 10.222.0.67 () {58 vars in 1171 bytes} [Fri Sep 16 12:45:23 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:23.932222 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-e19f6707-c7ef-4cbf-9a9b-a12f854b727e tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 16 12:45:23.932222 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e19f6707-c7ef-4cbf-9a9b-a12f854b727e tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Request method failure captured: Sep 16 12:45:23.932222 n-d-858094-4 devstack@n-api.service[128780]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 16 12:45:23.932222 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:45:23.932222 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:45:23.932222 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:45:23.932222 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:45:23.932222 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:45:23.932222 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:45:23.932222 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:45:23.932222 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:45:23.932222 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJG_dogbGgb8xPb05DjnyijiK6Mr5ivsrHcfgXpJUa34jPkjYsTAmPzS2w_1GHOLXXLpuUCQrAngDbVNIzH3-D3FbpbURcrAYTyYXsAQMtJEJacsiRRJYUkaU2OvpukdMHrDuG6MZ9VzYzuhgiA-Ul1SCOpHVGtsqhqKC8f4bB7P4AWQ Sep 16 12:45:23.932222 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:45:23.932222 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:45:23.932222 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:45:23.932222 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:45:23.932222 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:45:23.932222 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:45:23.932222 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 2e7ba092719d4ecbaa47b6772f68b391 Sep 16 12:45:23.932222 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1426247531 Sep 16 12:45:23.932222 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,admin,reader Sep 16 12:45:23.932222 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,admin,reader Sep 16 12:45:23.934677 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2e7ba092719d4ecbaa47b6772f68b391"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2e7ba092719d4ecbaa47b6772f68b391"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2e7ba092719d4ecbaa47b6772f68b391", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2e7ba092719d4ecbaa47b6772f68b391"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:45:23.934677 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1426247531 Sep 16 12:45:23.934677 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 2e7ba092719d4ecbaa47b6772f68b391 Sep 16 12:45:23.934677 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1426247531 Sep 16 12:45:23.934677 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin Sep 16 12:45:23.934677 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:45:23.934677 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:45:23.934677 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 5968b368bb7449988a1a2f55d2e9cea0 Sep 16 12:45:23.934677 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin Sep 16 12:45:23.934677 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:45:23.934677 n-d-858094-4 devstack@n-api.service[128780]: exception: Aggregate -1 could not be found. Sep 16 12:45:23.934677 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '-1'} Sep 16 12:45:23.935388 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:45:23.935388 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:23.935388 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 16 12:45:23.935388 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 16 12:45:23.935388 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 16 12:45:23.935388 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 16 12:45:23.935388 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:45:23.935388 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:45:23.935388 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:45:23.935388 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:45:23.935388 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 16 12:45:23.935388 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 16 12:45:23.935388 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 16 12:45:23.935388 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 16 12:45:23.935388 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 12:45:23.935388 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 12:45:23.935388 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 16 12:45:23.935388 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 16 12:45:23.935388 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 12:45:23.941383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 12:45:23.941383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 16 12:45:23.941383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 16 12:45:23.941383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 16 12:45:23.941383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:23.941383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:23.941383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:23.941383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:23.941383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:23.941383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:23.941383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:45:23.941383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:45:23.941383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:45:23.941383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:45:23.941383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 16 12:45:23.941383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:45:23.941383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 16 12:45:23.941383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:23.941383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:23.941383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:23.941383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:23.942807 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:23.942807 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:23.942807 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:45:23.942807 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:45:23.942807 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 16 12:45:23.942807 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:23.942807 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e19f6707-c7ef-4cbf-9a9b-a12f854b727e tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:45:23.942807 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e19f6707-c7ef-4cbf-9a9b-a12f854b727e tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.030892 Sep 16 12:45:23.943311 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9f6a1e8a-75dd-4f0e-9f8f-fe0b70057af6 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858094-4"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:23.943407 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 34/74] 10.222.0.67 () {58 vars in 1155 bytes} [Fri Sep 16 12:45:23 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 12:45:23.947586 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-26bf2038-6915-45b6-9752-b41851c76cbc tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1637081081"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:23.948329 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f6a1e8a-75dd-4f0e-9f8f-fe0b70057af6 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:23.949004 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f6a1e8a-75dd-4f0e-9f8f-fe0b70057af6 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:23.949573 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f6a1e8a-75dd-4f0e-9f8f-fe0b70057af6 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:23.962278 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.aggregate [None req-26bf2038-6915-45b6-9752-b41851c76cbc tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Generated uuid dfe3b5e4-b934-40e2-9fd9-962f577991e0 for aggregate {{(pid=128780) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 16 12:45:24.005937 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-26bf2038-6915-45b6-9752-b41851c76cbc tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.067201 Sep 16 12:45:24.014174 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 35/75] 10.222.0.67 () {60 vars in 1164 bytes} [Fri Sep 16 12:45:23 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:24.023266 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7d1af422-53e1-4f00-85dc-f71c99d1b49f tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:24.065249 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7d1af422-53e1-4f00-85dc-f71c99d1b49f tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.044689 Sep 16 12:45:24.076162 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 36/76] 10.222.0.67 () {58 vars in 1169 bytes} [Fri Sep 16 12:45:24 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:24.088733 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d724a006-a3cd-467d-8821-ba61e099f966 tempest-AggregatesAdminNegativeTestJSON-544684390 tempest-AggregatesAdminNegativeTestJSON-544684390-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:24.096248 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d724a006-a3cd-467d-8821-ba61e099f966 tempest-AggregatesAdminNegativeTestJSON-544684390 tempest-AggregatesAdminNegativeTestJSON-544684390-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '9eaa59a269b5458d811b4dbf79441e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6be22224574c009206f30e23b43b21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:24.104967 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d724a006-a3cd-467d-8821-ba61e099f966 tempest-AggregatesAdminNegativeTestJSON-544684390 tempest-AggregatesAdminNegativeTestJSON-544684390-project] Request method failure captured: Sep 16 12:45:24.104967 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Sep 16 12:45:24.104967 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:45:24.104967 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:45:24.104967 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:45:24.104967 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:45:24.104967 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:45:24.104967 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:45:24.104967 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:45:24.104967 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:45:24.104967 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJG_bVMOHzDIswazZ9MfDkLIuM6hqut9iR_HdPuvuNzJ3OaMJU4v7qJVkw2N4Pq_29Alggv3ZD22jd8wYZXPFFnIaUBKSO0kTC1gg08bgOJ_f2NYnpe8bGI68mEVukHwq8TFFX_B9bMbTFdE7utHb4z7ixDnudhwpHYeL2KKBCXN8YBc Sep 16 12:45:24.104967 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:45:24.104967 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:45:24.104967 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:45:24.104967 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:45:24.104967 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:45:24.104967 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:45:24.104967 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 3e6be22224574c009206f30e23b43b21 Sep 16 12:45:24.104967 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-544684390 Sep 16 12:45:24.104967 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:45:24.104967 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:45:24.106176 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3e6be22224574c009206f30e23b43b21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3e6be22224574c009206f30e23b43b21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3e6be22224574c009206f30e23b43b21", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3e6be22224574c009206f30e23b43b21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:45:24.106176 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-544684390 Sep 16 12:45:24.106176 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 3e6be22224574c009206f30e23b43b21 Sep 16 12:45:24.106176 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-544684390 Sep 16 12:45:24.106176 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-AggregatesAdminNegativeTestJSON-544684390-project Sep 16 12:45:24.106176 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:45:24.106176 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:45:24.106176 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 9eaa59a269b5458d811b4dbf79441e1f Sep 16 12:45:24.106176 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-544684390-project Sep 16 12:45:24.106176 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:45:24.106176 n-d-858094-4 devstack@n-api.service[128780]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 16 12:45:24.106176 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '8'} Sep 16 12:45:24.106924 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:45:24.106924 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:24.106924 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:24.106924 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:24.106924 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:45:24.106924 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:45:24.106924 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:45:24.106924 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:45:24.106924 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Sep 16 12:45:24.106924 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Sep 16 12:45:24.106924 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 12:45:24.106924 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 12:45:24.106924 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 12:45:24.106924 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 12:45:24.106924 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:45:24.106924 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:45:24.106924 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:45:24.106924 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:45:24.106924 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 12:45:24.108027 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 12:45:24.108027 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 12:45:24.108027 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 12:45:24.108027 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 12:45:24.108027 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 12:45:24.108027 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 16 12:45:24.108027 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:24.108027 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:24.108027 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:24.108027 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:24.108027 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:24.108027 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:24.108027 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 12:45:24.108027 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 12:45:24.108027 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 16 12:45:24.108027 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:24.108027 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d724a006-a3cd-467d-8821-ba61e099f966 tempest-AggregatesAdminNegativeTestJSON-544684390 tempest-AggregatesAdminNegativeTestJSON-544684390-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:45:24.115180 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d724a006-a3cd-467d-8821-ba61e099f966 tempest-AggregatesAdminNegativeTestJSON-544684390 tempest-AggregatesAdminNegativeTestJSON-544684390-project] 10.222.0.67 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.046834 Sep 16 12:45:24.116065 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 37/77] 10.222.0.67 () {58 vars in 1149 bytes} [Fri Sep 16 12:45:24 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 48 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:45:24.135944 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7d0b026b-80c2-47f1-bdb9-fb5edb80ec9f tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:24.220049 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7d0b026b-80c2-47f1-bdb9-fb5edb80ec9f tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5390 microversion: 2.1 time: 0.103180 Sep 16 12:45:24.236259 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 38/78] 10.222.0.67 () {58 vars in 1169 bytes} [Fri Sep 16 12:45:24 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5390 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:24.251396 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4d5f6ce2-03a8-42a9-b426-dcf6ce9cbb1f tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:24.264487 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9f6a1e8a-75dd-4f0e-9f8f-fe0b70057af6 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 312 microversion: 2.1 time: 0.339168 Sep 16 12:45:24.268904 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 41/79] 10.222.0.67 () {60 vars in 1191 bytes} [Fri Sep 16 12:45:23 2022] POST /compute/v2.1/os-aggregates/7/action => generated 312 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:24.283858 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d6b5a2a9-ff26-4573-b10e-e6447ae6fd1c tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:24.320936 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d6b5a2a9-ff26-4573-b10e-e6447ae6fd1c tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5390 microversion: 2.1 time: 0.050172 Sep 16 12:45:24.339814 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 42/80] 10.222.0.67 () {58 vars in 1175 bytes} [Fri Sep 16 12:45:24 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5390 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:24.347537 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4d5f6ce2-03a8-42a9-b426-dcf6ce9cbb1f tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.112002 Sep 16 12:45:24.348143 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 39/81] 10.222.0.67 () {58 vars in 1152 bytes} [Fri Sep 16 12:45:24 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 16 12:45:24.358960 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-00eefa26-f37d-4ed4-8822-73b9b94f2e71 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:24.360627 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ad290733-4fd2-4551-a049-50adc973edde tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:24.373642 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-ad290733-4fd2-4551-a049-50adc973edde tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 16 12:45:24.375448 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ad290733-4fd2-4551-a049-50adc973edde tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Request method failure captured: Sep 16 12:45:24.375448 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 16 12:45:24.375448 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:45:24.375448 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:45:24.375448 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:45:24.375448 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:45:24.375448 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:45:24.375448 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:45:24.375448 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:45:24.375448 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:45:24.375448 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJG_dogbGgb8xPb05DjnyijiK6Mr5ivsrHcfgXpJUa34jPkjYsTAmPzS2w_1GHOLXXLpuUCQrAngDbVNIzH3-D3FbpbURcrAYTyYXsAQMtJEJacsiRRJYUkaU2OvpukdMHrDuG6MZ9VzYzuhgiA-Ul1SCOpHVGtsqhqKC8f4bB7P4AWQ Sep 16 12:45:24.375448 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:45:24.375448 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:45:24.375448 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:45:24.375448 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:45:24.375448 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:45:24.375448 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:45:24.375448 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 2e7ba092719d4ecbaa47b6772f68b391 Sep 16 12:45:24.375448 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1426247531 Sep 16 12:45:24.375448 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,admin,reader Sep 16 12:45:24.375448 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,admin,reader Sep 16 12:45:24.376596 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2e7ba092719d4ecbaa47b6772f68b391"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2e7ba092719d4ecbaa47b6772f68b391"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2e7ba092719d4ecbaa47b6772f68b391", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2e7ba092719d4ecbaa47b6772f68b391"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:45:24.376596 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1426247531 Sep 16 12:45:24.376596 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 2e7ba092719d4ecbaa47b6772f68b391 Sep 16 12:45:24.376596 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1426247531 Sep 16 12:45:24.376596 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin Sep 16 12:45:24.376596 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:45:24.376596 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:45:24.376596 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 5968b368bb7449988a1a2f55d2e9cea0 Sep 16 12:45:24.376596 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin Sep 16 12:45:24.376596 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:45:24.376596 n-d-858094-4 devstack@n-api.service[128780]: exception: Aggregate -1 could not be found. Sep 16 12:45:24.376596 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '-1'} Sep 16 12:45:24.377211 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:45:24.377211 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:24.377211 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 16 12:45:24.377211 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 16 12:45:24.377211 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 16 12:45:24.377211 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 16 12:45:24.377211 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 12:45:24.377211 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 12:45:24.377211 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 16 12:45:24.377211 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 16 12:45:24.377211 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 12:45:24.377211 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 12:45:24.377211 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 16 12:45:24.377211 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 16 12:45:24.377211 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 16 12:45:24.377211 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:24.377211 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:24.377211 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:24.377211 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:24.377211 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:24.378180 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:24.378180 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:45:24.378180 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:45:24.378180 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:45:24.378180 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:45:24.378180 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 16 12:45:24.378180 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:45:24.378180 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 16 12:45:24.378180 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:24.378180 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:24.378180 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:24.378180 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:24.378180 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:24.378180 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:24.378180 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:45:24.378180 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:45:24.378180 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 16 12:45:24.378180 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:24.379149 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ad290733-4fd2-4551-a049-50adc973edde tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:45:24.379149 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ad290733-4fd2-4551-a049-50adc973edde tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] 10.222.0.67 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.022933 Sep 16 12:45:24.379149 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 40/82] 10.222.0.67 () {58 vars in 1152 bytes} [Fri Sep 16 12:45:24 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 16 12:45:24.396909 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-00eefa26-f37d-4ed4-8822-73b9b94f2e71 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5390 microversion: 2.1 time: 0.048817 Sep 16 12:45:24.411615 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-bed38eb5-0146-447a-ad59-88499a5c8aee tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:24.412515 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-bed38eb5-0146-447a-ad59-88499a5c8aee tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: 3ab83a18-0e02-4082-a9f8-b7f93ad2e347] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:24.414412 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 43/83] 10.222.0.67 () {58 vars in 1173 bytes} [Fri Sep 16 12:45:24 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5390 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:45:24.421766 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-902a17d6-ae52-4526-9df3-e24edf92c971 tempest-AggregatesAdminNegativeTestJSON-544684390 tempest-AggregatesAdminNegativeTestJSON-544684390-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:24.423474 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bed38eb5-0146-447a-ad59-88499a5c8aee tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:24.423954 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bed38eb5-0146-447a-ad59-88499a5c8aee tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:24.424880 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-902a17d6-ae52-4526-9df3-e24edf92c971 tempest-AggregatesAdminNegativeTestJSON-544684390 tempest-AggregatesAdminNegativeTestJSON-544684390-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '9eaa59a269b5458d811b4dbf79441e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6be22224574c009206f30e23b43b21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:24.427021 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-902a17d6-ae52-4526-9df3-e24edf92c971 tempest-AggregatesAdminNegativeTestJSON-544684390 tempest-AggregatesAdminNegativeTestJSON-544684390-project] Request method failure captured: Sep 16 12:45:24.427021 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Sep 16 12:45:24.427021 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:45:24.427021 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:45:24.427021 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:45:24.427021 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:45:24.427021 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:45:24.427021 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:45:24.427021 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:45:24.427021 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:45:24.427021 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJG_bVMOHzDIswazZ9MfDkLIuM6hqut9iR_HdPuvuNzJ3OaMJU4v7qJVkw2N4Pq_29Alggv3ZD22jd8wYZXPFFnIaUBKSO0kTC1gg08bgOJ_f2NYnpe8bGI68mEVukHwq8TFFX_B9bMbTFdE7utHb4z7ixDnudhwpHYeL2KKBCXN8YBc Sep 16 12:45:24.427021 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:45:24.427021 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:45:24.427021 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:45:24.427021 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:45:24.427021 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:45:24.427021 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:45:24.427021 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 3e6be22224574c009206f30e23b43b21 Sep 16 12:45:24.427021 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-544684390 Sep 16 12:45:24.427021 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:45:24.427021 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:45:24.428175 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3e6be22224574c009206f30e23b43b21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3e6be22224574c009206f30e23b43b21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3e6be22224574c009206f30e23b43b21", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3e6be22224574c009206f30e23b43b21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:45:24.428175 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-544684390 Sep 16 12:45:24.428175 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 3e6be22224574c009206f30e23b43b21 Sep 16 12:45:24.428175 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-544684390 Sep 16 12:45:24.428175 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-AggregatesAdminNegativeTestJSON-544684390-project Sep 16 12:45:24.428175 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:45:24.428175 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:45:24.428175 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 9eaa59a269b5458d811b4dbf79441e1f Sep 16 12:45:24.428175 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-544684390-project Sep 16 12:45:24.428175 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:45:24.428175 n-d-858094-4 devstack@n-api.service[128779]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 16 12:45:24.428175 n-d-858094-4 devstack@n-api.service[128779]: action_args: {} Sep 16 12:45:24.428904 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:45:24.428904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:24.428904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:24.428904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:24.428904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:45:24.428904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:45:24.428904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:45:24.428904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:45:24.428904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Sep 16 12:45:24.428904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Sep 16 12:45:24.428904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 12:45:24.428904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 12:45:24.428904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 12:45:24.428904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 12:45:24.428904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:45:24.428904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:45:24.428904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:45:24.428904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:45:24.428904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 12:45:24.430013 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 12:45:24.430013 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 12:45:24.430013 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 12:45:24.430013 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 12:45:24.430013 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 12:45:24.430013 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 16 12:45:24.430013 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:24.430013 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:24.430013 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:24.430013 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:24.430013 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:24.430013 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:24.430013 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 12:45:24.430013 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 12:45:24.430013 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 16 12:45:24.430013 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:24.430951 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bed38eb5-0146-447a-ad59-88499a5c8aee tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:24.430951 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bed38eb5-0146-447a-ad59-88499a5c8aee tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:24.432939 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-902a17d6-ae52-4526-9df3-e24edf92c971 tempest-AggregatesAdminNegativeTestJSON-544684390 tempest-AggregatesAdminNegativeTestJSON-544684390-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:45:24.433525 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bed38eb5-0146-447a-ad59-88499a5c8aee tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:24.434067 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bed38eb5-0146-447a-ad59-88499a5c8aee tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:24.435120 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-902a17d6-ae52-4526-9df3-e24edf92c971 tempest-AggregatesAdminNegativeTestJSON-544684390 tempest-AggregatesAdminNegativeTestJSON-544684390-project] 10.222.0.67 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.018326 Sep 16 12:45:24.435830 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 44/84] 10.222.0.67 () {58 vars in 1143 bytes} [Fri Sep 16 12:45:24 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:45:24.448432 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dd2df619-4113-4c87-923d-c51652a8db19 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:24.476352 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dd2df619-4113-4c87-923d-c51652a8db19 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5390 microversion: 2.1 time: 0.033332 Sep 16 12:45:24.490214 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 45/85] 10.222.0.67 () {58 vars in 1169 bytes} [Fri Sep 16 12:45:24 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5390 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:24.498768 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-710cc493-ec3d-4fc9-baf3-893cfb53374e tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:24.524555 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-710cc493-ec3d-4fc9-baf3-893cfb53374e tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/889368304" status: 202 len: 0 microversion: 2.1 time: 0.030270 Sep 16 12:45:24.525146 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 46/86] 10.222.0.67 () {58 vars in 1158 bytes} [Fri Sep 16 12:45:24 2022] DELETE /compute/v2.1/flavors/889368304 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:45:24.546362 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-79b5daa6-0c3e-47d0-9f09-4c0d437678fc tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:24.582574 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-79b5daa6-0c3e-47d0-9f09-4c0d437678fc tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040282 Sep 16 12:45:24.583726 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 47/87] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:45:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:24.609487 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3c2657af-d849-4e44-9354-f86a2733c5f5 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:24.690187 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3c2657af-d849-4e44-9354-f86a2733c5f5 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1950587401" status: 202 len: 0 microversion: 2.1 time: 0.087313 Sep 16 12:45:24.692278 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 48/88] 10.222.0.67 () {58 vars in 1161 bytes} [Fri Sep 16 12:45:24 2022] DELETE /compute/v2.1/flavors/1950587401 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:45:24.705259 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5ce6473c-c82b-41d3-a3c4-b5e4a30151c6 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:24.758956 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5ce6473c-c82b-41d3-a3c4-b5e4a30151c6 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061888 Sep 16 12:45:24.764286 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 49/89] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:45:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:24.789404 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9b8792cc-d755-49b2-b8e3-89ebf3f4f6c9 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1834741512", "id": 69822111, "os-flavor-access:is_public": "False"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:24.842573 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9b8792cc-d755-49b2-b8e3-89ebf3f4f6c9 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.1 time: 0.056707 Sep 16 12:45:24.843937 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 50/90] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:45:24 2022] POST /compute/v2.1/flavors => generated 409 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:24.858619 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b5a85d16-5a3e-459f-8c90-1c56a2319a7e tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:24.895436 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b5a85d16-5a3e-459f-8c90-1c56a2319a7e tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042505 Sep 16 12:45:24.917875 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 51/91] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:45:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:45:24.946092 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-aea6b264-5db5-404f-afd7-0c6cb92ba6d1 tempest-FlavorsAdminTestJSON-789456293 tempest-FlavorsAdminTestJSON-789456293-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:25.022532 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-aea6b264-5db5-404f-afd7-0c6cb92ba6d1 tempest-FlavorsAdminTestJSON-789456293 tempest-FlavorsAdminTestJSON-789456293-project] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.080559 Sep 16 12:45:25.028513 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 52/92] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:45:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:25.044512 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bf3da39a-f811-4459-8105-53bbe0030d5b tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:25.085310 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bf3da39a-f811-4459-8105-53bbe0030d5b tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/69822111" status: 202 len: 0 microversion: 2.1 time: 0.045167 Sep 16 12:45:25.090928 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 53/93] 10.222.0.67 () {58 vars in 1155 bytes} [Fri Sep 16 12:45:25 2022] DELETE /compute/v2.1/flavors/69822111 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:45:25.102131 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5c6b3388-dadc-4450-b764-ff635569dce2 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:25.169145 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5c6b3388-dadc-4450-b764-ff635569dce2 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.076417 Sep 16 12:45:25.174564 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 54/94] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:45:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:25.213335 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-35ee935c-0973-4022-8c6e-87d9d9c21d86 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2144813898", "id": 2057119777, "os-flavor-access:is_public": "True"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:25.273785 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-35ee935c-0973-4022-8c6e-87d9d9c21d86 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.077509 Sep 16 12:45:25.278633 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 55/95] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:45:25 2022] POST /compute/v2.1/flavors => generated 414 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:45:25.294691 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2de010a6-0fb4-4c02-8c4b-2500ddc4dfd9 tempest-FlavorsAdminTestJSON-789456293 tempest-FlavorsAdminTestJSON-789456293-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:25.301773 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-bed38eb5-0146-447a-ad59-88499a5c8aee tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da877221336e4e58859c207fca5e857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b6b2ef87ef4629941a0cc9942d7e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:25.327644 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-bed38eb5-0146-447a-ad59-88499a5c8aee tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347" status: 200 len: 1341 microversion: 2.1 time: 0.948946 Sep 16 12:45:25.340641 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 41/96] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:24 2022] GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347 => generated 1341 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:25.354831 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2de010a6-0fb4-4c02-8c4b-2500ddc4dfd9 tempest-FlavorsAdminTestJSON-789456293 tempest-FlavorsAdminTestJSON-789456293-project] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.066281 Sep 16 12:45:25.355416 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 56/97] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:45:25 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:45:25.386551 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f29dfb23-7111-4e6f-a38d-2a88e492f382 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:25.439767 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f29dfb23-7111-4e6f-a38d-2a88e492f382 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/2057119777" status: 202 len: 0 microversion: 2.1 time: 0.064333 Sep 16 12:45:25.441000 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 42/98] 10.222.0.67 () {58 vars in 1161 bytes} [Fri Sep 16 12:45:25 2022] DELETE /compute/v2.1/flavors/2057119777 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:45:25.462138 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bef091f3-3d32-4ac7-8b74-3072268cacf2 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:25.473666 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=80,nova_api:DELETE=14 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:45:25.536658 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bef091f3-3d32-4ac7-8b74-3072268cacf2 tempest-FlavorsAdminTestJSON-1789602690 tempest-FlavorsAdminTestJSON-1789602690-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.076976 Sep 16 12:45:25.541301 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 57/99] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:45:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:25.707225 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-cf764a48-19b3-49e0-abb9-5c7e2d231cb4 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-988665675", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "availability_zone": "tempest-test_az-955207094"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:25.761358 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cf764a48-19b3-49e0-abb9-5c7e2d231cb4 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:25.762989 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cf764a48-19b3-49e0-abb9-5c7e2d231cb4 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:25.768604 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cf764a48-19b3-49e0-abb9-5c7e2d231cb4 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:25.770761 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cf764a48-19b3-49e0-abb9-5c7e2d231cb4 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:25.771252 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cf764a48-19b3-49e0-abb9-5c7e2d231cb4 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:25.771689 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cf764a48-19b3-49e0-abb9-5c7e2d231cb4 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:26.073847 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-cf764a48-19b3-49e0-abb9-5c7e2d231cb4 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] validate_networks() for None {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:45:26.354701 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8ee9138c-d153-456b-ac78-f0992d08968f tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:26.355451 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8ee9138c-d153-456b-ac78-f0992d08968f tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: 3ab83a18-0e02-4082-a9f8-b7f93ad2e347] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:26.393500 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ee9138c-d153-456b-ac78-f0992d08968f tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:26.394064 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ee9138c-d153-456b-ac78-f0992d08968f tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:26.403157 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ee9138c-d153-456b-ac78-f0992d08968f tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:26.403993 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ee9138c-d153-456b-ac78-f0992d08968f tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:26.408519 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ee9138c-d153-456b-ac78-f0992d08968f tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:26.409032 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ee9138c-d153-456b-ac78-f0992d08968f tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:26.927709 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-cf764a48-19b3-49e0-abb9-5c7e2d231cb4 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:45:26.928328 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-cf764a48-19b3-49e0-abb9-5c7e2d231cb4 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:45:26.928660 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-cf764a48-19b3-49e0-abb9-5c7e2d231cb4 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:45:26.929074 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-cf764a48-19b3-49e0-abb9-5c7e2d231cb4 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:45:26.930018 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-cf764a48-19b3-49e0-abb9-5c7e2d231cb4 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:45:26.987778 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cf764a48-19b3-49e0-abb9-5c7e2d231cb4 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:26.988307 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cf764a48-19b3-49e0-abb9-5c7e2d231cb4 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:26.989785 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cf764a48-19b3-49e0-abb9-5c7e2d231cb4 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:26.990559 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cf764a48-19b3-49e0-abb9-5c7e2d231cb4 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:26.991028 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cf764a48-19b3-49e0-abb9-5c7e2d231cb4 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:26.991457 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cf764a48-19b3-49e0-abb9-5c7e2d231cb4 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:27.051967 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-cf764a48-19b3-49e0-abb9-5c7e2d231cb4 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Getting quotas for project 065037c7cf1d4b0d8d12253372a605b0. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:45:27.057722 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-cf764a48-19b3-49e0-abb9-5c7e2d231cb4 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Getting quotas for user 3cbe3a24b2f6451ca174d708962e49ff and project 065037c7cf1d4b0d8d12253372a605b0. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:45:27.074457 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-cf764a48-19b3-49e0-abb9-5c7e2d231cb4 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:45:27.083159 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-cf764a48-19b3-49e0-abb9-5c7e2d231cb4 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] [instance: cafdd5ab-69fa-40fc-a555-8a2668f40e5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:45:27.159770 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=12,nova_api:INSERT=7 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:45:27.198763 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-cf764a48-19b3-49e0-abb9-5c7e2d231cb4 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.668194 Sep 16 12:45:27.199923 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 43/100] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:45:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:45:27.212811 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-39736966-86fc-41e9-a601-95c3d88048ad tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:27.214374 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-39736966-86fc-41e9-a601-95c3d88048ad tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] [instance: cafdd5ab-69fa-40fc-a555-8a2668f40e5e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:27.214959 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8ee9138c-d153-456b-ac78-f0992d08968f tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da877221336e4e58859c207fca5e857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b6b2ef87ef4629941a0cc9942d7e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:27.270707 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8ee9138c-d153-456b-ac78-f0992d08968f tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347" status: 200 len: 1341 microversion: 2.1 time: 0.920366 Sep 16 12:45:27.272913 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 58/101] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:26 2022] GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347 => generated 1341 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:27.429791 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-39736966-86fc-41e9-a601-95c3d88048ad tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbe3a24b2f6451ca174d708962e49ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065037c7cf1d4b0d8d12253372a605b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:27.459892 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-39736966-86fc-41e9-a601-95c3d88048ad tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] 10.222.0.67 "GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e" status: 200 len: 1241 microversion: 2.1 time: 0.248900 Sep 16 12:45:27.464224 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 44/102] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:27 2022] GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e => generated 1241 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:28.316668 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-406d25b5-b7f0-48a5-ace1-189eb8e1643e tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:28.324862 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-406d25b5-b7f0-48a5-ace1-189eb8e1643e tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: 3ab83a18-0e02-4082-a9f8-b7f93ad2e347] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:28.377258 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-406d25b5-b7f0-48a5-ace1-189eb8e1643e tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:28.381643 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-406d25b5-b7f0-48a5-ace1-189eb8e1643e tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:28.389777 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-406d25b5-b7f0-48a5-ace1-189eb8e1643e tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:28.401848 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-406d25b5-b7f0-48a5-ace1-189eb8e1643e tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:28.407132 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-406d25b5-b7f0-48a5-ace1-189eb8e1643e tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:28.410474 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-406d25b5-b7f0-48a5-ace1-189eb8e1643e tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:28.502905 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d68a900b-821d-489a-b739-93912ba883e1 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:28.504072 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d68a900b-821d-489a-b739-93912ba883e1 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] [instance: cafdd5ab-69fa-40fc-a555-8a2668f40e5e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:28.846576 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d68a900b-821d-489a-b739-93912ba883e1 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbe3a24b2f6451ca174d708962e49ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065037c7cf1d4b0d8d12253372a605b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:28.869399 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d68a900b-821d-489a-b739-93912ba883e1 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] 10.222.0.67 "GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e" status: 200 len: 1241 microversion: 2.1 time: 0.380930 Sep 16 12:45:28.871292 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 45/103] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:28 2022] GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e => generated 1241 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:45:28.902886 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:45:28.959352 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-406d25b5-b7f0-48a5-ace1-189eb8e1643e tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da877221336e4e58859c207fca5e857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b6b2ef87ef4629941a0cc9942d7e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:28.983103 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-406d25b5-b7f0-48a5-ace1-189eb8e1643e tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347" status: 200 len: 1341 microversion: 2.1 time: 0.685708 Sep 16 12:45:28.988504 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 59/104] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:28 2022] GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347 => generated 1341 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:45:29.783498 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-9c6b1b4c-fc26-47f1-96e5-e2f3c1884e00 req-fbf80d1b-755d-4617-8a13-bd81c2d2d0c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ab83a18-0e02-4082-a9f8-b7f93ad2e347", "tag": "aef79ed7-9782-4b45-9885-4a06aa3cc1f4"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:29.824785 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-9c6b1b4c-fc26-47f1-96e5-e2f3c1884e00 req-fbf80d1b-755d-4617-8a13-bd81c2d2d0c5 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:29.824785 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-9c6b1b4c-fc26-47f1-96e5-e2f3c1884e00 req-fbf80d1b-755d-4617-8a13-bd81c2d2d0c5 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:29.824785 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-9c6b1b4c-fc26-47f1-96e5-e2f3c1884e00 req-fbf80d1b-755d-4617-8a13-bd81c2d2d0c5 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:29.864767 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-9c6b1b4c-fc26-47f1-96e5-e2f3c1884e00 req-fbf80d1b-755d-4617-8a13-bd81c2d2d0c5 service nova] Creating event network-changed:aef79ed7-9782-4b45-9885-4a06aa3cc1f4 for instance 3ab83a18-0e02-4082-a9f8-b7f93ad2e347 on n-h2-858094-4 Sep 16 12:45:29.865384 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-9c6b1b4c-fc26-47f1-96e5-e2f3c1884e00 req-fbf80d1b-755d-4617-8a13-bd81c2d2d0c5 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128780) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 16 12:45:29.865777 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-9c6b1b4c-fc26-47f1-96e5-e2f3c1884e00 req-fbf80d1b-755d-4617-8a13-bd81c2d2d0c5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128780) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 16 12:45:29.867137 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ab7fcd06-ac9c-4a82-a62d-f7fc63019749 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:29.867729 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ab7fcd06-ac9c-4a82-a62d-f7fc63019749 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:29.868381 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ab7fcd06-ac9c-4a82-a62d-f7fc63019749 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:29.869650 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ab7fcd06-ac9c-4a82-a62d-f7fc63019749 None None] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:29.870169 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ab7fcd06-ac9c-4a82-a62d-f7fc63019749 None None] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:29.870866 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ab7fcd06-ac9c-4a82-a62d-f7fc63019749 None None] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:29.881203 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.compute.rpcapi [None req-ab7fcd06-ac9c-4a82-a62d-f7fc63019749 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 16 12:45:29.882443 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ab7fcd06-ac9c-4a82-a62d-f7fc63019749 None None] Releasing lock "compute-rpcapi-router" {{(pid=128780) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 16 12:45:29.897457 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bece7969-ced7-40d8-8cb5-9282d6b2ccac tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:29.898478 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bece7969-ced7-40d8-8cb5-9282d6b2ccac tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] [instance: cafdd5ab-69fa-40fc-a555-8a2668f40e5e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:29.910450 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bece7969-ced7-40d8-8cb5-9282d6b2ccac tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:29.912517 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bece7969-ced7-40d8-8cb5-9282d6b2ccac tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:29.913469 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bece7969-ced7-40d8-8cb5-9282d6b2ccac tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:29.915186 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bece7969-ced7-40d8-8cb5-9282d6b2ccac tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:29.916184 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ab7fcd06-ac9c-4a82-a62d-f7fc63019749 None None] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.042816 Sep 16 12:45:29.917000 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 46/105] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:29.923245 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bece7969-ced7-40d8-8cb5-9282d6b2ccac tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:29.926095 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bece7969-ced7-40d8-8cb5-9282d6b2ccac tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:30.013489 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-14814e23-d147-4c8d-8fb8-190f4f5de53c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:30.014204 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-14814e23-d147-4c8d-8fb8-190f4f5de53c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: 3ab83a18-0e02-4082-a9f8-b7f93ad2e347] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:30.028498 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14814e23-d147-4c8d-8fb8-190f4f5de53c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:30.029039 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14814e23-d147-4c8d-8fb8-190f4f5de53c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:30.029479 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14814e23-d147-4c8d-8fb8-190f4f5de53c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:30.032507 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bece7969-ced7-40d8-8cb5-9282d6b2ccac tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbe3a24b2f6451ca174d708962e49ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065037c7cf1d4b0d8d12253372a605b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:30.043308 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14814e23-d147-4c8d-8fb8-190f4f5de53c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:30.044162 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14814e23-d147-4c8d-8fb8-190f4f5de53c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:30.044609 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14814e23-d147-4c8d-8fb8-190f4f5de53c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:30.046845 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bece7969-ced7-40d8-8cb5-9282d6b2ccac tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] 10.222.0.67 "GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e" status: 200 len: 1233 microversion: 2.1 time: 0.153760 Sep 16 12:45:30.047834 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 60/106] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:29 2022] GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e => generated 1233 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:45:30.297686 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-14814e23-d147-4c8d-8fb8-190f4f5de53c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da877221336e4e58859c207fca5e857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b6b2ef87ef4629941a0cc9942d7e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:30.313089 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-14814e23-d147-4c8d-8fb8-190f4f5de53c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347" status: 200 len: 1341 microversion: 2.1 time: 0.305581 Sep 16 12:45:30.314382 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 47/107] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:30 2022] GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347 => generated 1341 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:31.075416 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fa1f7064-eac5-48f9-b173-71367564a594 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:31.076039 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fa1f7064-eac5-48f9-b173-71367564a594 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] [instance: cafdd5ab-69fa-40fc-a555-8a2668f40e5e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:31.087666 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:45:31.090591 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa1f7064-eac5-48f9-b173-71367564a594 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:31.093775 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa1f7064-eac5-48f9-b173-71367564a594 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:31.096173 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa1f7064-eac5-48f9-b173-71367564a594 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:31.097810 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa1f7064-eac5-48f9-b173-71367564a594 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:31.099001 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa1f7064-eac5-48f9-b173-71367564a594 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:31.101422 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa1f7064-eac5-48f9-b173-71367564a594 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:31.230973 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fa1f7064-eac5-48f9-b173-71367564a594 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbe3a24b2f6451ca174d708962e49ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065037c7cf1d4b0d8d12253372a605b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:31.251067 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fa1f7064-eac5-48f9-b173-71367564a594 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] 10.222.0.67 "GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e" status: 200 len: 1233 microversion: 2.1 time: 0.180167 Sep 16 12:45:31.252521 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 61/108] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:31 2022] GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e => generated 1233 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:31.346278 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b0bf26bf-a1b8-4ee2-be17-d57c59fe87e6 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:31.348625 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b0bf26bf-a1b8-4ee2-be17-d57c59fe87e6 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: 3ab83a18-0e02-4082-a9f8-b7f93ad2e347] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:31.363585 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b0bf26bf-a1b8-4ee2-be17-d57c59fe87e6 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:31.364103 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b0bf26bf-a1b8-4ee2-be17-d57c59fe87e6 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:31.364570 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b0bf26bf-a1b8-4ee2-be17-d57c59fe87e6 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:31.365298 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b0bf26bf-a1b8-4ee2-be17-d57c59fe87e6 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:31.365741 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b0bf26bf-a1b8-4ee2-be17-d57c59fe87e6 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:31.368981 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b0bf26bf-a1b8-4ee2-be17-d57c59fe87e6 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:31.698844 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-b0bf26bf-a1b8-4ee2-be17-d57c59fe87e6 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da877221336e4e58859c207fca5e857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b6b2ef87ef4629941a0cc9942d7e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:31.716772 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b0bf26bf-a1b8-4ee2-be17-d57c59fe87e6 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347" status: 200 len: 1341 microversion: 2.1 time: 0.382411 Sep 16 12:45:31.718193 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 48/109] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:31 2022] GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347 => generated 1341 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:45:32.280487 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3830d454-9361-4eaa-b874-d0f6629544e7 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:32.282325 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3830d454-9361-4eaa-b874-d0f6629544e7 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] [instance: cafdd5ab-69fa-40fc-a555-8a2668f40e5e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:32.307442 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3830d454-9361-4eaa-b874-d0f6629544e7 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:32.314637 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3830d454-9361-4eaa-b874-d0f6629544e7 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:32.316153 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3830d454-9361-4eaa-b874-d0f6629544e7 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:32.319632 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3830d454-9361-4eaa-b874-d0f6629544e7 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:32.325884 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3830d454-9361-4eaa-b874-d0f6629544e7 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:32.326481 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3830d454-9361-4eaa-b874-d0f6629544e7 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:32.471178 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3830d454-9361-4eaa-b874-d0f6629544e7 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbe3a24b2f6451ca174d708962e49ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065037c7cf1d4b0d8d12253372a605b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:32.496915 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3830d454-9361-4eaa-b874-d0f6629544e7 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] 10.222.0.67 "GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e" status: 200 len: 1233 microversion: 2.1 time: 0.217194 Sep 16 12:45:32.506405 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 62/110] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:32 2022] GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e => generated 1233 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:32.747668 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a32ff28b-cc38-46c8-ba1f-cc236d881959 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:32.748635 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a32ff28b-cc38-46c8-ba1f-cc236d881959 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: 3ab83a18-0e02-4082-a9f8-b7f93ad2e347] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:32.768891 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a32ff28b-cc38-46c8-ba1f-cc236d881959 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:32.772281 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a32ff28b-cc38-46c8-ba1f-cc236d881959 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:32.773689 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a32ff28b-cc38-46c8-ba1f-cc236d881959 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:32.775146 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a32ff28b-cc38-46c8-ba1f-cc236d881959 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:32.775958 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a32ff28b-cc38-46c8-ba1f-cc236d881959 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:32.778359 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a32ff28b-cc38-46c8-ba1f-cc236d881959 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:33.175990 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a32ff28b-cc38-46c8-ba1f-cc236d881959 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da877221336e4e58859c207fca5e857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b6b2ef87ef4629941a0cc9942d7e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:33.190731 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a32ff28b-cc38-46c8-ba1f-cc236d881959 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347" status: 200 len: 1341 microversion: 2.1 time: 0.444252 Sep 16 12:45:33.192029 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 49/111] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:32 2022] GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347 => generated 1341 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:33.528003 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9a8b07b0-6db0-4952-8aba-885f88d2a3cf tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:33.529099 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9a8b07b0-6db0-4952-8aba-885f88d2a3cf tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] [instance: cafdd5ab-69fa-40fc-a555-8a2668f40e5e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:33.543744 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9a8b07b0-6db0-4952-8aba-885f88d2a3cf tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:33.544594 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9a8b07b0-6db0-4952-8aba-885f88d2a3cf tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:33.549718 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9a8b07b0-6db0-4952-8aba-885f88d2a3cf tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:33.554274 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9a8b07b0-6db0-4952-8aba-885f88d2a3cf tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:33.555067 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9a8b07b0-6db0-4952-8aba-885f88d2a3cf tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:33.556450 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9a8b07b0-6db0-4952-8aba-885f88d2a3cf tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:33.801972 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9a8b07b0-6db0-4952-8aba-885f88d2a3cf tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbe3a24b2f6451ca174d708962e49ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065037c7cf1d4b0d8d12253372a605b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:33.812688 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9a8b07b0-6db0-4952-8aba-885f88d2a3cf tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] 10.222.0.67 "GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e" status: 200 len: 1289 microversion: 2.1 time: 0.289275 Sep 16 12:45:33.829745 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 50/112] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:33 2022] GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e => generated 1289 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:34.208676 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-280a853d-8420-4238-b1ee-1b26f710be6b tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Calling method '.version_select at 0x7f10366254c0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:34.211034 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-280a853d-8420-4238-b1ee-1b26f710be6b tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:34.211600 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-280a853d-8420-4238-b1ee-1b26f710be6b tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:34.212784 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-280a853d-8420-4238-b1ee-1b26f710be6b tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:34.215904 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-34d3123b-c136-4932-a6b1-a3472728746b tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:34.216770 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-34d3123b-c136-4932-a6b1-a3472728746b tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: 3ab83a18-0e02-4082-a9f8-b7f93ad2e347] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:34.228176 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-34d3123b-c136-4932-a6b1-a3472728746b tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:34.233273 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-34d3123b-c136-4932-a6b1-a3472728746b tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:34.234040 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-34d3123b-c136-4932-a6b1-a3472728746b tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:34.235325 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-34d3123b-c136-4932-a6b1-a3472728746b tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:34.236016 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-34d3123b-c136-4932-a6b1-a3472728746b tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:34.236741 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-34d3123b-c136-4932-a6b1-a3472728746b tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:34.297718 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-280a853d-8420-4238-b1ee-1b26f710be6b tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:34.303262 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-280a853d-8420-4238-b1ee-1b26f710be6b tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:34.306040 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-280a853d-8420-4238-b1ee-1b26f710be6b tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:34.391503 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-280a853d-8420-4238-b1ee-1b26f710be6b tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:34.392088 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-280a853d-8420-4238-b1ee-1b26f710be6b tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:34.393167 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-280a853d-8420-4238-b1ee-1b26f710be6b tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:34.418150 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-280a853d-8420-4238-b1ee-1b26f710be6b tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.974996 Sep 16 12:45:34.418617 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 63/113] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:45:33 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:34.568052 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-34d3123b-c136-4932-a6b1-a3472728746b tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da877221336e4e58859c207fca5e857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b6b2ef87ef4629941a0cc9942d7e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:34.579228 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-34d3123b-c136-4932-a6b1-a3472728746b tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347" status: 200 len: 1341 microversion: 2.1 time: 0.368720 Sep 16 12:45:34.581813 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 51/114] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:34 2022] GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347 => generated 1341 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:34.589589 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6aef61f0-b536-46ce-8250-5d52a064c3fc tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Calling method '.version_select at 0x7f10361c7940>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:34.593034 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6aef61f0-b536-46ce-8250-5d52a064c3fc tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:34.595896 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6aef61f0-b536-46ce-8250-5d52a064c3fc tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:34.596805 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6aef61f0-b536-46ce-8250-5d52a064c3fc tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:34.649417 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6aef61f0-b536-46ce-8250-5d52a064c3fc tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:34.650874 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6aef61f0-b536-46ce-8250-5d52a064c3fc tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:34.652176 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6aef61f0-b536-46ce-8250-5d52a064c3fc tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:34.708169 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6aef61f0-b536-46ce-8250-5d52a064c3fc tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:34.709110 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6aef61f0-b536-46ce-8250-5d52a064c3fc tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:34.713646 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6aef61f0-b536-46ce-8250-5d52a064c3fc tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:34.737284 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6aef61f0-b536-46ce-8250-5d52a064c3fc tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.142597 Sep 16 12:45:34.745286 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 52/115] 10.222.0.67 () {58 vars in 1167 bytes} [Fri Sep 16 12:45:34 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:34.762128 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8962ef92-4e59-42b7-8b0a-684ce58d72a9 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Calling method '.version_select at 0x7f103629f550>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:34.764546 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8962ef92-4e59-42b7-8b0a-684ce58d72a9 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:34.772690 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8962ef92-4e59-42b7-8b0a-684ce58d72a9 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:34.772690 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8962ef92-4e59-42b7-8b0a-684ce58d72a9 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:34.792197 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8962ef92-4e59-42b7-8b0a-684ce58d72a9 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:34.794142 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8962ef92-4e59-42b7-8b0a-684ce58d72a9 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:34.799976 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8962ef92-4e59-42b7-8b0a-684ce58d72a9 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:34.830260 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8962ef92-4e59-42b7-8b0a-684ce58d72a9 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:34.832775 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8962ef92-4e59-42b7-8b0a-684ce58d72a9 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:34.836179 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8962ef92-4e59-42b7-8b0a-684ce58d72a9 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:34.846994 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8962ef92-4e59-42b7-8b0a-684ce58d72a9 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.089344 Sep 16 12:45:34.853364 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 53/116] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:45:34 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:45:34.864378 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-cf66d061-ab35-4f7d-b1c2-85f4b86047d2 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:34.866814 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-cf66d061-ab35-4f7d-b1c2-85f4b86047d2 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] [instance: cafdd5ab-69fa-40fc-a555-8a2668f40e5e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:34.882738 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cf66d061-ab35-4f7d-b1c2-85f4b86047d2 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:34.886046 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cf66d061-ab35-4f7d-b1c2-85f4b86047d2 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:34.886752 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cf66d061-ab35-4f7d-b1c2-85f4b86047d2 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:34.887777 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-440270ce-711f-490b-b20e-ef314b8bf82f tempest-FlavorsExtraSpecsNegativeTestJSON-208206581 tempest-FlavorsExtraSpecsNegativeTestJSON-208206581-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1747211970", "ram": 512, "vcpus": 1, "disk": 10, "id": 676767665, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:34.893776 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cf66d061-ab35-4f7d-b1c2-85f4b86047d2 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:34.894959 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cf66d061-ab35-4f7d-b1c2-85f4b86047d2 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:34.897988 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cf66d061-ab35-4f7d-b1c2-85f4b86047d2 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:34.987029 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-440270ce-711f-490b-b20e-ef314b8bf82f tempest-FlavorsExtraSpecsNegativeTestJSON-208206581 tempest-FlavorsExtraSpecsNegativeTestJSON-208206581-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.565950 Sep 16 12:45:34.990142 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 64/117] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:45:34 2022] POST /compute/v2.1/flavors => generated 413 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:34.997354 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0de4323a-6291-4fa4-9240-725123281d9d tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Calling method '.version_select at 0x7f10365fb040>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:35.013826 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0de4323a-6291-4fa4-9240-725123281d9d tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:35.014335 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0de4323a-6291-4fa4-9240-725123281d9d tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:35.015587 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0de4323a-6291-4fa4-9240-725123281d9d tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:35.059201 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0de4323a-6291-4fa4-9240-725123281d9d tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:35.060004 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0de4323a-6291-4fa4-9240-725123281d9d tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:35.060611 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0de4323a-6291-4fa4-9240-725123281d9d tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:35.069515 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0de4323a-6291-4fa4-9240-725123281d9d tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.077608 Sep 16 12:45:35.070816 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 65/118] 10.222.0.67 () {58 vars in 1152 bytes} [Fri Sep 16 12:45:34 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:35.135305 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-cf66d061-ab35-4f7d-b1c2-85f4b86047d2 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbe3a24b2f6451ca174d708962e49ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065037c7cf1d4b0d8d12253372a605b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:35.145961 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-cf66d061-ab35-4f7d-b1c2-85f4b86047d2 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] 10.222.0.67 "GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e" status: 200 len: 1307 microversion: 2.1 time: 0.291012 Sep 16 12:45:35.147244 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 54/119] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:34 2022] GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e => generated 1307 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:35.152614 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0d9cbe40-3324-4236-a5a0-6e45a6c46c46 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Calling method '.version_select at 0x7f10361b1b80>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:35.154735 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0d9cbe40-3324-4236-a5a0-6e45a6c46c46 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:35.155302 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0d9cbe40-3324-4236-a5a0-6e45a6c46c46 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:35.155830 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0d9cbe40-3324-4236-a5a0-6e45a6c46c46 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:35.176521 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0d9cbe40-3324-4236-a5a0-6e45a6c46c46 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.027774 Sep 16 12:45:35.177465 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 55/120] 10.222.0.67 () {58 vars in 1179 bytes} [Fri Sep 16 12:45:35 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:35.199864 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f551c13f-6893-4367-9351-f4b3aaec6992 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Calling method '.version_select at 0x7f10361b1430>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:35.203602 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f551c13f-6893-4367-9351-f4b3aaec6992 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:35.204464 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f551c13f-6893-4367-9351-f4b3aaec6992 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:35.205086 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f551c13f-6893-4367-9351-f4b3aaec6992 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:35.245810 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f551c13f-6893-4367-9351-f4b3aaec6992 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:35.249959 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f551c13f-6893-4367-9351-f4b3aaec6992 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:35.250981 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f551c13f-6893-4367-9351-f4b3aaec6992 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:35.285531 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f551c13f-6893-4367-9351-f4b3aaec6992 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:35.287669 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f551c13f-6893-4367-9351-f4b3aaec6992 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:35.291013 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f551c13f-6893-4367-9351-f4b3aaec6992 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:35.300301 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=100 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:45:35.313839 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f551c13f-6893-4367-9351-f4b3aaec6992 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.119330 Sep 16 12:45:35.317297 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 56/121] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:45:35 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:45:35.331087 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3f9f92f8-5ae7-455d-8538-0cdd5b3f97c7 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Calling method '.version_select at 0x7f10361b15e0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:35.334136 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3f9f92f8-5ae7-455d-8538-0cdd5b3f97c7 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:35.337398 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3f9f92f8-5ae7-455d-8538-0cdd5b3f97c7 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:35.338322 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3f9f92f8-5ae7-455d-8538-0cdd5b3f97c7 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:35.407734 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3f9f92f8-5ae7-455d-8538-0cdd5b3f97c7 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:35.412976 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3f9f92f8-5ae7-455d-8538-0cdd5b3f97c7 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:35.413731 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3f9f92f8-5ae7-455d-8538-0cdd5b3f97c7 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:35.438727 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3f9f92f8-5ae7-455d-8538-0cdd5b3f97c7 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.111765 Sep 16 12:45:35.444490 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 57/122] 10.222.0.67 () {58 vars in 1152 bytes} [Fri Sep 16 12:45:35 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:45:35.456712 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0aba7a05-bb85-423e-adb3-ce5dc1776a63 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Calling method '.version_select at 0x7f10363319d0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:35.458543 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0aba7a05-bb85-423e-adb3-ce5dc1776a63 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:35.459030 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0aba7a05-bb85-423e-adb3-ce5dc1776a63 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:35.459469 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0aba7a05-bb85-423e-adb3-ce5dc1776a63 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:35.484112 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0aba7a05-bb85-423e-adb3-ce5dc1776a63 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:35.485013 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0aba7a05-bb85-423e-adb3-ce5dc1776a63 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:35.485661 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0aba7a05-bb85-423e-adb3-ce5dc1776a63 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:35.494213 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0aba7a05-bb85-423e-adb3-ce5dc1776a63 tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.040797 Sep 16 12:45:35.495488 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 58/123] 10.222.0.67 () {58 vars in 1152 bytes} [Fri Sep 16 12:45:35 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:35.511101 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-45ce28d6-10e4-4bbc-85dd-9a9e5ce1584c tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Calling method '.version_select at 0x7f10361b1160>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:35.513538 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-45ce28d6-10e4-4bbc-85dd-9a9e5ce1584c tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:35.514274 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-45ce28d6-10e4-4bbc-85dd-9a9e5ce1584c tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:35.514943 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-45ce28d6-10e4-4bbc-85dd-9a9e5ce1584c tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:35.535177 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-45ce28d6-10e4-4bbc-85dd-9a9e5ce1584c tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:35.535769 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-45ce28d6-10e4-4bbc-85dd-9a9e5ce1584c tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:35.536350 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-45ce28d6-10e4-4bbc-85dd-9a9e5ce1584c tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:35.552541 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-018510e5-7b63-45ef-89fe-70b2b27c5d01 tempest-FlavorsExtraSpecsNegativeTestJSON-7179991 tempest-FlavorsExtraSpecsNegativeTestJSON-7179991-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:35.553126 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-45ce28d6-10e4-4bbc-85dd-9a9e5ce1584c tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:35.553700 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-45ce28d6-10e4-4bbc-85dd-9a9e5ce1584c tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:35.555298 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-45ce28d6-10e4-4bbc-85dd-9a9e5ce1584c tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:35.601068 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-018510e5-7b63-45ef-89fe-70b2b27c5d01 tempest-FlavorsExtraSpecsNegativeTestJSON-7179991 tempest-FlavorsExtraSpecsNegativeTestJSON-7179991-project] HTTP exception thrown: Flavor 676767665 has no extra specs with key hw:cpu_thread_policy. Sep 16 12:45:35.603342 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-018510e5-7b63-45ef-89fe-70b2b27c5d01 tempest-FlavorsExtraSpecsNegativeTestJSON-7179991 tempest-FlavorsExtraSpecsNegativeTestJSON-7179991-project] Request method failure captured: Sep 16 12:45:35.603342 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/flavors/676767665/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 16 12:45:35.603342 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:45:35.603342 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:45:35.603342 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:45:35.603342 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:45:35.603342 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:45:35.603342 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:45:35.603342 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:45:35.603342 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:45:35.603342 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJG_qjYQLQ06XibWcVyp-L203TsdUT8EYYakRjju48TJQxfClFPSnx5gwPIlXHkBowcIKyWtDUtCNujcWLDU0OEdoPSZNNUy98-mg7J6a_Qe3PS4Xw5g7afbknqBFIcC7Pft1-_qKdR48QFyLpwNuIq_idPN1aSiIGbUd5kRpAFJZvs0 Sep 16 12:45:35.603342 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:45:35.603342 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:45:35.603342 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:45:35.603342 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:45:35.603342 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:45:35.603342 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:45:35.603342 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 15ec07e7ce844c45a8ebf10e45c689a3 Sep 16 12:45:35.603342 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-7179991 Sep 16 12:45:35.603342 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:45:35.603342 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:45:35.604729 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/15ec07e7ce844c45a8ebf10e45c689a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/15ec07e7ce844c45a8ebf10e45c689a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_15ec07e7ce844c45a8ebf10e45c689a3", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/15ec07e7ce844c45a8ebf10e45c689a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:45:35.604729 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-7179991 Sep 16 12:45:35.604729 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 15ec07e7ce844c45a8ebf10e45c689a3 Sep 16 12:45:35.604729 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-7179991 Sep 16 12:45:35.604729 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-7179991-project Sep 16 12:45:35.604729 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:45:35.604729 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:45:35.604729 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: d3a42aa8da434b3080bb55a6f9fe8a56 Sep 16 12:45:35.604729 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-7179991-project Sep 16 12:45:35.604729 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:45:35.604729 n-d-858094-4 devstack@n-api.service[128779]: exception: Flavor 676767665 has no extra specs with key hw:cpu_thread_policy. Sep 16 12:45:35.605584 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'flavor_id': '676767665', 'id': 'hw:cpu_thread_policy'} Sep 16 12:45:35.605584 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:45:35.605584 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:35.605584 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Sep 16 12:45:35.605584 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Sep 16 12:45:35.605584 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 16 12:45:35.605584 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:35.605584 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:35.605584 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:35.605584 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:35.605584 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:35.605584 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:35.605584 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:45:35.605584 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:45:35.605584 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:45:35.605584 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:45:35.605584 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Sep 16 12:45:35.605584 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 16 12:45:35.605584 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 676767665 has no extra specs with key hw:cpu_thread_policy. Sep 16 12:45:35.605584 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:35.605584 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:35.605584 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:35.606992 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:35.606992 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:35.606992 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:35.606992 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:45:35.606992 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:45:35.606992 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 676767665 has no extra specs with key hw:cpu_thread_policy. Sep 16 12:45:35.606992 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:35.606992 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-018510e5-7b63-45ef-89fe-70b2b27c5d01 tempest-FlavorsExtraSpecsNegativeTestJSON-7179991 tempest-FlavorsExtraSpecsNegativeTestJSON-7179991-project] Returning 404 to user: Flavor 676767665 has no extra specs with key hw:cpu_thread_policy. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:45:35.606992 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-018510e5-7b63-45ef-89fe-70b2b27c5d01 tempest-FlavorsExtraSpecsNegativeTestJSON-7179991 tempest-FlavorsExtraSpecsNegativeTestJSON-7179991-project] 10.222.0.67 "GET /compute/v2.1/flavors/676767665/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.532671 Sep 16 12:45:35.617961 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 66/124] 10.222.0.67 () {58 vars in 1263 bytes} [Fri Sep 16 12:45:35 2022] GET /compute/v2.1/flavors/676767665/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 546 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:45:35.629884 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5b56b873-cba9-46fa-b6a1-07e12001bae1 tempest-FlavorsExtraSpecsNegativeTestJSON-7179991 tempest-FlavorsExtraSpecsNegativeTestJSON-7179991-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:35.635833 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5b56b873-cba9-46fa-b6a1-07e12001bae1 tempest-FlavorsExtraSpecsNegativeTestJSON-7179991 tempest-FlavorsExtraSpecsNegativeTestJSON-7179991-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'd3a42aa8da434b3080bb55a6f9fe8a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ec07e7ce844c45a8ebf10e45c689a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:35.645217 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5b56b873-cba9-46fa-b6a1-07e12001bae1 tempest-FlavorsExtraSpecsNegativeTestJSON-7179991 tempest-FlavorsExtraSpecsNegativeTestJSON-7179991-project] Request method failure captured: Sep 16 12:45:35.645217 n-d-858094-4 devstack@n-api.service[128779]: request: POST /compute/v2.1/flavors/676767665/os-extra_specs HTTP/1.1 Sep 16 12:45:35.645217 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:45:35.645217 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:45:35.645217 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:45:35.645217 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 66 Sep 16 12:45:35.645217 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:45:35.645217 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:45:35.645217 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:45:35.645217 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:45:35.645217 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJG_qjYQLQ06XibWcVyp-L203TsdUT8EYYakRjju48TJQxfClFPSnx5gwPIlXHkBowcIKyWtDUtCNujcWLDU0OEdoPSZNNUy98-mg7J6a_Qe3PS4Xw5g7afbknqBFIcC7Pft1-_qKdR48QFyLpwNuIq_idPN1aSiIGbUd5kRpAFJZvs0 Sep 16 12:45:35.645217 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:45:35.645217 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:45:35.645217 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:45:35.645217 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:45:35.645217 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:45:35.645217 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:45:35.645217 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 15ec07e7ce844c45a8ebf10e45c689a3 Sep 16 12:45:35.645217 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-7179991 Sep 16 12:45:35.645217 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:45:35.645217 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:45:35.646599 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/15ec07e7ce844c45a8ebf10e45c689a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/15ec07e7ce844c45a8ebf10e45c689a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_15ec07e7ce844c45a8ebf10e45c689a3", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/15ec07e7ce844c45a8ebf10e45c689a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:45:35.646599 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-7179991 Sep 16 12:45:35.646599 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 15ec07e7ce844c45a8ebf10e45c689a3 Sep 16 12:45:35.646599 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-7179991 Sep 16 12:45:35.646599 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-7179991-project Sep 16 12:45:35.646599 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:45:35.646599 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:45:35.646599 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: d3a42aa8da434b3080bb55a6f9fe8a56 Sep 16 12:45:35.646599 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-7179991-project Sep 16 12:45:35.646599 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 12:45:35.646599 n-d-858094-4 devstack@n-api.service[128779]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Sep 16 12:45:35.646599 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:45:35.647360 n-d-858094-4 devstack@n-api.service[128779]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 16 12:45:35.647360 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'flavor_id': '676767665', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Sep 16 12:45:35.647360 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:45:35.647360 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:35.647360 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:35.647360 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:35.647360 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:45:35.647360 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:45:35.647360 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:45:35.647360 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:45:35.647360 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:45:35.647360 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:45:35.647360 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Sep 16 12:45:35.647360 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Sep 16 12:45:35.647360 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 12:45:35.647360 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 12:45:35.647360 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 12:45:35.647360 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 12:45:35.647360 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:45:35.648574 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:45:35.648574 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:45:35.648574 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:45:35.648574 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 12:45:35.648574 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 12:45:35.648574 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 12:45:35.648574 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 12:45:35.648574 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 12:45:35.648574 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 12:45:35.648574 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 16 12:45:35.648574 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:35.648574 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:35.648574 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:35.648574 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:35.648574 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:35.648574 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:35.648574 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 12:45:35.648574 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 12:45:35.648574 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 16 12:45:35.648574 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:35.651232 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5b56b873-cba9-46fa-b6a1-07e12001bae1 tempest-FlavorsExtraSpecsNegativeTestJSON-7179991 tempest-FlavorsExtraSpecsNegativeTestJSON-7179991-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:45:35.659906 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5b56b873-cba9-46fa-b6a1-07e12001bae1 tempest-FlavorsExtraSpecsNegativeTestJSON-7179991 tempest-FlavorsExtraSpecsNegativeTestJSON-7179991-project] 10.222.0.67 "POST /compute/v2.1/flavors/676767665/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.040555 Sep 16 12:45:35.667789 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 67/125] 10.222.0.67 () {60 vars in 1221 bytes} [Fri Sep 16 12:45:35 2022] POST /compute/v2.1/flavors/676767665/os-extra_specs => generated 124 bytes in 49 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:45:35.674150 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-444b8fc9-3c5d-48d0-acfe-755f19ef0b29 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:35.675056 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-444b8fc9-3c5d-48d0-acfe-755f19ef0b29 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: 3ab83a18-0e02-4082-a9f8-b7f93ad2e347] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:35.682220 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-444b8fc9-3c5d-48d0-acfe-755f19ef0b29 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:35.682927 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-444b8fc9-3c5d-48d0-acfe-755f19ef0b29 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:35.683190 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-444b8fc9-3c5d-48d0-acfe-755f19ef0b29 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:35.684501 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-444b8fc9-3c5d-48d0-acfe-755f19ef0b29 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:35.685249 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-444b8fc9-3c5d-48d0-acfe-755f19ef0b29 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:35.685903 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-444b8fc9-3c5d-48d0-acfe-755f19ef0b29 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:35.945761 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-444b8fc9-3c5d-48d0-acfe-755f19ef0b29 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da877221336e4e58859c207fca5e857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b6b2ef87ef4629941a0cc9942d7e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:35.965011 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-444b8fc9-3c5d-48d0-acfe-755f19ef0b29 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347" status: 200 len: 1341 microversion: 2.1 time: 0.294674 Sep 16 12:45:35.980287 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 68/126] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:35 2022] GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347 => generated 1341 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:35.990159 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f07ceacf-9e42-48ac-90ad-5e8d9d78b286 tempest-FlavorsExtraSpecsNegativeTestJSON-208206581 tempest-FlavorsExtraSpecsNegativeTestJSON-208206581-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:36.065302 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f07ceacf-9e42-48ac-90ad-5e8d9d78b286 tempest-FlavorsExtraSpecsNegativeTestJSON-208206581 tempest-FlavorsExtraSpecsNegativeTestJSON-208206581-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/676767665/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.086838 Sep 16 12:45:36.067283 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 69/127] 10.222.0.67 () {60 vars in 1221 bytes} [Fri Sep 16 12:45:35 2022] POST /compute/v2.1/flavors/676767665/os-extra_specs => generated 66 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 12:45:36.399548 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6fea1448-09a1-4366-b14e-fa198e3e607b tempest-FlavorsV261TestJSON-395929769 tempest-FlavorsV261TestJSON-395929769-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-280295537", "id": 802837376, "os-flavor-access:is_public": "True"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:36.429014 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6fea1448-09a1-4366-b14e-fa198e3e607b tempest-FlavorsV261TestJSON-395929769 tempest-FlavorsV261TestJSON-395929769-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 0.358772 Sep 16 12:45:36.430137 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 70/128] 10.222.0.67 () {62 vars in 1188 bytes} [Fri Sep 16 12:45:36 2022] POST /compute/v2.1/flavors => generated 464 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:45:36.437902 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7da2058b-cdf5-4e06-8907-46b971991070 tempest-FlavorsExtraSpecsNegativeTestJSON-7179991 tempest-FlavorsExtraSpecsNegativeTestJSON-7179991-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:36.442500 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7da2058b-cdf5-4e06-8907-46b971991070 tempest-FlavorsExtraSpecsNegativeTestJSON-7179991 tempest-FlavorsExtraSpecsNegativeTestJSON-7179991-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'd3a42aa8da434b3080bb55a6f9fe8a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ec07e7ce844c45a8ebf10e45c689a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:36.446852 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7da2058b-cdf5-4e06-8907-46b971991070 tempest-FlavorsExtraSpecsNegativeTestJSON-7179991 tempest-FlavorsExtraSpecsNegativeTestJSON-7179991-project] Request method failure captured: Sep 16 12:45:36.446852 n-d-858094-4 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/flavors/676767665/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 16 12:45:36.446852 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:45:36.446852 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:45:36.446852 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:45:36.446852 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:45:36.446852 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:45:36.446852 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:45:36.446852 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:45:36.446852 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:45:36.446852 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJG_qjYQLQ06XibWcVyp-L203TsdUT8EYYakRjju48TJQxfClFPSnx5gwPIlXHkBowcIKyWtDUtCNujcWLDU0OEdoPSZNNUy98-mg7J6a_Qe3PS4Xw5g7afbknqBFIcC7Pft1-_qKdR48QFyLpwNuIq_idPN1aSiIGbUd5kRpAFJZvs0 Sep 16 12:45:36.446852 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:45:36.446852 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:45:36.446852 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:45:36.446852 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:45:36.446852 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:45:36.446852 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:45:36.446852 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 15ec07e7ce844c45a8ebf10e45c689a3 Sep 16 12:45:36.446852 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-7179991 Sep 16 12:45:36.446852 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:45:36.446852 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:45:36.448233 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/15ec07e7ce844c45a8ebf10e45c689a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/15ec07e7ce844c45a8ebf10e45c689a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_15ec07e7ce844c45a8ebf10e45c689a3", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/15ec07e7ce844c45a8ebf10e45c689a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:45:36.448233 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-7179991 Sep 16 12:45:36.448233 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 15ec07e7ce844c45a8ebf10e45c689a3 Sep 16 12:45:36.448233 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-7179991 Sep 16 12:45:36.448233 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-7179991-project Sep 16 12:45:36.448233 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:45:36.448233 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:45:36.448233 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: d3a42aa8da434b3080bb55a6f9fe8a56 Sep 16 12:45:36.448233 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-7179991-project Sep 16 12:45:36.448233 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:45:36.448233 n-d-858094-4 devstack@n-api.service[128779]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 16 12:45:36.448926 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'flavor_id': '676767665', 'id': 'hw:numa_nodes'} Sep 16 12:45:36.448926 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:45:36.448926 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:36.448926 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:36.448926 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:36.448926 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:45:36.448926 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:45:36.448926 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:45:36.448926 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:45:36.448926 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Sep 16 12:45:36.448926 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Sep 16 12:45:36.448926 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 12:45:36.448926 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 12:45:36.448926 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 12:45:36.448926 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 12:45:36.448926 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:45:36.448926 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:45:36.448926 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:45:36.448926 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:45:36.448926 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 12:45:36.450226 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 12:45:36.450226 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 12:45:36.450226 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 12:45:36.450226 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 12:45:36.450226 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 12:45:36.450226 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 16 12:45:36.450226 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:36.450226 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:36.450226 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:36.450226 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:36.450226 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:36.450226 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:36.450226 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 12:45:36.450226 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 12:45:36.450226 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 16 12:45:36.450226 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:36.455368 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7da2058b-cdf5-4e06-8907-46b971991070 tempest-FlavorsExtraSpecsNegativeTestJSON-7179991 tempest-FlavorsExtraSpecsNegativeTestJSON-7179991-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:45:36.456530 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7da2058b-cdf5-4e06-8907-46b971991070 tempest-FlavorsExtraSpecsNegativeTestJSON-7179991 tempest-FlavorsExtraSpecsNegativeTestJSON-7179991-project] 10.222.0.67 "DELETE /compute/v2.1/flavors/676767665/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.023611 Sep 16 12:45:36.457563 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 71/129] 10.222.0.67 () {58 vars in 1245 bytes} [Fri Sep 16 12:45:36 2022] DELETE /compute/v2.1/flavors/676767665/os-extra_specs/hw:numa_nodes => generated 124 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:45:36.462692 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5ad00448-c4f9-4bac-9708-6fa9f05ec8f6 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:36.463508 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5ad00448-c4f9-4bac-9708-6fa9f05ec8f6 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] [instance: cafdd5ab-69fa-40fc-a555-8a2668f40e5e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:36.472551 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ad00448-c4f9-4bac-9708-6fa9f05ec8f6 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:36.473108 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ad00448-c4f9-4bac-9708-6fa9f05ec8f6 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:36.473681 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ad00448-c4f9-4bac-9708-6fa9f05ec8f6 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:36.474771 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ad00448-c4f9-4bac-9708-6fa9f05ec8f6 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:36.475546 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ad00448-c4f9-4bac-9708-6fa9f05ec8f6 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:36.476229 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ad00448-c4f9-4bac-9708-6fa9f05ec8f6 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:36.575812 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5ad00448-c4f9-4bac-9708-6fa9f05ec8f6 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbe3a24b2f6451ca174d708962e49ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065037c7cf1d4b0d8d12253372a605b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:36.584155 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5ad00448-c4f9-4bac-9708-6fa9f05ec8f6 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] 10.222.0.67 "GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e" status: 200 len: 1295 microversion: 2.1 time: 0.125302 Sep 16 12:45:36.584866 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 72/130] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:36 2022] GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e => generated 1295 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:36.847428 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-10bd3690-07b1-4336-870b-3af2b1ea48e2 tempest-FlavorsV261TestJSON-1539452439 tempest-FlavorsV261TestJSON-1539452439-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:36.859376 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-10bd3690-07b1-4336-870b-3af2b1ea48e2 tempest-FlavorsV261TestJSON-1539452439 tempest-FlavorsV261TestJSON-1539452439-project] 10.222.0.67 "GET /compute/v2.1/flavors/802837376" status: 200 len: 464 microversion: 2.61 time: 0.272832 Sep 16 12:45:36.860659 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 73/131] 10.222.0.67 () {60 vars in 1196 bytes} [Fri Sep 16 12:45:36 2022] GET /compute/v2.1/flavors/802837376 => generated 464 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:45:36.866014 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3b24fe75-0b42-4fc6-a288-99b95fc9e198 tempest-FlavorsExtraSpecsNegativeTestJSON-208206581 tempest-FlavorsExtraSpecsNegativeTestJSON-208206581-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:36.920410 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3b24fe75-0b42-4fc6-a288-99b95fc9e198 tempest-FlavorsExtraSpecsNegativeTestJSON-208206581 tempest-FlavorsExtraSpecsNegativeTestJSON-208206581-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/676767665/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.058012 Sep 16 12:45:36.924169 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-45ce28d6-10e4-4bbc-85dd-9a9e5ce1584c tempest-HypervisorAdminTestJSON-1331213373 tempest-HypervisorAdminTestJSON-1331213373-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 1.416753 Sep 16 12:45:36.924702 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 74/132] 10.222.0.67 () {60 vars in 1221 bytes} [Fri Sep 16 12:45:36 2022] POST /compute/v2.1/flavors/676767665/os-extra_specs => generated 66 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 12:45:36.925755 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 59/133] 10.222.0.67 () {58 vars in 1173 bytes} [Fri Sep 16 12:45:35 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:45:36.937621 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-bba37f79-c0e5-44f2-82c8-7e24af370f00 tempest-FlavorsV261TestJSON-395929769 tempest-FlavorsV261TestJSON-395929769-project-admin] Action: 'update', calling method: .version_select at 0x7f1037639af0>, body: {"flavor": {"description": "new"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:37.046784 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-bba37f79-c0e5-44f2-82c8-7e24af370f00 tempest-FlavorsV261TestJSON-395929769 tempest-FlavorsV261TestJSON-395929769-project-admin] 10.222.0.67 "PUT /compute/v2.1/flavors/802837376" status: 200 len: 465 microversion: 2.61 time: 0.119413 Sep 16 12:45:37.064469 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 60/134] 10.222.0.67 () {62 vars in 1216 bytes} [Fri Sep 16 12:45:36 2022] PUT /compute/v2.1/flavors/802837376 => generated 465 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:45:37.071904 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f826f3df-b327-4227-a9d7-01e195a727c9 tempest-FlavorsExtraSpecsNegativeTestJSON-7179991 tempest-FlavorsExtraSpecsNegativeTestJSON-7179991-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:37.082952 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f826f3df-b327-4227-a9d7-01e195a727c9 tempest-FlavorsExtraSpecsNegativeTestJSON-7179991 tempest-FlavorsExtraSpecsNegativeTestJSON-7179991-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'd3a42aa8da434b3080bb55a6f9fe8a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ec07e7ce844c45a8ebf10e45c689a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:37.094042 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f826f3df-b327-4227-a9d7-01e195a727c9 tempest-FlavorsExtraSpecsNegativeTestJSON-7179991 tempest-FlavorsExtraSpecsNegativeTestJSON-7179991-project] Request method failure captured: Sep 16 12:45:37.094042 n-d-858094-4 devstack@n-api.service[128780]: request: PUT /compute/v2.1/flavors/676767665/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 16 12:45:37.094042 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:45:37.094042 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:45:37.094042 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:45:37.094042 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 22 Sep 16 12:45:37.094042 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:45:37.094042 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:45:37.094042 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:45:37.094042 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:45:37.094042 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJG_qjYQLQ06XibWcVyp-L203TsdUT8EYYakRjju48TJQxfClFPSnx5gwPIlXHkBowcIKyWtDUtCNujcWLDU0OEdoPSZNNUy98-mg7J6a_Qe3PS4Xw5g7afbknqBFIcC7Pft1-_qKdR48QFyLpwNuIq_idPN1aSiIGbUd5kRpAFJZvs0 Sep 16 12:45:37.094042 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:45:37.094042 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:45:37.094042 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:45:37.094042 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:45:37.094042 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:45:37.094042 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:45:37.094042 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 15ec07e7ce844c45a8ebf10e45c689a3 Sep 16 12:45:37.094042 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-7179991 Sep 16 12:45:37.094042 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:45:37.094042 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:45:37.095625 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/15ec07e7ce844c45a8ebf10e45c689a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/15ec07e7ce844c45a8ebf10e45c689a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_15ec07e7ce844c45a8ebf10e45c689a3", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/15ec07e7ce844c45a8ebf10e45c689a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:45:37.095625 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-7179991 Sep 16 12:45:37.095625 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 15ec07e7ce844c45a8ebf10e45c689a3 Sep 16 12:45:37.095625 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-7179991 Sep 16 12:45:37.095625 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-7179991-project Sep 16 12:45:37.095625 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:45:37.095625 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:45:37.095625 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: d3a42aa8da434b3080bb55a6f9fe8a56 Sep 16 12:45:37.095625 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-7179991-project Sep 16 12:45:37.095625 n-d-858094-4 devstack@n-api.service[128780]: Sep 16 12:45:37.095625 n-d-858094-4 devstack@n-api.service[128780]: {"hw:numa_nodes": "1"} Sep 16 12:45:37.095625 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:45:37.095625 n-d-858094-4 devstack@n-api.service[128780]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 16 12:45:37.096299 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'flavor_id': '676767665', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Sep 16 12:45:37.096299 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:45:37.096299 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:37.096299 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:37.096299 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:37.096299 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:45:37.096299 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:45:37.096299 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:45:37.096299 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:45:37.096299 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:45:37.096299 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:45:37.096299 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Sep 16 12:45:37.096299 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Sep 16 12:45:37.096299 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 12:45:37.096299 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 12:45:37.096299 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 12:45:37.096299 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 12:45:37.096299 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:45:37.096299 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:45:37.097247 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:45:37.097247 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:45:37.097247 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 12:45:37.097247 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 12:45:37.097247 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 12:45:37.097247 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 12:45:37.097247 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 12:45:37.097247 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 12:45:37.097247 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 16 12:45:37.097247 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:37.097247 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:37.097247 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:37.097247 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:37.097247 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:37.097247 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:37.097247 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 12:45:37.097247 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 12:45:37.097247 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 16 12:45:37.097247 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:37.098369 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f826f3df-b327-4227-a9d7-01e195a727c9 tempest-FlavorsExtraSpecsNegativeTestJSON-7179991 tempest-FlavorsExtraSpecsNegativeTestJSON-7179991-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:45:37.098369 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f826f3df-b327-4227-a9d7-01e195a727c9 tempest-FlavorsExtraSpecsNegativeTestJSON-7179991 tempest-FlavorsExtraSpecsNegativeTestJSON-7179991-project] 10.222.0.67 "PUT /compute/v2.1/flavors/676767665/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.038023 Sep 16 12:45:37.107550 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 61/135] 10.222.0.67 () {60 vars in 1262 bytes} [Fri Sep 16 12:45:37 2022] PUT /compute/v2.1/flavors/676767665/os-extra_specs/hw:numa_nodes => generated 124 bytes in 51 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:45:37.129243 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-70661c5b-1163-4b57-9a7e-a9474af67332 tempest-FlavorsAccessTestJSON-171593654 tempest-FlavorsAccessTestJSON-171593654-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-898911566", "id": 676792272, "os-flavor-access:is_public": "False"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:37.144042 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d461846a-1ce1-47aa-8e90-d60d90de25dc tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:37.147222 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d461846a-1ce1-47aa-8e90-d60d90de25dc tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: 3ab83a18-0e02-4082-a9f8-b7f93ad2e347] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:37.179422 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d461846a-1ce1-47aa-8e90-d60d90de25dc tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:37.182532 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d461846a-1ce1-47aa-8e90-d60d90de25dc tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:37.182827 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-70661c5b-1163-4b57-9a7e-a9474af67332 tempest-FlavorsAccessTestJSON-171593654 tempest-FlavorsAccessTestJSON-171593654-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.257136 Sep 16 12:45:37.183418 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d461846a-1ce1-47aa-8e90-d60d90de25dc tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:37.184755 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d461846a-1ce1-47aa-8e90-d60d90de25dc tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:37.189717 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 75/136] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:45:36 2022] POST /compute/v2.1/flavors => generated 427 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:37.190086 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d461846a-1ce1-47aa-8e90-d60d90de25dc tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:37.193909 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d461846a-1ce1-47aa-8e90-d60d90de25dc tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:37.205066 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8fb4519e-bb0e-4545-a1a6-0055d70088b5 tempest-FlavorsV261TestJSON-1539452439 tempest-FlavorsV261TestJSON-1539452439-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:37.275035 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8fb4519e-bb0e-4545-a1a6-0055d70088b5 tempest-FlavorsV261TestJSON-1539452439 tempest-FlavorsV261TestJSON-1539452439-project] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 6736 microversion: 2.61 time: 0.081397 Sep 16 12:45:37.276088 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 76/137] 10.222.0.67 () {60 vars in 1187 bytes} [Fri Sep 16 12:45:37 2022] GET /compute/v2.1/flavors/detail => generated 6736 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:45:37.280996 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5d684180-8945-42a5-bd56-692a6535f49a tempest-FlavorsExtraSpecsNegativeTestJSON-208206581 tempest-FlavorsExtraSpecsNegativeTestJSON-208206581-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:37.288544 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-5d684180-8945-42a5-bd56-692a6535f49a tempest-FlavorsExtraSpecsNegativeTestJSON-208206581 tempest-FlavorsExtraSpecsNegativeTestJSON-208206581-project-admin] HTTP exception thrown: Flavor 676767665 has no extra specs with key hw:cpu_thread_policy. Sep 16 12:45:37.290915 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5d684180-8945-42a5-bd56-692a6535f49a tempest-FlavorsExtraSpecsNegativeTestJSON-208206581 tempest-FlavorsExtraSpecsNegativeTestJSON-208206581-project-admin] Request method failure captured: Sep 16 12:45:37.290915 n-d-858094-4 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/flavors/676767665/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 16 12:45:37.290915 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:45:37.290915 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:45:37.290915 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:45:37.290915 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:45:37.290915 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:45:37.290915 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:45:37.290915 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:45:37.290915 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:45:37.290915 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJG_uHORcdc7i2ZOkmV4yhDeJuJvqZVdURdsX2YlUpMt442B-oRnJIHgEu16DemCSiIdxGYSW5Z3t9G8lnu_9tnlr26pYhL8uULqfXdAZUyBuQFSxCx4r5lBoD7-eNWIcX5x1P4EtjIMcPDE0Hd8AM9kA-rjBmfbwwPHYjPrPbzW9Gfo Sep 16 12:45:37.290915 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:45:37.290915 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:45:37.290915 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:45:37.290915 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:45:37.290915 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:45:37.290915 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:45:37.290915 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: c2701d066d59484e9fbe9bef95b60186 Sep 16 12:45:37.290915 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-208206581 Sep 16 12:45:37.290915 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,admin,reader Sep 16 12:45:37.290915 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,admin,reader Sep 16 12:45:37.292297 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c2701d066d59484e9fbe9bef95b60186"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c2701d066d59484e9fbe9bef95b60186"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c2701d066d59484e9fbe9bef95b60186", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c2701d066d59484e9fbe9bef95b60186"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:45:37.292297 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-208206581 Sep 16 12:45:37.292297 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: c2701d066d59484e9fbe9bef95b60186 Sep 16 12:45:37.292297 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-208206581 Sep 16 12:45:37.292297 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-208206581-project-admin Sep 16 12:45:37.292297 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:45:37.292297 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:45:37.292297 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 6cbecd46863b4f05829f9d4c346a9a37 Sep 16 12:45:37.292297 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-208206581-project-admin Sep 16 12:45:37.292297 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:45:37.292297 n-d-858094-4 devstack@n-api.service[128779]: exception: Flavor 676767665 has no extra specs with key hw:cpu_thread_policy. Sep 16 12:45:37.293012 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'flavor_id': '676767665', 'id': 'hw:cpu_thread_policy'} Sep 16 12:45:37.293012 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:45:37.293012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:37.293012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Sep 16 12:45:37.293012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Sep 16 12:45:37.293012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 16 12:45:37.293012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:37.293012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:37.293012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:37.293012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:37.293012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:37.293012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:37.293012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:45:37.293012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:45:37.293012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:45:37.293012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:45:37.293012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Sep 16 12:45:37.293012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 16 12:45:37.293012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 676767665 has no extra specs with key hw:cpu_thread_policy. Sep 16 12:45:37.293012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:37.293012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:37.293012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:37.294387 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:37.294387 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:37.294387 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:37.294387 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:45:37.294387 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:45:37.294387 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 676767665 has no extra specs with key hw:cpu_thread_policy. Sep 16 12:45:37.294387 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:37.295676 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5d684180-8945-42a5-bd56-692a6535f49a tempest-FlavorsExtraSpecsNegativeTestJSON-208206581 tempest-FlavorsExtraSpecsNegativeTestJSON-208206581-project-admin] Returning 404 to user: Flavor 676767665 has no extra specs with key hw:cpu_thread_policy. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:45:37.296784 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5d684180-8945-42a5-bd56-692a6535f49a tempest-FlavorsExtraSpecsNegativeTestJSON-208206581 tempest-FlavorsExtraSpecsNegativeTestJSON-208206581-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/676767665/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.019500 Sep 16 12:45:37.297804 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 77/138] 10.222.0.67 () {58 vars in 1266 bytes} [Fri Sep 16 12:45:37 2022] DELETE /compute/v2.1/flavors/676767665/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:45:37.319023 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9d6b0c7d-b125-4266-b072-6977bf922357 tempest-FlavorsAccessTestJSON-171593654 tempest-FlavorsAccessTestJSON-171593654-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0a35211ee97448ed8b968c929692adc5"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:37.495690 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9d6b0c7d-b125-4266-b072-6977bf922357 tempest-FlavorsAccessTestJSON-171593654 tempest-FlavorsAccessTestJSON-171593654-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/676792272/action" status: 200 len: 96 microversion: 2.1 time: 0.179946 Sep 16 12:45:37.496480 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 78/139] 10.222.0.67 () {60 vars in 1197 bytes} [Fri Sep 16 12:45:37 2022] POST /compute/v2.1/flavors/676792272/action => generated 96 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 12:45:37.513252 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f85ad145-8e04-4ee2-a01c-3f41f6a6f33e tempest-FlavorsV261TestJSON-1539452439 tempest-FlavorsV261TestJSON-1539452439-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:37.558472 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f85ad145-8e04-4ee2-a01c-3f41f6a6f33e tempest-FlavorsV261TestJSON-1539452439 tempest-FlavorsV261TestJSON-1539452439-project] 10.222.0.67 "GET /compute/v2.1/flavors" status: 200 len: 3403 microversion: 2.61 time: 0.060747 Sep 16 12:45:37.559269 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 79/140] 10.222.0.67 () {60 vars in 1166 bytes} [Fri Sep 16 12:45:37 2022] GET /compute/v2.1/flavors => generated 3403 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:45:37.585670 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-93e13f54-2cd4-41c1-9597-1a447fbbd1cd tempest-FlavorsExtraSpecsNegativeTestJSON-208206581 tempest-FlavorsExtraSpecsNegativeTestJSON-208206581-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:37.595330 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-93e13f54-2cd4-41c1-9597-1a447fbbd1cd tempest-FlavorsExtraSpecsNegativeTestJSON-208206581 tempest-FlavorsExtraSpecsNegativeTestJSON-208206581-project-admin] HTTP exception thrown: Request body and URI mismatch Sep 16 12:45:37.599033 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-93e13f54-2cd4-41c1-9597-1a447fbbd1cd tempest-FlavorsExtraSpecsNegativeTestJSON-208206581 tempest-FlavorsExtraSpecsNegativeTestJSON-208206581-project-admin] Request method failure captured: Sep 16 12:45:37.599033 n-d-858094-4 devstack@n-api.service[128779]: request: PUT /compute/v2.1/flavors/676767665/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 16 12:45:37.599033 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:45:37.599033 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:45:37.599033 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:45:37.599033 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 27 Sep 16 12:45:37.599033 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:45:37.599033 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:45:37.599033 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:45:37.599033 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:45:37.599033 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJG_uHORcdc7i2ZOkmV4yhDeJuJvqZVdURdsX2YlUpMt442B-oRnJIHgEu16DemCSiIdxGYSW5Z3t9G8lnu_9tnlr26pYhL8uULqfXdAZUyBuQFSxCx4r5lBoD7-eNWIcX5x1P4EtjIMcPDE0Hd8AM9kA-rjBmfbwwPHYjPrPbzW9Gfo Sep 16 12:45:37.599033 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:45:37.599033 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:45:37.599033 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:45:37.599033 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:45:37.599033 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:45:37.599033 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:45:37.599033 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: c2701d066d59484e9fbe9bef95b60186 Sep 16 12:45:37.599033 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-208206581 Sep 16 12:45:37.599033 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,admin,reader Sep 16 12:45:37.599033 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,admin,reader Sep 16 12:45:37.600300 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c2701d066d59484e9fbe9bef95b60186"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c2701d066d59484e9fbe9bef95b60186"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c2701d066d59484e9fbe9bef95b60186", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c2701d066d59484e9fbe9bef95b60186"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:45:37.600300 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-208206581 Sep 16 12:45:37.600300 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: c2701d066d59484e9fbe9bef95b60186 Sep 16 12:45:37.600300 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-208206581 Sep 16 12:45:37.600300 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-208206581-project-admin Sep 16 12:45:37.600300 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:45:37.600300 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:45:37.600300 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 6cbecd46863b4f05829f9d4c346a9a37 Sep 16 12:45:37.600300 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-208206581-project-admin Sep 16 12:45:37.600300 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 12:45:37.600300 n-d-858094-4 devstack@n-api.service[128779]: {"hw:cpu_policy": "shared"} Sep 16 12:45:37.600300 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:45:37.600300 n-d-858094-4 devstack@n-api.service[128779]: exception: Request body and URI mismatch Sep 16 12:45:37.601178 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'flavor_id': '676767665', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Sep 16 12:45:37.601178 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:45:37.601178 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:37.601178 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:37.601178 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:37.601178 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:45:37.601178 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:45:37.601178 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:45:37.601178 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:45:37.601178 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:45:37.601178 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:45:37.601178 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Sep 16 12:45:37.601178 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Sep 16 12:45:37.601178 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Sep 16 12:45:37.601178 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:37.601178 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:37.601178 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:37.601178 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:37.601178 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:37.601178 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:37.602393 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:45:37.602393 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:45:37.602393 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Sep 16 12:45:37.602393 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:37.602393 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-93e13f54-2cd4-41c1-9597-1a447fbbd1cd tempest-FlavorsExtraSpecsNegativeTestJSON-208206581 tempest-FlavorsExtraSpecsNegativeTestJSON-208206581-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:45:37.604050 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-93e13f54-2cd4-41c1-9597-1a447fbbd1cd tempest-FlavorsExtraSpecsNegativeTestJSON-208206581 tempest-FlavorsExtraSpecsNegativeTestJSON-208206581-project-admin] 10.222.0.67 "PUT /compute/v2.1/flavors/676767665/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.026957 Sep 16 12:45:37.605009 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 80/141] 10.222.0.67 () {60 vars in 1262 bytes} [Fri Sep 16 12:45:37 2022] PUT /compute/v2.1/flavors/676767665/os-extra_specs/hw:numa_nodes => generated 73 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 16 12:45:38.037334 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7ac23732-7643-41cf-a6ca-8d1e1d3d2cb7 tempest-FlavorsAccessTestJSON-1257941767 tempest-FlavorsAccessTestJSON-1257941767-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:38.100749 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7ac23732-7643-41cf-a6ca-8d1e1d3d2cb7 tempest-FlavorsAccessTestJSON-1257941767 tempest-FlavorsAccessTestJSON-1257941767-project] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 6225 microversion: 2.1 time: 0.491220 Sep 16 12:45:38.101932 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 81/142] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:45:37 2022] GET /compute/v2.1/flavors/detail => generated 6225 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:38.107829 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6c4274a6-e1ad-42c9-ac5f-f6821065256f tempest-FlavorsV261TestJSON-395929769 tempest-FlavorsV261TestJSON-395929769-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:38.154335 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6c4274a6-e1ad-42c9-ac5f-f6821065256f tempest-FlavorsV261TestJSON-395929769 tempest-FlavorsV261TestJSON-395929769-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/802837376" status: 202 len: 0 microversion: 2.61 time: 0.050810 Sep 16 12:45:38.159317 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 82/143] 10.222.0.67 () {60 vars in 1199 bytes} [Fri Sep 16 12:45:38 2022] DELETE /compute/v2.1/flavors/802837376 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:45:38.167066 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a831dce7-f9f5-4af7-a9f5-e58f66aba621 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:38.167972 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a831dce7-f9f5-4af7-a9f5-e58f66aba621 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] [instance: cafdd5ab-69fa-40fc-a555-8a2668f40e5e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:38.177216 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a831dce7-f9f5-4af7-a9f5-e58f66aba621 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:38.177945 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a831dce7-f9f5-4af7-a9f5-e58f66aba621 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:38.178681 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a831dce7-f9f5-4af7-a9f5-e58f66aba621 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:38.181362 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a831dce7-f9f5-4af7-a9f5-e58f66aba621 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:38.182844 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a831dce7-f9f5-4af7-a9f5-e58f66aba621 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:38.183454 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a831dce7-f9f5-4af7-a9f5-e58f66aba621 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:38.455740 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d461846a-1ce1-47aa-8e90-d60d90de25dc tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da877221336e4e58859c207fca5e857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b6b2ef87ef4629941a0cc9942d7e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:38.468774 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d461846a-1ce1-47aa-8e90-d60d90de25dc tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347" status: 200 len: 1341 microversion: 2.1 time: 1.359763 Sep 16 12:45:38.470476 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 62/144] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:37 2022] GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347 => generated 1341 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:38.476578 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0098def4-4b7d-407a-b599-33afbff7b6b6 tempest-FlavorsExtraSpecsNegativeTestJSON-208206581 tempest-FlavorsExtraSpecsNegativeTestJSON-208206581-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:38.483495 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0098def4-4b7d-407a-b599-33afbff7b6b6 tempest-FlavorsExtraSpecsNegativeTestJSON-208206581 tempest-FlavorsExtraSpecsNegativeTestJSON-208206581-project-admin] Request method failure captured: Sep 16 12:45:38.483495 n-d-858094-4 devstack@n-api.service[128780]: request: PUT /compute/v2.1/flavors/676767665/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 16 12:45:38.483495 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:45:38.483495 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:45:38.483495 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:45:38.483495 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 49 Sep 16 12:45:38.483495 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:45:38.483495 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:45:38.483495 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:45:38.483495 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:45:38.483495 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJG_uHORcdc7i2ZOkmV4yhDeJuJvqZVdURdsX2YlUpMt442B-oRnJIHgEu16DemCSiIdxGYSW5Z3t9G8lnu_9tnlr26pYhL8uULqfXdAZUyBuQFSxCx4r5lBoD7-eNWIcX5x1P4EtjIMcPDE0Hd8AM9kA-rjBmfbwwPHYjPrPbzW9Gfo Sep 16 12:45:38.483495 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:45:38.483495 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:45:38.483495 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:45:38.483495 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:45:38.483495 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:45:38.483495 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:45:38.483495 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: c2701d066d59484e9fbe9bef95b60186 Sep 16 12:45:38.483495 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-208206581 Sep 16 12:45:38.483495 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,admin,reader Sep 16 12:45:38.483495 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,admin,reader Sep 16 12:45:38.484735 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c2701d066d59484e9fbe9bef95b60186"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c2701d066d59484e9fbe9bef95b60186"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c2701d066d59484e9fbe9bef95b60186", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c2701d066d59484e9fbe9bef95b60186"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:45:38.484735 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-208206581 Sep 16 12:45:38.484735 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: c2701d066d59484e9fbe9bef95b60186 Sep 16 12:45:38.484735 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-208206581 Sep 16 12:45:38.484735 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-208206581-project-admin Sep 16 12:45:38.484735 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:45:38.484735 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:45:38.484735 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 6cbecd46863b4f05829f9d4c346a9a37 Sep 16 12:45:38.484735 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-208206581-project-admin Sep 16 12:45:38.484735 n-d-858094-4 devstack@n-api.service[128780]: Sep 16 12:45:38.484735 n-d-858094-4 devstack@n-api.service[128780]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Sep 16 12:45:38.484735 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:45:38.485350 n-d-858094-4 devstack@n-api.service[128780]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 16 12:45:38.485350 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'flavor_id': '676767665', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Sep 16 12:45:38.485350 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:45:38.485350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:38.485350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 12:45:38.485350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 12:45:38.485350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 12:45:38.485350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise error Sep 16 12:45:38.485350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 16 12:45:38.485350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:38.485350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Sep 16 12:45:38.485350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 16 12:45:38.485350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Sep 16 12:45:38.485350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Sep 16 12:45:38.485350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 16 12:45:38.485350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi 'type': ['string', Sep 16 12:45:38.485350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi 'number']}}, Sep 16 12:45:38.485350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 16 12:45:38.485350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:38.485350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi On instance: Sep 16 12:45:38.485350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Sep 16 12:45:38.485350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:38.486492 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:38.486492 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:38.486492 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:38.486492 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:38.486492 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:38.486492 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:45:38.486492 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:45:38.486492 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:45:38.486492 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:45:38.486492 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 12:45:38.486492 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 12:45:38.486492 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 12:45:38.486492 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 12:45:38.486492 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 12:45:38.486492 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 12:45:38.486492 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 16 12:45:38.486492 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:38.486492 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:38.486492 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:38.486492 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:38.487461 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:38.487461 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:38.487461 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 12:45:38.487461 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 12:45:38.487461 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 16 12:45:38.487461 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:38.487461 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0098def4-4b7d-407a-b599-33afbff7b6b6 tempest-FlavorsExtraSpecsNegativeTestJSON-208206581 tempest-FlavorsExtraSpecsNegativeTestJSON-208206581-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:45:38.487461 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0098def4-4b7d-407a-b599-33afbff7b6b6 tempest-FlavorsExtraSpecsNegativeTestJSON-208206581 tempest-FlavorsExtraSpecsNegativeTestJSON-208206581-project-admin] 10.222.0.67 "PUT /compute/v2.1/flavors/676767665/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.013354 Sep 16 12:45:38.490314 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 63/145] 10.222.0.67 () {60 vars in 1262 bytes} [Fri Sep 16 12:45:38 2022] PUT /compute/v2.1/flavors/676767665/os-extra_specs/hw:numa_nodes => generated 117 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 12:45:38.497954 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ca0f6055-ef89-4f6a-bad4-a775b1038c7b tempest-FlavorsAccessTestJSON-171593654 tempest-FlavorsAccessTestJSON-171593654-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0a35211ee97448ed8b968c929692adc5"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:38.498183 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a831dce7-f9f5-4af7-a9f5-e58f66aba621 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbe3a24b2f6451ca174d708962e49ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065037c7cf1d4b0d8d12253372a605b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:38.508666 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a831dce7-f9f5-4af7-a9f5-e58f66aba621 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] 10.222.0.67 "GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e" status: 200 len: 1337 microversion: 2.1 time: 0.347010 Sep 16 12:45:38.520789 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 83/146] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:38 2022] GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e => generated 1337 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:38.534087 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f5ff69d4-bb8e-4c26-95ed-e99fdd687570 tempest-FlavorsV261TestJSON-395929769 tempest-FlavorsV261TestJSON-395929769-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:38.576457 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f5ff69d4-bb8e-4c26-95ed-e99fdd687570 tempest-FlavorsV261TestJSON-395929769 tempest-FlavorsV261TestJSON-395929769-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 6281 microversion: 2.61 time: 0.058734 Sep 16 12:45:38.588703 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 84/147] 10.222.0.67 () {60 vars in 1187 bytes} [Fri Sep 16 12:45:38 2022] GET /compute/v2.1/flavors/detail => generated 6281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:45:38.623540 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0938cb3c-9fb7-44ae-bf69-f19d5cb7abf7 tempest-FlavorsExtraSpecsNegativeTestJSON-208206581 tempest-FlavorsExtraSpecsNegativeTestJSON-208206581-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:38.667938 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0938cb3c-9fb7-44ae-bf69-f19d5cb7abf7 tempest-FlavorsExtraSpecsNegativeTestJSON-208206581 tempest-FlavorsExtraSpecsNegativeTestJSON-208206581-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/676767665" status: 202 len: 0 microversion: 2.1 time: 0.054145 Sep 16 12:45:38.672108 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 85/148] 10.222.0.67 () {58 vars in 1158 bytes} [Fri Sep 16 12:45:38 2022] DELETE /compute/v2.1/flavors/676767665 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:45:38.681435 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-95900e4e-f276-431e-b510-9f9a1841bd44 tempest-FlavorsExtraSpecsNegativeTestJSON-208206581 tempest-FlavorsExtraSpecsNegativeTestJSON-208206581-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:38.704663 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-95900e4e-f276-431e-b510-9f9a1841bd44 tempest-FlavorsExtraSpecsNegativeTestJSON-208206581 tempest-FlavorsExtraSpecsNegativeTestJSON-208206581-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030895 Sep 16 12:45:38.717988 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 86/149] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:45:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:38.816818 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ca0f6055-ef89-4f6a-bad4-a775b1038c7b tempest-FlavorsAccessTestJSON-171593654 tempest-FlavorsAccessTestJSON-171593654-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/676792272/action" status: 200 len: 21 microversion: 2.1 time: 0.325261 Sep 16 12:45:38.819923 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 64/150] 10.222.0.67 () {60 vars in 1197 bytes} [Fri Sep 16 12:45:38 2022] POST /compute/v2.1/flavors/676792272/action => generated 21 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 12:45:38.835246 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-504b8dfa-e8f2-4b71-9ff4-8bc458f410f4 tempest-FlavorsAccessTestJSON-1257941767 tempest-FlavorsAccessTestJSON-1257941767-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:38.843605 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:DELETE=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:45:38.871263 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-504b8dfa-e8f2-4b71-9ff4-8bc458f410f4 tempest-FlavorsAccessTestJSON-1257941767 tempest-FlavorsAccessTestJSON-1257941767-project] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044212 Sep 16 12:45:38.873388 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 87/151] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:45:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:38.896699 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2650f8e6-5f61-4abb-957a-2ee8273b8255 tempest-FlavorsAccessTestJSON-171593654 tempest-FlavorsAccessTestJSON-171593654-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:38.901340 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=16 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:45:38.938981 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2650f8e6-5f61-4abb-957a-2ee8273b8255 tempest-FlavorsAccessTestJSON-171593654 tempest-FlavorsAccessTestJSON-171593654-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/676792272" status: 202 len: 0 microversion: 2.1 time: 0.048890 Sep 16 12:45:38.944261 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 65/152] 10.222.0.67 () {58 vars in 1158 bytes} [Fri Sep 16 12:45:38 2022] DELETE /compute/v2.1/flavors/676792272 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:45:38.951820 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ccc3991f-6253-4cca-b950-cb0e506e29ff tempest-FlavorsAccessTestJSON-171593654 tempest-FlavorsAccessTestJSON-171593654-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:39.017629 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ccc3991f-6253-4cca-b950-cb0e506e29ff tempest-FlavorsAccessTestJSON-171593654 tempest-FlavorsAccessTestJSON-171593654-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.073177 Sep 16 12:45:39.040750 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 88/153] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:45:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:39.051865 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9bac7d3c-9540-4e5e-9477-36020641891e tempest-FlavorsAccessTestJSON-171593654 tempest-FlavorsAccessTestJSON-171593654-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1853440941", "id": 108060991, "os-flavor-access:is_public": "False"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:39.091090 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9bac7d3c-9540-4e5e-9477-36020641891e tempest-FlavorsAccessTestJSON-171593654 tempest-FlavorsAccessTestJSON-171593654-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.042969 Sep 16 12:45:39.108601 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a15c9938-b579-42da-8e23-20f0ccfdf6c0 tempest-FlavorsAccessTestJSON-171593654 tempest-FlavorsAccessTestJSON-171593654-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:39.113902 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 66/154] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:45:39 2022] POST /compute/v2.1/flavors => generated 428 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:39.132377 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a15c9938-b579-42da-8e23-20f0ccfdf6c0 tempest-FlavorsAccessTestJSON-171593654 tempest-FlavorsAccessTestJSON-171593654-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/108060991/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.032033 Sep 16 12:45:39.148325 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3af4f60f-fce2-407d-8302-fe75bac8f8b4 tempest-FlavorsAccessTestJSON-171593654 tempest-FlavorsAccessTestJSON-171593654-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:39.154878 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 89/155] 10.222.0.67 () {58 vars in 1206 bytes} [Fri Sep 16 12:45:39 2022] GET /compute/v2.1/flavors/108060991/os-flavor-access => generated 21 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 12:45:39.174951 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3af4f60f-fce2-407d-8302-fe75bac8f8b4 tempest-FlavorsAccessTestJSON-171593654 tempest-FlavorsAccessTestJSON-171593654-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/108060991" status: 202 len: 0 microversion: 2.1 time: 0.030408 Sep 16 12:45:39.185241 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a970ab9a-a1ed-439a-9dfe-f3ffd471a347 tempest-FlavorsAccessTestJSON-171593654 tempest-FlavorsAccessTestJSON-171593654-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:39.193582 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 67/156] 10.222.0.67 () {58 vars in 1158 bytes} [Fri Sep 16 12:45:39 2022] DELETE /compute/v2.1/flavors/108060991 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 12:45:39.233341 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a970ab9a-a1ed-439a-9dfe-f3ffd471a347 tempest-FlavorsAccessTestJSON-171593654 tempest-FlavorsAccessTestJSON-171593654-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052844 Sep 16 12:45:39.244723 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 90/157] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:45:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:39.492570 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e8103977-27de-4880-8209-a68ae4ec8b68 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:39.493600 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e8103977-27de-4880-8209-a68ae4ec8b68 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: 3ab83a18-0e02-4082-a9f8-b7f93ad2e347] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:39.518197 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e8103977-27de-4880-8209-a68ae4ec8b68 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:39.523454 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e8103977-27de-4880-8209-a68ae4ec8b68 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:39.526403 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e8103977-27de-4880-8209-a68ae4ec8b68 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:39.527187 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e8103977-27de-4880-8209-a68ae4ec8b68 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:39.527940 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e8103977-27de-4880-8209-a68ae4ec8b68 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:39.528409 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e8103977-27de-4880-8209-a68ae4ec8b68 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:39.550744 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ec7001d8-1f7b-4aaf-8608-e22b914a864c tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:39.551361 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ec7001d8-1f7b-4aaf-8608-e22b914a864c tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] [instance: cafdd5ab-69fa-40fc-a555-8a2668f40e5e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:39.559320 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec7001d8-1f7b-4aaf-8608-e22b914a864c tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:39.559817 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec7001d8-1f7b-4aaf-8608-e22b914a864c tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:39.560286 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec7001d8-1f7b-4aaf-8608-e22b914a864c tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:39.583227 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec7001d8-1f7b-4aaf-8608-e22b914a864c tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:39.584491 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec7001d8-1f7b-4aaf-8608-e22b914a864c tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:39.590201 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec7001d8-1f7b-4aaf-8608-e22b914a864c tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:39.881641 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=10 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:45:40.371608 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e8103977-27de-4880-8209-a68ae4ec8b68 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da877221336e4e58859c207fca5e857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b6b2ef87ef4629941a0cc9942d7e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:40.389801 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e8103977-27de-4880-8209-a68ae4ec8b68 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347" status: 200 len: 1341 microversion: 2.1 time: 0.896989 Sep 16 12:45:40.404642 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 68/158] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:39 2022] GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347 => generated 1341 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:40.641307 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-78ae2248-9b1f-4142-917c-3f565707ccd3 req-13a0cb86-8180-49f9-9488-5fa6a8a29b7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cafdd5ab-69fa-40fc-a555-8a2668f40e5e", "tag": "63de9e43-b08e-4ff1-a01a-86057adb6cc8"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:40.664878 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-78ae2248-9b1f-4142-917c-3f565707ccd3 req-13a0cb86-8180-49f9-9488-5fa6a8a29b7b service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:40.665505 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-78ae2248-9b1f-4142-917c-3f565707ccd3 req-13a0cb86-8180-49f9-9488-5fa6a8a29b7b service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:40.666425 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-78ae2248-9b1f-4142-917c-3f565707ccd3 req-13a0cb86-8180-49f9-9488-5fa6a8a29b7b service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:40.695049 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-78ae2248-9b1f-4142-917c-3f565707ccd3 req-13a0cb86-8180-49f9-9488-5fa6a8a29b7b service nova] Creating event network-changed:63de9e43-b08e-4ff1-a01a-86057adb6cc8 for instance cafdd5ab-69fa-40fc-a555-8a2668f40e5e on n-h2-858094-4 Sep 16 12:45:40.703200 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-78ae2248-9b1f-4142-917c-3f565707ccd3 req-13a0cb86-8180-49f9-9488-5fa6a8a29b7b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170269 Sep 16 12:45:40.705264 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 69/159] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:45:40.888405 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ec7001d8-1f7b-4aaf-8608-e22b914a864c tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbe3a24b2f6451ca174d708962e49ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065037c7cf1d4b0d8d12253372a605b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:40.907338 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ec7001d8-1f7b-4aaf-8608-e22b914a864c tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] 10.222.0.67 "GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e" status: 200 len: 1337 microversion: 2.1 time: 1.359130 Sep 16 12:45:40.908441 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 91/160] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:39 2022] GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e => generated 1337 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:45:41.419800 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7af581b6-7245-46d1-b30b-26534fd49c04 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:41.420625 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7af581b6-7245-46d1-b30b-26534fd49c04 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: 3ab83a18-0e02-4082-a9f8-b7f93ad2e347] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:41.437466 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7af581b6-7245-46d1-b30b-26534fd49c04 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:41.442617 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7af581b6-7245-46d1-b30b-26534fd49c04 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:41.443438 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7af581b6-7245-46d1-b30b-26534fd49c04 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:41.446807 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7af581b6-7245-46d1-b30b-26534fd49c04 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:41.449697 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7af581b6-7245-46d1-b30b-26534fd49c04 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:41.456832 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7af581b6-7245-46d1-b30b-26534fd49c04 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:41.927108 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7af581b6-7245-46d1-b30b-26534fd49c04 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da877221336e4e58859c207fca5e857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b6b2ef87ef4629941a0cc9942d7e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:41.937689 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-94f014b4-0de1-49e5-9caa-7771dcda23f8 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:41.938447 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-94f014b4-0de1-49e5-9caa-7771dcda23f8 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] [instance: cafdd5ab-69fa-40fc-a555-8a2668f40e5e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:41.945687 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7af581b6-7245-46d1-b30b-26534fd49c04 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347" status: 200 len: 1341 microversion: 2.1 time: 0.531312 Sep 16 12:45:41.950336 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 70/161] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:41 2022] GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347 => generated 1341 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:41.966162 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94f014b4-0de1-49e5-9caa-7771dcda23f8 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:41.967889 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94f014b4-0de1-49e5-9caa-7771dcda23f8 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:41.971079 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94f014b4-0de1-49e5-9caa-7771dcda23f8 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:41.974924 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94f014b4-0de1-49e5-9caa-7771dcda23f8 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:41.988984 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94f014b4-0de1-49e5-9caa-7771dcda23f8 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:41.990946 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94f014b4-0de1-49e5-9caa-7771dcda23f8 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:42.308992 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-94f014b4-0de1-49e5-9caa-7771dcda23f8 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbe3a24b2f6451ca174d708962e49ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065037c7cf1d4b0d8d12253372a605b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:42.372172 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-94f014b4-0de1-49e5-9caa-7771dcda23f8 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] 10.222.0.67 "GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e" status: 200 len: 1337 microversion: 2.1 time: 0.439862 Sep 16 12:45:42.381162 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 92/162] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:41 2022] GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e => generated 1337 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:42.971279 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-dce3b290-f7f0-45c4-bc5e-89682311fd01 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:42.972603 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-dce3b290-f7f0-45c4-bc5e-89682311fd01 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: 3ab83a18-0e02-4082-a9f8-b7f93ad2e347] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:42.977482 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:DELETE=7 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:45:42.988485 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dce3b290-f7f0-45c4-bc5e-89682311fd01 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:42.989827 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dce3b290-f7f0-45c4-bc5e-89682311fd01 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:42.993245 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dce3b290-f7f0-45c4-bc5e-89682311fd01 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:42.997442 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dce3b290-f7f0-45c4-bc5e-89682311fd01 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:43.000095 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dce3b290-f7f0-45c4-bc5e-89682311fd01 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:43.001973 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dce3b290-f7f0-45c4-bc5e-89682311fd01 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:43.396221 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3ecf67eb-610a-48ca-8319-bdc9940ade0b tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:43.396855 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3ecf67eb-610a-48ca-8319-bdc9940ade0b tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] [instance: cafdd5ab-69fa-40fc-a555-8a2668f40e5e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:43.407986 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ecf67eb-610a-48ca-8319-bdc9940ade0b tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:43.408524 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ecf67eb-610a-48ca-8319-bdc9940ade0b tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:43.409025 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ecf67eb-610a-48ca-8319-bdc9940ade0b tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:43.409686 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ecf67eb-610a-48ca-8319-bdc9940ade0b tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:43.414002 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ecf67eb-610a-48ca-8319-bdc9940ade0b tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:43.418997 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ecf67eb-610a-48ca-8319-bdc9940ade0b tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:44.132141 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-dce3b290-f7f0-45c4-bc5e-89682311fd01 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da877221336e4e58859c207fca5e857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b6b2ef87ef4629941a0cc9942d7e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:44.166599 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-dce3b290-f7f0-45c4-bc5e-89682311fd01 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347" status: 200 len: 1341 microversion: 2.1 time: 1.190170 Sep 16 12:45:44.168179 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 71/163] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:42 2022] GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347 => generated 1341 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:44.792523 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3ecf67eb-610a-48ca-8319-bdc9940ade0b tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbe3a24b2f6451ca174d708962e49ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065037c7cf1d4b0d8d12253372a605b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:44.807530 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3ecf67eb-610a-48ca-8319-bdc9940ade0b tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] 10.222.0.67 "GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e" status: 200 len: 1337 microversion: 2.1 time: 1.415409 Sep 16 12:45:44.810783 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 93/164] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:43 2022] GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e => generated 1337 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:45.192939 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7651283e-25ad-40d1-97c7-24a7137c43c8 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:45.193690 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7651283e-25ad-40d1-97c7-24a7137c43c8 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: 3ab83a18-0e02-4082-a9f8-b7f93ad2e347] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:45.210046 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7651283e-25ad-40d1-97c7-24a7137c43c8 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:45.210541 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7651283e-25ad-40d1-97c7-24a7137c43c8 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:45.210979 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7651283e-25ad-40d1-97c7-24a7137c43c8 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:45.212235 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7651283e-25ad-40d1-97c7-24a7137c43c8 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:45.212689 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7651283e-25ad-40d1-97c7-24a7137c43c8 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:45.213110 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7651283e-25ad-40d1-97c7-24a7137c43c8 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:45.836211 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c22dc4a5-893b-46c8-8876-f112597b075c tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:45.836940 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c22dc4a5-893b-46c8-8876-f112597b075c tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] [instance: cafdd5ab-69fa-40fc-a555-8a2668f40e5e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:45.847103 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c22dc4a5-893b-46c8-8876-f112597b075c tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:45.849642 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c22dc4a5-893b-46c8-8876-f112597b075c tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:45.850432 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c22dc4a5-893b-46c8-8876-f112597b075c tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:45.852211 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c22dc4a5-893b-46c8-8876-f112597b075c tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:45.854544 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c22dc4a5-893b-46c8-8876-f112597b075c tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:45.856425 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c22dc4a5-893b-46c8-8876-f112597b075c tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:45.913016 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:45:46.177046 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7651283e-25ad-40d1-97c7-24a7137c43c8 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da877221336e4e58859c207fca5e857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b6b2ef87ef4629941a0cc9942d7e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:46.189473 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7651283e-25ad-40d1-97c7-24a7137c43c8 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347" status: 200 len: 1341 microversion: 2.1 time: 0.999954 Sep 16 12:45:46.190723 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 72/165] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:45 2022] GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347 => generated 1341 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:46.405796 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c22dc4a5-893b-46c8-8876-f112597b075c tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbe3a24b2f6451ca174d708962e49ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065037c7cf1d4b0d8d12253372a605b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:46.420771 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c22dc4a5-893b-46c8-8876-f112597b075c tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] 10.222.0.67 "GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e" status: 200 len: 1337 microversion: 2.1 time: 0.588679 Sep 16 12:45:46.422447 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 94/166] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:45 2022] GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e => generated 1337 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:45:46.470052 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-f88c4d7b-bc00-4ecb-be71-65c84c307ef5 req-9e2eba02-13e3-42ed-b811-ee36593045c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ab83a18-0e02-4082-a9f8-b7f93ad2e347", "name": "network-vif-plugged", "status": "completed", "tag": "aef79ed7-9782-4b45-9885-4a06aa3cc1f4"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:46.517892 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-f88c4d7b-bc00-4ecb-be71-65c84c307ef5 req-9e2eba02-13e3-42ed-b811-ee36593045c8 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:46.518947 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-f88c4d7b-bc00-4ecb-be71-65c84c307ef5 req-9e2eba02-13e3-42ed-b811-ee36593045c8 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:46.519531 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-f88c4d7b-bc00-4ecb-be71-65c84c307ef5 req-9e2eba02-13e3-42ed-b811-ee36593045c8 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:46.543412 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-f88c4d7b-bc00-4ecb-be71-65c84c307ef5 req-9e2eba02-13e3-42ed-b811-ee36593045c8 service nova] Creating event network-vif-plugged:aef79ed7-9782-4b45-9885-4a06aa3cc1f4 for instance 3ab83a18-0e02-4082-a9f8-b7f93ad2e347 on n-h2-858094-4 Sep 16 12:45:46.552242 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-f88c4d7b-bc00-4ecb-be71-65c84c307ef5 req-9e2eba02-13e3-42ed-b811-ee36593045c8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.340762 Sep 16 12:45:46.558844 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 73/167] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:47.065477 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-baa13ae3-d48f-4ead-bbfe-58235d3bd4f9 tempest-HypervisorAdminV228Test-1353075774 tempest-HypervisorAdminV228Test-1353075774-project-admin] Calling method '.version_select at 0x7f10366f2ca0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:47.068546 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-baa13ae3-d48f-4ead-bbfe-58235d3bd4f9 tempest-HypervisorAdminV228Test-1353075774 tempest-HypervisorAdminV228Test-1353075774-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:47.069413 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-baa13ae3-d48f-4ead-bbfe-58235d3bd4f9 tempest-HypervisorAdminV228Test-1353075774 tempest-HypervisorAdminV228Test-1353075774-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:47.070349 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-baa13ae3-d48f-4ead-bbfe-58235d3bd4f9 tempest-HypervisorAdminV228Test-1353075774 tempest-HypervisorAdminV228Test-1353075774-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:47.112046 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-baa13ae3-d48f-4ead-bbfe-58235d3bd4f9 tempest-HypervisorAdminV228Test-1353075774 tempest-HypervisorAdminV228Test-1353075774-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:47.117734 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-baa13ae3-d48f-4ead-bbfe-58235d3bd4f9 tempest-HypervisorAdminV228Test-1353075774 tempest-HypervisorAdminV228Test-1353075774-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:47.119384 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-baa13ae3-d48f-4ead-bbfe-58235d3bd4f9 tempest-HypervisorAdminV228Test-1353075774 tempest-HypervisorAdminV228Test-1353075774-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:47.153980 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-baa13ae3-d48f-4ead-bbfe-58235d3bd4f9 tempest-HypervisorAdminV228Test-1353075774 tempest-HypervisorAdminV228Test-1353075774-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:47.157850 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-baa13ae3-d48f-4ead-bbfe-58235d3bd4f9 tempest-HypervisorAdminV228Test-1353075774 tempest-HypervisorAdminV228Test-1353075774-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:47.158292 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-baa13ae3-d48f-4ead-bbfe-58235d3bd4f9 tempest-HypervisorAdminV228Test-1353075774 tempest-HypervisorAdminV228Test-1353075774-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:47.177652 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-baa13ae3-d48f-4ead-bbfe-58235d3bd4f9 tempest-HypervisorAdminV228Test-1353075774 tempest-HypervisorAdminV228Test-1353075774-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.579353 Sep 16 12:45:47.178262 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 95/168] 10.222.0.67 () {60 vars in 1187 bytes} [Fri Sep 16 12:45:46 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:45:47.196109 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-90c90beb-885c-475d-9392-ad44a05e1ca8 tempest-HypervisorAdminV228Test-1353075774 tempest-HypervisorAdminV228Test-1353075774-project-admin] Calling method '.version_select at 0x7f1036431940>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:47.212470 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-90c90beb-885c-475d-9392-ad44a05e1ca8 tempest-HypervisorAdminV228Test-1353075774 tempest-HypervisorAdminV228Test-1353075774-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:47.213248 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-90c90beb-885c-475d-9392-ad44a05e1ca8 tempest-HypervisorAdminV228Test-1353075774 tempest-HypervisorAdminV228Test-1353075774-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:47.213808 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-90c90beb-885c-475d-9392-ad44a05e1ca8 tempest-HypervisorAdminV228Test-1353075774 tempest-HypervisorAdminV228Test-1353075774-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:47.217536 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5c96011e-3ab7-409a-9c2c-cfe15d9634ee tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:47.218163 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5c96011e-3ab7-409a-9c2c-cfe15d9634ee tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: 3ab83a18-0e02-4082-a9f8-b7f93ad2e347] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:47.235252 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c96011e-3ab7-409a-9c2c-cfe15d9634ee tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:47.235970 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c96011e-3ab7-409a-9c2c-cfe15d9634ee tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:47.236580 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c96011e-3ab7-409a-9c2c-cfe15d9634ee tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:47.237461 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c96011e-3ab7-409a-9c2c-cfe15d9634ee tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:47.238059 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c96011e-3ab7-409a-9c2c-cfe15d9634ee tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:47.238626 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c96011e-3ab7-409a-9c2c-cfe15d9634ee tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:47.257732 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-90c90beb-885c-475d-9392-ad44a05e1ca8 tempest-HypervisorAdminV228Test-1353075774 tempest-HypervisorAdminV228Test-1353075774-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:47.258774 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-90c90beb-885c-475d-9392-ad44a05e1ca8 tempest-HypervisorAdminV228Test-1353075774 tempest-HypervisorAdminV228Test-1353075774-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:47.259222 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-90c90beb-885c-475d-9392-ad44a05e1ca8 tempest-HypervisorAdminV228Test-1353075774 tempest-HypervisorAdminV228Test-1353075774-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:47.287525 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-90c90beb-885c-475d-9392-ad44a05e1ca8 tempest-HypervisorAdminV228Test-1353075774 tempest-HypervisorAdminV228Test-1353075774-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.099656 Sep 16 12:45:47.298904 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 74/169] 10.222.0.67 () {60 vars in 1193 bytes} [Fri Sep 16 12:45:47 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:45:47.448527 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-10d0fb39-93e7-4215-850c-9f798e46e0d2 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:47.449278 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-10d0fb39-93e7-4215-850c-9f798e46e0d2 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] [instance: cafdd5ab-69fa-40fc-a555-8a2668f40e5e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:47.466474 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-10d0fb39-93e7-4215-850c-9f798e46e0d2 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:47.480526 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-10d0fb39-93e7-4215-850c-9f798e46e0d2 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:47.481732 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-10d0fb39-93e7-4215-850c-9f798e46e0d2 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:47.484207 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-10d0fb39-93e7-4215-850c-9f798e46e0d2 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:47.485584 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-10d0fb39-93e7-4215-850c-9f798e46e0d2 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:47.486211 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-10d0fb39-93e7-4215-850c-9f798e46e0d2 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:47.765914 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5c96011e-3ab7-409a-9c2c-cfe15d9634ee tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da877221336e4e58859c207fca5e857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b6b2ef87ef4629941a0cc9942d7e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:47.780331 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5c96011e-3ab7-409a-9c2c-cfe15d9634ee tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347" status: 200 len: 1341 microversion: 2.1 time: 0.566870 Sep 16 12:45:47.781424 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 96/170] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:47 2022] GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347 => generated 1341 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:47.874587 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-10d0fb39-93e7-4215-850c-9f798e46e0d2 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbe3a24b2f6451ca174d708962e49ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065037c7cf1d4b0d8d12253372a605b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:47.883710 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-10d0fb39-93e7-4215-850c-9f798e46e0d2 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] 10.222.0.67 "GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e" status: 200 len: 1337 microversion: 2.1 time: 0.438313 Sep 16 12:45:47.904590 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 75/171] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:47 2022] GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e => generated 1337 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:45:48.803462 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c6a73db0-bd2c-4a7a-bbbb-0ddcf953cb01 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:48.804174 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c6a73db0-bd2c-4a7a-bbbb-0ddcf953cb01 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: 3ab83a18-0e02-4082-a9f8-b7f93ad2e347] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:48.817793 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6a73db0-bd2c-4a7a-bbbb-0ddcf953cb01 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:48.818355 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6a73db0-bd2c-4a7a-bbbb-0ddcf953cb01 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:48.818782 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6a73db0-bd2c-4a7a-bbbb-0ddcf953cb01 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:48.819497 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6a73db0-bd2c-4a7a-bbbb-0ddcf953cb01 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:48.819944 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6a73db0-bd2c-4a7a-bbbb-0ddcf953cb01 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:48.820525 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6a73db0-bd2c-4a7a-bbbb-0ddcf953cb01 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:48.909230 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-91ccb2d0-321e-40b3-8d02-b8a5c6178ec7 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:48.909878 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-91ccb2d0-321e-40b3-8d02-b8a5c6178ec7 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] [instance: cafdd5ab-69fa-40fc-a555-8a2668f40e5e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:48.918778 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-91ccb2d0-321e-40b3-8d02-b8a5c6178ec7 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:48.922546 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-91ccb2d0-321e-40b3-8d02-b8a5c6178ec7 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:48.923050 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-91ccb2d0-321e-40b3-8d02-b8a5c6178ec7 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:48.925130 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-91ccb2d0-321e-40b3-8d02-b8a5c6178ec7 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:48.925604 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-91ccb2d0-321e-40b3-8d02-b8a5c6178ec7 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:48.926085 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-91ccb2d0-321e-40b3-8d02-b8a5c6178ec7 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:49.331369 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-91ccb2d0-321e-40b3-8d02-b8a5c6178ec7 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbe3a24b2f6451ca174d708962e49ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065037c7cf1d4b0d8d12253372a605b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:49.343923 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-91ccb2d0-321e-40b3-8d02-b8a5c6178ec7 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] 10.222.0.67 "GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e" status: 200 len: 1337 microversion: 2.1 time: 0.439015 Sep 16 12:45:49.345440 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 76/172] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:48 2022] GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e => generated 1337 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:45:49.360577 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-92887907-a6a8-48e0-8107-0682c4e0ea7b req-add8d45e-43d7-4b8e-891f-dfc8646dbb5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cafdd5ab-69fa-40fc-a555-8a2668f40e5e", "name": "network-vif-plugged", "status": "completed", "tag": "63de9e43-b08e-4ff1-a01a-86057adb6cc8"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:49.392634 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c6a73db0-bd2c-4a7a-bbbb-0ddcf953cb01 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da877221336e4e58859c207fca5e857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b6b2ef87ef4629941a0cc9942d7e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:49.393223 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-92887907-a6a8-48e0-8107-0682c4e0ea7b req-add8d45e-43d7-4b8e-891f-dfc8646dbb5e service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:49.394188 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-92887907-a6a8-48e0-8107-0682c4e0ea7b req-add8d45e-43d7-4b8e-891f-dfc8646dbb5e service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:49.395243 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-92887907-a6a8-48e0-8107-0682c4e0ea7b req-add8d45e-43d7-4b8e-891f-dfc8646dbb5e service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:49.402171 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c6a73db0-bd2c-4a7a-bbbb-0ddcf953cb01 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347" status: 200 len: 1341 microversion: 2.1 time: 0.602865 Sep 16 12:45:49.424517 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 97/173] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:48 2022] GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347 => generated 1341 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:49.453527 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-92887907-a6a8-48e0-8107-0682c4e0ea7b req-add8d45e-43d7-4b8e-891f-dfc8646dbb5e service nova] Creating event network-vif-plugged:63de9e43-b08e-4ff1-a01a-86057adb6cc8 for instance cafdd5ab-69fa-40fc-a555-8a2668f40e5e on n-h2-858094-4 Sep 16 12:45:49.465241 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-92887907-a6a8-48e0-8107-0682c4e0ea7b req-add8d45e-43d7-4b8e-891f-dfc8646dbb5e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116656 Sep 16 12:45:49.466618 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 77/174] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:50.372048 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ab8ee595-446c-4e19-abf7-0dfe1bcf8b86 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:50.372949 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ab8ee595-446c-4e19-abf7-0dfe1bcf8b86 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] [instance: cafdd5ab-69fa-40fc-a555-8a2668f40e5e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:50.388650 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ab8ee595-446c-4e19-abf7-0dfe1bcf8b86 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:50.389763 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ab8ee595-446c-4e19-abf7-0dfe1bcf8b86 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:50.390859 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ab8ee595-446c-4e19-abf7-0dfe1bcf8b86 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:50.392082 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ab8ee595-446c-4e19-abf7-0dfe1bcf8b86 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:50.393146 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ab8ee595-446c-4e19-abf7-0dfe1bcf8b86 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:50.393783 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ab8ee595-446c-4e19-abf7-0dfe1bcf8b86 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:50.627467 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ab8ee595-446c-4e19-abf7-0dfe1bcf8b86 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbe3a24b2f6451ca174d708962e49ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065037c7cf1d4b0d8d12253372a605b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:50.638041 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ab8ee595-446c-4e19-abf7-0dfe1bcf8b86 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] 10.222.0.67 "GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e" status: 200 len: 1337 microversion: 2.1 time: 0.272508 Sep 16 12:45:50.640112 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 78/175] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:50 2022] GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e => generated 1337 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:50.645044 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-cb945a47-5749-46f6-ad18-f1d2715ff6b1 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:50.645854 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-cb945a47-5749-46f6-ad18-f1d2715ff6b1 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: 3ab83a18-0e02-4082-a9f8-b7f93ad2e347] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:50.652453 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cb945a47-5749-46f6-ad18-f1d2715ff6b1 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:50.653154 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cb945a47-5749-46f6-ad18-f1d2715ff6b1 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:50.653725 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cb945a47-5749-46f6-ad18-f1d2715ff6b1 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:50.654589 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cb945a47-5749-46f6-ad18-f1d2715ff6b1 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:50.655667 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cb945a47-5749-46f6-ad18-f1d2715ff6b1 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:50.656294 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cb945a47-5749-46f6-ad18-f1d2715ff6b1 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:50.854500 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-cb945a47-5749-46f6-ad18-f1d2715ff6b1 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da877221336e4e58859c207fca5e857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b6b2ef87ef4629941a0cc9942d7e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:50.868807 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-cb945a47-5749-46f6-ad18-f1d2715ff6b1 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347" status: 200 len: 1491 microversion: 2.1 time: 0.225635 Sep 16 12:45:50.870221 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 79/176] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:50 2022] GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347 => generated 1491 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:50.956465 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b641ece1-d8b5-4184-b5fb-5e2545d058c3 tempest-HypervisorAdminNegativeUnderV252Test-2065495957 tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin] Calling method '.version_select at 0x7f10365fb550>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:50.958449 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b641ece1-d8b5-4184-b5fb-5e2545d058c3 tempest-HypervisorAdminNegativeUnderV252Test-2065495957 tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:50.959118 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b641ece1-d8b5-4184-b5fb-5e2545d058c3 tempest-HypervisorAdminNegativeUnderV252Test-2065495957 tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:50.959766 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b641ece1-d8b5-4184-b5fb-5e2545d058c3 tempest-HypervisorAdminNegativeUnderV252Test-2065495957 tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:50.998264 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b641ece1-d8b5-4184-b5fb-5e2545d058c3 tempest-HypervisorAdminNegativeUnderV252Test-2065495957 tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:50.999762 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b641ece1-d8b5-4184-b5fb-5e2545d058c3 tempest-HypervisorAdminNegativeUnderV252Test-2065495957 tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:51.001567 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b641ece1-d8b5-4184-b5fb-5e2545d058c3 tempest-HypervisorAdminNegativeUnderV252Test-2065495957 tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:51.033932 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b641ece1-d8b5-4184-b5fb-5e2545d058c3 tempest-HypervisorAdminNegativeUnderV252Test-2065495957 tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:51.039977 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b641ece1-d8b5-4184-b5fb-5e2545d058c3 tempest-HypervisorAdminNegativeUnderV252Test-2065495957 tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:51.040836 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b641ece1-d8b5-4184-b5fb-5e2545d058c3 tempest-HypervisorAdminNegativeUnderV252Test-2065495957 tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:51.051376 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b641ece1-d8b5-4184-b5fb-5e2545d058c3 tempest-HypervisorAdminNegativeUnderV252Test-2065495957 tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.699498 Sep 16 12:45:51.052696 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 98/177] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:45:50 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:51.106849 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fc3819e1-d67f-43ef-a8f1-24eae7e39d29 tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Calling method '.version_select at 0x7f10363344c0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:51.115483 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fc3819e1-d67f-43ef-a8f1-24eae7e39d29 tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:51.118009 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fc3819e1-d67f-43ef-a8f1-24eae7e39d29 tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:51.118920 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fc3819e1-d67f-43ef-a8f1-24eae7e39d29 tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:51.119944 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fc3819e1-d67f-43ef-a8f1-24eae7e39d29 tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:51.120571 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fc3819e1-d67f-43ef-a8f1-24eae7e39d29 tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:51.121167 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fc3819e1-d67f-43ef-a8f1-24eae7e39d29 tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:51.197993 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-fc3819e1-d67f-43ef-a8f1-24eae7e39d29 tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hosts" status: 200 len: 397 microversion: 2.1 time: 0.312970 Sep 16 12:45:51.198905 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 80/178] 10.222.0.67 () {58 vars in 1128 bytes} [Fri Sep 16 12:45:50 2022] GET /compute/v2.1/os-hosts => generated 397 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:51.343066 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d0dca1c7-8983-4bc4-9e12-20b22c712506 tempest-DeleteServersAdminTestJSON-189891681 tempest-DeleteServersAdminTestJSON-189891681-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:51.344170 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d0dca1c7-8983-4bc4-9e12-20b22c712506 tempest-DeleteServersAdminTestJSON-189891681 tempest-DeleteServersAdminTestJSON-189891681-project-admin] [instance: 3ab83a18-0e02-4082-a9f8-b7f93ad2e347] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:51.367891 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0dca1c7-8983-4bc4-9e12-20b22c712506 tempest-DeleteServersAdminTestJSON-189891681 tempest-DeleteServersAdminTestJSON-189891681-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:51.367891 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0dca1c7-8983-4bc4-9e12-20b22c712506 tempest-DeleteServersAdminTestJSON-189891681 tempest-DeleteServersAdminTestJSON-189891681-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:51.367891 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0dca1c7-8983-4bc4-9e12-20b22c712506 tempest-DeleteServersAdminTestJSON-189891681 tempest-DeleteServersAdminTestJSON-189891681-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:51.367891 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0dca1c7-8983-4bc4-9e12-20b22c712506 tempest-DeleteServersAdminTestJSON-189891681 tempest-DeleteServersAdminTestJSON-189891681-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:51.368208 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0dca1c7-8983-4bc4-9e12-20b22c712506 tempest-DeleteServersAdminTestJSON-189891681 tempest-DeleteServersAdminTestJSON-189891681-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:51.368208 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0dca1c7-8983-4bc4-9e12-20b22c712506 tempest-DeleteServersAdminTestJSON-189891681 tempest-DeleteServersAdminTestJSON-189891681-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:51.518944 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d0dca1c7-8983-4bc4-9e12-20b22c712506 tempest-DeleteServersAdminTestJSON-189891681 tempest-DeleteServersAdminTestJSON-189891681-project-admin] [instance: 3ab83a18-0e02-4082-a9f8-b7f93ad2e347] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:45:51.611693 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-01ef74fa-df58-415d-9357-ef250b88a517 tempest-HypervisorAdminNegativeUnderV252Test-972755075 tempest-HypervisorAdminNegativeUnderV252Test-972755075-project] Calling method '.version_select at 0x7f1036334670>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:51.614192 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-01ef74fa-df58-415d-9357-ef250b88a517 tempest-HypervisorAdminNegativeUnderV252Test-972755075 tempest-HypervisorAdminNegativeUnderV252Test-972755075-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '9a2f6a2e2748400cbf148555b6452074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995ff149d49d4c238f69059941491677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:51.617324 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-01ef74fa-df58-415d-9357-ef250b88a517 tempest-HypervisorAdminNegativeUnderV252Test-972755075 tempest-HypervisorAdminNegativeUnderV252Test-972755075-project] Request method failure captured: Sep 16 12:45:51.617324 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/os-hypervisors/n-h2-858094-4/search HTTP/1.1 Sep 16 12:45:51.617324 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:45:51.617324 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:45:51.617324 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:45:51.617324 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:45:51.617324 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:45:51.617324 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:45:51.617324 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:45:51.617324 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:45:51.617324 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJG_8X44hcJ88-SjtY8f4RjhWqRn1pFDy2Sw6axGec1n-s2d9zQ2ExiSFHSacamHMwANJ1YBUH75vi5ERwutfuJCing1IzHb4vJhTE9GqVA3O3F2wj0BmOgHn4kqZpqmvFsSNX8UPRXqmq6YPsy1VNM9S-r354MdUSn8iURDZq7sU-Zk Sep 16 12:45:51.617324 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:45:51.617324 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:45:51.617324 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:45:51.617324 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:45:51.617324 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:45:51.617324 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:45:51.617324 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 995ff149d49d4c238f69059941491677 Sep 16 12:45:51.617324 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-972755075 Sep 16 12:45:51.617324 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:45:51.617324 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:45:51.618898 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/995ff149d49d4c238f69059941491677"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/995ff149d49d4c238f69059941491677"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_995ff149d49d4c238f69059941491677", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/995ff149d49d4c238f69059941491677"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:45:51.618898 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-972755075 Sep 16 12:45:51.618898 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 995ff149d49d4c238f69059941491677 Sep 16 12:45:51.618898 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-972755075 Sep 16 12:45:51.618898 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-972755075-project Sep 16 12:45:51.618898 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:45:51.618898 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:45:51.618898 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 9a2f6a2e2748400cbf148555b6452074 Sep 16 12:45:51.618898 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-972755075-project Sep 16 12:45:51.618898 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 12:45:51.618898 n-d-858094-4 devstack@n-api.service[128780]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 16 12:45:51.618898 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'n-h2-858094-4'} Sep 16 12:45:51.619549 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:45:51.619549 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:51.619549 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:51.619549 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:51.619549 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:45:51.619549 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:45:51.619549 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:45:51.619549 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:45:51.619549 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:45:51.619549 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:45:51.619549 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Sep 16 12:45:51.619549 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Sep 16 12:45:51.619549 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 12:45:51.619549 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 12:45:51.619549 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 12:45:51.619549 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 12:45:51.619549 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:45:51.619549 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:45:51.619549 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:45:51.620571 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:45:51.620571 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 12:45:51.620571 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 12:45:51.620571 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 12:45:51.620571 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 12:45:51.620571 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 12:45:51.620571 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 12:45:51.620571 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 16 12:45:51.620571 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:51.620571 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:51.620571 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:51.620571 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:51.620571 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:51.620571 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:51.620571 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 12:45:51.620571 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 12:45:51.620571 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 16 12:45:51.620571 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:51.621536 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-01ef74fa-df58-415d-9357-ef250b88a517 tempest-HypervisorAdminNegativeUnderV252Test-972755075 tempest-HypervisorAdminNegativeUnderV252Test-972755075-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:45:51.621536 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-01ef74fa-df58-415d-9357-ef250b88a517 tempest-HypervisorAdminNegativeUnderV252Test-972755075 tempest-HypervisorAdminNegativeUnderV252Test-972755075-project] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/n-h2-858094-4/search" status: 403 len: 117 microversion: 2.1 time: 0.420384 Sep 16 12:45:51.627988 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 81/179] 10.222.0.67 () {58 vars in 1209 bytes} [Fri Sep 16 12:45:51 2022] GET /compute/v2.1/os-hypervisors/n-h2-858094-4/search => generated 117 bytes in 428 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:45:51.641942 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5f4673b0-91dd-4d41-925c-afca1c2ed2a9 tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Calling method '.version_select at 0x7f103618d160>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:51.648891 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5f4673b0-91dd-4d41-925c-afca1c2ed2a9 tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:51.652144 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5f4673b0-91dd-4d41-925c-afca1c2ed2a9 tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:51.652772 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5f4673b0-91dd-4d41-925c-afca1c2ed2a9 tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:51.654273 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5f4673b0-91dd-4d41-925c-afca1c2ed2a9 tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:51.655933 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5f4673b0-91dd-4d41-925c-afca1c2ed2a9 tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:51.659196 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5f4673b0-91dd-4d41-925c-afca1c2ed2a9 tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:51.675597 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0dca1c7-8983-4bc4-9e12-20b22c712506 tempest-DeleteServersAdminTestJSON-189891681 tempest-DeleteServersAdminTestJSON-189891681-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=128779) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 16 12:45:51.676545 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0dca1c7-8983-4bc4-9e12-20b22c712506 tempest-DeleteServersAdminTestJSON-189891681 tempest-DeleteServersAdminTestJSON-189891681-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=128779) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 16 12:45:51.677983 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a7f88c7-ca92-4056-9fb1-25a02f1bba01 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:51.678795 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a7f88c7-ca92-4056-9fb1-25a02f1bba01 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:51.679368 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a7f88c7-ca92-4056-9fb1-25a02f1bba01 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:51.680861 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a7f88c7-ca92-4056-9fb1-25a02f1bba01 None None] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:51.681413 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a7f88c7-ca92-4056-9fb1-25a02f1bba01 None None] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:51.682525 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a7f88c7-ca92-4056-9fb1-25a02f1bba01 None None] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:51.704200 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5f4673b0-91dd-4d41-925c-afca1c2ed2a9 tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 397 microversion: 2.1 time: 0.072190 Sep 16 12:45:51.705106 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 82/180] 10.222.0.67 () {58 vars in 1139 bytes} [Fri Sep 16 12:45:51 2022] GET /compute/v2.1/os-hosts?zone= => generated 397 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:51.712159 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5b10b3c2-b46e-4394-a5d9-75f5760014bd tempest-HypervisorAdminNegativeUnderV252Test-2065495957 tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin] Calling method '.version_select at 0x7f103618d700>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:51.714288 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5b10b3c2-b46e-4394-a5d9-75f5760014bd tempest-HypervisorAdminNegativeUnderV252Test-2065495957 tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:51.714930 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5b10b3c2-b46e-4394-a5d9-75f5760014bd tempest-HypervisorAdminNegativeUnderV252Test-2065495957 tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:51.715517 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5b10b3c2-b46e-4394-a5d9-75f5760014bd tempest-HypervisorAdminNegativeUnderV252Test-2065495957 tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:51.717831 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.compute.rpcapi [None req-8a7f88c7-ca92-4056-9fb1-25a02f1bba01 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 16 12:45:51.718741 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a7f88c7-ca92-4056-9fb1-25a02f1bba01 None None] Releasing lock "compute-rpcapi-router" {{(pid=128779) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 16 12:45:51.731010 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-5b10b3c2-b46e-4394-a5d9-75f5760014bd tempest-HypervisorAdminNegativeUnderV252Test-2065495957 tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 16 12:45:51.732657 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5b10b3c2-b46e-4394-a5d9-75f5760014bd tempest-HypervisorAdminNegativeUnderV252Test-2065495957 tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin] Request method failure captured: Sep 16 12:45:51.732657 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Sep 16 12:45:51.732657 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:45:51.732657 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:45:51.732657 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:45:51.732657 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:45:51.732657 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:45:51.732657 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:45:51.732657 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:45:51.732657 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:45:51.732657 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJG_-H95pMuRW2c8Ez2oL3Jmja2XxmDO324aCgvwK6sDvAFhqeWvAvklNoowjj4c8xuHhOhfQuqfu26v-P-gy1wEb9tVpynCXbYJ0jxgz6Y5HoMSYnqwaE9gYNH8qgxC0e5-M4NA6OHOnEqidJBQrtXU4OF-qwtFWxVAh_UFTERTo6eA Sep 16 12:45:51.732657 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:45:51.732657 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:45:51.732657 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:45:51.732657 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:45:51.732657 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:45:51.732657 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:45:51.732657 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 9d38d41d9abd4ca2808562ccc29ebff9 Sep 16 12:45:51.732657 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-2065495957 Sep 16 12:45:51.732657 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,admin,reader Sep 16 12:45:51.732657 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,admin,reader Sep 16 12:45:51.734077 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9d38d41d9abd4ca2808562ccc29ebff9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9d38d41d9abd4ca2808562ccc29ebff9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9d38d41d9abd4ca2808562ccc29ebff9", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9d38d41d9abd4ca2808562ccc29ebff9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:45:51.734077 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-2065495957 Sep 16 12:45:51.734077 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 9d38d41d9abd4ca2808562ccc29ebff9 Sep 16 12:45:51.734077 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-2065495957 Sep 16 12:45:51.734077 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin Sep 16 12:45:51.734077 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:45:51.734077 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:45:51.734077 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: c3bfaf4edbe64d4584c0ed634b0ec454 Sep 16 12:45:51.734077 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin Sep 16 12:45:51.734077 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 12:45:51.734077 n-d-858094-4 devstack@n-api.service[128780]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 16 12:45:51.734077 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'nonexistent_hypervisor_name'} Sep 16 12:45:51.734901 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:45:51.734901 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:51.734901 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:51.734901 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:51.734901 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:45:51.734901 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:45:51.734901 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:45:51.734901 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:45:51.734901 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:45:51.734901 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:45:51.734901 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Sep 16 12:45:51.734901 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 16 12:45:51.734901 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 16 12:45:51.734901 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 16 12:45:51.734901 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 16 12:45:51.734901 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:51.734901 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:51.734901 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:51.734901 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:51.734901 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:51.736232 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:51.736232 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:45:51.736232 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:45:51.736232 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 16 12:45:51.736232 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:51.738278 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5b10b3c2-b46e-4394-a5d9-75f5760014bd tempest-HypervisorAdminNegativeUnderV252Test-2065495957 tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:45:51.739443 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5b10b3c2-b46e-4394-a5d9-75f5760014bd tempest-HypervisorAdminNegativeUnderV252Test-2065495957 tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.033173 Sep 16 12:45:51.741925 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 83/181] 10.222.0.67 () {58 vars in 1251 bytes} [Fri Sep 16 12:45:51 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:45:51.755953 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e42e17db-b5ac-44c0-afe1-adbd4840ac72 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:51.756605 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e42e17db-b5ac-44c0-afe1-adbd4840ac72 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] [instance: cafdd5ab-69fa-40fc-a555-8a2668f40e5e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:51.772169 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e42e17db-b5ac-44c0-afe1-adbd4840ac72 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:51.774222 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e42e17db-b5ac-44c0-afe1-adbd4840ac72 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:51.775312 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e42e17db-b5ac-44c0-afe1-adbd4840ac72 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:51.776663 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e42e17db-b5ac-44c0-afe1-adbd4840ac72 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:51.777593 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e42e17db-b5ac-44c0-afe1-adbd4840ac72 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:51.778356 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e42e17db-b5ac-44c0-afe1-adbd4840ac72 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:51.785524 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8a7f88c7-ca92-4056-9fb1-25a02f1bba01 None None] 10.222.0.67 "DELETE /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347" status: 204 len: 0 microversion: 2.1 time: 0.731341 Sep 16 12:45:51.789839 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 99/182] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:45:51 2022] DELETE /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347 => generated 0 bytes in 733 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:45:51.807922 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c97b673f-d2fa-4e0b-b0ab-94c5adf5c1db tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Calling method '.version_select at 0x7f103676e4c0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:51.818926 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c97b673f-d2fa-4e0b-b0ab-94c5adf5c1db tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:51.820306 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c97b673f-d2fa-4e0b-b0ab-94c5adf5c1db tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:51.822409 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c97b673f-d2fa-4e0b-b0ab-94c5adf5c1db tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:51.825349 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c97b673f-d2fa-4e0b-b0ab-94c5adf5c1db tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:51.825930 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c97b673f-d2fa-4e0b-b0ab-94c5adf5c1db tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:51.828427 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c97b673f-d2fa-4e0b-b0ab-94c5adf5c1db tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:51.932478 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c97b673f-d2fa-4e0b-b0ab-94c5adf5c1db tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.138809 Sep 16 12:45:51.934016 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 100/183] 10.222.0.67 () {58 vars in 1145 bytes} [Fri Sep 16 12:45:51 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 12:45:51.951190 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a5c855ce-23cc-446a-88f4-c000a8c44b62 tempest-HypervisorAdminNegativeUnderV252Test-2065495957 tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin] Calling method '.version_select at 0x7f1036608b80>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:51.961748 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5c855ce-23cc-446a-88f4-c000a8c44b62 tempest-HypervisorAdminNegativeUnderV252Test-2065495957 tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:51.962301 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5c855ce-23cc-446a-88f4-c000a8c44b62 tempest-HypervisorAdminNegativeUnderV252Test-2065495957 tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:51.962615 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5c855ce-23cc-446a-88f4-c000a8c44b62 tempest-HypervisorAdminNegativeUnderV252Test-2065495957 tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:51.985260 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5c855ce-23cc-446a-88f4-c000a8c44b62 tempest-HypervisorAdminNegativeUnderV252Test-2065495957 tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:51.986116 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5c855ce-23cc-446a-88f4-c000a8c44b62 tempest-HypervisorAdminNegativeUnderV252Test-2065495957 tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:51.987628 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5c855ce-23cc-446a-88f4-c000a8c44b62 tempest-HypervisorAdminNegativeUnderV252Test-2065495957 tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:52.012287 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5c855ce-23cc-446a-88f4-c000a8c44b62 tempest-HypervisorAdminNegativeUnderV252Test-2065495957 tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:52.013030 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5c855ce-23cc-446a-88f4-c000a8c44b62 tempest-HypervisorAdminNegativeUnderV252Test-2065495957 tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:52.013614 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5c855ce-23cc-446a-88f4-c000a8c44b62 tempest-HypervisorAdminNegativeUnderV252Test-2065495957 tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:52.020789 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a5c855ce-23cc-446a-88f4-c000a8c44b62 tempest-HypervisorAdminNegativeUnderV252Test-2065495957 tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.085543 Sep 16 12:45:52.029812 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 101/184] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:45:51 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:52.030457 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e42e17db-b5ac-44c0-afe1-adbd4840ac72 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbe3a24b2f6451ca174d708962e49ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065037c7cf1d4b0d8d12253372a605b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:52.036059 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f9c33150-9c81-40e5-b827-37d11d7e5726 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:52.041141 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e42e17db-b5ac-44c0-afe1-adbd4840ac72 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] 10.222.0.67 "GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e" status: 200 len: 1486 microversion: 2.1 time: 0.290096 Sep 16 12:45:52.041829 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f9c33150-9c81-40e5-b827-37d11d7e5726 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: 3ab83a18-0e02-4082-a9f8-b7f93ad2e347] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:52.053748 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 84/185] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:51 2022] GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e => generated 1486 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:52.058966 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9c33150-9c81-40e5-b827-37d11d7e5726 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:52.060266 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9c33150-9c81-40e5-b827-37d11d7e5726 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:52.060894 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9c33150-9c81-40e5-b827-37d11d7e5726 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:52.061850 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9c33150-9c81-40e5-b827-37d11d7e5726 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:52.062490 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9c33150-9c81-40e5-b827-37d11d7e5726 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:52.063257 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9c33150-9c81-40e5-b827-37d11d7e5726 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:52.307344 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f9c33150-9c81-40e5-b827-37d11d7e5726 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da877221336e4e58859c207fca5e857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b6b2ef87ef4629941a0cc9942d7e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:52.318432 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f9c33150-9c81-40e5-b827-37d11d7e5726 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347" status: 200 len: 1497 microversion: 2.1 time: 0.287128 Sep 16 12:45:52.331449 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 102/186] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:52 2022] GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347 => generated 1497 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:52.331449 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bd554739-dba0-4efd-997a-170fb6175a5b tempest-HypervisorAdminNegativeUnderV252Test-972755075 tempest-HypervisorAdminNegativeUnderV252Test-972755075-project] Calling method '.version_select at 0x7f10364c2700>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:52.331449 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bd554739-dba0-4efd-997a-170fb6175a5b tempest-HypervisorAdminNegativeUnderV252Test-972755075 tempest-HypervisorAdminNegativeUnderV252Test-972755075-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '9a2f6a2e2748400cbf148555b6452074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995ff149d49d4c238f69059941491677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:52.331449 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bd554739-dba0-4efd-997a-170fb6175a5b tempest-HypervisorAdminNegativeUnderV252Test-972755075 tempest-HypervisorAdminNegativeUnderV252Test-972755075-project] Request method failure captured: Sep 16 12:45:52.331449 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Sep 16 12:45:52.331449 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:45:52.331449 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:45:52.331449 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:45:52.331449 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:45:52.331449 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:45:52.331449 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:45:52.331449 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:45:52.332382 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:45:52.332382 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJG_8X44hcJ88-SjtY8f4RjhWqRn1pFDy2Sw6axGec1n-s2d9zQ2ExiSFHSacamHMwANJ1YBUH75vi5ERwutfuJCing1IzHb4vJhTE9GqVA3O3F2wj0BmOgHn4kqZpqmvFsSNX8UPRXqmq6YPsy1VNM9S-r354MdUSn8iURDZq7sU-Zk Sep 16 12:45:52.332382 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:45:52.332382 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:45:52.332382 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:45:52.332382 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:45:52.332382 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:45:52.332382 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:45:52.332382 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 995ff149d49d4c238f69059941491677 Sep 16 12:45:52.332382 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-972755075 Sep 16 12:45:52.332382 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:45:52.332382 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:45:52.332382 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/995ff149d49d4c238f69059941491677"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/995ff149d49d4c238f69059941491677"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_995ff149d49d4c238f69059941491677", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/995ff149d49d4c238f69059941491677"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:45:52.332382 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-972755075 Sep 16 12:45:52.332382 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 995ff149d49d4c238f69059941491677 Sep 16 12:45:52.333210 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-972755075 Sep 16 12:45:52.333210 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-972755075-project Sep 16 12:45:52.333210 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:45:52.333210 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:45:52.333210 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 9a2f6a2e2748400cbf148555b6452074 Sep 16 12:45:52.333210 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-972755075-project Sep 16 12:45:52.333210 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 12:45:52.333210 n-d-858094-4 devstack@n-api.service[128779]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 16 12:45:52.333210 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '1'} Sep 16 12:45:52.333210 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:45:52.333210 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:52.333210 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:52.333210 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:52.333210 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:45:52.333210 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:45:52.333210 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:45:52.333210 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:45:52.333210 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:45:52.333210 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:45:52.333210 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Sep 16 12:45:52.333210 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Sep 16 12:45:52.333210 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 12:45:52.333210 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 12:45:52.334396 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 12:45:52.334396 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 12:45:52.334396 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:45:52.334396 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:45:52.334396 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:45:52.334396 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:45:52.334396 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 12:45:52.334396 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 12:45:52.334396 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 12:45:52.334396 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 12:45:52.334396 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 12:45:52.334396 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 12:45:52.334396 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 16 12:45:52.334396 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:52.334396 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:52.334396 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:52.334396 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:52.334396 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:52.334396 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:52.334396 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 12:45:52.335424 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 12:45:52.335424 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 16 12:45:52.335424 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:52.335424 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bd554739-dba0-4efd-997a-170fb6175a5b tempest-HypervisorAdminNegativeUnderV252Test-972755075 tempest-HypervisorAdminNegativeUnderV252Test-972755075-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:45:52.335424 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bd554739-dba0-4efd-997a-170fb6175a5b tempest-HypervisorAdminNegativeUnderV252Test-972755075 tempest-HypervisorAdminNegativeUnderV252Test-972755075-project] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.009766 Sep 16 12:45:52.343427 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 103/187] 10.222.0.67 () {58 vars in 1176 bytes} [Fri Sep 16 12:45:52 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:45:52.349881 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7d277b64-5422-4253-ac2c-57996d837578 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:52.350491 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7d277b64-5422-4253-ac2c-57996d837578 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] [instance: cafdd5ab-69fa-40fc-a555-8a2668f40e5e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:52.364075 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d277b64-5422-4253-ac2c-57996d837578 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:52.364937 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d277b64-5422-4253-ac2c-57996d837578 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:52.365380 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d277b64-5422-4253-ac2c-57996d837578 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:52.366511 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d277b64-5422-4253-ac2c-57996d837578 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:52.368918 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d277b64-5422-4253-ac2c-57996d837578 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:52.369346 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d277b64-5422-4253-ac2c-57996d837578 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:52.489445 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4dc6b50e-1e36-4264-8100-b97496e1bca4 tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-495867089", "id": 697822469, "os-flavor-access:is_public": "False"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:52.520494 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4dc6b50e-1e36-4264-8100-b97496e1bca4 tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.464676 Sep 16 12:45:52.530226 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 85/188] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:45:52 2022] POST /compute/v2.1/flavors => generated 435 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:52.536052 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-360c6ba1-938e-4284-9564-166c3520bfce tempest-HypervisorAdminNegativeUnderV252Test-2065495957 tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin] Calling method '.version_select at 0x7f1036129dc0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:52.538120 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-360c6ba1-938e-4284-9564-166c3520bfce tempest-HypervisorAdminNegativeUnderV252Test-2065495957 tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:52.539325 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-360c6ba1-938e-4284-9564-166c3520bfce tempest-HypervisorAdminNegativeUnderV252Test-2065495957 tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:52.540116 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-360c6ba1-938e-4284-9564-166c3520bfce tempest-HypervisorAdminNegativeUnderV252Test-2065495957 tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:52.552726 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-360c6ba1-938e-4284-9564-166c3520bfce tempest-HypervisorAdminNegativeUnderV252Test-2065495957 tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin] HTTP exception thrown: No hypervisor matching '61bcf991-b472-403f-a2a1-ad132d6055be' could be found. Sep 16 12:45:52.555414 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-360c6ba1-938e-4284-9564-166c3520bfce tempest-HypervisorAdminNegativeUnderV252Test-2065495957 tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin] Request method failure captured: Sep 16 12:45:52.555414 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/os-hypervisors/61bcf991-b472-403f-a2a1-ad132d6055be/servers HTTP/1.1 Sep 16 12:45:52.555414 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:45:52.555414 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:45:52.555414 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:45:52.555414 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:45:52.555414 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:45:52.555414 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:45:52.555414 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:45:52.555414 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:45:52.555414 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJG_-H95pMuRW2c8Ez2oL3Jmja2XxmDO324aCgvwK6sDvAFhqeWvAvklNoowjj4c8xuHhOhfQuqfu26v-P-gy1wEb9tVpynCXbYJ0jxgz6Y5HoMSYnqwaE9gYNH8qgxC0e5-M4NA6OHOnEqidJBQrtXU4OF-qwtFWxVAh_UFTERTo6eA Sep 16 12:45:52.555414 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:45:52.555414 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:45:52.555414 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:45:52.555414 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:45:52.555414 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:45:52.555414 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:45:52.555414 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 9d38d41d9abd4ca2808562ccc29ebff9 Sep 16 12:45:52.555414 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-2065495957 Sep 16 12:45:52.555414 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,admin,reader Sep 16 12:45:52.555414 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,admin,reader Sep 16 12:45:52.557072 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9d38d41d9abd4ca2808562ccc29ebff9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9d38d41d9abd4ca2808562ccc29ebff9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9d38d41d9abd4ca2808562ccc29ebff9", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9d38d41d9abd4ca2808562ccc29ebff9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:45:52.557072 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-2065495957 Sep 16 12:45:52.557072 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 9d38d41d9abd4ca2808562ccc29ebff9 Sep 16 12:45:52.557072 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-2065495957 Sep 16 12:45:52.557072 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin Sep 16 12:45:52.557072 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:45:52.557072 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:45:52.557072 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: c3bfaf4edbe64d4584c0ed634b0ec454 Sep 16 12:45:52.557072 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin Sep 16 12:45:52.557072 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 12:45:52.557072 n-d-858094-4 devstack@n-api.service[128780]: exception: No hypervisor matching '61bcf991-b472-403f-a2a1-ad132d6055be' could be found. Sep 16 12:45:52.557072 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '61bcf991-b472-403f-a2a1-ad132d6055be'} Sep 16 12:45:52.557814 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:45:52.557814 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:52.557814 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:52.557814 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:52.557814 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:45:52.557814 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:45:52.557814 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:45:52.557814 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:45:52.557814 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:45:52.557814 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:45:52.557814 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Sep 16 12:45:52.557814 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 16 12:45:52.557814 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 16 12:45:52.557814 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 16 12:45:52.557814 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '61bcf991-b472-403f-a2a1-ad132d6055be' could be found. Sep 16 12:45:52.557814 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:52.557814 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:52.557814 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:52.557814 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:52.559061 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:52.559061 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:52.559061 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:45:52.559061 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:45:52.559061 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '61bcf991-b472-403f-a2a1-ad132d6055be' could be found. Sep 16 12:45:52.559061 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:52.561208 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-360c6ba1-938e-4284-9564-166c3520bfce tempest-HypervisorAdminNegativeUnderV252Test-2065495957 tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin] Returning 404 to user: No hypervisor matching '61bcf991-b472-403f-a2a1-ad132d6055be' could be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:45:52.562909 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-360c6ba1-938e-4284-9564-166c3520bfce tempest-HypervisorAdminNegativeUnderV252Test-2065495957 tempest-HypervisorAdminNegativeUnderV252Test-2065495957-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/61bcf991-b472-403f-a2a1-ad132d6055be/servers" status: 404 len: 123 microversion: 2.1 time: 0.031237 Sep 16 12:45:52.564589 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 86/189] 10.222.0.67 () {58 vars in 1281 bytes} [Fri Sep 16 12:45:52 2022] GET /compute/v2.1/os-hypervisors/61bcf991-b472-403f-a2a1-ad132d6055be/servers => generated 123 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:45:52.570378 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a7228404-b31c-4db9-9584-52fa26ce55b3 tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "99e33211f2aa485494c21705192881af"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:52.775384 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7d277b64-5422-4253-ac2c-57996d837578 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e" status: 200 len: 1637 microversion: 2.1 time: 0.430715 Sep 16 12:45:52.776722 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 104/190] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:52 2022] GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e => generated 1637 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:52.811474 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ec2c1f02-ceea-4248-ad33-21dfa4bdbabe tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:52.813284 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ec2c1f02-ceea-4248-ad33-21dfa4bdbabe tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] [instance: cafdd5ab-69fa-40fc-a555-8a2668f40e5e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:52.833423 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec2c1f02-ceea-4248-ad33-21dfa4bdbabe tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:52.835312 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec2c1f02-ceea-4248-ad33-21dfa4bdbabe tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:52.838584 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec2c1f02-ceea-4248-ad33-21dfa4bdbabe tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:52.839511 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec2c1f02-ceea-4248-ad33-21dfa4bdbabe tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:52.840050 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec2c1f02-ceea-4248-ad33-21dfa4bdbabe tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:52.840469 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec2c1f02-ceea-4248-ad33-21dfa4bdbabe tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:52.883366 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ec2c1f02-ceea-4248-ad33-21dfa4bdbabe tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] [instance: cafdd5ab-69fa-40fc-a555-8a2668f40e5e] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:45:53.065606 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ec2c1f02-ceea-4248-ad33-21dfa4bdbabe tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] 10.222.0.67 "DELETE /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e" status: 204 len: 0 microversion: 2.1 time: 0.261777 Sep 16 12:45:53.070840 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 105/191] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:45:52 2022] DELETE /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:45:53.082885 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fc67089b-4b60-4e69-83bc-2aeb928c9d0b tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:53.083596 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fc67089b-4b60-4e69-83bc-2aeb928c9d0b tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] [instance: cafdd5ab-69fa-40fc-a555-8a2668f40e5e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:53.099835 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc67089b-4b60-4e69-83bc-2aeb928c9d0b tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:53.102233 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc67089b-4b60-4e69-83bc-2aeb928c9d0b tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:53.103062 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc67089b-4b60-4e69-83bc-2aeb928c9d0b tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:53.103917 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc67089b-4b60-4e69-83bc-2aeb928c9d0b tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:53.104403 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc67089b-4b60-4e69-83bc-2aeb928c9d0b tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:53.104828 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc67089b-4b60-4e69-83bc-2aeb928c9d0b tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:53.240324 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a7228404-b31c-4db9-9584-52fa26ce55b3 tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/697822469/action" status: 200 len: 96 microversion: 2.1 time: 0.674290 Sep 16 12:45:53.244593 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 87/192] 10.222.0.67 () {60 vars in 1197 bytes} [Fri Sep 16 12:45:52 2022] POST /compute/v2.1/flavors/697822469/action => generated 96 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 12:45:53.258437 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-65d224da-8d99-418d-9910-86d2d70f24e4 tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "99e33211f2aa485494c21705192881af"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:53.338075 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fc67089b-4b60-4e69-83bc-2aeb928c9d0b tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbe3a24b2f6451ca174d708962e49ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065037c7cf1d4b0d8d12253372a605b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:53.348604 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fc67089b-4b60-4e69-83bc-2aeb928c9d0b tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] 10.222.0.67 "GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e" status: 200 len: 1492 microversion: 2.1 time: 0.275954 Sep 16 12:45:53.352109 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 106/193] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:53 2022] GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e => generated 1492 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:53.370137 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f05800e7-e714-40b2-9b07-3fcade132589 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:53.370755 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f05800e7-e714-40b2-9b07-3fcade132589 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: 3ab83a18-0e02-4082-a9f8-b7f93ad2e347] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:53.381265 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f05800e7-e714-40b2-9b07-3fcade132589 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:53.382011 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f05800e7-e714-40b2-9b07-3fcade132589 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:53.383302 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f05800e7-e714-40b2-9b07-3fcade132589 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:53.384253 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f05800e7-e714-40b2-9b07-3fcade132589 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:53.384914 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f05800e7-e714-40b2-9b07-3fcade132589 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:53.385523 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f05800e7-e714-40b2-9b07-3fcade132589 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:53.680646 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f05800e7-e714-40b2-9b07-3fcade132589 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da877221336e4e58859c207fca5e857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b6b2ef87ef4629941a0cc9942d7e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:53.694593 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f05800e7-e714-40b2-9b07-3fcade132589 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347" status: 200 len: 1497 microversion: 2.1 time: 0.341514 Sep 16 12:45:53.696319 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 107/194] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:53 2022] GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347 => generated 1497 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:53.958780 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-65d224da-8d99-418d-9910-86d2d70f24e4 tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] HTTP exception thrown: Flavor access already exists for flavor 31 and project 99e33211f2aa485494c21705192881af combination. Sep 16 12:45:53.986561 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-65d224da-8d99-418d-9910-86d2d70f24e4 tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] Request method failure captured: Sep 16 12:45:53.986561 n-d-858094-4 devstack@n-api.service[128780]: request: POST /compute/v2.1/flavors/697822469/action HTTP/1.1 Sep 16 12:45:53.986561 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:45:53.986561 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:45:53.986561 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:45:53.986561 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 67 Sep 16 12:45:53.986561 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:45:53.986561 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:45:53.986561 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:45:53.986561 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:45:53.986561 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJG_9vHwlDqjCxyweX6B9BUjxEsf8GWkNHJSl07uqum2KcEcKrKbbQRNr7BiY0W_kp7p5bSHuQ7rKD9gTARPirTF5VrODek09xdegClh2WoMP6tjZ7HLtzmtTa1pHPqpvIOiml9dwh1xq1bvwPAdu1f45kG6iqBKQtsjDGDtKIh3M4hE Sep 16 12:45:53.986561 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:45:53.986561 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:45:53.986561 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:45:53.986561 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:45:53.986561 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:45:53.986561 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:45:53.986561 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 2e4deeed319146bd8b52ceffc75a31f9 Sep 16 12:45:53.986561 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1448533164 Sep 16 12:45:53.986561 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,admin,reader Sep 16 12:45:53.986561 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,admin,reader Sep 16 12:45:53.988634 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2e4deeed319146bd8b52ceffc75a31f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2e4deeed319146bd8b52ceffc75a31f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2e4deeed319146bd8b52ceffc75a31f9", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2e4deeed319146bd8b52ceffc75a31f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:45:53.988634 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1448533164 Sep 16 12:45:53.988634 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 2e4deeed319146bd8b52ceffc75a31f9 Sep 16 12:45:53.988634 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1448533164 Sep 16 12:45:53.988634 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin Sep 16 12:45:53.988634 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:45:53.988634 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:45:53.988634 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 4926f05bdd62479682338814adcb4876 Sep 16 12:45:53.988634 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin Sep 16 12:45:53.988634 n-d-858094-4 devstack@n-api.service[128780]: Sep 16 12:45:53.988634 n-d-858094-4 devstack@n-api.service[128780]: {"addTenantAccess": {"tenant": "99e33211f2aa485494c21705192881af"}} Sep 16 12:45:53.988634 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:45:53.989771 n-d-858094-4 devstack@n-api.service[128780]: exception: Flavor access already exists for flavor 31 and project 99e33211f2aa485494c21705192881af combination. Sep 16 12:45:53.989771 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '697822469', 'body': {'addTenantAccess': {'tenant': '99e33211f2aa485494c21705192881af'}}} Sep 16 12:45:53.989771 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:45:53.989771 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:53.989771 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 12:45:53.989771 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 16 12:45:53.989771 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 12:45:53.989771 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 16 12:45:53.989771 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 12:45:53.989771 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 16 12:45:53.989771 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 12:45:53.989771 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 16 12:45:53.989771 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 12:45:53.989771 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 12:45:53.989771 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 12:45:53.989771 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result.read() Sep 16 12:45:53.989771 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 12:45:53.989771 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 16 12:45:53.996323 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 12:45:53.996323 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 16 12:45:53.996323 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 12:45:53.996323 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 16 12:45:53.996323 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 12:45:53.996323 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 16 12:45:53.996323 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '31-99e33211f2aa485494c21705192881af' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 16 12:45:53.996323 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:53.996323 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 16 12:45:53.996323 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:53.996323 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:53.996323 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Sep 16 12:45:53.996323 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi project.save(context.session) Sep 16 12:45:53.996323 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 16 12:45:53.996323 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi session.flush() Sep 16 12:45:53.996323 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 16 12:45:53.996323 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 16 12:45:53.996323 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 16 12:45:53.996323 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 16 12:45:54.000105 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 16 12:45:54.000105 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 16 12:45:54.000105 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 12:45:54.000105 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception Sep 16 12:45:54.000105 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 16 12:45:54.000105 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 16 12:45:54.000105 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 16 12:45:54.000105 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 16 12:45:54.000105 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 16 12:45:54.000105 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 16 12:45:54.000105 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 16 12:45:54.000105 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 16 12:45:54.000105 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 16 12:45:54.000105 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 16 12:45:54.000105 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 16 12:45:54.000105 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 16 12:45:54.000105 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 16 12:45:54.000105 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 16 12:45:54.005053 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 16 12:45:54.005053 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 16 12:45:54.005053 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 16 12:45:54.005053 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 16 12:45:54.005053 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 16 12:45:54.005053 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 16 12:45:54.005053 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 12:45:54.005053 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception Sep 16 12:45:54.005053 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 12:45:54.005053 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 16 12:45:54.005053 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 12:45:54.005053 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 16 12:45:54.005053 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 12:45:54.005053 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 16 12:45:54.005053 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 12:45:54.005053 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 16 12:45:54.005053 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 12:45:54.005053 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 12:45:54.008015 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 12:45:54.008015 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result.read() Sep 16 12:45:54.008015 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 12:45:54.008015 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 16 12:45:54.008015 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 12:45:54.008015 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 16 12:45:54.008015 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 12:45:54.008015 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 16 12:45:54.008015 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 12:45:54.008015 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 16 12:45:54.008015 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '31-99e33211f2aa485494c21705192881af' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 16 12:45:54.008015 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Sep 16 12:45:54.008015 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 16, 12, 45, 53, 948393), 'updated_at': None, 'flavor_id': 31, 'project_id': '99e33211f2aa485494c21705192881af'}] Sep 16 12:45:54.008015 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 16 12:45:54.008015 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:54.008015 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:54.008015 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:54.010969 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:54.010969 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Sep 16 12:45:54.010969 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Sep 16 12:45:54.010969 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 16 12:45:54.010969 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 16 12:45:54.010969 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Sep 16 12:45:54.010969 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Sep 16 12:45:54.010969 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Sep 16 12:45:54.010969 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Sep 16 12:45:54.010969 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Sep 16 12:45:54.010969 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Sep 16 12:45:54.010969 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 12:45:54.010969 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 12:45:54.010969 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Sep 16 12:45:54.010969 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Sep 16 12:45:54.010969 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 31 and project 99e33211f2aa485494c21705192881af combination. Sep 16 12:45:54.010969 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:54.010969 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:54.010969 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:54.013417 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:54.013417 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:54.013417 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:54.013417 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:45:54.013417 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:45:54.013417 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:45:54.013417 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:45:54.013417 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:45:54.013417 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:45:54.013417 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Sep 16 12:45:54.013417 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Sep 16 12:45:54.013417 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 31 and project 99e33211f2aa485494c21705192881af combination. Sep 16 12:45:54.013417 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:54.013417 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:54.013417 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:54.013417 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:54.013417 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:54.013417 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:54.013417 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:45:54.013417 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:45:54.016049 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 31 and project 99e33211f2aa485494c21705192881af combination. Sep 16 12:45:54.016049 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:54.016049 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-65d224da-8d99-418d-9910-86d2d70f24e4 tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] Returning 409 to user: Flavor access already exists for flavor 31 and project 99e33211f2aa485494c21705192881af combination. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:45:54.016049 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-65d224da-8d99-418d-9910-86d2d70f24e4 tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/697822469/action" status: 409 len: 152 microversion: 2.1 time: 0.739035 Sep 16 12:45:54.016049 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 88/195] 10.222.0.67 () {60 vars in 1197 bytes} [Fri Sep 16 12:45:53 2022] POST /compute/v2.1/flavors/697822469/action => generated 152 bytes in 743 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 16 12:45:54.016049 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-307297d9-d5c4-435c-81af-a1c299b70186 tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "99e33211f2aa485494c21705192881af"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:54.021150 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a7268960-eb8b-4fdf-8eb7-c71d3df17bcb tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] Calling method '.version_select at 0x7f10365d81f0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:54.025713 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7268960-eb8b-4fdf-8eb7-c71d3df17bcb tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:54.026199 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7268960-eb8b-4fdf-8eb7-c71d3df17bcb tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:54.026636 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7268960-eb8b-4fdf-8eb7-c71d3df17bcb tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:54.180072 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-307297d9-d5c4-435c-81af-a1c299b70186 tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/697822469/action" status: 200 len: 21 microversion: 2.1 time: 0.181638 Sep 16 12:45:54.181802 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 89/196] 10.222.0.67 () {60 vars in 1197 bytes} [Fri Sep 16 12:45:53 2022] POST /compute/v2.1/flavors/697822469/action => generated 21 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 12:45:54.194916 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-bf4d4a82-0b1e-4a86-9acf-124166afa71b tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:54.221619 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-bf4d4a82-0b1e-4a86-9acf-124166afa71b tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/697822469" status: 202 len: 0 microversion: 2.1 time: 0.032149 Sep 16 12:45:54.222890 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 90/197] 10.222.0.67 () {58 vars in 1158 bytes} [Fri Sep 16 12:45:54 2022] DELETE /compute/v2.1/flavors/697822469 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:45:54.238383 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2f4951d6-7e3e-4913-8e09-07d831a3140a tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:54.241713 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7268960-eb8b-4fdf-8eb7-c71d3df17bcb tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:54.244953 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7268960-eb8b-4fdf-8eb7-c71d3df17bcb tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:54.246260 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7268960-eb8b-4fdf-8eb7-c71d3df17bcb tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:54.271640 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2f4951d6-7e3e-4913-8e09-07d831a3140a tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042701 Sep 16 12:45:54.273666 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 91/198] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:45:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:45:54.293385 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:45:54.295351 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ed2a4b87-2d6d-4ac9-9931-40519ad7b73d tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-536856603", "id": 2040577861, "os-flavor-access:is_public": "True"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:54.332015 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7268960-eb8b-4fdf-8eb7-c71d3df17bcb tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:54.332900 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ed2a4b87-2d6d-4ac9-9931-40519ad7b73d tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.042582 Sep 16 12:45:54.333641 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7268960-eb8b-4fdf-8eb7-c71d3df17bcb tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:54.336443 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7268960-eb8b-4fdf-8eb7-c71d3df17bcb tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:54.337142 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 92/199] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:45:54 2022] POST /compute/v2.1/flavors => generated 437 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:54.351070 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2b20269c-24fa-4098-8d51-5b161b8d8013 tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:54.370302 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7268960-eb8b-4fdf-8eb7-c71d3df17bcb tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:54.370801 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7268960-eb8b-4fdf-8eb7-c71d3df17bcb tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:54.371421 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7268960-eb8b-4fdf-8eb7-c71d3df17bcb tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:54.372580 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-2b20269c-24fa-4098-8d51-5b161b8d8013 tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] HTTP exception thrown: Access list not available for public flavors. Sep 16 12:45:54.377754 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2b20269c-24fa-4098-8d51-5b161b8d8013 tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] Request method failure captured: Sep 16 12:45:54.377754 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/flavors/2040577861/os-flavor-access HTTP/1.1 Sep 16 12:45:54.377754 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:45:54.377754 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:45:54.377754 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:45:54.377754 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:45:54.377754 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:45:54.377754 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:45:54.377754 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:45:54.377754 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:45:54.377754 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJG_9vHwlDqjCxyweX6B9BUjxEsf8GWkNHJSl07uqum2KcEcKrKbbQRNr7BiY0W_kp7p5bSHuQ7rKD9gTARPirTF5VrODek09xdegClh2WoMP6tjZ7HLtzmtTa1pHPqpvIOiml9dwh1xq1bvwPAdu1f45kG6iqBKQtsjDGDtKIh3M4hE Sep 16 12:45:54.377754 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:45:54.377754 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:45:54.377754 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:45:54.377754 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:45:54.377754 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:45:54.377754 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:45:54.377754 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 2e4deeed319146bd8b52ceffc75a31f9 Sep 16 12:45:54.377754 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1448533164 Sep 16 12:45:54.377754 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,admin,reader Sep 16 12:45:54.377754 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,admin,reader Sep 16 12:45:54.378997 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2e4deeed319146bd8b52ceffc75a31f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2e4deeed319146bd8b52ceffc75a31f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2e4deeed319146bd8b52ceffc75a31f9", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2e4deeed319146bd8b52ceffc75a31f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:45:54.378997 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1448533164 Sep 16 12:45:54.378997 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 2e4deeed319146bd8b52ceffc75a31f9 Sep 16 12:45:54.378997 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1448533164 Sep 16 12:45:54.378997 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin Sep 16 12:45:54.378997 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:45:54.378997 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:45:54.378997 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 4926f05bdd62479682338814adcb4876 Sep 16 12:45:54.378997 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin Sep 16 12:45:54.378997 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:45:54.378997 n-d-858094-4 devstack@n-api.service[128780]: exception: Access list not available for public flavors. Sep 16 12:45:54.378997 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'flavor_id': '2040577861'} Sep 16 12:45:54.379692 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:45:54.379692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:54.379692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:54.379692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:54.379692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:45:54.379692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:45:54.379692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:45:54.379692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:45:54.379692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Sep 16 12:45:54.379692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 16 12:45:54.379692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Sep 16 12:45:54.379692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:54.379692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:54.379692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:54.379692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:54.379692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:54.379692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:54.379692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:45:54.379692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:45:54.379692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Sep 16 12:45:54.379692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:54.380830 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2b20269c-24fa-4098-8d51-5b161b8d8013 tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:45:54.380830 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2b20269c-24fa-4098-8d51-5b161b8d8013 tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/2040577861/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.034593 Sep 16 12:45:54.381162 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 93/200] 10.222.0.67 () {58 vars in 1209 bytes} [Fri Sep 16 12:45:54 2022] GET /compute/v2.1/flavors/2040577861/os-flavor-access => generated 91 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 16 12:45:54.403193 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2678f84c-8cdb-4853-a431-173adf0b4df8 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:54.404749 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-2678f84c-8cdb-4853-a431-173adf0b4df8 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] [instance: cafdd5ab-69fa-40fc-a555-8a2668f40e5e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:54.408445 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7268960-eb8b-4fdf-8eb7-c71d3df17bcb tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:54.412677 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7268960-eb8b-4fdf-8eb7-c71d3df17bcb tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:54.413356 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7268960-eb8b-4fdf-8eb7-c71d3df17bcb tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:54.419239 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2678f84c-8cdb-4853-a431-173adf0b4df8 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:54.419736 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2678f84c-8cdb-4853-a431-173adf0b4df8 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:54.420190 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2678f84c-8cdb-4853-a431-173adf0b4df8 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:54.421528 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2678f84c-8cdb-4853-a431-173adf0b4df8 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:54.422279 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2678f84c-8cdb-4853-a431-173adf0b4df8 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:54.422962 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2678f84c-8cdb-4853-a431-173adf0b4df8 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:54.430441 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a7268960-eb8b-4fdf-8eb7-c71d3df17bcb tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1743 microversion: 2.53 time: 0.609691 Sep 16 12:45:54.431364 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 108/201] 10.222.0.67 () {60 vars in 1243 bytes} [Fri Sep 16 12:45:53 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1743 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:45:54.448586 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3af4affa-c27c-4efe-a115-71bfe72064bb tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:54.484760 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3af4affa-c27c-4efe-a115-71bfe72064bb tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/2040577861" status: 202 len: 0 microversion: 2.1 time: 0.051972 Sep 16 12:45:54.488819 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 109/202] 10.222.0.67 () {58 vars in 1161 bytes} [Fri Sep 16 12:45:54 2022] DELETE /compute/v2.1/flavors/2040577861 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:45:54.494372 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-82524cac-2945-4285-8802-7eef8742264f tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] Calling method '.version_select at 0x7f10364c2ca0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:54.501977 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82524cac-2945-4285-8802-7eef8742264f tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:54.502472 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82524cac-2945-4285-8802-7eef8742264f tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:54.503001 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82524cac-2945-4285-8802-7eef8742264f tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:54.536977 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82524cac-2945-4285-8802-7eef8742264f tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:54.537784 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82524cac-2945-4285-8802-7eef8742264f tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:54.538383 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82524cac-2945-4285-8802-7eef8742264f tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:54.578200 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82524cac-2945-4285-8802-7eef8742264f tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:54.588966 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82524cac-2945-4285-8802-7eef8742264f tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:54.589578 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82524cac-2945-4285-8802-7eef8742264f tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:54.637707 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82524cac-2945-4285-8802-7eef8742264f tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:54.640362 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82524cac-2945-4285-8802-7eef8742264f tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:54.641062 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82524cac-2945-4285-8802-7eef8742264f tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:54.687408 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82524cac-2945-4285-8802-7eef8742264f tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:54.693284 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82524cac-2945-4285-8802-7eef8742264f tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:54.693734 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82524cac-2945-4285-8802-7eef8742264f tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:54.712974 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-82524cac-2945-4285-8802-7eef8742264f tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 436 microversion: 2.53 time: 0.222556 Sep 16 12:45:54.713570 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 110/203] 10.222.0.67 () {60 vars in 1222 bytes} [Fri Sep 16 12:45:54 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 436 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:45:54.738712 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-2678f84c-8cdb-4853-a431-173adf0b4df8 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbe3a24b2f6451ca174d708962e49ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065037c7cf1d4b0d8d12253372a605b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:54.746286 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3bce24cc-12a7-46f2-94d7-ec5542526a35 tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:54.754664 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2678f84c-8cdb-4853-a431-173adf0b4df8 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] 10.222.0.67 "GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e" status: 200 len: 1492 microversion: 2.1 time: 0.369941 Sep 16 12:45:54.764187 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 94/204] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:54 2022] GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e => generated 1492 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:54.764187 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2a3c31b8-e045-45e7-9737-854fc212ffdc tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:54.764187 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-2a3c31b8-e045-45e7-9737-854fc212ffdc tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: 3ab83a18-0e02-4082-a9f8-b7f93ad2e347] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:54.797955 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2a3c31b8-e045-45e7-9737-854fc212ffdc tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:54.798449 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2a3c31b8-e045-45e7-9737-854fc212ffdc tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:54.798607 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3bce24cc-12a7-46f2-94d7-ec5542526a35 tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.067769 Sep 16 12:45:54.799045 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2a3c31b8-e045-45e7-9737-854fc212ffdc tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:54.799981 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2a3c31b8-e045-45e7-9737-854fc212ffdc tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:54.803207 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2a3c31b8-e045-45e7-9737-854fc212ffdc tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:54.804076 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2a3c31b8-e045-45e7-9737-854fc212ffdc tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:54.810177 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=100 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:45:54.814459 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 111/205] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:45:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:54.828683 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-52d43927-2858-496b-9400-b42ce3ee7eac tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] Calling method '.version_select at 0x7f10364c29d0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:54.837511 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52d43927-2858-496b-9400-b42ce3ee7eac tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:54.838340 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52d43927-2858-496b-9400-b42ce3ee7eac tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:54.838944 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52d43927-2858-496b-9400-b42ce3ee7eac tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:54.865770 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52d43927-2858-496b-9400-b42ce3ee7eac tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:54.866518 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52d43927-2858-496b-9400-b42ce3ee7eac tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:54.867305 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52d43927-2858-496b-9400-b42ce3ee7eac tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:54.874759 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-52d43927-2858-496b-9400-b42ce3ee7eac tempest-HypervisorAdminV253TestBase-1514189349 tempest-HypervisorAdminV253TestBase-1514189349-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/9e2c3c76-37eb-4c69-9684-a58d1a1f5871" status: 200 len: 792 microversion: 2.53 time: 0.057171 Sep 16 12:45:54.876626 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 112/206] 10.222.0.67 () {60 vars in 1298 bytes} [Fri Sep 16 12:45:54 2022] GET /compute/v2.1/os-hypervisors/9e2c3c76-37eb-4c69-9684-a58d1a1f5871 => generated 792 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:45:54.883622 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2dbd7165-cc70-4497-a2d9-1e70118990b4 tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1141436134", "id": 1831686526, "os-flavor-access:is_public": "False"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:54.914011 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=3,nova_api:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:45:54.922867 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2dbd7165-cc70-4497-a2d9-1e70118990b4 tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.044930 Sep 16 12:45:54.923536 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 113/207] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:45:54 2022] POST /compute/v2.1/flavors => generated 439 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:55.109954 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-2a3c31b8-e045-45e7-9737-854fc212ffdc tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da877221336e4e58859c207fca5e857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b6b2ef87ef4629941a0cc9942d7e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:55.119150 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2a3c31b8-e045-45e7-9737-854fc212ffdc tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347" status: 200 len: 1497 microversion: 2.1 time: 0.362534 Sep 16 12:45:55.137775 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 95/208] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:54 2022] GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347 => generated 1497 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:55.422961 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-46cdfc36-1acd-43ee-9935-f3b4c1daa415 req-94d36720-2f90-4cdb-a2cb-19726182c8c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ab83a18-0e02-4082-a9f8-b7f93ad2e347", "name": "network-vif-deleted", "tag": "aef79ed7-9782-4b45-9885-4a06aa3cc1f4"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:55.454109 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-46cdfc36-1acd-43ee-9935-f3b4c1daa415 req-94d36720-2f90-4cdb-a2cb-19726182c8c5 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:55.454586 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-46cdfc36-1acd-43ee-9935-f3b4c1daa415 req-94d36720-2f90-4cdb-a2cb-19726182c8c5 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:55.455018 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-46cdfc36-1acd-43ee-9935-f3b4c1daa415 req-94d36720-2f90-4cdb-a2cb-19726182c8c5 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:55.502347 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-46cdfc36-1acd-43ee-9935-f3b4c1daa415 req-94d36720-2f90-4cdb-a2cb-19726182c8c5 service nova] Creating event network-vif-deleted:aef79ed7-9782-4b45-9885-4a06aa3cc1f4 for instance 3ab83a18-0e02-4082-a9f8-b7f93ad2e347 on n-h2-858094-4 Sep 16 12:45:55.522694 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-46cdfc36-1acd-43ee-9935-f3b4c1daa415 req-94d36720-2f90-4cdb-a2cb-19726182c8c5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104204 Sep 16 12:45:55.524915 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 96/209] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:45:55.591859 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f7a2c16e-2119-4deb-9bee-b52e6f17c770 tempest-FlavorsAccessNegativeTestJSON-843542993 tempest-FlavorsAccessNegativeTestJSON-843542993-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "99e33211f2aa485494c21705192881af"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:55.596411 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f7a2c16e-2119-4deb-9bee-b52e6f17c770 tempest-FlavorsAccessNegativeTestJSON-843542993 tempest-FlavorsAccessNegativeTestJSON-843542993-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '03fade81d56142b1a2b4f969bb7ecccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e33211f2aa485494c21705192881af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:55.611146 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f7a2c16e-2119-4deb-9bee-b52e6f17c770 tempest-FlavorsAccessNegativeTestJSON-843542993 tempest-FlavorsAccessNegativeTestJSON-843542993-project] Request method failure captured: Sep 16 12:45:55.611146 n-d-858094-4 devstack@n-api.service[128779]: request: POST /compute/v2.1/flavors/1831686526/action HTTP/1.1 Sep 16 12:45:55.611146 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:45:55.611146 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:45:55.611146 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:45:55.611146 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 67 Sep 16 12:45:55.611146 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:45:55.611146 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:45:55.611146 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:45:55.611146 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:45:55.611146 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJG_7lKNw28kZCvZaXC4DhwKjQhWve_iuSYh7DkAll6GFdv7ha3h-WN5C6u-ZQnQypfLsxOrb115mrC39Xh6erKUR2SX4wSsW5PAZwbVjriCH9r47tND1fQAoqfUlbKBnoYTO5VXyGsiekiLscimJEBjeSKi8STI-gOQpnrNcpukst7s Sep 16 12:45:55.611146 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:45:55.611146 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:45:55.611146 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:45:55.611146 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:45:55.611146 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:45:55.611146 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:45:55.611146 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 99e33211f2aa485494c21705192881af Sep 16 12:45:55.611146 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-843542993 Sep 16 12:45:55.611146 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:45:55.611146 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:45:55.612405 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/99e33211f2aa485494c21705192881af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/99e33211f2aa485494c21705192881af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_99e33211f2aa485494c21705192881af", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/99e33211f2aa485494c21705192881af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:45:55.612405 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-843542993 Sep 16 12:45:55.612405 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 99e33211f2aa485494c21705192881af Sep 16 12:45:55.612405 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-843542993 Sep 16 12:45:55.612405 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-FlavorsAccessNegativeTestJSON-843542993-project Sep 16 12:45:55.612405 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:45:55.612405 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:45:55.612405 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 03fade81d56142b1a2b4f969bb7ecccc Sep 16 12:45:55.612405 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-843542993-project Sep 16 12:45:55.612405 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 12:45:55.612405 n-d-858094-4 devstack@n-api.service[128779]: {"addTenantAccess": {"tenant": "99e33211f2aa485494c21705192881af"}} Sep 16 12:45:55.612405 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:45:55.613076 n-d-858094-4 devstack@n-api.service[128779]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 16 12:45:55.613076 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '1831686526', 'body': {'addTenantAccess': {'tenant': '99e33211f2aa485494c21705192881af'}}} Sep 16 12:45:55.613076 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:45:55.613076 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:55.613076 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:55.613076 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:55.613076 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:45:55.613076 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:45:55.613076 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:45:55.613076 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:45:55.613076 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:45:55.613076 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:45:55.613076 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Sep 16 12:45:55.613076 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Sep 16 12:45:55.613076 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 12:45:55.613076 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 12:45:55.613076 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 12:45:55.613076 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 12:45:55.613076 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:45:55.614141 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:45:55.614141 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:45:55.614141 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:45:55.614141 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 12:45:55.614141 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 12:45:55.614141 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 12:45:55.614141 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 12:45:55.614141 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 12:45:55.614141 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 12:45:55.614141 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 16 12:45:55.614141 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:55.614141 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:55.614141 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:55.614141 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:55.614141 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:55.614141 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:55.614141 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 12:45:55.614141 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 12:45:55.614141 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 16 12:45:55.614141 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:55.615886 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f7a2c16e-2119-4deb-9bee-b52e6f17c770 tempest-FlavorsAccessNegativeTestJSON-843542993 tempest-FlavorsAccessNegativeTestJSON-843542993-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:45:55.615886 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f7a2c16e-2119-4deb-9bee-b52e6f17c770 tempest-FlavorsAccessNegativeTestJSON-843542993 tempest-FlavorsAccessNegativeTestJSON-843542993-project] 10.222.0.67 "POST /compute/v2.1/flavors/1831686526/action" status: 403 len: 130 microversion: 2.1 time: 0.679177 Sep 16 12:45:55.615886 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 114/210] 10.222.0.67 () {60 vars in 1200 bytes} [Fri Sep 16 12:45:54 2022] POST /compute/v2.1/flavors/1831686526/action => generated 130 bytes in 680 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:45:55.623893 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-55457de2-34b7-4801-9828-d70ef814e9eb tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:55.659911 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-55457de2-34b7-4801-9828-d70ef814e9eb tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1831686526" status: 202 len: 0 microversion: 2.1 time: 0.040386 Sep 16 12:45:55.664967 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 97/211] 10.222.0.67 () {58 vars in 1161 bytes} [Fri Sep 16 12:45:55 2022] DELETE /compute/v2.1/flavors/1831686526 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:45:55.673125 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9c1bc61d-e5bb-44e1-a847-843e8ff4b079 tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:55.715556 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9c1bc61d-e5bb-44e1-a847-843e8ff4b079 tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046104 Sep 16 12:45:55.733646 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 115/212] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:45:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:55.740161 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-55741332-29d4-4bca-8732-080ac71653fc tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1139029652", "id": 1636927127, "os-flavor-access:is_public": "False"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:55.767851 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-55741332-29d4-4bca-8732-080ac71653fc tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.031461 Sep 16 12:45:55.769462 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 98/213] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:45:55 2022] POST /compute/v2.1/flavors => generated 439 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:55.781646 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cb8f6fa2-50e9-482f-a885-ff93801cb7a1 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:55.783533 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cb8f6fa2-50e9-482f-a885-ff93801cb7a1 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] [instance: cafdd5ab-69fa-40fc-a555-8a2668f40e5e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:55.791408 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4a0f251b-276a-4431-a2fc-09a223149e18 tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "99e33211f2aa485494c21705192881af"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:55.792429 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb8f6fa2-50e9-482f-a885-ff93801cb7a1 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:55.792917 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb8f6fa2-50e9-482f-a885-ff93801cb7a1 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:55.793449 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb8f6fa2-50e9-482f-a885-ff93801cb7a1 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:55.796412 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb8f6fa2-50e9-482f-a885-ff93801cb7a1 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:55.799538 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb8f6fa2-50e9-482f-a885-ff93801cb7a1 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:55.800310 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb8f6fa2-50e9-482f-a885-ff93801cb7a1 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:56.062852 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4a0f251b-276a-4431-a2fc-09a223149e18 tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/1636927127/action" status: 200 len: 97 microversion: 2.1 time: 0.281005 Sep 16 12:45:56.064293 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 99/214] 10.222.0.67 () {60 vars in 1200 bytes} [Fri Sep 16 12:45:55 2022] POST /compute/v2.1/flavors/1636927127/action => generated 97 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 12:45:56.078466 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-cf59fd6a-e045-493b-beb6-79a4c908991a tempest-FlavorsAccessNegativeTestJSON-843542993 tempest-FlavorsAccessNegativeTestJSON-843542993-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "99e33211f2aa485494c21705192881af"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:56.103275 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cb8f6fa2-50e9-482f-a885-ff93801cb7a1 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbe3a24b2f6451ca174d708962e49ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065037c7cf1d4b0d8d12253372a605b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:56.117749 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cb8f6fa2-50e9-482f-a885-ff93801cb7a1 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] 10.222.0.67 "GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e" status: 200 len: 1492 microversion: 2.1 time: 0.342352 Sep 16 12:45:56.121165 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-cf59fd6a-e045-493b-beb6-79a4c908991a tempest-FlavorsAccessNegativeTestJSON-843542993 tempest-FlavorsAccessNegativeTestJSON-843542993-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '03fade81d56142b1a2b4f969bb7ecccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e33211f2aa485494c21705192881af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:56.124027 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 116/215] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:55 2022] GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e => generated 1492 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:45:56.151244 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9c9818f5-32fc-4ea0-820d-87be9eff0989 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:56.151615 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9c9818f5-32fc-4ea0-820d-87be9eff0989 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: 3ab83a18-0e02-4082-a9f8-b7f93ad2e347] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:56.152103 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-cf59fd6a-e045-493b-beb6-79a4c908991a tempest-FlavorsAccessNegativeTestJSON-843542993 tempest-FlavorsAccessNegativeTestJSON-843542993-project] Request method failure captured: Sep 16 12:45:56.152103 n-d-858094-4 devstack@n-api.service[128780]: request: POST /compute/v2.1/flavors/1636927127/action HTTP/1.1 Sep 16 12:45:56.152103 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:45:56.152103 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:45:56.152103 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:45:56.152103 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 70 Sep 16 12:45:56.152103 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:45:56.152103 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:45:56.152103 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:45:56.152103 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:45:56.152103 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJG_7lKNw28kZCvZaXC4DhwKjQhWve_iuSYh7DkAll6GFdv7ha3h-WN5C6u-ZQnQypfLsxOrb115mrC39Xh6erKUR2SX4wSsW5PAZwbVjriCH9r47tND1fQAoqfUlbKBnoYTO5VXyGsiekiLscimJEBjeSKi8STI-gOQpnrNcpukst7s Sep 16 12:45:56.152103 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:45:56.152103 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:45:56.152103 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:45:56.152103 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:45:56.152103 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:45:56.152103 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:45:56.152103 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 99e33211f2aa485494c21705192881af Sep 16 12:45:56.152103 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-843542993 Sep 16 12:45:56.152103 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:45:56.152103 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:45:56.153311 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/99e33211f2aa485494c21705192881af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/99e33211f2aa485494c21705192881af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_99e33211f2aa485494c21705192881af", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/99e33211f2aa485494c21705192881af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:45:56.153311 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-843542993 Sep 16 12:45:56.153311 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 99e33211f2aa485494c21705192881af Sep 16 12:45:56.153311 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-843542993 Sep 16 12:45:56.153311 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-FlavorsAccessNegativeTestJSON-843542993-project Sep 16 12:45:56.153311 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:45:56.153311 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:45:56.153311 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 03fade81d56142b1a2b4f969bb7ecccc Sep 16 12:45:56.153311 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-843542993-project Sep 16 12:45:56.153311 n-d-858094-4 devstack@n-api.service[128780]: Sep 16 12:45:56.153311 n-d-858094-4 devstack@n-api.service[128780]: {"removeTenantAccess": {"tenant": "99e33211f2aa485494c21705192881af"}} Sep 16 12:45:56.153311 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:45:56.154031 n-d-858094-4 devstack@n-api.service[128780]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 16 12:45:56.154031 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '1636927127', 'body': {'removeTenantAccess': {'tenant': '99e33211f2aa485494c21705192881af'}}} Sep 16 12:45:56.154031 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:45:56.154031 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:56.154031 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:56.154031 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:56.154031 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:45:56.154031 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:45:56.154031 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:45:56.154031 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:45:56.154031 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:45:56.154031 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:45:56.154031 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Sep 16 12:45:56.154031 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi context.can( Sep 16 12:45:56.154031 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 12:45:56.154031 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 12:45:56.154031 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 12:45:56.154031 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 12:45:56.154031 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:45:56.154031 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:45:56.155099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:45:56.155099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:45:56.155099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 12:45:56.155099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 12:45:56.155099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 12:45:56.155099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 12:45:56.155099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 12:45:56.155099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 12:45:56.155099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 16 12:45:56.155099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:56.155099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:56.155099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:56.155099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:56.155099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:56.155099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:56.155099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 12:45:56.155099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 12:45:56.155099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 16 12:45:56.155099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:56.158407 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-cf59fd6a-e045-493b-beb6-79a4c908991a tempest-FlavorsAccessNegativeTestJSON-843542993 tempest-FlavorsAccessNegativeTestJSON-843542993-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:45:56.159269 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c9818f5-32fc-4ea0-820d-87be9eff0989 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:56.159780 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c9818f5-32fc-4ea0-820d-87be9eff0989 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:56.160270 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c9818f5-32fc-4ea0-820d-87be9eff0989 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:56.160971 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c9818f5-32fc-4ea0-820d-87be9eff0989 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:56.161584 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c9818f5-32fc-4ea0-820d-87be9eff0989 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:56.162182 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c9818f5-32fc-4ea0-820d-87be9eff0989 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:56.162439 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-cf59fd6a-e045-493b-beb6-79a4c908991a tempest-FlavorsAccessNegativeTestJSON-843542993 tempest-FlavorsAccessNegativeTestJSON-843542993-project] 10.222.0.67 "POST /compute/v2.1/flavors/1636927127/action" status: 403 len: 133 microversion: 2.1 time: 0.090965 Sep 16 12:45:56.170055 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 100/216] 10.222.0.67 () {60 vars in 1200 bytes} [Fri Sep 16 12:45:56 2022] POST /compute/v2.1/flavors/1636927127/action => generated 133 bytes in 98 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:45:56.186972 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-eac1e8be-016a-4719-8dc9-444b623fd4e0 tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "99e33211f2aa485494c21705192881af"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:56.257673 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c9818f5-32fc-4ea0-820d-87be9eff0989 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:56.258557 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c9818f5-32fc-4ea0-820d-87be9eff0989 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:56.259202 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c9818f5-32fc-4ea0-820d-87be9eff0989 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:56.259875 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-9c9818f5-32fc-4ea0-820d-87be9eff0989 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lazy-loading 'fault' on Instance uuid 3ab83a18-0e02-4082-a9f8-b7f93ad2e347 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:45:56.452632 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9c9818f5-32fc-4ea0-820d-87be9eff0989 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da877221336e4e58859c207fca5e857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b6b2ef87ef4629941a0cc9942d7e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:56.475767 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9c9818f5-32fc-4ea0-820d-87be9eff0989 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347" status: 200 len: 1331 microversion: 2.1 time: 0.328377 Sep 16 12:45:56.478766 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 117/217] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:56 2022] GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347 => generated 1331 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:56.493510 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-c1714665-62c0-42b0-bb4d-1ccd8fdb3c72 req-5f9555a7-c190-4bfe-8e1c-370dce3913f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cafdd5ab-69fa-40fc-a555-8a2668f40e5e", "name": "network-vif-deleted", "tag": "63de9e43-b08e-4ff1-a01a-86057adb6cc8"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:56.530545 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c1714665-62c0-42b0-bb4d-1ccd8fdb3c72 req-5f9555a7-c190-4bfe-8e1c-370dce3913f0 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:56.537463 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c1714665-62c0-42b0-bb4d-1ccd8fdb3c72 req-5f9555a7-c190-4bfe-8e1c-370dce3913f0 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:56.540022 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c1714665-62c0-42b0-bb4d-1ccd8fdb3c72 req-5f9555a7-c190-4bfe-8e1c-370dce3913f0 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:56.607628 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-c1714665-62c0-42b0-bb4d-1ccd8fdb3c72 req-5f9555a7-c190-4bfe-8e1c-370dce3913f0 service nova] Creating event network-vif-deleted:63de9e43-b08e-4ff1-a01a-86057adb6cc8 for instance cafdd5ab-69fa-40fc-a555-8a2668f40e5e on n-h2-858094-4 Sep 16 12:45:56.620084 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-eac1e8be-016a-4719-8dc9-444b623fd4e0 tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/1636927127/action" status: 200 len: 21 microversion: 2.1 time: 0.444755 Sep 16 12:45:56.621356 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 101/218] 10.222.0.67 () {60 vars in 1200 bytes} [Fri Sep 16 12:45:56 2022] POST /compute/v2.1/flavors/1636927127/action => generated 21 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 12:45:56.622830 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-c1714665-62c0-42b0-bb4d-1ccd8fdb3c72 req-5f9555a7-c190-4bfe-8e1c-370dce3913f0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141426 Sep 16 12:45:56.624806 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 118/219] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:56.635422 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-46791e7a-b24e-4eb9-99e5-489ca8a63de4 tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:56.641624 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6,nova_api:DELETE=8 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:45:56.671642 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-46791e7a-b24e-4eb9-99e5-489ca8a63de4 tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1636927127" status: 202 len: 0 microversion: 2.1 time: 0.043935 Sep 16 12:45:56.673254 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 102/220] 10.222.0.67 () {58 vars in 1161 bytes} [Fri Sep 16 12:45:56 2022] DELETE /compute/v2.1/flavors/1636927127 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:45:56.683635 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7b387f4b-2a83-4ccd-a5d8-8bbfc8954319 tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:56.725452 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7b387f4b-2a83-4ccd-a5d8-8bbfc8954319 tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047729 Sep 16 12:45:56.729750 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 119/221] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:45:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:45:56.752691 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4297cec7-d9b9-41f5-874d-2959bc1f21ff tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1939030188", "id": 1444439314, "os-flavor-access:is_public": "False"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:56.784416 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4297cec7-d9b9-41f5-874d-2959bc1f21ff tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.040171 Sep 16 12:45:56.785991 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 103/222] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:45:56 2022] POST /compute/v2.1/flavors => generated 439 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:56.800261 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e7bc4918-d3b6-41f5-9d3f-b2a40940be8f tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "3de1580a72ca4e92bca9e38be01fea4a"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:57.149094 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6b8c27fd-9e86-4b68-ae23-dd267dc2138e tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:57.149923 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6b8c27fd-9e86-4b68-ae23-dd267dc2138e tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] [instance: cafdd5ab-69fa-40fc-a555-8a2668f40e5e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:57.176502 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6b8c27fd-9e86-4b68-ae23-dd267dc2138e tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:57.177012 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6b8c27fd-9e86-4b68-ae23-dd267dc2138e tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:57.177443 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6b8c27fd-9e86-4b68-ae23-dd267dc2138e tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:57.178146 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6b8c27fd-9e86-4b68-ae23-dd267dc2138e tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:57.178590 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6b8c27fd-9e86-4b68-ae23-dd267dc2138e tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:57.179795 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6b8c27fd-9e86-4b68-ae23-dd267dc2138e tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:57.267460 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6b8c27fd-9e86-4b68-ae23-dd267dc2138e tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:57.267941 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6b8c27fd-9e86-4b68-ae23-dd267dc2138e tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:57.268394 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6b8c27fd-9e86-4b68-ae23-dd267dc2138e tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:57.268852 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-6b8c27fd-9e86-4b68-ae23-dd267dc2138e tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lazy-loading 'fault' on Instance uuid cafdd5ab-69fa-40fc-a555-8a2668f40e5e {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:45:57.463775 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-e7bc4918-d3b6-41f5-9d3f-b2a40940be8f tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] HTTP exception thrown: Flavor access not found for 35 / 3de1580a72ca4e92bca9e38be01fea4a combination. Sep 16 12:45:57.467074 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e7bc4918-d3b6-41f5-9d3f-b2a40940be8f tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] Request method failure captured: Sep 16 12:45:57.467074 n-d-858094-4 devstack@n-api.service[128779]: request: POST /compute/v2.1/flavors/1444439314/action HTTP/1.1 Sep 16 12:45:57.467074 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:45:57.467074 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:45:57.467074 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:45:57.467074 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 70 Sep 16 12:45:57.467074 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:45:57.467074 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:45:57.467074 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:45:57.467074 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:45:57.467074 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJG_9vHwlDqjCxyweX6B9BUjxEsf8GWkNHJSl07uqum2KcEcKrKbbQRNr7BiY0W_kp7p5bSHuQ7rKD9gTARPirTF5VrODek09xdegClh2WoMP6tjZ7HLtzmtTa1pHPqpvIOiml9dwh1xq1bvwPAdu1f45kG6iqBKQtsjDGDtKIh3M4hE Sep 16 12:45:57.467074 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:45:57.467074 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:45:57.467074 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:45:57.467074 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:45:57.467074 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:45:57.467074 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:45:57.467074 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 2e4deeed319146bd8b52ceffc75a31f9 Sep 16 12:45:57.467074 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1448533164 Sep 16 12:45:57.467074 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,admin,reader Sep 16 12:45:57.467074 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,admin,reader Sep 16 12:45:57.468282 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2e4deeed319146bd8b52ceffc75a31f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2e4deeed319146bd8b52ceffc75a31f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2e4deeed319146bd8b52ceffc75a31f9", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2e4deeed319146bd8b52ceffc75a31f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:45:57.468282 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1448533164 Sep 16 12:45:57.468282 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 2e4deeed319146bd8b52ceffc75a31f9 Sep 16 12:45:57.468282 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1448533164 Sep 16 12:45:57.468282 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin Sep 16 12:45:57.468282 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:45:57.468282 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:45:57.468282 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 4926f05bdd62479682338814adcb4876 Sep 16 12:45:57.468282 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin Sep 16 12:45:57.468282 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 12:45:57.468282 n-d-858094-4 devstack@n-api.service[128779]: {"removeTenantAccess": {"tenant": "3de1580a72ca4e92bca9e38be01fea4a"}} Sep 16 12:45:57.468282 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:45:57.468930 n-d-858094-4 devstack@n-api.service[128779]: exception: Flavor access not found for 35 / 3de1580a72ca4e92bca9e38be01fea4a combination. Sep 16 12:45:57.468930 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '1444439314', 'body': {'removeTenantAccess': {'tenant': '3de1580a72ca4e92bca9e38be01fea4a'}}} Sep 16 12:45:57.468930 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:45:57.468930 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:57.468930 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Sep 16 12:45:57.468930 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Sep 16 12:45:57.468930 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 16 12:45:57.468930 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 16 12:45:57.468930 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Sep 16 12:45:57.468930 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Sep 16 12:45:57.468930 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Sep 16 12:45:57.468930 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Sep 16 12:45:57.468930 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Sep 16 12:45:57.468930 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Sep 16 12:45:57.468930 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 12:45:57.468930 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 12:45:57.468930 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Sep 16 12:45:57.468930 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Sep 16 12:45:57.469877 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 35 / 3de1580a72ca4e92bca9e38be01fea4a combination. Sep 16 12:45:57.469877 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:57.469877 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:57.469877 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:57.469877 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:57.469877 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:57.469877 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:57.469877 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:45:57.469877 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:45:57.469877 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:45:57.469877 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:45:57.469877 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:45:57.469877 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:45:57.469877 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Sep 16 12:45:57.469877 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:45:57.469877 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 35 / 3de1580a72ca4e92bca9e38be01fea4a combination. Sep 16 12:45:57.469877 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:57.469877 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:57.469877 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:57.469877 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:57.470920 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:57.470920 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:57.470920 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:45:57.470920 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:45:57.470920 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 35 / 3de1580a72ca4e92bca9e38be01fea4a combination. Sep 16 12:45:57.470920 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:57.470920 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e7bc4918-d3b6-41f5-9d3f-b2a40940be8f tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] Returning 404 to user: Flavor access not found for 35 / 3de1580a72ca4e92bca9e38be01fea4a combination. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:45:57.472110 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e7bc4918-d3b6-41f5-9d3f-b2a40940be8f tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/1444439314/action" status: 404 len: 124 microversion: 2.1 time: 0.673759 Sep 16 12:45:57.474906 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 120/223] 10.222.0.67 () {60 vars in 1200 bytes} [Fri Sep 16 12:45:56 2022] POST /compute/v2.1/flavors/1444439314/action => generated 124 bytes in 681 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:45:57.487134 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f259a152-76f7-4656-afc0-6173aad9ae63 tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:57.532978 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f259a152-76f7-4656-afc0-6173aad9ae63 tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1444439314" status: 202 len: 0 microversion: 2.1 time: 0.049842 Sep 16 12:45:57.533613 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 121/224] 10.222.0.67 () {58 vars in 1161 bytes} [Fri Sep 16 12:45:57 2022] DELETE /compute/v2.1/flavors/1444439314 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 12:45:57.543747 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d5f416e8-f7bf-4cfe-ba6a-2e0136fab47d tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:57.547307 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d5f416e8-f7bf-4cfe-ba6a-2e0136fab47d tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: 3ab83a18-0e02-4082-a9f8-b7f93ad2e347] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:57.562093 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6b8c27fd-9e86-4b68-ae23-dd267dc2138e tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbe3a24b2f6451ca174d708962e49ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065037c7cf1d4b0d8d12253372a605b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:57.563938 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5f416e8-f7bf-4cfe-ba6a-2e0136fab47d tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:57.564557 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5f416e8-f7bf-4cfe-ba6a-2e0136fab47d tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:57.565089 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5f416e8-f7bf-4cfe-ba6a-2e0136fab47d tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:57.566058 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5f416e8-f7bf-4cfe-ba6a-2e0136fab47d tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:57.567502 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5f416e8-f7bf-4cfe-ba6a-2e0136fab47d tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:57.568015 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5f416e8-f7bf-4cfe-ba6a-2e0136fab47d tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:57.578769 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6b8c27fd-9e86-4b68-ae23-dd267dc2138e tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] 10.222.0.67 "GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e" status: 200 len: 1327 microversion: 2.1 time: 0.433501 Sep 16 12:45:57.581995 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 104/225] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:57 2022] GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e => generated 1327 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:57.591768 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2b1b6e0c-7371-4221-9a32-ffb2d9e2845c tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:57.608889 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-d5f416e8-f7bf-4cfe-ba6a-2e0136fab47d tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] HTTP exception thrown: Instance 3ab83a18-0e02-4082-a9f8-b7f93ad2e347 could not be found. Sep 16 12:45:57.615181 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d5f416e8-f7bf-4cfe-ba6a-2e0136fab47d tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Request method failure captured: Sep 16 12:45:57.615181 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347 HTTP/1.1 Sep 16 12:45:57.615181 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:45:57.615181 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:45:57.615181 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:45:57.615181 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:45:57.615181 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:45:57.615181 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:45:57.615181 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:45:57.615181 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:45:57.615181 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJG_aXJ-jOi44QzEE6jtjSUcTLFo3CTXgtANbx9pxAV6teugnqsJnF-5xHLbNeLTOC3tI75BtPhY6GK_fOll9MJM24O7e3Oec9dPloeIC-A1kxwQLjtGaYe7X_Uu4KDdLnUh9iDgU80j-ygIAk6Amn7GE9j_XNSc4UrKVi3zpuouD0ys Sep 16 12:45:57.615181 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:45:57.615181 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:45:57.615181 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:45:57.615181 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:45:57.615181 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:45:57.615181 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:45:57.615181 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: e1b6b2ef87ef4629941a0cc9942d7e4c Sep 16 12:45:57.615181 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1508389863 Sep 16 12:45:57.615181 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:45:57.615181 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:45:57.616776 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e1b6b2ef87ef4629941a0cc9942d7e4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e1b6b2ef87ef4629941a0cc9942d7e4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e1b6b2ef87ef4629941a0cc9942d7e4c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e1b6b2ef87ef4629941a0cc9942d7e4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:45:57.616776 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-DeleteServersAdminTestJSON-1508389863 Sep 16 12:45:57.616776 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: e1b6b2ef87ef4629941a0cc9942d7e4c Sep 16 12:45:57.616776 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1508389863 Sep 16 12:45:57.616776 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-DeleteServersAdminTestJSON-1508389863-project Sep 16 12:45:57.616776 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:45:57.616776 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:45:57.616776 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: da877221336e4e58859c207fca5e857c Sep 16 12:45:57.616776 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-DeleteServersAdminTestJSON-1508389863-project Sep 16 12:45:57.616776 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:45:57.616776 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 3ab83a18-0e02-4082-a9f8-b7f93ad2e347 could not be found. Sep 16 12:45:57.616776 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '3ab83a18-0e02-4082-a9f8-b7f93ad2e347'} Sep 16 12:45:57.617579 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:45:57.617579 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:57.617579 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:45:57.617579 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:45:57.617579 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:45:57.617579 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:45:57.617579 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:45:57.617579 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:45:57.617579 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:45:57.617579 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:45:57.617579 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ab83a18-0e02-4082-a9f8-b7f93ad2e347 could not be found. Sep 16 12:45:57.617579 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:57.617579 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:57.617579 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:57.617579 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:57.617579 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:57.617579 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:57.617579 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:45:57.617579 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:45:57.617579 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:45:57.618726 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:45:57.618726 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:45:57.618726 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:45:57.618726 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:45:57.618726 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:45:57.618726 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:45:57.618726 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:45:57.618726 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ab83a18-0e02-4082-a9f8-b7f93ad2e347 could not be found. Sep 16 12:45:57.618726 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:57.618726 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:57.618726 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:57.618726 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:57.618726 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:57.618726 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:57.618726 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:45:57.618726 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:45:57.618726 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ab83a18-0e02-4082-a9f8-b7f93ad2e347 could not be found. Sep 16 12:45:57.618726 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:45:57.622097 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d5f416e8-f7bf-4cfe-ba6a-2e0136fab47d tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Returning 404 to user: Instance 3ab83a18-0e02-4082-a9f8-b7f93ad2e347 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:45:57.624223 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d5f416e8-f7bf-4cfe-ba6a-2e0136fab47d tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347" status: 404 len: 111 microversion: 2.1 time: 0.088440 Sep 16 12:45:57.625099 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 122/226] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:57 2022] GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:45:57.635855 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2b1b6e0c-7371-4221-9a32-ffb2d9e2845c tempest-FlavorsAccessNegativeTestJSON-1448533164 tempest-FlavorsAccessNegativeTestJSON-1448533164-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052168 Sep 16 12:45:57.639571 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 105/227] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:45:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:45:57.926009 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-680ef4f1-a7c2-4739-84b8-0cae90c1e406 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1198792679", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:58.068049 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-680ef4f1-a7c2-4739-84b8-0cae90c1e406 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] validate_networks() for None {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:45:58.537836 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-680ef4f1-a7c2-4739-84b8-0cae90c1e406 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:45:58.539676 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-680ef4f1-a7c2-4739-84b8-0cae90c1e406 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:45:58.540657 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-680ef4f1-a7c2-4739-84b8-0cae90c1e406 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:45:58.541250 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-680ef4f1-a7c2-4739-84b8-0cae90c1e406 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:45:58.541819 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-680ef4f1-a7c2-4739-84b8-0cae90c1e406 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:45:58.583484 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-680ef4f1-a7c2-4739-84b8-0cae90c1e406 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:58.584419 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-680ef4f1-a7c2-4739-84b8-0cae90c1e406 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:58.585106 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-680ef4f1-a7c2-4739-84b8-0cae90c1e406 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:58.588794 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-680ef4f1-a7c2-4739-84b8-0cae90c1e406 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:58.590064 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-680ef4f1-a7c2-4739-84b8-0cae90c1e406 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:58.592234 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-680ef4f1-a7c2-4739-84b8-0cae90c1e406 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:58.608720 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-cfa28ac8-6344-46a1-af60-309a69482d7d tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:58.609677 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-cfa28ac8-6344-46a1-af60-309a69482d7d tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] [instance: cafdd5ab-69fa-40fc-a555-8a2668f40e5e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:58.630202 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cfa28ac8-6344-46a1-af60-309a69482d7d tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:58.630951 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cfa28ac8-6344-46a1-af60-309a69482d7d tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:58.631567 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cfa28ac8-6344-46a1-af60-309a69482d7d tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:58.632789 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cfa28ac8-6344-46a1-af60-309a69482d7d tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:58.638162 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cfa28ac8-6344-46a1-af60-309a69482d7d tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:58.639290 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cfa28ac8-6344-46a1-af60-309a69482d7d tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:58.669492 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-680ef4f1-a7c2-4739-84b8-0cae90c1e406 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Getting quotas for project e1b6b2ef87ef4629941a0cc9942d7e4c. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:45:58.680944 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-cfa28ac8-6344-46a1-af60-309a69482d7d tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] HTTP exception thrown: Instance cafdd5ab-69fa-40fc-a555-8a2668f40e5e could not be found. Sep 16 12:45:58.682218 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-680ef4f1-a7c2-4739-84b8-0cae90c1e406 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Getting quotas for user da877221336e4e58859c207fca5e857c and project e1b6b2ef87ef4629941a0cc9942d7e4c. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:45:58.688232 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-cfa28ac8-6344-46a1-af60-309a69482d7d tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Request method failure captured: Sep 16 12:45:58.688232 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e HTTP/1.1 Sep 16 12:45:58.688232 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:45:58.688232 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:45:58.688232 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:45:58.688232 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:45:58.688232 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:45:58.688232 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:45:58.688232 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:45:58.688232 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:45:58.688232 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJG_buGoNxpW3pPhuKaKhwxvg-gl3wF73BIRt59K5_a11vxuUY6ehTHOzAXyXvjkP16A5G9cpbI18-nIDMZtHffPc1xg_seGOTgOdOnuWyBO2QzhYVlQ9yKAQo5J820PWot4jmNR98U3iff1Q2Jp3YXwTy0UybMl2nNfI0xrSnN--Www Sep 16 12:45:58.688232 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:45:58.688232 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:45:58.688232 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:45:58.688232 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:45:58.688232 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:45:58.688232 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:45:58.688232 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 065037c7cf1d4b0d8d12253372a605b0 Sep 16 12:45:58.688232 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-AggregatesAdminTestJSON-1773349254 Sep 16 12:45:58.688232 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:45:58.688232 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:45:58.689491 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/065037c7cf1d4b0d8d12253372a605b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/065037c7cf1d4b0d8d12253372a605b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_065037c7cf1d4b0d8d12253372a605b0", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/065037c7cf1d4b0d8d12253372a605b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:45:58.689491 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-AggregatesAdminTestJSON-1773349254 Sep 16 12:45:58.689491 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 065037c7cf1d4b0d8d12253372a605b0 Sep 16 12:45:58.689491 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1773349254 Sep 16 12:45:58.689491 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-AggregatesAdminTestJSON-1773349254-project Sep 16 12:45:58.689491 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:45:58.689491 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:45:58.689491 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 3cbe3a24b2f6451ca174d708962e49ff Sep 16 12:45:58.689491 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-AggregatesAdminTestJSON-1773349254-project Sep 16 12:45:58.689491 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:45:58.689491 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance cafdd5ab-69fa-40fc-a555-8a2668f40e5e could not be found. Sep 16 12:45:58.689491 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'cafdd5ab-69fa-40fc-a555-8a2668f40e5e'} Sep 16 12:45:58.690242 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:45:58.690242 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:58.690242 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:45:58.690242 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:45:58.690242 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:45:58.690242 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:45:58.690242 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:45:58.690242 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:45:58.690242 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:45:58.690242 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:45:58.690242 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cafdd5ab-69fa-40fc-a555-8a2668f40e5e could not be found. Sep 16 12:45:58.690242 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:58.690242 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:58.690242 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:58.690242 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:58.690242 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:58.690242 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:58.690242 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:45:58.690242 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:45:58.690242 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:45:58.691393 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:45:58.691393 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:45:58.691393 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:45:58.691393 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:45:58.691393 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:45:58.691393 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:45:58.691393 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:45:58.691393 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cafdd5ab-69fa-40fc-a555-8a2668f40e5e could not be found. Sep 16 12:45:58.691393 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:58.691393 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:45:58.691393 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:58.691393 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:45:58.691393 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:45:58.691393 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:45:58.691393 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:45:58.691393 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:45:58.691393 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cafdd5ab-69fa-40fc-a555-8a2668f40e5e could not be found. Sep 16 12:45:58.691393 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:45:58.694488 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-cfa28ac8-6344-46a1-af60-309a69482d7d tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Returning 404 to user: Instance cafdd5ab-69fa-40fc-a555-8a2668f40e5e could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:45:58.698376 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-cfa28ac8-6344-46a1-af60-309a69482d7d tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] 10.222.0.67 "GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e" status: 404 len: 111 microversion: 2.1 time: 0.092775 Sep 16 12:45:58.700093 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 106/228] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:58 2022] GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:45:58.714513 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-680ef4f1-a7c2-4739-84b8-0cae90c1e406 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:45:58.714985 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-afa8ac83-1cf7-4e7e-8535-dbfaeae3bb04 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858094-4"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:58.717332 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-680ef4f1-a7c2-4739-84b8-0cae90c1e406 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: dab4fa5f-1804-403e-9387-5c12685ddfb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:45:58.768944 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-afa8ac83-1cf7-4e7e-8535-dbfaeae3bb04 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:58.770487 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-afa8ac83-1cf7-4e7e-8535-dbfaeae3bb04 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:58.773697 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-afa8ac83-1cf7-4e7e-8535-dbfaeae3bb04 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:58.846200 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-680ef4f1-a7c2-4739-84b8-0cae90c1e406 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.938122 Sep 16 12:45:58.848997 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 123/229] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:45:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 12:45:58.866859 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-89364b73-b070-460d-81c9-e8d0efb2e08e tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:58.867793 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-89364b73-b070-460d-81c9-e8d0efb2e08e tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: dab4fa5f-1804-403e-9387-5c12685ddfb3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:45:59.090270 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-afa8ac83-1cf7-4e7e-8535-dbfaeae3bb04 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 297 microversion: 2.1 time: 0.379103 Sep 16 12:45:59.090956 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 107/230] 10.222.0.67 () {60 vars in 1191 bytes} [Fri Sep 16 12:45:58 2022] POST /compute/v2.1/os-aggregates/7/action => generated 297 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:45:59.096392 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-89364b73-b070-460d-81c9-e8d0efb2e08e tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da877221336e4e58859c207fca5e857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b6b2ef87ef4629941a0cc9942d7e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:45:59.104895 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a2420dcc-d1e4-4f28-959b-b919879159a7 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:59.108056 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-89364b73-b070-460d-81c9-e8d0efb2e08e tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3" status: 200 len: 1220 microversion: 2.1 time: 0.244055 Sep 16 12:45:59.110498 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 124/231] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:45:58 2022] GET /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3 => generated 1220 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:45:59.201430 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a2420dcc-d1e4-4f28-959b-b919879159a7 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.102576 Sep 16 12:45:59.203049 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 108/232] 10.222.0.67 () {58 vars in 1152 bytes} [Fri Sep 16 12:45:59 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 16 12:45:59.227677 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-70af7153-b2e3-44c6-ae5f-3627ea73e9ae tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Calling method '.version_select at 0x7f10362a1f70>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:59.231705 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70af7153-b2e3-44c6-ae5f-3627ea73e9ae tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:59.232563 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70af7153-b2e3-44c6-ae5f-3627ea73e9ae tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:59.233212 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70af7153-b2e3-44c6-ae5f-3627ea73e9ae tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:59.234507 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70af7153-b2e3-44c6-ae5f-3627ea73e9ae tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:59.235414 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70af7153-b2e3-44c6-ae5f-3627ea73e9ae tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:59.236341 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70af7153-b2e3-44c6-ae5f-3627ea73e9ae tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:59.274335 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-70af7153-b2e3-44c6-ae5f-3627ea73e9ae tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.054607 Sep 16 12:45:59.275680 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 125/233] 10.222.0.67 () {58 vars in 1128 bytes} [Fri Sep 16 12:45:59 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:59.289341 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d3797810-b515-4211-84c5-a72bdfc1cb9f tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Calling method '.version_select at 0x7f103614b8b0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:59.296166 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d3797810-b515-4211-84c5-a72bdfc1cb9f tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:59.297086 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d3797810-b515-4211-84c5-a72bdfc1cb9f tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:59.297798 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d3797810-b515-4211-84c5-a72bdfc1cb9f tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:59.298831 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d3797810-b515-4211-84c5-a72bdfc1cb9f tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:59.299422 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d3797810-b515-4211-84c5-a72bdfc1cb9f tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:59.299969 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d3797810-b515-4211-84c5-a72bdfc1cb9f tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:59.344567 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d3797810-b515-4211-84c5-a72bdfc1cb9f tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.059839 Sep 16 12:45:59.355531 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 109/234] 10.222.0.67 () {58 vars in 1155 bytes} [Fri Sep 16 12:45:59 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:59.360331 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4ab80001-0d23-4153-aa1c-74b700f06b97 tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Calling method '.version_select at 0x7f10362bbd30>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:59.369310 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ab80001-0d23-4153-aa1c-74b700f06b97 tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:59.373614 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ab80001-0d23-4153-aa1c-74b700f06b97 tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:59.373614 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ab80001-0d23-4153-aa1c-74b700f06b97 tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:59.375011 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ab80001-0d23-4153-aa1c-74b700f06b97 tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:59.375581 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ab80001-0d23-4153-aa1c-74b700f06b97 tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:59.377516 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ab80001-0d23-4153-aa1c-74b700f06b97 tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:59.378934 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5c54def6-2093-4cd0-a2fa-4a4705d6cc24 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1161571379"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:59.387494 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.aggregate [None req-5c54def6-2093-4cd0-a2fa-4a4705d6cc24 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Generated uuid c307f59d-fadf-4644-9027-e217cf0185fc for aggregate {{(pid=128780) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 16 12:45:59.437877 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5c54def6-2093-4cd0-a2fa-4a4705d6cc24 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.061493 Sep 16 12:45:59.439530 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 110/235] 10.222.0.67 () {60 vars in 1164 bytes} [Fri Sep 16 12:45:59 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:45:59.463585 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5dc01ae8-45df-4856-971b-1bca4bf3ba0d tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858094-4"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:59.478590 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4ab80001-0d23-4153-aa1c-74b700f06b97 tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.122513 Sep 16 12:45:59.479593 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 126/236] 10.222.0.67 () {58 vars in 1128 bytes} [Fri Sep 16 12:45:59 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:59.489426 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a96ba08b-0399-4b25-8809-1046c9f257d9 tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Calling method '.version_select at 0x7f103624aa60>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:59.506634 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a96ba08b-0399-4b25-8809-1046c9f257d9 tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:59.510028 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5dc01ae8-45df-4856-971b-1bca4bf3ba0d tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:59.511961 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a96ba08b-0399-4b25-8809-1046c9f257d9 tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:59.512467 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a96ba08b-0399-4b25-8809-1046c9f257d9 tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:59.514012 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5dc01ae8-45df-4856-971b-1bca4bf3ba0d tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:59.517597 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5dc01ae8-45df-4856-971b-1bca4bf3ba0d tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:59.528164 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a96ba08b-0399-4b25-8809-1046c9f257d9 tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:59.528846 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a96ba08b-0399-4b25-8809-1046c9f257d9 tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:59.529484 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a96ba08b-0399-4b25-8809-1046c9f257d9 tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:59.558859 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a96ba08b-0399-4b25-8809-1046c9f257d9 tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hosts/n-h2-858094-4" status: 200 len: 332 microversion: 2.1 time: 0.072959 Sep 16 12:45:59.561647 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 127/237] 10.222.0.67 () {58 vars in 1170 bytes} [Fri Sep 16 12:45:59 2022] GET /compute/v2.1/os-hosts/n-h2-858094-4 => generated 332 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:45:59.575820 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-feed4dd9-5b27-498c-a5c4-29212ef4d5bb tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Calling method '.version_select at 0x7f10362bbb80>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:59.594689 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-feed4dd9-5b27-498c-a5c4-29212ef4d5bb tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:59.595239 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-feed4dd9-5b27-498c-a5c4-29212ef4d5bb tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:59.595712 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-feed4dd9-5b27-498c-a5c4-29212ef4d5bb tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:59.638726 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-feed4dd9-5b27-498c-a5c4-29212ef4d5bb tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:59.639728 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-feed4dd9-5b27-498c-a5c4-29212ef4d5bb tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:59.640403 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-feed4dd9-5b27-498c-a5c4-29212ef4d5bb tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:45:59.651077 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-feed4dd9-5b27-498c-a5c4-29212ef4d5bb tempest-HostsAdminTestJSON-955157350 tempest-HostsAdminTestJSON-955157350-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hosts/n-h1-858094-4" status: 200 len: 332 microversion: 2.1 time: 0.081301 Sep 16 12:45:59.652436 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 128/238] 10.222.0.67 () {58 vars in 1170 bytes} [Fri Sep 16 12:45:59 2022] GET /compute/v2.1/os-hosts/n-h1-858094-4 => generated 332 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:59.814702 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5dc01ae8-45df-4856-971b-1bca4bf3ba0d tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 242 microversion: 2.1 time: 0.367311 Sep 16 12:45:59.816300 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 111/239] 10.222.0.67 () {60 vars in 1191 bytes} [Fri Sep 16 12:45:59 2022] POST /compute/v2.1/os-aggregates/9/action => generated 242 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:59.836273 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-705fe853-c78d-4f98-ad30-2a9af5fb6af9 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:45:59.860677 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-705fe853-c78d-4f98-ad30-2a9af5fb6af9 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 242 microversion: 2.1 time: 0.025471 Sep 16 12:45:59.861087 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 129/240] 10.222.0.67 () {58 vars in 1149 bytes} [Fri Sep 16 12:45:59 2022] GET /compute/v2.1/os-aggregates/9 => generated 242 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:45:59.874342 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7a098a5f-ffe3-4797-9d70-3ed318d5d0b2 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858094-4"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:45:59.900992 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7a098a5f-ffe3-4797-9d70-3ed318d5d0b2 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:45:59.902530 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7a098a5f-ffe3-4797-9d70-3ed318d5d0b2 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:45:59.903041 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7a098a5f-ffe3-4797-9d70-3ed318d5d0b2 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:00.139849 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b669304e-880b-4d8a-bbdc-ae58770ecc6c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:00.144957 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b669304e-880b-4d8a-bbdc-ae58770ecc6c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: dab4fa5f-1804-403e-9387-5c12685ddfb3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:00.188595 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b669304e-880b-4d8a-bbdc-ae58770ecc6c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:00.189417 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b669304e-880b-4d8a-bbdc-ae58770ecc6c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:00.190765 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b669304e-880b-4d8a-bbdc-ae58770ecc6c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:00.193188 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b669304e-880b-4d8a-bbdc-ae58770ecc6c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:00.195241 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b669304e-880b-4d8a-bbdc-ae58770ecc6c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:00.196684 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b669304e-880b-4d8a-bbdc-ae58770ecc6c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:00.253468 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7a098a5f-ffe3-4797-9d70-3ed318d5d0b2 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.383512 Sep 16 12:46:00.254417 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 112/241] 10.222.0.67 () {60 vars in 1191 bytes} [Fri Sep 16 12:45:59 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:00.278286 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-66245958-465b-47e6-a885-5743a4110158 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:00.326209 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-66245958-465b-47e6-a885-5743a4110158 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.058784 Sep 16 12:46:00.327811 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 113/242] 10.222.0.67 () {58 vars in 1152 bytes} [Fri Sep 16 12:46:00 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 16 12:46:00.354108 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e6d561f5-8fc5-423f-9451-63d133a6063f tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-794006009"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:00.363570 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.aggregate [None req-e6d561f5-8fc5-423f-9451-63d133a6063f tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Generated uuid 7324ed50-06fc-430d-bca8-7e122700e484 for aggregate {{(pid=128780) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 16 12:46:00.419884 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e6d561f5-8fc5-423f-9451-63d133a6063f tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.077638 Sep 16 12:46:00.421264 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 114/243] 10.222.0.67 () {60 vars in 1164 bytes} [Fri Sep 16 12:46:00 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:00.440905 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-02be7357-271c-44d4-b794-96068107106c tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858094-4"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:00.456824 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b669304e-880b-4d8a-bbdc-ae58770ecc6c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da877221336e4e58859c207fca5e857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b6b2ef87ef4629941a0cc9942d7e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:00.457969 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-02be7357-271c-44d4-b794-96068107106c tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:00.458709 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-02be7357-271c-44d4-b794-96068107106c tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:00.459803 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-02be7357-271c-44d4-b794-96068107106c tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:00.467751 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b669304e-880b-4d8a-bbdc-ae58770ecc6c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3" status: 200 len: 1224 microversion: 2.1 time: 0.337254 Sep 16 12:46:00.475431 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 130/244] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:00 2022] GET /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3 => generated 1224 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:46:00.747761 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-02be7357-271c-44d4-b794-96068107106c tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 242 microversion: 2.1 time: 0.317242 Sep 16 12:46:00.748839 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 115/245] 10.222.0.67 () {60 vars in 1194 bytes} [Fri Sep 16 12:46:00 2022] POST /compute/v2.1/os-aggregates/10/action => generated 242 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:00.766973 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0ed97f4b-ae32-470d-b0bc-3ce17c3815fa tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:00.781967 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0ed97f4b-ae32-470d-b0bc-3ce17c3815fa tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.025688 Sep 16 12:46:00.782555 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 131/246] 10.222.0.67 () {58 vars in 1143 bytes} [Fri Sep 16 12:46:00 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:00.795126 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-638a22af-266a-481c-b0cd-8c291db1118b tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858094-4"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:00.812585 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-638a22af-266a-481c-b0cd-8c291db1118b tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:00.813507 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-638a22af-266a-481c-b0cd-8c291db1118b tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:00.814854 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-638a22af-266a-481c-b0cd-8c291db1118b tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:01.065378 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-638a22af-266a-481c-b0cd-8c291db1118b tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 227 microversion: 2.1 time: 0.274068 Sep 16 12:46:01.072488 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 116/247] 10.222.0.67 () {60 vars in 1194 bytes} [Fri Sep 16 12:46:00 2022] POST /compute/v2.1/os-aggregates/10/action => generated 227 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:01.086955 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d372ea6d-1541-4388-b587-bddcc12d7562 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:01.146696 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d372ea6d-1541-4388-b587-bddcc12d7562 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.065453 Sep 16 12:46:01.149004 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 132/248] 10.222.0.67 () {58 vars in 1155 bytes} [Fri Sep 16 12:46:01 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 16 12:46:01.160705 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b325bde2-b77a-4f09-bd7e-66d0d73c8583 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-141072952"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:01.166508 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.aggregate [None req-b325bde2-b77a-4f09-bd7e-66d0d73c8583 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Generated uuid 2937c88d-4512-411c-997d-b9e6613eb54a for aggregate {{(pid=128780) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 16 12:46:01.224614 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b325bde2-b77a-4f09-bd7e-66d0d73c8583 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.064930 Sep 16 12:46:01.226346 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 117/249] 10.222.0.67 () {60 vars in 1164 bytes} [Fri Sep 16 12:46:01 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:01.238918 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-243cc754-1e61-4a6e-bd11-b7441ed87923 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858094-4"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:01.264166 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-243cc754-1e61-4a6e-bd11-b7441ed87923 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:01.265746 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-243cc754-1e61-4a6e-bd11-b7441ed87923 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:01.267739 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-243cc754-1e61-4a6e-bd11-b7441ed87923 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:01.551018 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-243cc754-1e61-4a6e-bd11-b7441ed87923 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 242 microversion: 2.1 time: 0.317274 Sep 16 12:46:01.551766 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 133/250] 10.222.0.67 () {60 vars in 1194 bytes} [Fri Sep 16 12:46:01 2022] POST /compute/v2.1/os-aggregates/11/action => generated 242 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:01.563524 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-672a3e38-cd9d-4c74-97b5-d0a9a6e4d901 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:01.565910 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-672a3e38-cd9d-4c74-97b5-d0a9a6e4d901 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: dab4fa5f-1804-403e-9387-5c12685ddfb3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:01.594707 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-672a3e38-cd9d-4c74-97b5-d0a9a6e4d901 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:01.595203 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-672a3e38-cd9d-4c74-97b5-d0a9a6e4d901 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:01.598324 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-672a3e38-cd9d-4c74-97b5-d0a9a6e4d901 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:01.602885 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-672a3e38-cd9d-4c74-97b5-d0a9a6e4d901 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:01.603546 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-672a3e38-cd9d-4c74-97b5-d0a9a6e4d901 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:01.605135 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-672a3e38-cd9d-4c74-97b5-d0a9a6e4d901 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:01.763708 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-672a3e38-cd9d-4c74-97b5-d0a9a6e4d901 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da877221336e4e58859c207fca5e857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b6b2ef87ef4629941a0cc9942d7e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:01.771825 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-672a3e38-cd9d-4c74-97b5-d0a9a6e4d901 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3" status: 200 len: 1278 microversion: 2.1 time: 0.218223 Sep 16 12:46:01.772142 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 134/251] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:01 2022] GET /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3 => generated 1278 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:01.777441 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ef34f76a-6285-4c9e-9e12-ac585008450f tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858094-4"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:01.795477 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d0c0d469-26b8-43c5-9d6a-965d3ab0c69d tempest-SecurityGroupsTestAdminJSON-2079169535 tempest-SecurityGroupsTestAdminJSON-2079169535-project] Action: 'create', calling method: .version_select at 0x7f1036109700>, body: {"security_group": {"name": "tempest-securitygroup-544644183", "description": "tempest-description-837276700"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:01.811543 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef34f76a-6285-4c9e-9e12-ac585008450f tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:01.812037 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef34f76a-6285-4c9e-9e12-ac585008450f tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:01.812502 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef34f76a-6285-4c9e-9e12-ac585008450f tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:02.075553 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ef34f76a-6285-4c9e-9e12-ac585008450f tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.301519 Sep 16 12:46:02.078967 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 135/252] 10.222.0.67 () {60 vars in 1194 bytes} [Fri Sep 16 12:46:01 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:02.102535 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9a4cbd6f-3345-4d99-8422-f48e247599da tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:02.144783 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9a4cbd6f-3345-4d99-8422-f48e247599da tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.056695 Sep 16 12:46:02.149132 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 136/253] 10.222.0.67 () {58 vars in 1155 bytes} [Fri Sep 16 12:46:02 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 16 12:46:02.160314 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-122e82bc-eb48-42f4-8f68-1756c4748f5b tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-201491411"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:02.167993 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.aggregate [None req-122e82bc-eb48-42f4-8f68-1756c4748f5b tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Generated uuid ce2d93b1-e3ec-49eb-9488-ad9cde9ad9ff for aggregate {{(pid=128779) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 16 12:46:02.191851 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=9,nova_api:INSERT=5 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:46:02.220732 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-122e82bc-eb48-42f4-8f68-1756c4748f5b tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.065213 Sep 16 12:46:02.222362 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 137/254] 10.222.0.67 () {60 vars in 1164 bytes} [Fri Sep 16 12:46:02 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:02.230763 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a2e14aa1-9495-470f-b2d3-afbe6d716bae tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-3112668"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:02.241849 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.aggregate [None req-a2e14aa1-9495-470f-b2d3-afbe6d716bae tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Generated uuid 391c876c-13ea-494a-bb5e-51c8a788cd35 for aggregate {{(pid=128779) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 16 12:46:02.295655 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a2e14aa1-9495-470f-b2d3-afbe6d716bae tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.072006 Sep 16 12:46:02.298435 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 138/255] 10.222.0.67 () {60 vars in 1164 bytes} [Fri Sep 16 12:46:02 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:02.314782 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-673ede1e-45e0-48de-ac48-fefb64d8b319 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:02.354998 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-673ede1e-45e0-48de-ac48-fefb64d8b319 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.055196 Sep 16 12:46:02.357017 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 139/256] 10.222.0.67 () {58 vars in 1155 bytes} [Fri Sep 16 12:46:02 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 16 12:46:02.371604 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0b3c32b4-17ca-46b7-98b7-bb7df7e9686b tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858094-4"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:02.393121 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b3c32b4-17ca-46b7-98b7-bb7df7e9686b tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:02.393734 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b3c32b4-17ca-46b7-98b7-bb7df7e9686b tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:02.398637 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b3c32b4-17ca-46b7-98b7-bb7df7e9686b tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:02.653212 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0b3c32b4-17ca-46b7-98b7-bb7df7e9686b tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 240 microversion: 2.1 time: 0.290511 Sep 16 12:46:02.653987 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 140/257] 10.222.0.67 () {60 vars in 1194 bytes} [Fri Sep 16 12:46:02 2022] POST /compute/v2.1/os-aggregates/13/action => generated 240 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:02.659327 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-10c45de8-8b43-4360-93e0-cafe3f7e6b73 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:02.687589 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-10c45de8-8b43-4360-93e0-cafe3f7e6b73 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Sep 16 12:46:02.696582 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-10c45de8-8b43-4360-93e0-cafe3f7e6b73 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Request method failure captured: Sep 16 12:46:02.696582 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Sep 16 12:46:02.696582 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:46:02.696582 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:46:02.696582 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:46:02.696582 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:46:02.696582 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:46:02.696582 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:46:02.696582 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:46:02.696582 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:46:02.696582 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJG_egnW68fU9gIna--mQ2d8WgEpADNeiGI79M66FX5lxVHEt_D0qwdTBvCFKICy72_iK8yYZf6Gp7Igqe5dWRtkIV_0sbGGjJmdXbO9RZyW6_HviPZ00LIjZLr0yNGUrf3cZDoElzpyogW1FylYq6AU37D3V3y17vRm-PH0Nhc3M4m4 Sep 16 12:46:02.696582 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:46:02.696582 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:46:02.696582 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:46:02.696582 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:46:02.696582 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:46:02.696582 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:46:02.696582 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 4dd00307ed7c4f21945198ca246c9512 Sep 16 12:46:02.696582 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-AggregatesAdminTestJSON-1770599592 Sep 16 12:46:02.696582 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,admin,reader Sep 16 12:46:02.696582 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,admin,reader Sep 16 12:46:02.698102 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4dd00307ed7c4f21945198ca246c9512"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4dd00307ed7c4f21945198ca246c9512"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4dd00307ed7c4f21945198ca246c9512", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4dd00307ed7c4f21945198ca246c9512"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:46:02.698102 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-AggregatesAdminTestJSON-1770599592 Sep 16 12:46:02.698102 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 4dd00307ed7c4f21945198ca246c9512 Sep 16 12:46:02.698102 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1770599592 Sep 16 12:46:02.698102 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-AggregatesAdminTestJSON-1770599592-project-admin Sep 16 12:46:02.698102 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:46:02.698102 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:46:02.698102 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 2080140dec1548639b5f9966beecc18f Sep 16 12:46:02.698102 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-AggregatesAdminTestJSON-1770599592-project-admin Sep 16 12:46:02.698102 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:46:02.698102 n-d-858094-4 devstack@n-api.service[128779]: exception: Aggregate 12 could not be found. Sep 16 12:46:02.698102 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '12'} Sep 16 12:46:02.698102 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:46:02.698970 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:02.698970 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 16 12:46:02.698970 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 16 12:46:02.698970 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 16 12:46:02.698970 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 16 12:46:02.698970 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 12:46:02.698970 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 12:46:02.698970 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 16 12:46:02.698970 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 16 12:46:02.698970 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 12:46:02.698970 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 12:46:02.698970 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 16 12:46:02.698970 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 16 12:46:02.698970 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Sep 16 12:46:02.698970 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:02.698970 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:02.698970 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:02.698970 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:02.698970 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:02.700251 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:02.700251 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:46:02.700251 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:46:02.700251 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:46:02.700251 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:46:02.700251 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 16 12:46:02.700251 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:46:02.700251 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Sep 16 12:46:02.700251 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:02.700251 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:02.700251 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:02.700251 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:02.700251 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:02.700251 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:02.700251 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:46:02.700251 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:46:02.700251 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Sep 16 12:46:02.700251 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:02.701407 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-10c45de8-8b43-4360-93e0-cafe3f7e6b73 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:46:02.701407 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-10c45de8-8b43-4360-93e0-cafe3f7e6b73 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.045398 Sep 16 12:46:02.701843 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 141/258] 10.222.0.67 () {58 vars in 1152 bytes} [Fri Sep 16 12:46:02 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 12:46:02.721333 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8ca1862e-d62e-4065-923c-b36bd3c80357 tempest-AggregatesAdminNegativeTestJSON-544684390 tempest-AggregatesAdminNegativeTestJSON-544684390-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858094-4"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:02.731016 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8ca1862e-d62e-4065-923c-b36bd3c80357 tempest-AggregatesAdminNegativeTestJSON-544684390 tempest-AggregatesAdminNegativeTestJSON-544684390-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '9eaa59a269b5458d811b4dbf79441e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6be22224574c009206f30e23b43b21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:02.740410 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8ca1862e-d62e-4065-923c-b36bd3c80357 tempest-AggregatesAdminNegativeTestJSON-544684390 tempest-AggregatesAdminNegativeTestJSON-544684390-project] Request method failure captured: Sep 16 12:46:02.740410 n-d-858094-4 devstack@n-api.service[128779]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Sep 16 12:46:02.740410 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:46:02.740410 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:46:02.740410 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:46:02.740410 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 42 Sep 16 12:46:02.740410 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:46:02.740410 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:46:02.740410 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:46:02.740410 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:46:02.740410 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJG_bVMOHzDIswazZ9MfDkLIuM6hqut9iR_HdPuvuNzJ3OaMJU4v7qJVkw2N4Pq_29Alggv3ZD22jd8wYZXPFFnIaUBKSO0kTC1gg08bgOJ_f2NYnpe8bGI68mEVukHwq8TFFX_B9bMbTFdE7utHb4z7ixDnudhwpHYeL2KKBCXN8YBc Sep 16 12:46:02.740410 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:46:02.740410 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:46:02.740410 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:46:02.740410 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:46:02.740410 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:46:02.740410 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:46:02.740410 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 3e6be22224574c009206f30e23b43b21 Sep 16 12:46:02.740410 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-544684390 Sep 16 12:46:02.740410 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:46:02.740410 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:46:02.742862 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3e6be22224574c009206f30e23b43b21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3e6be22224574c009206f30e23b43b21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3e6be22224574c009206f30e23b43b21", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3e6be22224574c009206f30e23b43b21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:46:02.742862 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-544684390 Sep 16 12:46:02.742862 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 3e6be22224574c009206f30e23b43b21 Sep 16 12:46:02.742862 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-544684390 Sep 16 12:46:02.742862 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-AggregatesAdminNegativeTestJSON-544684390-project Sep 16 12:46:02.742862 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:46:02.742862 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:46:02.742862 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 9eaa59a269b5458d811b4dbf79441e1f Sep 16 12:46:02.742862 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-544684390-project Sep 16 12:46:02.742862 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 12:46:02.742862 n-d-858094-4 devstack@n-api.service[128779]: {"remove_host": {"host": "n-h2-858094-4"}} Sep 16 12:46:02.742862 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:46:02.742862 n-d-858094-4 devstack@n-api.service[128779]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 16 12:46:02.743745 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'n-h2-858094-4'}}} Sep 16 12:46:02.743745 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:46:02.743745 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:02.743745 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:02.743745 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:02.743745 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:46:02.743745 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:46:02.743745 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:46:02.743745 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:46:02.743745 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:46:02.743745 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:46:02.743745 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Sep 16 12:46:02.743745 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Sep 16 12:46:02.743745 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 12:46:02.743745 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 12:46:02.743745 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 12:46:02.743745 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 12:46:02.743745 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:46:02.743745 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:46:02.744929 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:46:02.744929 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:46:02.744929 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 12:46:02.744929 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 12:46:02.744929 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 12:46:02.744929 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 12:46:02.744929 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 12:46:02.744929 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 12:46:02.744929 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 16 12:46:02.744929 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:02.744929 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:02.744929 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:02.744929 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:02.744929 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:02.744929 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:02.744929 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 12:46:02.744929 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 12:46:02.744929 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 16 12:46:02.744929 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:02.749287 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8ca1862e-d62e-4065-923c-b36bd3c80357 tempest-AggregatesAdminNegativeTestJSON-544684390 tempest-AggregatesAdminNegativeTestJSON-544684390-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:46:02.750473 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8ca1862e-d62e-4065-923c-b36bd3c80357 tempest-AggregatesAdminNegativeTestJSON-544684390 tempest-AggregatesAdminNegativeTestJSON-544684390-project] 10.222.0.67 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.046928 Sep 16 12:46:02.756337 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 142/259] 10.222.0.67 () {60 vars in 1194 bytes} [Fri Sep 16 12:46:02 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 54 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:46:02.764910 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-73d79487-6382-4993-bce2-ed4b675e67db tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:02.783389 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-73d79487-6382-4993-bce2-ed4b675e67db tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Sep 16 12:46:02.785699 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-73d79487-6382-4993-bce2-ed4b675e67db tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Request method failure captured: Sep 16 12:46:02.785699 n-d-858094-4 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Sep 16 12:46:02.785699 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:46:02.785699 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:46:02.785699 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:46:02.785699 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:46:02.785699 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:46:02.785699 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:46:02.785699 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:46:02.785699 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:46:02.785699 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJG_egnW68fU9gIna--mQ2d8WgEpADNeiGI79M66FX5lxVHEt_D0qwdTBvCFKICy72_iK8yYZf6Gp7Igqe5dWRtkIV_0sbGGjJmdXbO9RZyW6_HviPZ00LIjZLr0yNGUrf3cZDoElzpyogW1FylYq6AU37D3V3y17vRm-PH0Nhc3M4m4 Sep 16 12:46:02.785699 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:46:02.785699 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:46:02.785699 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:46:02.785699 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:46:02.785699 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:46:02.785699 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:46:02.785699 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 4dd00307ed7c4f21945198ca246c9512 Sep 16 12:46:02.785699 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-AggregatesAdminTestJSON-1770599592 Sep 16 12:46:02.785699 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,admin,reader Sep 16 12:46:02.785699 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,admin,reader Sep 16 12:46:02.786984 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4dd00307ed7c4f21945198ca246c9512"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4dd00307ed7c4f21945198ca246c9512"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4dd00307ed7c4f21945198ca246c9512", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4dd00307ed7c4f21945198ca246c9512"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:46:02.786984 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-AggregatesAdminTestJSON-1770599592 Sep 16 12:46:02.786984 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 4dd00307ed7c4f21945198ca246c9512 Sep 16 12:46:02.786984 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1770599592 Sep 16 12:46:02.786984 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-AggregatesAdminTestJSON-1770599592-project-admin Sep 16 12:46:02.786984 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:46:02.786984 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:46:02.786984 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 2080140dec1548639b5f9966beecc18f Sep 16 12:46:02.786984 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-AggregatesAdminTestJSON-1770599592-project-admin Sep 16 12:46:02.786984 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:46:02.786984 n-d-858094-4 devstack@n-api.service[128779]: exception: Aggregate 12 could not be found. Sep 16 12:46:02.786984 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '12'} Sep 16 12:46:02.786984 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:46:02.787824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:02.787824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 16 12:46:02.787824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 16 12:46:02.787824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 16 12:46:02.787824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 16 12:46:02.787824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:46:02.787824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:46:02.787824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:46:02.787824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:46:02.787824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 16 12:46:02.787824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 16 12:46:02.787824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 16 12:46:02.787824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 16 12:46:02.787824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 12:46:02.787824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 12:46:02.787824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 16 12:46:02.787824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 16 12:46:02.787824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 12:46:02.787824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 12:46:02.789523 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 16 12:46:02.789523 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 16 12:46:02.789523 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Sep 16 12:46:02.789523 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:02.789523 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:02.789523 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:02.789523 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:02.789523 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:02.789523 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:02.789523 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:46:02.789523 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:46:02.789523 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:46:02.789523 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:46:02.789523 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 16 12:46:02.789523 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:46:02.789523 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Sep 16 12:46:02.789523 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:02.789523 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:02.789523 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:02.789523 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:02.789523 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:02.790689 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:02.790689 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:46:02.790689 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:46:02.790689 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Sep 16 12:46:02.790689 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:02.792899 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-73d79487-6382-4993-bce2-ed4b675e67db tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:46:02.794423 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-73d79487-6382-4993-bce2-ed4b675e67db tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.034564 Sep 16 12:46:02.796217 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 143/260] 10.222.0.67 () {58 vars in 1155 bytes} [Fri Sep 16 12:46:02 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 12:46:02.809300 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-68e75966-be27-46d9-b5fe-e09d70dba81a tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858094-4"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:02.830057 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68e75966-be27-46d9-b5fe-e09d70dba81a tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:02.830799 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68e75966-be27-46d9-b5fe-e09d70dba81a tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:02.831296 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68e75966-be27-46d9-b5fe-e09d70dba81a tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:02.964205 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d0c0d469-26b8-43c5-9d6a-965d3ab0c69d tempest-SecurityGroupsTestAdminJSON-2079169535 tempest-SecurityGroupsTestAdminJSON-2079169535-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.588425 Sep 16 12:46:02.965170 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 118/261] 10.222.0.67 () {60 vars in 1180 bytes} [Fri Sep 16 12:46:01 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:46:02.977887 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b9b32f4f-7544-416d-88cb-b7a4f8b661fd tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:02.978506 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b9b32f4f-7544-416d-88cb-b7a4f8b661fd tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: dab4fa5f-1804-403e-9387-5c12685ddfb3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:02.997869 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b9b32f4f-7544-416d-88cb-b7a4f8b661fd tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:02.998367 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b9b32f4f-7544-416d-88cb-b7a4f8b661fd tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:02.998819 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b9b32f4f-7544-416d-88cb-b7a4f8b661fd tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:02.999504 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b9b32f4f-7544-416d-88cb-b7a4f8b661fd tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:02.999952 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b9b32f4f-7544-416d-88cb-b7a4f8b661fd tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:03.000401 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b9b32f4f-7544-416d-88cb-b7a4f8b661fd tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:03.082774 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-68e75966-be27-46d9-b5fe-e09d70dba81a tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 225 microversion: 2.1 time: 0.284896 Sep 16 12:46:03.083802 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 144/262] 10.222.0.67 () {60 vars in 1194 bytes} [Fri Sep 16 12:46:02 2022] POST /compute/v2.1/os-aggregates/13/action => generated 225 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:03.099586 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a1072624-afe5-4741-8c12-256f3c8879b3 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1886455805", "name": "tempest-test_aggregate-1060522513"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:03.147713 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.aggregate [None req-a1072624-afe5-4741-8c12-256f3c8879b3 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Generated uuid ef0c8d31-ee5e-44e0-8009-8219d37a2b9e for aggregate {{(pid=128779) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 16 12:46:03.209878 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a1072624-afe5-4741-8c12-256f3c8879b3 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.116617 Sep 16 12:46:03.213646 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 145/263] 10.222.0.67 () {60 vars in 1165 bytes} [Fri Sep 16 12:46:03 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:03.225822 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-783a539b-50c1-4d4b-b16d-9bd6cb8f6e2c tempest-SecurityGroupsTestAdminJSON-2079169535 tempest-SecurityGroupsTestAdminJSON-2079169535-project] Action: 'create', calling method: .version_select at 0x7f103624ac10>, body: {"security_group": {"name": "tempest-securitygroup-1971310443", "description": "tempest-description-2001669614"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:03.526250 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-b9b32f4f-7544-416d-88cb-b7a4f8b661fd tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da877221336e4e58859c207fca5e857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b6b2ef87ef4629941a0cc9942d7e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:03.541332 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b9b32f4f-7544-416d-88cb-b7a4f8b661fd tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3" status: 200 len: 1320 microversion: 2.1 time: 0.574833 Sep 16 12:46:03.542531 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 119/264] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:02 2022] GET /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3 => generated 1320 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:03.547615 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f62a76cb-20ce-4307-846f-655447497508 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:03.596935 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f62a76cb-20ce-4307-846f-655447497508 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.053123 Sep 16 12:46:03.598610 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 120/265] 10.222.0.67 () {58 vars in 1155 bytes} [Fri Sep 16 12:46:03 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 16 12:46:03.607812 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-720c365d-8282-43e7-9a85-4550545c3d88 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:03.648472 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-720c365d-8282-43e7-9a85-4550545c3d88 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.048189 Sep 16 12:46:03.651178 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 121/266] 10.222.0.67 () {58 vars in 1155 bytes} [Fri Sep 16 12:46:03 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 16 12:46:03.657005 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-315963e1-1381-4dae-a4cb-2186a503f215 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1629023070"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:03.664682 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.aggregate [None req-315963e1-1381-4dae-a4cb-2186a503f215 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Generated uuid 78eb72cc-0f00-4dca-a978-ff655793fee6 for aggregate {{(pid=128780) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 16 12:46:03.688202 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:DELETE=14,nova_api:SELECT=79,nova_api:INSERT=7 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:46:03.704358 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-315963e1-1381-4dae-a4cb-2186a503f215 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.051518 Sep 16 12:46:03.712812 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 122/267] 10.222.0.67 () {60 vars in 1164 bytes} [Fri Sep 16 12:46:03 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:03.717043 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-65596243-c9fe-483f-927f-633de60b0d3d tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:03.728195 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-65596243-c9fe-483f-927f-633de60b0d3d tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Sep 16 12:46:03.729769 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-65596243-c9fe-483f-927f-633de60b0d3d tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Request method failure captured: Sep 16 12:46:03.729769 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Sep 16 12:46:03.729769 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:46:03.729769 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:46:03.729769 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:46:03.729769 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:46:03.729769 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:46:03.729769 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:46:03.729769 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:46:03.729769 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:46:03.729769 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJG_egnW68fU9gIna--mQ2d8WgEpADNeiGI79M66FX5lxVHEt_D0qwdTBvCFKICy72_iK8yYZf6Gp7Igqe5dWRtkIV_0sbGGjJmdXbO9RZyW6_HviPZ00LIjZLr0yNGUrf3cZDoElzpyogW1FylYq6AU37D3V3y17vRm-PH0Nhc3M4m4 Sep 16 12:46:03.729769 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:46:03.729769 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:46:03.729769 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:46:03.729769 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:46:03.729769 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:46:03.729769 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:46:03.729769 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 4dd00307ed7c4f21945198ca246c9512 Sep 16 12:46:03.729769 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-AggregatesAdminTestJSON-1770599592 Sep 16 12:46:03.729769 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,admin,reader Sep 16 12:46:03.729769 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,admin,reader Sep 16 12:46:03.730996 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4dd00307ed7c4f21945198ca246c9512"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4dd00307ed7c4f21945198ca246c9512"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4dd00307ed7c4f21945198ca246c9512", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4dd00307ed7c4f21945198ca246c9512"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:46:03.730996 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-AggregatesAdminTestJSON-1770599592 Sep 16 12:46:03.730996 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 4dd00307ed7c4f21945198ca246c9512 Sep 16 12:46:03.730996 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1770599592 Sep 16 12:46:03.730996 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-AggregatesAdminTestJSON-1770599592-project-admin Sep 16 12:46:03.730996 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:46:03.730996 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:46:03.730996 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 2080140dec1548639b5f9966beecc18f Sep 16 12:46:03.730996 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-AggregatesAdminTestJSON-1770599592-project-admin Sep 16 12:46:03.730996 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:46:03.730996 n-d-858094-4 devstack@n-api.service[128780]: exception: Aggregate 14 could not be found. Sep 16 12:46:03.730996 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '14'} Sep 16 12:46:03.730996 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:46:03.731745 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:03.731745 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 16 12:46:03.731745 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 16 12:46:03.731745 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 16 12:46:03.731745 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 16 12:46:03.731745 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 12:46:03.731745 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 12:46:03.731745 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 16 12:46:03.731745 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 16 12:46:03.731745 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 12:46:03.731745 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 12:46:03.731745 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 16 12:46:03.731745 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 16 12:46:03.731745 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Sep 16 12:46:03.731745 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:03.731745 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:03.731745 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:03.731745 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:03.731745 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:03.732856 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:03.732856 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:46:03.732856 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:46:03.732856 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:46:03.732856 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:46:03.732856 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 16 12:46:03.732856 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:46:03.732856 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Sep 16 12:46:03.732856 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:03.732856 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:03.732856 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:03.732856 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:03.732856 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:03.732856 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:03.732856 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:46:03.732856 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:46:03.732856 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Sep 16 12:46:03.732856 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:03.737855 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-65596243-c9fe-483f-927f-633de60b0d3d tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:46:03.737855 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-65596243-c9fe-483f-927f-633de60b0d3d tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.024219 Sep 16 12:46:03.737855 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 123/268] 10.222.0.67 () {58 vars in 1152 bytes} [Fri Sep 16 12:46:03 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 12:46:03.901802 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e477e526-f10c-4fbe-80f9-4d321488d643 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-844335396", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:03.925306 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-783a539b-50c1-4d4b-b16d-9bd6cb8f6e2c tempest-SecurityGroupsTestAdminJSON-2079169535 tempest-SecurityGroupsTestAdminJSON-2079169535-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.705971 Sep 16 12:46:03.926303 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 146/269] 10.222.0.67 () {60 vars in 1180 bytes} [Fri Sep 16 12:46:03 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:03.947598 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-30275385-dd0c-4bbb-9ba6-5b854cff38f0 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:03.967133 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30275385-dd0c-4bbb-9ba6-5b854cff38f0 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:03.968355 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30275385-dd0c-4bbb-9ba6-5b854cff38f0 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:03.969384 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30275385-dd0c-4bbb-9ba6-5b854cff38f0 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:03.976008 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-e477e526-f10c-4fbe-80f9-4d321488d643 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] validate_networks() for None {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:46:03.986098 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30275385-dd0c-4bbb-9ba6-5b854cff38f0 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:03.987219 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30275385-dd0c-4bbb-9ba6-5b854cff38f0 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:03.995434 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30275385-dd0c-4bbb-9ba6-5b854cff38f0 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:04.026707 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.compute.aggregates [None req-30275385-dd0c-4bbb-9ba6-5b854cff38f0 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Failed to remove host nonexist_host from aggregate 15. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 16 12:46:04.027644 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-30275385-dd0c-4bbb-9ba6-5b854cff38f0 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 15 Sep 16 12:46:04.044392 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-30275385-dd0c-4bbb-9ba6-5b854cff38f0 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Request method failure captured: Sep 16 12:46:04.044392 n-d-858094-4 devstack@n-api.service[128779]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 Sep 16 12:46:04.044392 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:46:04.044392 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:46:04.044392 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:46:04.044392 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 42 Sep 16 12:46:04.044392 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:46:04.044392 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:46:04.044392 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:46:04.044392 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:46:04.044392 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJG_dogbGgb8xPb05DjnyijiK6Mr5ivsrHcfgXpJUa34jPkjYsTAmPzS2w_1GHOLXXLpuUCQrAngDbVNIzH3-D3FbpbURcrAYTyYXsAQMtJEJacsiRRJYUkaU2OvpukdMHrDuG6MZ9VzYzuhgiA-Ul1SCOpHVGtsqhqKC8f4bB7P4AWQ Sep 16 12:46:04.044392 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:46:04.044392 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:46:04.044392 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:46:04.044392 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:46:04.044392 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:46:04.044392 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:46:04.044392 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 2e7ba092719d4ecbaa47b6772f68b391 Sep 16 12:46:04.044392 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1426247531 Sep 16 12:46:04.044392 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,admin,reader Sep 16 12:46:04.044392 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,admin,reader Sep 16 12:46:04.047039 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2e7ba092719d4ecbaa47b6772f68b391"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2e7ba092719d4ecbaa47b6772f68b391"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2e7ba092719d4ecbaa47b6772f68b391", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2e7ba092719d4ecbaa47b6772f68b391"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:46:04.047039 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1426247531 Sep 16 12:46:04.047039 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 2e7ba092719d4ecbaa47b6772f68b391 Sep 16 12:46:04.047039 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1426247531 Sep 16 12:46:04.047039 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin Sep 16 12:46:04.047039 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:46:04.047039 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:46:04.047039 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 5968b368bb7449988a1a2f55d2e9cea0 Sep 16 12:46:04.047039 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin Sep 16 12:46:04.047039 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 12:46:04.047039 n-d-858094-4 devstack@n-api.service[128779]: {"remove_host": {"host": "nonexist_host"}} Sep 16 12:46:04.047039 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:46:04.047039 n-d-858094-4 devstack@n-api.service[128779]: exception: Cannot remove host nonexist_host in aggregate 15 Sep 16 12:46:04.049411 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'nonexist_host'}}} Sep 16 12:46:04.049411 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:46:04.049411 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:04.049411 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 16 12:46:04.049411 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 16 12:46:04.049411 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 12:46:04.049411 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 12:46:04.049411 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 16 12:46:04.049411 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 16 12:46:04.049411 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 12:46:04.049411 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 12:46:04.049411 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 16 12:46:04.049411 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 16 12:46:04.049411 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Sep 16 12:46:04.049411 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:04.049411 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:04.049411 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:04.049411 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:04.049411 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 16 12:46:04.049411 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 16 12:46:04.051930 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 16 12:46:04.051930 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 16 12:46:04.051930 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 16 12:46:04.051930 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:04.051930 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:04.051930 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:04.051930 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:04.051930 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Sep 16 12:46:04.051930 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Sep 16 12:46:04.051930 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 16 12:46:04.051930 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 16 12:46:04.051930 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:46:04.051930 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:46:04.051930 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:46:04.051930 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:46:04.051930 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 16 12:46:04.051930 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 16 12:46:04.051930 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Sep 16 12:46:04.051930 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Sep 16 12:46:04.051930 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 16 12:46:04.056745 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 16 12:46:04.056745 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 16 12:46:04.056745 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:04.056745 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:04.056745 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:04.056745 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:04.056745 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:04.056745 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:04.056745 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:46:04.056745 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:46:04.056745 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:46:04.056745 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:46:04.056745 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:46:04.056745 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:46:04.056745 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Sep 16 12:46:04.056745 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 16 12:46:04.056745 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 15 Sep 16 12:46:04.056745 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:04.056745 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:04.056745 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:04.056745 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:04.058912 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:04.058912 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:04.058912 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:46:04.058912 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:46:04.058912 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 15 Sep 16 12:46:04.058912 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:04.058912 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-30275385-dd0c-4bbb-9ba6-5b854cff38f0 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 15 {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:46:04.058912 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-30275385-dd0c-4bbb-9ba6-5b854cff38f0 tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/15/action" status: 404 len: 94 microversion: 2.1 time: 0.129641 Sep 16 12:46:04.060693 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 147/270] 10.222.0.67 () {60 vars in 1194 bytes} [Fri Sep 16 12:46:03 2022] POST /compute/v2.1/os-aggregates/15/action => generated 94 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 12:46:04.070865 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-41921a86-341c-4617-82e1-ab41d5caee7a tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:04.088972 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-41921a86-341c-4617-82e1-ab41d5caee7a tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Sep 16 12:46:04.093559 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-41921a86-341c-4617-82e1-ab41d5caee7a tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Request method failure captured: Sep 16 12:46:04.093559 n-d-858094-4 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Sep 16 12:46:04.093559 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:46:04.093559 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:46:04.093559 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:46:04.093559 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:46:04.093559 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:46:04.093559 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:46:04.093559 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:46:04.093559 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:46:04.093559 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJG_egnW68fU9gIna--mQ2d8WgEpADNeiGI79M66FX5lxVHEt_D0qwdTBvCFKICy72_iK8yYZf6Gp7Igqe5dWRtkIV_0sbGGjJmdXbO9RZyW6_HviPZ00LIjZLr0yNGUrf3cZDoElzpyogW1FylYq6AU37D3V3y17vRm-PH0Nhc3M4m4 Sep 16 12:46:04.093559 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:46:04.093559 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:46:04.093559 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:46:04.093559 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:46:04.093559 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:46:04.093559 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:46:04.093559 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 4dd00307ed7c4f21945198ca246c9512 Sep 16 12:46:04.093559 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-AggregatesAdminTestJSON-1770599592 Sep 16 12:46:04.093559 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,admin,reader Sep 16 12:46:04.093559 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,admin,reader Sep 16 12:46:04.094840 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4dd00307ed7c4f21945198ca246c9512"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4dd00307ed7c4f21945198ca246c9512"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4dd00307ed7c4f21945198ca246c9512", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4dd00307ed7c4f21945198ca246c9512"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:46:04.094840 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-AggregatesAdminTestJSON-1770599592 Sep 16 12:46:04.094840 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 4dd00307ed7c4f21945198ca246c9512 Sep 16 12:46:04.094840 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1770599592 Sep 16 12:46:04.094840 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-AggregatesAdminTestJSON-1770599592-project-admin Sep 16 12:46:04.094840 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:46:04.094840 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:46:04.094840 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 2080140dec1548639b5f9966beecc18f Sep 16 12:46:04.094840 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-AggregatesAdminTestJSON-1770599592-project-admin Sep 16 12:46:04.094840 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:46:04.094840 n-d-858094-4 devstack@n-api.service[128779]: exception: Aggregate 14 could not be found. Sep 16 12:46:04.094840 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '14'} Sep 16 12:46:04.094840 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:46:04.095553 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:04.095553 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 16 12:46:04.095553 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 16 12:46:04.095553 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 16 12:46:04.095553 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 16 12:46:04.095553 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:46:04.095553 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:46:04.095553 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:46:04.095553 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:46:04.095553 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 16 12:46:04.095553 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 16 12:46:04.095553 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 16 12:46:04.095553 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 16 12:46:04.095553 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 12:46:04.095553 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 12:46:04.095553 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 16 12:46:04.095553 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 16 12:46:04.095553 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 12:46:04.095553 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 12:46:04.096848 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 16 12:46:04.096848 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 16 12:46:04.096848 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Sep 16 12:46:04.096848 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:04.096848 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:04.096848 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:04.096848 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:04.096848 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:04.096848 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:04.096848 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:46:04.096848 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:46:04.096848 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:46:04.096848 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:46:04.096848 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 16 12:46:04.096848 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:46:04.096848 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Sep 16 12:46:04.096848 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:04.096848 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:04.096848 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:04.096848 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:04.096848 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:04.098101 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:04.098101 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:46:04.098101 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:46:04.098101 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Sep 16 12:46:04.098101 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:04.098101 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-41921a86-341c-4617-82e1-ab41d5caee7a tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:46:04.098101 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-41921a86-341c-4617-82e1-ab41d5caee7a tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.034911 Sep 16 12:46:04.098101 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 148/271] 10.222.0.67 () {58 vars in 1155 bytes} [Fri Sep 16 12:46:04 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 12:46:04.293864 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5bd81a33-3f6c-4684-8c45-7458c8113350 tempest-SecurityGroupsTestAdminJSON-127425830 tempest-SecurityGroupsTestAdminJSON-127425830-project-admin] Action: 'create', calling method: .version_select at 0x7f103625edc0>, body: {"security_group": {"name": "tempest-securitygroup-1206358112", "description": "tempest-description-582440902"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:04.579009 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-e477e526-f10c-4fbe-80f9-4d321488d643 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:46:04.579831 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-e477e526-f10c-4fbe-80f9-4d321488d643 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:46:04.580538 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-e477e526-f10c-4fbe-80f9-4d321488d643 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:46:04.581145 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-e477e526-f10c-4fbe-80f9-4d321488d643 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:46:04.582247 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-e477e526-f10c-4fbe-80f9-4d321488d643 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:46:04.606934 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e477e526-f10c-4fbe-80f9-4d321488d643 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:04.607685 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e477e526-f10c-4fbe-80f9-4d321488d643 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:04.608730 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e477e526-f10c-4fbe-80f9-4d321488d643 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:04.609720 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e477e526-f10c-4fbe-80f9-4d321488d643 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:04.612146 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e477e526-f10c-4fbe-80f9-4d321488d643 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:04.612595 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e477e526-f10c-4fbe-80f9-4d321488d643 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:04.665318 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-e477e526-f10c-4fbe-80f9-4d321488d643 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Getting quotas for project 20770fd1243d4412bfc90d2a079473bd. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:46:04.677741 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-e477e526-f10c-4fbe-80f9-4d321488d643 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Getting quotas for user 7b0815c12c4340109ec1c379a0602322 and project 20770fd1243d4412bfc90d2a079473bd. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:46:04.723554 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e477e526-f10c-4fbe-80f9-4d321488d643 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:46:04.729740 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e477e526-f10c-4fbe-80f9-4d321488d643 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: 4d860eb6-336f-4ba4-be81-d1ec6fecc87b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:46:04.855432 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e477e526-f10c-4fbe-80f9-4d321488d643 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.121619 Sep 16 12:46:04.856610 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 124/272] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:46:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:46:04.880361 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-4824b69a-b64e-442b-99f4-09346ce1bdc4 req-037d645f-c95d-4331-b3e5-65739cabdd1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dab4fa5f-1804-403e-9387-5c12685ddfb3", "tag": "5b604c8c-012f-4e9f-a5b7-54d52a817f1a"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:04.907413 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-4824b69a-b64e-442b-99f4-09346ce1bdc4 req-037d645f-c95d-4331-b3e5-65739cabdd1d service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:04.908945 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-4824b69a-b64e-442b-99f4-09346ce1bdc4 req-037d645f-c95d-4331-b3e5-65739cabdd1d service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:04.910040 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-4824b69a-b64e-442b-99f4-09346ce1bdc4 req-037d645f-c95d-4331-b3e5-65739cabdd1d service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:04.952253 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-4824b69a-b64e-442b-99f4-09346ce1bdc4 req-037d645f-c95d-4331-b3e5-65739cabdd1d service nova] Creating event network-changed:5b604c8c-012f-4e9f-a5b7-54d52a817f1a for instance dab4fa5f-1804-403e-9387-5c12685ddfb3 on n-h2-858094-4 Sep 16 12:46:04.967890 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-4824b69a-b64e-442b-99f4-09346ce1bdc4 req-037d645f-c95d-4331-b3e5-65739cabdd1d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097454 Sep 16 12:46:04.970014 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 125/273] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:04.983154 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e9179914-34db-472f-8903-0b87ec6734df tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:05.013294 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e9179914-34db-472f-8903-0b87ec6734df tempest-AggregatesAdminNegativeTestJSON-1426247531 tempest-AggregatesAdminNegativeTestJSON-1426247531-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.039273 Sep 16 12:46:05.014498 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 126/274] 10.222.0.67 () {58 vars in 1155 bytes} [Fri Sep 16 12:46:04 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 16 12:46:05.024921 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-83c6ed63-265e-4b0c-a9d6-192887455817 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1598059650"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:05.029684 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.aggregate [None req-83c6ed63-265e-4b0c-a9d6-192887455817 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Generated uuid 59ad66ac-8871-49fd-b365-2e7f7fc467cd for aggregate {{(pid=128780) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 16 12:46:05.072632 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-83c6ed63-265e-4b0c-a9d6-192887455817 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.056240 Sep 16 12:46:05.081566 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 127/275] 10.222.0.67 () {60 vars in 1164 bytes} [Fri Sep 16 12:46:05 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:05.091027 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d55201c6-6453-430f-9412-abbd76117849 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:05.105246 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d55201c6-6453-430f-9412-abbd76117849 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: dab4fa5f-1804-403e-9387-5c12685ddfb3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:05.121339 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d55201c6-6453-430f-9412-abbd76117849 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:05.122625 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d55201c6-6453-430f-9412-abbd76117849 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:05.123634 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d55201c6-6453-430f-9412-abbd76117849 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:05.125641 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d55201c6-6453-430f-9412-abbd76117849 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:05.126408 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d55201c6-6453-430f-9412-abbd76117849 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:05.127065 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d55201c6-6453-430f-9412-abbd76117849 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:05.336707 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5bd81a33-3f6c-4684-8c45-7458c8113350 tempest-SecurityGroupsTestAdminJSON-127425830 tempest-SecurityGroupsTestAdminJSON-127425830-project-admin] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.238987 Sep 16 12:46:05.337285 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 149/276] 10.222.0.67 () {60 vars in 1180 bytes} [Fri Sep 16 12:46:04 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:05.342175 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-502e681f-8f07-49c3-9767-4cc51f80d3ad tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:05.342778 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-502e681f-8f07-49c3-9767-4cc51f80d3ad tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: 4d860eb6-336f-4ba4-be81-d1ec6fecc87b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:05.607243 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-502e681f-8f07-49c3-9767-4cc51f80d3ad tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0815c12c4340109ec1c379a0602322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20770fd1243d4412bfc90d2a079473bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:05.623471 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-502e681f-8f07-49c3-9767-4cc51f80d3ad tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b" status: 200 len: 1221 microversion: 2.1 time: 0.284875 Sep 16 12:46:05.624464 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 150/277] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:05 2022] GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b => generated 1221 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:05.629595 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-60917812-f6e4-4c49-9c6c-9736c9dbda25 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:05.649345 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-60917812-f6e4-4c49-9c6c-9736c9dbda25 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 228 microversion: 2.1 time: 0.023801 Sep 16 12:46:05.650369 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 151/278] 10.222.0.67 () {58 vars in 1152 bytes} [Fri Sep 16 12:46:05 2022] GET /compute/v2.1/os-aggregates/16 => generated 228 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:05.666296 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dab75e09-8afa-4bd3-99fb-96be65a6d55d tempest-SecurityGroupsTestAdminJSON-127425830 tempest-SecurityGroupsTestAdminJSON-127425830-project-admin] Action: 'create', calling method: .version_select at 0x7f103624a280>, body: {"security_group": {"name": "tempest-securitygroup-1833989171", "description": "tempest-description-531191321"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:06.215238 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d55201c6-6453-430f-9412-abbd76117849 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da877221336e4e58859c207fca5e857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b6b2ef87ef4629941a0cc9942d7e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:06.235471 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d55201c6-6453-430f-9412-abbd76117849 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3" status: 200 len: 1320 microversion: 2.1 time: 1.152416 Sep 16 12:46:06.236065 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 128/279] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:05 2022] GET /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3 => generated 1320 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:06.260140 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fce1519c-b449-4b1e-b39f-616bb89bf2ca tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:06.313738 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-fce1519c-b449-4b1e-b39f-616bb89bf2ca tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 266 microversion: 2.1 time: 0.057705 Sep 16 12:46:06.317909 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 129/280] 10.222.0.67 () {60 vars in 1194 bytes} [Fri Sep 16 12:46:06 2022] POST /compute/v2.1/os-aggregates/16/action => generated 266 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:06.329241 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7e6dac85-f240-4529-95c2-e5ec7f16d614 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:06.343305 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7e6dac85-f240-4529-95c2-e5ec7f16d614 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 242 microversion: 2.1 time: 0.017671 Sep 16 12:46:06.350975 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 130/281] 10.222.0.67 () {58 vars in 1152 bytes} [Fri Sep 16 12:46:06 2022] GET /compute/v2.1/os-aggregates/16 => generated 242 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:06.365308 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8b9cb876-9e04-4443-af94-ec6a60426bb1 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:06.413592 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8b9cb876-9e04-4443-af94-ec6a60426bb1 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.051419 Sep 16 12:46:06.414509 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 131/282] 10.222.0.67 () {58 vars in 1155 bytes} [Fri Sep 16 12:46:06 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 16 12:46:06.430836 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e21eb50d-f433-489f-bff4-a29dc1721c17 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-404598422", "availability_zone": "tempest-test_az-536373121"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:06.442662 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.aggregate [None req-e21eb50d-f433-489f-bff4-a29dc1721c17 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Generated uuid b3b5d9f0-eb98-4030-8bd5-c309be41dfec for aggregate {{(pid=128780) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 16 12:46:06.500360 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dab75e09-8afa-4bd3-99fb-96be65a6d55d tempest-SecurityGroupsTestAdminJSON-127425830 tempest-SecurityGroupsTestAdminJSON-127425830-project-admin] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.848872 Sep 16 12:46:06.500953 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 152/283] 10.222.0.67 () {60 vars in 1180 bytes} [Fri Sep 16 12:46:05 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:06.517735 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-17043ef8-a357-4ac8-b588-668bcdb9c12e tempest-SecurityGroupsTestAdminJSON-127425830 tempest-SecurityGroupsTestAdminJSON-127425830-project-admin] Calling method '.version_select at 0x7f103624aa60>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:06.523323 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e21eb50d-f433-489f-bff4-a29dc1721c17 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.099151 Sep 16 12:46:06.530396 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 132/284] 10.222.0.67 () {60 vars in 1165 bytes} [Fri Sep 16 12:46:06 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:06.537100 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b88afb12-efc3-4085-9dc9-930b024d6527 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-404598422_new", "availability_zone": "tempest-test_az-536373121_new"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:06.622284 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b88afb12-efc3-4085-9dc9-930b024d6527 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:06.622817 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b88afb12-efc3-4085-9dc9-930b024d6527 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:06.623267 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b88afb12-efc3-4085-9dc9-930b024d6527 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:06.681529 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b88afb12-efc3-4085-9dc9-930b024d6527 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 334 microversion: 2.1 time: 0.148685 Sep 16 12:46:06.682638 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 133/285] 10.222.0.67 () {60 vars in 1173 bytes} [Fri Sep 16 12:46:06 2022] PUT /compute/v2.1/os-aggregates/17 => generated 334 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:46:06.692656 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-62b8f01b-d35f-46c2-a0e9-1352b1456bae tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:06.702543 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-62b8f01b-d35f-46c2-a0e9-1352b1456bae tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: 4d860eb6-336f-4ba4-be81-d1ec6fecc87b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:06.721729 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62b8f01b-d35f-46c2-a0e9-1352b1456bae tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:06.726953 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62b8f01b-d35f-46c2-a0e9-1352b1456bae tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:06.728490 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62b8f01b-d35f-46c2-a0e9-1352b1456bae tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:06.734275 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62b8f01b-d35f-46c2-a0e9-1352b1456bae tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:06.735339 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62b8f01b-d35f-46c2-a0e9-1352b1456bae tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:06.739381 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62b8f01b-d35f-46c2-a0e9-1352b1456bae tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:06.999362 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-62b8f01b-d35f-46c2-a0e9-1352b1456bae tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0815c12c4340109ec1c379a0602322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20770fd1243d4412bfc90d2a079473bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:07.025787 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-62b8f01b-d35f-46c2-a0e9-1352b1456bae tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b" status: 200 len: 1273 microversion: 2.1 time: 0.339925 Sep 16 12:46:07.026422 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 134/286] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:06 2022] GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b => generated 1273 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:07.044116 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-10a53f68-00c8-4cc5-8cde-68c3fe67acb8 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:07.065846 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-10a53f68-00c8-4cc5-8cde-68c3fe67acb8 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "GET /compute/v2.1/os-aggregates" status: 200 len: 337 microversion: 2.1 time: 0.036157 Sep 16 12:46:07.075618 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 135/287] 10.222.0.67 () {58 vars in 1143 bytes} [Fri Sep 16 12:46:07 2022] GET /compute/v2.1/os-aggregates => generated 337 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:07.081949 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d0c14dae-4d8d-470e-96f5-40467514c450 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:07.136862 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d0c14dae-4d8d-470e-96f5-40467514c450 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.058500 Sep 16 12:46:07.137476 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 136/288] 10.222.0.67 () {58 vars in 1155 bytes} [Fri Sep 16 12:46:07 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 16 12:46:07.147623 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-599218ce-ab8b-4882-afbb-5123bac1701e tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-951451866"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:07.153900 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.aggregate [None req-599218ce-ab8b-4882-afbb-5123bac1701e tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Generated uuid e51a6de8-d1c1-4e4c-8599-eb2bdee031c9 for aggregate {{(pid=128780) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 16 12:46:07.209039 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-599218ce-ab8b-4882-afbb-5123bac1701e tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.065750 Sep 16 12:46:07.209837 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 137/289] 10.222.0.67 () {60 vars in 1164 bytes} [Fri Sep 16 12:46:07 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:07.222735 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f42cf9a5-17dd-4707-922c-f8658dbc12d8 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:07.236073 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f42cf9a5-17dd-4707-922c-f8658dbc12d8 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.018437 Sep 16 12:46:07.236812 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 138/290] 10.222.0.67 () {58 vars in 1143 bytes} [Fri Sep 16 12:46:07 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:46:07.251841 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-52a977a5-660a-4d26-9bb2-a2288f67f2c1 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:07.290289 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-52a977a5-660a-4d26-9bb2-a2288f67f2c1 tempest-AggregatesAdminTestJSON-1770599592 tempest-AggregatesAdminTestJSON-1770599592-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.042374 Sep 16 12:46:07.291858 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 139/291] 10.222.0.67 () {58 vars in 1155 bytes} [Fri Sep 16 12:46:07 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 16 12:46:07.302789 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-967a881d-d2a4-4ff3-aad9-5cbdc067c26f tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:07.304447 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-967a881d-d2a4-4ff3-aad9-5cbdc067c26f tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: dab4fa5f-1804-403e-9387-5c12685ddfb3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:07.314438 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-967a881d-d2a4-4ff3-aad9-5cbdc067c26f tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:07.315034 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-967a881d-d2a4-4ff3-aad9-5cbdc067c26f tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:07.315801 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-967a881d-d2a4-4ff3-aad9-5cbdc067c26f tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:07.318522 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-967a881d-d2a4-4ff3-aad9-5cbdc067c26f tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:07.319820 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-967a881d-d2a4-4ff3-aad9-5cbdc067c26f tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:07.320302 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-967a881d-d2a4-4ff3-aad9-5cbdc067c26f tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:07.797388 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-967a881d-d2a4-4ff3-aad9-5cbdc067c26f tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da877221336e4e58859c207fca5e857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b6b2ef87ef4629941a0cc9942d7e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:07.822283 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-967a881d-d2a4-4ff3-aad9-5cbdc067c26f tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3" status: 200 len: 1320 microversion: 2.1 time: 0.523700 Sep 16 12:46:07.833835 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 140/292] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:07 2022] GET /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3 => generated 1320 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:07.841128 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ff94d147-3e26-451b-a5fd-51d4a35a1f98 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:07.841724 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ff94d147-3e26-451b-a5fd-51d4a35a1f98 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] [instance: cafdd5ab-69fa-40fc-a555-8a2668f40e5e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:07.858521 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ff94d147-3e26-451b-a5fd-51d4a35a1f98 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:07.859469 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ff94d147-3e26-451b-a5fd-51d4a35a1f98 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:07.860048 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ff94d147-3e26-451b-a5fd-51d4a35a1f98 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:07.861949 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ff94d147-3e26-451b-a5fd-51d4a35a1f98 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:07.863720 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ff94d147-3e26-451b-a5fd-51d4a35a1f98 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:07.866699 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ff94d147-3e26-451b-a5fd-51d4a35a1f98 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:07.926529 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-ff94d147-3e26-451b-a5fd-51d4a35a1f98 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] HTTP exception thrown: Instance cafdd5ab-69fa-40fc-a555-8a2668f40e5e could not be found. Sep 16 12:46:07.935176 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ff94d147-3e26-451b-a5fd-51d4a35a1f98 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Request method failure captured: Sep 16 12:46:07.935176 n-d-858094-4 devstack@n-api.service[128780]: request: DELETE /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e HTTP/1.1 Sep 16 12:46:07.935176 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:46:07.935176 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:46:07.935176 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:46:07.935176 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:46:07.935176 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:46:07.935176 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:46:07.935176 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:46:07.935176 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:46:07.935176 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJG_buGoNxpW3pPhuKaKhwxvg-gl3wF73BIRt59K5_a11vxuUY6ehTHOzAXyXvjkP16A5G9cpbI18-nIDMZtHffPc1xg_seGOTgOdOnuWyBO2QzhYVlQ9yKAQo5J820PWot4jmNR98U3iff1Q2Jp3YXwTy0UybMl2nNfI0xrSnN--Www Sep 16 12:46:07.935176 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:46:07.935176 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:46:07.935176 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:46:07.935176 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:46:07.935176 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:46:07.935176 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:46:07.935176 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 065037c7cf1d4b0d8d12253372a605b0 Sep 16 12:46:07.935176 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-AggregatesAdminTestJSON-1773349254 Sep 16 12:46:07.935176 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:46:07.935176 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:46:07.936709 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/065037c7cf1d4b0d8d12253372a605b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/065037c7cf1d4b0d8d12253372a605b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_065037c7cf1d4b0d8d12253372a605b0", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/065037c7cf1d4b0d8d12253372a605b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:46:07.936709 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-AggregatesAdminTestJSON-1773349254 Sep 16 12:46:07.936709 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 065037c7cf1d4b0d8d12253372a605b0 Sep 16 12:46:07.936709 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1773349254 Sep 16 12:46:07.936709 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-AggregatesAdminTestJSON-1773349254-project Sep 16 12:46:07.936709 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:46:07.936709 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:46:07.936709 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 3cbe3a24b2f6451ca174d708962e49ff Sep 16 12:46:07.936709 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-AggregatesAdminTestJSON-1773349254-project Sep 16 12:46:07.936709 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:46:07.936709 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance cafdd5ab-69fa-40fc-a555-8a2668f40e5e could not be found. Sep 16 12:46:07.936709 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'cafdd5ab-69fa-40fc-a555-8a2668f40e5e'} Sep 16 12:46:07.937482 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:46:07.937482 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:07.937482 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:46:07.937482 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:46:07.937482 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:46:07.937482 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:46:07.937482 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:46:07.937482 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:46:07.937482 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:46:07.937482 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:46:07.937482 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cafdd5ab-69fa-40fc-a555-8a2668f40e5e could not be found. Sep 16 12:46:07.937482 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:07.937482 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:07.937482 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:07.937482 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:07.937482 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:07.937482 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:07.937482 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:46:07.937482 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:46:07.937482 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:46:07.938854 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:46:07.938854 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 12:46:07.938854 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 12:46:07.938854 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 12:46:07.938854 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 12:46:07.938854 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:46:07.938854 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:46:07.938854 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:46:07.938854 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:46:07.938854 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cafdd5ab-69fa-40fc-a555-8a2668f40e5e could not be found. Sep 16 12:46:07.938854 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:07.938854 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:07.938854 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:07.938854 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:07.938854 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:07.938854 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:07.938854 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:46:07.938854 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:46:07.938854 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cafdd5ab-69fa-40fc-a555-8a2668f40e5e could not be found. Sep 16 12:46:07.938854 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:07.949220 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ff94d147-3e26-451b-a5fd-51d4a35a1f98 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Returning 404 to user: Instance cafdd5ab-69fa-40fc-a555-8a2668f40e5e could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:46:07.950231 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ff94d147-3e26-451b-a5fd-51d4a35a1f98 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] 10.222.0.67 "DELETE /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e" status: 404 len: 111 microversion: 2.1 time: 0.113697 Sep 16 12:46:07.951199 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 141/293] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:46:07 2022] DELETE /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:46:07.960034 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-19ea9b44-cc4d-4150-bbdc-2291f4f0deb8 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:07.960826 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-19ea9b44-cc4d-4150-bbdc-2291f4f0deb8 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] [instance: cafdd5ab-69fa-40fc-a555-8a2668f40e5e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:07.977036 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19ea9b44-cc4d-4150-bbdc-2291f4f0deb8 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:07.977457 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19ea9b44-cc4d-4150-bbdc-2291f4f0deb8 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:07.977898 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19ea9b44-cc4d-4150-bbdc-2291f4f0deb8 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:07.981560 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19ea9b44-cc4d-4150-bbdc-2291f4f0deb8 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:07.984841 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19ea9b44-cc4d-4150-bbdc-2291f4f0deb8 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:07.985528 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19ea9b44-cc4d-4150-bbdc-2291f4f0deb8 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:08.019344 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-19ea9b44-cc4d-4150-bbdc-2291f4f0deb8 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] HTTP exception thrown: Instance cafdd5ab-69fa-40fc-a555-8a2668f40e5e could not be found. Sep 16 12:46:08.021149 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-19ea9b44-cc4d-4150-bbdc-2291f4f0deb8 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Request method failure captured: Sep 16 12:46:08.021149 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e HTTP/1.1 Sep 16 12:46:08.021149 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:46:08.021149 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:46:08.021149 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:46:08.021149 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:46:08.021149 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:46:08.021149 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:46:08.021149 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:46:08.021149 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:46:08.021149 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJG_buGoNxpW3pPhuKaKhwxvg-gl3wF73BIRt59K5_a11vxuUY6ehTHOzAXyXvjkP16A5G9cpbI18-nIDMZtHffPc1xg_seGOTgOdOnuWyBO2QzhYVlQ9yKAQo5J820PWot4jmNR98U3iff1Q2Jp3YXwTy0UybMl2nNfI0xrSnN--Www Sep 16 12:46:08.021149 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:46:08.021149 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:46:08.021149 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:46:08.021149 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:46:08.021149 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:46:08.021149 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:46:08.021149 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 065037c7cf1d4b0d8d12253372a605b0 Sep 16 12:46:08.021149 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-AggregatesAdminTestJSON-1773349254 Sep 16 12:46:08.021149 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:46:08.021149 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:46:08.023002 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/065037c7cf1d4b0d8d12253372a605b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/065037c7cf1d4b0d8d12253372a605b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_065037c7cf1d4b0d8d12253372a605b0", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/065037c7cf1d4b0d8d12253372a605b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:46:08.023002 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-AggregatesAdminTestJSON-1773349254 Sep 16 12:46:08.023002 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 065037c7cf1d4b0d8d12253372a605b0 Sep 16 12:46:08.023002 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1773349254 Sep 16 12:46:08.023002 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-AggregatesAdminTestJSON-1773349254-project Sep 16 12:46:08.023002 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:46:08.023002 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:46:08.023002 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 3cbe3a24b2f6451ca174d708962e49ff Sep 16 12:46:08.023002 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-AggregatesAdminTestJSON-1773349254-project Sep 16 12:46:08.023002 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:46:08.023002 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance cafdd5ab-69fa-40fc-a555-8a2668f40e5e could not be found. Sep 16 12:46:08.023002 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'cafdd5ab-69fa-40fc-a555-8a2668f40e5e'} Sep 16 12:46:08.023655 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:46:08.023655 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:08.023655 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:46:08.023655 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:46:08.023655 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:46:08.023655 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:46:08.023655 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:46:08.023655 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:46:08.023655 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:46:08.023655 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:46:08.023655 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cafdd5ab-69fa-40fc-a555-8a2668f40e5e could not be found. Sep 16 12:46:08.023655 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:08.023655 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:08.023655 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:08.023655 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:08.023655 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:08.023655 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:08.023655 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:46:08.023655 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:46:08.023655 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:46:08.024743 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:46:08.024743 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:46:08.024743 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:46:08.024743 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:46:08.024743 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:46:08.024743 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:46:08.024743 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:46:08.024743 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cafdd5ab-69fa-40fc-a555-8a2668f40e5e could not be found. Sep 16 12:46:08.024743 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:08.024743 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:08.024743 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:08.024743 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:08.024743 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:08.024743 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:08.024743 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:46:08.024743 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:46:08.024743 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cafdd5ab-69fa-40fc-a555-8a2668f40e5e could not be found. Sep 16 12:46:08.024743 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:08.027472 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-19ea9b44-cc4d-4150-bbdc-2291f4f0deb8 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] Returning 404 to user: Instance cafdd5ab-69fa-40fc-a555-8a2668f40e5e could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:46:08.028740 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-19ea9b44-cc4d-4150-bbdc-2291f4f0deb8 tempest-AggregatesAdminTestJSON-1773349254 tempest-AggregatesAdminTestJSON-1773349254-project] 10.222.0.67 "GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e" status: 404 len: 111 microversion: 2.1 time: 0.073528 Sep 16 12:46:08.040154 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 142/294] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:07 2022] GET /compute/v2.1/servers/cafdd5ab-69fa-40fc-a555-8a2668f40e5e => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 12:46:08.056431 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a00eae15-9f4b-4f2a-9378-ec8c57b643a2 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:08.058691 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a00eae15-9f4b-4f2a-9378-ec8c57b643a2 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: 4d860eb6-336f-4ba4-be81-d1ec6fecc87b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:08.078257 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a00eae15-9f4b-4f2a-9378-ec8c57b643a2 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:08.079319 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a00eae15-9f4b-4f2a-9378-ec8c57b643a2 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:08.080052 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a00eae15-9f4b-4f2a-9378-ec8c57b643a2 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:08.081048 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a00eae15-9f4b-4f2a-9378-ec8c57b643a2 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:08.081788 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a00eae15-9f4b-4f2a-9378-ec8c57b643a2 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:08.082430 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a00eae15-9f4b-4f2a-9378-ec8c57b643a2 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:08.394993 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a00eae15-9f4b-4f2a-9378-ec8c57b643a2 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0815c12c4340109ec1c379a0602322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20770fd1243d4412bfc90d2a079473bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:08.417988 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a00eae15-9f4b-4f2a-9378-ec8c57b643a2 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b" status: 200 len: 1279 microversion: 2.1 time: 0.366157 Sep 16 12:46:08.419195 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 143/295] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:08 2022] GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b => generated 1279 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:09.317202 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d5b23a66-bd12-486a-acf3-25fc313841ee tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] Calling method '.version_select at 0x7f1036134ca0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:09.320710 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d5b23a66-bd12-486a-acf3-25fc313841ee tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:09.322634 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d5b23a66-bd12-486a-acf3-25fc313841ee tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:09.323503 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d5b23a66-bd12-486a-acf3-25fc313841ee tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:09.355980 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d5b23a66-bd12-486a-acf3-25fc313841ee tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:09.356797 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d5b23a66-bd12-486a-acf3-25fc313841ee tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:09.388272 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d5b23a66-bd12-486a-acf3-25fc313841ee tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:09.427160 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d5b23a66-bd12-486a-acf3-25fc313841ee tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:09.427838 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d5b23a66-bd12-486a-acf3-25fc313841ee tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:09.428225 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d5b23a66-bd12-486a-acf3-25fc313841ee tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:09.466821 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d5b23a66-bd12-486a-acf3-25fc313841ee tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.046188 Sep 16 12:46:09.467421 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 144/296] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:46:08 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:09.791603 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-efebfe00-5de4-41c4-9da3-42060837e70a tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] Calling method '.version_select at 0x7f10361341f0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:09.795730 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-efebfe00-5de4-41c4-9da3-42060837e70a tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:09.798374 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-efebfe00-5de4-41c4-9da3-42060837e70a tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:09.799572 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-efebfe00-5de4-41c4-9da3-42060837e70a tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:09.802255 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-efebfe00-5de4-41c4-9da3-42060837e70a tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:09.803362 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-efebfe00-5de4-41c4-9da3-42060837e70a tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:09.803973 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-efebfe00-5de4-41c4-9da3-42060837e70a tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:09.832189 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=8,nova_api:DELETE=8,nova_api:UPDATE=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:46:09.844310 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-efebfe00-5de4-41c4-9da3-42060837e70a tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.369047 Sep 16 12:46:09.845137 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 145/297] 10.222.0.67 () {58 vars in 1128 bytes} [Fri Sep 16 12:46:09 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:09.852754 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e0199cbc-a5c2-49e3-bf35-e751a77c77c9 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:09.853810 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e0199cbc-a5c2-49e3-bf35-e751a77c77c9 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: dab4fa5f-1804-403e-9387-5c12685ddfb3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:09.862464 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e0199cbc-a5c2-49e3-bf35-e751a77c77c9 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:09.863338 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e0199cbc-a5c2-49e3-bf35-e751a77c77c9 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:09.864053 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e0199cbc-a5c2-49e3-bf35-e751a77c77c9 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:09.869358 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e0199cbc-a5c2-49e3-bf35-e751a77c77c9 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:09.870076 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e0199cbc-a5c2-49e3-bf35-e751a77c77c9 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:09.870626 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e0199cbc-a5c2-49e3-bf35-e751a77c77c9 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:10.102648 n-d-858094-4 devstack@n-api.service[128779]: DEBUG neutronclient.v2_0.client [None req-17043ef8-a357-4ac8-b588-668bcdb9c12e tempest-SecurityGroupsTestAdminJSON-127425830 tempest-SecurityGroupsTestAdminJSON-127425830-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ab3bd97c-b33e-476f-8e64-772aa29f1305 does not exist", "detail": ""}} {{(pid=128779) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 12:46:10.103390 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.security_group_api [None req-17043ef8-a357-4ac8-b588-668bcdb9c12e tempest-SecurityGroupsTestAdminJSON-127425830 tempest-SecurityGroupsTestAdminJSON-127425830-project-admin] Neutron security group ab3bd97c-b33e-476f-8e64-772aa29f1305 not found {{(pid=128779) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 16 12:46:10.104526 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.compute.security_groups [None req-17043ef8-a357-4ac8-b588-668bcdb9c12e tempest-SecurityGroupsTestAdminJSON-127425830 tempest-SecurityGroupsTestAdminJSON-127425830-project-admin] Security Group ID ab3bd97c-b33e-476f-8e64-772aa29f1305 does not exist {{(pid=128779) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Sep 16 12:46:10.169582 n-d-858094-4 devstack@n-api.service[128779]: DEBUG neutronclient.v2_0.client [None req-17043ef8-a357-4ac8-b588-668bcdb9c12e tempest-SecurityGroupsTestAdminJSON-127425830 tempest-SecurityGroupsTestAdminJSON-127425830-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ab3bd97c-b33e-476f-8e64-772aa29f1305 does not exist", "detail": ""}} {{(pid=128779) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 12:46:10.170731 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.security_group_api [None req-17043ef8-a357-4ac8-b588-668bcdb9c12e tempest-SecurityGroupsTestAdminJSON-127425830 tempest-SecurityGroupsTestAdminJSON-127425830-project-admin] Neutron security group ab3bd97c-b33e-476f-8e64-772aa29f1305 not found {{(pid=128779) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 16 12:46:10.171468 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.compute.security_groups [None req-17043ef8-a357-4ac8-b588-668bcdb9c12e tempest-SecurityGroupsTestAdminJSON-127425830 tempest-SecurityGroupsTestAdminJSON-127425830-project-admin] Security Group ID ab3bd97c-b33e-476f-8e64-772aa29f1305 does not exist {{(pid=128779) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Sep 16 12:46:10.447453 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e0199cbc-a5c2-49e3-bf35-e751a77c77c9 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da877221336e4e58859c207fca5e857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b6b2ef87ef4629941a0cc9942d7e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:10.461189 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e0199cbc-a5c2-49e3-bf35-e751a77c77c9 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3" status: 200 len: 1320 microversion: 2.1 time: 0.614409 Sep 16 12:46:10.464859 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 146/298] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:09 2022] GET /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3 => generated 1320 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:10.480257 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b40b8f5a-1215-40d0-b2c6-6a8fb86fe901 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:10.480854 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b40b8f5a-1215-40d0-b2c6-6a8fb86fe901 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: 4d860eb6-336f-4ba4-be81-d1ec6fecc87b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:10.507081 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b40b8f5a-1215-40d0-b2c6-6a8fb86fe901 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:10.507709 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b40b8f5a-1215-40d0-b2c6-6a8fb86fe901 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:10.508991 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b40b8f5a-1215-40d0-b2c6-6a8fb86fe901 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:10.510979 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b40b8f5a-1215-40d0-b2c6-6a8fb86fe901 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:10.512062 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b40b8f5a-1215-40d0-b2c6-6a8fb86fe901 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:10.515057 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b40b8f5a-1215-40d0-b2c6-6a8fb86fe901 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:10.869127 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-b40b8f5a-1215-40d0-b2c6-6a8fb86fe901 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0815c12c4340109ec1c379a0602322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20770fd1243d4412bfc90d2a079473bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:10.878484 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b40b8f5a-1215-40d0-b2c6-6a8fb86fe901 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b" status: 200 len: 1321 microversion: 2.1 time: 0.410442 Sep 16 12:46:10.888885 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 147/299] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:10 2022] GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b => generated 1321 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:10.894537 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4f05cebd-240c-42a9-a5e1-6894cb0786f4 tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] Calling method '.version_select at 0x7f1036376940>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:10.896382 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4f05cebd-240c-42a9-a5e1-6894cb0786f4 tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:10.899050 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4f05cebd-240c-42a9-a5e1-6894cb0786f4 tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:10.899487 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4f05cebd-240c-42a9-a5e1-6894cb0786f4 tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:10.903007 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=100 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:46:10.931725 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4f05cebd-240c-42a9-a5e1-6894cb0786f4 tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:10.934166 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4f05cebd-240c-42a9-a5e1-6894cb0786f4 tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:10.934869 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4f05cebd-240c-42a9-a5e1-6894cb0786f4 tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:11.000403 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4f05cebd-240c-42a9-a5e1-6894cb0786f4 tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:11.003996 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4f05cebd-240c-42a9-a5e1-6894cb0786f4 tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:11.004767 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4f05cebd-240c-42a9-a5e1-6894cb0786f4 tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:11.015103 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4f05cebd-240c-42a9-a5e1-6894cb0786f4 tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/n-h2-858094-4/servers" status: 200 len: 196 microversion: 2.1 time: 0.122249 Sep 16 12:46:11.026318 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 148/300] 10.222.0.67 () {58 vars in 1212 bytes} [Fri Sep 16 12:46:10 2022] GET /compute/v2.1/os-hypervisors/n-h2-858094-4/servers => generated 196 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:11.166002 n-d-858094-4 devstack@n-api.service[128779]: DEBUG neutronclient.v2_0.client [None req-17043ef8-a357-4ac8-b588-668bcdb9c12e tempest-SecurityGroupsTestAdminJSON-127425830 tempest-SecurityGroupsTestAdminJSON-127425830-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e522b84e-5b4f-44f9-aede-b56d6280ea0c does not exist", "detail": ""}} {{(pid=128779) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 12:46:11.166549 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.security_group_api [None req-17043ef8-a357-4ac8-b588-668bcdb9c12e tempest-SecurityGroupsTestAdminJSON-127425830 tempest-SecurityGroupsTestAdminJSON-127425830-project-admin] Neutron security group e522b84e-5b4f-44f9-aede-b56d6280ea0c not found {{(pid=128779) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 16 12:46:11.166694 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.compute.security_groups [None req-17043ef8-a357-4ac8-b588-668bcdb9c12e tempest-SecurityGroupsTestAdminJSON-127425830 tempest-SecurityGroupsTestAdminJSON-127425830-project-admin] Security Group ID e522b84e-5b4f-44f9-aede-b56d6280ea0c does not exist {{(pid=128779) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Sep 16 12:46:11.233738 n-d-858094-4 devstack@n-api.service[128779]: DEBUG neutronclient.v2_0.client [None req-17043ef8-a357-4ac8-b588-668bcdb9c12e tempest-SecurityGroupsTestAdminJSON-127425830 tempest-SecurityGroupsTestAdminJSON-127425830-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e522b84e-5b4f-44f9-aede-b56d6280ea0c does not exist", "detail": ""}} {{(pid=128779) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 12:46:11.234976 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.security_group_api [None req-17043ef8-a357-4ac8-b588-668bcdb9c12e tempest-SecurityGroupsTestAdminJSON-127425830 tempest-SecurityGroupsTestAdminJSON-127425830-project-admin] Neutron security group e522b84e-5b4f-44f9-aede-b56d6280ea0c not found {{(pid=128779) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 16 12:46:11.236142 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.compute.security_groups [None req-17043ef8-a357-4ac8-b588-668bcdb9c12e tempest-SecurityGroupsTestAdminJSON-127425830 tempest-SecurityGroupsTestAdminJSON-127425830-project-admin] Security Group ID e522b84e-5b4f-44f9-aede-b56d6280ea0c does not exist {{(pid=128779) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Sep 16 12:46:11.441208 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-17043ef8-a357-4ac8-b588-668bcdb9c12e tempest-SecurityGroupsTestAdminJSON-127425830 tempest-SecurityGroupsTestAdminJSON-127425830-project-admin] 10.222.0.67 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 7343 microversion: 2.1 time: 4.929648 Sep 16 12:46:11.442547 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 153/301] 10.222.0.67 () {58 vars in 1191 bytes} [Fri Sep 16 12:46:06 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 7343 bytes in 4932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:11.460908 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-c72ab9d7-1e7a-4a4d-8886-37b52b98ab89 req-c37132c3-0bc8-475b-9f5f-bb9541c99db9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dab4fa5f-1804-403e-9387-5c12685ddfb3", "name": "network-vif-plugged", "status": "completed", "tag": "5b604c8c-012f-4e9f-a5b7-54d52a817f1a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:11.477556 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c72ab9d7-1e7a-4a4d-8886-37b52b98ab89 req-c37132c3-0bc8-475b-9f5f-bb9541c99db9 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:11.478229 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c72ab9d7-1e7a-4a4d-8886-37b52b98ab89 req-c37132c3-0bc8-475b-9f5f-bb9541c99db9 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:11.478871 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c72ab9d7-1e7a-4a4d-8886-37b52b98ab89 req-c37132c3-0bc8-475b-9f5f-bb9541c99db9 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:11.516212 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-aa5b29c2-2904-432b-8e4c-a9fe84260778 tempest-HostsAdminNegativeTestJSON-1967769077 tempest-HostsAdminNegativeTestJSON-1967769077-project] Calling method '.version_select at 0x7f1036129c10>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:11.525123 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-aa5b29c2-2904-432b-8e4c-a9fe84260778 tempest-HostsAdminNegativeTestJSON-1967769077 tempest-HostsAdminNegativeTestJSON-1967769077-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '496b7f883b514178bb87b7b446f5287e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27610d4e76b144eba55bcbff93aeac26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:11.529340 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-aa5b29c2-2904-432b-8e4c-a9fe84260778 tempest-HostsAdminNegativeTestJSON-1967769077 tempest-HostsAdminNegativeTestJSON-1967769077-project] Request method failure captured: Sep 16 12:46:11.529340 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Sep 16 12:46:11.529340 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:46:11.529340 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:46:11.529340 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:46:11.529340 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:46:11.529340 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:46:11.529340 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:46:11.529340 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:46:11.529340 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:46:11.529340 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHANeswtMKIf9a2uvm6uxorvPQjv_L7g61rtbT9neyWNZpOpIpp4jpB2Zbus-Ztq8O4AXdQVlnYFw4DjkWLuI4xZdYU9_GzOr6ovgUyM6RtBg5Xvb2prrFRG_TFQxSq5hc9Mc6l3HOtg756SrzEJ-nDVzL-XWz9D1FEV1kXfzMyuTpY Sep 16 12:46:11.529340 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:46:11.529340 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:46:11.529340 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:46:11.529340 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:46:11.529340 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:46:11.529340 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:46:11.529340 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 27610d4e76b144eba55bcbff93aeac26 Sep 16 12:46:11.529340 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1967769077 Sep 16 12:46:11.529340 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:46:11.529340 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:46:11.530723 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/27610d4e76b144eba55bcbff93aeac26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/27610d4e76b144eba55bcbff93aeac26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_27610d4e76b144eba55bcbff93aeac26", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/27610d4e76b144eba55bcbff93aeac26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:46:11.530723 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1967769077 Sep 16 12:46:11.530723 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 27610d4e76b144eba55bcbff93aeac26 Sep 16 12:46:11.530723 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1967769077 Sep 16 12:46:11.530723 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-HostsAdminNegativeTestJSON-1967769077-project Sep 16 12:46:11.530723 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:46:11.530723 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:46:11.530723 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 496b7f883b514178bb87b7b446f5287e Sep 16 12:46:11.530723 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1967769077-project Sep 16 12:46:11.530723 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 12:46:11.530723 n-d-858094-4 devstack@n-api.service[128780]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 16 12:46:11.530723 n-d-858094-4 devstack@n-api.service[128780]: action_args: {} Sep 16 12:46:11.530723 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:46:11.531469 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:11.531469 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:11.531469 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:11.531469 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:46:11.531469 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:46:11.531469 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:46:11.531469 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:46:11.531469 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 12:46:11.531469 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:46:11.531469 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:46:11.531469 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:46:11.531469 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Sep 16 12:46:11.531469 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Sep 16 12:46:11.531469 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 12:46:11.531469 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 12:46:11.531469 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 12:46:11.531469 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 12:46:11.531469 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:46:11.531469 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:46:11.532717 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:46:11.532717 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:46:11.532717 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 12:46:11.532717 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 12:46:11.532717 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 12:46:11.532717 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 12:46:11.532717 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 12:46:11.532717 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 12:46:11.532717 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 16 12:46:11.532717 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:11.532717 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:11.532717 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:11.532717 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:11.532717 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:11.532717 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:11.532717 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 12:46:11.532717 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 12:46:11.532717 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 16 12:46:11.532717 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:11.533797 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-aa5b29c2-2904-432b-8e4c-a9fe84260778 tempest-HostsAdminNegativeTestJSON-1967769077 tempest-HostsAdminNegativeTestJSON-1967769077-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:46:11.533797 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-aa5b29c2-2904-432b-8e4c-a9fe84260778 tempest-HostsAdminNegativeTestJSON-1967769077 tempest-HostsAdminNegativeTestJSON-1967769077-project] 10.222.0.67 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.503458 Sep 16 12:46:11.533797 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 149/302] 10.222.0.67 () {58 vars in 1128 bytes} [Fri Sep 16 12:46:11 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 505 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:46:11.541217 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1b920dbf-9e47-4e61-b089-89db2d534509 tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] Calling method '.version_select at 0x7f103618d700>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:11.543233 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1b920dbf-9e47-4e61-b089-89db2d534509 tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:11.543839 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1b920dbf-9e47-4e61-b089-89db2d534509 tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:11.544482 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1b920dbf-9e47-4e61-b089-89db2d534509 tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:11.546864 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-c72ab9d7-1e7a-4a4d-8886-37b52b98ab89 req-c37132c3-0bc8-475b-9f5f-bb9541c99db9 service nova] Creating event network-vif-plugged:5b604c8c-012f-4e9f-a5b7-54d52a817f1a for instance dab4fa5f-1804-403e-9387-5c12685ddfb3 on n-h2-858094-4 Sep 16 12:46:11.588242 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-c72ab9d7-1e7a-4a4d-8886-37b52b98ab89 req-c37132c3-0bc8-475b-9f5f-bb9541c99db9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126932 Sep 16 12:46:11.589044 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 154/303] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:11.614718 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1b920dbf-9e47-4e61-b089-89db2d534509 tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:11.616191 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1b920dbf-9e47-4e61-b089-89db2d534509 tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:11.616815 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d5260fcb-161a-4e67-b213-afacede95e25 tempest-SecurityGroupsTestAdminJSON-2079169535 tempest-SecurityGroupsTestAdminJSON-2079169535-project] Calling method '.version_select at 0x7f103624a9d0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:11.621681 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1b920dbf-9e47-4e61-b089-89db2d534509 tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:11.679566 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1b920dbf-9e47-4e61-b089-89db2d534509 tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:11.681685 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1b920dbf-9e47-4e61-b089-89db2d534509 tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:11.683595 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1b920dbf-9e47-4e61-b089-89db2d534509 tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:11.694419 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1b920dbf-9e47-4e61-b089-89db2d534509 tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.160906 Sep 16 12:46:11.704212 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 150/304] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:46:11 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:11.714930 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c84eeb15-e3d1-44e7-b592-11fdc9e89b5e tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:11.715971 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c84eeb15-e3d1-44e7-b592-11fdc9e89b5e tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: dab4fa5f-1804-403e-9387-5c12685ddfb3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:11.734921 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c84eeb15-e3d1-44e7-b592-11fdc9e89b5e tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:11.734921 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c84eeb15-e3d1-44e7-b592-11fdc9e89b5e tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:11.736877 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c84eeb15-e3d1-44e7-b592-11fdc9e89b5e tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:11.739535 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c84eeb15-e3d1-44e7-b592-11fdc9e89b5e tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:11.741034 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c84eeb15-e3d1-44e7-b592-11fdc9e89b5e tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:11.743208 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c84eeb15-e3d1-44e7-b592-11fdc9e89b5e tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:12.050046 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d5260fcb-161a-4e67-b213-afacede95e25 tempest-SecurityGroupsTestAdminJSON-2079169535 tempest-SecurityGroupsTestAdminJSON-2079169535-project] 10.222.0.67 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.453888 Sep 16 12:46:12.058537 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 155/305] 10.222.0.67 () {58 vars in 1191 bytes} [Fri Sep 16 12:46:11 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:12.065470 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5b232602-1a8b-45d2-93be-e96643161323 tempest-HostsAdminNegativeTestJSON-1967769077 tempest-HostsAdminNegativeTestJSON-1967769077-project] Calling method '.version_select at 0x7f10361ec790>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:12.067255 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5b232602-1a8b-45d2-93be-e96643161323 tempest-HostsAdminNegativeTestJSON-1967769077 tempest-HostsAdminNegativeTestJSON-1967769077-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '496b7f883b514178bb87b7b446f5287e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27610d4e76b144eba55bcbff93aeac26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:12.072828 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5b232602-1a8b-45d2-93be-e96643161323 tempest-HostsAdminNegativeTestJSON-1967769077 tempest-HostsAdminNegativeTestJSON-1967769077-project] Request method failure captured: Sep 16 12:46:12.072828 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/os-hosts/n-d-858094-4/reboot HTTP/1.1 Sep 16 12:46:12.072828 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:46:12.072828 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:46:12.072828 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:46:12.072828 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:46:12.072828 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:46:12.072828 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:46:12.072828 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:46:12.072828 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:46:12.072828 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHANeswtMKIf9a2uvm6uxorvPQjv_L7g61rtbT9neyWNZpOpIpp4jpB2Zbus-Ztq8O4AXdQVlnYFw4DjkWLuI4xZdYU9_GzOr6ovgUyM6RtBg5Xvb2prrFRG_TFQxSq5hc9Mc6l3HOtg756SrzEJ-nDVzL-XWz9D1FEV1kXfzMyuTpY Sep 16 12:46:12.072828 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:46:12.072828 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:46:12.072828 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:46:12.072828 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:46:12.072828 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:46:12.072828 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:46:12.072828 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 27610d4e76b144eba55bcbff93aeac26 Sep 16 12:46:12.072828 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1967769077 Sep 16 12:46:12.072828 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:46:12.072828 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:46:12.074073 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/27610d4e76b144eba55bcbff93aeac26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/27610d4e76b144eba55bcbff93aeac26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_27610d4e76b144eba55bcbff93aeac26", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/27610d4e76b144eba55bcbff93aeac26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:46:12.074073 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1967769077 Sep 16 12:46:12.074073 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 27610d4e76b144eba55bcbff93aeac26 Sep 16 12:46:12.074073 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1967769077 Sep 16 12:46:12.074073 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-HostsAdminNegativeTestJSON-1967769077-project Sep 16 12:46:12.074073 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:46:12.074073 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:46:12.074073 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 496b7f883b514178bb87b7b446f5287e Sep 16 12:46:12.074073 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1967769077-project Sep 16 12:46:12.074073 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 12:46:12.074073 n-d-858094-4 devstack@n-api.service[128779]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 16 12:46:12.074073 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': 'n-d-858094-4'} Sep 16 12:46:12.074073 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:46:12.074791 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:12.074791 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:12.074791 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:12.074791 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:46:12.074791 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:46:12.074791 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:46:12.074791 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:46:12.074791 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:46:12.074791 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:46:12.074791 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Sep 16 12:46:12.074791 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Sep 16 12:46:12.074791 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 12:46:12.074791 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 12:46:12.074791 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 12:46:12.074791 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 12:46:12.074791 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:46:12.074791 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:46:12.074791 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:46:12.074791 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:46:12.076417 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 12:46:12.076417 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 12:46:12.076417 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 12:46:12.076417 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 12:46:12.076417 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 12:46:12.076417 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 12:46:12.076417 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 16 12:46:12.076417 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:12.076417 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:12.076417 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:12.076417 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:12.076417 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:12.076417 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:12.076417 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 12:46:12.076417 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 12:46:12.076417 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 16 12:46:12.076417 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:12.077360 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5b232602-1a8b-45d2-93be-e96643161323 tempest-HostsAdminNegativeTestJSON-1967769077 tempest-HostsAdminNegativeTestJSON-1967769077-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:46:12.077360 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5b232602-1a8b-45d2-93be-e96643161323 tempest-HostsAdminNegativeTestJSON-1967769077 tempest-HostsAdminNegativeTestJSON-1967769077-project] 10.222.0.67 "GET /compute/v2.1/os-hosts/n-d-858094-4/reboot" status: 403 len: 111 microversion: 2.1 time: 0.014675 Sep 16 12:46:12.079537 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 156/306] 10.222.0.67 () {58 vars in 1188 bytes} [Fri Sep 16 12:46:12 2022] GET /compute/v2.1/os-hosts/n-d-858094-4/reboot => generated 111 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:46:12.086648 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ecf85a51-6911-484b-8bd8-68af018f4e2e tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] Calling method '.version_select at 0x7f10361b29d0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:12.089387 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecf85a51-6911-484b-8bd8-68af018f4e2e tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:12.089876 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecf85a51-6911-484b-8bd8-68af018f4e2e tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:12.090312 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecf85a51-6911-484b-8bd8-68af018f4e2e tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:12.096729 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c84eeb15-e3d1-44e7-b592-11fdc9e89b5e tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da877221336e4e58859c207fca5e857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b6b2ef87ef4629941a0cc9942d7e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:12.108495 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c84eeb15-e3d1-44e7-b592-11fdc9e89b5e tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3" status: 200 len: 1320 microversion: 2.1 time: 0.407497 Sep 16 12:46:12.109251 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 151/307] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:11 2022] GET /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3 => generated 1320 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:12.124540 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecf85a51-6911-484b-8bd8-68af018f4e2e tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:12.125063 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecf85a51-6911-484b-8bd8-68af018f4e2e tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:12.125489 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecf85a51-6911-484b-8bd8-68af018f4e2e tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:12.137478 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5d43235f-d845-4e6a-9450-cb246580fe0d tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:12.138124 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5d43235f-d845-4e6a-9450-cb246580fe0d tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: 4d860eb6-336f-4ba4-be81-d1ec6fecc87b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:12.142784 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ecf85a51-6911-484b-8bd8-68af018f4e2e tempest-HypervisorAdminUnderV252Test-455534335 tempest-HypervisorAdminUnderV252Test-455534335-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/n-h2-858094-4/search" status: 200 len: 104 microversion: 2.1 time: 0.062068 Sep 16 12:46:12.143385 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 157/308] 10.222.0.67 () {58 vars in 1209 bytes} [Fri Sep 16 12:46:12 2022] GET /compute/v2.1/os-hypervisors/n-h2-858094-4/search => generated 104 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:12.151085 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cc76f83a-96a5-4380-acc3-dbe627f8b8ef tempest-SecurityGroupsTestAdminJSON-127425830 tempest-SecurityGroupsTestAdminJSON-127425830-project-admin] Calling method '.version_select at 0x7f10361ec820>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:12.158756 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5d43235f-d845-4e6a-9450-cb246580fe0d tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:12.159408 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5d43235f-d845-4e6a-9450-cb246580fe0d tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:12.159846 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5d43235f-d845-4e6a-9450-cb246580fe0d tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:12.160741 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5d43235f-d845-4e6a-9450-cb246580fe0d tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:12.161390 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5d43235f-d845-4e6a-9450-cb246580fe0d tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:12.161861 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5d43235f-d845-4e6a-9450-cb246580fe0d tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:12.596297 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cc76f83a-96a5-4380-acc3-dbe627f8b8ef tempest-SecurityGroupsTestAdminJSON-127425830 tempest-SecurityGroupsTestAdminJSON-127425830-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/5cb7b90f-6661-4822-a353-21c2957ec16b" status: 202 len: 0 microversion: 2.1 time: 0.447731 Sep 16 12:46:12.598301 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 158/309] 10.222.0.67 () {58 vars in 1272 bytes} [Fri Sep 16 12:46:12 2022] DELETE /compute/v2.1/os-security-groups/5cb7b90f-6661-4822-a353-21c2957ec16b => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:46:12.609142 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9be44847-7485-4b9b-834a-bde1e2c088c4 tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] Calling method '.version_select at 0x7f1036461c10>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:12.634315 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-9be44847-7485-4b9b-834a-bde1e2c088c4 tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 12:46:12.638150 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9be44847-7485-4b9b-834a-bde1e2c088c4 tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] Request method failure captured: Sep 16 12:46:12.638150 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Sep 16 12:46:12.638150 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:46:12.638150 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:46:12.638150 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:46:12.638150 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:46:12.638150 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:46:12.638150 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:46:12.638150 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:46:12.638150 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:46:12.638150 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHAQjQ1ufvqV2IlNdvcvNDljU5rlNmZqpxR25RmBwECUUMGmEkb2sNbvAPNkDnaFFgBcNhYPe0BfbSZoD5YutWn5xXNbcuVFX0NWY08XbM7iqKU_B4mGZZ1mrpvSqrF6OwbbrqVBgSAR82N0LDLLzEdSUOCwFbPrtVfU4pZjB4RQKRs Sep 16 12:46:12.638150 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:46:12.638150 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:46:12.638150 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:46:12.638150 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:46:12.638150 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:46:12.638150 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:46:12.638150 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: b1bb5e09dceb4c55b5692e001e63d1e2 Sep 16 12:46:12.638150 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-799532100 Sep 16 12:46:12.638150 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,admin,reader Sep 16 12:46:12.638150 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,admin,reader Sep 16 12:46:12.639624 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b1bb5e09dceb4c55b5692e001e63d1e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b1bb5e09dceb4c55b5692e001e63d1e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b1bb5e09dceb4c55b5692e001e63d1e2", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b1bb5e09dceb4c55b5692e001e63d1e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:46:12.639624 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-HostsAdminNegativeTestJSON-799532100 Sep 16 12:46:12.639624 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: b1bb5e09dceb4c55b5692e001e63d1e2 Sep 16 12:46:12.639624 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-799532100 Sep 16 12:46:12.639624 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-HostsAdminNegativeTestJSON-799532100-project-admin Sep 16 12:46:12.639624 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:46:12.639624 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:46:12.639624 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 90765ac4ba824e0fa32f2cf63aafb545 Sep 16 12:46:12.639624 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-HostsAdminNegativeTestJSON-799532100-project-admin Sep 16 12:46:12.639624 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 12:46:12.639624 n-d-858094-4 devstack@n-api.service[128779]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 12:46:12.639624 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': 'nonexistent_hostname'} Sep 16 12:46:12.639624 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:46:12.640602 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:12.640602 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 16 12:46:12.640602 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 16 12:46:12.640602 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 16 12:46:12.640602 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 16 12:46:12.640602 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:46:12.640602 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:46:12.640602 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:46:12.640602 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:46:12.640602 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 16 12:46:12.640602 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 16 12:46:12.640602 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 16 12:46:12.640602 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 16 12:46:12.640602 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 12:46:12.640602 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 12:46:12.640602 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 16 12:46:12.640602 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 16 12:46:12.640602 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 12:46:12.640602 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 12:46:12.642545 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 16 12:46:12.642545 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 16 12:46:12.642545 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 12:46:12.642545 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:12.642545 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:12.642545 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:12.642545 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:12.642545 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:12.642545 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:12.642545 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:46:12.642545 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:46:12.642545 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:46:12.642545 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:46:12.642545 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:46:12.642545 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:46:12.642545 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Sep 16 12:46:12.642545 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Sep 16 12:46:12.642545 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 16 12:46:12.642545 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:46:12.643674 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 12:46:12.643674 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:12.643674 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:12.643674 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:12.643674 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:12.643674 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:12.643674 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:12.643674 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:46:12.643674 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:46:12.643674 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 12:46:12.643674 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:12.643674 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9be44847-7485-4b9b-834a-bde1e2c088c4 tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:46:12.643674 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9be44847-7485-4b9b-834a-bde1e2c088c4 tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.040257 Sep 16 12:46:12.645837 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 159/310] 10.222.0.67 () {58 vars in 1212 bytes} [Fri Sep 16 12:46:12 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 12:46:12.656214 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-69397d58-2ee2-472a-a039-d9307b039f10 tempest-SecurityGroupsTestAdminJSON-127425830 tempest-SecurityGroupsTestAdminJSON-127425830-project-admin] Calling method '.version_select at 0x7f103624ae50>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:12.687845 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5d43235f-d845-4e6a-9450-cb246580fe0d tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0815c12c4340109ec1c379a0602322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20770fd1243d4412bfc90d2a079473bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:12.709929 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5d43235f-d845-4e6a-9450-cb246580fe0d tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b" status: 200 len: 1321 microversion: 2.1 time: 0.581921 Sep 16 12:46:12.713043 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 152/311] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:12 2022] GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b => generated 1321 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:12.731156 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4f2fe2b2-84ee-45ba-b4eb-b00f474f2a29 tempest-HostsAdminNegativeTestJSON-1967769077 tempest-HostsAdminNegativeTestJSON-1967769077-project] Calling method '.version_select at 0x7f103614b430>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:12.742473 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4f2fe2b2-84ee-45ba-b4eb-b00f474f2a29 tempest-HostsAdminNegativeTestJSON-1967769077 tempest-HostsAdminNegativeTestJSON-1967769077-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '496b7f883b514178bb87b7b446f5287e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27610d4e76b144eba55bcbff93aeac26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:12.746858 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4f2fe2b2-84ee-45ba-b4eb-b00f474f2a29 tempest-HostsAdminNegativeTestJSON-1967769077 tempest-HostsAdminNegativeTestJSON-1967769077-project] Request method failure captured: Sep 16 12:46:12.746858 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/os-hosts/n-d-858094-4 HTTP/1.1 Sep 16 12:46:12.746858 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:46:12.746858 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:46:12.746858 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:46:12.746858 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:46:12.746858 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:46:12.746858 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:46:12.746858 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:46:12.746858 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:46:12.746858 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHANeswtMKIf9a2uvm6uxorvPQjv_L7g61rtbT9neyWNZpOpIpp4jpB2Zbus-Ztq8O4AXdQVlnYFw4DjkWLuI4xZdYU9_GzOr6ovgUyM6RtBg5Xvb2prrFRG_TFQxSq5hc9Mc6l3HOtg756SrzEJ-nDVzL-XWz9D1FEV1kXfzMyuTpY Sep 16 12:46:12.746858 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:46:12.746858 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:46:12.746858 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:46:12.746858 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:46:12.746858 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:46:12.746858 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:46:12.746858 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 27610d4e76b144eba55bcbff93aeac26 Sep 16 12:46:12.746858 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1967769077 Sep 16 12:46:12.746858 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:46:12.746858 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:46:12.748589 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/27610d4e76b144eba55bcbff93aeac26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/27610d4e76b144eba55bcbff93aeac26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_27610d4e76b144eba55bcbff93aeac26", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/27610d4e76b144eba55bcbff93aeac26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:46:12.748589 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1967769077 Sep 16 12:46:12.748589 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 27610d4e76b144eba55bcbff93aeac26 Sep 16 12:46:12.748589 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1967769077 Sep 16 12:46:12.748589 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-HostsAdminNegativeTestJSON-1967769077-project Sep 16 12:46:12.748589 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:46:12.748589 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:46:12.748589 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 496b7f883b514178bb87b7b446f5287e Sep 16 12:46:12.748589 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1967769077-project Sep 16 12:46:12.748589 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 12:46:12.748589 n-d-858094-4 devstack@n-api.service[128780]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 16 12:46:12.748589 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'n-d-858094-4'} Sep 16 12:46:12.748589 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:46:12.749401 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:12.749401 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:12.749401 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:12.749401 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:46:12.749401 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:46:12.749401 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:46:12.749401 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:46:12.749401 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:46:12.749401 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:46:12.749401 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Sep 16 12:46:12.749401 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Sep 16 12:46:12.749401 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 12:46:12.749401 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 12:46:12.749401 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 12:46:12.749401 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 12:46:12.749401 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:46:12.749401 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:46:12.749401 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:46:12.749401 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:46:12.750644 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 12:46:12.750644 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 12:46:12.750644 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 12:46:12.750644 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 12:46:12.750644 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 12:46:12.750644 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 12:46:12.750644 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 16 12:46:12.750644 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:12.750644 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:12.750644 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:12.750644 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:12.750644 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:12.750644 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:12.750644 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 12:46:12.750644 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 12:46:12.750644 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 16 12:46:12.750644 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:12.753767 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4f2fe2b2-84ee-45ba-b4eb-b00f474f2a29 tempest-HostsAdminNegativeTestJSON-1967769077 tempest-HostsAdminNegativeTestJSON-1967769077-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:46:12.753767 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4f2fe2b2-84ee-45ba-b4eb-b00f474f2a29 tempest-HostsAdminNegativeTestJSON-1967769077 tempest-HostsAdminNegativeTestJSON-1967769077-project] 10.222.0.67 "GET /compute/v2.1/os-hosts/n-d-858094-4" status: 403 len: 109 microversion: 2.1 time: 0.032830 Sep 16 12:46:12.753767 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 153/312] 10.222.0.67 () {58 vars in 1167 bytes} [Fri Sep 16 12:46:12 2022] GET /compute/v2.1/os-hosts/n-d-858094-4 => generated 109 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:46:12.764073 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-476c1488-b37b-4eb7-9150-63078dd42b0c tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] Calling method '.version_select at 0x7f10361cfca0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:12.788565 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-476c1488-b37b-4eb7-9150-63078dd42b0c tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 12:46:12.793049 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-476c1488-b37b-4eb7-9150-63078dd42b0c tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] Request method failure captured: Sep 16 12:46:12.793049 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 16 12:46:12.793049 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:46:12.793049 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:46:12.793049 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:46:12.793049 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:46:12.793049 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:46:12.793049 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:46:12.793049 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:46:12.793049 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:46:12.793049 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHAQjQ1ufvqV2IlNdvcvNDljU5rlNmZqpxR25RmBwECUUMGmEkb2sNbvAPNkDnaFFgBcNhYPe0BfbSZoD5YutWn5xXNbcuVFX0NWY08XbM7iqKU_B4mGZZ1mrpvSqrF6OwbbrqVBgSAR82N0LDLLzEdSUOCwFbPrtVfU4pZjB4RQKRs Sep 16 12:46:12.793049 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:46:12.793049 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:46:12.793049 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:46:12.793049 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:46:12.793049 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:46:12.793049 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:46:12.793049 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: b1bb5e09dceb4c55b5692e001e63d1e2 Sep 16 12:46:12.793049 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-799532100 Sep 16 12:46:12.793049 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,admin,reader Sep 16 12:46:12.793049 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,admin,reader Sep 16 12:46:12.794534 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b1bb5e09dceb4c55b5692e001e63d1e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b1bb5e09dceb4c55b5692e001e63d1e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b1bb5e09dceb4c55b5692e001e63d1e2", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b1bb5e09dceb4c55b5692e001e63d1e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:46:12.794534 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-HostsAdminNegativeTestJSON-799532100 Sep 16 12:46:12.794534 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: b1bb5e09dceb4c55b5692e001e63d1e2 Sep 16 12:46:12.794534 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-799532100 Sep 16 12:46:12.794534 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-HostsAdminNegativeTestJSON-799532100-project-admin Sep 16 12:46:12.794534 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:46:12.794534 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:46:12.794534 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 90765ac4ba824e0fa32f2cf63aafb545 Sep 16 12:46:12.794534 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-HostsAdminNegativeTestJSON-799532100-project-admin Sep 16 12:46:12.794534 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 12:46:12.794534 n-d-858094-4 devstack@n-api.service[128780]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 12:46:12.794534 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'nonexistent_hostname'} Sep 16 12:46:12.794534 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:46:12.795374 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:12.795374 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Sep 16 12:46:12.795374 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 16 12:46:12.795374 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 12:46:12.795374 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 12:46:12.795374 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 16 12:46:12.795374 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 16 12:46:12.795374 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 12:46:12.795374 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 12:46:12.795374 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 16 12:46:12.795374 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 16 12:46:12.795374 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 12:46:12.795374 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:12.795374 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:12.795374 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:12.795374 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:12.795374 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:12.795374 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:12.795374 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:46:12.796415 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:46:12.796415 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:46:12.796415 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:46:12.796415 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:46:12.796415 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:46:12.796415 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Sep 16 12:46:12.796415 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:46:12.796415 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 12:46:12.796415 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:12.796415 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:12.796415 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:12.796415 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:12.796415 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:12.796415 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:12.796415 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:46:12.796415 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:46:12.796415 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 12:46:12.796415 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:12.813121 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-476c1488-b37b-4eb7-9150-63078dd42b0c tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:46:12.819134 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-476c1488-b37b-4eb7-9150-63078dd42b0c tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.059412 Sep 16 12:46:12.823642 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 154/313] 10.222.0.67 () {58 vars in 1191 bytes} [Fri Sep 16 12:46:12 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 16 12:46:12.842154 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-94ead86a-86f9-4043-9378-1d00883ca941 tempest-HostsAdminNegativeTestJSON-1967769077 tempest-HostsAdminNegativeTestJSON-1967769077-project] Calling method '.version_select at 0x7f1036334160>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:12.858053 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-94ead86a-86f9-4043-9378-1d00883ca941 tempest-HostsAdminNegativeTestJSON-1967769077 tempest-HostsAdminNegativeTestJSON-1967769077-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '496b7f883b514178bb87b7b446f5287e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27610d4e76b144eba55bcbff93aeac26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:12.859924 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-94ead86a-86f9-4043-9378-1d00883ca941 tempest-HostsAdminNegativeTestJSON-1967769077 tempest-HostsAdminNegativeTestJSON-1967769077-project] Request method failure captured: Sep 16 12:46:12.859924 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/os-hosts/n-d-858094-4/shutdown HTTP/1.1 Sep 16 12:46:12.859924 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:46:12.859924 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:46:12.859924 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:46:12.859924 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:46:12.859924 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:46:12.859924 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:46:12.859924 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:46:12.859924 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:46:12.859924 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHANeswtMKIf9a2uvm6uxorvPQjv_L7g61rtbT9neyWNZpOpIpp4jpB2Zbus-Ztq8O4AXdQVlnYFw4DjkWLuI4xZdYU9_GzOr6ovgUyM6RtBg5Xvb2prrFRG_TFQxSq5hc9Mc6l3HOtg756SrzEJ-nDVzL-XWz9D1FEV1kXfzMyuTpY Sep 16 12:46:12.859924 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:46:12.859924 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:46:12.859924 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:46:12.859924 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:46:12.859924 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:46:12.859924 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:46:12.859924 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 27610d4e76b144eba55bcbff93aeac26 Sep 16 12:46:12.859924 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1967769077 Sep 16 12:46:12.859924 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:46:12.859924 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:46:12.861345 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/27610d4e76b144eba55bcbff93aeac26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/27610d4e76b144eba55bcbff93aeac26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_27610d4e76b144eba55bcbff93aeac26", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/27610d4e76b144eba55bcbff93aeac26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:46:12.861345 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1967769077 Sep 16 12:46:12.861345 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 27610d4e76b144eba55bcbff93aeac26 Sep 16 12:46:12.861345 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1967769077 Sep 16 12:46:12.861345 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-HostsAdminNegativeTestJSON-1967769077-project Sep 16 12:46:12.861345 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:46:12.861345 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:46:12.861345 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 496b7f883b514178bb87b7b446f5287e Sep 16 12:46:12.861345 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1967769077-project Sep 16 12:46:12.861345 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 12:46:12.861345 n-d-858094-4 devstack@n-api.service[128780]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 16 12:46:12.861345 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'n-d-858094-4'} Sep 16 12:46:12.861345 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:46:12.862081 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:12.862081 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:12.862081 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:12.862081 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:46:12.862081 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:46:12.862081 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:46:12.862081 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:46:12.862081 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:46:12.862081 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:46:12.862081 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Sep 16 12:46:12.862081 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Sep 16 12:46:12.862081 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 12:46:12.862081 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 12:46:12.862081 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 12:46:12.862081 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 12:46:12.862081 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:46:12.862081 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:46:12.862081 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:46:12.862081 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:46:12.864022 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 12:46:12.864022 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 12:46:12.864022 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 12:46:12.864022 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 12:46:12.864022 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 12:46:12.864022 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 12:46:12.864022 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 16 12:46:12.864022 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:12.864022 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:12.864022 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:12.864022 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:12.864022 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:12.864022 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:12.864022 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 12:46:12.864022 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 12:46:12.864022 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 16 12:46:12.864022 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:12.865548 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-94ead86a-86f9-4043-9378-1d00883ca941 tempest-HostsAdminNegativeTestJSON-1967769077 tempest-HostsAdminNegativeTestJSON-1967769077-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:46:12.865548 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-94ead86a-86f9-4043-9378-1d00883ca941 tempest-HostsAdminNegativeTestJSON-1967769077 tempest-HostsAdminNegativeTestJSON-1967769077-project] 10.222.0.67 "GET /compute/v2.1/os-hosts/n-d-858094-4/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.033580 Sep 16 12:46:12.865548 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 155/314] 10.222.0.67 () {58 vars in 1194 bytes} [Fri Sep 16 12:46:12 2022] GET /compute/v2.1/os-hosts/n-d-858094-4/shutdown => generated 113 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:46:12.882575 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-19060ab3-2e8b-4f38-8a67-496a497cec36 tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] Calling method '.version_select at 0x7f103618d820>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:12.914612 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-19060ab3-2e8b-4f38-8a67-496a497cec36 tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 12:46:12.919229 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-19060ab3-2e8b-4f38-8a67-496a497cec36 tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] Request method failure captured: Sep 16 12:46:12.919229 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Sep 16 12:46:12.919229 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:46:12.919229 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:46:12.919229 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:46:12.919229 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:46:12.919229 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:46:12.919229 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:46:12.919229 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:46:12.919229 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:46:12.919229 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHAQjQ1ufvqV2IlNdvcvNDljU5rlNmZqpxR25RmBwECUUMGmEkb2sNbvAPNkDnaFFgBcNhYPe0BfbSZoD5YutWn5xXNbcuVFX0NWY08XbM7iqKU_B4mGZZ1mrpvSqrF6OwbbrqVBgSAR82N0LDLLzEdSUOCwFbPrtVfU4pZjB4RQKRs Sep 16 12:46:12.919229 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:46:12.919229 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:46:12.919229 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:46:12.919229 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:46:12.919229 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:46:12.919229 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:46:12.919229 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: b1bb5e09dceb4c55b5692e001e63d1e2 Sep 16 12:46:12.919229 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-799532100 Sep 16 12:46:12.919229 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,admin,reader Sep 16 12:46:12.919229 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,admin,reader Sep 16 12:46:12.920684 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b1bb5e09dceb4c55b5692e001e63d1e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b1bb5e09dceb4c55b5692e001e63d1e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b1bb5e09dceb4c55b5692e001e63d1e2", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b1bb5e09dceb4c55b5692e001e63d1e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:46:12.920684 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-HostsAdminNegativeTestJSON-799532100 Sep 16 12:46:12.920684 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: b1bb5e09dceb4c55b5692e001e63d1e2 Sep 16 12:46:12.920684 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-799532100 Sep 16 12:46:12.920684 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-HostsAdminNegativeTestJSON-799532100-project-admin Sep 16 12:46:12.920684 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:46:12.920684 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:46:12.920684 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 90765ac4ba824e0fa32f2cf63aafb545 Sep 16 12:46:12.920684 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-HostsAdminNegativeTestJSON-799532100-project-admin Sep 16 12:46:12.920684 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 12:46:12.920684 n-d-858094-4 devstack@n-api.service[128780]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 12:46:12.920684 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'nonexistent_hostname'} Sep 16 12:46:12.920684 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:46:12.921568 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:12.921568 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 16 12:46:12.921568 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 16 12:46:12.921568 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 16 12:46:12.921568 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 16 12:46:12.921568 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:46:12.921568 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:46:12.921568 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:46:12.921568 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:46:12.921568 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 16 12:46:12.921568 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 16 12:46:12.921568 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 16 12:46:12.921568 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 16 12:46:12.921568 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 12:46:12.921568 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 12:46:12.921568 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 16 12:46:12.921568 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 16 12:46:12.921568 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 12:46:12.921568 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 12:46:12.922706 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 16 12:46:12.922706 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 16 12:46:12.922706 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 12:46:12.922706 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:12.922706 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:12.922706 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:12.922706 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:12.922706 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:12.922706 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:12.922706 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:46:12.922706 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:46:12.922706 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:46:12.922706 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:46:12.922706 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:46:12.922706 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:46:12.922706 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Sep 16 12:46:12.922706 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Sep 16 12:46:12.922706 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 16 12:46:12.922706 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:46:12.923981 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 12:46:12.923981 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:12.923981 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:12.923981 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:12.923981 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:12.923981 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:12.923981 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:12.923981 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:46:12.923981 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:46:12.923981 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 12:46:12.923981 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:12.929920 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-19060ab3-2e8b-4f38-8a67-496a497cec36 tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:46:12.934248 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-19060ab3-2e8b-4f38-8a67-496a497cec36 tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.065398 Sep 16 12:46:12.934407 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-69397d58-2ee2-472a-a039-d9307b039f10 tempest-SecurityGroupsTestAdminJSON-127425830 tempest-SecurityGroupsTestAdminJSON-127425830-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/cb1726da-19fa-4553-8a35-2a63ed6e5d54" status: 202 len: 0 microversion: 2.1 time: 0.288663 Sep 16 12:46:12.935129 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 160/315] 10.222.0.67 () {58 vars in 1272 bytes} [Fri Sep 16 12:46:12 2022] DELETE /compute/v2.1/os-security-groups/cb1726da-19fa-4553-8a35-2a63ed6e5d54 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:46:12.937617 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 156/316] 10.222.0.67 () {58 vars in 1218 bytes} [Fri Sep 16 12:46:12 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 16 12:46:12.944589 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-affe6372-1e78-4747-b666-42a0fae9b5b2 tempest-SecurityGroupsTestAdminJSON-2079169535 tempest-SecurityGroupsTestAdminJSON-2079169535-project] Calling method '.version_select at 0x7f10361ec430>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:12.951111 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5a3b8f2b-ac16-4ff0-94a9-d41fd7976533 tempest-HostsAdminNegativeTestJSON-1967769077 tempest-HostsAdminNegativeTestJSON-1967769077-project] Calling method '.version_select at 0x7f10361345e0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:12.955765 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5a3b8f2b-ac16-4ff0-94a9-d41fd7976533 tempest-HostsAdminNegativeTestJSON-1967769077 tempest-HostsAdminNegativeTestJSON-1967769077-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '496b7f883b514178bb87b7b446f5287e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27610d4e76b144eba55bcbff93aeac26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:12.961238 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5a3b8f2b-ac16-4ff0-94a9-d41fd7976533 tempest-HostsAdminNegativeTestJSON-1967769077 tempest-HostsAdminNegativeTestJSON-1967769077-project] Request method failure captured: Sep 16 12:46:12.961238 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/os-hosts/n-d-858094-4/startup HTTP/1.1 Sep 16 12:46:12.961238 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:46:12.961238 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:46:12.961238 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:46:12.961238 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:46:12.961238 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:46:12.961238 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:46:12.961238 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:46:12.961238 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:46:12.961238 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHANeswtMKIf9a2uvm6uxorvPQjv_L7g61rtbT9neyWNZpOpIpp4jpB2Zbus-Ztq8O4AXdQVlnYFw4DjkWLuI4xZdYU9_GzOr6ovgUyM6RtBg5Xvb2prrFRG_TFQxSq5hc9Mc6l3HOtg756SrzEJ-nDVzL-XWz9D1FEV1kXfzMyuTpY Sep 16 12:46:12.961238 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:46:12.961238 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:46:12.961238 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:46:12.961238 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:46:12.961238 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:46:12.961238 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:46:12.961238 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 27610d4e76b144eba55bcbff93aeac26 Sep 16 12:46:12.961238 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1967769077 Sep 16 12:46:12.961238 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:46:12.961238 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:46:12.962631 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/27610d4e76b144eba55bcbff93aeac26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/27610d4e76b144eba55bcbff93aeac26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_27610d4e76b144eba55bcbff93aeac26", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/27610d4e76b144eba55bcbff93aeac26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:46:12.962631 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1967769077 Sep 16 12:46:12.962631 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 27610d4e76b144eba55bcbff93aeac26 Sep 16 12:46:12.962631 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1967769077 Sep 16 12:46:12.962631 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-HostsAdminNegativeTestJSON-1967769077-project Sep 16 12:46:12.962631 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:46:12.962631 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:46:12.962631 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 496b7f883b514178bb87b7b446f5287e Sep 16 12:46:12.962631 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1967769077-project Sep 16 12:46:12.962631 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 12:46:12.962631 n-d-858094-4 devstack@n-api.service[128780]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 16 12:46:12.962631 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'n-d-858094-4'} Sep 16 12:46:12.962631 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:46:12.963475 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:12.963475 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:12.963475 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:12.963475 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:46:12.963475 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:46:12.963475 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:46:12.963475 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:46:12.963475 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:46:12.963475 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:46:12.963475 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Sep 16 12:46:12.963475 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Sep 16 12:46:12.963475 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 12:46:12.963475 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 12:46:12.963475 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 12:46:12.963475 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 12:46:12.963475 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:46:12.963475 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:46:12.963475 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:46:12.963475 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:46:12.964692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 12:46:12.964692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 12:46:12.964692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 12:46:12.964692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 12:46:12.964692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 12:46:12.964692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 12:46:12.964692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 16 12:46:12.964692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:12.964692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:12.964692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:12.964692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:12.964692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:12.964692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:12.964692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 12:46:12.964692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 12:46:12.964692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 16 12:46:12.964692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:12.970510 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5a3b8f2b-ac16-4ff0-94a9-d41fd7976533 tempest-HostsAdminNegativeTestJSON-1967769077 tempest-HostsAdminNegativeTestJSON-1967769077-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:46:12.972599 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5a3b8f2b-ac16-4ff0-94a9-d41fd7976533 tempest-HostsAdminNegativeTestJSON-1967769077 tempest-HostsAdminNegativeTestJSON-1967769077-project] 10.222.0.67 "GET /compute/v2.1/os-hosts/n-d-858094-4/startup" status: 403 len: 110 microversion: 2.1 time: 0.026152 Sep 16 12:46:12.976487 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 157/317] 10.222.0.67 () {58 vars in 1191 bytes} [Fri Sep 16 12:46:12 2022] GET /compute/v2.1/os-hosts/n-d-858094-4/startup => generated 110 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:46:12.987501 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2e46089d-e3c7-41f4-acde-3f40b693c56b tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] Calling method '.version_select at 0x7f1036395160>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:13.019425 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-2e46089d-e3c7-41f4-acde-3f40b693c56b tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 12:46:13.024412 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2e46089d-e3c7-41f4-acde-3f40b693c56b tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] Request method failure captured: Sep 16 12:46:13.024412 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Sep 16 12:46:13.024412 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:46:13.024412 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:46:13.024412 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:46:13.024412 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:46:13.024412 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:46:13.024412 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:46:13.024412 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:46:13.024412 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:46:13.024412 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHAQjQ1ufvqV2IlNdvcvNDljU5rlNmZqpxR25RmBwECUUMGmEkb2sNbvAPNkDnaFFgBcNhYPe0BfbSZoD5YutWn5xXNbcuVFX0NWY08XbM7iqKU_B4mGZZ1mrpvSqrF6OwbbrqVBgSAR82N0LDLLzEdSUOCwFbPrtVfU4pZjB4RQKRs Sep 16 12:46:13.024412 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:46:13.024412 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:46:13.024412 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:46:13.024412 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:46:13.024412 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:46:13.024412 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:46:13.024412 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: b1bb5e09dceb4c55b5692e001e63d1e2 Sep 16 12:46:13.024412 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-799532100 Sep 16 12:46:13.024412 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,admin,reader Sep 16 12:46:13.024412 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,admin,reader Sep 16 12:46:13.025953 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b1bb5e09dceb4c55b5692e001e63d1e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b1bb5e09dceb4c55b5692e001e63d1e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b1bb5e09dceb4c55b5692e001e63d1e2", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b1bb5e09dceb4c55b5692e001e63d1e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:46:13.025953 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-HostsAdminNegativeTestJSON-799532100 Sep 16 12:46:13.025953 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: b1bb5e09dceb4c55b5692e001e63d1e2 Sep 16 12:46:13.025953 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-799532100 Sep 16 12:46:13.025953 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-HostsAdminNegativeTestJSON-799532100-project-admin Sep 16 12:46:13.025953 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:46:13.025953 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:46:13.025953 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 90765ac4ba824e0fa32f2cf63aafb545 Sep 16 12:46:13.025953 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-HostsAdminNegativeTestJSON-799532100-project-admin Sep 16 12:46:13.025953 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 12:46:13.025953 n-d-858094-4 devstack@n-api.service[128780]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 12:46:13.025953 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'nonexistent_hostname'} Sep 16 12:46:13.025953 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:46:13.026813 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:13.026813 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 16 12:46:13.026813 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 16 12:46:13.026813 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 16 12:46:13.026813 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 16 12:46:13.026813 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:46:13.026813 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:46:13.026813 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:46:13.026813 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:46:13.026813 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 16 12:46:13.026813 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 16 12:46:13.026813 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 16 12:46:13.026813 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 16 12:46:13.026813 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 12:46:13.026813 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 12:46:13.026813 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 16 12:46:13.026813 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 16 12:46:13.026813 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 12:46:13.026813 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 12:46:13.028058 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 16 12:46:13.028058 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 16 12:46:13.028058 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 12:46:13.028058 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:13.028058 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:13.028058 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:13.028058 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:13.028058 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:13.028058 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:13.028058 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:46:13.028058 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:46:13.028058 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:46:13.028058 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:46:13.028058 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:46:13.028058 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:46:13.028058 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Sep 16 12:46:13.028058 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Sep 16 12:46:13.028058 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 16 12:46:13.028058 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:46:13.029338 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 12:46:13.029338 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:13.029338 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:13.029338 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:13.029338 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:13.029338 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:13.029338 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:13.029338 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:46:13.029338 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:46:13.029338 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 12:46:13.029338 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:13.029338 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2e46089d-e3c7-41f4-acde-3f40b693c56b tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:46:13.029338 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2e46089d-e3c7-41f4-acde-3f40b693c56b tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.045512 Sep 16 12:46:13.029338 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 158/318] 10.222.0.67 () {58 vars in 1215 bytes} [Fri Sep 16 12:46:12 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 12:46:13.054580 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-81d273d0-5e5b-49ed-b3cf-8cdf50845221 tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] Action: 'update', calling method: .version_select at 0x7f10363b1430>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:13.064866 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-81d273d0-5e5b-49ed-b3cf-8cdf50845221 tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] Request method failure captured: Sep 16 12:46:13.064866 n-d-858094-4 devstack@n-api.service[128780]: request: PUT /compute/v2.1/os-hosts/n-d-858094-4 HTTP/1.1 Sep 16 12:46:13.064866 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:46:13.064866 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:46:13.064866 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:46:13.064866 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 51 Sep 16 12:46:13.064866 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:46:13.064866 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:46:13.064866 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:46:13.064866 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:46:13.064866 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHAQjQ1ufvqV2IlNdvcvNDljU5rlNmZqpxR25RmBwECUUMGmEkb2sNbvAPNkDnaFFgBcNhYPe0BfbSZoD5YutWn5xXNbcuVFX0NWY08XbM7iqKU_B4mGZZ1mrpvSqrF6OwbbrqVBgSAR82N0LDLLzEdSUOCwFbPrtVfU4pZjB4RQKRs Sep 16 12:46:13.064866 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:46:13.064866 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:46:13.064866 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:46:13.064866 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:46:13.064866 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:46:13.064866 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:46:13.064866 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: b1bb5e09dceb4c55b5692e001e63d1e2 Sep 16 12:46:13.064866 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-799532100 Sep 16 12:46:13.064866 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,admin,reader Sep 16 12:46:13.064866 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,admin,reader Sep 16 12:46:13.066185 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b1bb5e09dceb4c55b5692e001e63d1e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b1bb5e09dceb4c55b5692e001e63d1e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b1bb5e09dceb4c55b5692e001e63d1e2", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b1bb5e09dceb4c55b5692e001e63d1e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:46:13.066185 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-HostsAdminNegativeTestJSON-799532100 Sep 16 12:46:13.066185 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: b1bb5e09dceb4c55b5692e001e63d1e2 Sep 16 12:46:13.066185 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-799532100 Sep 16 12:46:13.066185 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-HostsAdminNegativeTestJSON-799532100-project-admin Sep 16 12:46:13.066185 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:46:13.066185 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:46:13.066185 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 90765ac4ba824e0fa32f2cf63aafb545 Sep 16 12:46:13.066185 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-HostsAdminNegativeTestJSON-799532100-project-admin Sep 16 12:46:13.066185 n-d-858094-4 devstack@n-api.service[128780]: Sep 16 12:46:13.066185 n-d-858094-4 devstack@n-api.service[128780]: {"status": "enable", "maintenance_mode": "invalid"} Sep 16 12:46:13.066185 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 12:46:13.066185 n-d-858094-4 devstack@n-api.service[128780]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 16 12:46:13.066898 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'n-d-858094-4', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Sep 16 12:46:13.066898 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:46:13.066898 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:13.066898 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 12:46:13.066898 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 12:46:13.066898 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 12:46:13.066898 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise error Sep 16 12:46:13.066898 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 16 12:46:13.066898 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:13.066898 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Sep 16 12:46:13.066898 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 16 12:46:13.066898 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi 'disable', Sep 16 12:46:13.066898 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi 'Enable', Sep 16 12:46:13.066898 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi 'Disable', Sep 16 12:46:13.066898 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 16 12:46:13.066898 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 16 12:46:13.066898 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 16 12:46:13.066898 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:13.066898 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi On instance: Sep 16 12:46:13.066898 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi 'invalid' Sep 16 12:46:13.066898 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:13.066898 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:13.066898 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:13.066898 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:13.066898 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:13.068316 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:13.068316 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:46:13.068316 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:46:13.068316 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:46:13.068316 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:46:13.068316 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:46:13.068316 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:46:13.068316 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 12:46:13.068316 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 12:46:13.068316 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 12:46:13.068316 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 12:46:13.068316 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 12:46:13.068316 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 12:46:13.068316 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 16 12:46:13.068316 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:13.068316 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:13.068316 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:13.068316 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:13.068316 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:13.070003 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:13.070003 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 12:46:13.070003 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 12:46:13.070003 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 16 12:46:13.070003 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:13.070400 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-81d273d0-5e5b-49ed-b3cf-8cdf50845221 tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:46:13.071459 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-81d273d0-5e5b-49ed-b3cf-8cdf50845221 tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-hosts/n-d-858094-4" status: 400 len: 199 microversion: 2.1 time: 0.034798 Sep 16 12:46:13.072233 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 159/319] 10.222.0.67 () {60 vars in 1187 bytes} [Fri Sep 16 12:46:13 2022] PUT /compute/v2.1/os-hosts/n-d-858094-4 => generated 199 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 16 12:46:13.084934 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d269dbc5-6d9d-4d45-a6ad-684b777ecd40 tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] Action: 'update', calling method: .version_select at 0x7f1036376b80>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:13.095845 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d269dbc5-6d9d-4d45-a6ad-684b777ecd40 tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] Request method failure captured: Sep 16 12:46:13.095845 n-d-858094-4 devstack@n-api.service[128780]: request: PUT /compute/v2.1/os-hosts/n-d-858094-4 HTTP/1.1 Sep 16 12:46:13.095845 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:46:13.095845 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:46:13.095845 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:46:13.095845 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 51 Sep 16 12:46:13.095845 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:46:13.095845 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:46:13.095845 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:46:13.095845 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:46:13.095845 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHAQjQ1ufvqV2IlNdvcvNDljU5rlNmZqpxR25RmBwECUUMGmEkb2sNbvAPNkDnaFFgBcNhYPe0BfbSZoD5YutWn5xXNbcuVFX0NWY08XbM7iqKU_B4mGZZ1mrpvSqrF6OwbbrqVBgSAR82N0LDLLzEdSUOCwFbPrtVfU4pZjB4RQKRs Sep 16 12:46:13.095845 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:46:13.095845 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:46:13.095845 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:46:13.095845 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:46:13.095845 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:46:13.095845 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:46:13.095845 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: b1bb5e09dceb4c55b5692e001e63d1e2 Sep 16 12:46:13.095845 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-799532100 Sep 16 12:46:13.095845 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,admin,reader Sep 16 12:46:13.095845 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,admin,reader Sep 16 12:46:13.097179 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b1bb5e09dceb4c55b5692e001e63d1e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b1bb5e09dceb4c55b5692e001e63d1e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b1bb5e09dceb4c55b5692e001e63d1e2", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b1bb5e09dceb4c55b5692e001e63d1e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:46:13.097179 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-HostsAdminNegativeTestJSON-799532100 Sep 16 12:46:13.097179 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: b1bb5e09dceb4c55b5692e001e63d1e2 Sep 16 12:46:13.097179 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-799532100 Sep 16 12:46:13.097179 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-HostsAdminNegativeTestJSON-799532100-project-admin Sep 16 12:46:13.097179 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:46:13.097179 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:46:13.097179 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 90765ac4ba824e0fa32f2cf63aafb545 Sep 16 12:46:13.097179 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-HostsAdminNegativeTestJSON-799532100-project-admin Sep 16 12:46:13.097179 n-d-858094-4 devstack@n-api.service[128780]: Sep 16 12:46:13.097179 n-d-858094-4 devstack@n-api.service[128780]: {"status": "invalid", "maintenance_mode": "enable"} Sep 16 12:46:13.097179 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 12:46:13.097179 n-d-858094-4 devstack@n-api.service[128780]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 16 12:46:13.098000 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'n-d-858094-4', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Sep 16 12:46:13.098000 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:46:13.098000 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:13.098000 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 12:46:13.098000 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 12:46:13.098000 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 12:46:13.098000 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise error Sep 16 12:46:13.098000 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 16 12:46:13.098000 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:13.098000 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Sep 16 12:46:13.098000 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 16 12:46:13.098000 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi 'disable', Sep 16 12:46:13.098000 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi 'Enable', Sep 16 12:46:13.098000 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi 'Disable', Sep 16 12:46:13.098000 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 16 12:46:13.098000 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 16 12:46:13.098000 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 16 12:46:13.098000 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:13.098000 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi On instance: Sep 16 12:46:13.098000 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi 'invalid' Sep 16 12:46:13.098000 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:13.098000 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:13.098000 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:13.098000 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:13.098000 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:13.099300 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:13.099300 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:46:13.099300 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:46:13.099300 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:46:13.099300 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:46:13.099300 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:46:13.099300 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:46:13.099300 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 12:46:13.099300 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 12:46:13.099300 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 12:46:13.099300 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 12:46:13.099300 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 12:46:13.099300 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 12:46:13.099300 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 16 12:46:13.099300 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:13.099300 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:13.099300 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:13.099300 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:13.099300 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:13.100372 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:13.100372 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 12:46:13.100372 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 12:46:13.100372 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 16 12:46:13.100372 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:13.100372 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d269dbc5-6d9d-4d45-a6ad-684b777ecd40 tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:46:13.103070 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d269dbc5-6d9d-4d45-a6ad-684b777ecd40 tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-hosts/n-d-858094-4" status: 400 len: 189 microversion: 2.1 time: 0.020724 Sep 16 12:46:13.103895 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 160/320] 10.222.0.67 () {60 vars in 1187 bytes} [Fri Sep 16 12:46:13 2022] PUT /compute/v2.1/os-hosts/n-d-858094-4 => generated 189 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 12:46:13.125984 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ae1c288c-b7e3-459d-ad77-5ff4efaa5dc7 tempest-HostsAdminNegativeTestJSON-1967769077 tempest-HostsAdminNegativeTestJSON-1967769077-project] Action: 'update', calling method: .version_select at 0x7f103618d430>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:13.142137 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ae1c288c-b7e3-459d-ad77-5ff4efaa5dc7 tempest-HostsAdminNegativeTestJSON-1967769077 tempest-HostsAdminNegativeTestJSON-1967769077-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '496b7f883b514178bb87b7b446f5287e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27610d4e76b144eba55bcbff93aeac26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:13.142137 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ae1c288c-b7e3-459d-ad77-5ff4efaa5dc7 tempest-HostsAdminNegativeTestJSON-1967769077 tempest-HostsAdminNegativeTestJSON-1967769077-project] Request method failure captured: Sep 16 12:46:13.142137 n-d-858094-4 devstack@n-api.service[128780]: request: PUT /compute/v2.1/os-hosts/n-d-858094-4 HTTP/1.1 Sep 16 12:46:13.142137 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:46:13.142137 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:46:13.142137 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:46:13.142137 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 50 Sep 16 12:46:13.142137 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:46:13.142137 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:46:13.142137 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:46:13.142137 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:46:13.142137 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHANeswtMKIf9a2uvm6uxorvPQjv_L7g61rtbT9neyWNZpOpIpp4jpB2Zbus-Ztq8O4AXdQVlnYFw4DjkWLuI4xZdYU9_GzOr6ovgUyM6RtBg5Xvb2prrFRG_TFQxSq5hc9Mc6l3HOtg756SrzEJ-nDVzL-XWz9D1FEV1kXfzMyuTpY Sep 16 12:46:13.142137 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:46:13.142137 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:46:13.142137 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:46:13.142137 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:46:13.142137 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:46:13.142137 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:46:13.142137 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 27610d4e76b144eba55bcbff93aeac26 Sep 16 12:46:13.142137 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1967769077 Sep 16 12:46:13.142137 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:46:13.142137 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:46:13.143720 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/27610d4e76b144eba55bcbff93aeac26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/27610d4e76b144eba55bcbff93aeac26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_27610d4e76b144eba55bcbff93aeac26", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/27610d4e76b144eba55bcbff93aeac26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:46:13.143720 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1967769077 Sep 16 12:46:13.143720 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 27610d4e76b144eba55bcbff93aeac26 Sep 16 12:46:13.143720 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1967769077 Sep 16 12:46:13.143720 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-HostsAdminNegativeTestJSON-1967769077-project Sep 16 12:46:13.143720 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:46:13.143720 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:46:13.143720 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 496b7f883b514178bb87b7b446f5287e Sep 16 12:46:13.143720 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1967769077-project Sep 16 12:46:13.143720 n-d-858094-4 devstack@n-api.service[128780]: Sep 16 12:46:13.143720 n-d-858094-4 devstack@n-api.service[128780]: {"status": "enable", "maintenance_mode": "enable"} Sep 16 12:46:13.143720 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 12:46:13.143720 n-d-858094-4 devstack@n-api.service[128780]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 16 12:46:13.143720 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'n-d-858094-4', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 16 12:46:13.144507 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:46:13.144507 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:13.144507 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:13.144507 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:13.144507 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:46:13.144507 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:46:13.144507 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:46:13.144507 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:46:13.144507 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:46:13.144507 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:46:13.144507 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:46:13.144507 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:46:13.144507 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Sep 16 12:46:13.144507 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Sep 16 12:46:13.144507 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 12:46:13.144507 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 12:46:13.144507 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 12:46:13.144507 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 12:46:13.144507 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:46:13.144507 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:46:13.145638 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:46:13.145638 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:46:13.145638 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 12:46:13.145638 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 12:46:13.145638 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 12:46:13.145638 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 12:46:13.145638 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 12:46:13.145638 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 12:46:13.145638 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 16 12:46:13.145638 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:13.145638 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:13.145638 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:13.145638 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:13.145638 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:13.145638 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:13.145638 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 12:46:13.145638 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 12:46:13.145638 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 16 12:46:13.145638 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:13.146757 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ae1c288c-b7e3-459d-ad77-5ff4efaa5dc7 tempest-HostsAdminNegativeTestJSON-1967769077 tempest-HostsAdminNegativeTestJSON-1967769077-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:46:13.146757 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ae1c288c-b7e3-459d-ad77-5ff4efaa5dc7 tempest-HostsAdminNegativeTestJSON-1967769077 tempest-HostsAdminNegativeTestJSON-1967769077-project] 10.222.0.67 "PUT /compute/v2.1/os-hosts/n-d-858094-4" status: 403 len: 111 microversion: 2.1 time: 0.027385 Sep 16 12:46:13.146757 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 161/321] 10.222.0.67 () {60 vars in 1187 bytes} [Fri Sep 16 12:46:13 2022] PUT /compute/v2.1/os-hosts/n-d-858094-4 => generated 111 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 16 12:46:13.162679 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-847d21c3-4f83-4b07-8234-d960a8167423 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:13.163996 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-847d21c3-4f83-4b07-8234-d960a8167423 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: dab4fa5f-1804-403e-9387-5c12685ddfb3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:13.180553 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-847d21c3-4f83-4b07-8234-d960a8167423 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:13.181215 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-847d21c3-4f83-4b07-8234-d960a8167423 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:13.181667 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-847d21c3-4f83-4b07-8234-d960a8167423 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:13.185003 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-847d21c3-4f83-4b07-8234-d960a8167423 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:13.185913 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-847d21c3-4f83-4b07-8234-d960a8167423 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:13.186959 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-847d21c3-4f83-4b07-8234-d960a8167423 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:13.603356 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-847d21c3-4f83-4b07-8234-d960a8167423 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da877221336e4e58859c207fca5e857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b6b2ef87ef4629941a0cc9942d7e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:13.618660 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-847d21c3-4f83-4b07-8234-d960a8167423 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3" status: 200 len: 1320 microversion: 2.1 time: 0.462744 Sep 16 12:46:13.619348 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 162/322] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:13 2022] GET /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3 => generated 1320 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:13.640024 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-32e97be6-5ca4-44e8-877a-d77cf9bbed4a tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] Action: 'update', calling method: .version_select at 0x7f1036134040>, body: {"status": null, "maintenance_mode": null} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:13.644420 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-32e97be6-5ca4-44e8-877a-d77cf9bbed4a tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] Request method failure captured: Sep 16 12:46:13.644420 n-d-858094-4 devstack@n-api.service[128780]: request: PUT /compute/v2.1/os-hosts/n-d-858094-4 HTTP/1.1 Sep 16 12:46:13.644420 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:46:13.644420 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:46:13.644420 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:46:13.644420 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 42 Sep 16 12:46:13.644420 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:46:13.644420 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:46:13.644420 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:46:13.644420 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:46:13.644420 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHAQjQ1ufvqV2IlNdvcvNDljU5rlNmZqpxR25RmBwECUUMGmEkb2sNbvAPNkDnaFFgBcNhYPe0BfbSZoD5YutWn5xXNbcuVFX0NWY08XbM7iqKU_B4mGZZ1mrpvSqrF6OwbbrqVBgSAR82N0LDLLzEdSUOCwFbPrtVfU4pZjB4RQKRs Sep 16 12:46:13.644420 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:46:13.644420 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:46:13.644420 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:46:13.644420 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:46:13.644420 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:46:13.644420 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:46:13.644420 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: b1bb5e09dceb4c55b5692e001e63d1e2 Sep 16 12:46:13.644420 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-799532100 Sep 16 12:46:13.644420 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,admin,reader Sep 16 12:46:13.644420 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,admin,reader Sep 16 12:46:13.645724 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b1bb5e09dceb4c55b5692e001e63d1e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b1bb5e09dceb4c55b5692e001e63d1e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b1bb5e09dceb4c55b5692e001e63d1e2", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b1bb5e09dceb4c55b5692e001e63d1e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:46:13.645724 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-HostsAdminNegativeTestJSON-799532100 Sep 16 12:46:13.645724 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: b1bb5e09dceb4c55b5692e001e63d1e2 Sep 16 12:46:13.645724 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-799532100 Sep 16 12:46:13.645724 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-HostsAdminNegativeTestJSON-799532100-project-admin Sep 16 12:46:13.645724 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:46:13.645724 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:46:13.645724 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 90765ac4ba824e0fa32f2cf63aafb545 Sep 16 12:46:13.645724 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-HostsAdminNegativeTestJSON-799532100-project-admin Sep 16 12:46:13.645724 n-d-858094-4 devstack@n-api.service[128780]: Sep 16 12:46:13.645724 n-d-858094-4 devstack@n-api.service[128780]: {"status": null, "maintenance_mode": null} Sep 16 12:46:13.645724 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 12:46:13.645724 n-d-858094-4 devstack@n-api.service[128780]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 16 12:46:13.645724 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'n-d-858094-4', 'body': {'status': None, 'maintenance_mode': None}} Sep 16 12:46:13.646715 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:46:13.646715 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:13.646715 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 12:46:13.646715 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 12:46:13.646715 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 12:46:13.646715 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise error Sep 16 12:46:13.646715 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Sep 16 12:46:13.646715 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:13.646715 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Sep 16 12:46:13.646715 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 16 12:46:13.646715 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi 'disable', Sep 16 12:46:13.646715 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi 'Enable', Sep 16 12:46:13.646715 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi 'Disable', Sep 16 12:46:13.646715 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 16 12:46:13.646715 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 16 12:46:13.646715 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 16 12:46:13.646715 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:13.646715 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi On instance: Sep 16 12:46:13.646715 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi None Sep 16 12:46:13.646715 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:13.646715 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:13.646715 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:13.646715 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:13.646715 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:13.646715 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:13.648059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:46:13.648059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:46:13.648059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:46:13.648059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:46:13.648059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:46:13.648059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:46:13.648059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 12:46:13.648059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 12:46:13.648059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 12:46:13.648059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 12:46:13.648059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 12:46:13.648059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 12:46:13.648059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 16 12:46:13.648059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:13.648059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:13.648059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:13.648059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:13.648059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:13.648059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:13.649150 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 12:46:13.649150 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 12:46:13.649150 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 16 12:46:13.649150 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:13.651678 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-32e97be6-5ca4-44e8-877a-d77cf9bbed4a tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:46:13.652839 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-32e97be6-5ca4-44e8-877a-d77cf9bbed4a tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-hosts/n-d-858094-4" status: 400 len: 127 microversion: 2.1 time: 0.019407 Sep 16 12:46:13.654172 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 163/323] 10.222.0.67 () {60 vars in 1187 bytes} [Fri Sep 16 12:46:13 2022] PUT /compute/v2.1/os-hosts/n-d-858094-4 => generated 127 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 12:46:13.668670 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3c2afde9-56e3-461f-8f38-817512403f33 tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] Action: 'update', calling method: .version_select at 0x7f103614b3a0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:13.680187 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.hosts [None req-3c2afde9-56e3-461f-8f38-817512403f33 tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] Enabling host nonexistent_hostname. Sep 16 12:46:13.702916 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-3c2afde9-56e3-461f-8f38-817512403f33 tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 12:46:13.705462 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3c2afde9-56e3-461f-8f38-817512403f33 tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] Request method failure captured: Sep 16 12:46:13.705462 n-d-858094-4 devstack@n-api.service[128780]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 16 12:46:13.705462 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:46:13.705462 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:46:13.705462 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:46:13.705462 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 50 Sep 16 12:46:13.705462 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:46:13.705462 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:46:13.705462 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:46:13.705462 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:46:13.705462 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHAQjQ1ufvqV2IlNdvcvNDljU5rlNmZqpxR25RmBwECUUMGmEkb2sNbvAPNkDnaFFgBcNhYPe0BfbSZoD5YutWn5xXNbcuVFX0NWY08XbM7iqKU_B4mGZZ1mrpvSqrF6OwbbrqVBgSAR82N0LDLLzEdSUOCwFbPrtVfU4pZjB4RQKRs Sep 16 12:46:13.705462 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:46:13.705462 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:46:13.705462 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:46:13.705462 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:46:13.705462 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:46:13.705462 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:46:13.705462 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: b1bb5e09dceb4c55b5692e001e63d1e2 Sep 16 12:46:13.705462 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-799532100 Sep 16 12:46:13.705462 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,admin,reader Sep 16 12:46:13.705462 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,admin,reader Sep 16 12:46:13.706695 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b1bb5e09dceb4c55b5692e001e63d1e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b1bb5e09dceb4c55b5692e001e63d1e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b1bb5e09dceb4c55b5692e001e63d1e2", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b1bb5e09dceb4c55b5692e001e63d1e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:46:13.706695 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-HostsAdminNegativeTestJSON-799532100 Sep 16 12:46:13.706695 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: b1bb5e09dceb4c55b5692e001e63d1e2 Sep 16 12:46:13.706695 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-799532100 Sep 16 12:46:13.706695 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-HostsAdminNegativeTestJSON-799532100-project-admin Sep 16 12:46:13.706695 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:46:13.706695 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:46:13.706695 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 90765ac4ba824e0fa32f2cf63aafb545 Sep 16 12:46:13.706695 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-HostsAdminNegativeTestJSON-799532100-project-admin Sep 16 12:46:13.706695 n-d-858094-4 devstack@n-api.service[128780]: Sep 16 12:46:13.706695 n-d-858094-4 devstack@n-api.service[128780]: {"status": "enable", "maintenance_mode": "enable"} Sep 16 12:46:13.706695 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 12:46:13.706695 n-d-858094-4 devstack@n-api.service[128780]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 12:46:13.706695 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 16 12:46:13.707498 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:46:13.707498 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:13.707498 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Sep 16 12:46:13.707498 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Sep 16 12:46:13.707498 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 16 12:46:13.707498 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 16 12:46:13.707498 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:46:13.707498 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:46:13.707498 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:46:13.707498 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:46:13.707498 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 16 12:46:13.707498 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 16 12:46:13.707498 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 16 12:46:13.707498 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 16 12:46:13.707498 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 12:46:13.707498 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 12:46:13.707498 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 16 12:46:13.707498 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 16 12:46:13.709266 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 12:46:13.709266 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 12:46:13.709266 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 16 12:46:13.709266 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 16 12:46:13.709266 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 12:46:13.709266 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:13.709266 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:13.709266 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:13.709266 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:13.709266 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:13.709266 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:13.709266 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:46:13.709266 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:46:13.709266 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:46:13.709266 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:46:13.709266 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:46:13.709266 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:46:13.709266 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:46:13.709266 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:46:13.709266 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Sep 16 12:46:13.710369 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Sep 16 12:46:13.710369 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Sep 16 12:46:13.710369 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:46:13.710369 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 12:46:13.710369 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:13.710369 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:13.710369 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:13.710369 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:13.710369 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:13.710369 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:13.710369 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:46:13.710369 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:46:13.710369 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 12:46:13.710369 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:13.714238 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3c2afde9-56e3-461f-8f38-817512403f33 tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:46:13.714238 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3c2afde9-56e3-461f-8f38-817512403f33 tempest-HostsAdminNegativeTestJSON-799532100 tempest-HostsAdminNegativeTestJSON-799532100-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.053768 Sep 16 12:46:13.714238 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 164/324] 10.222.0.67 () {60 vars in 1211 bytes} [Fri Sep 16 12:46:13 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 12:46:13.717676 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-affe6372-1e78-4747-b666-42a0fae9b5b2 tempest-SecurityGroupsTestAdminJSON-2079169535 tempest-SecurityGroupsTestAdminJSON-2079169535-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/b74cdce4-acfa-4f40-8334-202d98d9c520" status: 202 len: 0 microversion: 2.1 time: 0.777926 Sep 16 12:46:13.718812 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 161/325] 10.222.0.67 () {58 vars in 1272 bytes} [Fri Sep 16 12:46:12 2022] DELETE /compute/v2.1/os-security-groups/b74cdce4-acfa-4f40-8334-202d98d9c520 => generated 0 bytes in 780 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 12:46:13.727497 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1fac0311-0c6b-4e35-aa6a-ddabea46b2a5 tempest-SecurityGroupsTestAdminJSON-2079169535 tempest-SecurityGroupsTestAdminJSON-2079169535-project] Calling method '.version_select at 0x7f10361c74c0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:13.740671 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6343f727-8b90-4dc9-ab92-7587527f3683 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:13.741446 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6343f727-8b90-4dc9-ab92-7587527f3683 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: 4d860eb6-336f-4ba4-be81-d1ec6fecc87b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:13.749376 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6343f727-8b90-4dc9-ab92-7587527f3683 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:13.754093 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6343f727-8b90-4dc9-ab92-7587527f3683 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:13.754821 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6343f727-8b90-4dc9-ab92-7587527f3683 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:13.755613 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6343f727-8b90-4dc9-ab92-7587527f3683 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:13.758259 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6343f727-8b90-4dc9-ab92-7587527f3683 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:13.758782 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6343f727-8b90-4dc9-ab92-7587527f3683 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:13.985506 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=12 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:46:14.416700 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6343f727-8b90-4dc9-ab92-7587527f3683 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0815c12c4340109ec1c379a0602322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20770fd1243d4412bfc90d2a079473bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:14.431704 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6343f727-8b90-4dc9-ab92-7587527f3683 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b" status: 200 len: 1321 microversion: 2.1 time: 0.696991 Sep 16 12:46:14.432976 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 162/326] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:13 2022] GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b => generated 1321 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:14.644272 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ebca8af8-9a30-4af6-8e0c-eca6c7933b1a tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:14.644852 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1fac0311-0c6b-4e35-aa6a-ddabea46b2a5 tempest-SecurityGroupsTestAdminJSON-2079169535 tempest-SecurityGroupsTestAdminJSON-2079169535-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/6b0aad3f-ff4c-4a3d-9b0a-4fb427ca4979" status: 202 len: 0 microversion: 2.1 time: 0.921505 Sep 16 12:46:14.644975 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ebca8af8-9a30-4af6-8e0c-eca6c7933b1a tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: dab4fa5f-1804-403e-9387-5c12685ddfb3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:14.645600 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 165/327] 10.222.0.67 () {58 vars in 1272 bytes} [Fri Sep 16 12:46:13 2022] DELETE /compute/v2.1/os-security-groups/6b0aad3f-ff4c-4a3d-9b0a-4fb427ca4979 => generated 0 bytes in 923 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:46:14.661004 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebca8af8-9a30-4af6-8e0c-eca6c7933b1a tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:14.661004 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebca8af8-9a30-4af6-8e0c-eca6c7933b1a tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:14.661004 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebca8af8-9a30-4af6-8e0c-eca6c7933b1a tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:14.662842 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebca8af8-9a30-4af6-8e0c-eca6c7933b1a tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:14.667429 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebca8af8-9a30-4af6-8e0c-eca6c7933b1a tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:14.668008 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebca8af8-9a30-4af6-8e0c-eca6c7933b1a tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:14.695729 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:46:14.707108 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=6 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:46:14.884501 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ebca8af8-9a30-4af6-8e0c-eca6c7933b1a tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da877221336e4e58859c207fca5e857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b6b2ef87ef4629941a0cc9942d7e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:14.901172 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ebca8af8-9a30-4af6-8e0c-eca6c7933b1a tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3" status: 200 len: 1470 microversion: 2.1 time: 0.261432 Sep 16 12:46:14.903295 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 163/328] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:14 2022] GET /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3 => generated 1470 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:46:14.927328 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8590bd63-5388-4c93-8ee5-80a46dcd0469 tempest-DeleteServersAdminTestJSON-189891681 tempest-DeleteServersAdminTestJSON-189891681-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:14.930580 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8590bd63-5388-4c93-8ee5-80a46dcd0469 tempest-DeleteServersAdminTestJSON-189891681 tempest-DeleteServersAdminTestJSON-189891681-project-admin] [instance: dab4fa5f-1804-403e-9387-5c12685ddfb3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:14.937973 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8590bd63-5388-4c93-8ee5-80a46dcd0469 tempest-DeleteServersAdminTestJSON-189891681 tempest-DeleteServersAdminTestJSON-189891681-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:14.938503 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8590bd63-5388-4c93-8ee5-80a46dcd0469 tempest-DeleteServersAdminTestJSON-189891681 tempest-DeleteServersAdminTestJSON-189891681-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:14.938927 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8590bd63-5388-4c93-8ee5-80a46dcd0469 tempest-DeleteServersAdminTestJSON-189891681 tempest-DeleteServersAdminTestJSON-189891681-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:14.939650 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8590bd63-5388-4c93-8ee5-80a46dcd0469 tempest-DeleteServersAdminTestJSON-189891681 tempest-DeleteServersAdminTestJSON-189891681-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:14.940095 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8590bd63-5388-4c93-8ee5-80a46dcd0469 tempest-DeleteServersAdminTestJSON-189891681 tempest-DeleteServersAdminTestJSON-189891681-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:14.940565 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8590bd63-5388-4c93-8ee5-80a46dcd0469 tempest-DeleteServersAdminTestJSON-189891681 tempest-DeleteServersAdminTestJSON-189891681-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:15.069241 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8590bd63-5388-4c93-8ee5-80a46dcd0469 tempest-DeleteServersAdminTestJSON-189891681 tempest-DeleteServersAdminTestJSON-189891681-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3/action" status: 202 len: 0 microversion: 2.1 time: 0.145366 Sep 16 12:46:15.072608 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 164/329] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:46:14 2022] POST /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 12:46:15.082481 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-05462665-69b8-4806-91d8-b867fcad6f48 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:15.083609 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-05462665-69b8-4806-91d8-b867fcad6f48 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: dab4fa5f-1804-403e-9387-5c12685ddfb3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:15.093803 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05462665-69b8-4806-91d8-b867fcad6f48 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:15.100848 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05462665-69b8-4806-91d8-b867fcad6f48 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:15.101584 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05462665-69b8-4806-91d8-b867fcad6f48 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:15.102498 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05462665-69b8-4806-91d8-b867fcad6f48 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:15.104044 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05462665-69b8-4806-91d8-b867fcad6f48 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:15.107624 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05462665-69b8-4806-91d8-b867fcad6f48 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:15.162438 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05462665-69b8-4806-91d8-b867fcad6f48 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:15.163231 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05462665-69b8-4806-91d8-b867fcad6f48 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:15.163844 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05462665-69b8-4806-91d8-b867fcad6f48 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:15.164539 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-05462665-69b8-4806-91d8-b867fcad6f48 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lazy-loading 'fault' on Instance uuid dab4fa5f-1804-403e-9387-5c12685ddfb3 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:46:15.435961 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ba2cf3c5-d804-4e7c-9bb5-add5161e8fc5 tempest-AZAdminV2TestJSON-1048480787 tempest-AZAdminV2TestJSON-1048480787-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:15.440772 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ba2cf3c5-d804-4e7c-9bb5-add5161e8fc5 tempest-AZAdminV2TestJSON-1048480787 tempest-AZAdminV2TestJSON-1048480787-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:15.442233 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ba2cf3c5-d804-4e7c-9bb5-add5161e8fc5 tempest-AZAdminV2TestJSON-1048480787 tempest-AZAdminV2TestJSON-1048480787-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:15.442800 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ba2cf3c5-d804-4e7c-9bb5-add5161e8fc5 tempest-AZAdminV2TestJSON-1048480787 tempest-AZAdminV2TestJSON-1048480787-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:15.445367 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ba2cf3c5-d804-4e7c-9bb5-add5161e8fc5 tempest-AZAdminV2TestJSON-1048480787 tempest-AZAdminV2TestJSON-1048480787-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:15.446820 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ba2cf3c5-d804-4e7c-9bb5-add5161e8fc5 tempest-AZAdminV2TestJSON-1048480787 tempest-AZAdminV2TestJSON-1048480787-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:15.448839 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ba2cf3c5-d804-4e7c-9bb5-add5161e8fc5 tempest-AZAdminV2TestJSON-1048480787 tempest-AZAdminV2TestJSON-1048480787-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:15.495066 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-05462665-69b8-4806-91d8-b867fcad6f48 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da877221336e4e58859c207fca5e857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b6b2ef87ef4629941a0cc9942d7e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:15.507383 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-05462665-69b8-4806-91d8-b867fcad6f48 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3" status: 200 len: 1453 microversion: 2.1 time: 0.425946 Sep 16 12:46:15.520877 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 165/330] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:15 2022] GET /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3 => generated 1453 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:15.535383 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-86fe6890-c04d-4572-ba1f-f67c961ee18f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:15.536022 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-86fe6890-c04d-4572-ba1f-f67c961ee18f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: 4d860eb6-336f-4ba4-be81-d1ec6fecc87b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:15.537660 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ba2cf3c5-d804-4e7c-9bb5-add5161e8fc5 tempest-AZAdminV2TestJSON-1048480787 tempest-AZAdminV2TestJSON-1048480787-project-admin] 10.222.0.67 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.875167 Sep 16 12:46:15.538248 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 166/331] 10.222.0.67 () {58 vars in 1164 bytes} [Fri Sep 16 12:46:14 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 16 12:46:15.550364 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86fe6890-c04d-4572-ba1f-f67c961ee18f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:15.551931 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ce7affe4-bab5-491b-930b-f8665e9e5ab2 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:15.552852 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ce7affe4-bab5-491b-930b-f8665e9e5ab2 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: dab4fa5f-1804-403e-9387-5c12685ddfb3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:15.553019 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86fe6890-c04d-4572-ba1f-f67c961ee18f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:15.553832 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86fe6890-c04d-4572-ba1f-f67c961ee18f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:15.554565 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86fe6890-c04d-4572-ba1f-f67c961ee18f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:15.555020 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86fe6890-c04d-4572-ba1f-f67c961ee18f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:15.555446 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86fe6890-c04d-4572-ba1f-f67c961ee18f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:15.572567 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce7affe4-bab5-491b-930b-f8665e9e5ab2 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:15.574516 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce7affe4-bab5-491b-930b-f8665e9e5ab2 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:15.574834 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce7affe4-bab5-491b-930b-f8665e9e5ab2 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:15.578092 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce7affe4-bab5-491b-930b-f8665e9e5ab2 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:15.579956 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce7affe4-bab5-491b-930b-f8665e9e5ab2 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:15.581732 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce7affe4-bab5-491b-930b-f8665e9e5ab2 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:15.616321 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=10 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:46:15.659155 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ce7affe4-bab5-491b-930b-f8665e9e5ab2 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: dab4fa5f-1804-403e-9387-5c12685ddfb3] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:46:15.888299 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-86fe6890-c04d-4572-ba1f-f67c961ee18f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0815c12c4340109ec1c379a0602322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20770fd1243d4412bfc90d2a079473bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:15.898608 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-86fe6890-c04d-4572-ba1f-f67c961ee18f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b" status: 200 len: 1321 microversion: 2.1 time: 0.375434 Sep 16 12:46:15.901735 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 166/332] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:15 2022] GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b => generated 1321 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:15.913640 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8076f5a1-d530-4af7-b0a2-203ceb2f4a06 tempest-AZAdminV2TestJSON-1048480787 tempest-AZAdminV2TestJSON-1048480787-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:15.915651 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8076f5a1-d530-4af7-b0a2-203ceb2f4a06 tempest-AZAdminV2TestJSON-1048480787 tempest-AZAdminV2TestJSON-1048480787-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:15.919927 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8076f5a1-d530-4af7-b0a2-203ceb2f4a06 tempest-AZAdminV2TestJSON-1048480787 tempest-AZAdminV2TestJSON-1048480787-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:15.920682 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8076f5a1-d530-4af7-b0a2-203ceb2f4a06 tempest-AZAdminV2TestJSON-1048480787 tempest-AZAdminV2TestJSON-1048480787-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:15.922002 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8076f5a1-d530-4af7-b0a2-203ceb2f4a06 tempest-AZAdminV2TestJSON-1048480787 tempest-AZAdminV2TestJSON-1048480787-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:15.922670 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8076f5a1-d530-4af7-b0a2-203ceb2f4a06 tempest-AZAdminV2TestJSON-1048480787 tempest-AZAdminV2TestJSON-1048480787-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:15.924670 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8076f5a1-d530-4af7-b0a2-203ceb2f4a06 tempest-AZAdminV2TestJSON-1048480787 tempest-AZAdminV2TestJSON-1048480787-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:15.977954 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ce7affe4-bab5-491b-930b-f8665e9e5ab2 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "DELETE /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3" status: 204 len: 0 microversion: 2.1 time: 0.435486 Sep 16 12:46:15.980979 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 167/333] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:46:15 2022] DELETE /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:46:15.994041 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8076f5a1-d530-4af7-b0a2-203ceb2f4a06 tempest-AZAdminV2TestJSON-1048480787 tempest-AZAdminV2TestJSON-1048480787-project-admin] 10.222.0.67 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.086389 Sep 16 12:46:15.996328 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 167/334] 10.222.0.67 () {58 vars in 1185 bytes} [Fri Sep 16 12:46:15 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:16.002229 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2b45dac1-fab5-4e3d-9bad-ae199fd75f1c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:16.003071 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-2b45dac1-fab5-4e3d-9bad-ae199fd75f1c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: dab4fa5f-1804-403e-9387-5c12685ddfb3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:16.012425 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2b45dac1-fab5-4e3d-9bad-ae199fd75f1c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:16.012927 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2b45dac1-fab5-4e3d-9bad-ae199fd75f1c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:16.013561 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2b45dac1-fab5-4e3d-9bad-ae199fd75f1c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:16.014872 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2b45dac1-fab5-4e3d-9bad-ae199fd75f1c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:16.015503 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2b45dac1-fab5-4e3d-9bad-ae199fd75f1c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:16.015934 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2b45dac1-fab5-4e3d-9bad-ae199fd75f1c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:16.071652 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2b45dac1-fab5-4e3d-9bad-ae199fd75f1c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:16.072618 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2b45dac1-fab5-4e3d-9bad-ae199fd75f1c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:16.073309 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2b45dac1-fab5-4e3d-9bad-ae199fd75f1c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:16.073998 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-2b45dac1-fab5-4e3d-9bad-ae199fd75f1c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lazy-loading 'fault' on Instance uuid dab4fa5f-1804-403e-9387-5c12685ddfb3 {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:46:16.278736 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-2b45dac1-fab5-4e3d-9bad-ae199fd75f1c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da877221336e4e58859c207fca5e857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b6b2ef87ef4629941a0cc9942d7e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:16.291834 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2b45dac1-fab5-4e3d-9bad-ae199fd75f1c tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3" status: 200 len: 1459 microversion: 2.1 time: 0.305664 Sep 16 12:46:16.298044 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 168/335] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:15 2022] GET /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3 => generated 1459 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:16.924463 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e2592008-f7aa-4ac0-94ba-f248eefa8b24 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:16.929899 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e2592008-f7aa-4ac0-94ba-f248eefa8b24 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: 4d860eb6-336f-4ba4-be81-d1ec6fecc87b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:16.943776 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2592008-f7aa-4ac0-94ba-f248eefa8b24 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:16.944589 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2592008-f7aa-4ac0-94ba-f248eefa8b24 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:16.945280 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2592008-f7aa-4ac0-94ba-f248eefa8b24 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:16.946561 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2592008-f7aa-4ac0-94ba-f248eefa8b24 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:16.958273 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2592008-f7aa-4ac0-94ba-f248eefa8b24 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:16.959230 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2592008-f7aa-4ac0-94ba-f248eefa8b24 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:17.325243 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0f057538-1087-4a24-b5a5-f0a0196b0f82 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:17.327061 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0f057538-1087-4a24-b5a5-f0a0196b0f82 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: dab4fa5f-1804-403e-9387-5c12685ddfb3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:17.343815 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0f057538-1087-4a24-b5a5-f0a0196b0f82 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:17.346032 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0f057538-1087-4a24-b5a5-f0a0196b0f82 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:17.348419 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0f057538-1087-4a24-b5a5-f0a0196b0f82 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:17.350493 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0f057538-1087-4a24-b5a5-f0a0196b0f82 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:17.351344 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0f057538-1087-4a24-b5a5-f0a0196b0f82 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:17.355499 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0f057538-1087-4a24-b5a5-f0a0196b0f82 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:17.466680 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0f057538-1087-4a24-b5a5-f0a0196b0f82 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:17.467164 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0f057538-1087-4a24-b5a5-f0a0196b0f82 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:17.467885 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0f057538-1087-4a24-b5a5-f0a0196b0f82 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:17.468371 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-0f057538-1087-4a24-b5a5-f0a0196b0f82 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lazy-loading 'fault' on Instance uuid dab4fa5f-1804-403e-9387-5c12685ddfb3 {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:46:17.686557 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e2592008-f7aa-4ac0-94ba-f248eefa8b24 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0815c12c4340109ec1c379a0602322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20770fd1243d4412bfc90d2a079473bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:17.694474 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e2592008-f7aa-4ac0-94ba-f248eefa8b24 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b" status: 200 len: 1321 microversion: 2.1 time: 0.774429 Sep 16 12:46:17.712611 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 168/336] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:16 2022] GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b => generated 1321 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:17.760431 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-2e4cbecf-6829-44ce-a3ba-de76942a14e5 req-5d36e8f0-1167-4edb-9773-074166dedc73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d860eb6-336f-4ba4-be81-d1ec6fecc87b", "tag": "4cbb6233-6017-40a2-a247-e622df5f31a3"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:17.793403 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2e4cbecf-6829-44ce-a3ba-de76942a14e5 req-5d36e8f0-1167-4edb-9773-074166dedc73 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:17.794564 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2e4cbecf-6829-44ce-a3ba-de76942a14e5 req-5d36e8f0-1167-4edb-9773-074166dedc73 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:17.795182 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2e4cbecf-6829-44ce-a3ba-de76942a14e5 req-5d36e8f0-1167-4edb-9773-074166dedc73 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:17.825369 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-2e4cbecf-6829-44ce-a3ba-de76942a14e5 req-5d36e8f0-1167-4edb-9773-074166dedc73 service nova] Creating event network-changed:4cbb6233-6017-40a2-a247-e622df5f31a3 for instance 4d860eb6-336f-4ba4-be81-d1ec6fecc87b on n-h1-858094-4 Sep 16 12:46:17.839926 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-2e4cbecf-6829-44ce-a3ba-de76942a14e5 req-5d36e8f0-1167-4edb-9773-074166dedc73 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091027 Sep 16 12:46:17.840891 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 169/337] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:18.020893 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0f057538-1087-4a24-b5a5-f0a0196b0f82 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da877221336e4e58859c207fca5e857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b6b2ef87ef4629941a0cc9942d7e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:18.032565 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0f057538-1087-4a24-b5a5-f0a0196b0f82 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3" status: 200 len: 1459 microversion: 2.1 time: 0.711366 Sep 16 12:46:18.049343 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 169/338] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:17 2022] GET /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3 => generated 1459 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:18.725016 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-334c0139-e425-4432-b696-b6c55add950f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:18.726488 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-334c0139-e425-4432-b696-b6c55add950f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: 4d860eb6-336f-4ba4-be81-d1ec6fecc87b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:18.746983 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-334c0139-e425-4432-b696-b6c55add950f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:18.747440 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-334c0139-e425-4432-b696-b6c55add950f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:18.752235 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-334c0139-e425-4432-b696-b6c55add950f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:18.753962 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-334c0139-e425-4432-b696-b6c55add950f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:18.754710 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-334c0139-e425-4432-b696-b6c55add950f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:18.756682 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-334c0139-e425-4432-b696-b6c55add950f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:19.057872 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-037a4c4b-2b08-491c-8d2b-457272d6caa1 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:19.058509 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-037a4c4b-2b08-491c-8d2b-457272d6caa1 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: dab4fa5f-1804-403e-9387-5c12685ddfb3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:19.067795 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-037a4c4b-2b08-491c-8d2b-457272d6caa1 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:19.069208 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-037a4c4b-2b08-491c-8d2b-457272d6caa1 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:19.073175 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-037a4c4b-2b08-491c-8d2b-457272d6caa1 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:19.078054 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-037a4c4b-2b08-491c-8d2b-457272d6caa1 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:19.079052 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-037a4c4b-2b08-491c-8d2b-457272d6caa1 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:19.079696 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-037a4c4b-2b08-491c-8d2b-457272d6caa1 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:19.183851 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-037a4c4b-2b08-491c-8d2b-457272d6caa1 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:19.184442 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-037a4c4b-2b08-491c-8d2b-457272d6caa1 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:19.184902 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-037a4c4b-2b08-491c-8d2b-457272d6caa1 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:19.185397 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-037a4c4b-2b08-491c-8d2b-457272d6caa1 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lazy-loading 'fault' on Instance uuid dab4fa5f-1804-403e-9387-5c12685ddfb3 {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:46:19.344792 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-334c0139-e425-4432-b696-b6c55add950f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0815c12c4340109ec1c379a0602322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20770fd1243d4412bfc90d2a079473bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:19.352230 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-037a4c4b-2b08-491c-8d2b-457272d6caa1 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da877221336e4e58859c207fca5e857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b6b2ef87ef4629941a0cc9942d7e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:19.368906 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-334c0139-e425-4432-b696-b6c55add950f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b" status: 200 len: 1321 microversion: 2.1 time: 0.647828 Sep 16 12:46:19.369377 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-037a4c4b-2b08-491c-8d2b-457272d6caa1 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3" status: 200 len: 1417 microversion: 2.1 time: 0.315758 Sep 16 12:46:19.371523 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 170/339] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:19 2022] GET /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3 => generated 1417 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:19.399019 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 170/340] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:18 2022] GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b => generated 1321 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:19.979540 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-3299ab92-e9f2-48ac-93d8-02a6652a5d60 req-0782b85d-9780-4a03-8753-0ababddce4e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dab4fa5f-1804-403e-9387-5c12685ddfb3", "name": "network-vif-deleted", "tag": "5b604c8c-012f-4e9f-a5b7-54d52a817f1a"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:19.999412 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-3299ab92-e9f2-48ac-93d8-02a6652a5d60 req-0782b85d-9780-4a03-8753-0ababddce4e0 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:20.000298 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-3299ab92-e9f2-48ac-93d8-02a6652a5d60 req-0782b85d-9780-4a03-8753-0ababddce4e0 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:20.001253 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-3299ab92-e9f2-48ac-93d8-02a6652a5d60 req-0782b85d-9780-4a03-8753-0ababddce4e0 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:20.039594 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-3299ab92-e9f2-48ac-93d8-02a6652a5d60 req-0782b85d-9780-4a03-8753-0ababddce4e0 service nova] Creating event network-vif-deleted:5b604c8c-012f-4e9f-a5b7-54d52a817f1a for instance dab4fa5f-1804-403e-9387-5c12685ddfb3 on n-h2-858094-4 Sep 16 12:46:20.050929 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-3299ab92-e9f2-48ac-93d8-02a6652a5d60 req-0782b85d-9780-4a03-8753-0ababddce4e0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076811 Sep 16 12:46:20.055002 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 171/341] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:20.403250 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6b7c158a-ef61-484f-9b54-c91317ec95d5 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:20.405036 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ecc840d3-8548-40dc-9b82-36226d6eec3a tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:20.406210 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6b7c158a-ef61-484f-9b54-c91317ec95d5 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: 4d860eb6-336f-4ba4-be81-d1ec6fecc87b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:20.406864 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ecc840d3-8548-40dc-9b82-36226d6eec3a tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: dab4fa5f-1804-403e-9387-5c12685ddfb3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:20.425301 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b7c158a-ef61-484f-9b54-c91317ec95d5 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:20.426251 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ecc840d3-8548-40dc-9b82-36226d6eec3a tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:20.426966 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ecc840d3-8548-40dc-9b82-36226d6eec3a tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:20.427428 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b7c158a-ef61-484f-9b54-c91317ec95d5 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:20.427990 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b7c158a-ef61-484f-9b54-c91317ec95d5 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:20.429831 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ecc840d3-8548-40dc-9b82-36226d6eec3a tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:20.430810 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ecc840d3-8548-40dc-9b82-36226d6eec3a tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:20.431415 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b7c158a-ef61-484f-9b54-c91317ec95d5 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:20.432749 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b7c158a-ef61-484f-9b54-c91317ec95d5 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:20.432969 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ecc840d3-8548-40dc-9b82-36226d6eec3a tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:20.433599 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b7c158a-ef61-484f-9b54-c91317ec95d5 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:20.434610 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ecc840d3-8548-40dc-9b82-36226d6eec3a tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:20.473063 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-ecc840d3-8548-40dc-9b82-36226d6eec3a tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] HTTP exception thrown: Instance dab4fa5f-1804-403e-9387-5c12685ddfb3 could not be found. Sep 16 12:46:20.477935 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ecc840d3-8548-40dc-9b82-36226d6eec3a tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Request method failure captured: Sep 16 12:46:20.477935 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3 HTTP/1.1 Sep 16 12:46:20.477935 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:46:20.477935 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:46:20.477935 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:46:20.477935 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:46:20.477935 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:46:20.477935 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:46:20.477935 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:46:20.477935 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:46:20.477935 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJG_aXJ-jOi44QzEE6jtjSUcTLFo3CTXgtANbx9pxAV6teugnqsJnF-5xHLbNeLTOC3tI75BtPhY6GK_fOll9MJM24O7e3Oec9dPloeIC-A1kxwQLjtGaYe7X_Uu4KDdLnUh9iDgU80j-ygIAk6Amn7GE9j_XNSc4UrKVi3zpuouD0ys Sep 16 12:46:20.477935 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:46:20.477935 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:46:20.477935 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:46:20.477935 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:46:20.477935 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:46:20.477935 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:46:20.477935 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: e1b6b2ef87ef4629941a0cc9942d7e4c Sep 16 12:46:20.477935 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1508389863 Sep 16 12:46:20.477935 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:46:20.477935 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:46:20.479339 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e1b6b2ef87ef4629941a0cc9942d7e4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e1b6b2ef87ef4629941a0cc9942d7e4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e1b6b2ef87ef4629941a0cc9942d7e4c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e1b6b2ef87ef4629941a0cc9942d7e4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:46:20.479339 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-DeleteServersAdminTestJSON-1508389863 Sep 16 12:46:20.479339 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: e1b6b2ef87ef4629941a0cc9942d7e4c Sep 16 12:46:20.479339 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1508389863 Sep 16 12:46:20.479339 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-DeleteServersAdminTestJSON-1508389863-project Sep 16 12:46:20.479339 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:46:20.479339 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:46:20.479339 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: da877221336e4e58859c207fca5e857c Sep 16 12:46:20.479339 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-DeleteServersAdminTestJSON-1508389863-project Sep 16 12:46:20.479339 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:46:20.479339 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance dab4fa5f-1804-403e-9387-5c12685ddfb3 could not be found. Sep 16 12:46:20.479339 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'dab4fa5f-1804-403e-9387-5c12685ddfb3'} Sep 16 12:46:20.480134 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:46:20.480134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:20.480134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:46:20.480134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:46:20.480134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:46:20.480134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:46:20.480134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:46:20.480134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:46:20.480134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:46:20.480134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:46:20.480134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dab4fa5f-1804-403e-9387-5c12685ddfb3 could not be found. Sep 16 12:46:20.480134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:20.480134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:20.480134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:20.480134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:20.480134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:20.480134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:20.480134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:46:20.480134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:46:20.480134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:46:20.481323 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:46:20.481323 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:46:20.481323 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:46:20.481323 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:46:20.481323 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:46:20.481323 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:46:20.481323 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:46:20.481323 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dab4fa5f-1804-403e-9387-5c12685ddfb3 could not be found. Sep 16 12:46:20.481323 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:20.481323 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:20.481323 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:20.481323 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:20.481323 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:20.481323 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:20.481323 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:46:20.481323 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:46:20.481323 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dab4fa5f-1804-403e-9387-5c12685ddfb3 could not be found. Sep 16 12:46:20.481323 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:20.484852 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ecc840d3-8548-40dc-9b82-36226d6eec3a tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Returning 404 to user: Instance dab4fa5f-1804-403e-9387-5c12685ddfb3 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:46:20.486166 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ecc840d3-8548-40dc-9b82-36226d6eec3a tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3" status: 404 len: 111 microversion: 2.1 time: 0.093248 Sep 16 12:46:20.487506 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 172/342] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:20 2022] GET /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 12:46:20.500113 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-bda1354e-34dd-4fba-ae48-5302e890fdce tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:20.501523 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-bda1354e-34dd-4fba-ae48-5302e890fdce tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: dab4fa5f-1804-403e-9387-5c12685ddfb3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:20.510065 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bda1354e-34dd-4fba-ae48-5302e890fdce tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:20.510925 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bda1354e-34dd-4fba-ae48-5302e890fdce tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:20.511573 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bda1354e-34dd-4fba-ae48-5302e890fdce tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:20.512339 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bda1354e-34dd-4fba-ae48-5302e890fdce tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:20.513522 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bda1354e-34dd-4fba-ae48-5302e890fdce tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:20.514444 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bda1354e-34dd-4fba-ae48-5302e890fdce tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:20.531969 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-bda1354e-34dd-4fba-ae48-5302e890fdce tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] HTTP exception thrown: Instance dab4fa5f-1804-403e-9387-5c12685ddfb3 could not be found. Sep 16 12:46:20.534982 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-bda1354e-34dd-4fba-ae48-5302e890fdce tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Request method failure captured: Sep 16 12:46:20.534982 n-d-858094-4 devstack@n-api.service[128780]: request: DELETE /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3 HTTP/1.1 Sep 16 12:46:20.534982 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:46:20.534982 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:46:20.534982 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:46:20.534982 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:46:20.534982 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:46:20.534982 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:46:20.534982 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:46:20.534982 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:46:20.534982 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJG_aXJ-jOi44QzEE6jtjSUcTLFo3CTXgtANbx9pxAV6teugnqsJnF-5xHLbNeLTOC3tI75BtPhY6GK_fOll9MJM24O7e3Oec9dPloeIC-A1kxwQLjtGaYe7X_Uu4KDdLnUh9iDgU80j-ygIAk6Amn7GE9j_XNSc4UrKVi3zpuouD0ys Sep 16 12:46:20.534982 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:46:20.534982 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:46:20.534982 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:46:20.534982 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:46:20.534982 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:46:20.534982 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:46:20.534982 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: e1b6b2ef87ef4629941a0cc9942d7e4c Sep 16 12:46:20.534982 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1508389863 Sep 16 12:46:20.534982 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:46:20.534982 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:46:20.536346 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e1b6b2ef87ef4629941a0cc9942d7e4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e1b6b2ef87ef4629941a0cc9942d7e4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e1b6b2ef87ef4629941a0cc9942d7e4c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e1b6b2ef87ef4629941a0cc9942d7e4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:46:20.536346 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-DeleteServersAdminTestJSON-1508389863 Sep 16 12:46:20.536346 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: e1b6b2ef87ef4629941a0cc9942d7e4c Sep 16 12:46:20.536346 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1508389863 Sep 16 12:46:20.536346 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-DeleteServersAdminTestJSON-1508389863-project Sep 16 12:46:20.536346 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:46:20.536346 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:46:20.536346 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: da877221336e4e58859c207fca5e857c Sep 16 12:46:20.536346 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-DeleteServersAdminTestJSON-1508389863-project Sep 16 12:46:20.536346 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:46:20.536346 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance dab4fa5f-1804-403e-9387-5c12685ddfb3 could not be found. Sep 16 12:46:20.536346 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'dab4fa5f-1804-403e-9387-5c12685ddfb3'} Sep 16 12:46:20.537148 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:46:20.537148 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:20.537148 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:46:20.537148 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:46:20.537148 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:46:20.537148 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:46:20.537148 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:46:20.537148 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:46:20.537148 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:46:20.537148 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:46:20.537148 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dab4fa5f-1804-403e-9387-5c12685ddfb3 could not be found. Sep 16 12:46:20.537148 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:20.537148 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:20.537148 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:20.537148 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:20.537148 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:20.537148 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:20.537148 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:46:20.537148 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:46:20.537148 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:46:20.538276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:46:20.538276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 12:46:20.538276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 12:46:20.538276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 12:46:20.538276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 12:46:20.538276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:46:20.538276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:46:20.538276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:46:20.538276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:46:20.538276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dab4fa5f-1804-403e-9387-5c12685ddfb3 could not be found. Sep 16 12:46:20.538276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:20.538276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:20.538276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:20.538276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:20.538276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:20.538276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:20.538276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:46:20.538276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:46:20.538276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dab4fa5f-1804-403e-9387-5c12685ddfb3 could not be found. Sep 16 12:46:20.538276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:20.541703 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-bda1354e-34dd-4fba-ae48-5302e890fdce tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Returning 404 to user: Instance dab4fa5f-1804-403e-9387-5c12685ddfb3 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:46:20.542668 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-bda1354e-34dd-4fba-ae48-5302e890fdce tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "DELETE /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3" status: 404 len: 111 microversion: 2.1 time: 0.049114 Sep 16 12:46:20.543865 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 173/343] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:46:20 2022] DELETE /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:46:20.551787 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-59682262-6777-4001-822a-42224c559eab tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:20.557406 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-59682262-6777-4001-822a-42224c559eab tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: dab4fa5f-1804-403e-9387-5c12685ddfb3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:20.571756 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-59682262-6777-4001-822a-42224c559eab tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:20.573695 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-59682262-6777-4001-822a-42224c559eab tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:20.574752 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-59682262-6777-4001-822a-42224c559eab tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:20.576558 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-59682262-6777-4001-822a-42224c559eab tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:20.578641 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-59682262-6777-4001-822a-42224c559eab tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:20.579080 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-59682262-6777-4001-822a-42224c559eab tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:20.606731 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-59682262-6777-4001-822a-42224c559eab tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] HTTP exception thrown: Instance dab4fa5f-1804-403e-9387-5c12685ddfb3 could not be found. Sep 16 12:46:20.608864 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-59682262-6777-4001-822a-42224c559eab tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Request method failure captured: Sep 16 12:46:20.608864 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3 HTTP/1.1 Sep 16 12:46:20.608864 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:46:20.608864 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:46:20.608864 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:46:20.608864 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:46:20.608864 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:46:20.608864 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:46:20.608864 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:46:20.608864 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:46:20.608864 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJG_aXJ-jOi44QzEE6jtjSUcTLFo3CTXgtANbx9pxAV6teugnqsJnF-5xHLbNeLTOC3tI75BtPhY6GK_fOll9MJM24O7e3Oec9dPloeIC-A1kxwQLjtGaYe7X_Uu4KDdLnUh9iDgU80j-ygIAk6Amn7GE9j_XNSc4UrKVi3zpuouD0ys Sep 16 12:46:20.608864 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:46:20.608864 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:46:20.608864 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:46:20.608864 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:46:20.608864 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:46:20.608864 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:46:20.608864 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: e1b6b2ef87ef4629941a0cc9942d7e4c Sep 16 12:46:20.608864 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1508389863 Sep 16 12:46:20.608864 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:46:20.608864 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:46:20.610074 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e1b6b2ef87ef4629941a0cc9942d7e4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e1b6b2ef87ef4629941a0cc9942d7e4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e1b6b2ef87ef4629941a0cc9942d7e4c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e1b6b2ef87ef4629941a0cc9942d7e4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:46:20.610074 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-DeleteServersAdminTestJSON-1508389863 Sep 16 12:46:20.610074 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: e1b6b2ef87ef4629941a0cc9942d7e4c Sep 16 12:46:20.610074 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1508389863 Sep 16 12:46:20.610074 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-DeleteServersAdminTestJSON-1508389863-project Sep 16 12:46:20.610074 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:46:20.610074 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:46:20.610074 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: da877221336e4e58859c207fca5e857c Sep 16 12:46:20.610074 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-DeleteServersAdminTestJSON-1508389863-project Sep 16 12:46:20.610074 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:46:20.610074 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance dab4fa5f-1804-403e-9387-5c12685ddfb3 could not be found. Sep 16 12:46:20.610074 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'dab4fa5f-1804-403e-9387-5c12685ddfb3'} Sep 16 12:46:20.610954 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:46:20.610954 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:20.610954 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:46:20.610954 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:46:20.610954 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:46:20.610954 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:46:20.610954 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:46:20.610954 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:46:20.610954 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:46:20.610954 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:46:20.610954 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dab4fa5f-1804-403e-9387-5c12685ddfb3 could not be found. Sep 16 12:46:20.610954 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:20.610954 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:20.610954 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:20.610954 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:20.610954 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:20.610954 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:20.610954 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:46:20.610954 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:46:20.610954 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:46:20.612085 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:46:20.612085 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:46:20.612085 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:46:20.612085 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:46:20.612085 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:46:20.612085 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:46:20.612085 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:46:20.612085 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dab4fa5f-1804-403e-9387-5c12685ddfb3 could not be found. Sep 16 12:46:20.612085 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:20.612085 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:20.612085 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:20.612085 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:20.612085 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:20.612085 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:20.612085 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:46:20.612085 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:46:20.612085 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dab4fa5f-1804-403e-9387-5c12685ddfb3 could not be found. Sep 16 12:46:20.612085 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:20.615292 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-59682262-6777-4001-822a-42224c559eab tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Returning 404 to user: Instance dab4fa5f-1804-403e-9387-5c12685ddfb3 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:46:20.615292 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-59682262-6777-4001-822a-42224c559eab tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3" status: 404 len: 111 microversion: 2.1 time: 0.062485 Sep 16 12:46:20.618948 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 174/344] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:20 2022] GET /compute/v2.1/servers/dab4fa5f-1804-403e-9387-5c12685ddfb3 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:46:20.633639 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1e9b36c5-9d89-4cc3-b373-ec4852eebbd7 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:20.634352 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-1e9b36c5-9d89-4cc3-b373-ec4852eebbd7 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: 3ab83a18-0e02-4082-a9f8-b7f93ad2e347] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:20.641982 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1e9b36c5-9d89-4cc3-b373-ec4852eebbd7 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:20.642645 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1e9b36c5-9d89-4cc3-b373-ec4852eebbd7 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:20.643247 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1e9b36c5-9d89-4cc3-b373-ec4852eebbd7 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:20.644106 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1e9b36c5-9d89-4cc3-b373-ec4852eebbd7 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:20.644736 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1e9b36c5-9d89-4cc3-b373-ec4852eebbd7 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:20.645476 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1e9b36c5-9d89-4cc3-b373-ec4852eebbd7 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:20.683402 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-1e9b36c5-9d89-4cc3-b373-ec4852eebbd7 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] HTTP exception thrown: Instance 3ab83a18-0e02-4082-a9f8-b7f93ad2e347 could not be found. Sep 16 12:46:20.686425 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1e9b36c5-9d89-4cc3-b373-ec4852eebbd7 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Request method failure captured: Sep 16 12:46:20.686425 n-d-858094-4 devstack@n-api.service[128780]: request: DELETE /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347 HTTP/1.1 Sep 16 12:46:20.686425 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:46:20.686425 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:46:20.686425 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:46:20.686425 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:46:20.686425 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:46:20.686425 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:46:20.686425 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:46:20.686425 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:46:20.686425 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJG_aXJ-jOi44QzEE6jtjSUcTLFo3CTXgtANbx9pxAV6teugnqsJnF-5xHLbNeLTOC3tI75BtPhY6GK_fOll9MJM24O7e3Oec9dPloeIC-A1kxwQLjtGaYe7X_Uu4KDdLnUh9iDgU80j-ygIAk6Amn7GE9j_XNSc4UrKVi3zpuouD0ys Sep 16 12:46:20.686425 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:46:20.686425 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:46:20.686425 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:46:20.686425 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:46:20.686425 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:46:20.686425 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:46:20.686425 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: e1b6b2ef87ef4629941a0cc9942d7e4c Sep 16 12:46:20.686425 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1508389863 Sep 16 12:46:20.686425 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:46:20.686425 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:46:20.687674 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e1b6b2ef87ef4629941a0cc9942d7e4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e1b6b2ef87ef4629941a0cc9942d7e4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e1b6b2ef87ef4629941a0cc9942d7e4c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e1b6b2ef87ef4629941a0cc9942d7e4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:46:20.687674 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-DeleteServersAdminTestJSON-1508389863 Sep 16 12:46:20.687674 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: e1b6b2ef87ef4629941a0cc9942d7e4c Sep 16 12:46:20.687674 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1508389863 Sep 16 12:46:20.687674 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-DeleteServersAdminTestJSON-1508389863-project Sep 16 12:46:20.687674 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:46:20.687674 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:46:20.687674 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: da877221336e4e58859c207fca5e857c Sep 16 12:46:20.687674 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-DeleteServersAdminTestJSON-1508389863-project Sep 16 12:46:20.687674 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:46:20.687674 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance 3ab83a18-0e02-4082-a9f8-b7f93ad2e347 could not be found. Sep 16 12:46:20.687674 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '3ab83a18-0e02-4082-a9f8-b7f93ad2e347'} Sep 16 12:46:20.688394 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:46:20.688394 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:20.688394 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:46:20.688394 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:46:20.688394 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:46:20.688394 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:46:20.688394 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:46:20.688394 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:46:20.688394 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:46:20.688394 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:46:20.688394 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ab83a18-0e02-4082-a9f8-b7f93ad2e347 could not be found. Sep 16 12:46:20.688394 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:20.688394 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:20.688394 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:20.688394 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:20.688394 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:20.688394 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:20.688394 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:46:20.688394 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:46:20.688394 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:46:20.689475 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:46:20.689475 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 12:46:20.689475 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 12:46:20.689475 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 12:46:20.689475 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 12:46:20.689475 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:46:20.689475 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:46:20.689475 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:46:20.689475 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:46:20.689475 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ab83a18-0e02-4082-a9f8-b7f93ad2e347 could not be found. Sep 16 12:46:20.689475 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:20.689475 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:20.689475 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:20.689475 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:20.689475 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:20.689475 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:20.689475 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:46:20.689475 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:46:20.689475 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ab83a18-0e02-4082-a9f8-b7f93ad2e347 could not be found. Sep 16 12:46:20.689475 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:20.690555 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1e9b36c5-9d89-4cc3-b373-ec4852eebbd7 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Returning 404 to user: Instance 3ab83a18-0e02-4082-a9f8-b7f93ad2e347 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:46:20.690555 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1e9b36c5-9d89-4cc3-b373-ec4852eebbd7 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347" status: 404 len: 111 microversion: 2.1 time: 0.064837 Sep 16 12:46:20.690555 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 175/345] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:46:20 2022] DELETE /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:46:20.697721 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-872d39f7-aced-43e4-91bc-0260f8a51ce8 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:20.698531 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-872d39f7-aced-43e4-91bc-0260f8a51ce8 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] [instance: 3ab83a18-0e02-4082-a9f8-b7f93ad2e347] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:20.704772 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-872d39f7-aced-43e4-91bc-0260f8a51ce8 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:20.706836 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-872d39f7-aced-43e4-91bc-0260f8a51ce8 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:20.709025 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-872d39f7-aced-43e4-91bc-0260f8a51ce8 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:20.709898 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-872d39f7-aced-43e4-91bc-0260f8a51ce8 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:20.713018 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-872d39f7-aced-43e4-91bc-0260f8a51ce8 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:20.713604 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-872d39f7-aced-43e4-91bc-0260f8a51ce8 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:20.758324 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-872d39f7-aced-43e4-91bc-0260f8a51ce8 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] HTTP exception thrown: Instance 3ab83a18-0e02-4082-a9f8-b7f93ad2e347 could not be found. Sep 16 12:46:20.763122 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-872d39f7-aced-43e4-91bc-0260f8a51ce8 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Request method failure captured: Sep 16 12:46:20.763122 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347 HTTP/1.1 Sep 16 12:46:20.763122 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:46:20.763122 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:46:20.763122 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:46:20.763122 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:46:20.763122 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:46:20.763122 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:46:20.763122 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:46:20.763122 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:46:20.763122 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJG_aXJ-jOi44QzEE6jtjSUcTLFo3CTXgtANbx9pxAV6teugnqsJnF-5xHLbNeLTOC3tI75BtPhY6GK_fOll9MJM24O7e3Oec9dPloeIC-A1kxwQLjtGaYe7X_Uu4KDdLnUh9iDgU80j-ygIAk6Amn7GE9j_XNSc4UrKVi3zpuouD0ys Sep 16 12:46:20.763122 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:46:20.763122 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:46:20.763122 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:46:20.763122 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:46:20.763122 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:46:20.763122 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:46:20.763122 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: e1b6b2ef87ef4629941a0cc9942d7e4c Sep 16 12:46:20.763122 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1508389863 Sep 16 12:46:20.763122 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:46:20.763122 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:46:20.764361 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e1b6b2ef87ef4629941a0cc9942d7e4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e1b6b2ef87ef4629941a0cc9942d7e4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e1b6b2ef87ef4629941a0cc9942d7e4c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e1b6b2ef87ef4629941a0cc9942d7e4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:46:20.764361 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-DeleteServersAdminTestJSON-1508389863 Sep 16 12:46:20.764361 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: e1b6b2ef87ef4629941a0cc9942d7e4c Sep 16 12:46:20.764361 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1508389863 Sep 16 12:46:20.764361 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-DeleteServersAdminTestJSON-1508389863-project Sep 16 12:46:20.764361 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:46:20.764361 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:46:20.764361 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: da877221336e4e58859c207fca5e857c Sep 16 12:46:20.764361 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-DeleteServersAdminTestJSON-1508389863-project Sep 16 12:46:20.764361 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:46:20.764361 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance 3ab83a18-0e02-4082-a9f8-b7f93ad2e347 could not be found. Sep 16 12:46:20.764361 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '3ab83a18-0e02-4082-a9f8-b7f93ad2e347'} Sep 16 12:46:20.765061 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:46:20.765061 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:20.765061 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:46:20.765061 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:46:20.765061 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:46:20.765061 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:46:20.765061 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:46:20.765061 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:46:20.765061 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:46:20.765061 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:46:20.765061 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ab83a18-0e02-4082-a9f8-b7f93ad2e347 could not be found. Sep 16 12:46:20.765061 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:20.765061 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:20.765061 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:20.765061 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:20.765061 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:20.765061 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:20.765061 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:46:20.765061 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:46:20.765061 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:46:20.766226 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:46:20.766226 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:46:20.766226 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:46:20.766226 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:46:20.766226 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:46:20.766226 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:46:20.766226 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:46:20.766226 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ab83a18-0e02-4082-a9f8-b7f93ad2e347 could not be found. Sep 16 12:46:20.766226 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:20.766226 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:20.766226 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:20.766226 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:20.766226 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:20.766226 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:20.766226 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:46:20.766226 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:46:20.766226 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ab83a18-0e02-4082-a9f8-b7f93ad2e347 could not be found. Sep 16 12:46:20.766226 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:20.767183 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-872d39f7-aced-43e4-91bc-0260f8a51ce8 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] Returning 404 to user: Instance 3ab83a18-0e02-4082-a9f8-b7f93ad2e347 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:46:20.767861 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-872d39f7-aced-43e4-91bc-0260f8a51ce8 tempest-DeleteServersAdminTestJSON-1508389863 tempest-DeleteServersAdminTestJSON-1508389863-project] 10.222.0.67 "GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347" status: 404 len: 111 microversion: 2.1 time: 0.074811 Sep 16 12:46:20.771717 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 176/346] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:20 2022] GET /compute/v2.1/servers/3ab83a18-0e02-4082-a9f8-b7f93ad2e347 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:46:20.785615 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6b7c158a-ef61-484f-9b54-c91317ec95d5 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0815c12c4340109ec1c379a0602322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20770fd1243d4412bfc90d2a079473bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:20.807182 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6b7c158a-ef61-484f-9b54-c91317ec95d5 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b" status: 200 len: 1321 microversion: 2.1 time: 0.416881 Sep 16 12:46:20.816207 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 171/347] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:20 2022] GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b => generated 1321 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:21.833135 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-01e9bca3-812a-467c-890e-d1b255b846b9 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:21.834471 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-01e9bca3-812a-467c-890e-d1b255b846b9 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: 4d860eb6-336f-4ba4-be81-d1ec6fecc87b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:21.850456 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-01e9bca3-812a-467c-890e-d1b255b846b9 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:21.851198 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-01e9bca3-812a-467c-890e-d1b255b846b9 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:21.851665 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-01e9bca3-812a-467c-890e-d1b255b846b9 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:21.852562 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-01e9bca3-812a-467c-890e-d1b255b846b9 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:21.853119 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-01e9bca3-812a-467c-890e-d1b255b846b9 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:21.854130 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-01e9bca3-812a-467c-890e-d1b255b846b9 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:22.159372 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-01e9bca3-812a-467c-890e-d1b255b846b9 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0815c12c4340109ec1c379a0602322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20770fd1243d4412bfc90d2a079473bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:22.171956 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-01e9bca3-812a-467c-890e-d1b255b846b9 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b" status: 200 len: 1321 microversion: 2.1 time: 0.342951 Sep 16 12:46:22.177516 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 177/348] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:21 2022] GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b => generated 1321 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:22.725263 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3e52a2e9-96db-43d0-beb1-770b446427f8 tempest-QuotaClassesAdmin257Test-943212575 tempest-QuotaClassesAdmin257Test-943212575-project-admin] Calling method '.version_select at 0x7f10362bbb80>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:22.744189 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3e52a2e9-96db-43d0-beb1-770b446427f8 tempest-QuotaClassesAdmin257Test-943212575 tempest-QuotaClassesAdmin257Test-943212575-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.788408 Sep 16 12:46:22.745555 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 172/349] 10.222.0.67 () {60 vars in 1226 bytes} [Fri Sep 16 12:46:21 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:46:22.758458 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3ce8589e-f028-4bbb-88f2-ee587ec92d68 tempest-QuotaClassesAdmin257Test-943212575 tempest-QuotaClassesAdmin257Test-943212575-project-admin] Action: 'update', calling method: .version_select at 0x7f10363345e0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:22.973012 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=8,nova_api:INSERT=7 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:46:22.989657 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3ce8589e-f028-4bbb-88f2-ee587ec92d68 tempest-QuotaClassesAdmin257Test-943212575 tempest-QuotaClassesAdmin257Test-943212575-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.235373 Sep 16 12:46:22.992263 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 178/350] 10.222.0.67 () {62 vars in 1247 bytes} [Fri Sep 16 12:46:22 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:46:23.004588 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e70d37c0-17d5-4602-ad71-9bbb2836fa06 tempest-QuotaClassesAdmin257Test-943212575 tempest-QuotaClassesAdmin257Test-943212575-project-admin] Calling method '.version_select at 0x7f103624a3a0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:23.033968 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e70d37c0-17d5-4602-ad71-9bbb2836fa06 tempest-QuotaClassesAdmin257Test-943212575 tempest-QuotaClassesAdmin257Test-943212575-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.035598 Sep 16 12:46:23.050711 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-521d7360-3a64-4684-b52d-2c9fa3d7cd40 tempest-QuotaClassesAdmin257Test-943212575 tempest-QuotaClassesAdmin257Test-943212575-project-admin] Action: 'update', calling method: .version_select at 0x7f1035ff3790>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:23.051731 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 173/351] 10.222.0.67 () {60 vars in 1226 bytes} [Fri Sep 16 12:46:22 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:46:23.177710 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-521d7360-3a64-4684-b52d-2c9fa3d7cd40 tempest-QuotaClassesAdmin257Test-943212575 tempest-QuotaClassesAdmin257Test-943212575-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.131468 Sep 16 12:46:23.183593 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 179/352] 10.222.0.67 () {62 vars in 1247 bytes} [Fri Sep 16 12:46:23 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:46:23.214017 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fefe9e50-5c24-4e78-9932-5ddb4f69fb92 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:23.214791 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fefe9e50-5c24-4e78-9932-5ddb4f69fb92 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: 4d860eb6-336f-4ba4-be81-d1ec6fecc87b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:23.225106 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fefe9e50-5c24-4e78-9932-5ddb4f69fb92 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:23.225902 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fefe9e50-5c24-4e78-9932-5ddb4f69fb92 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:23.226518 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fefe9e50-5c24-4e78-9932-5ddb4f69fb92 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:23.230006 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fefe9e50-5c24-4e78-9932-5ddb4f69fb92 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:23.231056 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fefe9e50-5c24-4e78-9932-5ddb4f69fb92 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:23.232432 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fefe9e50-5c24-4e78-9932-5ddb4f69fb92 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:23.529043 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fefe9e50-5c24-4e78-9932-5ddb4f69fb92 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0815c12c4340109ec1c379a0602322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20770fd1243d4412bfc90d2a079473bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:23.537621 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fefe9e50-5c24-4e78-9932-5ddb4f69fb92 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b" status: 200 len: 1321 microversion: 2.1 time: 0.329289 Sep 16 12:46:23.559335 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 174/353] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:23 2022] GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b => generated 1321 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:24.438490 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fb7ef43b-dafb-402b-a04b-a2c7f6e33cd5 tempest-KeyPairsV210TestJSON-1637291764 tempest-KeyPairsV210TestJSON-1637291764-project-admin] Action: 'create', calling method: .version_select at 0x7f103618daf0>, body: {"keypair": {"name": "tempest-keypair-1018092636", "type": "ssh", "user_id": "51339b4722494c988fb19e1a99e9cbc5", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxcvVU3WwbcUNXLISry9FIotUc07/hoPnUvnPWfg4caRIz8kvHPC7nNwaN4VAk8FyyWpglpxwNgM/yB9lZ/vAMEd6x2TjnP2HhlhW40atLBSpoKh6yqvio2RYnIIvhfFw=="}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:24.497277 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-fb7ef43b-dafb-402b-a04b-a2c7f6e33cd5 tempest-KeyPairsV210TestJSON-1637291764 tempest-KeyPairsV210TestJSON-1637291764-project-admin] Getting quotas for project cfa2f72beb954e779afac30045c81775. Resources: {'key_pairs'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:46:24.512611 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-fb7ef43b-dafb-402b-a04b-a2c7f6e33cd5 tempest-KeyPairsV210TestJSON-1637291764 tempest-KeyPairsV210TestJSON-1637291764-project-admin] Getting quotas for user 77904b54bbb04acf98136ab3e00c537c and project cfa2f72beb954e779afac30045c81775. Resources: {'key_pairs'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:46:24.568651 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-91c7b5e6-94c5-4371-a7fb-7c513298ab69 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:24.570254 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-91c7b5e6-94c5-4371-a7fb-7c513298ab69 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: 4d860eb6-336f-4ba4-be81-d1ec6fecc87b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:24.578018 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-fb7ef43b-dafb-402b-a04b-a2c7f6e33cd5 tempest-KeyPairsV210TestJSON-1637291764 tempest-KeyPairsV210TestJSON-1637291764-project-admin] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.674911 Sep 16 12:46:24.590970 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 180/354] 10.222.0.67 () {62 vars in 1200 bytes} [Fri Sep 16 12:46:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 680 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 16 12:46:24.591206 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-91c7b5e6-94c5-4371-a7fb-7c513298ab69 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:24.591206 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-91c7b5e6-94c5-4371-a7fb-7c513298ab69 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:24.591206 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-91c7b5e6-94c5-4371-a7fb-7c513298ab69 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:24.591206 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-91c7b5e6-94c5-4371-a7fb-7c513298ab69 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:24.591604 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-91c7b5e6-94c5-4371-a7fb-7c513298ab69 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:24.591604 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-91c7b5e6-94c5-4371-a7fb-7c513298ab69 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:24.601675 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e1273982-7fdc-495c-ba39-510b2cfe9df9 tempest-KeyPairsV210TestJSON-1637291764 tempest-KeyPairsV210TestJSON-1637291764-project-admin] Action: 'create', calling method: .version_select at 0x7f103605dca0>, body: {"keypair": {"name": "tempest-keypair-2026043160", "type": "ssh", "user_id": "51339b4722494c988fb19e1a99e9cbc5", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNM5ovFv/3u72JCjr4kHm4SWUp8rB+f/e8VIe+viGzp7trCG9jJDlDO53r+45w9XRRiDcMkmndXN4vR5gnKmf+oZdgbJfR/Hac2LJguwf/jhlcT13w2a+MsT41/WtRMqew=="}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:24.649714 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-e1273982-7fdc-495c-ba39-510b2cfe9df9 tempest-KeyPairsV210TestJSON-1637291764 tempest-KeyPairsV210TestJSON-1637291764-project-admin] Getting quotas for project cfa2f72beb954e779afac30045c81775. Resources: {'key_pairs'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:46:24.660971 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-e1273982-7fdc-495c-ba39-510b2cfe9df9 tempest-KeyPairsV210TestJSON-1637291764 tempest-KeyPairsV210TestJSON-1637291764-project-admin] Getting quotas for user 77904b54bbb04acf98136ab3e00c537c and project cfa2f72beb954e779afac30045c81775. Resources: {'key_pairs'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:46:24.713583 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e1273982-7fdc-495c-ba39-510b2cfe9df9 tempest-KeyPairsV210TestJSON-1637291764 tempest-KeyPairsV210TestJSON-1637291764-project-admin] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.118808 Sep 16 12:46:24.714493 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 181/355] 10.222.0.67 () {62 vars in 1200 bytes} [Fri Sep 16 12:46:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 121 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 16 12:46:24.733918 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1ad84f38-44ea-4ee2-8a70-ea784cde7fc0 tempest-KeyPairsV210TestJSON-1637291764 tempest-KeyPairsV210TestJSON-1637291764-project-admin] Calling method '.version_select at 0x7f103600a4c0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:24.765808 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1ad84f38-44ea-4ee2-8a70-ea784cde7fc0 tempest-KeyPairsV210TestJSON-1637291764 tempest-KeyPairsV210TestJSON-1637291764-project-admin] 10.222.0.67 "GET /compute/v2.1/os-keypairs/tempest-keypair-1018092636?user_id=51339b4722494c988fb19e1a99e9cbc5" status: 200 len: 512 microversion: 2.10 time: 0.041051 Sep 16 12:46:24.767642 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 182/356] 10.222.0.67 () {60 vars in 1340 bytes} [Fri Sep 16 12:46:24 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1018092636?user_id=51339b4722494c988fb19e1a99e9cbc5 => generated 512 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 12:46:24.785389 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4a6390a3-1718-4941-8886-01fc8b5be8da tempest-KeyPairsV210TestJSON-1637291764 tempest-KeyPairsV210TestJSON-1637291764-project-admin] Action: 'create', calling method: .version_select at 0x7f103600adc0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-853326341", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqBZYapi3yPLIBgpM7R6rxSOZtfJBjZL2ilaPymuq0YAAOTyFnDsC9szBoVdNNvgr+4KqspiICBkas/AlXGurbgKxigU5iPSDOSTOB2I4MzkqRAscA17FPe9CFDbYzwEw=="}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:24.809854 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-4a6390a3-1718-4941-8886-01fc8b5be8da tempest-KeyPairsV210TestJSON-1637291764 tempest-KeyPairsV210TestJSON-1637291764-project-admin] Getting quotas for project cfa2f72beb954e779afac30045c81775. Resources: {'key_pairs'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:46:24.815940 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-4a6390a3-1718-4941-8886-01fc8b5be8da tempest-KeyPairsV210TestJSON-1637291764 tempest-KeyPairsV210TestJSON-1637291764-project-admin] Getting quotas for user 77904b54bbb04acf98136ab3e00c537c and project cfa2f72beb954e779afac30045c81775. Resources: {'key_pairs'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:46:24.854451 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4a6390a3-1718-4941-8886-01fc8b5be8da tempest-KeyPairsV210TestJSON-1637291764 tempest-KeyPairsV210TestJSON-1637291764-project-admin] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.073442 Sep 16 12:46:24.864783 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 183/357] 10.222.0.67 () {62 vars in 1200 bytes} [Fri Sep 16 12:46:24 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 85 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 16 12:46:24.873215 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-48cd0100-b5a8-41ba-85f3-42d9e16804b5 tempest-KeyPairsV210TestJSON-1637291764 tempest-KeyPairsV210TestJSON-1637291764-project-admin] Calling method '.version_select at 0x7f1035ffaee0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:24.878519 n-d-858094-4 devstack@n-api.service[128780]: WARNING oslo_db.sqlalchemy.utils [None req-48cd0100-b5a8-41ba-85f3-42d9e16804b5 tempest-KeyPairsV210TestJSON-1637291764 tempest-KeyPairsV210TestJSON-1637291764-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Sep 16 12:46:24.888655 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-48cd0100-b5a8-41ba-85f3-42d9e16804b5 tempest-KeyPairsV210TestJSON-1637291764 tempest-KeyPairsV210TestJSON-1637291764-project-admin] 10.222.0.67 "GET /compute/v2.1/os-keypairs?user_id=51339b4722494c988fb19e1a99e9cbc5" status: 200 len: 726 microversion: 2.10 time: 0.020669 Sep 16 12:46:24.889488 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 184/358] 10.222.0.67 () {60 vars in 1259 bytes} [Fri Sep 16 12:46:24 2022] GET /compute/v2.1/os-keypairs?user_id=51339b4722494c988fb19e1a99e9cbc5 => generated 726 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:46:24.890735 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-91c7b5e6-94c5-4371-a7fb-7c513298ab69 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0815c12c4340109ec1c379a0602322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20770fd1243d4412bfc90d2a079473bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:24.907112 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-91c7b5e6-94c5-4371-a7fb-7c513298ab69 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b" status: 200 len: 1321 microversion: 2.1 time: 0.346720 Sep 16 12:46:24.908601 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 175/359] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:24 2022] GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b => generated 1321 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:24.917736 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-90cc46c4-d1eb-43b5-b3f0-5e06aad7a1cd tempest-KeyPairsV210TestJSON-1637291764 tempest-KeyPairsV210TestJSON-1637291764-project-admin] Calling method '.version_select at 0x7f103605dc10>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:24.980826 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-90cc46c4-d1eb-43b5-b3f0-5e06aad7a1cd tempest-KeyPairsV210TestJSON-1637291764 tempest-KeyPairsV210TestJSON-1637291764-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-853326341" status: 204 len: 0 microversion: 2.10 time: 0.081440 Sep 16 12:46:24.984094 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 185/360] 10.222.0.67 () {60 vars in 1322 bytes} [Fri Sep 16 12:46:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-853326341 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 12:46:24.994194 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9daf8f3a-e8e6-48a5-9ce9-c63a95887e3a tempest-KeyPairsV210TestJSON-1637291764 tempest-KeyPairsV210TestJSON-1637291764-project-admin] Calling method '.version_select at 0x7f10361dcf70>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:25.039990 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9daf8f3a-e8e6-48a5-9ce9-c63a95887e3a tempest-KeyPairsV210TestJSON-1637291764 tempest-KeyPairsV210TestJSON-1637291764-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2026043160?user_id=51339b4722494c988fb19e1a99e9cbc5" status: 204 len: 0 microversion: 2.10 time: 0.051132 Sep 16 12:46:25.041518 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 176/361] 10.222.0.67 () {60 vars in 1343 bytes} [Fri Sep 16 12:46:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2026043160?user_id=51339b4722494c988fb19e1a99e9cbc5 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 12:46:25.051529 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7a6a03b4-3256-4568-b236-d7e6629a4628 tempest-KeyPairsV210TestJSON-1637291764 tempest-KeyPairsV210TestJSON-1637291764-project-admin] Calling method '.version_select at 0x7f1036009f70>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:25.082148 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7a6a03b4-3256-4568-b236-d7e6629a4628 tempest-KeyPairsV210TestJSON-1637291764 tempest-KeyPairsV210TestJSON-1637291764-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1018092636?user_id=51339b4722494c988fb19e1a99e9cbc5" status: 204 len: 0 microversion: 2.10 time: 0.035709 Sep 16 12:46:25.089698 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 186/362] 10.222.0.67 () {60 vars in 1343 bytes} [Fri Sep 16 12:46:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1018092636?user_id=51339b4722494c988fb19e1a99e9cbc5 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 12:46:25.928782 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=12 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:46:25.935624 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-650461a7-b487-49c8-a986-0752ad344c83 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:25.936438 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-650461a7-b487-49c8-a986-0752ad344c83 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: 4d860eb6-336f-4ba4-be81-d1ec6fecc87b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:25.944281 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:46:25.966866 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-650461a7-b487-49c8-a986-0752ad344c83 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:25.967853 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-650461a7-b487-49c8-a986-0752ad344c83 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:25.969660 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-650461a7-b487-49c8-a986-0752ad344c83 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:25.974196 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-650461a7-b487-49c8-a986-0752ad344c83 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:25.980386 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-650461a7-b487-49c8-a986-0752ad344c83 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:25.982451 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-650461a7-b487-49c8-a986-0752ad344c83 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:26.724720 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-66d477e7-ffaa-467c-84d5-8a43575be572 tempest-NetworksTest-1922201803 tempest-NetworksTest-1922201803-project-admin] Calling method '.version_select at 0x7f10361dc700>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:26.811413 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-650461a7-b487-49c8-a986-0752ad344c83 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0815c12c4340109ec1c379a0602322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20770fd1243d4412bfc90d2a079473bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:26.827182 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-650461a7-b487-49c8-a986-0752ad344c83 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b" status: 200 len: 1321 microversion: 2.1 time: 0.900634 Sep 16 12:46:26.840348 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 187/363] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:25 2022] GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b => generated 1321 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:27.179289 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-56108330-7582-4c32-b85d-97053587e7f7 req-7436c72e-df5f-4f8c-aac6-43de2c9c430b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d860eb6-336f-4ba4-be81-d1ec6fecc87b", "name": "network-vif-plugged", "status": "completed", "tag": "4cbb6233-6017-40a2-a247-e622df5f31a3"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:27.199494 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-56108330-7582-4c32-b85d-97053587e7f7 req-7436c72e-df5f-4f8c-aac6-43de2c9c430b service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:27.203770 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-56108330-7582-4c32-b85d-97053587e7f7 req-7436c72e-df5f-4f8c-aac6-43de2c9c430b service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:27.204404 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-56108330-7582-4c32-b85d-97053587e7f7 req-7436c72e-df5f-4f8c-aac6-43de2c9c430b service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:27.233123 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-56108330-7582-4c32-b85d-97053587e7f7 req-7436c72e-df5f-4f8c-aac6-43de2c9c430b service nova] Creating event network-vif-plugged:4cbb6233-6017-40a2-a247-e622df5f31a3 for instance 4d860eb6-336f-4ba4-be81-d1ec6fecc87b on n-h1-858094-4 Sep 16 12:46:27.255615 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-56108330-7582-4c32-b85d-97053587e7f7 req-7436c72e-df5f-4f8c-aac6-43de2c9c430b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080486 Sep 16 12:46:27.259800 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 188/364] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:46:28.014662 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-66d477e7-ffaa-467c-84d5-8a43575be572 tempest-NetworksTest-1922201803 tempest-NetworksTest-1922201803-project-admin] 10.222.0.67 "GET /compute/v2.1/os-networks" status: 200 len: 4004 microversion: 2.1 time: 2.129632 Sep 16 12:46:28.020116 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 177/365] 10.222.0.67 () {58 vars in 1137 bytes} [Fri Sep 16 12:46:25 2022] GET /compute/v2.1/os-networks => generated 4004 bytes in 2136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:28.026127 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f666aafe-74e8-4e81-9129-2d055e11022c tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:28.027359 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f666aafe-74e8-4e81-9129-2d055e11022c tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: 4d860eb6-336f-4ba4-be81-d1ec6fecc87b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:28.036311 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f666aafe-74e8-4e81-9129-2d055e11022c tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:28.037138 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f666aafe-74e8-4e81-9129-2d055e11022c tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:28.038040 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f666aafe-74e8-4e81-9129-2d055e11022c tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:28.040325 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f666aafe-74e8-4e81-9129-2d055e11022c tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:28.040912 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f666aafe-74e8-4e81-9129-2d055e11022c tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:28.041398 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f666aafe-74e8-4e81-9129-2d055e11022c tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:28.264620 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e61d0c15-a0a7-4bfb-b683-25f4f7100dd4 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1335308107", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:28.329719 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f666aafe-74e8-4e81-9129-2d055e11022c tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0815c12c4340109ec1c379a0602322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20770fd1243d4412bfc90d2a079473bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:28.338205 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f666aafe-74e8-4e81-9129-2d055e11022c tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b" status: 200 len: 1321 microversion: 2.1 time: 0.316330 Sep 16 12:46:28.343740 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 178/366] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:28 2022] GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b => generated 1321 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:28.348766 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-da0c3f93-f611-4424-a303-277595ab2afa tempest-NetworksTest-1922201803 tempest-NetworksTest-1922201803-project-admin] Calling method '.version_select at 0x7f10361dcd30>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:28.369019 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-e61d0c15-a0a7-4bfb-b683-25f4f7100dd4 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] validate_networks() for None {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:46:28.758831 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-da0c3f93-f611-4424-a303-277595ab2afa tempest-NetworksTest-1922201803 tempest-NetworksTest-1922201803-project-admin] 10.222.0.67 "GET /compute/v2.1/os-networks/42d33e50-b5e8-4084-82dc-226debf86786" status: 200 len: 652 microversion: 2.1 time: 0.413846 Sep 16 12:46:28.759900 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 179/367] 10.222.0.67 () {58 vars in 1248 bytes} [Fri Sep 16 12:46:28 2022] GET /compute/v2.1/os-networks/42d33e50-b5e8-4084-82dc-226debf86786 => generated 652 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:28.772696 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7c70d673-2a8a-4621-bf3c-4722e9f335f8 tempest-NetworksTest-1922201803 tempest-NetworksTest-1922201803-project-admin] Calling method '.version_select at 0x7f10361dc550>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:29.203703 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7c70d673-2a8a-4621-bf3c-4722e9f335f8 tempest-NetworksTest-1922201803 tempest-NetworksTest-1922201803-project-admin] 10.222.0.67 "GET /compute/v2.1/os-networks" status: 200 len: 4004 microversion: 2.1 time: 0.437838 Sep 16 12:46:29.209677 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-e61d0c15-a0a7-4bfb-b683-25f4f7100dd4 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:46:29.209677 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-e61d0c15-a0a7-4bfb-b683-25f4f7100dd4 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:46:29.209677 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-e61d0c15-a0a7-4bfb-b683-25f4f7100dd4 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:46:29.210038 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-e61d0c15-a0a7-4bfb-b683-25f4f7100dd4 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:46:29.210515 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-e61d0c15-a0a7-4bfb-b683-25f4f7100dd4 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:46:29.211518 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 180/368] 10.222.0.67 () {58 vars in 1137 bytes} [Fri Sep 16 12:46:28 2022] GET /compute/v2.1/os-networks => generated 4004 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:46:29.229332 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e61d0c15-a0a7-4bfb-b683-25f4f7100dd4 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:29.231014 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e61d0c15-a0a7-4bfb-b683-25f4f7100dd4 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:29.232582 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e61d0c15-a0a7-4bfb-b683-25f4f7100dd4 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:29.233640 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e61d0c15-a0a7-4bfb-b683-25f4f7100dd4 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:29.236525 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e61d0c15-a0a7-4bfb-b683-25f4f7100dd4 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:29.238200 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e61d0c15-a0a7-4bfb-b683-25f4f7100dd4 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:29.264974 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:46:29.304388 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-e61d0c15-a0a7-4bfb-b683-25f4f7100dd4 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Getting quotas for project 0709d7ec436047a39dfb8c5d92f17fa3. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:46:29.321870 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-e61d0c15-a0a7-4bfb-b683-25f4f7100dd4 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Getting quotas for user 8bdc5bd0969148a3ac8879ccf0f58553 and project 0709d7ec436047a39dfb8c5d92f17fa3. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:46:29.363046 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-58a465fd-2c37-4794-b988-459cfd35092e tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:29.363747 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-58a465fd-2c37-4794-b988-459cfd35092e tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: 4d860eb6-336f-4ba4-be81-d1ec6fecc87b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:29.368572 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e61d0c15-a0a7-4bfb-b683-25f4f7100dd4 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:46:29.376649 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e61d0c15-a0a7-4bfb-b683-25f4f7100dd4 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:46:29.378009 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58a465fd-2c37-4794-b988-459cfd35092e tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:29.378558 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58a465fd-2c37-4794-b988-459cfd35092e tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:29.383891 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58a465fd-2c37-4794-b988-459cfd35092e tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:29.384768 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58a465fd-2c37-4794-b988-459cfd35092e tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:29.385577 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58a465fd-2c37-4794-b988-459cfd35092e tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:29.386026 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58a465fd-2c37-4794-b988-459cfd35092e tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:29.582626 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e61d0c15-a0a7-4bfb-b683-25f4f7100dd4 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.778803 Sep 16 12:46:29.589580 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 189/369] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:46:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:46:29.894035 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c3747383-03d3-4aa5-a1d8-5d2e2f057828 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1556948762", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:30.023437 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-c3747383-03d3-4aa5-a1d8-5d2e2f057828 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] validate_networks() for None {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:46:30.117899 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-58a465fd-2c37-4794-b988-459cfd35092e tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0815c12c4340109ec1c379a0602322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20770fd1243d4412bfc90d2a079473bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:30.129856 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-58a465fd-2c37-4794-b988-459cfd35092e tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b" status: 200 len: 1321 microversion: 2.1 time: 0.771607 Sep 16 12:46:30.136949 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 181/370] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:29 2022] GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b => generated 1321 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:30.948439 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-228de845-e471-458d-8efb-97b18b40fc48 tempest-FlavorsExtraSpecsTestJSON-1663858866 tempest-FlavorsExtraSpecsTestJSON-1663858866-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-190540021", "ram": 512, "vcpus": 1, "disk": 10, "id": 1689211037, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:30.998712 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-228de845-e471-458d-8efb-97b18b40fc48 tempest-FlavorsExtraSpecsTestJSON-1663858866 tempest-FlavorsExtraSpecsTestJSON-1663858866-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.772423 Sep 16 12:46:31.000908 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 182/371] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:46:30 2022] POST /compute/v2.1/flavors => generated 415 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:31.014403 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8699c656-ab55-4a0b-a641-ccbdc2c0cab5 tempest-FlavorsExtraSpecsTestJSON-1663858866 tempest-FlavorsExtraSpecsTestJSON-1663858866-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:31.041832 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:DELETE=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:46:31.090637 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-c3747383-03d3-4aa5-a1d8-5d2e2f057828 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:46:31.092948 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-c3747383-03d3-4aa5-a1d8-5d2e2f057828 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:46:31.093627 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-c3747383-03d3-4aa5-a1d8-5d2e2f057828 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:46:31.094222 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-c3747383-03d3-4aa5-a1d8-5d2e2f057828 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:46:31.094951 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-c3747383-03d3-4aa5-a1d8-5d2e2f057828 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:46:31.117705 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c3747383-03d3-4aa5-a1d8-5d2e2f057828 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:31.118832 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c3747383-03d3-4aa5-a1d8-5d2e2f057828 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:31.119372 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8699c656-ab55-4a0b-a641-ccbdc2c0cab5 tempest-FlavorsExtraSpecsTestJSON-1663858866 tempest-FlavorsExtraSpecsTestJSON-1663858866-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/1689211037/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.109075 Sep 16 12:46:31.120871 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 183/372] 10.222.0.67 () {60 vars in 1224 bytes} [Fri Sep 16 12:46:31 2022] POST /compute/v2.1/flavors/1689211037/os-extra_specs => generated 66 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 16 12:46:31.123622 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c3747383-03d3-4aa5-a1d8-5d2e2f057828 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:31.124720 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c3747383-03d3-4aa5-a1d8-5d2e2f057828 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:31.125340 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c3747383-03d3-4aa5-a1d8-5d2e2f057828 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:31.131137 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c3747383-03d3-4aa5-a1d8-5d2e2f057828 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:31.210477 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-c3747383-03d3-4aa5-a1d8-5d2e2f057828 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Getting quotas for project 0709d7ec436047a39dfb8c5d92f17fa3. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:46:31.226764 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-c3747383-03d3-4aa5-a1d8-5d2e2f057828 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Getting quotas for user 8bdc5bd0969148a3ac8879ccf0f58553 and project 0709d7ec436047a39dfb8c5d92f17fa3. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:46:31.262441 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c3747383-03d3-4aa5-a1d8-5d2e2f057828 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:46:31.270094 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c3747383-03d3-4aa5-a1d8-5d2e2f057828 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: 1b320dc8-1e79-4202-8162-0a418c6b1874] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:46:31.331919 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=7,nova_api:INSERT=8,nova_api:DELETE=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:46:31.407740 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c3747383-03d3-4aa5-a1d8-5d2e2f057828 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.518666 Sep 16 12:46:31.414456 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 190/373] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:46:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 12:46:31.432989 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d08df050-5eb8-47ac-91b3-66c190823c46 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:31.434182 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d08df050-5eb8-47ac-91b3-66c190823c46 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: 4d860eb6-336f-4ba4-be81-d1ec6fecc87b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:31.457160 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d08df050-5eb8-47ac-91b3-66c190823c46 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:31.459086 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d08df050-5eb8-47ac-91b3-66c190823c46 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:31.461054 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d08df050-5eb8-47ac-91b3-66c190823c46 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:31.461965 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d08df050-5eb8-47ac-91b3-66c190823c46 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:31.467824 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d08df050-5eb8-47ac-91b3-66c190823c46 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:31.468486 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d08df050-5eb8-47ac-91b3-66c190823c46 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:31.822635 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1426e781-87a1-4ae2-8879-d44098453554 tempest-FlavorsExtraSpecsTestJSON-880505936 tempest-FlavorsExtraSpecsTestJSON-880505936-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:31.837722 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1426e781-87a1-4ae2-8879-d44098453554 tempest-FlavorsExtraSpecsTestJSON-880505936 tempest-FlavorsExtraSpecsTestJSON-880505936-project] 10.222.0.67 "GET /compute/v2.1/flavors/1689211037/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.709831 Sep 16 12:46:31.850239 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 184/374] 10.222.0.67 () {58 vars in 1203 bytes} [Fri Sep 16 12:46:31 2022] GET /compute/v2.1/flavors/1689211037/os-extra_specs => generated 66 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 12:46:31.867079 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7e30cffe-2f82-4154-b430-326a186c1ec5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:31.868622 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7e30cffe-2f82-4154-b430-326a186c1ec5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: 1b320dc8-1e79-4202-8162-0a418c6b1874] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:31.900739 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d08df050-5eb8-47ac-91b3-66c190823c46 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0815c12c4340109ec1c379a0602322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20770fd1243d4412bfc90d2a079473bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:31.921882 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d08df050-5eb8-47ac-91b3-66c190823c46 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b" status: 200 len: 1471 microversion: 2.1 time: 0.505551 Sep 16 12:46:31.926807 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 191/375] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:31 2022] GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b => generated 1471 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:31.937924 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d28172e3-4200-46c2-9b02-8ca39192102f tempest-FlavorsExtraSpecsTestJSON-1663858866 tempest-FlavorsExtraSpecsTestJSON-1663858866-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:32.015974 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d28172e3-4200-46c2-9b02-8ca39192102f tempest-FlavorsExtraSpecsTestJSON-1663858866 tempest-FlavorsExtraSpecsTestJSON-1663858866-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/1689211037/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.073704 Sep 16 12:46:32.017736 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 192/376] 10.222.0.67 () {60 vars in 1224 bytes} [Fri Sep 16 12:46:31 2022] POST /compute/v2.1/flavors/1689211037/os-extra_specs => generated 66 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 12:46:32.096837 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7e30cffe-2f82-4154-b430-326a186c1ec5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:32.110028 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7e30cffe-2f82-4154-b430-326a186c1ec5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874" status: 200 len: 1214 microversion: 2.1 time: 0.258445 Sep 16 12:46:32.118017 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 185/377] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:31 2022] GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874 => generated 1214 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:32.138017 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-64f9b00d-d32b-453d-a8c7-c6abe736cbd8 tempest-FlavorsExtraSpecsTestJSON-880505936 tempest-FlavorsExtraSpecsTestJSON-880505936-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:32.183259 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-64f9b00d-d32b-453d-a8c7-c6abe736cbd8 tempest-FlavorsExtraSpecsTestJSON-880505936 tempest-FlavorsExtraSpecsTestJSON-880505936-project] 10.222.0.67 "GET /compute/v2.1/flavors/1689211037/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.056155 Sep 16 12:46:32.184989 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 186/378] 10.222.0.67 () {58 vars in 1245 bytes} [Fri Sep 16 12:46:32 2022] GET /compute/v2.1/flavors/1689211037/os-extra_specs/hw:numa_nodes => generated 22 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 12:46:32.199200 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6400e8cf-532c-427c-b6ea-5ce11b82d5a4 tempest-FlavorsExtraSpecsTestJSON-1663858866 tempest-FlavorsExtraSpecsTestJSON-1663858866-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:32.280878 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6400e8cf-532c-427c-b6ea-5ce11b82d5a4 tempest-FlavorsExtraSpecsTestJSON-1663858866 tempest-FlavorsExtraSpecsTestJSON-1663858866-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/1689211037/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.089287 Sep 16 12:46:32.287513 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 187/379] 10.222.0.67 () {60 vars in 1224 bytes} [Fri Sep 16 12:46:32 2022] POST /compute/v2.1/flavors/1689211037/os-extra_specs => generated 66 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 12:46:32.307481 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-686332e5-b8ae-4d13-a06c-74db1911b178 tempest-FlavorsExtraSpecsTestJSON-1663858866 tempest-FlavorsExtraSpecsTestJSON-1663858866-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:32.337050 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-686332e5-b8ae-4d13-a06c-74db1911b178 tempest-FlavorsExtraSpecsTestJSON-1663858866 tempest-FlavorsExtraSpecsTestJSON-1663858866-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/1689211037/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.040524 Sep 16 12:46:32.339177 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 188/380] 10.222.0.67 () {58 vars in 1203 bytes} [Fri Sep 16 12:46:32 2022] GET /compute/v2.1/flavors/1689211037/os-extra_specs => generated 66 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 12:46:32.355726 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6432b0b9-ca4b-4b1e-9ab0-68c830f6a0fb tempest-FlavorsExtraSpecsTestJSON-1663858866 tempest-FlavorsExtraSpecsTestJSON-1663858866-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:32.406479 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6432b0b9-ca4b-4b1e-9ab0-68c830f6a0fb tempest-FlavorsExtraSpecsTestJSON-1663858866 tempest-FlavorsExtraSpecsTestJSON-1663858866-project-admin] 10.222.0.67 "PUT /compute/v2.1/flavors/1689211037/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.060973 Sep 16 12:46:32.409349 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 189/381] 10.222.0.67 () {60 vars in 1265 bytes} [Fri Sep 16 12:46:32 2022] PUT /compute/v2.1/flavors/1689211037/os-extra_specs/hw:numa_nodes => generated 22 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 12:46:32.424042 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-735c1db7-8fb0-48d7-a3c5-1faa977bc36e tempest-FlavorsExtraSpecsTestJSON-1663858866 tempest-FlavorsExtraSpecsTestJSON-1663858866-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:32.443824 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-735c1db7-8fb0-48d7-a3c5-1faa977bc36e tempest-FlavorsExtraSpecsTestJSON-1663858866 tempest-FlavorsExtraSpecsTestJSON-1663858866-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/1689211037/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.026661 Sep 16 12:46:32.445622 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 190/382] 10.222.0.67 () {58 vars in 1203 bytes} [Fri Sep 16 12:46:32 2022] GET /compute/v2.1/flavors/1689211037/os-extra_specs => generated 66 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 12:46:32.455255 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b7f9a39d-93af-435e-aff3-b0801198c5c1 tempest-FlavorsExtraSpecsTestJSON-1663858866 tempest-FlavorsExtraSpecsTestJSON-1663858866-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:32.541207 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b7f9a39d-93af-435e-aff3-b0801198c5c1 tempest-FlavorsExtraSpecsTestJSON-1663858866 tempest-FlavorsExtraSpecsTestJSON-1663858866-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1689211037/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.090105 Sep 16 12:46:32.547255 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 191/383] 10.222.0.67 () {58 vars in 1248 bytes} [Fri Sep 16 12:46:32 2022] DELETE /compute/v2.1/flavors/1689211037/os-extra_specs/hw:numa_nodes => generated 0 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 16 12:46:32.557585 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b0d80446-8f67-499f-8cb2-59549a4058c6 tempest-FlavorsExtraSpecsTestJSON-1663858866 tempest-FlavorsExtraSpecsTestJSON-1663858866-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:32.597092 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b0d80446-8f67-499f-8cb2-59549a4058c6 tempest-FlavorsExtraSpecsTestJSON-1663858866 tempest-FlavorsExtraSpecsTestJSON-1663858866-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1689211037/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.047762 Sep 16 12:46:32.599951 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 192/384] 10.222.0.67 () {58 vars in 1248 bytes} [Fri Sep 16 12:46:32 2022] DELETE /compute/v2.1/flavors/1689211037/os-extra_specs/hw:cpu_policy => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 16 12:46:32.618420 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-25158834-074b-40c2-8057-838e924d587c tempest-FlavorsExtraSpecsTestJSON-1663858866 tempest-FlavorsExtraSpecsTestJSON-1663858866-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:32.635156 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-25158834-074b-40c2-8057-838e924d587c tempest-FlavorsExtraSpecsTestJSON-1663858866 tempest-FlavorsExtraSpecsTestJSON-1663858866-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/1689211037/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.030789 Sep 16 12:46:32.636355 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 193/385] 10.222.0.67 () {58 vars in 1203 bytes} [Fri Sep 16 12:46:32 2022] GET /compute/v2.1/flavors/1689211037/os-extra_specs => generated 19 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 12:46:32.647284 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e018c358-68f3-40c4-aaa1-d38326bbd83b tempest-FlavorsExtraSpecsTestJSON-1663858866 tempest-FlavorsExtraSpecsTestJSON-1663858866-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:32.675025 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e018c358-68f3-40c4-aaa1-d38326bbd83b tempest-FlavorsExtraSpecsTestJSON-1663858866 tempest-FlavorsExtraSpecsTestJSON-1663858866-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1689211037" status: 202 len: 0 microversion: 2.1 time: 0.031937 Sep 16 12:46:32.675942 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 194/386] 10.222.0.67 () {58 vars in 1161 bytes} [Fri Sep 16 12:46:32 2022] DELETE /compute/v2.1/flavors/1689211037 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 12:46:32.685656 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-84a9a94b-bc58-4a94-bd71-2cfc5189d199 tempest-FlavorsExtraSpecsTestJSON-1663858866 tempest-FlavorsExtraSpecsTestJSON-1663858866-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:32.749645 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-84a9a94b-bc58-4a94-bd71-2cfc5189d199 tempest-FlavorsExtraSpecsTestJSON-1663858866 tempest-FlavorsExtraSpecsTestJSON-1663858866-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.068810 Sep 16 12:46:32.756633 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 195/387] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:46:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:46:32.776582 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c4587c52-d2e0-4503-bae3-bd51c7a71223 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:32.777378 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c4587c52-d2e0-4503-bae3-bd51c7a71223 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] [instance: 23189ec4-2b3d-432e-86d8-b02db8368878] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:32.792941 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-c4587c52-d2e0-4503-bae3-bd51c7a71223 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] HTTP exception thrown: Instance 23189ec4-2b3d-432e-86d8-b02db8368878 could not be found. Sep 16 12:46:32.794886 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c4587c52-d2e0-4503-bae3-bd51c7a71223 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Request method failure captured: Sep 16 12:46:32.794886 n-d-858094-4 devstack@n-api.service[128780]: request: POST /compute/v2.1/servers/23189ec4-2b3d-432e-86d8-b02db8368878/action HTTP/1.1 Sep 16 12:46:32.794886 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:46:32.794886 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:46:32.794886 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:46:32.794886 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 15 Sep 16 12:46:32.794886 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:46:32.794886 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:46:32.794886 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:46:32.794886 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:46:32.794886 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHAL52L-sno-1Yd1ceJPP0Wv2MeDXukFtjSlNoyYrkU9bU1lbl5CuyJ3pwwMpFVZpUUEZ7Y0nvsVtK-A8yisgACJuq0feHbCmMwgha9_JhKv_4-wEjsZ3cxOCmgW5dbSolkzAPibHD_fdwd47ChBcd9UmMTT60oTEjiTzk7MfU4sKuY Sep 16 12:46:32.794886 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:46:32.794886 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:46:32.794886 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:46:32.794886 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:46:32.794886 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:46:32.794886 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:46:32.794886 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: df02d1f4029341a7a1f27484ea714c96 Sep 16 12:46:32.794886 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-250756494 Sep 16 12:46:32.794886 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,admin,reader Sep 16 12:46:32.794886 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,admin,reader Sep 16 12:46:32.796150 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/df02d1f4029341a7a1f27484ea714c96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/df02d1f4029341a7a1f27484ea714c96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_df02d1f4029341a7a1f27484ea714c96", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/df02d1f4029341a7a1f27484ea714c96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:46:32.796150 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ServersAdminNegativeTestJSON-250756494 Sep 16 12:46:32.796150 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: df02d1f4029341a7a1f27484ea714c96 Sep 16 12:46:32.796150 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-250756494 Sep 16 12:46:32.796150 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ServersAdminNegativeTestJSON-250756494-project-admin Sep 16 12:46:32.796150 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:46:32.796150 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:46:32.796150 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 6d8647a085014089877a089d1691bca5 Sep 16 12:46:32.796150 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ServersAdminNegativeTestJSON-250756494-project-admin Sep 16 12:46:32.796150 n-d-858094-4 devstack@n-api.service[128780]: Sep 16 12:46:32.796150 n-d-858094-4 devstack@n-api.service[128780]: {"migrate": {}} Sep 16 12:46:32.796150 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:46:32.796150 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance 23189ec4-2b3d-432e-86d8-b02db8368878 could not be found. Sep 16 12:46:32.796884 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '23189ec4-2b3d-432e-86d8-b02db8368878', 'body': {'migrate': {}}} Sep 16 12:46:32.796884 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:46:32.796884 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:32.796884 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:46:32.796884 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:46:32.796884 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:46:32.796884 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:46:32.796884 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 16 12:46:32.796884 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 16 12:46:32.796884 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23189ec4-2b3d-432e-86d8-b02db8368878 could not be found. Sep 16 12:46:32.796884 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:32.796884 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:32.796884 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:32.796884 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:32.796884 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:32.796884 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:32.796884 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:46:32.796884 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:46:32.796884 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:46:32.796884 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:46:32.798075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:46:32.798075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:46:32.798075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Sep 16 12:46:32.798075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Sep 16 12:46:32.798075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:46:32.798075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:46:32.798075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23189ec4-2b3d-432e-86d8-b02db8368878 could not be found. Sep 16 12:46:32.798075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:32.798075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:32.798075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:32.798075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:32.798075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:32.798075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:32.798075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:46:32.798075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:46:32.798075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23189ec4-2b3d-432e-86d8-b02db8368878 could not be found. Sep 16 12:46:32.798075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:32.799019 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c4587c52-d2e0-4503-bae3-bd51c7a71223 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Returning 404 to user: Instance 23189ec4-2b3d-432e-86d8-b02db8368878 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:46:32.806509 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c4587c52-d2e0-4503-bae3-bd51c7a71223 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/23189ec4-2b3d-432e-86d8-b02db8368878/action" status: 404 len: 111 microversion: 2.1 time: 0.777246 Sep 16 12:46:32.807159 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 193/388] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:46:32 2022] POST /compute/v2.1/servers/23189ec4-2b3d-432e-86d8-b02db8368878/action => generated 111 bytes in 789 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:46:33.145173 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-70c76e9a-76ab-4772-86ae-91db58d6b705 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:33.146465 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-70c76e9a-76ab-4772-86ae-91db58d6b705 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: 1b320dc8-1e79-4202-8162-0a418c6b1874] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:33.156562 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70c76e9a-76ab-4772-86ae-91db58d6b705 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:33.169113 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70c76e9a-76ab-4772-86ae-91db58d6b705 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:33.170314 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70c76e9a-76ab-4772-86ae-91db58d6b705 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:33.173129 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70c76e9a-76ab-4772-86ae-91db58d6b705 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:33.175204 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70c76e9a-76ab-4772-86ae-91db58d6b705 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:33.178703 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70c76e9a-76ab-4772-86ae-91db58d6b705 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:33.480511 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-70c76e9a-76ab-4772-86ae-91db58d6b705 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:33.499447 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-70c76e9a-76ab-4772-86ae-91db58d6b705 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874" status: 200 len: 1266 microversion: 2.1 time: 0.357635 Sep 16 12:46:33.502960 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 196/389] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:33 2022] GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874 => generated 1266 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:33.576402 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-67575cfb-de32-48d7-a09e-c49516304f10 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1872273851", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:33.699730 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-67575cfb-de32-48d7-a09e-c49516304f10 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] validate_networks() for None {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:46:34.700019 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-67575cfb-de32-48d7-a09e-c49516304f10 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:46:34.701501 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-67575cfb-de32-48d7-a09e-c49516304f10 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:46:34.701501 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-67575cfb-de32-48d7-a09e-c49516304f10 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:46:34.701765 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-67575cfb-de32-48d7-a09e-c49516304f10 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:46:34.702189 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-67575cfb-de32-48d7-a09e-c49516304f10 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:46:34.716984 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-67575cfb-de32-48d7-a09e-c49516304f10 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:34.719377 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-67575cfb-de32-48d7-a09e-c49516304f10 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:34.720035 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-67575cfb-de32-48d7-a09e-c49516304f10 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:34.725537 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-67575cfb-de32-48d7-a09e-c49516304f10 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:34.727849 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-67575cfb-de32-48d7-a09e-c49516304f10 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:34.731915 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-67575cfb-de32-48d7-a09e-c49516304f10 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:34.812313 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-67575cfb-de32-48d7-a09e-c49516304f10 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Getting quotas for project 20770fd1243d4412bfc90d2a079473bd. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:46:34.821528 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-67575cfb-de32-48d7-a09e-c49516304f10 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Getting quotas for user 7b0815c12c4340109ec1c379a0602322 and project 20770fd1243d4412bfc90d2a079473bd. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:46:34.896084 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-67575cfb-de32-48d7-a09e-c49516304f10 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:46:34.905678 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-67575cfb-de32-48d7-a09e-c49516304f10 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: cbbaed5d-b861-4f03-a39b-c384175b92ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:46:35.063475 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-67575cfb-de32-48d7-a09e-c49516304f10 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.492251 Sep 16 12:46:35.078442 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 194/390] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:46:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:46:35.098443 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0c2d2810-5ec6-42f9-9df7-a76fb2e83f7b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:35.099290 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0c2d2810-5ec6-42f9-9df7-a76fb2e83f7b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: 1b320dc8-1e79-4202-8162-0a418c6b1874] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:35.135007 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0c2d2810-5ec6-42f9-9df7-a76fb2e83f7b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:35.135726 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0c2d2810-5ec6-42f9-9df7-a76fb2e83f7b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:35.136352 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0c2d2810-5ec6-42f9-9df7-a76fb2e83f7b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:35.137263 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0c2d2810-5ec6-42f9-9df7-a76fb2e83f7b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:35.137848 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0c2d2810-5ec6-42f9-9df7-a76fb2e83f7b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:35.142343 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0c2d2810-5ec6-42f9-9df7-a76fb2e83f7b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:35.489463 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-814f7a8e-2607-43f2-a500-5ecdf246744b tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Calling method '.version_select at 0x7f10362a18b0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:35.983025 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-814f7a8e-2607-43f2-a500-5ecdf246744b tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/cc2c5f8ac0254d3cae8c28d053cb2722" status: 200 len: 371 microversion: 2.1 time: 1.470358 Sep 16 12:46:35.985591 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 197/391] 10.222.0.67 () {58 vars in 1242 bytes} [Fri Sep 16 12:46:34 2022] GET /compute/v2.1/os-quota-sets/cc2c5f8ac0254d3cae8c28d053cb2722 => generated 371 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:46:35.998264 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0c2d2810-5ec6-42f9-9df7-a76fb2e83f7b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:36.003234 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-06db9db7-0a76-4bda-bc1b-52ba7302a2fe tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:36.003865 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-06db9db7-0a76-4bda-bc1b-52ba7302a2fe tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: cbbaed5d-b861-4f03-a39b-c384175b92ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:36.024197 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0c2d2810-5ec6-42f9-9df7-a76fb2e83f7b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874" status: 200 len: 1272 microversion: 2.1 time: 0.941464 Sep 16 12:46:36.025793 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 195/392] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:35 2022] GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874 => generated 1272 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:36.156809 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2ae30653-9fa0-4393-a01a-534ccfc67756 tempest-QuotaClassesAdminTestJSON-1398680819 tempest-QuotaClassesAdminTestJSON-1398680819-project-admin] Calling method '.version_select at 0x7f103616c820>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:36.175485 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2ae30653-9fa0-4393-a01a-534ccfc67756 tempest-QuotaClassesAdminTestJSON-1398680819 tempest-QuotaClassesAdminTestJSON-1398680819-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.147282 Sep 16 12:46:36.180500 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 196/393] 10.222.0.67 () {58 vars in 1185 bytes} [Fri Sep 16 12:46:36 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:36.209646 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2c19e3f2-e6be-4b11-852b-e1f710d36a46 tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Action: 'update', calling method: .version_select at 0x7f10360099d0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:36.237320 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-06db9db7-0a76-4bda-bc1b-52ba7302a2fe tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0815c12c4340109ec1c379a0602322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20770fd1243d4412bfc90d2a079473bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:36.253295 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-06db9db7-0a76-4bda-bc1b-52ba7302a2fe tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "GET /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea" status: 200 len: 1222 microversion: 2.1 time: 0.266250 Sep 16 12:46:36.254654 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 198/394] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:35 2022] GET /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea => generated 1222 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:36.260988 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-83cb3e0a-988d-4ff1-8b25-c1370c1722be tempest-QuotaClassesAdminTestJSON-1398680819 tempest-QuotaClassesAdminTestJSON-1398680819-project-admin] Action: 'update', calling method: .version_select at 0x7f10361b6ee0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:36.339064 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c19e3f2-e6be-4b11-852b-e1f710d36a46 tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:36.340172 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c19e3f2-e6be-4b11-852b-e1f710d36a46 tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:36.341013 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c19e3f2-e6be-4b11-852b-e1f710d36a46 tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:36.342112 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c19e3f2-e6be-4b11-852b-e1f710d36a46 tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:36.342927 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c19e3f2-e6be-4b11-852b-e1f710d36a46 tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:36.345415 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c19e3f2-e6be-4b11-852b-e1f710d36a46 tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:36.441646 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2c19e3f2-e6be-4b11-852b-e1f710d36a46 tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/cc2c5f8ac0254d3cae8c28d053cb2722" status: 200 len: 328 microversion: 2.1 time: 0.259198 Sep 16 12:46:36.453373 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 197/395] 10.222.0.67 () {60 vars in 1262 bytes} [Fri Sep 16 12:46:36 2022] PUT /compute/v2.1/os-quota-sets/cc2c5f8ac0254d3cae8c28d053cb2722 => generated 328 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:36.522770 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SAVEPOINT=7,nova_api:INSERT=6,nova_api:RELEASE=7,nova_api:SELECT=69,nova_api:UPDATE=6,nova_api:DELETE=5 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:46:36.771007 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-83cb3e0a-988d-4ff1-8b25-c1370c1722be tempest-QuotaClassesAdminTestJSON-1398680819 tempest-QuotaClassesAdminTestJSON-1398680819-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.513596 Sep 16 12:46:36.784195 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 199/396] 10.222.0.67 () {60 vars in 1206 bytes} [Fri Sep 16 12:46:36 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:36.802559 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ae40b1d5-6049-4a33-94ad-359ceb3b24d7 tempest-QuotaClassesAdminTestJSON-1398680819 tempest-QuotaClassesAdminTestJSON-1398680819-project-admin] Calling method '.version_select at 0x7f10362e0940>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:36.820559 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ae40b1d5-6049-4a33-94ad-359ceb3b24d7 tempest-QuotaClassesAdminTestJSON-1398680819 tempest-QuotaClassesAdminTestJSON-1398680819-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.031948 Sep 16 12:46:36.821727 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 200/397] 10.222.0.67 () {58 vars in 1185 bytes} [Fri Sep 16 12:46:36 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:36.834447 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3cacdfb0-4112-406c-a277-56b8b46ba02c tempest-QuotaClassesAdminTestJSON-1398680819 tempest-QuotaClassesAdminTestJSON-1398680819-project-admin] Action: 'update', calling method: .version_select at 0x7f10361698b0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:36.948261 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d623e02f-4477-4b36-881c-5a9dd46ca7f5 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1586133659", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:37.061118 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-d623e02f-4477-4b36-881c-5a9dd46ca7f5 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] validate_networks() for None {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:46:37.072990 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3cacdfb0-4112-406c-a277-56b8b46ba02c tempest-QuotaClassesAdminTestJSON-1398680819 tempest-QuotaClassesAdminTestJSON-1398680819-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.243009 Sep 16 12:46:37.074133 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 201/398] 10.222.0.67 () {60 vars in 1206 bytes} [Fri Sep 16 12:46:36 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:37.095779 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-974253b4-7c6d-4f35-b995-a3903487ad20 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:37.098720 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-974253b4-7c6d-4f35-b995-a3903487ad20 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: 1b320dc8-1e79-4202-8162-0a418c6b1874] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:37.114677 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-974253b4-7c6d-4f35-b995-a3903487ad20 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:37.126533 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-974253b4-7c6d-4f35-b995-a3903487ad20 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:37.127427 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-974253b4-7c6d-4f35-b995-a3903487ad20 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:37.139282 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-974253b4-7c6d-4f35-b995-a3903487ad20 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:37.139282 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-974253b4-7c6d-4f35-b995-a3903487ad20 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:37.139282 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-974253b4-7c6d-4f35-b995-a3903487ad20 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:38.307351 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-d623e02f-4477-4b36-881c-5a9dd46ca7f5 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:46:38.307876 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-d623e02f-4477-4b36-881c-5a9dd46ca7f5 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:46:38.308342 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-d623e02f-4477-4b36-881c-5a9dd46ca7f5 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:46:38.309227 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-d623e02f-4477-4b36-881c-5a9dd46ca7f5 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:46:38.309642 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-d623e02f-4477-4b36-881c-5a9dd46ca7f5 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:46:38.329278 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d623e02f-4477-4b36-881c-5a9dd46ca7f5 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:38.329776 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d623e02f-4477-4b36-881c-5a9dd46ca7f5 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:38.330209 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d623e02f-4477-4b36-881c-5a9dd46ca7f5 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:38.331205 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d623e02f-4477-4b36-881c-5a9dd46ca7f5 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:38.331664 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d623e02f-4477-4b36-881c-5a9dd46ca7f5 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:38.335784 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d623e02f-4477-4b36-881c-5a9dd46ca7f5 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:38.381114 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-d623e02f-4477-4b36-881c-5a9dd46ca7f5 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Getting quotas for project cc2c5f8ac0254d3cae8c28d053cb2722. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:46:38.396367 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-d623e02f-4477-4b36-881c-5a9dd46ca7f5 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Getting quotas for user 03348f0e3c5546b3b4f19e045740c7ab and project cc2c5f8ac0254d3cae8c28d053cb2722. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:46:38.423260 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.utils [None req-d623e02f-4477-4b36-881c-5a9dd46ca7f5 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] cores quota exceeded for cc2c5f8ac0254d3cae8c28d053cb2722, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128780) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 16 12:46:38.424819 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-d623e02f-4477-4b36-881c-5a9dd46ca7f5 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 16 12:46:38.428641 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d623e02f-4477-4b36-881c-5a9dd46ca7f5 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Request method failure captured: Sep 16 12:46:38.428641 n-d-858094-4 devstack@n-api.service[128780]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 16 12:46:38.428641 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:46:38.428641 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:46:38.428641 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:46:38.428641 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 145 Sep 16 12:46:38.428641 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:46:38.428641 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:46:38.428641 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:46:38.428641 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:46:38.428641 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHAmVRdsz_fqEsSJRTHLzw4hhJpcdThMYAhrLrr_PxYemUlJEG4hWs1JHwNV14h1woJ3urY1UmPWORjP0NjmGE96Tk44ghY2nwzcGbx0K8HJVWVcI54OGihL6tGYm5HCJ7pp0IxpOV_GptfBOkx04Qu_FpNbj1rJEFiudwSuM16r7Tg Sep 16 12:46:38.428641 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:46:38.428641 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:46:38.428641 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:46:38.428641 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:46:38.428641 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:46:38.428641 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:46:38.428641 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: cc2c5f8ac0254d3cae8c28d053cb2722 Sep 16 12:46:38.428641 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-QuotasAdminNegativeTest-1717087707 Sep 16 12:46:38.428641 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:46:38.428641 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:46:38.430105 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cc2c5f8ac0254d3cae8c28d053cb2722"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/cc2c5f8ac0254d3cae8c28d053cb2722"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_cc2c5f8ac0254d3cae8c28d053cb2722", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cc2c5f8ac0254d3cae8c28d053cb2722"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:46:38.430105 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-QuotasAdminNegativeTest-1717087707 Sep 16 12:46:38.430105 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: cc2c5f8ac0254d3cae8c28d053cb2722 Sep 16 12:46:38.430105 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1717087707 Sep 16 12:46:38.430105 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-QuotasAdminNegativeTest-1717087707-project Sep 16 12:46:38.430105 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:46:38.430105 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:46:38.430105 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 03348f0e3c5546b3b4f19e045740c7ab Sep 16 12:46:38.430105 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-QuotasAdminNegativeTest-1717087707-project Sep 16 12:46:38.430105 n-d-858094-4 devstack@n-api.service[128780]: Sep 16 12:46:38.430105 n-d-858094-4 devstack@n-api.service[128780]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1586133659", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452"}} Sep 16 12:46:38.430105 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:46:38.430849 n-d-858094-4 devstack@n-api.service[128780]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 16 12:46:38.430849 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1586133659', 'imageRef': '7df4548b-8809-4742-80bd-4e4e6dcafc91', 'flavorRef': '452'}}} Sep 16 12:46:38.430849 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:46:38.430849 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:38.430849 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 16 12:46:38.430849 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 16 12:46:38.430849 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 12:46:38.430849 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 12:46:38.430849 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 16 12:46:38.430849 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc Sep 16 12:46:38.430849 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 16 12:46:38.430849 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 16 12:46:38.430849 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 12:46:38.430849 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 12:46:38.430849 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 16 12:46:38.430849 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 16 12:46:38.430849 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 16 12:46:38.430849 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 16 12:46:38.436658 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 16 12:46:38.436658 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 16 12:46:38.436658 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 16 12:46:38.436658 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:38.436658 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:38.436658 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:38.436658 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:38.436658 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 16 12:46:38.436658 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 16 12:46:38.436658 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 16 12:46:38.436658 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 16 12:46:38.436658 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 16 12:46:38.436658 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 16 12:46:38.436658 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 16 12:46:38.436658 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 16 12:46:38.436658 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 16 12:46:38.436658 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 16 12:46:38.436658 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 16 12:46:38.436658 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:38.436658 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:38.436658 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:38.438395 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:38.438395 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:38.438395 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:38.438395 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:46:38.438395 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:46:38.438395 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:46:38.438395 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:46:38.438395 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:46:38.438395 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:46:38.438395 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:46:38.438395 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:46:38.438395 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:46:38.438395 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:46:38.438395 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 16 12:46:38.438395 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 16 12:46:38.438395 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 16 12:46:38.438395 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 16 12:46:38.438395 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:38.438395 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:38.438395 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:38.438395 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:38.439759 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:38.439759 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:38.439759 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:46:38.439759 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:46:38.439759 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 16 12:46:38.439759 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:38.445511 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d623e02f-4477-4b36-881c-5a9dd46ca7f5 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:46:38.447028 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d623e02f-4477-4b36-881c-5a9dd46ca7f5 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.760742 Sep 16 12:46:38.448228 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 198/399] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:46:36 2022] POST /compute/v2.1/servers => generated 111 bytes in 1763 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:46:38.454177 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ffc84766-a459-4c26-ac25-eff06bcadf04 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:38.454880 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ffc84766-a459-4c26-ac25-eff06bcadf04 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: cbbaed5d-b861-4f03-a39b-c384175b92ea] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:38.463773 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ffc84766-a459-4c26-ac25-eff06bcadf04 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:38.464758 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ffc84766-a459-4c26-ac25-eff06bcadf04 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:38.466067 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ffc84766-a459-4c26-ac25-eff06bcadf04 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:38.467019 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ffc84766-a459-4c26-ac25-eff06bcadf04 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:38.467691 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ffc84766-a459-4c26-ac25-eff06bcadf04 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:38.468371 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ffc84766-a459-4c26-ac25-eff06bcadf04 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:38.674673 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-974253b4-7c6d-4f35-b995-a3903487ad20 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:38.687347 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-974253b4-7c6d-4f35-b995-a3903487ad20 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874" status: 200 len: 1314 microversion: 2.1 time: 1.611824 Sep 16 12:46:38.693027 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 202/400] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:37 2022] GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874 => generated 1314 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:38.699164 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-562aefe9-c2de-461d-a40b-d29f881a278f tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Action: 'update', calling method: .version_select at 0x7f1036122670>, body: {"quota_set": {"cores": 20}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:38.803723 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ffc84766-a459-4c26-ac25-eff06bcadf04 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0815c12c4340109ec1c379a0602322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20770fd1243d4412bfc90d2a079473bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:38.838848 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ffc84766-a459-4c26-ac25-eff06bcadf04 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "GET /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea" status: 200 len: 1280 microversion: 2.1 time: 0.388361 Sep 16 12:46:38.839562 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 199/401] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:38 2022] GET /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea => generated 1280 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:39.234978 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-1f777cc1-fa96-4827-b224-2719c1873325 req-fb4af9ce-f639-4d92-ae5e-80c06e0ab347 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6", "tag": "31e589d5-4175-4617-9376-ffdea1a75308"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:39.263650 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-1f777cc1-fa96-4827-b224-2719c1873325 req-fb4af9ce-f639-4d92-ae5e-80c06e0ab347 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:39.265230 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-1f777cc1-fa96-4827-b224-2719c1873325 req-fb4af9ce-f639-4d92-ae5e-80c06e0ab347 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:39.266052 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-1f777cc1-fa96-4827-b224-2719c1873325 req-fb4af9ce-f639-4d92-ae5e-80c06e0ab347 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:39.296264 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-562aefe9-c2de-461d-a40b-d29f881a278f tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:39.299184 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-562aefe9-c2de-461d-a40b-d29f881a278f tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:39.300923 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-562aefe9-c2de-461d-a40b-d29f881a278f tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:39.307426 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-562aefe9-c2de-461d-a40b-d29f881a278f tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:39.309363 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-562aefe9-c2de-461d-a40b-d29f881a278f tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:39.310694 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-562aefe9-c2de-461d-a40b-d29f881a278f tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:39.321911 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-1f777cc1-fa96-4827-b224-2719c1873325 req-fb4af9ce-f639-4d92-ae5e-80c06e0ab347 service nova] Creating event network-changed:31e589d5-4175-4617-9376-ffdea1a75308 for instance f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 on n-h2-858094-4 Sep 16 12:46:39.332724 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-1f777cc1-fa96-4827-b224-2719c1873325 req-fb4af9ce-f639-4d92-ae5e-80c06e0ab347 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106244 Sep 16 12:46:39.338893 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 200/402] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:39.506643 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-562aefe9-c2de-461d-a40b-d29f881a278f tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/cc2c5f8ac0254d3cae8c28d053cb2722" status: 200 len: 329 microversion: 2.1 time: 0.812355 Sep 16 12:46:39.517881 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 203/403] 10.222.0.67 () {60 vars in 1262 bytes} [Fri Sep 16 12:46:38 2022] PUT /compute/v2.1/os-quota-sets/cc2c5f8ac0254d3cae8c28d053cb2722 => generated 329 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:39.532792 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-15eaf337-67ab-4f5d-ade8-3a6b5c101f59 tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Calling method '.version_select at 0x7f1035f3df70>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:39.711821 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-80037408-aaae-4fe4-bb7a-acd67e3af93a tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:39.714041 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-80037408-aaae-4fe4-bb7a-acd67e3af93a tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: 1b320dc8-1e79-4202-8162-0a418c6b1874] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:39.734819 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80037408-aaae-4fe4-bb7a-acd67e3af93a tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:39.735318 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80037408-aaae-4fe4-bb7a-acd67e3af93a tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:39.735992 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80037408-aaae-4fe4-bb7a-acd67e3af93a tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:39.736969 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80037408-aaae-4fe4-bb7a-acd67e3af93a tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:39.741090 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80037408-aaae-4fe4-bb7a-acd67e3af93a tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:39.744528 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80037408-aaae-4fe4-bb7a-acd67e3af93a tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:40.375077 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-15eaf337-67ab-4f5d-ade8-3a6b5c101f59 tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/cc2c5f8ac0254d3cae8c28d053cb2722" status: 200 len: 371 microversion: 2.1 time: 0.855233 Sep 16 12:46:40.386028 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 201/404] 10.222.0.67 () {58 vars in 1242 bytes} [Fri Sep 16 12:46:39 2022] GET /compute/v2.1/os-quota-sets/cc2c5f8ac0254d3cae8c28d053cb2722 => generated 371 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:40.399854 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9205a382-7e25-4e2a-b5e4-cb16510687de tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:40.401761 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9205a382-7e25-4e2a-b5e4-cb16510687de tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: cbbaed5d-b861-4f03-a39b-c384175b92ea] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:40.417255 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9205a382-7e25-4e2a-b5e4-cb16510687de tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:40.421977 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9205a382-7e25-4e2a-b5e4-cb16510687de tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:40.422727 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9205a382-7e25-4e2a-b5e4-cb16510687de tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:40.426653 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9205a382-7e25-4e2a-b5e4-cb16510687de tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:40.429232 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9205a382-7e25-4e2a-b5e4-cb16510687de tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:40.432565 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9205a382-7e25-4e2a-b5e4-cb16510687de tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:40.704330 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9205a382-7e25-4e2a-b5e4-cb16510687de tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0815c12c4340109ec1c379a0602322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20770fd1243d4412bfc90d2a079473bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:40.715437 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9205a382-7e25-4e2a-b5e4-cb16510687de tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "GET /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea" status: 200 len: 1280 microversion: 2.1 time: 0.325844 Sep 16 12:46:40.720766 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 202/405] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:40 2022] GET /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea => generated 1280 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:40.744571 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-80037408-aaae-4fe4-bb7a-acd67e3af93a tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:40.758223 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-80037408-aaae-4fe4-bb7a-acd67e3af93a tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874" status: 200 len: 1314 microversion: 2.1 time: 1.051198 Sep 16 12:46:40.759338 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 204/406] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:39 2022] GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874 => generated 1314 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:40.774620 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-41d1a286-5f19-4fa4-b3ec-c5c0a5da6f26 tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Action: 'update', calling method: .version_select at 0x7f10361b69d0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:41.128310 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f5345cbb-2e51-4eb3-8470-6445315c0f4e tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Calling method '.version_select at 0x7f1035f53c10>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:41.500354 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41d1a286-5f19-4fa4-b3ec-c5c0a5da6f26 tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:41.501669 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41d1a286-5f19-4fa4-b3ec-c5c0a5da6f26 tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:41.502653 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41d1a286-5f19-4fa4-b3ec-c5c0a5da6f26 tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:41.509577 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41d1a286-5f19-4fa4-b3ec-c5c0a5da6f26 tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:41.514498 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41d1a286-5f19-4fa4-b3ec-c5c0a5da6f26 tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:41.517725 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41d1a286-5f19-4fa4-b3ec-c5c0a5da6f26 tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:41.529105 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f5345cbb-2e51-4eb3-8470-6445315c0f4e tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/9d47b314c38f4f25aa44daf56a6c5fce" status: 200 len: 371 microversion: 2.1 time: 0.805197 Sep 16 12:46:41.532283 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 203/407] 10.222.0.67 () {58 vars in 1242 bytes} [Fri Sep 16 12:46:40 2022] GET /compute/v2.1/os-quota-sets/9d47b314c38f4f25aa44daf56a6c5fce => generated 371 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:41.624083 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-41d1a286-5f19-4fa4-b3ec-c5c0a5da6f26 tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/cc2c5f8ac0254d3cae8c28d053cb2722" status: 200 len: 328 microversion: 2.1 time: 0.862493 Sep 16 12:46:41.638145 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 205/408] 10.222.0.67 () {60 vars in 1262 bytes} [Fri Sep 16 12:46:40 2022] PUT /compute/v2.1/os-quota-sets/cc2c5f8ac0254d3cae8c28d053cb2722 => generated 328 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:41.643207 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-d482c36d-e408-4104-b8ab-544fbcc9f17a req-85b2003d-9c61-4941-9ca9-7825106a1cb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b320dc8-1e79-4202-8162-0a418c6b1874", "tag": "cbbe2856-820c-4bc2-9d0e-6836f1fe0f7c"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:41.660729 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d482c36d-e408-4104-b8ab-544fbcc9f17a req-85b2003d-9c61-4941-9ca9-7825106a1cb1 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:41.662038 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d482c36d-e408-4104-b8ab-544fbcc9f17a req-85b2003d-9c61-4941-9ca9-7825106a1cb1 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:41.662523 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d482c36d-e408-4104-b8ab-544fbcc9f17a req-85b2003d-9c61-4941-9ca9-7825106a1cb1 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:41.676957 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:46:41.683043 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-d482c36d-e408-4104-b8ab-544fbcc9f17a req-85b2003d-9c61-4941-9ca9-7825106a1cb1 service nova] Creating event network-changed:cbbe2856-820c-4bc2-9d0e-6836f1fe0f7c for instance 1b320dc8-1e79-4202-8162-0a418c6b1874 on n-h1-858094-4 Sep 16 12:46:41.705875 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-d482c36d-e408-4104-b8ab-544fbcc9f17a req-85b2003d-9c61-4941-9ca9-7825106a1cb1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066185 Sep 16 12:46:41.710021 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 206/409] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:41.735472 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0a959870-197f-4f02-abf3-a287cbc97db5 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Action: 'update', calling method: .version_select at 0x7f10362e0940>, body: {"quota_set": {"ram": "5120"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:41.787541 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-32abd8d1-76a4-4782-89b2-d858525754bb tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:41.817426 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-32abd8d1-76a4-4782-89b2-d858525754bb tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.283794 Sep 16 12:46:41.825977 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 204/410] 10.222.0.67 () {58 vars in 1137 bytes} [Fri Sep 16 12:46:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:41.839420 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-19db3498-bf46-4969-9e15-c4d841ccba0b tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:41.840314 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-19db3498-bf46-4969-9e15-c4d841ccba0b tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: cbbaed5d-b861-4f03-a39b-c384175b92ea] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:41.866654 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19db3498-bf46-4969-9e15-c4d841ccba0b tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:41.870269 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19db3498-bf46-4969-9e15-c4d841ccba0b tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:41.872568 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19db3498-bf46-4969-9e15-c4d841ccba0b tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:41.873807 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19db3498-bf46-4969-9e15-c4d841ccba0b tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:41.877897 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19db3498-bf46-4969-9e15-c4d841ccba0b tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:41.883028 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19db3498-bf46-4969-9e15-c4d841ccba0b tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:41.960569 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a959870-197f-4f02-abf3-a287cbc97db5 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:41.964484 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a959870-197f-4f02-abf3-a287cbc97db5 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:41.966095 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a959870-197f-4f02-abf3-a287cbc97db5 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:41.970680 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a959870-197f-4f02-abf3-a287cbc97db5 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:41.971348 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a959870-197f-4f02-abf3-a287cbc97db5 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:41.971893 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a959870-197f-4f02-abf3-a287cbc97db5 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:42.094673 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=20,nova_api:INSERT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:46:42.156073 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0a959870-197f-4f02-abf3-a287cbc97db5 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/9d47b314c38f4f25aa44daf56a6c5fce" status: 200 len: 328 microversion: 2.1 time: 0.442730 Sep 16 12:46:42.163170 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 207/411] 10.222.0.67 () {60 vars in 1262 bytes} [Fri Sep 16 12:46:41 2022] PUT /compute/v2.1/os-quota-sets/9d47b314c38f4f25aa44daf56a6c5fce => generated 328 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:42.175504 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-48767d81-8122-4302-8102-e71273f31533 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:42.179941 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-48767d81-8122-4302-8102-e71273f31533 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: 1b320dc8-1e79-4202-8162-0a418c6b1874] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:42.200889 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-48767d81-8122-4302-8102-e71273f31533 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:42.205090 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-48767d81-8122-4302-8102-e71273f31533 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:42.205814 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-48767d81-8122-4302-8102-e71273f31533 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:42.208911 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-48767d81-8122-4302-8102-e71273f31533 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:42.211127 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-48767d81-8122-4302-8102-e71273f31533 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:42.218836 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-48767d81-8122-4302-8102-e71273f31533 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:43.101365 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-19db3498-bf46-4969-9e15-c4d841ccba0b tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0815c12c4340109ec1c379a0602322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20770fd1243d4412bfc90d2a079473bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:43.111933 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-19db3498-bf46-4969-9e15-c4d841ccba0b tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "GET /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea" status: 200 len: 1322 microversion: 2.1 time: 1.284809 Sep 16 12:46:43.112531 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 205/412] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:41 2022] GET /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea => generated 1322 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:43.222728 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-48767d81-8122-4302-8102-e71273f31533 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:43.235494 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-48767d81-8122-4302-8102-e71273f31533 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874" status: 200 len: 1314 microversion: 2.1 time: 1.071035 Sep 16 12:46:43.239104 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 208/413] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:42 2022] GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874 => generated 1314 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:43.257675 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-932a247a-0c42-408b-8096-e979fe629295 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-766288440", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:43.375739 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-932a247a-0c42-408b-8096-e979fe629295 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] validate_networks() for None {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:46:43.744026 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-90b31d41-8375-4e54-a790-07bd8e1eb8e9 tempest-ServersWithSpecificFlavorTestJSON-648082716 tempest-ServersWithSpecificFlavorTestJSON-648082716-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1279903670", "id": 1350934749, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:43.785491 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-90b31d41-8375-4e54-a790-07bd8e1eb8e9 tempest-ServersWithSpecificFlavorTestJSON-648082716 tempest-ServersWithSpecificFlavorTestJSON-648082716-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.671046 Sep 16 12:46:43.792507 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 206/414] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:46:43 2022] POST /compute/v2.1/flavors => generated 425 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:43.825831 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-149153a9-564e-44cb-b0b8-66d18440b2d3 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:43.862329 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-149153a9-564e-44cb-b0b8-66d18440b2d3 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-quota-sets/9d47b314c38f4f25aa44daf56a6c5fce" status: 202 len: 0 microversion: 2.1 time: 0.060598 Sep 16 12:46:43.863747 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 207/415] 10.222.0.67 () {58 vars in 1245 bytes} [Fri Sep 16 12:46:43 2022] DELETE /compute/v2.1/os-quota-sets/9d47b314c38f4f25aa44daf56a6c5fce => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:46:43.874634 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-eb722c3c-4cbe-4200-bd89-9274ab18e127 tempest-ServersWithSpecificFlavorTestJSON-648082716 tempest-ServersWithSpecificFlavorTestJSON-648082716-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:43.905029 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-eb722c3c-4cbe-4200-bd89-9274ab18e127 tempest-ServersWithSpecificFlavorTestJSON-648082716 tempest-ServersWithSpecificFlavorTestJSON-648082716-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.039350 Sep 16 12:46:43.908727 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 208/416] 10.222.0.67 () {58 vars in 1182 bytes} [Fri Sep 16 12:46:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 12:46:43.920672 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3cf7c0b4-354e-499f-9fbd-f2efde712cc2 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Calling method '.version_select at 0x7f1035f673a0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:44.379790 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-932a247a-0c42-408b-8096-e979fe629295 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:46:44.380456 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-932a247a-0c42-408b-8096-e979fe629295 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:46:44.381024 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-932a247a-0c42-408b-8096-e979fe629295 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:46:44.381531 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-932a247a-0c42-408b-8096-e979fe629295 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:46:44.382051 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-932a247a-0c42-408b-8096-e979fe629295 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:46:44.400680 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-932a247a-0c42-408b-8096-e979fe629295 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:44.401333 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-932a247a-0c42-408b-8096-e979fe629295 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:44.401875 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-932a247a-0c42-408b-8096-e979fe629295 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:44.403290 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-932a247a-0c42-408b-8096-e979fe629295 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:44.404012 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-932a247a-0c42-408b-8096-e979fe629295 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:44.405933 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-932a247a-0c42-408b-8096-e979fe629295 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:44.464767 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-932a247a-0c42-408b-8096-e979fe629295 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Getting quotas for project cc2c5f8ac0254d3cae8c28d053cb2722. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:46:44.491270 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-932a247a-0c42-408b-8096-e979fe629295 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Getting quotas for user 03348f0e3c5546b3b4f19e045740c7ab and project cc2c5f8ac0254d3cae8c28d053cb2722. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:46:44.503037 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3cf7c0b4-354e-499f-9fbd-f2efde712cc2 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/9d47b314c38f4f25aa44daf56a6c5fce" status: 200 len: 371 microversion: 2.1 time: 0.592852 Sep 16 12:46:44.504813 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 209/417] 10.222.0.67 () {58 vars in 1242 bytes} [Fri Sep 16 12:46:43 2022] GET /compute/v2.1/os-quota-sets/9d47b314c38f4f25aa44daf56a6c5fce => generated 371 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:44.512922 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-54681cb8-f99d-47fd-9221-cc3b1c2f00e7 tempest-ServersWithSpecificFlavorTestJSON-648082716 tempest-ServersWithSpecificFlavorTestJSON-648082716-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-2086639558", "id": 1411872597, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:44.550539 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.utils [None req-932a247a-0c42-408b-8096-e979fe629295 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] instances quota exceeded for cc2c5f8ac0254d3cae8c28d053cb2722, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128779) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 16 12:46:44.551347 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-932a247a-0c42-408b-8096-e979fe629295 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 16 12:46:44.554968 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-932a247a-0c42-408b-8096-e979fe629295 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Request method failure captured: Sep 16 12:46:44.554968 n-d-858094-4 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 16 12:46:44.554968 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:46:44.554968 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:46:44.554968 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:46:44.554968 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 144 Sep 16 12:46:44.554968 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:46:44.554968 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:46:44.554968 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:46:44.554968 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:46:44.554968 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHAmVRdsz_fqEsSJRTHLzw4hhJpcdThMYAhrLrr_PxYemUlJEG4hWs1JHwNV14h1woJ3urY1UmPWORjP0NjmGE96Tk44ghY2nwzcGbx0K8HJVWVcI54OGihL6tGYm5HCJ7pp0IxpOV_GptfBOkx04Qu_FpNbj1rJEFiudwSuM16r7Tg Sep 16 12:46:44.554968 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:46:44.554968 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:46:44.554968 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:46:44.554968 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:46:44.554968 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:46:44.554968 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:46:44.554968 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: cc2c5f8ac0254d3cae8c28d053cb2722 Sep 16 12:46:44.554968 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-QuotasAdminNegativeTest-1717087707 Sep 16 12:46:44.554968 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:46:44.554968 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:46:44.557086 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cc2c5f8ac0254d3cae8c28d053cb2722"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/cc2c5f8ac0254d3cae8c28d053cb2722"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_cc2c5f8ac0254d3cae8c28d053cb2722", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cc2c5f8ac0254d3cae8c28d053cb2722"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:46:44.557086 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-QuotasAdminNegativeTest-1717087707 Sep 16 12:46:44.557086 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: cc2c5f8ac0254d3cae8c28d053cb2722 Sep 16 12:46:44.557086 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1717087707 Sep 16 12:46:44.557086 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-QuotasAdminNegativeTest-1717087707-project Sep 16 12:46:44.557086 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:46:44.557086 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:46:44.557086 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 03348f0e3c5546b3b4f19e045740c7ab Sep 16 12:46:44.557086 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-QuotasAdminNegativeTest-1717087707-project Sep 16 12:46:44.557086 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 12:46:44.557086 n-d-858094-4 devstack@n-api.service[128779]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-766288440", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452"}} Sep 16 12:46:44.557086 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:46:44.557748 n-d-858094-4 devstack@n-api.service[128779]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 16 12:46:44.557748 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-766288440', 'imageRef': '7df4548b-8809-4742-80bd-4e4e6dcafc91', 'flavorRef': '452'}}} Sep 16 12:46:44.557748 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:46:44.557748 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:44.557748 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 16 12:46:44.557748 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 16 12:46:44.557748 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 12:46:44.557748 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 12:46:44.557748 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 16 12:46:44.557748 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc Sep 16 12:46:44.557748 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 16 12:46:44.557748 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 16 12:46:44.557748 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 12:46:44.557748 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 12:46:44.557748 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 16 12:46:44.557748 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 16 12:46:44.557748 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 16 12:46:44.557748 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 16 12:46:44.558741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 16 12:46:44.558741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 16 12:46:44.558741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Sep 16 12:46:44.558741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:44.558741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:44.558741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:44.558741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:44.558741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 16 12:46:44.558741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 16 12:46:44.558741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 16 12:46:44.558741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 16 12:46:44.558741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 16 12:46:44.558741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 16 12:46:44.558741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 16 12:46:44.558741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 16 12:46:44.558741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 16 12:46:44.558741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 16 12:46:44.558741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 16 12:46:44.558741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:44.558741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:44.558741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:44.560033 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:44.560033 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:44.560033 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:44.560033 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:46:44.560033 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:46:44.560033 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:46:44.560033 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:46:44.560033 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:46:44.560033 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:46:44.560033 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:46:44.560033 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:46:44.560033 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:46:44.560033 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:46:44.560033 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 16 12:46:44.560033 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 16 12:46:44.560033 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 16 12:46:44.560033 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 16 12:46:44.560033 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:44.560033 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:44.560033 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:44.560033 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:44.562297 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:44.562297 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:44.562297 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:46:44.562297 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:46:44.562297 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 16 12:46:44.562297 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:44.562297 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-932a247a-0c42-408b-8096-e979fe629295 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:46:44.562297 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-932a247a-0c42-408b-8096-e979fe629295 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.315578 Sep 16 12:46:44.562297 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 209/418] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:46:43 2022] POST /compute/v2.1/servers => generated 119 bytes in 1318 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:46:44.565057 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8090aae9-7903-4720-b883-eaade79660a9 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:44.566476 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8090aae9-7903-4720-b883-eaade79660a9 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: cbbaed5d-b861-4f03-a39b-c384175b92ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:44.576412 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8090aae9-7903-4720-b883-eaade79660a9 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:44.577220 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8090aae9-7903-4720-b883-eaade79660a9 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:44.577822 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8090aae9-7903-4720-b883-eaade79660a9 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:44.578835 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8090aae9-7903-4720-b883-eaade79660a9 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:44.579495 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8090aae9-7903-4720-b883-eaade79660a9 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:44.580821 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8090aae9-7903-4720-b883-eaade79660a9 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:44.596204 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-54681cb8-f99d-47fd-9221-cc3b1c2f00e7 tempest-ServersWithSpecificFlavorTestJSON-648082716 tempest-ServersWithSpecificFlavorTestJSON-648082716-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.090045 Sep 16 12:46:44.599416 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 210/419] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:46:44 2022] POST /compute/v2.1/flavors => generated 425 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:44.606371 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-54191b77-d7d9-4727-84ee-32af2d697b30 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:44.607759 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-54191b77-d7d9-4727-84ee-32af2d697b30 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: 1b320dc8-1e79-4202-8162-0a418c6b1874] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:44.616653 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-54191b77-d7d9-4727-84ee-32af2d697b30 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:44.617734 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-54191b77-d7d9-4727-84ee-32af2d697b30 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:44.618349 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-54191b77-d7d9-4727-84ee-32af2d697b30 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:44.619706 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-54191b77-d7d9-4727-84ee-32af2d697b30 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:44.620371 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-54191b77-d7d9-4727-84ee-32af2d697b30 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:44.620956 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-54191b77-d7d9-4727-84ee-32af2d697b30 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:45.601267 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8090aae9-7903-4720-b883-eaade79660a9 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0815c12c4340109ec1c379a0602322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20770fd1243d4412bfc90d2a079473bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:45.610786 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8090aae9-7903-4720-b883-eaade79660a9 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "GET /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea" status: 200 len: 1322 microversion: 2.1 time: 1.052479 Sep 16 12:46:45.611794 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 210/420] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:44 2022] GET /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea => generated 1322 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:45.617142 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-141696c2-8e5d-4ca5-bbc1-fde60baee9bc tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Action: 'update', calling method: .version_select at 0x7f1036185940>, body: {"quota_set": {"instances": 10}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:45.618939 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-54191b77-d7d9-4727-84ee-32af2d697b30 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:45.632423 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-54191b77-d7d9-4727-84ee-32af2d697b30 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874" status: 200 len: 1314 microversion: 2.1 time: 1.026510 Sep 16 12:46:45.644565 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 211/421] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:44 2022] GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874 => generated 1314 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:45.657880 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ae6877bf-3155-4399-981e-8e7e92b99607 tempest-ServersWithSpecificFlavorTestJSON-648082716 tempest-ServersWithSpecificFlavorTestJSON-648082716-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:45.666383 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=87,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:46:45.674821 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ae6877bf-3155-4399-981e-8e7e92b99607 tempest-ServersWithSpecificFlavorTestJSON-648082716 tempest-ServersWithSpecificFlavorTestJSON-648082716-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.031011 Sep 16 12:46:45.675469 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 212/422] 10.222.0.67 () {58 vars in 1182 bytes} [Fri Sep 16 12:46:45 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 12:46:45.680228 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0e8d44a8-e517-429e-a260-9b78fc2a3efd tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Calling method '.version_select at 0x7f103605dca0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:45.917922 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=68,nova_cell0:UPDATE=7 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:46:45.924796 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-141696c2-8e5d-4ca5-bbc1-fde60baee9bc tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:45.926328 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-141696c2-8e5d-4ca5-bbc1-fde60baee9bc tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:45.929592 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-141696c2-8e5d-4ca5-bbc1-fde60baee9bc tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:45.930573 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-141696c2-8e5d-4ca5-bbc1-fde60baee9bc tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:45.931537 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-141696c2-8e5d-4ca5-bbc1-fde60baee9bc tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:45.932201 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-141696c2-8e5d-4ca5-bbc1-fde60baee9bc tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:46.047373 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0e8d44a8-e517-429e-a260-9b78fc2a3efd tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/f506c947b0fa4f098ced1e2f2ba945ad/defaults" status: 200 len: 371 microversion: 2.1 time: 0.370382 Sep 16 12:46:46.051119 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 213/423] 10.222.0.67 () {58 vars in 1269 bytes} [Fri Sep 16 12:46:45 2022] GET /compute/v2.1/os-quota-sets/f506c947b0fa4f098ced1e2f2ba945ad/defaults => generated 371 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:46.058724 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0e8d44a8-e517-429e-a260-9b78fc2a3efd tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:46.061913 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0e8d44a8-e517-429e-a260-9b78fc2a3efd tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] 10.222.0.67 "GET /compute//" status: 200 len: 377 microversion: - time: 0.008420 Sep 16 12:46:46.067679 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 214/424] 10.222.0.67 () {56 vars in 886 bytes} [Fri Sep 16 12:46:46 2022] GET /compute/ => generated 377 bytes in 16 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 16 12:46:46.083950 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-141696c2-8e5d-4ca5-bbc1-fde60baee9bc tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/cc2c5f8ac0254d3cae8c28d053cb2722" status: 200 len: 329 microversion: 2.1 time: 0.470441 Sep 16 12:46:46.085418 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 211/425] 10.222.0.67 () {60 vars in 1262 bytes} [Fri Sep 16 12:46:45 2022] PUT /compute/v2.1/os-quota-sets/cc2c5f8ac0254d3cae8c28d053cb2722 => generated 329 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:46.098094 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-24e88f3d-6cb9-4d5e-9f69-08e6f778f0d2 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Action: 'create', calling method: .version_select at 0x7f1035ee3b80>, body: {"keypair": {"name": "tempest-keypair-1023851508", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2S3KZau0kNRJC3wwVkD8VVjnGW47DiFo/LKAfbR/cfL1MSCFXeP14X6BfQGjM+fpSEzrXg0ox9mS7EU+nPJKvTMFVHbWt1L5KGyF7AJgW0eLABw/JDo7IaGPNzeGJ5wg=="}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:46.119092 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5b288c67-ada5-44db-92fb-c7ce934f335d tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Calling method '.version_select at 0x7f1036156f70>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:46.151233 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=78,nova_cell0:UPDATE=7 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:46:46.160364 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-24e88f3d-6cb9-4d5e-9f69-08e6f778f0d2 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Getting quotas for project 7058e9e184834c39a5a299f481a6e62e. Resources: {'key_pairs'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:46:46.179371 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-24e88f3d-6cb9-4d5e-9f69-08e6f778f0d2 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Getting quotas for user 709f71c239ca40b8b958038c9ab16f37 and project 7058e9e184834c39a5a299f481a6e62e. Resources: {'key_pairs'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:46:46.227699 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-24e88f3d-6cb9-4d5e-9f69-08e6f778f0d2 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.156487 Sep 16 12:46:46.233715 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 215/426] 10.222.0.67 () {60 vars in 1159 bytes} [Fri Sep 16 12:46:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:46.312570 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-b69bfd9a-1111-4f39-9fb4-ef2aaeb0b2b1 req-4d2fb8f3-663d-4822-ab57-b8ca2e49a5e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbbaed5d-b861-4f03-a39b-c384175b92ea", "tag": "91c7636f-22ac-48c6-a666-8fef6f5cae01"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:46.358526 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-b69bfd9a-1111-4f39-9fb4-ef2aaeb0b2b1 req-4d2fb8f3-663d-4822-ab57-b8ca2e49a5e3 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:46.359536 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-b69bfd9a-1111-4f39-9fb4-ef2aaeb0b2b1 req-4d2fb8f3-663d-4822-ab57-b8ca2e49a5e3 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:46.360666 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-b69bfd9a-1111-4f39-9fb4-ef2aaeb0b2b1 req-4d2fb8f3-663d-4822-ab57-b8ca2e49a5e3 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:46.378774 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-b69bfd9a-1111-4f39-9fb4-ef2aaeb0b2b1 req-4d2fb8f3-663d-4822-ab57-b8ca2e49a5e3 service nova] Creating event network-changed:91c7636f-22ac-48c6-a666-8fef6f5cae01 for instance cbbaed5d-b861-4f03-a39b-c384175b92ea on n-h2-858094-4 Sep 16 12:46:46.387076 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-b69bfd9a-1111-4f39-9fb4-ef2aaeb0b2b1 req-4d2fb8f3-663d-4822-ab57-b8ca2e49a5e3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079596 Sep 16 12:46:46.388422 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 216/427] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:46.637804 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fad69da4-88c4-4cca-becb-2dadf39475fe tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:46.638828 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-fad69da4-88c4-4cca-becb-2dadf39475fe tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: cbbaed5d-b861-4f03-a39b-c384175b92ea] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:46.659141 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fad69da4-88c4-4cca-becb-2dadf39475fe tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:46.662527 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fad69da4-88c4-4cca-becb-2dadf39475fe tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:46.664052 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fad69da4-88c4-4cca-becb-2dadf39475fe tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:46.666144 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fad69da4-88c4-4cca-becb-2dadf39475fe tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:46.667312 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fad69da4-88c4-4cca-becb-2dadf39475fe tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:46.668469 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fad69da4-88c4-4cca-becb-2dadf39475fe tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:47.059733 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5b288c67-ada5-44db-92fb-c7ce934f335d tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/cc2c5f8ac0254d3cae8c28d053cb2722" status: 200 len: 371 microversion: 2.1 time: 0.947433 Sep 16 12:46:47.062419 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 212/428] 10.222.0.67 () {58 vars in 1242 bytes} [Fri Sep 16 12:46:46 2022] GET /compute/v2.1/os-quota-sets/cc2c5f8ac0254d3cae8c28d053cb2722 => generated 371 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:47.083163 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e417719c-28c8-486f-8242-b865aa8a7d09 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:47.086691 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e417719c-28c8-486f-8242-b865aa8a7d09 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: 1b320dc8-1e79-4202-8162-0a418c6b1874] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:47.105492 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e417719c-28c8-486f-8242-b865aa8a7d09 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:47.106952 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e417719c-28c8-486f-8242-b865aa8a7d09 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:47.108840 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e417719c-28c8-486f-8242-b865aa8a7d09 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:47.110893 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e417719c-28c8-486f-8242-b865aa8a7d09 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:47.111946 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e417719c-28c8-486f-8242-b865aa8a7d09 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:47.113377 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e417719c-28c8-486f-8242-b865aa8a7d09 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:47.604250 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e417719c-28c8-486f-8242-b865aa8a7d09 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:47.614765 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-fad69da4-88c4-4cca-becb-2dadf39475fe tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0815c12c4340109ec1c379a0602322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20770fd1243d4412bfc90d2a079473bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:47.617565 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e417719c-28c8-486f-8242-b865aa8a7d09 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874" status: 200 len: 1314 microversion: 2.1 time: 0.551607 Sep 16 12:46:47.622691 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-fad69da4-88c4-4cca-becb-2dadf39475fe tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "GET /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea" status: 200 len: 1322 microversion: 2.1 time: 0.991801 Sep 16 12:46:47.623279 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 217/429] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:46 2022] GET /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea => generated 1322 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:46:47.630540 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 213/430] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:47 2022] GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874 => generated 1314 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:47.639144 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-53de9794-e142-41ff-a42c-80f9a582bc3b tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Action: 'update', calling method: .version_select at 0x7f1035f3d8b0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:47.645462 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d93731fe-9dee-485d-b8f1-76cae5d4d1ed tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Action: 'update', calling method: .version_select at 0x7f10361b6dc0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:48.203197 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d93731fe-9dee-485d-b8f1-76cae5d4d1ed tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:48.205237 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d93731fe-9dee-485d-b8f1-76cae5d4d1ed tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:48.206000 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d93731fe-9dee-485d-b8f1-76cae5d4d1ed tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:48.210366 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d93731fe-9dee-485d-b8f1-76cae5d4d1ed tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:48.212868 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d93731fe-9dee-485d-b8f1-76cae5d4d1ed tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:48.213663 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d93731fe-9dee-485d-b8f1-76cae5d4d1ed tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:48.297304 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-53de9794-e142-41ff-a42c-80f9a582bc3b tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:48.298583 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-53de9794-e142-41ff-a42c-80f9a582bc3b tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:48.299851 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-53de9794-e142-41ff-a42c-80f9a582bc3b tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:48.301359 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-53de9794-e142-41ff-a42c-80f9a582bc3b tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:48.302594 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-53de9794-e142-41ff-a42c-80f9a582bc3b tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:48.303712 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-53de9794-e142-41ff-a42c-80f9a582bc3b tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:48.376067 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d93731fe-9dee-485d-b8f1-76cae5d4d1ed tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/cc2c5f8ac0254d3cae8c28d053cb2722" status: 200 len: 325 microversion: 2.1 time: 0.738336 Sep 16 12:46:48.376896 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 214/431] 10.222.0.67 () {60 vars in 1262 bytes} [Fri Sep 16 12:46:47 2022] PUT /compute/v2.1/os-quota-sets/cc2c5f8ac0254d3cae8c28d053cb2722 => generated 325 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:48.386459 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-8fbe25db-ee77-4e58-ab54-bbb893f46129 req-6db71226-47b6-4f32-9bf0-b1bcd96ac693 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6", "name": "network-vif-plugged", "status": "completed", "tag": "31e589d5-4175-4617-9376-ffdea1a75308"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:48.399304 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8fbe25db-ee77-4e58-ab54-bbb893f46129 req-6db71226-47b6-4f32-9bf0-b1bcd96ac693 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:48.399994 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8fbe25db-ee77-4e58-ab54-bbb893f46129 req-6db71226-47b6-4f32-9bf0-b1bcd96ac693 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:48.400729 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8fbe25db-ee77-4e58-ab54-bbb893f46129 req-6db71226-47b6-4f32-9bf0-b1bcd96ac693 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:48.414657 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-8fbe25db-ee77-4e58-ab54-bbb893f46129 req-6db71226-47b6-4f32-9bf0-b1bcd96ac693 service nova] Creating event network-vif-plugged:31e589d5-4175-4617-9376-ffdea1a75308 for instance f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 on n-h2-858094-4 Sep 16 12:46:48.421615 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-8fbe25db-ee77-4e58-ab54-bbb893f46129 req-6db71226-47b6-4f32-9bf0-b1bcd96ac693 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040488 Sep 16 12:46:48.422784 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 215/432] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:48.479465 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-53de9794-e142-41ff-a42c-80f9a582bc3b tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/a44039861dc94173817d7a9b206bfee1" status: 200 len: 328 microversion: 2.1 time: 0.851978 Sep 16 12:46:48.480480 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 218/433] 10.222.0.67 () {60 vars in 1262 bytes} [Fri Sep 16 12:46:47 2022] PUT /compute/v2.1/os-quota-sets/a44039861dc94173817d7a9b206bfee1 => generated 328 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:48.495745 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6220c7b5-d0b4-48a2-b1fb-bce98a2f7d70 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Calling method '.version_select at 0x7f1036156820>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:48.600298 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d1630a6f-fb73-4c3e-89ab-0220820b4a79 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-106762868", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:48.704527 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-d1630a6f-fb73-4c3e-89ab-0220820b4a79 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] validate_networks() for None {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:46:49.067272 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6220c7b5-d0b4-48a2-b1fb-bce98a2f7d70 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:49.068204 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6220c7b5-d0b4-48a2-b1fb-bce98a2f7d70 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:49.068852 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6220c7b5-d0b4-48a2-b1fb-bce98a2f7d70 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:49.070146 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6220c7b5-d0b4-48a2-b1fb-bce98a2f7d70 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:49.070828 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6220c7b5-d0b4-48a2-b1fb-bce98a2f7d70 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:49.071493 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6220c7b5-d0b4-48a2-b1fb-bce98a2f7d70 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:49.099341 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6220c7b5-d0b4-48a2-b1fb-bce98a2f7d70 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/a44039861dc94173817d7a9b206bfee1/detail" status: 200 len: 916 microversion: 2.1 time: 0.609407 Sep 16 12:46:49.115040 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 216/434] 10.222.0.67 () {58 vars in 1263 bytes} [Fri Sep 16 12:46:48 2022] GET /compute/v2.1/os-quota-sets/a44039861dc94173817d7a9b206bfee1/detail => generated 916 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:49.129992 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a9355763-dfea-457f-a720-7d83093dc2c5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:49.130759 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a9355763-dfea-457f-a720-7d83093dc2c5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: 1b320dc8-1e79-4202-8162-0a418c6b1874] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:49.146036 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9355763-dfea-457f-a720-7d83093dc2c5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:49.146535 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9355763-dfea-457f-a720-7d83093dc2c5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:49.146977 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9355763-dfea-457f-a720-7d83093dc2c5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:49.147687 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9355763-dfea-457f-a720-7d83093dc2c5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:49.148168 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9355763-dfea-457f-a720-7d83093dc2c5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:49.148600 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9355763-dfea-457f-a720-7d83093dc2c5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:49.794827 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-d1630a6f-fb73-4c3e-89ab-0220820b4a79 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:46:49.795369 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-d1630a6f-fb73-4c3e-89ab-0220820b4a79 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:46:49.795922 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-d1630a6f-fb73-4c3e-89ab-0220820b4a79 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:46:49.796476 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-d1630a6f-fb73-4c3e-89ab-0220820b4a79 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:46:49.797012 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-d1630a6f-fb73-4c3e-89ab-0220820b4a79 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:46:49.818870 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d1630a6f-fb73-4c3e-89ab-0220820b4a79 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:49.819505 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d1630a6f-fb73-4c3e-89ab-0220820b4a79 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:49.820035 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d1630a6f-fb73-4c3e-89ab-0220820b4a79 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:49.820938 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d1630a6f-fb73-4c3e-89ab-0220820b4a79 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:49.821650 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d1630a6f-fb73-4c3e-89ab-0220820b4a79 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:49.822320 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d1630a6f-fb73-4c3e-89ab-0220820b4a79 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:49.875935 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-d1630a6f-fb73-4c3e-89ab-0220820b4a79 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Getting quotas for project cc2c5f8ac0254d3cae8c28d053cb2722. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:46:49.888612 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-d1630a6f-fb73-4c3e-89ab-0220820b4a79 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Getting quotas for user 03348f0e3c5546b3b4f19e045740c7ab and project cc2c5f8ac0254d3cae8c28d053cb2722. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:46:49.913256 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.utils [None req-d1630a6f-fb73-4c3e-89ab-0220820b4a79 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] ram quota exceeded for cc2c5f8ac0254d3cae8c28d053cb2722, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128780) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 16 12:46:49.914090 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-d1630a6f-fb73-4c3e-89ab-0220820b4a79 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 16 12:46:49.916435 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d1630a6f-fb73-4c3e-89ab-0220820b4a79 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Request method failure captured: Sep 16 12:46:49.916435 n-d-858094-4 devstack@n-api.service[128780]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 16 12:46:49.916435 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:46:49.916435 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:46:49.916435 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:46:49.916435 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 144 Sep 16 12:46:49.916435 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:46:49.916435 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:46:49.916435 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:46:49.916435 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:46:49.916435 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHAmVRdsz_fqEsSJRTHLzw4hhJpcdThMYAhrLrr_PxYemUlJEG4hWs1JHwNV14h1woJ3urY1UmPWORjP0NjmGE96Tk44ghY2nwzcGbx0K8HJVWVcI54OGihL6tGYm5HCJ7pp0IxpOV_GptfBOkx04Qu_FpNbj1rJEFiudwSuM16r7Tg Sep 16 12:46:49.916435 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:46:49.916435 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:46:49.916435 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:46:49.916435 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:46:49.916435 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:46:49.916435 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:46:49.916435 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: cc2c5f8ac0254d3cae8c28d053cb2722 Sep 16 12:46:49.916435 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-QuotasAdminNegativeTest-1717087707 Sep 16 12:46:49.916435 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:46:49.916435 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:46:49.917969 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cc2c5f8ac0254d3cae8c28d053cb2722"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/cc2c5f8ac0254d3cae8c28d053cb2722"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_cc2c5f8ac0254d3cae8c28d053cb2722", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cc2c5f8ac0254d3cae8c28d053cb2722"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:46:49.917969 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-QuotasAdminNegativeTest-1717087707 Sep 16 12:46:49.917969 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: cc2c5f8ac0254d3cae8c28d053cb2722 Sep 16 12:46:49.917969 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1717087707 Sep 16 12:46:49.917969 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-QuotasAdminNegativeTest-1717087707-project Sep 16 12:46:49.917969 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:46:49.917969 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:46:49.917969 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 03348f0e3c5546b3b4f19e045740c7ab Sep 16 12:46:49.917969 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-QuotasAdminNegativeTest-1717087707-project Sep 16 12:46:49.917969 n-d-858094-4 devstack@n-api.service[128780]: Sep 16 12:46:49.917969 n-d-858094-4 devstack@n-api.service[128780]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-106762868", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452"}} Sep 16 12:46:49.917969 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:46:49.918842 n-d-858094-4 devstack@n-api.service[128780]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 16 12:46:49.918842 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-106762868', 'imageRef': '7df4548b-8809-4742-80bd-4e4e6dcafc91', 'flavorRef': '452'}}} Sep 16 12:46:49.918842 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:46:49.918842 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:49.918842 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 16 12:46:49.918842 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 16 12:46:49.918842 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 12:46:49.918842 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 12:46:49.918842 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 16 12:46:49.918842 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc Sep 16 12:46:49.918842 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 16 12:46:49.918842 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 16 12:46:49.918842 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 12:46:49.918842 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 12:46:49.918842 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 16 12:46:49.918842 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 16 12:46:49.918842 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 16 12:46:49.918842 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 16 12:46:49.920103 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 16 12:46:49.920103 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 16 12:46:49.920103 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 16 12:46:49.920103 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:49.920103 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:49.920103 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:49.920103 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:49.920103 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 16 12:46:49.920103 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 16 12:46:49.920103 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 16 12:46:49.920103 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 16 12:46:49.920103 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 16 12:46:49.920103 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 16 12:46:49.920103 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 16 12:46:49.920103 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 16 12:46:49.920103 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 16 12:46:49.920103 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 16 12:46:49.920103 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 16 12:46:49.920103 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:49.920103 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:49.920103 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:49.921594 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:49.921594 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:49.921594 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:49.921594 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:46:49.921594 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:46:49.921594 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:46:49.921594 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:46:49.921594 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:46:49.921594 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:46:49.921594 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:46:49.921594 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:46:49.921594 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:46:49.921594 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:46:49.921594 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 16 12:46:49.921594 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 16 12:46:49.921594 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 16 12:46:49.921594 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 16 12:46:49.921594 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:49.921594 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:49.921594 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:49.921594 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:49.923599 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:49.923599 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:49.923599 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:46:49.923599 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:46:49.923599 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 16 12:46:49.923599 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:49.926339 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d1630a6f-fb73-4c3e-89ab-0220820b4a79 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:46:49.935604 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a9355763-dfea-457f-a720-7d83093dc2c5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:49.938685 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d1630a6f-fb73-4c3e-89ab-0220820b4a79 tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.345598 Sep 16 12:46:49.944708 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 219/435] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:46:48 2022] POST /compute/v2.1/servers => generated 110 bytes in 1352 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 16 12:46:49.951717 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a9355763-dfea-457f-a720-7d83093dc2c5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874" status: 200 len: 1314 microversion: 2.1 time: 0.834614 Sep 16 12:46:49.953282 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 217/436] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:49 2022] GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874 => generated 1314 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:49.955084 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-08c31865-0dbd-4b7b-8515-cb59556d4b47 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:49.955882 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-08c31865-0dbd-4b7b-8515-cb59556d4b47 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: cbbaed5d-b861-4f03-a39b-c384175b92ea] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:49.965246 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-08c31865-0dbd-4b7b-8515-cb59556d4b47 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:49.965979 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-08c31865-0dbd-4b7b-8515-cb59556d4b47 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:49.966607 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-08c31865-0dbd-4b7b-8515-cb59556d4b47 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:49.967472 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-08c31865-0dbd-4b7b-8515-cb59556d4b47 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:49.968587 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-16c97fdb-0cf4-48e8-97f1-efd6fc710a47 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Action: 'update', calling method: .version_select at 0x7f1036122940>, body: {"quota_set": {"ram": "2048"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:49.968949 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-08c31865-0dbd-4b7b-8515-cb59556d4b47 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:49.969544 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-08c31865-0dbd-4b7b-8515-cb59556d4b47 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:50.164086 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16c97fdb-0cf4-48e8-97f1-efd6fc710a47 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:50.165116 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16c97fdb-0cf4-48e8-97f1-efd6fc710a47 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:50.165781 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16c97fdb-0cf4-48e8-97f1-efd6fc710a47 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:50.166822 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16c97fdb-0cf4-48e8-97f1-efd6fc710a47 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:50.168102 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16c97fdb-0cf4-48e8-97f1-efd6fc710a47 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:50.168826 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16c97fdb-0cf4-48e8-97f1-efd6fc710a47 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:50.272270 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16c97fdb-0cf4-48e8-97f1-efd6fc710a47 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:50.273064 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16c97fdb-0cf4-48e8-97f1-efd6fc710a47 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:50.273700 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16c97fdb-0cf4-48e8-97f1-efd6fc710a47 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:50.275305 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16c97fdb-0cf4-48e8-97f1-efd6fc710a47 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:50.276317 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16c97fdb-0cf4-48e8-97f1-efd6fc710a47 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:50.276983 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16c97fdb-0cf4-48e8-97f1-efd6fc710a47 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:50.442490 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-16c97fdb-0cf4-48e8-97f1-efd6fc710a47 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/a44039861dc94173817d7a9b206bfee1?user_id=fee06650a0fa408f87ed0139c9541e3e" status: 200 len: 328 microversion: 2.1 time: 0.486482 Sep 16 12:46:50.443500 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 218/437] 10.222.0.67 () {60 vars in 1343 bytes} [Fri Sep 16 12:46:49 2022] PUT /compute/v2.1/os-quota-sets/a44039861dc94173817d7a9b206bfee1?user_id=fee06650a0fa408f87ed0139c9541e3e => generated 328 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:50.449358 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-16e23dff-c978-4d9c-bae5-09c64437b458 tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Action: 'update', calling method: .version_select at 0x7f1036156820>, body: {"quota_set": {"ram": 51200}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:50.687184 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16e23dff-c978-4d9c-bae5-09c64437b458 tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:50.687670 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16e23dff-c978-4d9c-bae5-09c64437b458 tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:50.688102 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16e23dff-c978-4d9c-bae5-09c64437b458 tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:50.693459 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16e23dff-c978-4d9c-bae5-09c64437b458 tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:50.694191 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16e23dff-c978-4d9c-bae5-09c64437b458 tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:50.694632 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16e23dff-c978-4d9c-bae5-09c64437b458 tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:50.808881 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:46:50.858914 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-16e23dff-c978-4d9c-bae5-09c64437b458 tempest-QuotasAdminNegativeTest-766765485 tempest-QuotasAdminNegativeTest-766765485-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/cc2c5f8ac0254d3cae8c28d053cb2722" status: 200 len: 329 microversion: 2.1 time: 0.413599 Sep 16 12:46:50.863054 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 219/438] 10.222.0.67 () {60 vars in 1262 bytes} [Fri Sep 16 12:46:50 2022] PUT /compute/v2.1/os-quota-sets/cc2c5f8ac0254d3cae8c28d053cb2722 => generated 329 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:50.883490 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e3016533-cb75-422b-b2f4-d68a40016f2f tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Calling method '.version_select at 0x7f1036156dc0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:51.022750 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-08c31865-0dbd-4b7b-8515-cb59556d4b47 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0815c12c4340109ec1c379a0602322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20770fd1243d4412bfc90d2a079473bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:51.028512 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e3016533-cb75-422b-b2f4-d68a40016f2f tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/a44039861dc94173817d7a9b206bfee1?user_id=fee06650a0fa408f87ed0139c9541e3e" status: 200 len: 370 microversion: 2.1 time: 0.161266 Sep 16 12:46:51.033369 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-08c31865-0dbd-4b7b-8515-cb59556d4b47 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "GET /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea" status: 200 len: 1322 microversion: 2.1 time: 1.086216 Sep 16 12:46:51.036281 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 220/439] 10.222.0.67 () {58 vars in 1323 bytes} [Fri Sep 16 12:46:50 2022] GET /compute/v2.1/os-quota-sets/a44039861dc94173817d7a9b206bfee1?user_id=fee06650a0fa408f87ed0139c9541e3e => generated 370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:51.046225 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 220/440] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:49 2022] GET /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea => generated 1322 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:51.050539 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-648243ae-39cc-4284-bb13-b759efdcc894 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1511261391", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "1411872597", "adminPass": "***", "networks": [{"uuid": "eb8add18-d929-45d2-acc9-197a8391e875"}], "security_groups": [{"name": "tempest-securitygroup--1951644033"}], "key_name": "tempest-keypair-1023851508", "user_data": "}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:51.055308 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-1775c3ed-1c73-49b1-a89a-34a663efcb4b req-a88c6320-9526-4f4c-9a96-cdd4d2c79a56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b320dc8-1e79-4202-8162-0a418c6b1874", "name": "network-vif-plugged", "status": "completed", "tag": "cbbe2856-820c-4bc2-9d0e-6836f1fe0f7c"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:51.080775 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-1775c3ed-1c73-49b1-a89a-34a663efcb4b req-a88c6320-9526-4f4c-9a96-cdd4d2c79a56 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:51.090651 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-1775c3ed-1c73-49b1-a89a-34a663efcb4b req-a88c6320-9526-4f4c-9a96-cdd4d2c79a56 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:51.091096 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-1775c3ed-1c73-49b1-a89a-34a663efcb4b req-a88c6320-9526-4f4c-9a96-cdd4d2c79a56 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:51.110094 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-1775c3ed-1c73-49b1-a89a-34a663efcb4b req-a88c6320-9526-4f4c-9a96-cdd4d2c79a56 service nova] Creating event network-vif-plugged:cbbe2856-820c-4bc2-9d0e-6836f1fe0f7c for instance 1b320dc8-1e79-4202-8162-0a418c6b1874 on n-h1-858094-4 Sep 16 12:46:51.121791 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-1775c3ed-1c73-49b1-a89a-34a663efcb4b req-a88c6320-9526-4f4c-9a96-cdd4d2c79a56 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074278 Sep 16 12:46:51.143225 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 221/441] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:51.157250 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a88725d4-6ea3-4915-9886-5f4f7e8b597f tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Action: 'update', calling method: .version_select at 0x7f1035ffaa60>, body: {"quota_set": {"ram": 0}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:51.170608 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a88725d4-6ea3-4915-9886-5f4f7e8b597f tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '03348f0e3c5546b3b4f19e045740c7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2c5f8ac0254d3cae8c28d053cb2722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:51.175908 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a88725d4-6ea3-4915-9886-5f4f7e8b597f tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Request method failure captured: Sep 16 12:46:51.175908 n-d-858094-4 devstack@n-api.service[128780]: request: PUT /compute/v2.1/os-quota-sets/cc2c5f8ac0254d3cae8c28d053cb2722 HTTP/1.1 Sep 16 12:46:51.175908 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:46:51.175908 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:46:51.175908 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:46:51.175908 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 25 Sep 16 12:46:51.175908 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:46:51.175908 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:46:51.175908 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:46:51.175908 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:46:51.175908 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHAmVRdsz_fqEsSJRTHLzw4hhJpcdThMYAhrLrr_PxYemUlJEG4hWs1JHwNV14h1woJ3urY1UmPWORjP0NjmGE96Tk44ghY2nwzcGbx0K8HJVWVcI54OGihL6tGYm5HCJ7pp0IxpOV_GptfBOkx04Qu_FpNbj1rJEFiudwSuM16r7Tg Sep 16 12:46:51.175908 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:46:51.175908 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:46:51.175908 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:46:51.175908 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:46:51.175908 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:46:51.175908 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:46:51.175908 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: cc2c5f8ac0254d3cae8c28d053cb2722 Sep 16 12:46:51.175908 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-QuotasAdminNegativeTest-1717087707 Sep 16 12:46:51.175908 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:46:51.175908 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:46:51.177380 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cc2c5f8ac0254d3cae8c28d053cb2722"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/cc2c5f8ac0254d3cae8c28d053cb2722"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_cc2c5f8ac0254d3cae8c28d053cb2722", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cc2c5f8ac0254d3cae8c28d053cb2722"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:46:51.177380 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-QuotasAdminNegativeTest-1717087707 Sep 16 12:46:51.177380 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: cc2c5f8ac0254d3cae8c28d053cb2722 Sep 16 12:46:51.177380 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1717087707 Sep 16 12:46:51.177380 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-QuotasAdminNegativeTest-1717087707-project Sep 16 12:46:51.177380 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:46:51.177380 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:46:51.177380 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 03348f0e3c5546b3b4f19e045740c7ab Sep 16 12:46:51.177380 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-QuotasAdminNegativeTest-1717087707-project Sep 16 12:46:51.177380 n-d-858094-4 devstack@n-api.service[128780]: Sep 16 12:46:51.177380 n-d-858094-4 devstack@n-api.service[128780]: {"quota_set": {"ram": 0}} Sep 16 12:46:51.177380 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 12:46:51.177380 n-d-858094-4 devstack@n-api.service[128780]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 16 12:46:51.177380 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'cc2c5f8ac0254d3cae8c28d053cb2722', 'body': {'quota_set': {'ram': 0}}} Sep 16 12:46:51.183243 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:46:51.183243 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:51.183243 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:51.183243 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:51.183243 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:46:51.183243 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:46:51.183243 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:46:51.183243 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:46:51.183243 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:46:51.183243 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:46:51.183243 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:46:51.183243 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:46:51.183243 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Sep 16 12:46:51.183243 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Sep 16 12:46:51.183243 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 12:46:51.183243 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:46:51.183243 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 12:46:51.183243 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:46:51.183243 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Sep 16 12:46:51.184414 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Sep 16 12:46:51.184414 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 12:46:51.184414 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 12:46:51.184414 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 12:46:51.184414 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 12:46:51.184414 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:46:51.184414 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:46:51.184414 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:46:51.184414 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:46:51.184414 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 12:46:51.184414 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 12:46:51.184414 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 12:46:51.184414 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 12:46:51.184414 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 12:46:51.184414 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 12:46:51.184414 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 16 12:46:51.184414 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:51.184414 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:51.184414 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:51.184414 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:51.185807 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:51.185807 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:51.185807 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 12:46:51.185807 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 12:46:51.185807 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 16 12:46:51.185807 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:51.185807 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a88725d4-6ea3-4915-9886-5f4f7e8b597f tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:46:51.185807 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a88725d4-6ea3-4915-9886-5f4f7e8b597f tempest-QuotasAdminNegativeTest-1717087707 tempest-QuotasAdminNegativeTest-1717087707-project] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/cc2c5f8ac0254d3cae8c28d053cb2722" status: 403 len: 116 microversion: 2.1 time: 0.028296 Sep 16 12:46:51.185807 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 222/442] 10.222.0.67 () {60 vars in 1262 bytes} [Fri Sep 16 12:46:51 2022] PUT /compute/v2.1/os-quota-sets/cc2c5f8ac0254d3cae8c28d053cb2722 => generated 116 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:46:51.198483 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-141b581d-87cf-4c88-8da4-fd69278ebf77 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:51.199231 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-141b581d-87cf-4c88-8da4-fd69278ebf77 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: 1b320dc8-1e79-4202-8162-0a418c6b1874] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:51.218088 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-141b581d-87cf-4c88-8da4-fd69278ebf77 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:51.218786 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-141b581d-87cf-4c88-8da4-fd69278ebf77 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:51.219940 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-141b581d-87cf-4c88-8da4-fd69278ebf77 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:51.227785 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-141b581d-87cf-4c88-8da4-fd69278ebf77 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:51.230443 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-141b581d-87cf-4c88-8da4-fd69278ebf77 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:51.230944 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-141b581d-87cf-4c88-8da4-fd69278ebf77 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:51.742645 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-648243ae-39cc-4284-bb13-b759efdcc894 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] validate_networks() for [('eb8add18-d929-45d2-acc9-197a8391e875', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:46:52.658148 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-141b581d-87cf-4c88-8da4-fd69278ebf77 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:52.683301 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-141b581d-87cf-4c88-8da4-fd69278ebf77 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874" status: 200 len: 1314 microversion: 2.1 time: 1.497506 Sep 16 12:46:52.685558 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 223/443] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:51 2022] GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874 => generated 1314 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:52.693844 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-de238366-3ccf-43a8-ab96-e65dc3ba9336 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Calling method '.version_select at 0x7f1035ee69d0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:53.377967 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-de238366-3ccf-43a8-ab96-e65dc3ba9336 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/f506c947b0fa4f098ced1e2f2ba945ad/defaults" status: 200 len: 371 microversion: 2.1 time: 0.688744 Sep 16 12:46:53.379937 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 224/444] 10.222.0.67 () {58 vars in 1269 bytes} [Fri Sep 16 12:46:52 2022] GET /compute/v2.1/os-quota-sets/f506c947b0fa4f098ced1e2f2ba945ad/defaults => generated 371 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:53.394035 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-cca70a6c-0087-44f0-bc5f-b7b3c7cb3851 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:53.395608 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-cca70a6c-0087-44f0-bc5f-b7b3c7cb3851 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: cbbaed5d-b861-4f03-a39b-c384175b92ea] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:53.409902 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cca70a6c-0087-44f0-bc5f-b7b3c7cb3851 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:53.412604 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cca70a6c-0087-44f0-bc5f-b7b3c7cb3851 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:53.414320 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cca70a6c-0087-44f0-bc5f-b7b3c7cb3851 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:53.416421 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cca70a6c-0087-44f0-bc5f-b7b3c7cb3851 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:53.419492 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cca70a6c-0087-44f0-bc5f-b7b3c7cb3851 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:53.420344 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cca70a6c-0087-44f0-bc5f-b7b3c7cb3851 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:54.041101 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-cca70a6c-0087-44f0-bc5f-b7b3c7cb3851 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0815c12c4340109ec1c379a0602322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20770fd1243d4412bfc90d2a079473bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:54.051231 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-cca70a6c-0087-44f0-bc5f-b7b3c7cb3851 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "GET /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea" status: 200 len: 1322 microversion: 2.1 time: 0.669711 Sep 16 12:46:54.051842 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 225/445] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:53 2022] GET /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea => generated 1322 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:54.073915 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-bebfe659-2645-47af-a4e3-fb4ad316b85d tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Action: 'update', calling method: .version_select at 0x7f1035ffaa60>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:54.204412 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-648243ae-39cc-4284-bb13-b759efdcc894 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:46:54.205301 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-648243ae-39cc-4284-bb13-b759efdcc894 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:46:54.206462 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-648243ae-39cc-4284-bb13-b759efdcc894 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:46:54.206885 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-648243ae-39cc-4284-bb13-b759efdcc894 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:46:54.207429 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-648243ae-39cc-4284-bb13-b759efdcc894 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:46:54.227403 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-648243ae-39cc-4284-bb13-b759efdcc894 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:54.227896 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-648243ae-39cc-4284-bb13-b759efdcc894 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:54.228729 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-648243ae-39cc-4284-bb13-b759efdcc894 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:54.231425 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-648243ae-39cc-4284-bb13-b759efdcc894 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:54.231956 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-648243ae-39cc-4284-bb13-b759efdcc894 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:54.233528 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-648243ae-39cc-4284-bb13-b759efdcc894 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:54.278587 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-648243ae-39cc-4284-bb13-b759efdcc894 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Getting quotas for project 7058e9e184834c39a5a299f481a6e62e. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:46:54.292908 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-648243ae-39cc-4284-bb13-b759efdcc894 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Getting quotas for user 709f71c239ca40b8b958038c9ab16f37 and project 7058e9e184834c39a5a299f481a6e62e. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:46:54.325886 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-648243ae-39cc-4284-bb13-b759efdcc894 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:46:54.335108 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-648243ae-39cc-4284-bb13-b759efdcc894 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 07365fde-3701-46a6-aba7-4c6f74e181b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:46:54.461329 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-648243ae-39cc-4284-bb13-b759efdcc894 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.419891 Sep 16 12:46:54.464571 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 221/446] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:46:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 3426 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:46:54.478206 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-17dcb896-b378-47e1-9c1a-0de3b7c531aa tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:54.483499 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-17dcb896-b378-47e1-9c1a-0de3b7c531aa tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: 1b320dc8-1e79-4202-8162-0a418c6b1874] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:54.498146 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17dcb896-b378-47e1-9c1a-0de3b7c531aa tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:54.498732 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17dcb896-b378-47e1-9c1a-0de3b7c531aa tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:54.499187 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17dcb896-b378-47e1-9c1a-0de3b7c531aa tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:54.499927 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17dcb896-b378-47e1-9c1a-0de3b7c531aa tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:54.500417 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17dcb896-b378-47e1-9c1a-0de3b7c531aa tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:54.500851 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17dcb896-b378-47e1-9c1a-0de3b7c531aa tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:54.590899 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bebfe659-2645-47af-a4e3-fb4ad316b85d tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:54.593370 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bebfe659-2645-47af-a4e3-fb4ad316b85d tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:54.593927 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bebfe659-2645-47af-a4e3-fb4ad316b85d tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:54.594663 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bebfe659-2645-47af-a4e3-fb4ad316b85d tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:54.595131 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bebfe659-2645-47af-a4e3-fb4ad316b85d tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:54.595533 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bebfe659-2645-47af-a4e3-fb4ad316b85d tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:54.859222 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-17dcb896-b378-47e1-9c1a-0de3b7c531aa tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:54.874508 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-17dcb896-b378-47e1-9c1a-0de3b7c531aa tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874" status: 200 len: 1464 microversion: 2.1 time: 0.406318 Sep 16 12:46:54.875298 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 222/447] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:54 2022] GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874 => generated 1464 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:55.046426 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-bebfe659-2645-47af-a4e3-fb4ad316b85d tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/f506c947b0fa4f098ced1e2f2ba945ad" status: 200 len: 329 microversion: 2.1 time: 0.993475 Sep 16 12:46:55.052220 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 226/448] 10.222.0.67 () {60 vars in 1263 bytes} [Fri Sep 16 12:46:54 2022] PUT /compute/v2.1/os-quota-sets/f506c947b0fa4f098ced1e2f2ba945ad => generated 329 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:55.061904 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3a6af45f-1378-4a9b-b63f-ffe14dde90e3 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:55.063704 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3a6af45f-1378-4a9b-b63f-ffe14dde90e3 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 07365fde-3701-46a6-aba7-4c6f74e181b9] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:55.235727 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3a6af45f-1378-4a9b-b63f-ffe14dde90e3 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709f71c239ca40b8b958038c9ab16f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7058e9e184834c39a5a299f481a6e62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:55.254889 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3a6af45f-1378-4a9b-b63f-ffe14dde90e3 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9" status: 200 len: 1265 microversion: 2.1 time: 0.191573 Sep 16 12:46:55.256377 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 227/449] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:55 2022] GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9 => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:55.272158 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1008e874-da37-49fc-b6f9-4dd759231566 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:55.273107 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-1008e874-da37-49fc-b6f9-4dd759231566 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:55.277075 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=16 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:46:55.283110 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1008e874-da37-49fc-b6f9-4dd759231566 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:55.285669 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1008e874-da37-49fc-b6f9-4dd759231566 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:55.288537 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1008e874-da37-49fc-b6f9-4dd759231566 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:55.289577 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1008e874-da37-49fc-b6f9-4dd759231566 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:55.290221 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1008e874-da37-49fc-b6f9-4dd759231566 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:55.291009 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1008e874-da37-49fc-b6f9-4dd759231566 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:55.356907 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cbc48faf-dc7b-47d0-9476-9b11ee63388f tempest-HypervisorAdminNegativeTestJSON-96975489 tempest-HypervisorAdminNegativeTestJSON-96975489-project] Calling method '.version_select at 0x7f10360dfca0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:55.358943 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cbc48faf-dc7b-47d0-9476-9b11ee63388f tempest-HypervisorAdminNegativeTestJSON-96975489 tempest-HypervisorAdminNegativeTestJSON-96975489-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '6a8578c764a74d128c7baf027a04893d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1927dd9f8a4b2ab86503d2771ff1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:55.361216 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cbc48faf-dc7b-47d0-9476-9b11ee63388f tempest-HypervisorAdminNegativeTestJSON-96975489 tempest-HypervisorAdminNegativeTestJSON-96975489-project] Request method failure captured: Sep 16 12:46:55.361216 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Sep 16 12:46:55.361216 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:46:55.361216 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:46:55.361216 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:46:55.361216 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:46:55.361216 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:46:55.361216 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:46:55.361216 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:46:55.361216 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:46:55.361216 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHA9PCDJJFETitbb8vi51yXf49Cd85AqWE2NwEYgL1ZNx2rxL5ihG9cW4QxgYcjTh7y417sMlI8L606c9ohk01L7PBm0VuRvsZL6rbf1cBGVgHjFDvDh2xw1tgM65iFCPy7EjhQlle8jBzAk24CM5WwMNViqgqQRoLkL-ceXZF6FZMw Sep 16 12:46:55.361216 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:46:55.361216 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:46:55.361216 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:46:55.361216 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:46:55.361216 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:46:55.361216 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:46:55.361216 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 8a1927dd9f8a4b2ab86503d2771ff1bd Sep 16 12:46:55.361216 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-96975489 Sep 16 12:46:55.361216 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:46:55.361216 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:46:55.363408 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8a1927dd9f8a4b2ab86503d2771ff1bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8a1927dd9f8a4b2ab86503d2771ff1bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8a1927dd9f8a4b2ab86503d2771ff1bd", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8a1927dd9f8a4b2ab86503d2771ff1bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:46:55.363408 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-96975489 Sep 16 12:46:55.363408 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 8a1927dd9f8a4b2ab86503d2771ff1bd Sep 16 12:46:55.363408 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-96975489 Sep 16 12:46:55.363408 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-HypervisorAdminNegativeTestJSON-96975489-project Sep 16 12:46:55.363408 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:46:55.363408 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:46:55.363408 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 6a8578c764a74d128c7baf027a04893d Sep 16 12:46:55.363408 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-96975489-project Sep 16 12:46:55.363408 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 12:46:55.363408 n-d-858094-4 devstack@n-api.service[128779]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 16 12:46:55.363408 n-d-858094-4 devstack@n-api.service[128779]: action_args: {} Sep 16 12:46:55.363408 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:46:55.364312 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:55.364312 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:55.364312 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:55.364312 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:46:55.364312 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:46:55.364312 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:46:55.364312 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:46:55.364312 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:46:55.364312 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:46:55.364312 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Sep 16 12:46:55.364312 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._detail(req) Sep 16 12:46:55.364312 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Sep 16 12:46:55.364312 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Sep 16 12:46:55.364312 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 12:46:55.364312 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 12:46:55.364312 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 12:46:55.364312 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 12:46:55.364312 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:46:55.364312 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:46:55.365486 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:46:55.365486 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:46:55.365486 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 12:46:55.365486 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 12:46:55.365486 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 12:46:55.365486 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 12:46:55.365486 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 12:46:55.365486 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 12:46:55.365486 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 16 12:46:55.365486 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:55.365486 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:55.365486 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:55.365486 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:55.365486 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:55.365486 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:55.365486 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 12:46:55.365486 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 12:46:55.365486 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 16 12:46:55.365486 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:55.366567 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cbc48faf-dc7b-47d0-9476-9b11ee63388f tempest-HypervisorAdminNegativeTestJSON-96975489 tempest-HypervisorAdminNegativeTestJSON-96975489-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:46:55.366647 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cbc48faf-dc7b-47d0-9476-9b11ee63388f tempest-HypervisorAdminNegativeTestJSON-96975489 tempest-HypervisorAdminNegativeTestJSON-96975489-project] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.487699 Sep 16 12:46:55.373686 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 223/450] 10.222.0.67 () {58 vars in 1167 bytes} [Fri Sep 16 12:46:54 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 495 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:46:55.379929 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1f281efc-5509-4b23-b500-9ecd86562538 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Action: 'update', calling method: .version_select at 0x7f10360dff70>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:55.537794 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1008e874-da37-49fc-b6f9-4dd759231566 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:55.558508 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1008e874-da37-49fc-b6f9-4dd759231566 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6" status: 200 len: 1463 microversion: 2.1 time: 0.296293 Sep 16 12:46:55.559424 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 228/451] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:55 2022] GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 => generated 1463 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:55.570658 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-59c58d04-2013-4634-a8a6-86bf7b944583 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:55.572191 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-59c58d04-2013-4634-a8a6-86bf7b944583 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: cbbaed5d-b861-4f03-a39b-c384175b92ea] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:55.583613 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-59c58d04-2013-4634-a8a6-86bf7b944583 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:55.585450 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-59c58d04-2013-4634-a8a6-86bf7b944583 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:55.590253 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-59c58d04-2013-4634-a8a6-86bf7b944583 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:55.591206 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-59c58d04-2013-4634-a8a6-86bf7b944583 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:55.592181 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-59c58d04-2013-4634-a8a6-86bf7b944583 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:55.592797 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-59c58d04-2013-4634-a8a6-86bf7b944583 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:55.892068 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1f281efc-5509-4b23-b500-9ecd86562538 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:55.892719 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1f281efc-5509-4b23-b500-9ecd86562538 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:55.894349 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1f281efc-5509-4b23-b500-9ecd86562538 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:55.895392 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1f281efc-5509-4b23-b500-9ecd86562538 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:55.897346 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1f281efc-5509-4b23-b500-9ecd86562538 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:55.904360 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1f281efc-5509-4b23-b500-9ecd86562538 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:56.016727 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-59c58d04-2013-4634-a8a6-86bf7b944583 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0815c12c4340109ec1c379a0602322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20770fd1243d4412bfc90d2a079473bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:56.029799 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-59c58d04-2013-4634-a8a6-86bf7b944583 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "GET /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea" status: 200 len: 1322 microversion: 2.1 time: 0.468732 Sep 16 12:46:56.031201 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 229/452] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:55 2022] GET /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea => generated 1322 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:56.038090 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-69f0e10a-00ba-4951-a839-f54099ab41ad tempest-HypervisorAdminNegativeTestJSON-96975489 tempest-HypervisorAdminNegativeTestJSON-96975489-project] Calling method '.version_select at 0x7f1035ee39d0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:56.040250 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-69f0e10a-00ba-4951-a839-f54099ab41ad tempest-HypervisorAdminNegativeTestJSON-96975489 tempest-HypervisorAdminNegativeTestJSON-96975489-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '6a8578c764a74d128c7baf027a04893d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1927dd9f8a4b2ab86503d2771ff1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:56.042190 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-69f0e10a-00ba-4951-a839-f54099ab41ad tempest-HypervisorAdminNegativeTestJSON-96975489 tempest-HypervisorAdminNegativeTestJSON-96975489-project] Request method failure captured: Sep 16 12:46:56.042190 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Sep 16 12:46:56.042190 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:46:56.042190 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:46:56.042190 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:46:56.042190 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:46:56.042190 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:46:56.042190 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:46:56.042190 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:46:56.042190 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:46:56.042190 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHA9PCDJJFETitbb8vi51yXf49Cd85AqWE2NwEYgL1ZNx2rxL5ihG9cW4QxgYcjTh7y417sMlI8L606c9ohk01L7PBm0VuRvsZL6rbf1cBGVgHjFDvDh2xw1tgM65iFCPy7EjhQlle8jBzAk24CM5WwMNViqgqQRoLkL-ceXZF6FZMw Sep 16 12:46:56.042190 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:46:56.042190 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:46:56.042190 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:46:56.042190 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:46:56.042190 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:46:56.042190 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:46:56.042190 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 8a1927dd9f8a4b2ab86503d2771ff1bd Sep 16 12:46:56.042190 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-96975489 Sep 16 12:46:56.042190 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:46:56.042190 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:46:56.043543 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8a1927dd9f8a4b2ab86503d2771ff1bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8a1927dd9f8a4b2ab86503d2771ff1bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8a1927dd9f8a4b2ab86503d2771ff1bd", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8a1927dd9f8a4b2ab86503d2771ff1bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:46:56.043543 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-96975489 Sep 16 12:46:56.043543 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 8a1927dd9f8a4b2ab86503d2771ff1bd Sep 16 12:46:56.043543 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-96975489 Sep 16 12:46:56.043543 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-HypervisorAdminNegativeTestJSON-96975489-project Sep 16 12:46:56.043543 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:46:56.043543 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:46:56.043543 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 6a8578c764a74d128c7baf027a04893d Sep 16 12:46:56.043543 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-96975489-project Sep 16 12:46:56.043543 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 12:46:56.043543 n-d-858094-4 devstack@n-api.service[128780]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 16 12:46:56.043543 n-d-858094-4 devstack@n-api.service[128780]: action_args: {} Sep 16 12:46:56.043543 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:46:56.044350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:56.044350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:56.044350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:56.044350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:46:56.044350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:46:56.044350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:46:56.044350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:46:56.044350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:46:56.044350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:46:56.044350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Sep 16 12:46:56.044350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 16 12:46:56.044350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Sep 16 12:46:56.044350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Sep 16 12:46:56.044350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 12:46:56.044350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 12:46:56.044350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 12:46:56.044350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 12:46:56.044350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:46:56.044350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:46:56.045430 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:46:56.045430 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:46:56.045430 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 12:46:56.045430 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 12:46:56.045430 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 12:46:56.045430 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 12:46:56.045430 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 12:46:56.045430 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 12:46:56.045430 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 16 12:46:56.045430 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:56.045430 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:56.045430 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:56.045430 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:56.045430 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:56.045430 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:56.045430 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 12:46:56.045430 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 12:46:56.045430 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 16 12:46:56.045430 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:46:56.048441 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-69f0e10a-00ba-4951-a839-f54099ab41ad tempest-HypervisorAdminNegativeTestJSON-96975489 tempest-HypervisorAdminNegativeTestJSON-96975489-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:46:56.051095 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-69f0e10a-00ba-4951-a839-f54099ab41ad tempest-HypervisorAdminNegativeTestJSON-96975489 tempest-HypervisorAdminNegativeTestJSON-96975489-project] 10.222.0.67 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.018307 Sep 16 12:46:56.052575 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 230/453] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:46:56 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:46:56.058515 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-60ef920e-f65a-46a3-959a-a1edd4f3740b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1093601998", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:56.154390 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-60ef920e-f65a-46a3-959a-a1edd4f3740b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] validate_networks() for None {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:46:56.522283 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1f281efc-5509-4b23-b500-9ecd86562538 tempest-QuotasAdminTestJSON-289109708 tempest-QuotasAdminTestJSON-289109708-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/f506c947b0fa4f098ced1e2f2ba945ad" status: 200 len: 329 microversion: 2.1 time: 1.143695 Sep 16 12:46:56.524345 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 224/454] 10.222.0.67 () {60 vars in 1263 bytes} [Fri Sep 16 12:46:55 2022] PUT /compute/v2.1/os-quota-sets/f506c947b0fa4f098ced1e2f2ba945ad => generated 329 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:56.529453 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3d25c961-6816-4110-8a50-f411983d0fc7 tempest-HypervisorAdminNegativeTestJSON-96975489 tempest-HypervisorAdminNegativeTestJSON-96975489-project] Calling method '.version_select at 0x7f10360ede50>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:56.542373 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3d25c961-6816-4110-8a50-f411983d0fc7 tempest-HypervisorAdminNegativeTestJSON-96975489 tempest-HypervisorAdminNegativeTestJSON-96975489-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '6a8578c764a74d128c7baf027a04893d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1927dd9f8a4b2ab86503d2771ff1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:56.554914 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3d25c961-6816-4110-8a50-f411983d0fc7 tempest-HypervisorAdminNegativeTestJSON-96975489 tempest-HypervisorAdminNegativeTestJSON-96975489-project] Request method failure captured: Sep 16 12:46:56.554914 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Sep 16 12:46:56.554914 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:46:56.554914 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:46:56.554914 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:46:56.554914 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:46:56.554914 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:46:56.554914 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:46:56.554914 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:46:56.554914 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:46:56.554914 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHA9PCDJJFETitbb8vi51yXf49Cd85AqWE2NwEYgL1ZNx2rxL5ihG9cW4QxgYcjTh7y417sMlI8L606c9ohk01L7PBm0VuRvsZL6rbf1cBGVgHjFDvDh2xw1tgM65iFCPy7EjhQlle8jBzAk24CM5WwMNViqgqQRoLkL-ceXZF6FZMw Sep 16 12:46:56.554914 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:46:56.554914 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:46:56.554914 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:46:56.554914 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:46:56.554914 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:46:56.554914 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:46:56.554914 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 8a1927dd9f8a4b2ab86503d2771ff1bd Sep 16 12:46:56.554914 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-96975489 Sep 16 12:46:56.554914 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:46:56.554914 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:46:56.556693 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8a1927dd9f8a4b2ab86503d2771ff1bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8a1927dd9f8a4b2ab86503d2771ff1bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8a1927dd9f8a4b2ab86503d2771ff1bd", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8a1927dd9f8a4b2ab86503d2771ff1bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:46:56.556693 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-96975489 Sep 16 12:46:56.556693 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 8a1927dd9f8a4b2ab86503d2771ff1bd Sep 16 12:46:56.556693 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-96975489 Sep 16 12:46:56.556693 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-HypervisorAdminNegativeTestJSON-96975489-project Sep 16 12:46:56.556693 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:46:56.556693 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:46:56.556693 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 6a8578c764a74d128c7baf027a04893d Sep 16 12:46:56.556693 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-96975489-project Sep 16 12:46:56.556693 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 12:46:56.556693 n-d-858094-4 devstack@n-api.service[128779]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 16 12:46:56.556693 n-d-858094-4 devstack@n-api.service[128779]: action_args: {} Sep 16 12:46:56.556693 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:46:56.557486 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:56.557486 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:56.557486 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:56.557486 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:46:56.557486 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:46:56.557486 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:46:56.557486 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:46:56.557486 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:46:56.557486 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:46:56.557486 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Sep 16 12:46:56.557486 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Sep 16 12:46:56.557486 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 12:46:56.557486 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 12:46:56.557486 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 12:46:56.557486 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 12:46:56.557486 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:46:56.557486 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:46:56.557486 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:46:56.557486 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:46:56.558657 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 12:46:56.558657 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 12:46:56.558657 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 12:46:56.558657 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 12:46:56.558657 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 12:46:56.558657 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 12:46:56.558657 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 16 12:46:56.558657 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:56.558657 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:56.558657 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:56.558657 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:56.558657 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:56.558657 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:56.558657 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 12:46:56.558657 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 12:46:56.558657 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 16 12:46:56.558657 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:56.560942 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3d25c961-6816-4110-8a50-f411983d0fc7 tempest-HypervisorAdminNegativeTestJSON-96975489 tempest-HypervisorAdminNegativeTestJSON-96975489-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:46:56.565968 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3d25c961-6816-4110-8a50-f411983d0fc7 tempest-HypervisorAdminNegativeTestJSON-96975489 tempest-HypervisorAdminNegativeTestJSON-96975489-project] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.036468 Sep 16 12:46:56.573424 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 225/455] 10.222.0.67 () {58 vars in 1179 bytes} [Fri Sep 16 12:46:56 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 48 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:46:56.586687 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8f0624b4-98b3-476d-93f5-e7d3432a7421 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:56.587338 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8f0624b4-98b3-476d-93f5-e7d3432a7421 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 07365fde-3701-46a6-aba7-4c6f74e181b9] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:56.597280 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=17,nova_api:UPDATE=14 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:46:56.607853 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f0624b4-98b3-476d-93f5-e7d3432a7421 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:56.608357 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f0624b4-98b3-476d-93f5-e7d3432a7421 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:56.608802 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f0624b4-98b3-476d-93f5-e7d3432a7421 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:56.609510 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f0624b4-98b3-476d-93f5-e7d3432a7421 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:56.609962 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f0624b4-98b3-476d-93f5-e7d3432a7421 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:56.610385 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f0624b4-98b3-476d-93f5-e7d3432a7421 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:56.631369 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-60ef920e-f65a-46a3-959a-a1edd4f3740b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:46:56.632097 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-60ef920e-f65a-46a3-959a-a1edd4f3740b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:46:56.632816 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-60ef920e-f65a-46a3-959a-a1edd4f3740b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:46:56.633377 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-60ef920e-f65a-46a3-959a-a1edd4f3740b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:46:56.633941 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-60ef920e-f65a-46a3-959a-a1edd4f3740b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:46:56.645744 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-60ef920e-f65a-46a3-959a-a1edd4f3740b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:56.656904 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-60ef920e-f65a-46a3-959a-a1edd4f3740b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:56.657643 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-60ef920e-f65a-46a3-959a-a1edd4f3740b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:56.659475 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-60ef920e-f65a-46a3-959a-a1edd4f3740b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:56.660632 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-60ef920e-f65a-46a3-959a-a1edd4f3740b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:56.661363 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-60ef920e-f65a-46a3-959a-a1edd4f3740b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:56.679857 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=17 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:46:56.704739 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-60ef920e-f65a-46a3-959a-a1edd4f3740b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Getting quotas for project 0709d7ec436047a39dfb8c5d92f17fa3. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:46:56.719999 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-60ef920e-f65a-46a3-959a-a1edd4f3740b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Getting quotas for user 8bdc5bd0969148a3ac8879ccf0f58553 and project 0709d7ec436047a39dfb8c5d92f17fa3. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:46:56.774496 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-60ef920e-f65a-46a3-959a-a1edd4f3740b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:46:56.780490 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-60ef920e-f65a-46a3-959a-a1edd4f3740b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: e01ba46f-ddd1-47ae-90d9-4a187bf51b2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:46:56.794495 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8f0624b4-98b3-476d-93f5-e7d3432a7421 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709f71c239ca40b8b958038c9ab16f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7058e9e184834c39a5a299f481a6e62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:56.807745 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8f0624b4-98b3-476d-93f5-e7d3432a7421 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9" status: 200 len: 1317 microversion: 2.1 time: 0.230172 Sep 16 12:46:56.808956 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 226/456] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:56 2022] GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9 => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:56.884442 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-60ef920e-f65a-46a3-959a-a1edd4f3740b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.829430 Sep 16 12:46:56.886090 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 231/457] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:46:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:46:56.904010 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-bd0645e1-95a9-41bb-ac72-7f89466cb95f req-6baae6a5-8105-437b-ae6c-c4300e9172a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbbaed5d-b861-4f03-a39b-c384175b92ea", "name": "network-vif-plugged", "status": "completed", "tag": "91c7636f-22ac-48c6-a666-8fef6f5cae01"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:46:56.921519 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-bd0645e1-95a9-41bb-ac72-7f89466cb95f req-6baae6a5-8105-437b-ae6c-c4300e9172a7 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:56.922582 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-bd0645e1-95a9-41bb-ac72-7f89466cb95f req-6baae6a5-8105-437b-ae6c-c4300e9172a7 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:56.923404 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-bd0645e1-95a9-41bb-ac72-7f89466cb95f req-6baae6a5-8105-437b-ae6c-c4300e9172a7 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:56.940861 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-bd0645e1-95a9-41bb-ac72-7f89466cb95f req-6baae6a5-8105-437b-ae6c-c4300e9172a7 service nova] Creating event network-vif-plugged:91c7636f-22ac-48c6-a666-8fef6f5cae01 for instance cbbaed5d-b861-4f03-a39b-c384175b92ea on n-h2-858094-4 Sep 16 12:46:56.947529 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-bd0645e1-95a9-41bb-ac72-7f89466cb95f req-6baae6a5-8105-437b-ae6c-c4300e9172a7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054083 Sep 16 12:46:56.950258 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 232/458] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:56.957067 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-09b7f01f-f9bd-4aa5-a995-2395cdec1ede tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:56.960895 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-09b7f01f-f9bd-4aa5-a995-2395cdec1ede tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: e01ba46f-ddd1-47ae-90d9-4a187bf51b2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:57.103140 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-09b7f01f-f9bd-4aa5-a995-2395cdec1ede tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:57.112007 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-09b7f01f-f9bd-4aa5-a995-2395cdec1ede tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/e01ba46f-ddd1-47ae-90d9-4a187bf51b2b" status: 200 len: 1214 microversion: 2.1 time: 0.160048 Sep 16 12:46:57.127162 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 233/459] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:56 2022] GET /compute/v2.1/servers/e01ba46f-ddd1-47ae-90d9-4a187bf51b2b => generated 1214 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:57.130352 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-37eb461b-75a8-4081-b3cf-211b16415049 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:57.131039 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-37eb461b-75a8-4081-b3cf-211b16415049 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: cbbaed5d-b861-4f03-a39b-c384175b92ea] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:57.155726 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-37eb461b-75a8-4081-b3cf-211b16415049 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:57.161522 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-37eb461b-75a8-4081-b3cf-211b16415049 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:57.161980 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-37eb461b-75a8-4081-b3cf-211b16415049 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:57.168316 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-37eb461b-75a8-4081-b3cf-211b16415049 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:57.168984 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-37eb461b-75a8-4081-b3cf-211b16415049 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:57.169433 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-37eb461b-75a8-4081-b3cf-211b16415049 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:57.245673 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=100 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:46:57.721896 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-37eb461b-75a8-4081-b3cf-211b16415049 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0815c12c4340109ec1c379a0602322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20770fd1243d4412bfc90d2a079473bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:57.733819 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-37eb461b-75a8-4081-b3cf-211b16415049 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "GET /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea" status: 200 len: 1322 microversion: 2.1 time: 0.615232 Sep 16 12:46:57.738936 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 234/460] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:57 2022] GET /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea => generated 1322 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:57.781260 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5f0bd711-c05c-4464-8c53-c87ae1a17370 tempest-HypervisorAdminNegativeTestJSON-355441887 tempest-HypervisorAdminNegativeTestJSON-355441887-project-admin] Calling method '.version_select at 0x7f1036147b80>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:57.784141 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f0bd711-c05c-4464-8c53-c87ae1a17370 tempest-HypervisorAdminNegativeTestJSON-355441887 tempest-HypervisorAdminNegativeTestJSON-355441887-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:57.784754 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f0bd711-c05c-4464-8c53-c87ae1a17370 tempest-HypervisorAdminNegativeTestJSON-355441887 tempest-HypervisorAdminNegativeTestJSON-355441887-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:57.785272 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f0bd711-c05c-4464-8c53-c87ae1a17370 tempest-HypervisorAdminNegativeTestJSON-355441887 tempest-HypervisorAdminNegativeTestJSON-355441887-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:57.818436 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f0bd711-c05c-4464-8c53-c87ae1a17370 tempest-HypervisorAdminNegativeTestJSON-355441887 tempest-HypervisorAdminNegativeTestJSON-355441887-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:57.820104 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f0bd711-c05c-4464-8c53-c87ae1a17370 tempest-HypervisorAdminNegativeTestJSON-355441887 tempest-HypervisorAdminNegativeTestJSON-355441887-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:57.821059 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f0bd711-c05c-4464-8c53-c87ae1a17370 tempest-HypervisorAdminNegativeTestJSON-355441887 tempest-HypervisorAdminNegativeTestJSON-355441887-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:57.833730 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7f98c4c5-228c-44e3-b8a7-41cfc07b4938 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:57.834495 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7f98c4c5-228c-44e3-b8a7-41cfc07b4938 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 07365fde-3701-46a6-aba7-4c6f74e181b9] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:57.848704 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f0bd711-c05c-4464-8c53-c87ae1a17370 tempest-HypervisorAdminNegativeTestJSON-355441887 tempest-HypervisorAdminNegativeTestJSON-355441887-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:57.849910 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7f98c4c5-228c-44e3-b8a7-41cfc07b4938 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:57.852343 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f0bd711-c05c-4464-8c53-c87ae1a17370 tempest-HypervisorAdminNegativeTestJSON-355441887 tempest-HypervisorAdminNegativeTestJSON-355441887-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:57.852836 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7f98c4c5-228c-44e3-b8a7-41cfc07b4938 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:57.853290 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f0bd711-c05c-4464-8c53-c87ae1a17370 tempest-HypervisorAdminNegativeTestJSON-355441887 tempest-HypervisorAdminNegativeTestJSON-355441887-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:57.854827 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7f98c4c5-228c-44e3-b8a7-41cfc07b4938 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:57.858978 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7f98c4c5-228c-44e3-b8a7-41cfc07b4938 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:57.859663 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7f98c4c5-228c-44e3-b8a7-41cfc07b4938 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:57.863150 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7f98c4c5-228c-44e3-b8a7-41cfc07b4938 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:57.875119 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5f0bd711-c05c-4464-8c53-c87ae1a17370 tempest-HypervisorAdminNegativeTestJSON-355441887 tempest-HypervisorAdminNegativeTestJSON-355441887-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.063133 Sep 16 12:46:57.877230 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 227/461] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:46:56 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:57.909952 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-51e1afa8-1514-429f-b9ac-cf2784939046 tempest-HypervisorAdminNegativeTestJSON-96975489 tempest-HypervisorAdminNegativeTestJSON-96975489-project] Calling method '.version_select at 0x7f10360eddc0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:57.917734 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-51e1afa8-1514-429f-b9ac-cf2784939046 tempest-HypervisorAdminNegativeTestJSON-96975489 tempest-HypervisorAdminNegativeTestJSON-96975489-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '6a8578c764a74d128c7baf027a04893d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1927dd9f8a4b2ab86503d2771ff1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:57.926174 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-51e1afa8-1514-429f-b9ac-cf2784939046 tempest-HypervisorAdminNegativeTestJSON-96975489 tempest-HypervisorAdminNegativeTestJSON-96975489-project] Request method failure captured: Sep 16 12:46:57.926174 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Sep 16 12:46:57.926174 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:46:57.926174 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:46:57.926174 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:46:57.926174 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:46:57.926174 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:46:57.926174 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:46:57.926174 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:46:57.926174 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:46:57.926174 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHA9PCDJJFETitbb8vi51yXf49Cd85AqWE2NwEYgL1ZNx2rxL5ihG9cW4QxgYcjTh7y417sMlI8L606c9ohk01L7PBm0VuRvsZL6rbf1cBGVgHjFDvDh2xw1tgM65iFCPy7EjhQlle8jBzAk24CM5WwMNViqgqQRoLkL-ceXZF6FZMw Sep 16 12:46:57.926174 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:46:57.926174 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:46:57.926174 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:46:57.926174 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:46:57.926174 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:46:57.926174 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:46:57.926174 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 8a1927dd9f8a4b2ab86503d2771ff1bd Sep 16 12:46:57.926174 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-96975489 Sep 16 12:46:57.926174 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:46:57.926174 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:46:57.927641 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8a1927dd9f8a4b2ab86503d2771ff1bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8a1927dd9f8a4b2ab86503d2771ff1bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8a1927dd9f8a4b2ab86503d2771ff1bd", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8a1927dd9f8a4b2ab86503d2771ff1bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:46:57.927641 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-96975489 Sep 16 12:46:57.927641 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 8a1927dd9f8a4b2ab86503d2771ff1bd Sep 16 12:46:57.927641 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-96975489 Sep 16 12:46:57.927641 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-HypervisorAdminNegativeTestJSON-96975489-project Sep 16 12:46:57.927641 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:46:57.927641 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:46:57.927641 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 6a8578c764a74d128c7baf027a04893d Sep 16 12:46:57.927641 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-96975489-project Sep 16 12:46:57.927641 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 12:46:57.927641 n-d-858094-4 devstack@n-api.service[128779]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 16 12:46:57.927641 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '1'} Sep 16 12:46:57.927641 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:46:57.928579 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:57.928579 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:57.928579 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:57.928579 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:46:57.928579 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:46:57.928579 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:46:57.928579 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:46:57.928579 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:46:57.928579 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:46:57.928579 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Sep 16 12:46:57.928579 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Sep 16 12:46:57.928579 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 12:46:57.928579 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 12:46:57.928579 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 12:46:57.928579 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 12:46:57.928579 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:46:57.928579 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:46:57.928579 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:46:57.928579 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:46:57.930002 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 12:46:57.930002 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 12:46:57.930002 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 12:46:57.930002 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 12:46:57.930002 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 12:46:57.930002 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 12:46:57.930002 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 16 12:46:57.930002 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:57.930002 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:57.930002 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:57.930002 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:57.930002 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:57.930002 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:57.930002 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 12:46:57.930002 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 12:46:57.930002 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 16 12:46:57.930002 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:57.931634 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-51e1afa8-1514-429f-b9ac-cf2784939046 tempest-HypervisorAdminNegativeTestJSON-96975489 tempest-HypervisorAdminNegativeTestJSON-96975489-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:46:57.931634 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-51e1afa8-1514-429f-b9ac-cf2784939046 tempest-HypervisorAdminNegativeTestJSON-96975489 tempest-HypervisorAdminNegativeTestJSON-96975489-project] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.042531 Sep 16 12:46:57.932271 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 228/462] 10.222.0.67 () {58 vars in 1173 bytes} [Fri Sep 16 12:46:57 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:46:57.961745 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2426642a-23de-4146-b686-741364c6b8e6 tempest-HypervisorAdminNegativeTestJSON-355441887 tempest-HypervisorAdminNegativeTestJSON-355441887-project-admin] Calling method '.version_select at 0x7f1036075160>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:57.974060 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-2426642a-23de-4146-b686-741364c6b8e6 tempest-HypervisorAdminNegativeTestJSON-355441887 tempest-HypervisorAdminNegativeTestJSON-355441887-project-admin] HTTP exception thrown: Hypervisor with ID '1689b1f1-2809-4333-a9aa-be199f66aea8' could not be found. Sep 16 12:46:57.990121 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2426642a-23de-4146-b686-741364c6b8e6 tempest-HypervisorAdminNegativeTestJSON-355441887 tempest-HypervisorAdminNegativeTestJSON-355441887-project-admin] Request method failure captured: Sep 16 12:46:57.990121 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/os-hypervisors/1689b1f1-2809-4333-a9aa-be199f66aea8/uptime HTTP/1.1 Sep 16 12:46:57.990121 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:46:57.990121 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:46:57.990121 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:46:57.990121 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:46:57.990121 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:46:57.990121 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:46:57.990121 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:46:57.990121 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:46:57.990121 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHA-9NxgvDCO2JzOBqQmkOcgcQwvRtFqAQTB1p1ljMmY82_pI9hhlDofY11rbQ3YhqxMps0uObl6afgb1CjIiou5Xw7gZh5dDzTDVFLLtka_XURJGKKxyiu__vlu_1MJAYkqFHkwg-9cibqtwTntOk5q-I583wy7cA3DtvAHcgSaUms Sep 16 12:46:57.990121 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:46:57.990121 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:46:57.990121 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:46:57.990121 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:46:57.990121 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:46:57.990121 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:46:57.990121 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: b0ebff53da4d4c86aca4377ad6ee9aac Sep 16 12:46:57.990121 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-355441887 Sep 16 12:46:57.990121 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,admin,reader Sep 16 12:46:57.990121 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,admin,reader Sep 16 12:46:57.991752 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b0ebff53da4d4c86aca4377ad6ee9aac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b0ebff53da4d4c86aca4377ad6ee9aac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b0ebff53da4d4c86aca4377ad6ee9aac", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b0ebff53da4d4c86aca4377ad6ee9aac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:46:57.991752 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-355441887 Sep 16 12:46:57.991752 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: b0ebff53da4d4c86aca4377ad6ee9aac Sep 16 12:46:57.991752 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-355441887 Sep 16 12:46:57.991752 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-HypervisorAdminNegativeTestJSON-355441887-project-admin Sep 16 12:46:57.991752 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:46:57.991752 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:46:57.991752 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: d88a675d2e284a199d1b1e128813656e Sep 16 12:46:57.991752 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-355441887-project-admin Sep 16 12:46:57.991752 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 12:46:57.991752 n-d-858094-4 devstack@n-api.service[128779]: exception: Hypervisor with ID '1689b1f1-2809-4333-a9aa-be199f66aea8' could not be found. Sep 16 12:46:57.991752 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '1689b1f1-2809-4333-a9aa-be199f66aea8'} Sep 16 12:46:57.992703 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:46:57.992703 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:57.992703 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 16 12:46:57.992703 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 16 12:46:57.992703 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '1689b1f1-2809-4333-a9aa-be199f66aea8' Sep 16 12:46:57.992703 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:57.992703 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:57.992703 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:57.992703 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:57.992703 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 16 12:46:57.992703 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 16 12:46:57.992703 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 16 12:46:57.992703 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 16 12:46:57.992703 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 16 12:46:57.992703 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:57.992703 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:57.992703 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:57.992703 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:57.992703 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 16 12:46:57.992703 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 16 12:46:57.992703 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 16 12:46:57.992703 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 16 12:46:58.000518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 16 12:46:58.000518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:58.000518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:58.000518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:58.000518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:58.000518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:58.000518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:58.000518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:46:58.000518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:46:58.000518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:46:58.000518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:46:58.000518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:46:58.000518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:46:58.000518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Sep 16 12:46:58.000518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 16 12:46:58.000518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 16 12:46:58.000518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 16 12:46:58.000518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '1689b1f1-2809-4333-a9aa-be199f66aea8' could not be found. Sep 16 12:46:58.000518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:58.000518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:58.000518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:58.002059 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:58.002059 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:58.002059 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:58.002059 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:46:58.002059 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:46:58.002059 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '1689b1f1-2809-4333-a9aa-be199f66aea8' could not be found. Sep 16 12:46:58.002059 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:58.002059 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2426642a-23de-4146-b686-741364c6b8e6 tempest-HypervisorAdminNegativeTestJSON-355441887 tempest-HypervisorAdminNegativeTestJSON-355441887-project-admin] Returning 404 to user: Hypervisor with ID '1689b1f1-2809-4333-a9aa-be199f66aea8' could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:46:58.002059 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2426642a-23de-4146-b686-741364c6b8e6 tempest-HypervisorAdminNegativeTestJSON-355441887 tempest-HypervisorAdminNegativeTestJSON-355441887-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/1689b1f1-2809-4333-a9aa-be199f66aea8/uptime" status: 404 len: 123 microversion: 2.1 time: 0.039380 Sep 16 12:46:58.002059 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 229/463] 10.222.0.67 () {58 vars in 1278 bytes} [Fri Sep 16 12:46:57 2022] GET /compute/v2.1/os-hypervisors/1689b1f1-2809-4333-a9aa-be199f66aea8/uptime => generated 123 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:46:58.012948 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-250396b7-9c4e-4404-b00f-f0830430a26b tempest-HypervisorAdminNegativeTestJSON-355441887 tempest-HypervisorAdminNegativeTestJSON-355441887-project-admin] Calling method '.version_select at 0x7f1036075dc0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:58.026293 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-250396b7-9c4e-4404-b00f-f0830430a26b tempest-HypervisorAdminNegativeTestJSON-355441887 tempest-HypervisorAdminNegativeTestJSON-355441887-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:58.026567 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-250396b7-9c4e-4404-b00f-f0830430a26b tempest-HypervisorAdminNegativeTestJSON-355441887 tempest-HypervisorAdminNegativeTestJSON-355441887-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:58.026929 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-250396b7-9c4e-4404-b00f-f0830430a26b tempest-HypervisorAdminNegativeTestJSON-355441887 tempest-HypervisorAdminNegativeTestJSON-355441887-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:58.068330 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-250396b7-9c4e-4404-b00f-f0830430a26b tempest-HypervisorAdminNegativeTestJSON-355441887 tempest-HypervisorAdminNegativeTestJSON-355441887-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:58.071010 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-250396b7-9c4e-4404-b00f-f0830430a26b tempest-HypervisorAdminNegativeTestJSON-355441887 tempest-HypervisorAdminNegativeTestJSON-355441887-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:58.072547 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-250396b7-9c4e-4404-b00f-f0830430a26b tempest-HypervisorAdminNegativeTestJSON-355441887 tempest-HypervisorAdminNegativeTestJSON-355441887-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:58.105015 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7f98c4c5-228c-44e3-b8a7-41cfc07b4938 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709f71c239ca40b8b958038c9ab16f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7058e9e184834c39a5a299f481a6e62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:58.105640 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-250396b7-9c4e-4404-b00f-f0830430a26b tempest-HypervisorAdminNegativeTestJSON-355441887 tempest-HypervisorAdminNegativeTestJSON-355441887-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:58.106123 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-250396b7-9c4e-4404-b00f-f0830430a26b tempest-HypervisorAdminNegativeTestJSON-355441887 tempest-HypervisorAdminNegativeTestJSON-355441887-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:58.106572 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-250396b7-9c4e-4404-b00f-f0830430a26b tempest-HypervisorAdminNegativeTestJSON-355441887 tempest-HypervisorAdminNegativeTestJSON-355441887-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:58.117966 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7f98c4c5-228c-44e3-b8a7-41cfc07b4938 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9" status: 200 len: 1323 microversion: 2.1 time: 0.288604 Sep 16 12:46:58.119092 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 235/464] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:57 2022] GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9 => generated 1323 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:46:58.138416 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-250396b7-9c4e-4404-b00f-f0830430a26b tempest-HypervisorAdminNegativeTestJSON-355441887 tempest-HypervisorAdminNegativeTestJSON-355441887-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.137301 Sep 16 12:46:58.139701 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 230/465] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:46:57 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:46:58.151630 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c8608c9b-715b-46da-beb3-e85ecfa5a311 tempest-HypervisorAdminNegativeTestJSON-96975489 tempest-HypervisorAdminNegativeTestJSON-96975489-project] Calling method '.version_select at 0x7f10360753a0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:58.152438 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-bf23e003-ce48-4b43-a82f-687b944b130d tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:58.153492 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-bf23e003-ce48-4b43-a82f-687b944b130d tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: e01ba46f-ddd1-47ae-90d9-4a187bf51b2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:58.153717 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c8608c9b-715b-46da-beb3-e85ecfa5a311 tempest-HypervisorAdminNegativeTestJSON-96975489 tempest-HypervisorAdminNegativeTestJSON-96975489-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '6a8578c764a74d128c7baf027a04893d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1927dd9f8a4b2ab86503d2771ff1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:58.155495 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c8608c9b-715b-46da-beb3-e85ecfa5a311 tempest-HypervisorAdminNegativeTestJSON-96975489 tempest-HypervisorAdminNegativeTestJSON-96975489-project] Request method failure captured: Sep 16 12:46:58.155495 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Sep 16 12:46:58.155495 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:46:58.155495 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:46:58.155495 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:46:58.155495 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:46:58.155495 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:46:58.155495 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:46:58.155495 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:46:58.155495 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:46:58.155495 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHA9PCDJJFETitbb8vi51yXf49Cd85AqWE2NwEYgL1ZNx2rxL5ihG9cW4QxgYcjTh7y417sMlI8L606c9ohk01L7PBm0VuRvsZL6rbf1cBGVgHjFDvDh2xw1tgM65iFCPy7EjhQlle8jBzAk24CM5WwMNViqgqQRoLkL-ceXZF6FZMw Sep 16 12:46:58.155495 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:46:58.155495 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:46:58.155495 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:46:58.155495 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:46:58.155495 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:46:58.155495 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:46:58.155495 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 8a1927dd9f8a4b2ab86503d2771ff1bd Sep 16 12:46:58.155495 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-96975489 Sep 16 12:46:58.155495 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:46:58.155495 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:46:58.157058 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8a1927dd9f8a4b2ab86503d2771ff1bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8a1927dd9f8a4b2ab86503d2771ff1bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8a1927dd9f8a4b2ab86503d2771ff1bd", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8a1927dd9f8a4b2ab86503d2771ff1bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:46:58.157058 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-96975489 Sep 16 12:46:58.157058 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 8a1927dd9f8a4b2ab86503d2771ff1bd Sep 16 12:46:58.157058 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-96975489 Sep 16 12:46:58.157058 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-HypervisorAdminNegativeTestJSON-96975489-project Sep 16 12:46:58.157058 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:46:58.157058 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:46:58.157058 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 6a8578c764a74d128c7baf027a04893d Sep 16 12:46:58.157058 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-96975489-project Sep 16 12:46:58.157058 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 12:46:58.157058 n-d-858094-4 devstack@n-api.service[128779]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 16 12:46:58.157058 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '1'} Sep 16 12:46:58.157058 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:46:58.157911 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:58.157911 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:58.157911 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:58.157911 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:46:58.157911 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:46:58.157911 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:46:58.157911 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:46:58.157911 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:46:58.157911 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:46:58.157911 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 16 12:46:58.157911 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 16 12:46:58.157911 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Sep 16 12:46:58.157911 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Sep 16 12:46:58.157911 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 12:46:58.157911 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 12:46:58.157911 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 12:46:58.157911 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 12:46:58.157911 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:46:58.157911 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:46:58.159767 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:46:58.159767 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:46:58.159767 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 12:46:58.159767 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 12:46:58.159767 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 12:46:58.159767 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 12:46:58.159767 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 12:46:58.159767 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 12:46:58.159767 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 16 12:46:58.159767 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:58.159767 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:58.159767 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:58.159767 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:58.159767 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:58.159767 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:58.159767 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 12:46:58.159767 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 12:46:58.159767 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 16 12:46:58.159767 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:58.161089 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c8608c9b-715b-46da-beb3-e85ecfa5a311 tempest-HypervisorAdminNegativeTestJSON-96975489 tempest-HypervisorAdminNegativeTestJSON-96975489-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:46:58.161089 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c8608c9b-715b-46da-beb3-e85ecfa5a311 tempest-HypervisorAdminNegativeTestJSON-96975489 tempest-HypervisorAdminNegativeTestJSON-96975489-project] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.010081 Sep 16 12:46:58.164799 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 231/466] 10.222.0.67 () {58 vars in 1152 bytes} [Fri Sep 16 12:46:58 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:46:58.167244 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bf23e003-ce48-4b43-a82f-687b944b130d tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:58.168114 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bf23e003-ce48-4b43-a82f-687b944b130d tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:58.169783 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bf23e003-ce48-4b43-a82f-687b944b130d tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:58.170365 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0647ebca-8ac6-4bff-af1a-e113c0c5a225 tempest-HypervisorAdminNegativeTestJSON-355441887 tempest-HypervisorAdminNegativeTestJSON-355441887-project-admin] Calling method '.version_select at 0x7f10360edee0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:58.171664 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bf23e003-ce48-4b43-a82f-687b944b130d tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:58.171977 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-0647ebca-8ac6-4bff-af1a-e113c0c5a225 tempest-HypervisorAdminNegativeTestJSON-355441887 tempest-HypervisorAdminNegativeTestJSON-355441887-project-admin] HTTP exception thrown: Hypervisor with ID '06b6a739-57d7-4954-8f90-f8bf32e53b5f' could not be found. Sep 16 12:46:58.173104 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bf23e003-ce48-4b43-a82f-687b944b130d tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:58.173805 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0647ebca-8ac6-4bff-af1a-e113c0c5a225 tempest-HypervisorAdminNegativeTestJSON-355441887 tempest-HypervisorAdminNegativeTestJSON-355441887-project-admin] Request method failure captured: Sep 16 12:46:58.173805 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/os-hypervisors/06b6a739-57d7-4954-8f90-f8bf32e53b5f HTTP/1.1 Sep 16 12:46:58.173805 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:46:58.173805 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:46:58.173805 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:46:58.173805 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:46:58.173805 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:46:58.173805 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:46:58.173805 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:46:58.173805 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:46:58.173805 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHA-9NxgvDCO2JzOBqQmkOcgcQwvRtFqAQTB1p1ljMmY82_pI9hhlDofY11rbQ3YhqxMps0uObl6afgb1CjIiou5Xw7gZh5dDzTDVFLLtka_XURJGKKxyiu__vlu_1MJAYkqFHkwg-9cibqtwTntOk5q-I583wy7cA3DtvAHcgSaUms Sep 16 12:46:58.173805 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:46:58.173805 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:46:58.173805 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:46:58.173805 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:46:58.173805 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:46:58.173805 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:46:58.173805 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: b0ebff53da4d4c86aca4377ad6ee9aac Sep 16 12:46:58.173805 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-355441887 Sep 16 12:46:58.173805 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,admin,reader Sep 16 12:46:58.173805 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,admin,reader Sep 16 12:46:58.175832 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b0ebff53da4d4c86aca4377ad6ee9aac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b0ebff53da4d4c86aca4377ad6ee9aac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b0ebff53da4d4c86aca4377ad6ee9aac", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b0ebff53da4d4c86aca4377ad6ee9aac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:46:58.175832 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-355441887 Sep 16 12:46:58.175832 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: b0ebff53da4d4c86aca4377ad6ee9aac Sep 16 12:46:58.175832 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-355441887 Sep 16 12:46:58.175832 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-HypervisorAdminNegativeTestJSON-355441887-project-admin Sep 16 12:46:58.175832 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:46:58.175832 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:46:58.175832 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: d88a675d2e284a199d1b1e128813656e Sep 16 12:46:58.175832 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-355441887-project-admin Sep 16 12:46:58.175832 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 12:46:58.175832 n-d-858094-4 devstack@n-api.service[128779]: exception: Hypervisor with ID '06b6a739-57d7-4954-8f90-f8bf32e53b5f' could not be found. Sep 16 12:46:58.175832 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '06b6a739-57d7-4954-8f90-f8bf32e53b5f'} Sep 16 12:46:58.176718 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:46:58.176718 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:58.176718 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 16 12:46:58.176718 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 16 12:46:58.176718 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '06b6a739-57d7-4954-8f90-f8bf32e53b5f' Sep 16 12:46:58.176718 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:58.176718 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:58.176718 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:58.176718 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:58.176718 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 16 12:46:58.176718 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 16 12:46:58.176718 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 16 12:46:58.176718 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 16 12:46:58.176718 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 16 12:46:58.176718 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:58.176718 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:58.176718 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:58.176718 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:58.176718 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 16 12:46:58.176718 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 16 12:46:58.176718 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 16 12:46:58.176718 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 16 12:46:58.178076 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 16 12:46:58.178076 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:58.178076 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:58.178076 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:58.178076 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:58.178076 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:58.178076 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:58.178076 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:46:58.178076 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:46:58.178076 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:46:58.178076 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:46:58.178076 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:46:58.178076 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:46:58.178076 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 16 12:46:58.178076 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 16 12:46:58.178076 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Sep 16 12:46:58.178076 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 16 12:46:58.178076 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 16 12:46:58.178076 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 16 12:46:58.178076 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '06b6a739-57d7-4954-8f90-f8bf32e53b5f' could not be found. Sep 16 12:46:58.179407 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:58.179407 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:46:58.179407 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:58.179407 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:46:58.179407 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:46:58.179407 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:46:58.179407 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:46:58.179407 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:46:58.179407 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '06b6a739-57d7-4954-8f90-f8bf32e53b5f' could not be found. Sep 16 12:46:58.179407 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:46:58.179407 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0647ebca-8ac6-4bff-af1a-e113c0c5a225 tempest-HypervisorAdminNegativeTestJSON-355441887 tempest-HypervisorAdminNegativeTestJSON-355441887-project-admin] Returning 404 to user: Hypervisor with ID '06b6a739-57d7-4954-8f90-f8bf32e53b5f' could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:46:58.179407 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0647ebca-8ac6-4bff-af1a-e113c0c5a225 tempest-HypervisorAdminNegativeTestJSON-355441887 tempest-HypervisorAdminNegativeTestJSON-355441887-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/06b6a739-57d7-4954-8f90-f8bf32e53b5f" status: 404 len: 123 microversion: 2.1 time: 0.010103 Sep 16 12:46:58.179407 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 232/467] 10.222.0.67 () {58 vars in 1257 bytes} [Fri Sep 16 12:46:58 2022] GET /compute/v2.1/os-hypervisors/06b6a739-57d7-4954-8f90-f8bf32e53b5f => generated 123 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:46:58.182447 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bf23e003-ce48-4b43-a82f-687b944b130d tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:58.263471 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-bf23e003-ce48-4b43-a82f-687b944b130d tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:58.285896 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-bf23e003-ce48-4b43-a82f-687b944b130d tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/e01ba46f-ddd1-47ae-90d9-4a187bf51b2b" status: 200 len: 1218 microversion: 2.1 time: 0.154036 Sep 16 12:46:58.287534 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 236/468] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:58 2022] GET /compute/v2.1/servers/e01ba46f-ddd1-47ae-90d9-4a187bf51b2b => generated 1218 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:58.767449 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9313a4be-f82a-4e1a-96a2-dbac46ed2c5f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:58.768509 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9313a4be-f82a-4e1a-96a2-dbac46ed2c5f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: cbbaed5d-b861-4f03-a39b-c384175b92ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:58.790787 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9313a4be-f82a-4e1a-96a2-dbac46ed2c5f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:58.792158 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9313a4be-f82a-4e1a-96a2-dbac46ed2c5f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:58.795071 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9313a4be-f82a-4e1a-96a2-dbac46ed2c5f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:58.796006 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9313a4be-f82a-4e1a-96a2-dbac46ed2c5f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:58.796962 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9313a4be-f82a-4e1a-96a2-dbac46ed2c5f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:58.797577 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9313a4be-f82a-4e1a-96a2-dbac46ed2c5f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:59.125401 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9313a4be-f82a-4e1a-96a2-dbac46ed2c5f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0815c12c4340109ec1c379a0602322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20770fd1243d4412bfc90d2a079473bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:59.135029 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9313a4be-f82a-4e1a-96a2-dbac46ed2c5f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "GET /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea" status: 200 len: 1322 microversion: 2.1 time: 0.374803 Sep 16 12:46:59.144947 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6ca10311-8d2c-4ce4-81f4-1744bcc2d476 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:59.147039 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6ca10311-8d2c-4ce4-81f4-1744bcc2d476 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 07365fde-3701-46a6-aba7-4c6f74e181b9] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:59.149636 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 233/469] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:58 2022] GET /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea => generated 1322 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:59.162785 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6ca10311-8d2c-4ce4-81f4-1744bcc2d476 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:59.163703 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6ca10311-8d2c-4ce4-81f4-1744bcc2d476 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:59.164354 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6ca10311-8d2c-4ce4-81f4-1744bcc2d476 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:59.165585 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6ca10311-8d2c-4ce4-81f4-1744bcc2d476 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:59.166720 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6ca10311-8d2c-4ce4-81f4-1744bcc2d476 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:59.167257 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6ca10311-8d2c-4ce4-81f4-1744bcc2d476 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:59.299070 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6ca10311-8d2c-4ce4-81f4-1744bcc2d476 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709f71c239ca40b8b958038c9ab16f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7058e9e184834c39a5a299f481a6e62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:59.317261 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-937669e5-a8df-4a55-9ae7-909e35dcee1f tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:46:59.319823 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-937669e5-a8df-4a55-9ae7-909e35dcee1f tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: e01ba46f-ddd1-47ae-90d9-4a187bf51b2b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:46:59.328966 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6ca10311-8d2c-4ce4-81f4-1744bcc2d476 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9" status: 200 len: 1323 microversion: 2.1 time: 0.190477 Sep 16 12:46:59.333513 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-937669e5-a8df-4a55-9ae7-909e35dcee1f tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:59.334474 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-937669e5-a8df-4a55-9ae7-909e35dcee1f tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:59.337148 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-937669e5-a8df-4a55-9ae7-909e35dcee1f tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:59.338591 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-937669e5-a8df-4a55-9ae7-909e35dcee1f tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:46:59.339726 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-937669e5-a8df-4a55-9ae7-909e35dcee1f tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:46:59.340611 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-937669e5-a8df-4a55-9ae7-909e35dcee1f tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:46:59.363156 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 237/470] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:59 2022] GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9 => generated 1323 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:46:59.560642 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-937669e5-a8df-4a55-9ae7-909e35dcee1f tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:46:59.577688 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-937669e5-a8df-4a55-9ae7-909e35dcee1f tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/e01ba46f-ddd1-47ae-90d9-4a187bf51b2b" status: 200 len: 1266 microversion: 2.1 time: 0.267360 Sep 16 12:46:59.584359 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 234/471] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:46:59 2022] GET /compute/v2.1/servers/e01ba46f-ddd1-47ae-90d9-4a187bf51b2b => generated 1266 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:00.165192 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e1c8473b-e993-42c3-ac3c-aa1360c0a5d2 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:00.166160 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e1c8473b-e993-42c3-ac3c-aa1360c0a5d2 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: cbbaed5d-b861-4f03-a39b-c384175b92ea] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:00.192152 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1c8473b-e993-42c3-ac3c-aa1360c0a5d2 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:00.192684 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1c8473b-e993-42c3-ac3c-aa1360c0a5d2 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:00.193117 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1c8473b-e993-42c3-ac3c-aa1360c0a5d2 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:00.194016 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1c8473b-e993-42c3-ac3c-aa1360c0a5d2 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:00.198475 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1c8473b-e993-42c3-ac3c-aa1360c0a5d2 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:00.199226 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1c8473b-e993-42c3-ac3c-aa1360c0a5d2 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:00.356506 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e9d8d8f5-4dcd-4f72-8151-5358adc1057a tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:00.357086 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e9d8d8f5-4dcd-4f72-8151-5358adc1057a tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 07365fde-3701-46a6-aba7-4c6f74e181b9] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:00.365823 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9d8d8f5-4dcd-4f72-8151-5358adc1057a tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:00.366269 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9d8d8f5-4dcd-4f72-8151-5358adc1057a tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:00.366712 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9d8d8f5-4dcd-4f72-8151-5358adc1057a tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:00.373001 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9d8d8f5-4dcd-4f72-8151-5358adc1057a tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:00.373501 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9d8d8f5-4dcd-4f72-8151-5358adc1057a tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:00.374088 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9d8d8f5-4dcd-4f72-8151-5358adc1057a tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:00.646701 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e9d8d8f5-4dcd-4f72-8151-5358adc1057a tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709f71c239ca40b8b958038c9ab16f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7058e9e184834c39a5a299f481a6e62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:00.663079 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e9d8d8f5-4dcd-4f72-8151-5358adc1057a tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9" status: 200 len: 1323 microversion: 2.1 time: 0.303733 Sep 16 12:47:00.663763 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 235/472] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:00 2022] GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9 => generated 1323 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:00.683233 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fe41ec76-4d7c-4deb-a705-df1a87ab6f70 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:00.686329 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fe41ec76-4d7c-4deb-a705-df1a87ab6f70 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: e01ba46f-ddd1-47ae-90d9-4a187bf51b2b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:00.709431 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe41ec76-4d7c-4deb-a705-df1a87ab6f70 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:00.709933 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe41ec76-4d7c-4deb-a705-df1a87ab6f70 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:00.718665 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe41ec76-4d7c-4deb-a705-df1a87ab6f70 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:00.719795 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe41ec76-4d7c-4deb-a705-df1a87ab6f70 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:00.726065 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe41ec76-4d7c-4deb-a705-df1a87ab6f70 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:00.726898 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe41ec76-4d7c-4deb-a705-df1a87ab6f70 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:00.908516 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e1c8473b-e993-42c3-ac3c-aa1360c0a5d2 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0815c12c4340109ec1c379a0602322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20770fd1243d4412bfc90d2a079473bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:00.916589 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e1c8473b-e993-42c3-ac3c-aa1360c0a5d2 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "GET /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea" status: 200 len: 1472 microversion: 2.1 time: 0.759520 Sep 16 12:47:00.926485 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fe41ec76-4d7c-4deb-a705-df1a87ab6f70 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:00.930682 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 238/473] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:00 2022] GET /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea => generated 1472 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:00.941656 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fe41ec76-4d7c-4deb-a705-df1a87ab6f70 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/e01ba46f-ddd1-47ae-90d9-4a187bf51b2b" status: 200 len: 1272 microversion: 2.1 time: 0.272250 Sep 16 12:47:00.942595 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 236/474] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:00 2022] GET /compute/v2.1/servers/e01ba46f-ddd1-47ae-90d9-4a187bf51b2b => generated 1272 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:00.974517 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-adbb8327-7d61-4f5e-9334-ca168c074648 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:00.975500 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-adbb8327-7d61-4f5e-9334-ca168c074648 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] [instance: cbbaed5d-b861-4f03-a39b-c384175b92ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:00.990469 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-adbb8327-7d61-4f5e-9334-ca168c074648 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:00.991144 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-adbb8327-7d61-4f5e-9334-ca168c074648 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:00.991743 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-adbb8327-7d61-4f5e-9334-ca168c074648 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:00.992716 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-adbb8327-7d61-4f5e-9334-ca168c074648 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:00.993376 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-adbb8327-7d61-4f5e-9334-ca168c074648 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:00.993828 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-adbb8327-7d61-4f5e-9334-ca168c074648 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:01.030702 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:47:01.037546 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-adbb8327-7d61-4f5e-9334-ca168c074648 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Lazy-loading 'flavor' on Instance uuid cbbaed5d-b861-4f03-a39b-c384175b92ea {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:47:01.258402 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-adbb8327-7d61-4f5e-9334-ca168c074648 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea/action" status: 202 len: 0 microversion: 2.1 time: 0.291401 Sep 16 12:47:01.260079 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 237/475] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:47:00 2022] POST /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:47:01.273965 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7288ff33-79f7-429d-9751-94c6f910bc95 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:01.275428 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7288ff33-79f7-429d-9751-94c6f910bc95 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] [instance: cbbaed5d-b861-4f03-a39b-c384175b92ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:01.293878 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7288ff33-79f7-429d-9751-94c6f910bc95 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:01.294565 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7288ff33-79f7-429d-9751-94c6f910bc95 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:01.295295 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7288ff33-79f7-429d-9751-94c6f910bc95 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:01.296394 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7288ff33-79f7-429d-9751-94c6f910bc95 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:01.300846 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7288ff33-79f7-429d-9751-94c6f910bc95 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:01.301535 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7288ff33-79f7-429d-9751-94c6f910bc95 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:01.457192 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-18cf03a6-b2a9-4c34-9f21-47e4f81dfb09 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1938947356", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:01.574000 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-18cf03a6-b2a9-4c34-9f21-47e4f81dfb09 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] validate_networks() for None {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:47:02.467461 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-18cf03a6-b2a9-4c34-9f21-47e4f81dfb09 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:47:02.468090 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-18cf03a6-b2a9-4c34-9f21-47e4f81dfb09 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:47:02.468398 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-18cf03a6-b2a9-4c34-9f21-47e4f81dfb09 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:47:02.468852 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-18cf03a6-b2a9-4c34-9f21-47e4f81dfb09 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:47:02.469225 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-18cf03a6-b2a9-4c34-9f21-47e4f81dfb09 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:47:02.497611 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-18cf03a6-b2a9-4c34-9f21-47e4f81dfb09 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:02.498479 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-18cf03a6-b2a9-4c34-9f21-47e4f81dfb09 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:02.499982 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-18cf03a6-b2a9-4c34-9f21-47e4f81dfb09 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:02.502957 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-18cf03a6-b2a9-4c34-9f21-47e4f81dfb09 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:02.503723 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-18cf03a6-b2a9-4c34-9f21-47e4f81dfb09 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:02.517271 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-18cf03a6-b2a9-4c34-9f21-47e4f81dfb09 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:02.567803 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-18cf03a6-b2a9-4c34-9f21-47e4f81dfb09 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Getting quotas for project 6e4b83da544e4980b1c2fe2b1f597016. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:47:02.597680 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-18cf03a6-b2a9-4c34-9f21-47e4f81dfb09 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Getting quotas for user 318566be918e44a4894403f766cbd5cb and project 6e4b83da544e4980b1c2fe2b1f597016. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:47:02.638237 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-18cf03a6-b2a9-4c34-9f21-47e4f81dfb09 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:47:02.642373 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-18cf03a6-b2a9-4c34-9f21-47e4f81dfb09 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] [instance: ad946bd5-7ee5-47d6-a52f-00e8511d2bd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:47:02.678078 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7288ff33-79f7-429d-9751-94c6f910bc95 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea" status: 200 len: 1631 microversion: 2.1 time: 1.413100 Sep 16 12:47:02.681045 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 238/476] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:01 2022] GET /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea => generated 1631 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:02.697544 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8dc8fd9f-b2cc-47c9-8921-2fc6af30a78f tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:02.700614 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8dc8fd9f-b2cc-47c9-8921-2fc6af30a78f tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 07365fde-3701-46a6-aba7-4c6f74e181b9] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:02.715596 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8dc8fd9f-b2cc-47c9-8921-2fc6af30a78f tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:02.717166 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8dc8fd9f-b2cc-47c9-8921-2fc6af30a78f tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:02.718776 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8dc8fd9f-b2cc-47c9-8921-2fc6af30a78f tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:02.720542 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8dc8fd9f-b2cc-47c9-8921-2fc6af30a78f tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:02.723655 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8dc8fd9f-b2cc-47c9-8921-2fc6af30a78f tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:02.724385 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8dc8fd9f-b2cc-47c9-8921-2fc6af30a78f tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:02.787410 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-18cf03a6-b2a9-4c34-9f21-47e4f81dfb09 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.853267 Sep 16 12:47:02.797546 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 239/477] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:47:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:47:02.815145 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e7a63d73-2277-4cc8-8c35-0068b0d958c2 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:02.817540 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e7a63d73-2277-4cc8-8c35-0068b0d958c2 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: e01ba46f-ddd1-47ae-90d9-4a187bf51b2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:02.853966 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e7a63d73-2277-4cc8-8c35-0068b0d958c2 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:02.858286 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e7a63d73-2277-4cc8-8c35-0068b0d958c2 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:02.858905 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e7a63d73-2277-4cc8-8c35-0068b0d958c2 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:02.859789 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e7a63d73-2277-4cc8-8c35-0068b0d958c2 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:02.860658 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e7a63d73-2277-4cc8-8c35-0068b0d958c2 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:02.865550 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e7a63d73-2277-4cc8-8c35-0068b0d958c2 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:03.235484 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8dc8fd9f-b2cc-47c9-8921-2fc6af30a78f tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709f71c239ca40b8b958038c9ab16f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7058e9e184834c39a5a299f481a6e62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:03.244313 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8dc8fd9f-b2cc-47c9-8921-2fc6af30a78f tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9" status: 200 len: 1391 microversion: 2.1 time: 0.562070 Sep 16 12:47:03.256921 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 239/478] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:02 2022] GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9 => generated 1391 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:03.261934 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e25c670b-614d-4ac6-a1e4-b4b4221c8b32 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:03.262547 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e25c670b-614d-4ac6-a1e4-b4b4221c8b32 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] [instance: ad946bd5-7ee5-47d6-a52f-00e8511d2bd6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:04.143917 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e25c670b-614d-4ac6-a1e4-b4b4221c8b32 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318566be918e44a4894403f766cbd5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4b83da544e4980b1c2fe2b1f597016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:04.158992 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e25c670b-614d-4ac6-a1e4-b4b4221c8b32 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] 10.222.0.67 "GET /compute/v2.1/servers/ad946bd5-7ee5-47d6-a52f-00e8511d2bd6" status: 200 len: 1223 microversion: 2.1 time: 0.897235 Sep 16 12:47:04.159886 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 240/479] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:03 2022] GET /compute/v2.1/servers/ad946bd5-7ee5-47d6-a52f-00e8511d2bd6 => generated 1223 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:04.176980 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e7a63d73-2277-4cc8-8c35-0068b0d958c2 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:04.194506 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e7a63d73-2277-4cc8-8c35-0068b0d958c2 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/e01ba46f-ddd1-47ae-90d9-4a187bf51b2b" status: 200 len: 1314 microversion: 2.1 time: 1.392176 Sep 16 12:47:04.197082 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 240/480] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:02 2022] GET /compute/v2.1/servers/e01ba46f-ddd1-47ae-90d9-4a187bf51b2b => generated 1314 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:04.207914 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8035d723-b615-4328-aa95-4ce3f1b81fe3 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:04.212083 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8035d723-b615-4328-aa95-4ce3f1b81fe3 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] [instance: cbbaed5d-b861-4f03-a39b-c384175b92ea] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:04.227607 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8035d723-b615-4328-aa95-4ce3f1b81fe3 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:04.228138 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8035d723-b615-4328-aa95-4ce3f1b81fe3 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:04.230425 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8035d723-b615-4328-aa95-4ce3f1b81fe3 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:04.231388 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8035d723-b615-4328-aa95-4ce3f1b81fe3 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:04.233851 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8035d723-b615-4328-aa95-4ce3f1b81fe3 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:04.234302 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8035d723-b615-4328-aa95-4ce3f1b81fe3 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:04.756985 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8035d723-b615-4328-aa95-4ce3f1b81fe3 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea" status: 200 len: 1614 microversion: 2.1 time: 0.558296 Sep 16 12:47:04.765177 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 241/481] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:04 2022] GET /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea => generated 1614 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:04.765300 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3ecaa170-4bbd-4da0-8f2b-50cd149019fe tempest-FloatingIPDetailsNegativeTestJSON-887696399 tempest-FloatingIPDetailsNegativeTestJSON-887696399-project] Calling method '.version_select at 0x7f10360df940>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:04.912350 n-d-858094-4 devstack@n-api.service[128779]: DEBUG neutronclient.v2_0.client [None req-3ecaa170-4bbd-4da0-8f2b-50cd149019fe tempest-FloatingIPDetailsNegativeTestJSON-887696399 tempest-FloatingIPDetailsNegativeTestJSON-887696399-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 23868150-9371-4d1c-b433-6eeef7828761 could not be found", "detail": ""}} {{(pid=128779) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 12:47:04.913047 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-3ecaa170-4bbd-4da0-8f2b-50cd149019fe tempest-FloatingIPDetailsNegativeTestJSON-887696399 tempest-FloatingIPDetailsNegativeTestJSON-887696399-project] HTTP exception thrown: Floating IP not found for ID 23868150-9371-4d1c-b433-6eeef7828761 Sep 16 12:47:04.928201 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3ecaa170-4bbd-4da0-8f2b-50cd149019fe tempest-FloatingIPDetailsNegativeTestJSON-887696399 tempest-FloatingIPDetailsNegativeTestJSON-887696399-project] Request method failure captured: Sep 16 12:47:04.928201 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/os-floating-ips/23868150-9371-4d1c-b433-6eeef7828761 HTTP/1.1 Sep 16 12:47:04.928201 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:47:04.928201 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:47:04.928201 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:47:04.928201 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:47:04.928201 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:47:04.928201 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:47:04.928201 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:47:04.928201 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:47:04.928201 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHBGHjjydkg37AFBkFiybd_OzCUV6mUvfYbxw0s1bdjqYSg4nqOxd4IXYOqNTXQBppU-Pms4uLU0f0a_F1ezhraY2tWCM0VtiTwdz_Bt8d8x94SfLxCbrvlLCgAaFF0ux7bCRvU6WN3UU4NdjwZ5XBHZNhtiKK2P_TjX4VqoOBbzNvk Sep 16 12:47:04.928201 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:47:04.928201 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:47:04.928201 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:47:04.928201 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:47:04.928201 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:47:04.928201 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:47:04.928201 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 1a6a4f24f2d44f74994ace4760050435 Sep 16 12:47:04.928201 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-887696399 Sep 16 12:47:04.928201 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:47:04.928201 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:47:04.929587 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1a6a4f24f2d44f74994ace4760050435"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1a6a4f24f2d44f74994ace4760050435"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1a6a4f24f2d44f74994ace4760050435", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1a6a4f24f2d44f74994ace4760050435"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:47:04.929587 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-887696399 Sep 16 12:47:04.929587 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 1a6a4f24f2d44f74994ace4760050435 Sep 16 12:47:04.929587 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-887696399 Sep 16 12:47:04.929587 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-887696399-project Sep 16 12:47:04.929587 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:47:04.929587 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:47:04.929587 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: f38dae189a624954957575c33f0cb080 Sep 16 12:47:04.929587 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-887696399-project Sep 16 12:47:04.929587 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 12:47:04.929587 n-d-858094-4 devstack@n-api.service[128779]: exception: Floating IP not found for ID 23868150-9371-4d1c-b433-6eeef7828761 Sep 16 12:47:04.929587 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '23868150-9371-4d1c-b433-6eeef7828761'} Sep 16 12:47:04.930563 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:47:04.930563 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:47:04.930563 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 16 12:47:04.930563 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 16 12:47:04.930563 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:47:04.930563 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:47:04.930563 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 16 12:47:04.930563 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 16 12:47:04.930563 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:47:04.930563 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:47:04.930563 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 12:47:04.930563 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 16 12:47:04.930563 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:47:04.930563 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:47:04.930563 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 12:47:04.930563 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 12:47:04.930563 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:47:04.930563 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:47:04.930563 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 12:47:04.931648 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 12:47:04.931648 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:47:04.931648 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:47:04.931648 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 12:47:04.931648 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 12:47:04.931648 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 12:47:04.931648 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 12:47:04.931648 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 23868150-9371-4d1c-b433-6eeef7828761 could not be found Sep 16 12:47:04.931648 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5dc3cb1-4f8b-4a7d-b564-66d19e2511e5'] Sep 16 12:47:04.931648 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:47:04.931648 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:47:04.931648 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:47:04.931648 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:47:04.931648 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 16 12:47:04.931648 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 16 12:47:04.931648 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 16 12:47:04.931648 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 16 12:47:04.931648 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 23868150-9371-4d1c-b433-6eeef7828761. Sep 16 12:47:04.931648 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:47:04.939012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:47:04.939012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:47:04.939012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:47:04.939012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:47:04.939012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:47:04.939012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:47:04.939012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:47:04.939012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:47:04.939012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:47:04.939012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:47:04.939012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:47:04.939012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 16 12:47:04.939012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 16 12:47:04.939012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 23868150-9371-4d1c-b433-6eeef7828761 Sep 16 12:47:04.939012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:47:04.939012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:47:04.939012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:47:04.939012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:47:04.939012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:47:04.939012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:47:04.939012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:47:04.941284 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:47:04.941284 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 23868150-9371-4d1c-b433-6eeef7828761 Sep 16 12:47:04.941284 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:47:04.941284 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3ecaa170-4bbd-4da0-8f2b-50cd149019fe tempest-FloatingIPDetailsNegativeTestJSON-887696399 tempest-FloatingIPDetailsNegativeTestJSON-887696399-project] Returning 404 to user: Floating IP not found for ID 23868150-9371-4d1c-b433-6eeef7828761 {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:47:04.941284 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3ecaa170-4bbd-4da0-8f2b-50cd149019fe tempest-FloatingIPDetailsNegativeTestJSON-887696399 tempest-FloatingIPDetailsNegativeTestJSON-887696399-project] 10.222.0.67 "GET /compute/v2.1/os-floating-ips/23868150-9371-4d1c-b433-6eeef7828761" status: 404 len: 111 microversion: 2.1 time: 0.768223 Sep 16 12:47:04.941284 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 241/482] 10.222.0.67 () {58 vars in 1260 bytes} [Fri Sep 16 12:47:04 2022] GET /compute/v2.1/os-floating-ips/23868150-9371-4d1c-b433-6eeef7828761 => generated 111 bytes in 770 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:47:04.941284 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-7828cf33-9bc7-4bbf-b360-6109609c713e req-2d19aac8-22e6-470b-b959-9374ac935ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07365fde-3701-46a6-aba7-4c6f74e181b9", "tag": "57df8d9f-a9ff-49ba-a0ec-5581bc6e7cb6"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:04.964163 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7828cf33-9bc7-4bbf-b360-6109609c713e req-2d19aac8-22e6-470b-b959-9374ac935ee8 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:04.970208 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7828cf33-9bc7-4bbf-b360-6109609c713e req-2d19aac8-22e6-470b-b959-9374ac935ee8 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:04.972374 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7828cf33-9bc7-4bbf-b360-6109609c713e req-2d19aac8-22e6-470b-b959-9374ac935ee8 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:05.003658 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-7828cf33-9bc7-4bbf-b360-6109609c713e req-2d19aac8-22e6-470b-b959-9374ac935ee8 service nova] Creating event network-changed:57df8d9f-a9ff-49ba-a0ec-5581bc6e7cb6 for instance 07365fde-3701-46a6-aba7-4c6f74e181b9 on n-h1-858094-4 Sep 16 12:47:05.008867 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-7828cf33-9bc7-4bbf-b360-6109609c713e req-2d19aac8-22e6-470b-b959-9374ac935ee8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075849 Sep 16 12:47:05.009701 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 242/483] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:47:05.030116 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3027bcaf-03d5-4bc7-b55e-3b272601d5fa tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:05.030843 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3027bcaf-03d5-4bc7-b55e-3b272601d5fa tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 07365fde-3701-46a6-aba7-4c6f74e181b9] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:05.046157 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3027bcaf-03d5-4bc7-b55e-3b272601d5fa tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:05.046651 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3027bcaf-03d5-4bc7-b55e-3b272601d5fa tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:05.047088 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3027bcaf-03d5-4bc7-b55e-3b272601d5fa tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:05.051838 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3027bcaf-03d5-4bc7-b55e-3b272601d5fa tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:05.061789 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3027bcaf-03d5-4bc7-b55e-3b272601d5fa tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:05.062762 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3027bcaf-03d5-4bc7-b55e-3b272601d5fa tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:05.200624 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e5e01cc5-6172-4d6d-af6f-28deb954d15d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1171032999", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": [{"uuid": "40f9024a-6954-4a0a-afdb-132e05c6d9d2"}]}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:05.323214 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-e5e01cc5-6172-4d6d-af6f-28deb954d15d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] validate_networks() for [('40f9024a-6954-4a0a-afdb-132e05c6d9d2', None, None, None, None, None)] {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:47:05.920561 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=25 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:47:05.937790 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3027bcaf-03d5-4bc7-b55e-3b272601d5fa tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709f71c239ca40b8b958038c9ab16f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7058e9e184834c39a5a299f481a6e62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:05.955933 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3027bcaf-03d5-4bc7-b55e-3b272601d5fa tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9" status: 200 len: 1391 microversion: 2.1 time: 0.942764 Sep 16 12:47:05.960878 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 243/484] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:05 2022] GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9 => generated 1391 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:05.985269 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f1c9e09d-5ae7-4626-87c6-c3d89fbfc06e tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:05.988423 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f1c9e09d-5ae7-4626-87c6-c3d89fbfc06e tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] [instance: cbbaed5d-b861-4f03-a39b-c384175b92ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:05.997758 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1c9e09d-5ae7-4626-87c6-c3d89fbfc06e tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:05.998673 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1c9e09d-5ae7-4626-87c6-c3d89fbfc06e tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:06.002976 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1c9e09d-5ae7-4626-87c6-c3d89fbfc06e tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:06.007639 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1c9e09d-5ae7-4626-87c6-c3d89fbfc06e tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:06.009447 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1c9e09d-5ae7-4626-87c6-c3d89fbfc06e tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:06.010152 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1c9e09d-5ae7-4626-87c6-c3d89fbfc06e tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:06.239978 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-f1c9e09d-5ae7-4626-87c6-c3d89fbfc06e tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] HTTP exception thrown: Cannot 'migrate' instance cbbaed5d-b861-4f03-a39b-c384175b92ea while it is in vm_state suspended Sep 16 12:47:06.244016 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f1c9e09d-5ae7-4626-87c6-c3d89fbfc06e tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Request method failure captured: Sep 16 12:47:06.244016 n-d-858094-4 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea/action HTTP/1.1 Sep 16 12:47:06.244016 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:47:06.244016 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:47:06.244016 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:47:06.244016 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 15 Sep 16 12:47:06.244016 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:47:06.244016 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:47:06.244016 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:47:06.244016 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:47:06.244016 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHAL52L-sno-1Yd1ceJPP0Wv2MeDXukFtjSlNoyYrkU9bU1lbl5CuyJ3pwwMpFVZpUUEZ7Y0nvsVtK-A8yisgACJuq0feHbCmMwgha9_JhKv_4-wEjsZ3cxOCmgW5dbSolkzAPibHD_fdwd47ChBcd9UmMTT60oTEjiTzk7MfU4sKuY Sep 16 12:47:06.244016 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:47:06.244016 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:47:06.244016 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:47:06.244016 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:47:06.244016 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:47:06.244016 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:47:06.244016 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: df02d1f4029341a7a1f27484ea714c96 Sep 16 12:47:06.244016 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-250756494 Sep 16 12:47:06.244016 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,admin,reader Sep 16 12:47:06.244016 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,admin,reader Sep 16 12:47:06.246874 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/df02d1f4029341a7a1f27484ea714c96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/df02d1f4029341a7a1f27484ea714c96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_df02d1f4029341a7a1f27484ea714c96", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/df02d1f4029341a7a1f27484ea714c96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:47:06.246874 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ServersAdminNegativeTestJSON-250756494 Sep 16 12:47:06.246874 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: df02d1f4029341a7a1f27484ea714c96 Sep 16 12:47:06.246874 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-250756494 Sep 16 12:47:06.246874 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ServersAdminNegativeTestJSON-250756494-project-admin Sep 16 12:47:06.246874 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:47:06.246874 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:47:06.246874 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 6d8647a085014089877a089d1691bca5 Sep 16 12:47:06.246874 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ServersAdminNegativeTestJSON-250756494-project-admin Sep 16 12:47:06.246874 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 12:47:06.246874 n-d-858094-4 devstack@n-api.service[128779]: {"migrate": {}} Sep 16 12:47:06.246874 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:47:06.246874 n-d-858094-4 devstack@n-api.service[128779]: exception: Cannot 'migrate' instance cbbaed5d-b861-4f03-a39b-c384175b92ea while it is in vm_state suspended Sep 16 12:47:06.247704 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': 'cbbaed5d-b861-4f03-a39b-c384175b92ea', 'body': {'migrate': {}}} Sep 16 12:47:06.247704 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:47:06.247704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:47:06.247704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Sep 16 12:47:06.247704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Sep 16 12:47:06.247704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 16 12:47:06.247704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 12:47:06.247704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 16 12:47:06.247704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 16 12:47:06.247704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 16 12:47:06.247704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 16 12:47:06.247704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 16 12:47:06.247704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 12:47:06.247704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 16 12:47:06.247704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 16 12:47:06.247704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cbbaed5d-b861-4f03-a39b-c384175b92ea in vm_state suspended. Cannot resize while the instance is in this state. Sep 16 12:47:06.247704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:47:06.247704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:47:06.247704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:47:06.247704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:47:06.249033 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:47:06.249033 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:47:06.249033 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:47:06.249033 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:47:06.249033 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:47:06.249033 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:47:06.249033 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:47:06.249033 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:47:06.249033 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Sep 16 12:47:06.249033 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 16 12:47:06.249033 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 16 12:47:06.249033 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 16 12:47:06.249033 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance cbbaed5d-b861-4f03-a39b-c384175b92ea while it is in vm_state suspended Sep 16 12:47:06.249033 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:47:06.249033 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:47:06.249033 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:47:06.249033 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:47:06.249033 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:47:06.249033 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:47:06.250349 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:47:06.250349 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:47:06.250349 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance cbbaed5d-b861-4f03-a39b-c384175b92ea while it is in vm_state suspended Sep 16 12:47:06.250349 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:47:06.250349 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f1c9e09d-5ae7-4626-87c6-c3d89fbfc06e tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Returning 409 to user: Cannot 'migrate' instance cbbaed5d-b861-4f03-a39b-c384175b92ea while it is in vm_state suspended {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:47:06.250349 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f1c9e09d-5ae7-4626-87c6-c3d89fbfc06e tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea/action" status: 409 len: 148 microversion: 2.1 time: 0.287275 Sep 16 12:47:06.254266 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 244/485] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:47:05 2022] POST /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea/action => generated 148 bytes in 289 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 16 12:47:06.274740 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-99c75cc8-3157-4f4f-8c97-f42846069a9b tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:06.275359 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-99c75cc8-3157-4f4f-8c97-f42846069a9b tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] [instance: ad946bd5-7ee5-47d6-a52f-00e8511d2bd6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:06.289036 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99c75cc8-3157-4f4f-8c97-f42846069a9b tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:06.289529 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99c75cc8-3157-4f4f-8c97-f42846069a9b tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:06.289973 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99c75cc8-3157-4f4f-8c97-f42846069a9b tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:06.290810 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99c75cc8-3157-4f4f-8c97-f42846069a9b tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:06.292567 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99c75cc8-3157-4f4f-8c97-f42846069a9b tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:06.293239 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99c75cc8-3157-4f4f-8c97-f42846069a9b tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:06.552351 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-99c75cc8-3157-4f4f-8c97-f42846069a9b tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318566be918e44a4894403f766cbd5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4b83da544e4980b1c2fe2b1f597016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:06.562389 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-99c75cc8-3157-4f4f-8c97-f42846069a9b tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] 10.222.0.67 "GET /compute/v2.1/servers/ad946bd5-7ee5-47d6-a52f-00e8511d2bd6" status: 200 len: 1281 microversion: 2.1 time: 0.310419 Sep 16 12:47:06.582929 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 245/486] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:06 2022] GET /compute/v2.1/servers/ad946bd5-7ee5-47d6-a52f-00e8511d2bd6 => generated 1281 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:06.589482 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1ca7a02b-5985-4f59-b1c2-36ef784792a4 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:06.590086 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1ca7a02b-5985-4f59-b1c2-36ef784792a4 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: e01ba46f-ddd1-47ae-90d9-4a187bf51b2b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:06.607848 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ca7a02b-5985-4f59-b1c2-36ef784792a4 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:06.608769 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ca7a02b-5985-4f59-b1c2-36ef784792a4 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:06.613882 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ca7a02b-5985-4f59-b1c2-36ef784792a4 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:06.614895 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ca7a02b-5985-4f59-b1c2-36ef784792a4 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:06.615533 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ca7a02b-5985-4f59-b1c2-36ef784792a4 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:06.617011 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ca7a02b-5985-4f59-b1c2-36ef784792a4 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:07.049764 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1ca7a02b-5985-4f59-b1c2-36ef784792a4 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:07.069240 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1ca7a02b-5985-4f59-b1c2-36ef784792a4 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/e01ba46f-ddd1-47ae-90d9-4a187bf51b2b" status: 200 len: 1314 microversion: 2.1 time: 0.482685 Sep 16 12:47:07.070536 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 246/487] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:06 2022] GET /compute/v2.1/servers/e01ba46f-ddd1-47ae-90d9-4a187bf51b2b => generated 1314 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:07.076429 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-dc360a02-5afc-42c1-8252-30a5135b8510 req-7893620e-f081-4028-9385-2c7129fddc00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e01ba46f-ddd1-47ae-90d9-4a187bf51b2b", "tag": "a6fb319f-c3cf-4120-b2c2-c32144451c45"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:07.100357 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dc360a02-5afc-42c1-8252-30a5135b8510 req-7893620e-f081-4028-9385-2c7129fddc00 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:07.101043 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dc360a02-5afc-42c1-8252-30a5135b8510 req-7893620e-f081-4028-9385-2c7129fddc00 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:07.101863 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dc360a02-5afc-42c1-8252-30a5135b8510 req-7893620e-f081-4028-9385-2c7129fddc00 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:07.123745 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-dc360a02-5afc-42c1-8252-30a5135b8510 req-7893620e-f081-4028-9385-2c7129fddc00 service nova] Creating event network-changed:a6fb319f-c3cf-4120-b2c2-c32144451c45 for instance e01ba46f-ddd1-47ae-90d9-4a187bf51b2b on n-h2-858094-4 Sep 16 12:47:07.142431 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-dc360a02-5afc-42c1-8252-30a5135b8510 req-7893620e-f081-4028-9385-2c7129fddc00 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070248 Sep 16 12:47:07.143427 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 247/488] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:47:07.159670 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-40669974-5b88-42a5-956b-20560b52433a tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:07.182556 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-40669974-5b88-42a5-956b-20560b52433a tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Request method failure captured: Sep 16 12:47:07.182556 n-d-858094-4 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b/action HTTP/1.1 Sep 16 12:47:07.182556 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:47:07.182556 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:47:07.182556 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:47:07.182556 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 39 Sep 16 12:47:07.182556 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:47:07.182556 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:47:07.182556 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:47:07.182556 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:47:07.182556 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHAL52L-sno-1Yd1ceJPP0Wv2MeDXukFtjSlNoyYrkU9bU1lbl5CuyJ3pwwMpFVZpUUEZ7Y0nvsVtK-A8yisgACJuq0feHbCmMwgha9_JhKv_4-wEjsZ3cxOCmgW5dbSolkzAPibHD_fdwd47ChBcd9UmMTT60oTEjiTzk7MfU4sKuY Sep 16 12:47:07.182556 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:47:07.182556 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:47:07.182556 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:47:07.182556 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:47:07.182556 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:47:07.182556 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:47:07.182556 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: df02d1f4029341a7a1f27484ea714c96 Sep 16 12:47:07.182556 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-250756494 Sep 16 12:47:07.182556 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,admin,reader Sep 16 12:47:07.182556 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,admin,reader Sep 16 12:47:07.183840 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/df02d1f4029341a7a1f27484ea714c96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/df02d1f4029341a7a1f27484ea714c96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_df02d1f4029341a7a1f27484ea714c96", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/df02d1f4029341a7a1f27484ea714c96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:47:07.183840 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ServersAdminNegativeTestJSON-250756494 Sep 16 12:47:07.183840 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: df02d1f4029341a7a1f27484ea714c96 Sep 16 12:47:07.183840 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-250756494 Sep 16 12:47:07.183840 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ServersAdminNegativeTestJSON-250756494-project-admin Sep 16 12:47:07.183840 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:47:07.183840 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:47:07.183840 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 6d8647a085014089877a089d1691bca5 Sep 16 12:47:07.183840 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ServersAdminNegativeTestJSON-250756494-project-admin Sep 16 12:47:07.183840 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 12:47:07.183840 n-d-858094-4 devstack@n-api.service[128779]: {"os-resetState": {"state": "invalid"}} Sep 16 12:47:07.183840 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:47:07.185081 n-d-858094-4 devstack@n-api.service[128779]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 16 12:47:07.185081 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '4d860eb6-336f-4ba4-be81-d1ec6fecc87b', 'body': {'os-resetState': {'state': 'invalid'}}} Sep 16 12:47:07.185081 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:47:07.185081 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:47:07.185081 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 12:47:07.185081 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 12:47:07.185081 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 12:47:07.185081 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise error Sep 16 12:47:07.185081 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Sep 16 12:47:07.185081 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:47:07.185081 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Sep 16 12:47:07.185081 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 16 12:47:07.185081 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:47:07.185081 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 16 12:47:07.185081 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'invalid' Sep 16 12:47:07.185081 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:47:07.185081 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:47:07.185081 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:47:07.185081 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:47:07.185081 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:47:07.185081 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:47:07.185081 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:47:07.186418 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:47:07.186418 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:47:07.186418 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:47:07.186418 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 12:47:07.186418 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 12:47:07.186418 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 12:47:07.186418 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 12:47:07.186418 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 12:47:07.186418 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 12:47:07.186418 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 16 12:47:07.186418 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:47:07.186418 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:47:07.186418 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:47:07.186418 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:47:07.186418 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:47:07.186418 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:47:07.186418 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 12:47:07.186418 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 12:47:07.186418 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 16 12:47:07.187537 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:47:07.190585 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-40669974-5b88-42a5-956b-20560b52433a tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:47:07.200509 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-40669974-5b88-42a5-956b-20560b52433a tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b/action" status: 400 len: 144 microversion: 2.1 time: 0.045793 Sep 16 12:47:07.201608 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 248/489] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:47:07 2022] POST /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b/action => generated 144 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 12:47:07.593367 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-e5e01cc5-6172-4d6d-af6f-28deb954d15d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:47:07.616594 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-e5e01cc5-6172-4d6d-af6f-28deb954d15d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:47:07.619759 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-e5e01cc5-6172-4d6d-af6f-28deb954d15d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:47:07.620720 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-e5e01cc5-6172-4d6d-af6f-28deb954d15d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:47:07.622994 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-e5e01cc5-6172-4d6d-af6f-28deb954d15d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:47:07.646810 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e5e01cc5-6172-4d6d-af6f-28deb954d15d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:07.647590 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e5e01cc5-6172-4d6d-af6f-28deb954d15d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:07.648108 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e5e01cc5-6172-4d6d-af6f-28deb954d15d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:07.657774 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e5e01cc5-6172-4d6d-af6f-28deb954d15d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:07.659285 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e5e01cc5-6172-4d6d-af6f-28deb954d15d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:07.659913 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e5e01cc5-6172-4d6d-af6f-28deb954d15d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:07.712425 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-e5e01cc5-6172-4d6d-af6f-28deb954d15d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Getting quotas for project dd7ec914bffb4743921e4116b0c399eb. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:47:07.731082 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-e5e01cc5-6172-4d6d-af6f-28deb954d15d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Getting quotas for user 745ef253e9844572a0f081955b3e9a90 and project dd7ec914bffb4743921e4116b0c399eb. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:47:07.768065 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e5e01cc5-6172-4d6d-af6f-28deb954d15d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:47:07.770922 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e5e01cc5-6172-4d6d-af6f-28deb954d15d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 566f231d-345e-4665-bf9a-b61004b954ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:47:07.852525 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e5e01cc5-6172-4d6d-af6f-28deb954d15d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.089562 Sep 16 12:47:07.853366 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 242/490] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:47:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 3091 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:47:07.858940 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-49696b9e-ae5b-4d5c-8ae6-4657862b26fd tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:07.859891 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-49696b9e-ae5b-4d5c-8ae6-4657862b26fd tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 07365fde-3701-46a6-aba7-4c6f74e181b9] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:07.863929 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-33891541-4598-4843-9a7e-b6a8651db143 tempest-QuotasAdminTestV257-323812954 tempest-QuotasAdminTestV257-323812954-project-admin] Action: 'update', calling method: .version_select at 0x7f10360721f0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:07.868418 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-49696b9e-ae5b-4d5c-8ae6-4657862b26fd tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:07.868950 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-49696b9e-ae5b-4d5c-8ae6-4657862b26fd tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:07.869378 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-49696b9e-ae5b-4d5c-8ae6-4657862b26fd tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:07.870169 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-49696b9e-ae5b-4d5c-8ae6-4657862b26fd tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:07.870585 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-49696b9e-ae5b-4d5c-8ae6-4657862b26fd tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:07.871278 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-49696b9e-ae5b-4d5c-8ae6-4657862b26fd tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:08.025972 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33891541-4598-4843-9a7e-b6a8651db143 tempest-QuotasAdminTestV257-323812954 tempest-QuotasAdminTestV257-323812954-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:08.026471 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33891541-4598-4843-9a7e-b6a8651db143 tempest-QuotasAdminTestV257-323812954 tempest-QuotasAdminTestV257-323812954-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:08.026909 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33891541-4598-4843-9a7e-b6a8651db143 tempest-QuotasAdminTestV257-323812954 tempest-QuotasAdminTestV257-323812954-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:08.028386 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33891541-4598-4843-9a7e-b6a8651db143 tempest-QuotasAdminTestV257-323812954 tempest-QuotasAdminTestV257-323812954-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:08.028854 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33891541-4598-4843-9a7e-b6a8651db143 tempest-QuotasAdminTestV257-323812954 tempest-QuotasAdminTestV257-323812954-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:08.029291 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33891541-4598-4843-9a7e-b6a8651db143 tempest-QuotasAdminTestV257-323812954 tempest-QuotasAdminTestV257-323812954-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:08.091732 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-33891541-4598-4843-9a7e-b6a8651db143 tempest-QuotasAdminTestV257-323812954 tempest-QuotasAdminTestV257-323812954-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/63a3d02829134e519689a7ef36c0e67e" status: 200 len: 148 microversion: 2.57 time: 0.888340 Sep 16 12:47:08.100239 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 249/491] 10.222.0.67 () {62 vars in 1303 bytes} [Fri Sep 16 12:47:07 2022] PUT /compute/v2.1/os-quota-sets/63a3d02829134e519689a7ef36c0e67e => generated 148 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:47:08.113031 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c5d5eef5-4143-4138-ab6c-2435102b4399 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:08.117475 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c5d5eef5-4143-4138-ab6c-2435102b4399 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Request method failure captured: Sep 16 12:47:08.117475 n-d-858094-4 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b/action HTTP/1.1 Sep 16 12:47:08.117475 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:47:08.117475 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:47:08.117475 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:47:08.117475 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 31 Sep 16 12:47:08.117475 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:47:08.117475 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:47:08.117475 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:47:08.117475 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:47:08.117475 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHAL52L-sno-1Yd1ceJPP0Wv2MeDXukFtjSlNoyYrkU9bU1lbl5CuyJ3pwwMpFVZpUUEZ7Y0nvsVtK-A8yisgACJuq0feHbCmMwgha9_JhKv_4-wEjsZ3cxOCmgW5dbSolkzAPibHD_fdwd47ChBcd9UmMTT60oTEjiTzk7MfU4sKuY Sep 16 12:47:08.117475 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:47:08.117475 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:47:08.117475 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:47:08.117475 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:47:08.117475 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:47:08.117475 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:47:08.117475 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: df02d1f4029341a7a1f27484ea714c96 Sep 16 12:47:08.117475 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-250756494 Sep 16 12:47:08.117475 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,admin,reader Sep 16 12:47:08.117475 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,admin,reader Sep 16 12:47:08.118878 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/df02d1f4029341a7a1f27484ea714c96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/df02d1f4029341a7a1f27484ea714c96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_df02d1f4029341a7a1f27484ea714c96", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/df02d1f4029341a7a1f27484ea714c96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:47:08.118878 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ServersAdminNegativeTestJSON-250756494 Sep 16 12:47:08.118878 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: df02d1f4029341a7a1f27484ea714c96 Sep 16 12:47:08.118878 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-250756494 Sep 16 12:47:08.118878 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ServersAdminNegativeTestJSON-250756494-project-admin Sep 16 12:47:08.118878 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:47:08.118878 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:47:08.118878 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 6d8647a085014089877a089d1691bca5 Sep 16 12:47:08.118878 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ServersAdminNegativeTestJSON-250756494-project-admin Sep 16 12:47:08.118878 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 12:47:08.118878 n-d-858094-4 devstack@n-api.service[128779]: {"os-resetState": {"state": 1}} Sep 16 12:47:08.118878 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:47:08.118878 n-d-858094-4 devstack@n-api.service[128779]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 16 12:47:08.119724 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '4d860eb6-336f-4ba4-be81-d1ec6fecc87b', 'body': {'os-resetState': {'state': 1}}} Sep 16 12:47:08.119724 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:47:08.119724 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:47:08.119724 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 12:47:08.119724 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 12:47:08.119724 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 12:47:08.119724 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise error Sep 16 12:47:08.119724 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Sep 16 12:47:08.119724 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:47:08.119724 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Sep 16 12:47:08.119724 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 16 12:47:08.119724 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:47:08.119724 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 16 12:47:08.119724 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 1 Sep 16 12:47:08.119724 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:47:08.119724 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:47:08.119724 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:47:08.119724 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:47:08.119724 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:47:08.119724 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:47:08.119724 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:47:08.119724 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:47:08.121027 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:47:08.121027 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:47:08.121027 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 12:47:08.121027 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 12:47:08.121027 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 12:47:08.121027 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 12:47:08.121027 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 12:47:08.121027 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 12:47:08.121027 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 16 12:47:08.121027 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:47:08.121027 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:47:08.121027 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:47:08.121027 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:47:08.121027 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:47:08.121027 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:47:08.121027 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 12:47:08.121027 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 12:47:08.121027 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 16 12:47:08.121027 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:47:08.122123 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c5d5eef5-4143-4138-ab6c-2435102b4399 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:47:08.122879 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c5d5eef5-4143-4138-ab6c-2435102b4399 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b/action" status: 400 len: 120 microversion: 2.1 time: 0.021459 Sep 16 12:47:08.129813 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 250/492] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:47:08 2022] POST /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b/action => generated 120 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 12:47:08.141435 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-49696b9e-ae5b-4d5c-8ae6-4657862b26fd tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709f71c239ca40b8b958038c9ab16f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7058e9e184834c39a5a299f481a6e62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:08.151573 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-49696b9e-ae5b-4d5c-8ae6-4657862b26fd tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9" status: 200 len: 1391 microversion: 2.1 time: 0.296621 Sep 16 12:47:08.165807 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 243/493] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:07 2022] GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9 => generated 1391 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:08.179058 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2d6cf28d-218c-4142-92c3-105b0f0cc9df tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:08.180194 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-2d6cf28d-218c-4142-92c3-105b0f0cc9df tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] [instance: ad946bd5-7ee5-47d6-a52f-00e8511d2bd6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:08.195021 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2d6cf28d-218c-4142-92c3-105b0f0cc9df tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:08.196153 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2d6cf28d-218c-4142-92c3-105b0f0cc9df tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:08.196856 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2d6cf28d-218c-4142-92c3-105b0f0cc9df tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:08.198098 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2d6cf28d-218c-4142-92c3-105b0f0cc9df tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:08.198785 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2d6cf28d-218c-4142-92c3-105b0f0cc9df tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:08.199417 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2d6cf28d-218c-4142-92c3-105b0f0cc9df tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:08.227400 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e8bf257d-5eeb-4eca-812d-a64503703d13 tempest-InstanceUsageAuditLogTestJSON-1744793797 tempest-InstanceUsageAuditLogTestJSON-1744793797-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:08.252714 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e8bf257d-5eeb-4eca-812d-a64503703d13 tempest-InstanceUsageAuditLogTestJSON-1744793797 tempest-InstanceUsageAuditLogTestJSON-1744793797-project-admin] 10.222.0.67 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-16 12:47:07" status: 200 len: 318 microversion: 2.1 time: 0.120400 Sep 16 12:47:08.264450 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 251/494] 10.222.0.67 () {58 vars in 1251 bytes} [Fri Sep 16 12:47:08 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-16%2012%3A47%3A07 => generated 318 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:47:08.270557 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dcb9aea6-96ae-426a-8cbb-ce0b67dd4159 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:08.271693 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dcb9aea6-96ae-426a-8cbb-ce0b67dd4159 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 566f231d-345e-4665-bf9a-b61004b954ed] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:08.321279 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-2d6cf28d-218c-4142-92c3-105b0f0cc9df tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318566be918e44a4894403f766cbd5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4b83da544e4980b1c2fe2b1f597016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:08.332893 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2d6cf28d-218c-4142-92c3-105b0f0cc9df tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] 10.222.0.67 "GET /compute/v2.1/servers/ad946bd5-7ee5-47d6-a52f-00e8511d2bd6" status: 200 len: 1281 microversion: 2.1 time: 0.162666 Sep 16 12:47:08.336015 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 244/495] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:08 2022] GET /compute/v2.1/servers/ad946bd5-7ee5-47d6-a52f-00e8511d2bd6 => generated 1281 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:08.348042 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e6650966-9136-42fc-add6-02260423d010 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:08.348766 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e6650966-9136-42fc-add6-02260423d010 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: e01ba46f-ddd1-47ae-90d9-4a187bf51b2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:08.359409 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e6650966-9136-42fc-add6-02260423d010 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:08.359895 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e6650966-9136-42fc-add6-02260423d010 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:08.360374 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e6650966-9136-42fc-add6-02260423d010 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:08.361626 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e6650966-9136-42fc-add6-02260423d010 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:08.362076 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e6650966-9136-42fc-add6-02260423d010 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:08.370521 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e6650966-9136-42fc-add6-02260423d010 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:08.440663 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dcb9aea6-96ae-426a-8cbb-ce0b67dd4159 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:08.454242 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dcb9aea6-96ae-426a-8cbb-ce0b67dd4159 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed" status: 200 len: 1211 microversion: 2.1 time: 0.188179 Sep 16 12:47:08.454928 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 252/496] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:08 2022] GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed => generated 1211 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:08.461152 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c81bc766-4873-4ff3-9998-4eb8c9141afa tempest-QuotasAdminTestV257-323812954 tempest-QuotasAdminTestV257-323812954-project-admin] Calling method '.version_select at 0x7f10361b69d0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:08.591004 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:47:08.594275 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c81bc766-4873-4ff3-9998-4eb8c9141afa tempest-QuotasAdminTestV257-323812954 tempest-QuotasAdminTestV257-323812954-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:08.599315 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c81bc766-4873-4ff3-9998-4eb8c9141afa tempest-QuotasAdminTestV257-323812954 tempest-QuotasAdminTestV257-323812954-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:08.600152 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c81bc766-4873-4ff3-9998-4eb8c9141afa tempest-QuotasAdminTestV257-323812954 tempest-QuotasAdminTestV257-323812954-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:08.601401 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c81bc766-4873-4ff3-9998-4eb8c9141afa tempest-QuotasAdminTestV257-323812954 tempest-QuotasAdminTestV257-323812954-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:08.606643 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c81bc766-4873-4ff3-9998-4eb8c9141afa tempest-QuotasAdminTestV257-323812954 tempest-QuotasAdminTestV257-323812954-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:08.608365 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c81bc766-4873-4ff3-9998-4eb8c9141afa tempest-QuotasAdminTestV257-323812954 tempest-QuotasAdminTestV257-323812954-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:08.674083 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c81bc766-4873-4ff3-9998-4eb8c9141afa tempest-QuotasAdminTestV257-323812954 tempest-QuotasAdminTestV257-323812954-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/63a3d02829134e519689a7ef36c0e67e/detail" status: 200 len: 463 microversion: 2.57 time: 0.217253 Sep 16 12:47:08.674841 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 253/497] 10.222.0.67 () {60 vars in 1304 bytes} [Fri Sep 16 12:47:08 2022] GET /compute/v2.1/os-quota-sets/63a3d02829134e519689a7ef36c0e67e/detail => generated 463 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:47:08.689950 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-063d010a-095c-476b-9ead-16fda7a5b941 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:08.706042 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-063d010a-095c-476b-9ead-16fda7a5b941 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Failed to fetch instance by id 999 {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 16 12:47:08.706837 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-063d010a-095c-476b-9ead-16fda7a5b941 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] HTTP exception thrown: Instance 999 could not be found. Sep 16 12:47:08.708791 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-063d010a-095c-476b-9ead-16fda7a5b941 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Request method failure captured: Sep 16 12:47:08.708791 n-d-858094-4 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Sep 16 12:47:08.708791 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:47:08.708791 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:47:08.708791 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:47:08.708791 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 37 Sep 16 12:47:08.708791 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:47:08.708791 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:47:08.708791 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:47:08.708791 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:47:08.708791 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHAL52L-sno-1Yd1ceJPP0Wv2MeDXukFtjSlNoyYrkU9bU1lbl5CuyJ3pwwMpFVZpUUEZ7Y0nvsVtK-A8yisgACJuq0feHbCmMwgha9_JhKv_4-wEjsZ3cxOCmgW5dbSolkzAPibHD_fdwd47ChBcd9UmMTT60oTEjiTzk7MfU4sKuY Sep 16 12:47:08.708791 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:47:08.708791 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:47:08.708791 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:47:08.708791 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:47:08.708791 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:47:08.708791 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:47:08.708791 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: df02d1f4029341a7a1f27484ea714c96 Sep 16 12:47:08.708791 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-250756494 Sep 16 12:47:08.708791 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,admin,reader Sep 16 12:47:08.708791 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,admin,reader Sep 16 12:47:08.710058 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/df02d1f4029341a7a1f27484ea714c96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/df02d1f4029341a7a1f27484ea714c96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_df02d1f4029341a7a1f27484ea714c96", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/df02d1f4029341a7a1f27484ea714c96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:47:08.710058 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ServersAdminNegativeTestJSON-250756494 Sep 16 12:47:08.710058 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: df02d1f4029341a7a1f27484ea714c96 Sep 16 12:47:08.710058 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-250756494 Sep 16 12:47:08.710058 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ServersAdminNegativeTestJSON-250756494-project-admin Sep 16 12:47:08.710058 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:47:08.710058 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:47:08.710058 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 6d8647a085014089877a089d1691bca5 Sep 16 12:47:08.710058 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ServersAdminNegativeTestJSON-250756494-project-admin Sep 16 12:47:08.710058 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 12:47:08.710058 n-d-858094-4 devstack@n-api.service[128779]: {"os-resetState": {"state": "error"}} Sep 16 12:47:08.710058 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:47:08.710058 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 999 could not be found. Sep 16 12:47:08.711108 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Sep 16 12:47:08.711108 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:47:08.711108 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:47:08.711108 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:47:08.711108 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:47:08.711108 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 16 12:47:08.711108 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 16 12:47:08.711108 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 16 12:47:08.711108 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:47:08.711108 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:47:08.711108 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:47:08.711108 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:47:08.711108 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:47:08.711108 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:47:08.711108 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:47:08.711108 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:47:08.711108 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:47:08.711108 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:47:08.711108 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:47:08.711108 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:47:08.711108 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Sep 16 12:47:08.712654 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 16 12:47:08.712654 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:47:08.712654 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:47:08.712654 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 16 12:47:08.712654 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:47:08.712654 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:47:08.712654 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:47:08.712654 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:47:08.712654 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:47:08.712654 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:47:08.712654 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:47:08.712654 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:47:08.712654 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 16 12:47:08.712654 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:47:08.714844 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-063d010a-095c-476b-9ead-16fda7a5b941 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:47:08.716144 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-063d010a-095c-476b-9ead-16fda7a5b941 tempest-ServersAdminNegativeTestJSON-250756494 tempest-ServersAdminNegativeTestJSON-250756494-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.034997 Sep 16 12:47:08.717422 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 254/498] 10.222.0.67 () {60 vars in 1179 bytes} [Fri Sep 16 12:47:08 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 12:47:08.725440 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a666d71a-bda1-47e6-a01a-312df1ed7e25 tempest-InstanceUsageAuditLogTestJSON-1744793797 tempest-InstanceUsageAuditLogTestJSON-1744793797-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:08.778126 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a666d71a-bda1-47e6-a01a-312df1ed7e25 tempest-InstanceUsageAuditLogTestJSON-1744793797 tempest-InstanceUsageAuditLogTestJSON-1744793797-project-admin] 10.222.0.67 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.054574 Sep 16 12:47:08.787916 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 255/499] 10.222.0.67 () {58 vars in 1185 bytes} [Fri Sep 16 12:47:08 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:47:08.792030 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c3aa851c-cd9a-40ef-86a2-73df604d06a0 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:08.792651 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c3aa851c-cd9a-40ef-86a2-73df604d06a0 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: cbbaed5d-b861-4f03-a39b-c384175b92ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:08.808950 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3aa851c-cd9a-40ef-86a2-73df604d06a0 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:08.809486 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3aa851c-cd9a-40ef-86a2-73df604d06a0 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:08.809934 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3aa851c-cd9a-40ef-86a2-73df604d06a0 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:08.810987 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3aa851c-cd9a-40ef-86a2-73df604d06a0 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:08.811807 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3aa851c-cd9a-40ef-86a2-73df604d06a0 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:08.811909 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3aa851c-cd9a-40ef-86a2-73df604d06a0 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:08.911865 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c3aa851c-cd9a-40ef-86a2-73df604d06a0 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: cbbaed5d-b861-4f03-a39b-c384175b92ea] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:47:08.992988 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e6650966-9136-42fc-add6-02260423d010 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:09.009361 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e6650966-9136-42fc-add6-02260423d010 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/e01ba46f-ddd1-47ae-90d9-4a187bf51b2b" status: 200 len: 1314 microversion: 2.1 time: 0.670571 Sep 16 12:47:09.025630 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 245/500] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:08 2022] GET /compute/v2.1/servers/e01ba46f-ddd1-47ae-90d9-4a187bf51b2b => generated 1314 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:09.046098 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-52152882-c754-447f-bcf9-0bbf4a5fe65e tempest-QuotasAdminTestV257-323812954 tempest-QuotasAdminTestV257-323812954-project-admin] Action: 'update', calling method: .version_select at 0x7f1035ea6700>, body: {"quota_set": {"ram": "2048"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:09.104027 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c3aa851c-cd9a-40ef-86a2-73df604d06a0 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "DELETE /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea" status: 204 len: 0 microversion: 2.1 time: 0.322566 Sep 16 12:47:09.109854 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 256/501] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:47:08 2022] DELETE /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:47:09.120754 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f68f48db-c00a-4f0c-910b-9b741cd95366 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:09.129515 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f68f48db-c00a-4f0c-910b-9b741cd95366 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: cbbaed5d-b861-4f03-a39b-c384175b92ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:09.144670 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f68f48db-c00a-4f0c-910b-9b741cd95366 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:09.147103 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f68f48db-c00a-4f0c-910b-9b741cd95366 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:09.147760 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f68f48db-c00a-4f0c-910b-9b741cd95366 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:09.148778 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f68f48db-c00a-4f0c-910b-9b741cd95366 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:09.149241 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f68f48db-c00a-4f0c-910b-9b741cd95366 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:09.149663 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f68f48db-c00a-4f0c-910b-9b741cd95366 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:09.222638 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-52152882-c754-447f-bcf9-0bbf4a5fe65e tempest-QuotasAdminTestV257-323812954 tempest-QuotasAdminTestV257-323812954-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:09.228169 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-52152882-c754-447f-bcf9-0bbf4a5fe65e tempest-QuotasAdminTestV257-323812954 tempest-QuotasAdminTestV257-323812954-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:09.228891 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-52152882-c754-447f-bcf9-0bbf4a5fe65e tempest-QuotasAdminTestV257-323812954 tempest-QuotasAdminTestV257-323812954-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:09.234239 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-52152882-c754-447f-bcf9-0bbf4a5fe65e tempest-QuotasAdminTestV257-323812954 tempest-QuotasAdminTestV257-323812954-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:09.235737 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-52152882-c754-447f-bcf9-0bbf4a5fe65e tempest-QuotasAdminTestV257-323812954 tempest-QuotasAdminTestV257-323812954-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:09.239134 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-52152882-c754-447f-bcf9-0bbf4a5fe65e tempest-QuotasAdminTestV257-323812954 tempest-QuotasAdminTestV257-323812954-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:09.310020 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-52152882-c754-447f-bcf9-0bbf4a5fe65e tempest-QuotasAdminTestV257-323812954 tempest-QuotasAdminTestV257-323812954-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:09.311135 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-52152882-c754-447f-bcf9-0bbf4a5fe65e tempest-QuotasAdminTestV257-323812954 tempest-QuotasAdminTestV257-323812954-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:09.311952 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-52152882-c754-447f-bcf9-0bbf4a5fe65e tempest-QuotasAdminTestV257-323812954 tempest-QuotasAdminTestV257-323812954-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:09.312951 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-52152882-c754-447f-bcf9-0bbf4a5fe65e tempest-QuotasAdminTestV257-323812954 tempest-QuotasAdminTestV257-323812954-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:09.313628 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-52152882-c754-447f-bcf9-0bbf4a5fe65e tempest-QuotasAdminTestV257-323812954 tempest-QuotasAdminTestV257-323812954-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:09.314827 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-52152882-c754-447f-bcf9-0bbf4a5fe65e tempest-QuotasAdminTestV257-323812954 tempest-QuotasAdminTestV257-323812954-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:09.407964 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-52152882-c754-447f-bcf9-0bbf4a5fe65e tempest-QuotasAdminTestV257-323812954 tempest-QuotasAdminTestV257-323812954-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/63a3d02829134e519689a7ef36c0e67e?user_id=5e6e65fe33694b17a602dde11533a7f9" status: 200 len: 148 microversion: 2.57 time: 0.379479 Sep 16 12:47:09.409061 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 246/502] 10.222.0.67 () {62 vars in 1384 bytes} [Fri Sep 16 12:47:09 2022] PUT /compute/v2.1/os-quota-sets/63a3d02829134e519689a7ef36c0e67e?user_id=5e6e65fe33694b17a602dde11533a7f9 => generated 148 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:47:09.415167 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-19f9f681-2171-499f-a92b-0b501971e069 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:09.416236 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-19f9f681-2171-499f-a92b-0b501971e069 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 07365fde-3701-46a6-aba7-4c6f74e181b9] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:09.419587 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:47:09.425683 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19f9f681-2171-499f-a92b-0b501971e069 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:09.426511 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19f9f681-2171-499f-a92b-0b501971e069 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:09.427199 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19f9f681-2171-499f-a92b-0b501971e069 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:09.428660 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19f9f681-2171-499f-a92b-0b501971e069 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:09.429349 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19f9f681-2171-499f-a92b-0b501971e069 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:09.430259 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19f9f681-2171-499f-a92b-0b501971e069 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:10.051990 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f68f48db-c00a-4f0c-910b-9b741cd95366 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0815c12c4340109ec1c379a0602322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20770fd1243d4412bfc90d2a079473bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:10.058547 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-19f9f681-2171-499f-a92b-0b501971e069 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709f71c239ca40b8b958038c9ab16f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7058e9e184834c39a5a299f481a6e62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:10.063428 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f68f48db-c00a-4f0c-910b-9b741cd95366 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "GET /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea" status: 200 len: 1469 microversion: 2.1 time: 0.947331 Sep 16 12:47:10.064062 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 257/503] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:09 2022] GET /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea => generated 1469 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:10.070028 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-898ac32e-374b-422d-b88f-a5734178bec4 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:10.074503 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-898ac32e-374b-422d-b88f-a5734178bec4 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] [instance: ad946bd5-7ee5-47d6-a52f-00e8511d2bd6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:10.084627 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-19f9f681-2171-499f-a92b-0b501971e069 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9" status: 200 len: 1391 microversion: 2.1 time: 0.673863 Sep 16 12:47:10.085860 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 247/504] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:09 2022] GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9 => generated 1391 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:10.090816 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7b15a1a0-6e7a-407e-904f-cdede3f653fd tempest-QuotasAdminTestV257-323812954 tempest-QuotasAdminTestV257-323812954-project-admin] Calling method '.version_select at 0x7f1036018ee0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:10.098484 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-898ac32e-374b-422d-b88f-a5734178bec4 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:10.098975 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-898ac32e-374b-422d-b88f-a5734178bec4 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:10.099406 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-898ac32e-374b-422d-b88f-a5734178bec4 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:10.100105 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-898ac32e-374b-422d-b88f-a5734178bec4 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:10.100924 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-898ac32e-374b-422d-b88f-a5734178bec4 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:10.101398 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-898ac32e-374b-422d-b88f-a5734178bec4 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:10.328794 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7b15a1a0-6e7a-407e-904f-cdede3f653fd tempest-QuotasAdminTestV257-323812954 tempest-QuotasAdminTestV257-323812954-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/63a3d02829134e519689a7ef36c0e67e?user_id=5e6e65fe33694b17a602dde11533a7f9" status: 200 len: 190 microversion: 2.57 time: 0.241559 Sep 16 12:47:10.329883 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 248/505] 10.222.0.67 () {60 vars in 1364 bytes} [Fri Sep 16 12:47:10 2022] GET /compute/v2.1/os-quota-sets/63a3d02829134e519689a7ef36c0e67e?user_id=5e6e65fe33694b17a602dde11533a7f9 => generated 190 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:47:10.335668 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-74b25920-1ee4-42b0-91cd-efb610a5821d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:10.336640 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-74b25920-1ee4-42b0-91cd-efb610a5821d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 566f231d-345e-4665-bf9a-b61004b954ed] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:10.345581 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-74b25920-1ee4-42b0-91cd-efb610a5821d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:10.346159 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-74b25920-1ee4-42b0-91cd-efb610a5821d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:10.346668 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-74b25920-1ee4-42b0-91cd-efb610a5821d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:10.347605 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-74b25920-1ee4-42b0-91cd-efb610a5821d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:10.348156 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-74b25920-1ee4-42b0-91cd-efb610a5821d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:10.348754 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-74b25920-1ee4-42b0-91cd-efb610a5821d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:10.368728 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-898ac32e-374b-422d-b88f-a5734178bec4 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318566be918e44a4894403f766cbd5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4b83da544e4980b1c2fe2b1f597016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:10.389722 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-898ac32e-374b-422d-b88f-a5734178bec4 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] 10.222.0.67 "GET /compute/v2.1/servers/ad946bd5-7ee5-47d6-a52f-00e8511d2bd6" status: 200 len: 1281 microversion: 2.1 time: 0.322991 Sep 16 12:47:10.391510 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 258/506] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:10 2022] GET /compute/v2.1/servers/ad946bd5-7ee5-47d6-a52f-00e8511d2bd6 => generated 1281 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:10.403868 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5180acc8-376e-493c-88c3-460199d9024b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:10.404711 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5180acc8-376e-493c-88c3-460199d9024b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: e01ba46f-ddd1-47ae-90d9-4a187bf51b2b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:10.413539 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5180acc8-376e-493c-88c3-460199d9024b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:10.414167 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5180acc8-376e-493c-88c3-460199d9024b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:10.415448 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5180acc8-376e-493c-88c3-460199d9024b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:10.416804 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5180acc8-376e-493c-88c3-460199d9024b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:10.417828 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5180acc8-376e-493c-88c3-460199d9024b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:10.418837 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5180acc8-376e-493c-88c3-460199d9024b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:10.520766 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-74b25920-1ee4-42b0-91cd-efb610a5821d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:10.531619 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-74b25920-1ee4-42b0-91cd-efb610a5821d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed" status: 200 len: 1263 microversion: 2.1 time: 0.200326 Sep 16 12:47:10.535316 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 249/507] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:10 2022] GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed => generated 1263 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:10.784983 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5180acc8-376e-493c-88c3-460199d9024b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:10.794870 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5180acc8-376e-493c-88c3-460199d9024b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/e01ba46f-ddd1-47ae-90d9-4a187bf51b2b" status: 200 len: 1314 microversion: 2.1 time: 0.400497 Sep 16 12:47:10.798940 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 259/508] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:10 2022] GET /compute/v2.1/servers/e01ba46f-ddd1-47ae-90d9-4a187bf51b2b => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:11.091718 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6fda3188-7e54-4400-b130-49cfb45b04ee tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:11.092436 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6fda3188-7e54-4400-b130-49cfb45b04ee tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: cbbaed5d-b861-4f03-a39b-c384175b92ea] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:11.105391 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6fda3188-7e54-4400-b130-49cfb45b04ee tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:11.106378 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6fda3188-7e54-4400-b130-49cfb45b04ee tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:11.106834 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6fda3188-7e54-4400-b130-49cfb45b04ee tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:11.107571 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6fda3188-7e54-4400-b130-49cfb45b04ee tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:11.108032 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6fda3188-7e54-4400-b130-49cfb45b04ee tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:11.113515 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b63f38d4-807d-4f93-9ab4-578747fa1929 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:11.114478 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b63f38d4-807d-4f93-9ab4-578747fa1929 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 07365fde-3701-46a6-aba7-4c6f74e181b9] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:11.116857 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6fda3188-7e54-4400-b130-49cfb45b04ee tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:11.136731 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b63f38d4-807d-4f93-9ab4-578747fa1929 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:11.137538 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b63f38d4-807d-4f93-9ab4-578747fa1929 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:11.141021 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b63f38d4-807d-4f93-9ab4-578747fa1929 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:11.147395 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b63f38d4-807d-4f93-9ab4-578747fa1929 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:11.148909 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b63f38d4-807d-4f93-9ab4-578747fa1929 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:11.154799 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b63f38d4-807d-4f93-9ab4-578747fa1929 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:11.832828 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b63f38d4-807d-4f93-9ab4-578747fa1929 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709f71c239ca40b8b958038c9ab16f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7058e9e184834c39a5a299f481a6e62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:11.841133 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b63f38d4-807d-4f93-9ab4-578747fa1929 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9" status: 200 len: 1391 microversion: 2.1 time: 0.733812 Sep 16 12:47:11.842493 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 260/509] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:11 2022] GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9 => generated 1391 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:47:11.848064 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1708f556-b924-473f-9232-b25d5ece0a03 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:11.854537 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1708f556-b924-473f-9232-b25d5ece0a03 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] [instance: ad946bd5-7ee5-47d6-a52f-00e8511d2bd6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:11.862052 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1708f556-b924-473f-9232-b25d5ece0a03 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:11.862829 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1708f556-b924-473f-9232-b25d5ece0a03 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:11.863504 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1708f556-b924-473f-9232-b25d5ece0a03 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:11.864467 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1708f556-b924-473f-9232-b25d5ece0a03 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:11.865129 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1708f556-b924-473f-9232-b25d5ece0a03 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:11.865761 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1708f556-b924-473f-9232-b25d5ece0a03 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:11.888894 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6fda3188-7e54-4400-b130-49cfb45b04ee tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0815c12c4340109ec1c379a0602322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20770fd1243d4412bfc90d2a079473bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:11.906668 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6fda3188-7e54-4400-b130-49cfb45b04ee tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "GET /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea" status: 200 len: 1469 microversion: 2.1 time: 0.819590 Sep 16 12:47:11.909358 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 250/510] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:11 2022] GET /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea => generated 1469 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:11.922909 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0f5f9df7-3ccb-46c5-967d-accb6fa7c361 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:11.924113 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0f5f9df7-3ccb-46c5-967d-accb6fa7c361 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 566f231d-345e-4665-bf9a-b61004b954ed] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:11.933357 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0f5f9df7-3ccb-46c5-967d-accb6fa7c361 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:11.934134 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0f5f9df7-3ccb-46c5-967d-accb6fa7c361 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:11.934729 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0f5f9df7-3ccb-46c5-967d-accb6fa7c361 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:11.935691 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0f5f9df7-3ccb-46c5-967d-accb6fa7c361 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:11.936346 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0f5f9df7-3ccb-46c5-967d-accb6fa7c361 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:11.936923 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0f5f9df7-3ccb-46c5-967d-accb6fa7c361 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:12.098079 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0f5f9df7-3ccb-46c5-967d-accb6fa7c361 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:12.114847 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0f5f9df7-3ccb-46c5-967d-accb6fa7c361 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed" status: 200 len: 1269 microversion: 2.1 time: 0.202640 Sep 16 12:47:12.118302 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 251/511] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:11 2022] GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed => generated 1269 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:12.124888 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6182bbf6-a85c-491f-ac01-397002c7a67c tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:12.126328 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6182bbf6-a85c-491f-ac01-397002c7a67c tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: e01ba46f-ddd1-47ae-90d9-4a187bf51b2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:12.135406 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6182bbf6-a85c-491f-ac01-397002c7a67c tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:12.136683 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6182bbf6-a85c-491f-ac01-397002c7a67c tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:12.137689 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6182bbf6-a85c-491f-ac01-397002c7a67c tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:12.139678 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6182bbf6-a85c-491f-ac01-397002c7a67c tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:12.147115 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6182bbf6-a85c-491f-ac01-397002c7a67c tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:12.149668 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6182bbf6-a85c-491f-ac01-397002c7a67c tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:12.391235 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1708f556-b924-473f-9232-b25d5ece0a03 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318566be918e44a4894403f766cbd5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4b83da544e4980b1c2fe2b1f597016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:12.395617 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:47:12.409188 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1708f556-b924-473f-9232-b25d5ece0a03 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] 10.222.0.67 "GET /compute/v2.1/servers/ad946bd5-7ee5-47d6-a52f-00e8511d2bd6" status: 200 len: 1323 microversion: 2.1 time: 0.565316 Sep 16 12:47:12.410020 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 261/512] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:11 2022] GET /compute/v2.1/servers/ad946bd5-7ee5-47d6-a52f-00e8511d2bd6 => generated 1323 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:12.598289 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6182bbf6-a85c-491f-ac01-397002c7a67c tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:12.606411 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6182bbf6-a85c-491f-ac01-397002c7a67c tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/e01ba46f-ddd1-47ae-90d9-4a187bf51b2b" status: 200 len: 1314 microversion: 2.1 time: 0.486655 Sep 16 12:47:12.607096 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 252/513] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:12 2022] GET /compute/v2.1/servers/e01ba46f-ddd1-47ae-90d9-4a187bf51b2b => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:12.874692 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-65659fbe-74d1-4ad4-83ae-f466742f568f tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:12.875431 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-65659fbe-74d1-4ad4-83ae-f466742f568f tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 07365fde-3701-46a6-aba7-4c6f74e181b9] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:12.890229 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65659fbe-74d1-4ad4-83ae-f466742f568f tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:12.895760 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65659fbe-74d1-4ad4-83ae-f466742f568f tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:12.896167 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65659fbe-74d1-4ad4-83ae-f466742f568f tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:12.896911 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65659fbe-74d1-4ad4-83ae-f466742f568f tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:12.897583 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65659fbe-74d1-4ad4-83ae-f466742f568f tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:12.898359 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65659fbe-74d1-4ad4-83ae-f466742f568f tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:12.937290 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1ccd54cd-371b-4121-b121-40c0f50062e0 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:12.938144 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-1ccd54cd-371b-4121-b121-40c0f50062e0 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: cbbaed5d-b861-4f03-a39b-c384175b92ea] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:12.955156 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1ccd54cd-371b-4121-b121-40c0f50062e0 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:12.956264 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1ccd54cd-371b-4121-b121-40c0f50062e0 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:12.958060 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1ccd54cd-371b-4121-b121-40c0f50062e0 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:12.959714 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1ccd54cd-371b-4121-b121-40c0f50062e0 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:12.962467 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1ccd54cd-371b-4121-b121-40c0f50062e0 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:12.964197 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1ccd54cd-371b-4121-b121-40c0f50062e0 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:13.525207 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-65659fbe-74d1-4ad4-83ae-f466742f568f tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709f71c239ca40b8b958038c9ab16f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7058e9e184834c39a5a299f481a6e62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:13.539311 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-65659fbe-74d1-4ad4-83ae-f466742f568f tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9" status: 200 len: 1391 microversion: 2.1 time: 0.671683 Sep 16 12:47:13.549712 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 262/514] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:12 2022] GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9 => generated 1391 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:13.568553 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1ccd54cd-371b-4121-b121-40c0f50062e0 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0815c12c4340109ec1c379a0602322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20770fd1243d4412bfc90d2a079473bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:13.570719 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=100 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:47:13.579726 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-d56e8983-6d3d-4473-b6e5-b9b81d6d9d29 req-9be9fc31-c46a-48ec-817d-e3d1e1d9a556 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e01ba46f-ddd1-47ae-90d9-4a187bf51b2b", "name": "network-vif-plugged", "status": "completed", "tag": "a6fb319f-c3cf-4120-b2c2-c32144451c45"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:13.581773 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1ccd54cd-371b-4121-b121-40c0f50062e0 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "GET /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea" status: 200 len: 1469 microversion: 2.1 time: 0.649502 Sep 16 12:47:13.587633 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 253/515] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:12 2022] GET /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea => generated 1469 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:13.611165 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9a39f115-cfd1-4d93-a30e-b325bdc1253f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:13.614899 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9a39f115-cfd1-4d93-a30e-b325bdc1253f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 566f231d-345e-4665-bf9a-b61004b954ed] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:13.619198 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d56e8983-6d3d-4473-b6e5-b9b81d6d9d29 req-9be9fc31-c46a-48ec-817d-e3d1e1d9a556 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:13.619873 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d56e8983-6d3d-4473-b6e5-b9b81d6d9d29 req-9be9fc31-c46a-48ec-817d-e3d1e1d9a556 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:13.620899 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d56e8983-6d3d-4473-b6e5-b9b81d6d9d29 req-9be9fc31-c46a-48ec-817d-e3d1e1d9a556 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:13.627714 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9a39f115-cfd1-4d93-a30e-b325bdc1253f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:13.628238 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9a39f115-cfd1-4d93-a30e-b325bdc1253f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:13.631000 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9a39f115-cfd1-4d93-a30e-b325bdc1253f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:13.633813 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9a39f115-cfd1-4d93-a30e-b325bdc1253f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:13.636043 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9a39f115-cfd1-4d93-a30e-b325bdc1253f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:13.636715 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9a39f115-cfd1-4d93-a30e-b325bdc1253f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:13.638281 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-d56e8983-6d3d-4473-b6e5-b9b81d6d9d29 req-9be9fc31-c46a-48ec-817d-e3d1e1d9a556 service nova] Creating event network-vif-plugged:a6fb319f-c3cf-4120-b2c2-c32144451c45 for instance e01ba46f-ddd1-47ae-90d9-4a187bf51b2b on n-h2-858094-4 Sep 16 12:47:13.645936 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-d56e8983-6d3d-4473-b6e5-b9b81d6d9d29 req-9be9fc31-c46a-48ec-817d-e3d1e1d9a556 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094653 Sep 16 12:47:13.647148 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 263/516] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:47:13.654846 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7c084368-4d80-4e76-8299-4e9a14e52706 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:13.656017 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7c084368-4d80-4e76-8299-4e9a14e52706 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] [instance: ad946bd5-7ee5-47d6-a52f-00e8511d2bd6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:13.665219 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c084368-4d80-4e76-8299-4e9a14e52706 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:13.665967 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c084368-4d80-4e76-8299-4e9a14e52706 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:13.667208 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c084368-4d80-4e76-8299-4e9a14e52706 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:13.668542 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c084368-4d80-4e76-8299-4e9a14e52706 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:13.669355 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c084368-4d80-4e76-8299-4e9a14e52706 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:13.670005 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c084368-4d80-4e76-8299-4e9a14e52706 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:14.073643 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9a39f115-cfd1-4d93-a30e-b325bdc1253f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:14.094502 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9a39f115-cfd1-4d93-a30e-b325bdc1253f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed" status: 200 len: 1269 microversion: 2.1 time: 0.505422 Sep 16 12:47:14.098142 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 254/517] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:13 2022] GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed => generated 1269 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:14.112769 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-0e9c6b82-ca15-4733-a6c8-55719ee68c14 req-fd6832b1-bcc2-4a10-8b69-276c7d76f812 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbbaed5d-b861-4f03-a39b-c384175b92ea", "name": "network-vif-deleted", "tag": "91c7636f-22ac-48c6-a666-8fef6f5cae01"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:14.134424 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-0e9c6b82-ca15-4733-a6c8-55719ee68c14 req-fd6832b1-bcc2-4a10-8b69-276c7d76f812 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:14.135337 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-0e9c6b82-ca15-4733-a6c8-55719ee68c14 req-fd6832b1-bcc2-4a10-8b69-276c7d76f812 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:14.137128 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-0e9c6b82-ca15-4733-a6c8-55719ee68c14 req-fd6832b1-bcc2-4a10-8b69-276c7d76f812 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:14.183540 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-0e9c6b82-ca15-4733-a6c8-55719ee68c14 req-fd6832b1-bcc2-4a10-8b69-276c7d76f812 service nova] Creating event network-vif-deleted:91c7636f-22ac-48c6-a666-8fef6f5cae01 for instance cbbaed5d-b861-4f03-a39b-c384175b92ea on n-h2-858094-4 Sep 16 12:47:14.193387 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-0e9c6b82-ca15-4733-a6c8-55719ee68c14 req-fd6832b1-bcc2-4a10-8b69-276c7d76f812 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093007 Sep 16 12:47:14.194828 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 255/518] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:47:14.203454 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-43764837-30ac-4b3c-bf21-fda57f96d1b6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:14.204518 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-43764837-30ac-4b3c-bf21-fda57f96d1b6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: e01ba46f-ddd1-47ae-90d9-4a187bf51b2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:14.211718 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-43764837-30ac-4b3c-bf21-fda57f96d1b6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:14.212593 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-43764837-30ac-4b3c-bf21-fda57f96d1b6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:14.213247 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-43764837-30ac-4b3c-bf21-fda57f96d1b6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:14.214182 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-43764837-30ac-4b3c-bf21-fda57f96d1b6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:14.214841 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-43764837-30ac-4b3c-bf21-fda57f96d1b6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:14.215521 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-43764837-30ac-4b3c-bf21-fda57f96d1b6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:14.508176 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7c084368-4d80-4e76-8299-4e9a14e52706 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318566be918e44a4894403f766cbd5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4b83da544e4980b1c2fe2b1f597016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:14.543256 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7c084368-4d80-4e76-8299-4e9a14e52706 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] 10.222.0.67 "GET /compute/v2.1/servers/ad946bd5-7ee5-47d6-a52f-00e8511d2bd6" status: 200 len: 1323 microversion: 2.1 time: 0.894429 Sep 16 12:47:14.561658 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 264/519] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:13 2022] GET /compute/v2.1/servers/ad946bd5-7ee5-47d6-a52f-00e8511d2bd6 => generated 1323 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:14.572204 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-7f74f1a0-b904-43ab-b7a2-1c60ea929c78 req-50bf4be5-5f72-497b-bf77-3ee9407de214 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad946bd5-7ee5-47d6-a52f-00e8511d2bd6", "tag": "f1d9e429-3d16-4f88-85c5-b9622e90e851"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:14.599264 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7f74f1a0-b904-43ab-b7a2-1c60ea929c78 req-50bf4be5-5f72-497b-bf77-3ee9407de214 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:14.599720 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7f74f1a0-b904-43ab-b7a2-1c60ea929c78 req-50bf4be5-5f72-497b-bf77-3ee9407de214 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:14.604928 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7f74f1a0-b904-43ab-b7a2-1c60ea929c78 req-50bf4be5-5f72-497b-bf77-3ee9407de214 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:14.636914 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-7f74f1a0-b904-43ab-b7a2-1c60ea929c78 req-50bf4be5-5f72-497b-bf77-3ee9407de214 service nova] Creating event network-changed:f1d9e429-3d16-4f88-85c5-b9622e90e851 for instance ad946bd5-7ee5-47d6-a52f-00e8511d2bd6 on n-h1-858094-4 Sep 16 12:47:14.642821 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-7f74f1a0-b904-43ab-b7a2-1c60ea929c78 req-50bf4be5-5f72-497b-bf77-3ee9407de214 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077139 Sep 16 12:47:14.643904 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 265/520] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:47:14.650075 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9e2cc949-534b-4af4-8e2c-29b8f77876ea tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:14.650964 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9e2cc949-534b-4af4-8e2c-29b8f77876ea tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 07365fde-3701-46a6-aba7-4c6f74e181b9] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:14.658149 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e2cc949-534b-4af4-8e2c-29b8f77876ea tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:14.659219 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e2cc949-534b-4af4-8e2c-29b8f77876ea tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:14.659840 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e2cc949-534b-4af4-8e2c-29b8f77876ea tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:14.660741 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e2cc949-534b-4af4-8e2c-29b8f77876ea tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:14.661350 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e2cc949-534b-4af4-8e2c-29b8f77876ea tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:14.661959 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e2cc949-534b-4af4-8e2c-29b8f77876ea tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:15.184771 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-43764837-30ac-4b3c-bf21-fda57f96d1b6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:15.198711 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-43764837-30ac-4b3c-bf21-fda57f96d1b6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/e01ba46f-ddd1-47ae-90d9-4a187bf51b2b" status: 200 len: 1314 microversion: 2.1 time: 1.002269 Sep 16 12:47:15.200260 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 256/521] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:14 2022] GET /compute/v2.1/servers/e01ba46f-ddd1-47ae-90d9-4a187bf51b2b => generated 1314 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:15.209419 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d92da5af-c31b-4022-a635-85785fdedc42 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:15.210313 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d92da5af-c31b-4022-a635-85785fdedc42 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: cbbaed5d-b861-4f03-a39b-c384175b92ea] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:15.220884 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d92da5af-c31b-4022-a635-85785fdedc42 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:15.222015 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d92da5af-c31b-4022-a635-85785fdedc42 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:15.222664 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d92da5af-c31b-4022-a635-85785fdedc42 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:15.223617 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d92da5af-c31b-4022-a635-85785fdedc42 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:15.224303 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d92da5af-c31b-4022-a635-85785fdedc42 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:15.224925 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d92da5af-c31b-4022-a635-85785fdedc42 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:15.249134 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-d92da5af-c31b-4022-a635-85785fdedc42 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] HTTP exception thrown: Instance cbbaed5d-b861-4f03-a39b-c384175b92ea could not be found. Sep 16 12:47:15.253859 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d92da5af-c31b-4022-a635-85785fdedc42 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Request method failure captured: Sep 16 12:47:15.253859 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea HTTP/1.1 Sep 16 12:47:15.253859 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:47:15.253859 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:47:15.253859 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:47:15.253859 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:47:15.253859 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:47:15.253859 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:47:15.253859 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:47:15.253859 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:47:15.253859 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHAJ530-wA71OqVDzXwX20qeD3P8ISpOIY6mCpf35_0vF0--4ok3DLook9UxDdLtLZJZ03M86Fq58v6JfwpLPYRkiiFLKtvlABPXO1tV7E2HpYKwNusTFUePrtHLJwdfkDuxh3aJfBGjrWJmBgYfPy_yf_nQyrjvPl4HmF0thaKh-tE Sep 16 12:47:15.253859 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:47:15.253859 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:47:15.253859 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:47:15.253859 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:47:15.253859 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:47:15.253859 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:47:15.253859 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 20770fd1243d4412bfc90d2a079473bd Sep 16 12:47:15.253859 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1917704830 Sep 16 12:47:15.253859 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:47:15.253859 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:47:15.255937 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/20770fd1243d4412bfc90d2a079473bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/20770fd1243d4412bfc90d2a079473bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_20770fd1243d4412bfc90d2a079473bd", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/20770fd1243d4412bfc90d2a079473bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:47:15.255937 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1917704830 Sep 16 12:47:15.255937 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 20770fd1243d4412bfc90d2a079473bd Sep 16 12:47:15.255937 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1917704830 Sep 16 12:47:15.255937 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ServersAdminNegativeTestJSON-1917704830-project Sep 16 12:47:15.255937 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:47:15.255937 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:47:15.255937 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 7b0815c12c4340109ec1c379a0602322 Sep 16 12:47:15.255937 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1917704830-project Sep 16 12:47:15.255937 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:47:15.255937 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance cbbaed5d-b861-4f03-a39b-c384175b92ea could not be found. Sep 16 12:47:15.255937 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'cbbaed5d-b861-4f03-a39b-c384175b92ea'} Sep 16 12:47:15.257654 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:47:15.257654 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:47:15.257654 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:47:15.257654 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:47:15.257654 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:47:15.257654 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:47:15.257654 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:47:15.257654 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:47:15.257654 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:47:15.257654 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:47:15.257654 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbbaed5d-b861-4f03-a39b-c384175b92ea could not be found. Sep 16 12:47:15.257654 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:47:15.257654 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:47:15.257654 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:47:15.257654 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:47:15.257654 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:47:15.257654 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:47:15.257654 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:47:15.257654 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:47:15.257654 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:47:15.259100 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:47:15.259100 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:47:15.259100 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:47:15.259100 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:47:15.259100 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:47:15.259100 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:47:15.259100 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:47:15.259100 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbbaed5d-b861-4f03-a39b-c384175b92ea could not be found. Sep 16 12:47:15.259100 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:47:15.259100 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:47:15.259100 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:47:15.259100 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:47:15.259100 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:47:15.259100 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:47:15.259100 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:47:15.259100 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:47:15.259100 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbbaed5d-b861-4f03-a39b-c384175b92ea could not be found. Sep 16 12:47:15.259100 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:47:15.261238 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d92da5af-c31b-4022-a635-85785fdedc42 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Returning 404 to user: Instance cbbaed5d-b861-4f03-a39b-c384175b92ea could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:47:15.261812 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d92da5af-c31b-4022-a635-85785fdedc42 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "GET /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea" status: 404 len: 111 microversion: 2.1 time: 0.059713 Sep 16 12:47:15.262383 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 257/522] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:15 2022] GET /compute/v2.1/servers/cbbaed5d-b861-4f03-a39b-c384175b92ea => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:47:15.275891 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-da05bd18-c92d-4d59-a300-56719f600656 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:15.276523 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-da05bd18-c92d-4d59-a300-56719f600656 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 566f231d-345e-4665-bf9a-b61004b954ed] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:15.284095 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-da05bd18-c92d-4d59-a300-56719f600656 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:15.284352 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-da05bd18-c92d-4d59-a300-56719f600656 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:15.284666 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-da05bd18-c92d-4d59-a300-56719f600656 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:15.285745 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-da05bd18-c92d-4d59-a300-56719f600656 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:15.285964 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-da05bd18-c92d-4d59-a300-56719f600656 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:15.286215 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-da05bd18-c92d-4d59-a300-56719f600656 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:15.385264 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9e2cc949-534b-4af4-8e2c-29b8f77876ea tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709f71c239ca40b8b958038c9ab16f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7058e9e184834c39a5a299f481a6e62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:15.397631 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9e2cc949-534b-4af4-8e2c-29b8f77876ea tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9" status: 200 len: 1391 microversion: 2.1 time: 0.752125 Sep 16 12:47:15.415604 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 266/523] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:14 2022] GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9 => generated 1391 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:15.421769 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-04482514-9fb3-40df-b6ad-6d6a4623ff1f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:15.422461 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-04482514-9fb3-40df-b6ad-6d6a4623ff1f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: 4d860eb6-336f-4ba4-be81-d1ec6fecc87b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:15.430257 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04482514-9fb3-40df-b6ad-6d6a4623ff1f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:15.430988 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04482514-9fb3-40df-b6ad-6d6a4623ff1f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:15.431639 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04482514-9fb3-40df-b6ad-6d6a4623ff1f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:15.432617 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04482514-9fb3-40df-b6ad-6d6a4623ff1f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:15.433214 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04482514-9fb3-40df-b6ad-6d6a4623ff1f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:15.433847 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04482514-9fb3-40df-b6ad-6d6a4623ff1f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:15.474740 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-04482514-9fb3-40df-b6ad-6d6a4623ff1f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: 4d860eb6-336f-4ba4-be81-d1ec6fecc87b] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:47:15.592544 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-04482514-9fb3-40df-b6ad-6d6a4623ff1f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b" status: 204 len: 0 microversion: 2.1 time: 0.175148 Sep 16 12:47:15.594857 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 267/524] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:47:15 2022] DELETE /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:47:15.776160 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-162b262b-7d69-4b08-b274-417c1ba251dc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-514230687", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:15.801091 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:47:15.820406 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-da05bd18-c92d-4d59-a300-56719f600656 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:15.834496 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-da05bd18-c92d-4d59-a300-56719f600656 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed" status: 200 len: 1311 microversion: 2.1 time: 0.571028 Sep 16 12:47:15.835236 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 258/525] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:15 2022] GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed => generated 1311 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:15.840111 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-66437101-8e0c-414a-a2db-4c240e6a574e tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:15.840750 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-66437101-8e0c-414a-a2db-4c240e6a574e tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] [instance: ad946bd5-7ee5-47d6-a52f-00e8511d2bd6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:15.860085 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-66437101-8e0c-414a-a2db-4c240e6a574e tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:15.861335 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-66437101-8e0c-414a-a2db-4c240e6a574e tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:15.861780 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-66437101-8e0c-414a-a2db-4c240e6a574e tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:15.862497 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-66437101-8e0c-414a-a2db-4c240e6a574e tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:15.862955 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-66437101-8e0c-414a-a2db-4c240e6a574e tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:15.863385 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-66437101-8e0c-414a-a2db-4c240e6a574e tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:15.871400 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-162b262b-7d69-4b08-b274-417c1ba251dc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] validate_networks() for None {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:47:16.293259 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-66437101-8e0c-414a-a2db-4c240e6a574e tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318566be918e44a4894403f766cbd5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4b83da544e4980b1c2fe2b1f597016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:16.305260 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-66437101-8e0c-414a-a2db-4c240e6a574e tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] 10.222.0.67 "GET /compute/v2.1/servers/ad946bd5-7ee5-47d6-a52f-00e8511d2bd6" status: 200 len: 1323 microversion: 2.1 time: 0.467412 Sep 16 12:47:16.306241 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 259/526] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:15 2022] GET /compute/v2.1/servers/ad946bd5-7ee5-47d6-a52f-00e8511d2bd6 => generated 1323 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:16.321902 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-85d454f5-a96e-4bb8-9069-7699d9f369dd tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:16.324550 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-85d454f5-a96e-4bb8-9069-7699d9f369dd tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: 4d860eb6-336f-4ba4-be81-d1ec6fecc87b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:16.339806 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-85d454f5-a96e-4bb8-9069-7699d9f369dd tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:16.340566 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-85d454f5-a96e-4bb8-9069-7699d9f369dd tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:16.341085 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-85d454f5-a96e-4bb8-9069-7699d9f369dd tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:16.341884 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-85d454f5-a96e-4bb8-9069-7699d9f369dd tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:16.342260 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-162b262b-7d69-4b08-b274-417c1ba251dc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:47:16.342698 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-162b262b-7d69-4b08-b274-417c1ba251dc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:47:16.342917 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-85d454f5-a96e-4bb8-9069-7699d9f369dd tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:16.343177 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-162b262b-7d69-4b08-b274-417c1ba251dc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:47:16.343592 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-162b262b-7d69-4b08-b274-417c1ba251dc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:47:16.344006 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-162b262b-7d69-4b08-b274-417c1ba251dc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:47:16.344161 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-85d454f5-a96e-4bb8-9069-7699d9f369dd tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:16.362911 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-162b262b-7d69-4b08-b274-417c1ba251dc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:16.363523 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-162b262b-7d69-4b08-b274-417c1ba251dc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:16.363835 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-162b262b-7d69-4b08-b274-417c1ba251dc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:16.364593 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-162b262b-7d69-4b08-b274-417c1ba251dc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:16.365054 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-162b262b-7d69-4b08-b274-417c1ba251dc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:16.365483 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-162b262b-7d69-4b08-b274-417c1ba251dc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:16.417934 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-162b262b-7d69-4b08-b274-417c1ba251dc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Getting quotas for project 0b18ec5302634d2a95e51547e0019d40. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:47:16.430151 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-162b262b-7d69-4b08-b274-417c1ba251dc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Getting quotas for user f3e2827a76d14e4a88c4562f1c0351ac and project 0b18ec5302634d2a95e51547e0019d40. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:47:16.458957 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-162b262b-7d69-4b08-b274-417c1ba251dc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:47:16.463186 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-162b262b-7d69-4b08-b274-417c1ba251dc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: efea200a-0b78-42de-a9e2-febab9817590] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:47:16.533380 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-162b262b-7d69-4b08-b274-417c1ba251dc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.936238 Sep 16 12:47:16.534946 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 268/527] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:47:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:47:16.544746 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-3c11979f-b9a9-47cb-abc1-4e583f0ec0b3 req-22137702-8695-4d30-ba58-11b962aaa878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07365fde-3701-46a6-aba7-4c6f74e181b9", "name": "network-vif-plugged", "status": "completed", "tag": "57df8d9f-a9ff-49ba-a0ec-5581bc6e7cb6"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:16.559327 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3c11979f-b9a9-47cb-abc1-4e583f0ec0b3 req-22137702-8695-4d30-ba58-11b962aaa878 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:16.560080 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3c11979f-b9a9-47cb-abc1-4e583f0ec0b3 req-22137702-8695-4d30-ba58-11b962aaa878 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:16.560693 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3c11979f-b9a9-47cb-abc1-4e583f0ec0b3 req-22137702-8695-4d30-ba58-11b962aaa878 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:16.572094 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-85d454f5-a96e-4bb8-9069-7699d9f369dd tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0815c12c4340109ec1c379a0602322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20770fd1243d4412bfc90d2a079473bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:16.574272 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-3c11979f-b9a9-47cb-abc1-4e583f0ec0b3 req-22137702-8695-4d30-ba58-11b962aaa878 service nova] Creating event network-vif-plugged:57df8d9f-a9ff-49ba-a0ec-5581bc6e7cb6 for instance 07365fde-3701-46a6-aba7-4c6f74e181b9 on n-h1-858094-4 Sep 16 12:47:16.583442 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-3c11979f-b9a9-47cb-abc1-4e583f0ec0b3 req-22137702-8695-4d30-ba58-11b962aaa878 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046826 Sep 16 12:47:16.586543 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 269/528] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:47:16.594939 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-a2cfc229-5b0d-4352-8040-cdf9525b291c req-066deb44-b546-4dc4-9b3b-1f7594864dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "566f231d-345e-4665-bf9a-b61004b954ed", "tag": "924f27c6-9b29-461f-bbff-57520beb8e29"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:16.598668 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-85d454f5-a96e-4bb8-9069-7699d9f369dd tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b" status: 200 len: 1477 microversion: 2.1 time: 0.276814 Sep 16 12:47:16.599547 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 260/529] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:16 2022] GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b => generated 1477 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:16.606872 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2090f836-3e1d-4c7b-a5ec-66ce2e2b239b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:16.607405 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-2090f836-3e1d-4c7b-a5ec-66ce2e2b239b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: e01ba46f-ddd1-47ae-90d9-4a187bf51b2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:16.622738 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a2cfc229-5b0d-4352-8040-cdf9525b291c req-066deb44-b546-4dc4-9b3b-1f7594864dd2 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:16.623151 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2090f836-3e1d-4c7b-a5ec-66ce2e2b239b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:16.623266 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a2cfc229-5b0d-4352-8040-cdf9525b291c req-066deb44-b546-4dc4-9b3b-1f7594864dd2 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:16.623644 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a2cfc229-5b0d-4352-8040-cdf9525b291c req-066deb44-b546-4dc4-9b3b-1f7594864dd2 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:16.623759 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2090f836-3e1d-4c7b-a5ec-66ce2e2b239b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:16.624073 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2090f836-3e1d-4c7b-a5ec-66ce2e2b239b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:16.624792 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2090f836-3e1d-4c7b-a5ec-66ce2e2b239b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:16.625239 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2090f836-3e1d-4c7b-a5ec-66ce2e2b239b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:16.625650 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2090f836-3e1d-4c7b-a5ec-66ce2e2b239b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:16.637854 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-a2cfc229-5b0d-4352-8040-cdf9525b291c req-066deb44-b546-4dc4-9b3b-1f7594864dd2 service nova] Creating event network-changed:924f27c6-9b29-461f-bbff-57520beb8e29 for instance 566f231d-345e-4665-bf9a-b61004b954ed on n-h2-858094-4 Sep 16 12:47:16.644654 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-a2cfc229-5b0d-4352-8040-cdf9525b291c req-066deb44-b546-4dc4-9b3b-1f7594864dd2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056280 Sep 16 12:47:16.646111 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 270/530] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:47:16.651750 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-eabdbcd5-e865-47e7-9014-bd463c3a4077 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:16.652563 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-eabdbcd5-e865-47e7-9014-bd463c3a4077 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 07365fde-3701-46a6-aba7-4c6f74e181b9] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:16.660084 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eabdbcd5-e865-47e7-9014-bd463c3a4077 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:16.660882 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eabdbcd5-e865-47e7-9014-bd463c3a4077 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:16.661648 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eabdbcd5-e865-47e7-9014-bd463c3a4077 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:16.662621 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eabdbcd5-e865-47e7-9014-bd463c3a4077 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:16.663609 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eabdbcd5-e865-47e7-9014-bd463c3a4077 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:16.664403 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eabdbcd5-e865-47e7-9014-bd463c3a4077 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:16.960300 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-2090f836-3e1d-4c7b-a5ec-66ce2e2b239b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:16.972275 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-eabdbcd5-e865-47e7-9014-bd463c3a4077 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709f71c239ca40b8b958038c9ab16f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7058e9e184834c39a5a299f481a6e62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:16.975391 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2090f836-3e1d-4c7b-a5ec-66ce2e2b239b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/e01ba46f-ddd1-47ae-90d9-4a187bf51b2b" status: 200 len: 1464 microversion: 2.1 time: 0.370599 Sep 16 12:47:16.977521 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 261/531] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:16 2022] GET /compute/v2.1/servers/e01ba46f-ddd1-47ae-90d9-4a187bf51b2b => generated 1464 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:16.988261 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c9787e9a-e22d-4a70-98a4-5f27c29b1ccf tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:16.991303 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c9787e9a-e22d-4a70-98a4-5f27c29b1ccf tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: efea200a-0b78-42de-a9e2-febab9817590] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:16.998034 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-eabdbcd5-e865-47e7-9014-bd463c3a4077 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9" status: 200 len: 1391 microversion: 2.1 time: 0.350557 Sep 16 12:47:17.018411 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 271/532] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:16 2022] GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9 => generated 1391 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:17.025062 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-62e7c7a3-0f3d-4fb0-9bb7-da4dd4d8f890 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:17.025948 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-62e7c7a3-0f3d-4fb0-9bb7-da4dd4d8f890 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 566f231d-345e-4665-bf9a-b61004b954ed] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:17.035438 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62e7c7a3-0f3d-4fb0-9bb7-da4dd4d8f890 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:17.036083 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62e7c7a3-0f3d-4fb0-9bb7-da4dd4d8f890 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:17.037011 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62e7c7a3-0f3d-4fb0-9bb7-da4dd4d8f890 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:17.038389 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62e7c7a3-0f3d-4fb0-9bb7-da4dd4d8f890 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:17.038912 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62e7c7a3-0f3d-4fb0-9bb7-da4dd4d8f890 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:17.039408 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62e7c7a3-0f3d-4fb0-9bb7-da4dd4d8f890 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:17.106181 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c9787e9a-e22d-4a70-98a4-5f27c29b1ccf tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:17.108600 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=90 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:47:17.117582 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c9787e9a-e22d-4a70-98a4-5f27c29b1ccf tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590" status: 200 len: 1212 microversion: 2.1 time: 0.138855 Sep 16 12:47:17.118501 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 262/533] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:16 2022] GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590 => generated 1212 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:17.241829 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-62e7c7a3-0f3d-4fb0-9bb7-da4dd4d8f890 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:17.252895 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-62e7c7a3-0f3d-4fb0-9bb7-da4dd4d8f890 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed" status: 200 len: 1311 microversion: 2.1 time: 0.233013 Sep 16 12:47:17.253775 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 272/534] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:17 2022] GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed => generated 1311 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:17.329955 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ea689c36-ef80-4e85-9e7f-f7b7e3b8fc86 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:17.330629 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ea689c36-ef80-4e85-9e7f-f7b7e3b8fc86 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] [instance: ad946bd5-7ee5-47d6-a52f-00e8511d2bd6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:17.337946 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea689c36-ef80-4e85-9e7f-f7b7e3b8fc86 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:17.338811 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea689c36-ef80-4e85-9e7f-f7b7e3b8fc86 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:17.339403 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea689c36-ef80-4e85-9e7f-f7b7e3b8fc86 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:17.339975 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea689c36-ef80-4e85-9e7f-f7b7e3b8fc86 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:17.340460 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea689c36-ef80-4e85-9e7f-f7b7e3b8fc86 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:17.340885 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea689c36-ef80-4e85-9e7f-f7b7e3b8fc86 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:17.405666 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b6d5dc33-ef6c-46f6-98f9-8c15664003f2 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:17.411294 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b6d5dc33-ef6c-46f6-98f9-8c15664003f2 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Searching by: {'deleted': False, 'project_id': '568dc7e893ab43438b74fec5d3ac186a'} {{(pid=128780) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 12:47:17.419687 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b6d5dc33-ef6c-46f6-98f9-8c15664003f2 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:17.420532 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b6d5dc33-ef6c-46f6-98f9-8c15664003f2 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:17.421183 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b6d5dc33-ef6c-46f6-98f9-8c15664003f2 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:17.422119 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b6d5dc33-ef6c-46f6-98f9-8c15664003f2 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:17.423751 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b6d5dc33-ef6c-46f6-98f9-8c15664003f2 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:17.424643 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b6d5dc33-ef6c-46f6-98f9-8c15664003f2 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:17.486896 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ea689c36-ef80-4e85-9e7f-f7b7e3b8fc86 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318566be918e44a4894403f766cbd5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4b83da544e4980b1c2fe2b1f597016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:17.497526 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ea689c36-ef80-4e85-9e7f-f7b7e3b8fc86 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] 10.222.0.67 "GET /compute/v2.1/servers/ad946bd5-7ee5-47d6-a52f-00e8511d2bd6" status: 200 len: 1323 microversion: 2.1 time: 0.172344 Sep 16 12:47:17.508756 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 273/535] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:17 2022] GET /compute/v2.1/servers/ad946bd5-7ee5-47d6-a52f-00e8511d2bd6 => generated 1323 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:47:17.579038 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b6d5dc33-ef6c-46f6-98f9-8c15664003f2 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.459172 Sep 16 12:47:17.580712 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 263/536] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:47:17 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 12:47:17.605034 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dbdbf60c-2484-4b9f-b2d5-b023528ebc29 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:17.611969 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dbdbf60c-2484-4b9f-b2d5-b023528ebc29 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Searching by: {'deleted': False} {{(pid=128779) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 12:47:17.627471 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7fa9baf8-3272-4e04-ac91-7a8ee4f4d9e4 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:17.629698 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7fa9baf8-3272-4e04-ac91-7a8ee4f4d9e4 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: 4d860eb6-336f-4ba4-be81-d1ec6fecc87b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:17.637616 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7fa9baf8-3272-4e04-ac91-7a8ee4f4d9e4 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:17.638402 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7fa9baf8-3272-4e04-ac91-7a8ee4f4d9e4 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:17.639047 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7fa9baf8-3272-4e04-ac91-7a8ee4f4d9e4 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:17.640409 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7fa9baf8-3272-4e04-ac91-7a8ee4f4d9e4 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:17.641221 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7fa9baf8-3272-4e04-ac91-7a8ee4f4d9e4 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:17.642147 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7fa9baf8-3272-4e04-ac91-7a8ee4f4d9e4 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:17.646506 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dbdbf60c-2484-4b9f-b2d5-b023528ebc29 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:17.649101 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dbdbf60c-2484-4b9f-b2d5-b023528ebc29 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:17.651005 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dbdbf60c-2484-4b9f-b2d5-b023528ebc29 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:17.651941 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dbdbf60c-2484-4b9f-b2d5-b023528ebc29 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:17.652582 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dbdbf60c-2484-4b9f-b2d5-b023528ebc29 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:17.654203 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dbdbf60c-2484-4b9f-b2d5-b023528ebc29 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:17.910694 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.multi_cell_list [None req-dbdbf60c-2484-4b9f-b2d5-b023528ebc29 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Listed batch of 8 results from cell out of 1000 limit. Returned 8 total so far. {{(pid=128779) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 12:47:17.960834 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7fa9baf8-3272-4e04-ac91-7a8ee4f4d9e4 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0815c12c4340109ec1c379a0602322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20770fd1243d4412bfc90d2a079473bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:17.976282 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7fa9baf8-3272-4e04-ac91-7a8ee4f4d9e4 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b" status: 200 len: 1477 microversion: 2.1 time: 0.352924 Sep 16 12:47:17.994221 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 264/537] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:17 2022] GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b => generated 1477 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:18.026044 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-877fa862-0905-46c3-996a-3a0e0f365720 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:18.026830 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-877fa862-0905-46c3-996a-3a0e0f365720 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 07365fde-3701-46a6-aba7-4c6f74e181b9] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:18.055729 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dbdbf60c-2484-4b9f-b2d5-b023528ebc29 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:18.056458 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dbdbf60c-2484-4b9f-b2d5-b023528ebc29 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:18.057140 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dbdbf60c-2484-4b9f-b2d5-b023528ebc29 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:18.069672 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-877fa862-0905-46c3-996a-3a0e0f365720 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:18.075475 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-877fa862-0905-46c3-996a-3a0e0f365720 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:18.078241 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-877fa862-0905-46c3-996a-3a0e0f365720 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:18.080826 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-877fa862-0905-46c3-996a-3a0e0f365720 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:18.082717 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-877fa862-0905-46c3-996a-3a0e0f365720 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:18.084776 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-877fa862-0905-46c3-996a-3a0e0f365720 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:18.430381 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-877fa862-0905-46c3-996a-3a0e0f365720 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709f71c239ca40b8b958038c9ab16f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7058e9e184834c39a5a299f481a6e62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:18.442093 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-877fa862-0905-46c3-996a-3a0e0f365720 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9" status: 200 len: 1391 microversion: 2.1 time: 0.419925 Sep 16 12:47:18.443351 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 265/538] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:18 2022] GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9 => generated 1391 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:18.449744 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1635c212-6e8f-48ad-abe8-0fbac5398297 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:18.450788 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-1635c212-6e8f-48ad-abe8-0fbac5398297 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: efea200a-0b78-42de-a9e2-febab9817590] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:18.459530 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1635c212-6e8f-48ad-abe8-0fbac5398297 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:18.460029 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1635c212-6e8f-48ad-abe8-0fbac5398297 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:18.461184 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1635c212-6e8f-48ad-abe8-0fbac5398297 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:18.468932 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1635c212-6e8f-48ad-abe8-0fbac5398297 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:18.469460 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1635c212-6e8f-48ad-abe8-0fbac5398297 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:18.470079 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1635c212-6e8f-48ad-abe8-0fbac5398297 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:18.587144 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1635c212-6e8f-48ad-abe8-0fbac5398297 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:18.602626 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1635c212-6e8f-48ad-abe8-0fbac5398297 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590" status: 200 len: 1272 microversion: 2.1 time: 0.158042 Sep 16 12:47:18.603779 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 266/539] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:18 2022] GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590 => generated 1272 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:18.621336 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-011dbdf2-564a-4669-b7c6-abab34bee40c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:18.622083 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-011dbdf2-564a-4669-b7c6-abab34bee40c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 566f231d-345e-4665-bf9a-b61004b954ed] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:18.630003 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-011dbdf2-564a-4669-b7c6-abab34bee40c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:18.630583 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-011dbdf2-564a-4669-b7c6-abab34bee40c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:18.631081 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-011dbdf2-564a-4669-b7c6-abab34bee40c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:18.631957 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-011dbdf2-564a-4669-b7c6-abab34bee40c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:18.632450 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-011dbdf2-564a-4669-b7c6-abab34bee40c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:18.632870 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-011dbdf2-564a-4669-b7c6-abab34bee40c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:18.965184 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dbdbf60c-2484-4b9f-b2d5-b023528ebc29 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 12298 microversion: 2.1 time: 1.362305 Sep 16 12:47:18.981766 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 274/540] 10.222.0.67 () {58 vars in 1171 bytes} [Fri Sep 16 12:47:17 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 12298 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:47:18.991634 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7687b6ed-c0e3-426d-b54e-0657655c7d1c tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:18.995538 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7687b6ed-c0e3-426d-b54e-0657655c7d1c tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] [instance: ad946bd5-7ee5-47d6-a52f-00e8511d2bd6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:19.005499 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7687b6ed-c0e3-426d-b54e-0657655c7d1c tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:19.005988 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7687b6ed-c0e3-426d-b54e-0657655c7d1c tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:19.006889 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7687b6ed-c0e3-426d-b54e-0657655c7d1c tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:19.007599 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7687b6ed-c0e3-426d-b54e-0657655c7d1c tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:19.008051 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7687b6ed-c0e3-426d-b54e-0657655c7d1c tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:19.008499 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7687b6ed-c0e3-426d-b54e-0657655c7d1c tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:19.101693 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-011dbdf2-564a-4669-b7c6-abab34bee40c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:19.109499 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-011dbdf2-564a-4669-b7c6-abab34bee40c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed" status: 200 len: 1311 microversion: 2.1 time: 0.504522 Sep 16 12:47:19.110889 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 267/541] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:18 2022] GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed => generated 1311 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:19.116531 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6491e02a-8cac-407a-878e-2390ac1a4f59 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:19.117383 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6491e02a-8cac-407a-878e-2390ac1a4f59 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: 4d860eb6-336f-4ba4-be81-d1ec6fecc87b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:19.124269 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6491e02a-8cac-407a-878e-2390ac1a4f59 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:19.124985 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6491e02a-8cac-407a-878e-2390ac1a4f59 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:19.125714 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6491e02a-8cac-407a-878e-2390ac1a4f59 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:19.126599 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6491e02a-8cac-407a-878e-2390ac1a4f59 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:19.127229 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6491e02a-8cac-407a-878e-2390ac1a4f59 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:19.127855 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6491e02a-8cac-407a-878e-2390ac1a4f59 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:19.513010 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7687b6ed-c0e3-426d-b54e-0657655c7d1c tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318566be918e44a4894403f766cbd5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4b83da544e4980b1c2fe2b1f597016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:19.530961 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7687b6ed-c0e3-426d-b54e-0657655c7d1c tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] 10.222.0.67 "GET /compute/v2.1/servers/ad946bd5-7ee5-47d6-a52f-00e8511d2bd6" status: 200 len: 1323 microversion: 2.1 time: 0.547966 Sep 16 12:47:19.544547 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 275/542] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:18 2022] GET /compute/v2.1/servers/ad946bd5-7ee5-47d6-a52f-00e8511d2bd6 => generated 1323 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:19.553225 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-67910ac0-92d6-499f-b913-a8e5bf016068 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:19.558865 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-67910ac0-92d6-499f-b913-a8e5bf016068 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Searching by: {'deleted': False, 'project_id': '568dc7e893ab43438b74fec5d3ac186a'} {{(pid=128779) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 12:47:19.563215 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6491e02a-8cac-407a-878e-2390ac1a4f59 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0815c12c4340109ec1c379a0602322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20770fd1243d4412bfc90d2a079473bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:19.564803 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67910ac0-92d6-499f-b913-a8e5bf016068 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:19.565497 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67910ac0-92d6-499f-b913-a8e5bf016068 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:19.566079 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67910ac0-92d6-499f-b913-a8e5bf016068 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:19.568314 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67910ac0-92d6-499f-b913-a8e5bf016068 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:19.568935 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67910ac0-92d6-499f-b913-a8e5bf016068 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:19.569534 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67910ac0-92d6-499f-b913-a8e5bf016068 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:19.571238 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6491e02a-8cac-407a-878e-2390ac1a4f59 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b" status: 200 len: 1477 microversion: 2.1 time: 0.459066 Sep 16 12:47:19.572212 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 268/543] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:19 2022] GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b => generated 1477 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:19.576830 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f6891c59-ee18-447e-bae8-e8518ff1a6ce tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:19.577442 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f6891c59-ee18-447e-bae8-e8518ff1a6ce tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 07365fde-3701-46a6-aba7-4c6f74e181b9] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:19.586490 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f6891c59-ee18-447e-bae8-e8518ff1a6ce tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:19.586980 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f6891c59-ee18-447e-bae8-e8518ff1a6ce tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:19.587416 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f6891c59-ee18-447e-bae8-e8518ff1a6ce tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:19.588142 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f6891c59-ee18-447e-bae8-e8518ff1a6ce tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:19.588590 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f6891c59-ee18-447e-bae8-e8518ff1a6ce tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:19.589005 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f6891c59-ee18-447e-bae8-e8518ff1a6ce tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:19.675196 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-67910ac0-92d6-499f-b913-a8e5bf016068 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/detail?tenant_id=0709d7ec436047a39dfb8c5d92f17fa3" status: 200 len: 15 microversion: 2.1 time: 0.129386 Sep 16 12:47:19.676040 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 276/544] 10.222.0.67 () {58 vars in 1231 bytes} [Fri Sep 16 12:47:19 2022] GET /compute/v2.1/servers/detail?tenant_id=0709d7ec436047a39dfb8c5d92f17fa3 => generated 15 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 12:47:19.681394 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-acbc942c-f5a6-4306-b85c-f96347b040e8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:19.682011 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-acbc942c-f5a6-4306-b85c-f96347b040e8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: efea200a-0b78-42de-a9e2-febab9817590] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:19.688263 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-acbc942c-f5a6-4306-b85c-f96347b040e8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:19.689045 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-acbc942c-f5a6-4306-b85c-f96347b040e8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:19.689659 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-acbc942c-f5a6-4306-b85c-f96347b040e8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:19.690538 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-acbc942c-f5a6-4306-b85c-f96347b040e8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:19.691147 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-acbc942c-f5a6-4306-b85c-f96347b040e8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:19.691724 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-acbc942c-f5a6-4306-b85c-f96347b040e8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:20.570452 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f6891c59-ee18-447e-bae8-e8518ff1a6ce tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709f71c239ca40b8b958038c9ab16f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7058e9e184834c39a5a299f481a6e62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:20.588443 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f6891c59-ee18-447e-bae8-e8518ff1a6ce tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9" status: 200 len: 1391 microversion: 2.1 time: 1.014541 Sep 16 12:47:20.589790 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 269/545] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:19 2022] GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9 => generated 1391 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:20.599683 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2ac19615-4840-4ec3-a0bc-1fb101c6864a tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:20.608592 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-acbc942c-f5a6-4306-b85c-f96347b040e8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:20.611604 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-2ac19615-4840-4ec3-a0bc-1fb101c6864a tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Searching by: {'tenant_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'deleted': False} {{(pid=128780) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 12:47:20.622577 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-acbc942c-f5a6-4306-b85c-f96347b040e8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590" status: 200 len: 1312 microversion: 2.1 time: 0.945239 Sep 16 12:47:20.623438 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 277/546] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:19 2022] GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590 => generated 1312 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:20.642626 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c54bc066-74d3-4b50-9632-c0f689b9da2a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:20.643537 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c54bc066-74d3-4b50-9632-c0f689b9da2a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 566f231d-345e-4665-bf9a-b61004b954ed] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:20.644829 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2ac19615-4840-4ec3-a0bc-1fb101c6864a tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:20.646644 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2ac19615-4840-4ec3-a0bc-1fb101c6864a tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:20.648996 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2ac19615-4840-4ec3-a0bc-1fb101c6864a tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:20.650094 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c54bc066-74d3-4b50-9632-c0f689b9da2a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:20.651985 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2ac19615-4840-4ec3-a0bc-1fb101c6864a tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:20.652777 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c54bc066-74d3-4b50-9632-c0f689b9da2a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:20.654424 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2ac19615-4840-4ec3-a0bc-1fb101c6864a tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:20.655011 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2ac19615-4840-4ec3-a0bc-1fb101c6864a tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:20.655290 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c54bc066-74d3-4b50-9632-c0f689b9da2a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:20.656212 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c54bc066-74d3-4b50-9632-c0f689b9da2a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:20.657523 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c54bc066-74d3-4b50-9632-c0f689b9da2a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:20.668898 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c54bc066-74d3-4b50-9632-c0f689b9da2a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:20.709099 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.multi_cell_list [None req-2ac19615-4840-4ec3-a0bc-1fb101c6864a tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128780) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 12:47:21.004736 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2ac19615-4840-4ec3-a0bc-1fb101c6864a tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:21.005638 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2ac19615-4840-4ec3-a0bc-1fb101c6864a tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:21.006184 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2ac19615-4840-4ec3-a0bc-1fb101c6864a tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:21.143924 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c54bc066-74d3-4b50-9632-c0f689b9da2a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:21.155171 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c54bc066-74d3-4b50-9632-c0f689b9da2a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed" status: 200 len: 1311 microversion: 2.1 time: 0.530217 Sep 16 12:47:21.156494 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 278/547] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:20 2022] GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed => generated 1311 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:21.178835 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ddbee711-c4e3-48ae-a9cd-7e7d4f5a0019 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:21.179825 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ddbee711-c4e3-48ae-a9cd-7e7d4f5a0019 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] [instance: ad946bd5-7ee5-47d6-a52f-00e8511d2bd6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:21.189176 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ddbee711-c4e3-48ae-a9cd-7e7d4f5a0019 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:21.191084 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ddbee711-c4e3-48ae-a9cd-7e7d4f5a0019 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:21.192298 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ddbee711-c4e3-48ae-a9cd-7e7d4f5a0019 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:21.195594 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ddbee711-c4e3-48ae-a9cd-7e7d4f5a0019 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:21.196505 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ddbee711-c4e3-48ae-a9cd-7e7d4f5a0019 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:21.197661 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ddbee711-c4e3-48ae-a9cd-7e7d4f5a0019 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:21.538433 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2ac19615-4840-4ec3-a0bc-1fb101c6864a tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=0709d7ec436047a39dfb8c5d92f17fa3" status: 200 len: 4827 microversion: 2.1 time: 0.946565 Sep 16 12:47:21.552659 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 270/548] 10.222.0.67 () {58 vars in 1257 bytes} [Fri Sep 16 12:47:20 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=0709d7ec436047a39dfb8c5d92f17fa3 => generated 4827 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:21.569067 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-833f3074-6e58-40e7-b3f2-16d6a5fa036f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:21.569923 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-833f3074-6e58-40e7-b3f2-16d6a5fa036f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: 4d860eb6-336f-4ba4-be81-d1ec6fecc87b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:21.577135 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-833f3074-6e58-40e7-b3f2-16d6a5fa036f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:21.578315 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-833f3074-6e58-40e7-b3f2-16d6a5fa036f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:21.579081 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-833f3074-6e58-40e7-b3f2-16d6a5fa036f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:21.580182 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-833f3074-6e58-40e7-b3f2-16d6a5fa036f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:21.580787 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-833f3074-6e58-40e7-b3f2-16d6a5fa036f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:21.581429 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-833f3074-6e58-40e7-b3f2-16d6a5fa036f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:21.769511 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-833f3074-6e58-40e7-b3f2-16d6a5fa036f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0815c12c4340109ec1c379a0602322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20770fd1243d4412bfc90d2a079473bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:21.784834 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ddbee711-c4e3-48ae-a9cd-7e7d4f5a0019 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318566be918e44a4894403f766cbd5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4b83da544e4980b1c2fe2b1f597016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:21.786133 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-833f3074-6e58-40e7-b3f2-16d6a5fa036f tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b" status: 200 len: 1435 microversion: 2.1 time: 0.232265 Sep 16 12:47:21.800564 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 271/549] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:21 2022] GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b => generated 1435 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:21.801766 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ddbee711-c4e3-48ae-a9cd-7e7d4f5a0019 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] 10.222.0.67 "GET /compute/v2.1/servers/ad946bd5-7ee5-47d6-a52f-00e8511d2bd6" status: 200 len: 1323 microversion: 2.1 time: 0.642809 Sep 16 12:47:21.818682 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 279/550] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:21 2022] GET /compute/v2.1/servers/ad946bd5-7ee5-47d6-a52f-00e8511d2bd6 => generated 1323 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:21.818903 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f378f181-389e-4495-99ce-9f7a32aab09d tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:21.819092 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d289ef18-7bb2-4713-b5f0-657d6334f67c tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:21.833357 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f378f181-389e-4495-99ce-9f7a32aab09d tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Searching by: {'tenant_id': '568dc7e893ab43438b74fec5d3ac186a', 'deleted': False} {{(pid=128780) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 12:47:21.842612 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d289ef18-7bb2-4713-b5f0-657d6334f67c tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 07365fde-3701-46a6-aba7-4c6f74e181b9] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:21.845279 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f378f181-389e-4495-99ce-9f7a32aab09d tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:21.848490 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f378f181-389e-4495-99ce-9f7a32aab09d tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:21.848989 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f378f181-389e-4495-99ce-9f7a32aab09d tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:21.850379 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f378f181-389e-4495-99ce-9f7a32aab09d tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:21.851054 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f378f181-389e-4495-99ce-9f7a32aab09d tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:21.851591 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f378f181-389e-4495-99ce-9f7a32aab09d tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:21.859119 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d289ef18-7bb2-4713-b5f0-657d6334f67c tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:21.860776 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d289ef18-7bb2-4713-b5f0-657d6334f67c tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:21.861576 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d289ef18-7bb2-4713-b5f0-657d6334f67c tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:21.862937 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d289ef18-7bb2-4713-b5f0-657d6334f67c tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:21.867148 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d289ef18-7bb2-4713-b5f0-657d6334f67c tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:21.867859 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d289ef18-7bb2-4713-b5f0-657d6334f67c tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:21.879398 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:47:21.893266 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f378f181-389e-4495-99ce-9f7a32aab09d tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=568dc7e893ab43438b74fec5d3ac186a" status: 200 len: 15 microversion: 2.1 time: 0.091028 Sep 16 12:47:21.915215 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 272/551] 10.222.0.67 () {58 vars in 1257 bytes} [Fri Sep 16 12:47:21 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=568dc7e893ab43438b74fec5d3ac186a => generated 15 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 12:47:21.924247 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-998863ee-fc7b-47bb-ac60-b09e992211c3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:21.925407 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-998863ee-fc7b-47bb-ac60-b09e992211c3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: efea200a-0b78-42de-a9e2-febab9817590] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:21.932832 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-998863ee-fc7b-47bb-ac60-b09e992211c3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:21.933523 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-998863ee-fc7b-47bb-ac60-b09e992211c3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:21.934104 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-998863ee-fc7b-47bb-ac60-b09e992211c3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:21.935617 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-998863ee-fc7b-47bb-ac60-b09e992211c3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:21.937256 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-998863ee-fc7b-47bb-ac60-b09e992211c3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:21.938494 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-998863ee-fc7b-47bb-ac60-b09e992211c3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:21.970934 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=100 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:47:22.326147 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-998863ee-fc7b-47bb-ac60-b09e992211c3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:22.338761 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-998863ee-fc7b-47bb-ac60-b09e992211c3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590" status: 200 len: 1312 microversion: 2.1 time: 0.421471 Sep 16 12:47:22.343380 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 273/552] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:21 2022] GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590 => generated 1312 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:22.354080 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-bca5f6c9-c712-43f0-869d-a325b481b94d req-024824a9-fc8d-4a2b-a7c6-cc1383abbae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d860eb6-336f-4ba4-be81-d1ec6fecc87b", "name": "network-vif-deleted", "tag": "4cbb6233-6017-40a2-a247-e622df5f31a3"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:22.390975 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-bca5f6c9-c712-43f0-869d-a325b481b94d req-024824a9-fc8d-4a2b-a7c6-cc1383abbae1 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:22.401545 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-bca5f6c9-c712-43f0-869d-a325b481b94d req-024824a9-fc8d-4a2b-a7c6-cc1383abbae1 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:22.402499 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-bca5f6c9-c712-43f0-869d-a325b481b94d req-024824a9-fc8d-4a2b-a7c6-cc1383abbae1 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:22.405030 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d289ef18-7bb2-4713-b5f0-657d6334f67c tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709f71c239ca40b8b958038c9ab16f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7058e9e184834c39a5a299f481a6e62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:22.422053 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d289ef18-7bb2-4713-b5f0-657d6334f67c tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9" status: 200 len: 1589 microversion: 2.1 time: 0.614029 Sep 16 12:47:22.428625 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-bca5f6c9-c712-43f0-869d-a325b481b94d req-024824a9-fc8d-4a2b-a7c6-cc1383abbae1 service nova] Creating event network-vif-deleted:4cbb6233-6017-40a2-a247-e622df5f31a3 for instance 4d860eb6-336f-4ba4-be81-d1ec6fecc87b on n-h1-858094-4 Sep 16 12:47:22.433584 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 280/553] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:21 2022] GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9 => generated 1589 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:22.443811 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-bca5f6c9-c712-43f0-869d-a325b481b94d req-024824a9-fc8d-4a2b-a7c6-cc1383abbae1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097934 Sep 16 12:47:22.451170 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 274/554] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:47:22.454677 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4481d2e5-bcc7-4501-94e9-130905abc5b2 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:22.461524 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-41ea523a-1f6d-442d-87fb-927e7a79ff05 req-e1248d6c-3bbe-4185-a360-b2919c4b33ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efea200a-0b78-42de-a9e2-febab9817590", "tag": "3fe50ad6-99ae-4c0b-a11b-3e41218b0317"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:22.472681 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4481d2e5-bcc7-4501-94e9-130905abc5b2 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.037364 Sep 16 12:47:22.473233 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 281/555] 10.222.0.67 () {58 vars in 1189 bytes} [Fri Sep 16 12:47:22 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 12:47:22.476561 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-41ea523a-1f6d-442d-87fb-927e7a79ff05 req-e1248d6c-3bbe-4185-a360-b2919c4b33ae service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:22.477622 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-41ea523a-1f6d-442d-87fb-927e7a79ff05 req-e1248d6c-3bbe-4185-a360-b2919c4b33ae service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:22.478505 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-41ea523a-1f6d-442d-87fb-927e7a79ff05 req-e1248d6c-3bbe-4185-a360-b2919c4b33ae service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:22.492061 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ebf88bcc-fd06-485c-bb2c-b2e4512e4950 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:22.495954 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ebf88bcc-fd06-485c-bb2c-b2e4512e4950 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 566f231d-345e-4665-bf9a-b61004b954ed] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:22.503781 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebf88bcc-fd06-485c-bb2c-b2e4512e4950 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:22.506676 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebf88bcc-fd06-485c-bb2c-b2e4512e4950 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:22.507348 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebf88bcc-fd06-485c-bb2c-b2e4512e4950 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:22.508311 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebf88bcc-fd06-485c-bb2c-b2e4512e4950 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:22.508536 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-41ea523a-1f6d-442d-87fb-927e7a79ff05 req-e1248d6c-3bbe-4185-a360-b2919c4b33ae service nova] Creating event network-changed:3fe50ad6-99ae-4c0b-a11b-3e41218b0317 for instance efea200a-0b78-42de-a9e2-febab9817590 on n-h2-858094-4 Sep 16 12:47:22.509114 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebf88bcc-fd06-485c-bb2c-b2e4512e4950 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:22.509691 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebf88bcc-fd06-485c-bb2c-b2e4512e4950 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:22.525694 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-41ea523a-1f6d-442d-87fb-927e7a79ff05 req-e1248d6c-3bbe-4185-a360-b2919c4b33ae service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063043 Sep 16 12:47:22.536229 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 275/556] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:47:22.542536 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1b9bfc1e-aa7c-4559-a9f7-3ad40c91e2e0 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:22.543956 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-1b9bfc1e-aa7c-4559-a9f7-3ad40c91e2e0 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 07365fde-3701-46a6-aba7-4c6f74e181b9] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:22.562091 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1b9bfc1e-aa7c-4559-a9f7-3ad40c91e2e0 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:22.565666 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1b9bfc1e-aa7c-4559-a9f7-3ad40c91e2e0 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:22.569857 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1b9bfc1e-aa7c-4559-a9f7-3ad40c91e2e0 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:22.576337 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1b9bfc1e-aa7c-4559-a9f7-3ad40c91e2e0 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:22.577157 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1b9bfc1e-aa7c-4559-a9f7-3ad40c91e2e0 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:22.578244 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1b9bfc1e-aa7c-4559-a9f7-3ad40c91e2e0 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:22.810121 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1b9bfc1e-aa7c-4559-a9f7-3ad40c91e2e0 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.272229 Sep 16 12:47:22.810725 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 276/557] 10.222.0.67 () {58 vars in 1275 bytes} [Fri Sep 16 12:47:22 2022] GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9/os-interface => generated 284 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:47:22.817438 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5b93099a-8cd9-4b82-b7f9-b718b45213bf tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:22.829467 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5b93099a-8cd9-4b82-b7f9-b718b45213bf tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:22.839126 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ebf88bcc-fd06-485c-bb2c-b2e4512e4950 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:22.856414 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ebf88bcc-fd06-485c-bb2c-b2e4512e4950 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed" status: 200 len: 1311 microversion: 2.1 time: 0.377099 Sep 16 12:47:22.857004 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 282/558] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:22 2022] GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed => generated 1311 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:22.858406 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5b93099a-8cd9-4b82-b7f9-b718b45213bf tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:22.859166 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5b93099a-8cd9-4b82-b7f9-b718b45213bf tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:22.863475 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5b93099a-8cd9-4b82-b7f9-b718b45213bf tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:22.864826 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5b93099a-8cd9-4b82-b7f9-b718b45213bf tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:22.865555 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5b93099a-8cd9-4b82-b7f9-b718b45213bf tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:22.866199 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5b93099a-8cd9-4b82-b7f9-b718b45213bf tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:22.866784 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-33f1fae5-40c4-4bc0-a493-588a38ca5a6c tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:22.867408 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-33f1fae5-40c4-4bc0-a493-588a38ca5a6c tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: 4d860eb6-336f-4ba4-be81-d1ec6fecc87b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:22.886527 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33f1fae5-40c4-4bc0-a493-588a38ca5a6c tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:22.887036 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33f1fae5-40c4-4bc0-a493-588a38ca5a6c tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:22.887476 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33f1fae5-40c4-4bc0-a493-588a38ca5a6c tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:22.888250 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33f1fae5-40c4-4bc0-a493-588a38ca5a6c tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:22.888714 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33f1fae5-40c4-4bc0-a493-588a38ca5a6c tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:22.889139 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33f1fae5-40c4-4bc0-a493-588a38ca5a6c tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:22.973677 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33f1fae5-40c4-4bc0-a493-588a38ca5a6c tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:22.975852 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33f1fae5-40c4-4bc0-a493-588a38ca5a6c tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:22.977141 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33f1fae5-40c4-4bc0-a493-588a38ca5a6c tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:22.979943 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-33f1fae5-40c4-4bc0-a493-588a38ca5a6c tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lazy-loading 'fault' on Instance uuid 4d860eb6-336f-4ba4-be81-d1ec6fecc87b {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:47:23.104350 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5b93099a-8cd9-4b82-b7f9-b718b45213bf tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6/action" status: 202 len: 0 microversion: 2.1 time: 0.292479 Sep 16 12:47:23.112635 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 277/559] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:47:22 2022] POST /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:47:23.117708 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9c443f76-cf59-48a4-9838-97ac3a57a03c tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:23.129344 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9c443f76-cf59-48a4-9838-97ac3a57a03c tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] [instance: ad946bd5-7ee5-47d6-a52f-00e8511d2bd6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:23.135904 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9c443f76-cf59-48a4-9838-97ac3a57a03c tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:23.136781 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9c443f76-cf59-48a4-9838-97ac3a57a03c tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:23.137746 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9c443f76-cf59-48a4-9838-97ac3a57a03c tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:23.140158 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9c443f76-cf59-48a4-9838-97ac3a57a03c tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:23.141443 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9c443f76-cf59-48a4-9838-97ac3a57a03c tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:23.146766 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9c443f76-cf59-48a4-9838-97ac3a57a03c tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:23.728473 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-33f1fae5-40c4-4bc0-a493-588a38ca5a6c tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0815c12c4340109ec1c379a0602322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20770fd1243d4412bfc90d2a079473bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:23.760084 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-33f1fae5-40c4-4bc0-a493-588a38ca5a6c tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b" status: 200 len: 1311 microversion: 2.1 time: 0.893815 Sep 16 12:47:23.761402 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 283/560] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:22 2022] GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b => generated 1311 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:23.767109 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-82b8334d-3faa-4905-8ec3-e775920ca923 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:23.776550 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-82b8334d-3faa-4905-8ec3-e775920ca923 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:23.782077 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-82b8334d-3faa-4905-8ec3-e775920ca923 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3'} {{(pid=128779) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 12:47:23.805038 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82b8334d-3faa-4905-8ec3-e775920ca923 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:23.810679 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82b8334d-3faa-4905-8ec3-e775920ca923 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:23.811139 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82b8334d-3faa-4905-8ec3-e775920ca923 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:23.816852 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82b8334d-3faa-4905-8ec3-e775920ca923 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:23.817346 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82b8334d-3faa-4905-8ec3-e775920ca923 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:23.820397 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82b8334d-3faa-4905-8ec3-e775920ca923 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:24.044444 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.multi_cell_list [None req-82b8334d-3faa-4905-8ec3-e775920ca923 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128779) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 12:47:24.169222 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-82b8334d-3faa-4905-8ec3-e775920ca923 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.404724 Sep 16 12:47:24.170277 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 284/561] 10.222.0.67 () {58 vars in 1150 bytes} [Fri Sep 16 12:47:23 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:47:24.184738 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9cb5393f-5b90-41b0-88e9-e07705b91c98 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:24.193094 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9cb5393f-5b90-41b0-88e9-e07705b91c98 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: efea200a-0b78-42de-a9e2-febab9817590] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:24.202002 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9cb5393f-5b90-41b0-88e9-e07705b91c98 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:24.202671 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9cb5393f-5b90-41b0-88e9-e07705b91c98 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:24.203266 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9cb5393f-5b90-41b0-88e9-e07705b91c98 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:24.204097 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9cb5393f-5b90-41b0-88e9-e07705b91c98 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:24.208488 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9cb5393f-5b90-41b0-88e9-e07705b91c98 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:24.209075 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9cb5393f-5b90-41b0-88e9-e07705b91c98 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:24.696573 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9c443f76-cf59-48a4-9838-97ac3a57a03c tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318566be918e44a4894403f766cbd5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4b83da544e4980b1c2fe2b1f597016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:24.705474 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9c443f76-cf59-48a4-9838-97ac3a57a03c tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] 10.222.0.67 "GET /compute/v2.1/servers/ad946bd5-7ee5-47d6-a52f-00e8511d2bd6" status: 200 len: 1323 microversion: 2.1 time: 1.591384 Sep 16 12:47:24.711747 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 278/562] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:23 2022] GET /compute/v2.1/servers/ad946bd5-7ee5-47d6-a52f-00e8511d2bd6 => generated 1323 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:24.731064 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-cfaa9daf-4090-408f-8cd5-dd6dc16a2152 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:24.732115 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-cfaa9daf-4090-408f-8cd5-dd6dc16a2152 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 566f231d-345e-4665-bf9a-b61004b954ed] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:24.740156 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cfaa9daf-4090-408f-8cd5-dd6dc16a2152 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:24.741014 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cfaa9daf-4090-408f-8cd5-dd6dc16a2152 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:24.742519 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cfaa9daf-4090-408f-8cd5-dd6dc16a2152 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:24.743466 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cfaa9daf-4090-408f-8cd5-dd6dc16a2152 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:24.744187 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cfaa9daf-4090-408f-8cd5-dd6dc16a2152 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:24.745126 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cfaa9daf-4090-408f-8cd5-dd6dc16a2152 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:25.121589 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9cb5393f-5b90-41b0-88e9-e07705b91c98 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:25.135766 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9cb5393f-5b90-41b0-88e9-e07705b91c98 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590" status: 200 len: 1312 microversion: 2.1 time: 0.954840 Sep 16 12:47:25.138607 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 285/563] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:24 2022] GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590 => generated 1312 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:25.151532 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dc55d13d-70bb-47a3-bb94-e0d21f663611 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:25.151532 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dc55d13d-70bb-47a3-bb94-e0d21f663611 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:25.170684 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc55d13d-70bb-47a3-bb94-e0d21f663611 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:25.171187 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc55d13d-70bb-47a3-bb94-e0d21f663611 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:25.171618 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc55d13d-70bb-47a3-bb94-e0d21f663611 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:25.172451 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc55d13d-70bb-47a3-bb94-e0d21f663611 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:25.172869 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc55d13d-70bb-47a3-bb94-e0d21f663611 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:25.173296 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc55d13d-70bb-47a3-bb94-e0d21f663611 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:25.338510 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-cfaa9daf-4090-408f-8cd5-dd6dc16a2152 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:25.340894 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dc55d13d-70bb-47a3-bb94-e0d21f663611 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6/action" status: 202 len: 0 microversion: 2.1 time: 0.201127 Sep 16 12:47:25.341790 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 286/564] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:47:25 2022] POST /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:47:25.347772 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2842d0d0-db84-43a8-b842-ff46a95cc3f9 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:25.351064 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-cfaa9daf-4090-408f-8cd5-dd6dc16a2152 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed" status: 200 len: 1311 microversion: 2.1 time: 0.637711 Sep 16 12:47:25.355050 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2842d0d0-db84-43a8-b842-ff46a95cc3f9 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] [instance: 4d860eb6-336f-4ba4-be81-d1ec6fecc87b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:25.355910 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 279/565] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:24 2022] GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed => generated 1311 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:25.364869 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-c5c0081e-cbad-44b7-bcbd-d8bf83ffc642 req-0b7cbd77-ab88-4cbf-abfa-3b1be4d86fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad946bd5-7ee5-47d6-a52f-00e8511d2bd6", "name": "network-vif-plugged", "status": "completed", "tag": "f1d9e429-3d16-4f88-85c5-b9622e90e851"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:25.384982 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2842d0d0-db84-43a8-b842-ff46a95cc3f9 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:25.385487 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2842d0d0-db84-43a8-b842-ff46a95cc3f9 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:25.385961 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-c5c0081e-cbad-44b7-bcbd-d8bf83ffc642 req-0b7cbd77-ab88-4cbf-abfa-3b1be4d86fa5 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:25.386637 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-c5c0081e-cbad-44b7-bcbd-d8bf83ffc642 req-0b7cbd77-ab88-4cbf-abfa-3b1be4d86fa5 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:25.387546 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-c5c0081e-cbad-44b7-bcbd-d8bf83ffc642 req-0b7cbd77-ab88-4cbf-abfa-3b1be4d86fa5 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:25.389768 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2842d0d0-db84-43a8-b842-ff46a95cc3f9 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:25.395675 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2842d0d0-db84-43a8-b842-ff46a95cc3f9 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:25.397006 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2842d0d0-db84-43a8-b842-ff46a95cc3f9 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:25.397361 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2842d0d0-db84-43a8-b842-ff46a95cc3f9 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:25.407877 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-c5c0081e-cbad-44b7-bcbd-d8bf83ffc642 req-0b7cbd77-ab88-4cbf-abfa-3b1be4d86fa5 service nova] Creating event network-vif-plugged:f1d9e429-3d16-4f88-85c5-b9622e90e851 for instance ad946bd5-7ee5-47d6-a52f-00e8511d2bd6 on n-h1-858094-4 Sep 16 12:47:25.414037 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-c5c0081e-cbad-44b7-bcbd-d8bf83ffc642 req-0b7cbd77-ab88-4cbf-abfa-3b1be4d86fa5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056493 Sep 16 12:47:25.415234 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 280/566] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:47:25.424707 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8b6eddc2-bb9d-494d-91ca-598e3f75cb33 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:25.425788 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8b6eddc2-bb9d-494d-91ca-598e3f75cb33 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:25.428482 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-2842d0d0-db84-43a8-b842-ff46a95cc3f9 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] HTTP exception thrown: Instance 4d860eb6-336f-4ba4-be81-d1ec6fecc87b could not be found. Sep 16 12:47:25.431054 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2842d0d0-db84-43a8-b842-ff46a95cc3f9 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Request method failure captured: Sep 16 12:47:25.431054 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b HTTP/1.1 Sep 16 12:47:25.431054 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:47:25.431054 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:47:25.431054 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:47:25.431054 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:47:25.431054 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:47:25.431054 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:47:25.431054 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:47:25.431054 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:47:25.431054 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHAJ530-wA71OqVDzXwX20qeD3P8ISpOIY6mCpf35_0vF0--4ok3DLook9UxDdLtLZJZ03M86Fq58v6JfwpLPYRkiiFLKtvlABPXO1tV7E2HpYKwNusTFUePrtHLJwdfkDuxh3aJfBGjrWJmBgYfPy_yf_nQyrjvPl4HmF0thaKh-tE Sep 16 12:47:25.431054 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:47:25.431054 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:47:25.431054 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:47:25.431054 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:47:25.431054 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:47:25.431054 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:47:25.431054 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 20770fd1243d4412bfc90d2a079473bd Sep 16 12:47:25.431054 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1917704830 Sep 16 12:47:25.431054 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:47:25.431054 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:47:25.432383 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/20770fd1243d4412bfc90d2a079473bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/20770fd1243d4412bfc90d2a079473bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_20770fd1243d4412bfc90d2a079473bd", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/20770fd1243d4412bfc90d2a079473bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:47:25.432383 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1917704830 Sep 16 12:47:25.432383 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 20770fd1243d4412bfc90d2a079473bd Sep 16 12:47:25.432383 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1917704830 Sep 16 12:47:25.432383 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ServersAdminNegativeTestJSON-1917704830-project Sep 16 12:47:25.432383 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:47:25.432383 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:47:25.432383 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 7b0815c12c4340109ec1c379a0602322 Sep 16 12:47:25.432383 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1917704830-project Sep 16 12:47:25.432383 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:47:25.432383 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 4d860eb6-336f-4ba4-be81-d1ec6fecc87b could not be found. Sep 16 12:47:25.432383 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '4d860eb6-336f-4ba4-be81-d1ec6fecc87b'} Sep 16 12:47:25.433115 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:47:25.433115 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:47:25.433115 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:47:25.433115 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:47:25.433115 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:47:25.433115 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:47:25.433115 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:47:25.433115 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:47:25.433115 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:47:25.433115 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:47:25.433115 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d860eb6-336f-4ba4-be81-d1ec6fecc87b could not be found. Sep 16 12:47:25.433115 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:47:25.433115 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:47:25.433115 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:47:25.433115 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:47:25.433115 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:47:25.433115 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:47:25.433115 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:47:25.433115 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:47:25.433115 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:47:25.434237 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:47:25.434237 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:47:25.434237 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:47:25.434237 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:47:25.434237 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:47:25.434237 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:47:25.434237 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:47:25.434237 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d860eb6-336f-4ba4-be81-d1ec6fecc87b could not be found. Sep 16 12:47:25.434237 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:47:25.434237 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:47:25.434237 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:47:25.434237 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:47:25.434237 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:47:25.434237 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:47:25.434237 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:47:25.434237 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:47:25.434237 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d860eb6-336f-4ba4-be81-d1ec6fecc87b could not be found. Sep 16 12:47:25.434237 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:47:25.435257 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2842d0d0-db84-43a8-b842-ff46a95cc3f9 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] Returning 404 to user: Instance 4d860eb6-336f-4ba4-be81-d1ec6fecc87b could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:47:25.435257 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2842d0d0-db84-43a8-b842-ff46a95cc3f9 tempest-ServersAdminNegativeTestJSON-1917704830 tempest-ServersAdminNegativeTestJSON-1917704830-project] 10.222.0.67 "GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b" status: 404 len: 111 microversion: 2.1 time: 0.089846 Sep 16 12:47:25.436585 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 287/567] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:25 2022] GET /compute/v2.1/servers/4d860eb6-336f-4ba4-be81-d1ec6fecc87b => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:47:25.441761 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8b6eddc2-bb9d-494d-91ca-598e3f75cb33 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:25.442480 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8b6eddc2-bb9d-494d-91ca-598e3f75cb33 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:25.443118 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8b6eddc2-bb9d-494d-91ca-598e3f75cb33 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:25.444042 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8b6eddc2-bb9d-494d-91ca-598e3f75cb33 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:25.444736 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8b6eddc2-bb9d-494d-91ca-598e3f75cb33 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:25.445379 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8b6eddc2-bb9d-494d-91ca-598e3f75cb33 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:25.733843 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-da5a0497-6811-4871-bd41-c118dc22f9fa tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:25.735023 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-da5a0497-6811-4871-bd41-c118dc22f9fa tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] [instance: ad946bd5-7ee5-47d6-a52f-00e8511d2bd6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:25.748098 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da5a0497-6811-4871-bd41-c118dc22f9fa tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:25.748789 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da5a0497-6811-4871-bd41-c118dc22f9fa tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:25.749693 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da5a0497-6811-4871-bd41-c118dc22f9fa tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:25.751832 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da5a0497-6811-4871-bd41-c118dc22f9fa tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:25.752533 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da5a0497-6811-4871-bd41-c118dc22f9fa tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:25.759013 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da5a0497-6811-4871-bd41-c118dc22f9fa tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:26.118416 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8b6eddc2-bb9d-494d-91ca-598e3f75cb33 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6" status: 200 len: 1614 microversion: 2.1 time: 0.701478 Sep 16 12:47:26.147509 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 281/568] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:25 2022] GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 => generated 1614 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:26.157693 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-badd4c0a-8981-4bf5-aeb6-a6219a2e9800 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:26.158081 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-badd4c0a-8981-4bf5-aeb6-a6219a2e9800 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 07365fde-3701-46a6-aba7-4c6f74e181b9] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:26.164792 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-badd4c0a-8981-4bf5-aeb6-a6219a2e9800 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:26.165283 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-badd4c0a-8981-4bf5-aeb6-a6219a2e9800 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:26.165713 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-badd4c0a-8981-4bf5-aeb6-a6219a2e9800 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:26.166930 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-badd4c0a-8981-4bf5-aeb6-a6219a2e9800 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:26.167381 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-badd4c0a-8981-4bf5-aeb6-a6219a2e9800 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:26.167798 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-badd4c0a-8981-4bf5-aeb6-a6219a2e9800 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:26.418737 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-da5a0497-6811-4871-bd41-c118dc22f9fa tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318566be918e44a4894403f766cbd5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4b83da544e4980b1c2fe2b1f597016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:26.427828 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-da5a0497-6811-4871-bd41-c118dc22f9fa tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] 10.222.0.67 "GET /compute/v2.1/servers/ad946bd5-7ee5-47d6-a52f-00e8511d2bd6" status: 200 len: 1323 microversion: 2.1 time: 0.697886 Sep 16 12:47:26.435998 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 288/569] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:25 2022] GET /compute/v2.1/servers/ad946bd5-7ee5-47d6-a52f-00e8511d2bd6 => generated 1323 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:26.441440 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-4a5bad58-e047-4421-a1a4-fca5a168202b req-798287ab-6157-45ae-b3f2-eb9734abed1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07365fde-3701-46a6-aba7-4c6f74e181b9", "tag": "57df8d9f-a9ff-49ba-a0ec-5581bc6e7cb6"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:26.466063 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4a5bad58-e047-4421-a1a4-fca5a168202b req-798287ab-6157-45ae-b3f2-eb9734abed1b service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:26.466589 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4a5bad58-e047-4421-a1a4-fca5a168202b req-798287ab-6157-45ae-b3f2-eb9734abed1b service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:26.467192 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4a5bad58-e047-4421-a1a4-fca5a168202b req-798287ab-6157-45ae-b3f2-eb9734abed1b service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:26.494136 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-4a5bad58-e047-4421-a1a4-fca5a168202b req-798287ab-6157-45ae-b3f2-eb9734abed1b service nova] Creating event network-changed:57df8d9f-a9ff-49ba-a0ec-5581bc6e7cb6 for instance 07365fde-3701-46a6-aba7-4c6f74e181b9 on n-h1-858094-4 Sep 16 12:47:26.506816 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-4a5bad58-e047-4421-a1a4-fca5a168202b req-798287ab-6157-45ae-b3f2-eb9734abed1b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069096 Sep 16 12:47:26.510210 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 289/570] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:47:26.522251 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ff05d3b5-5ef0-4304-ad0e-923aa7d12495 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:26.524276 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ff05d3b5-5ef0-4304-ad0e-923aa7d12495 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:26.541051 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff05d3b5-5ef0-4304-ad0e-923aa7d12495 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:26.542266 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff05d3b5-5ef0-4304-ad0e-923aa7d12495 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:26.542857 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff05d3b5-5ef0-4304-ad0e-923aa7d12495 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:26.544440 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff05d3b5-5ef0-4304-ad0e-923aa7d12495 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:26.547558 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff05d3b5-5ef0-4304-ad0e-923aa7d12495 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:26.548453 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff05d3b5-5ef0-4304-ad0e-923aa7d12495 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:26.596158 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-badd4c0a-8981-4bf5-aeb6-a6219a2e9800 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709f71c239ca40b8b958038c9ab16f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7058e9e184834c39a5a299f481a6e62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:26.609329 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-badd4c0a-8981-4bf5-aeb6-a6219a2e9800 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9" status: 200 len: 1589 microversion: 2.1 time: 0.460228 Sep 16 12:47:26.609938 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 282/571] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:26 2022] GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9 => generated 1589 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:26.629107 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-618eba7a-ca4c-4292-8488-ad3759ef0e5a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:26.629722 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-618eba7a-ca4c-4292-8488-ad3759ef0e5a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: efea200a-0b78-42de-a9e2-febab9817590] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:26.646835 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-618eba7a-ca4c-4292-8488-ad3759ef0e5a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:26.647327 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-618eba7a-ca4c-4292-8488-ad3759ef0e5a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:26.647759 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-618eba7a-ca4c-4292-8488-ad3759ef0e5a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:26.653632 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-618eba7a-ca4c-4292-8488-ad3759ef0e5a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:26.658985 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-618eba7a-ca4c-4292-8488-ad3759ef0e5a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:26.659550 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-618eba7a-ca4c-4292-8488-ad3759ef0e5a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:26.889408 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ff05d3b5-5ef0-4304-ad0e-923aa7d12495 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6" status: 200 len: 1614 microversion: 2.1 time: 0.375557 Sep 16 12:47:26.890091 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 290/572] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:26 2022] GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 => generated 1614 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:26.895040 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0bf88840-4e80-4702-9638-582f88ecbf10 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:26.908554 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0bf88840-4e80-4702-9638-582f88ecbf10 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 566f231d-345e-4665-bf9a-b61004b954ed] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:26.915157 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bf88840-4e80-4702-9638-582f88ecbf10 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:26.917557 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bf88840-4e80-4702-9638-582f88ecbf10 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:26.918145 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bf88840-4e80-4702-9638-582f88ecbf10 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:26.920390 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bf88840-4e80-4702-9638-582f88ecbf10 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:26.921072 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bf88840-4e80-4702-9638-582f88ecbf10 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:26.921522 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bf88840-4e80-4702-9638-582f88ecbf10 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:26.958191 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-618eba7a-ca4c-4292-8488-ad3759ef0e5a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:26.968805 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-618eba7a-ca4c-4292-8488-ad3759ef0e5a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590" status: 200 len: 1312 microversion: 2.1 time: 0.355371 Sep 16 12:47:26.971760 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 283/573] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:26 2022] GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590 => generated 1312 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:26.983572 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b3d26145-7046-48f9-84d9-6ea6fc762c17 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:27.002209 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b3d26145-7046-48f9-84d9-6ea6fc762c17 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Searching by: {'host': 'n-h2-858094-4', 'deleted': False} {{(pid=128780) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 12:47:27.014848 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b3d26145-7046-48f9-84d9-6ea6fc762c17 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:27.015858 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b3d26145-7046-48f9-84d9-6ea6fc762c17 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:27.019316 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b3d26145-7046-48f9-84d9-6ea6fc762c17 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:27.020950 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b3d26145-7046-48f9-84d9-6ea6fc762c17 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:27.021795 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b3d26145-7046-48f9-84d9-6ea6fc762c17 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:27.022457 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b3d26145-7046-48f9-84d9-6ea6fc762c17 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:27.082452 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=17 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:47:27.220933 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.multi_cell_list [None req-b3d26145-7046-48f9-84d9-6ea6fc762c17 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=128780) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 12:47:27.261193 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0bf88840-4e80-4702-9638-582f88ecbf10 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:27.284461 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0bf88840-4e80-4702-9638-582f88ecbf10 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed" status: 200 len: 1311 microversion: 2.1 time: 0.392921 Sep 16 12:47:27.304749 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 291/574] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:26 2022] GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed => generated 1311 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:27.357042 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b3d26145-7046-48f9-84d9-6ea6fc762c17 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] 10.222.0.67 "GET /compute/v2.1/servers?host=n-h2-858094-4&all_tenants=1" status: 200 len: 1312 microversion: 2.1 time: 0.382530 Sep 16 12:47:27.365509 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 284/575] 10.222.0.67 () {58 vars in 1190 bytes} [Fri Sep 16 12:47:26 2022] GET /compute/v2.1/servers?host=n-h2-858094-4&all_tenants=1 => generated 1312 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:27.372273 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-999a41bd-d542-48ce-b1a7-9b6cba004017 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:27.393066 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-999a41bd-d542-48ce-b1a7-9b6cba004017 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=128779) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 12:47:27.398001 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-999a41bd-d542-48ce-b1a7-9b6cba004017 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:27.398492 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-999a41bd-d542-48ce-b1a7-9b6cba004017 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:27.398926 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-999a41bd-d542-48ce-b1a7-9b6cba004017 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:27.399652 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-999a41bd-d542-48ce-b1a7-9b6cba004017 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:27.400133 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-999a41bd-d542-48ce-b1a7-9b6cba004017 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:27.400806 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-999a41bd-d542-48ce-b1a7-9b6cba004017 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:27.458021 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2d9c1a2f-c736-42b7-8526-6d65433e295e tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:27.458644 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-2d9c1a2f-c736-42b7-8526-6d65433e295e tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] [instance: ad946bd5-7ee5-47d6-a52f-00e8511d2bd6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:27.470156 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2d9c1a2f-c736-42b7-8526-6d65433e295e tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:27.471006 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2d9c1a2f-c736-42b7-8526-6d65433e295e tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:27.471679 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2d9c1a2f-c736-42b7-8526-6d65433e295e tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:27.472686 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2d9c1a2f-c736-42b7-8526-6d65433e295e tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:27.476883 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2d9c1a2f-c736-42b7-8526-6d65433e295e tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:27.477719 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2d9c1a2f-c736-42b7-8526-6d65433e295e tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:27.572995 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-999a41bd-d542-48ce-b1a7-9b6cba004017 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] 10.222.0.67 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.205995 Sep 16 12:47:27.574604 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 292/576] 10.222.0.67 () {58 vars in 1196 bytes} [Fri Sep 16 12:47:27 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 12:47:27.579791 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-69703b24-9c9a-4c88-8d55-b3b7047e098d req-d7e715a3-30a6-42ab-918d-2e98349333ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "566f231d-345e-4665-bf9a-b61004b954ed", "name": "network-vif-plugged", "status": "completed", "tag": "924f27c6-9b29-461f-bbff-57520beb8e29"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:27.589664 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-69703b24-9c9a-4c88-8d55-b3b7047e098d req-d7e715a3-30a6-42ab-918d-2e98349333ca service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:27.590705 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-69703b24-9c9a-4c88-8d55-b3b7047e098d req-d7e715a3-30a6-42ab-918d-2e98349333ca service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:27.591347 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-69703b24-9c9a-4c88-8d55-b3b7047e098d req-d7e715a3-30a6-42ab-918d-2e98349333ca service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:27.606256 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-69703b24-9c9a-4c88-8d55-b3b7047e098d req-d7e715a3-30a6-42ab-918d-2e98349333ca service nova] Creating event network-vif-plugged:924f27c6-9b29-461f-bbff-57520beb8e29 for instance 566f231d-345e-4665-bf9a-b61004b954ed on n-h2-858094-4 Sep 16 12:47:27.623316 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-69703b24-9c9a-4c88-8d55-b3b7047e098d req-d7e715a3-30a6-42ab-918d-2e98349333ca service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047176 Sep 16 12:47:27.625270 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 293/577] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:47:27.631569 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cc769c3d-effc-4060-a987-f9d539540453 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:27.638316 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cc769c3d-effc-4060-a987-f9d539540453 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:27.651502 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc769c3d-effc-4060-a987-f9d539540453 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:27.659187 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc769c3d-effc-4060-a987-f9d539540453 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:27.660105 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc769c3d-effc-4060-a987-f9d539540453 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:27.662873 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc769c3d-effc-4060-a987-f9d539540453 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:27.664429 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc769c3d-effc-4060-a987-f9d539540453 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:27.665141 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc769c3d-effc-4060-a987-f9d539540453 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:27.828530 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cc769c3d-effc-4060-a987-f9d539540453 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6/action" status: 202 len: 0 microversion: 2.1 time: 0.201127 Sep 16 12:47:27.829702 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 294/578] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:47:27 2022] POST /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:47:27.837501 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4faf00c0-5ac7-4552-b923-28d438dbdccb tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:27.840543 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4faf00c0-5ac7-4552-b923-28d438dbdccb tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:27.862041 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4faf00c0-5ac7-4552-b923-28d438dbdccb tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:27.862540 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4faf00c0-5ac7-4552-b923-28d438dbdccb tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:27.862978 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4faf00c0-5ac7-4552-b923-28d438dbdccb tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:27.863703 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4faf00c0-5ac7-4552-b923-28d438dbdccb tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:27.864179 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4faf00c0-5ac7-4552-b923-28d438dbdccb tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:27.864715 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4faf00c0-5ac7-4552-b923-28d438dbdccb tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:28.024097 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-4faf00c0-5ac7-4552-b923-28d438dbdccb tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:47:28.024563 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-4faf00c0-5ac7-4552-b923-28d438dbdccb tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:47:28.025035 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-4faf00c0-5ac7-4552-b923-28d438dbdccb tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:47:28.025875 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-4faf00c0-5ac7-4552-b923-28d438dbdccb tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:47:28.026483 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-4faf00c0-5ac7-4552-b923-28d438dbdccb tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:47:28.051845 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=13 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:47:28.133433 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=5 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:47:28.229084 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4faf00c0-5ac7-4552-b923-28d438dbdccb tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:28.237790 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4faf00c0-5ac7-4552-b923-28d438dbdccb tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:28.238294 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4faf00c0-5ac7-4552-b923-28d438dbdccb tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:28.238741 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4faf00c0-5ac7-4552-b923-28d438dbdccb tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:28.239467 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4faf00c0-5ac7-4552-b923-28d438dbdccb tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:28.239926 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4faf00c0-5ac7-4552-b923-28d438dbdccb tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:28.246590 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4faf00c0-5ac7-4552-b923-28d438dbdccb tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:28.346137 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4faf00c0-5ac7-4552-b923-28d438dbdccb tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "POST /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6/action" status: 202 len: 1067 microversion: 2.1 time: 0.512455 Sep 16 12:47:28.346794 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 295/579] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:47:27 2022] POST /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6/action => generated 1067 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Sep 16 12:47:28.366227 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fe44cb0a-9608-429c-985c-692099678d1a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:28.367119 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fe44cb0a-9608-429c-985c-692099678d1a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: efea200a-0b78-42de-a9e2-febab9817590] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:28.383943 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe44cb0a-9608-429c-985c-692099678d1a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:28.387175 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe44cb0a-9608-429c-985c-692099678d1a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:28.389192 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe44cb0a-9608-429c-985c-692099678d1a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:28.393319 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe44cb0a-9608-429c-985c-692099678d1a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:28.394351 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe44cb0a-9608-429c-985c-692099678d1a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:28.395711 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe44cb0a-9608-429c-985c-692099678d1a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:28.479016 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-2d9c1a2f-c736-42b7-8526-6d65433e295e tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318566be918e44a4894403f766cbd5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4b83da544e4980b1c2fe2b1f597016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:28.491252 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2d9c1a2f-c736-42b7-8526-6d65433e295e tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] 10.222.0.67 "GET /compute/v2.1/servers/ad946bd5-7ee5-47d6-a52f-00e8511d2bd6" status: 200 len: 1323 microversion: 2.1 time: 1.037497 Sep 16 12:47:28.491843 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 285/580] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:27 2022] GET /compute/v2.1/servers/ad946bd5-7ee5-47d6-a52f-00e8511d2bd6 => generated 1323 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:47:28.509600 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8baa5a3e-ac4e-4ffc-af9c-7ec76a19c453 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:28.510220 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8baa5a3e-ac4e-4ffc-af9c-7ec76a19c453 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 566f231d-345e-4665-bf9a-b61004b954ed] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:28.532769 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8baa5a3e-ac4e-4ffc-af9c-7ec76a19c453 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:28.533270 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8baa5a3e-ac4e-4ffc-af9c-7ec76a19c453 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:28.533702 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8baa5a3e-ac4e-4ffc-af9c-7ec76a19c453 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:28.534423 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8baa5a3e-ac4e-4ffc-af9c-7ec76a19c453 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:28.545764 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8baa5a3e-ac4e-4ffc-af9c-7ec76a19c453 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:28.546286 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8baa5a3e-ac4e-4ffc-af9c-7ec76a19c453 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:29.257507 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8baa5a3e-ac4e-4ffc-af9c-7ec76a19c453 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:29.262488 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fe44cb0a-9608-429c-985c-692099678d1a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:29.271817 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8baa5a3e-ac4e-4ffc-af9c-7ec76a19c453 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed" status: 200 len: 1311 microversion: 2.1 time: 0.769815 Sep 16 12:47:29.272948 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 286/581] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:28 2022] GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed => generated 1311 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:29.279772 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fe44cb0a-9608-429c-985c-692099678d1a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590" status: 200 len: 1312 microversion: 2.1 time: 0.927422 Sep 16 12:47:29.282519 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 296/582] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:28 2022] GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590 => generated 1312 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:29.288531 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d12267d2-479f-4c64-a9ac-94c199c2e6ca tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:29.289150 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d12267d2-479f-4c64-a9ac-94c199c2e6ca tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:29.305773 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d12267d2-479f-4c64-a9ac-94c199c2e6ca tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:29.306950 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d12267d2-479f-4c64-a9ac-94c199c2e6ca tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:29.307558 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d12267d2-479f-4c64-a9ac-94c199c2e6ca tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:29.308466 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d12267d2-479f-4c64-a9ac-94c199c2e6ca tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:29.309062 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d12267d2-479f-4c64-a9ac-94c199c2e6ca tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:29.309628 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d12267d2-479f-4c64-a9ac-94c199c2e6ca tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:29.519811 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-14d65b88-6bb6-4c63-b706-ff52da4bd29a tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:29.520831 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-14d65b88-6bb6-4c63-b706-ff52da4bd29a tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] [instance: ad946bd5-7ee5-47d6-a52f-00e8511d2bd6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:29.532108 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14d65b88-6bb6-4c63-b706-ff52da4bd29a tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:29.534868 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14d65b88-6bb6-4c63-b706-ff52da4bd29a tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:29.535775 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14d65b88-6bb6-4c63-b706-ff52da4bd29a tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:29.539493 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14d65b88-6bb6-4c63-b706-ff52da4bd29a tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:29.540312 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14d65b88-6bb6-4c63-b706-ff52da4bd29a tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:29.540948 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14d65b88-6bb6-4c63-b706-ff52da4bd29a tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:29.578037 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d12267d2-479f-4c64-a9ac-94c199c2e6ca tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:29.595672 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d12267d2-479f-4c64-a9ac-94c199c2e6ca tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6" status: 200 len: 1471 microversion: 2.1 time: 0.317543 Sep 16 12:47:29.596847 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 287/583] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:29 2022] GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 => generated 1471 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:30.307109 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6bd7a8f7-8eed-4a05-9645-7840c1210e91 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:30.307736 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6bd7a8f7-8eed-4a05-9645-7840c1210e91 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 566f231d-345e-4665-bf9a-b61004b954ed] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:30.330890 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6bd7a8f7-8eed-4a05-9645-7840c1210e91 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:30.331402 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6bd7a8f7-8eed-4a05-9645-7840c1210e91 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:30.331837 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6bd7a8f7-8eed-4a05-9645-7840c1210e91 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:30.332585 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6bd7a8f7-8eed-4a05-9645-7840c1210e91 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:30.335213 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6bd7a8f7-8eed-4a05-9645-7840c1210e91 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:30.337537 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6bd7a8f7-8eed-4a05-9645-7840c1210e91 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:30.448995 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-14d65b88-6bb6-4c63-b706-ff52da4bd29a tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318566be918e44a4894403f766cbd5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4b83da544e4980b1c2fe2b1f597016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:30.476054 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-14d65b88-6bb6-4c63-b706-ff52da4bd29a tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] 10.222.0.67 "GET /compute/v2.1/servers/ad946bd5-7ee5-47d6-a52f-00e8511d2bd6" status: 200 len: 1472 microversion: 2.1 time: 0.955289 Sep 16 12:47:30.477031 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 297/584] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:29 2022] GET /compute/v2.1/servers/ad946bd5-7ee5-47d6-a52f-00e8511d2bd6 => generated 1472 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:47:30.483076 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d3bf5ac6-cb29-4df2-886a-1b61ae85660f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:30.483684 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d3bf5ac6-cb29-4df2-886a-1b61ae85660f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: efea200a-0b78-42de-a9e2-febab9817590] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:30.511672 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3bf5ac6-cb29-4df2-886a-1b61ae85660f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:30.512197 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3bf5ac6-cb29-4df2-886a-1b61ae85660f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:30.513256 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3bf5ac6-cb29-4df2-886a-1b61ae85660f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:30.513974 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3bf5ac6-cb29-4df2-886a-1b61ae85660f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:30.520100 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3bf5ac6-cb29-4df2-886a-1b61ae85660f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:30.521829 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3bf5ac6-cb29-4df2-886a-1b61ae85660f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:30.788739 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6bd7a8f7-8eed-4a05-9645-7840c1210e91 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:30.803131 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6bd7a8f7-8eed-4a05-9645-7840c1210e91 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed" status: 200 len: 1494 microversion: 2.1 time: 0.508891 Sep 16 12:47:30.806978 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 288/585] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:30 2022] GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed => generated 1494 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:30.813189 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6d212016-e30b-479d-b40e-6f3a864bff66 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:30.814083 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6d212016-e30b-479d-b40e-6f3a864bff66 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] [instance: ad946bd5-7ee5-47d6-a52f-00e8511d2bd6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:30.864013 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6d212016-e30b-479d-b40e-6f3a864bff66 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:30.869320 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6d212016-e30b-479d-b40e-6f3a864bff66 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:30.869773 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6d212016-e30b-479d-b40e-6f3a864bff66 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:30.870526 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6d212016-e30b-479d-b40e-6f3a864bff66 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:30.870987 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6d212016-e30b-479d-b40e-6f3a864bff66 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:30.871419 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6d212016-e30b-479d-b40e-6f3a864bff66 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:30.902850 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d3bf5ac6-cb29-4df2-886a-1b61ae85660f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:30.913940 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d3bf5ac6-cb29-4df2-886a-1b61ae85660f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590" status: 200 len: 1312 microversion: 2.1 time: 0.434505 Sep 16 12:47:30.915480 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 298/586] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:30 2022] GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590 => generated 1312 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:30.920775 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3a476344-da87-4de1-bf6f-f75b5f31ef92 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:30.922248 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3a476344-da87-4de1-bf6f-f75b5f31ef92 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:30.927470 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6d212016-e30b-479d-b40e-6f3a864bff66 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '318566be918e44a4894403f766cbd5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4b83da544e4980b1c2fe2b1f597016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:30.930133 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a476344-da87-4de1-bf6f-f75b5f31ef92 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:30.930884 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a476344-da87-4de1-bf6f-f75b5f31ef92 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:30.932024 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a476344-da87-4de1-bf6f-f75b5f31ef92 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:30.932857 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6d212016-e30b-479d-b40e-6f3a864bff66 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Request method failure captured: Sep 16 12:47:30.932857 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/ad946bd5-7ee5-47d6-a52f-00e8511d2bd6/diagnostics HTTP/1.1 Sep 16 12:47:30.932857 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:47:30.932857 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:47:30.932857 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:47:30.932857 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:47:30.932857 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:47:30.932857 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:47:30.932857 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:47:30.932857 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:47:30.932857 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHBC_h7biO6kfhPxKvOAswUSz3dWH_Z_mSvSZRgQHexTeK3JR-w9ARos20-HGzAKnbiNS1bCmnvi2OvjPUdVmeyg9T5zho29OyJTG7_YhIGcVc-DUNB6zyhenKjr6rFVcPyZdBShtULty1Bu0d_wntSC8-_QNjOnxnLOO0YOeSQg91Y Sep 16 12:47:30.932857 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:47:30.932857 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:47:30.932857 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:47:30.932857 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:47:30.932857 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:47:30.932857 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:47:30.932857 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 6e4b83da544e4980b1c2fe2b1f597016 Sep 16 12:47:30.932857 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-936469481 Sep 16 12:47:30.932857 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:47:30.932857 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:47:30.934374 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6e4b83da544e4980b1c2fe2b1f597016"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6e4b83da544e4980b1c2fe2b1f597016"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6e4b83da544e4980b1c2fe2b1f597016", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6e4b83da544e4980b1c2fe2b1f597016"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:47:30.934374 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-936469481 Sep 16 12:47:30.934374 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 6e4b83da544e4980b1c2fe2b1f597016 Sep 16 12:47:30.934374 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-936469481 Sep 16 12:47:30.934374 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ServerDiagnosticsNegativeTest-936469481-project Sep 16 12:47:30.934374 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:47:30.934374 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:47:30.934374 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 318566be918e44a4894403f766cbd5cb Sep 16 12:47:30.934374 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-936469481-project Sep 16 12:47:30.934374 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:47:30.934374 n-d-858094-4 devstack@n-api.service[128780]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 16 12:47:30.935159 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'server_id': 'ad946bd5-7ee5-47d6-a52f-00e8511d2bd6'} Sep 16 12:47:30.935159 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:47:30.935159 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:47:30.935159 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:47:30.935159 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:47:30.935159 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:47:30.935159 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:47:30.935159 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:47:30.935159 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:47:30.935159 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Sep 16 12:47:30.935159 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Sep 16 12:47:30.935159 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 12:47:30.935159 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 12:47:30.935159 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 12:47:30.935159 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 12:47:30.935159 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:47:30.935159 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:47:30.935159 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:47:30.935159 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:47:30.935159 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 12:47:30.936581 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 12:47:30.936581 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 12:47:30.936581 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 12:47:30.936581 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 12:47:30.936581 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 12:47:30.936581 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 16 12:47:30.936581 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:47:30.936581 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:47:30.936581 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:47:30.936581 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:47:30.936581 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:47:30.936581 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:47:30.936581 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 12:47:30.936581 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 12:47:30.936581 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 16 12:47:30.936581 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:47:30.938329 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a476344-da87-4de1-bf6f-f75b5f31ef92 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:30.938422 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6d212016-e30b-479d-b40e-6f3a864bff66 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:47:30.938422 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6d212016-e30b-479d-b40e-6f3a864bff66 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] 10.222.0.67 "GET /compute/v2.1/servers/ad946bd5-7ee5-47d6-a52f-00e8511d2bd6/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.126908 Sep 16 12:47:30.938422 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 289/587] 10.222.0.67 () {58 vars in 1272 bytes} [Fri Sep 16 12:47:30 2022] GET /compute/v2.1/servers/ad946bd5-7ee5-47d6-a52f-00e8511d2bd6/diagnostics => generated 117 bytes in 128 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:47:30.938657 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a476344-da87-4de1-bf6f-f75b5f31ef92 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:30.939297 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a476344-da87-4de1-bf6f-f75b5f31ef92 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:30.993130 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=3 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:47:31.226447 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3a476344-da87-4de1-bf6f-f75b5f31ef92 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:31.241996 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3a476344-da87-4de1-bf6f-f75b5f31ef92 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6" status: 200 len: 1471 microversion: 2.1 time: 0.323340 Sep 16 12:47:31.256148 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 299/588] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:30 2022] GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 => generated 1471 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:31.256148 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-515ea6b9-b330-4adf-990a-abaea0cf91d7 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:31.256148 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-515ea6b9-b330-4adf-990a-abaea0cf91d7 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] [instance: ad946bd5-7ee5-47d6-a52f-00e8511d2bd6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:31.264623 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-515ea6b9-b330-4adf-990a-abaea0cf91d7 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:31.265320 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-515ea6b9-b330-4adf-990a-abaea0cf91d7 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:31.265711 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-515ea6b9-b330-4adf-990a-abaea0cf91d7 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:31.266738 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-515ea6b9-b330-4adf-990a-abaea0cf91d7 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:31.268100 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-515ea6b9-b330-4adf-990a-abaea0cf91d7 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:31.268940 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-515ea6b9-b330-4adf-990a-abaea0cf91d7 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:31.327158 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-515ea6b9-b330-4adf-990a-abaea0cf91d7 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] [instance: ad946bd5-7ee5-47d6-a52f-00e8511d2bd6] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:47:31.391947 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8aaaaf4e-e2f1-4ac1-8e33-4400913bcbe5 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:31.392664 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8aaaaf4e-e2f1-4ac1-8e33-4400913bcbe5 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] [instance: 566f231d-345e-4665-bf9a-b61004b954ed] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:31.405179 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8aaaaf4e-e2f1-4ac1-8e33-4400913bcbe5 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:31.406851 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8aaaaf4e-e2f1-4ac1-8e33-4400913bcbe5 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:31.407309 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8aaaaf4e-e2f1-4ac1-8e33-4400913bcbe5 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:31.408038 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8aaaaf4e-e2f1-4ac1-8e33-4400913bcbe5 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:31.408522 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8aaaaf4e-e2f1-4ac1-8e33-4400913bcbe5 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:31.413116 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8aaaaf4e-e2f1-4ac1-8e33-4400913bcbe5 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:31.495898 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-515ea6b9-b330-4adf-990a-abaea0cf91d7 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ad946bd5-7ee5-47d6-a52f-00e8511d2bd6" status: 204 len: 0 microversion: 2.1 time: 0.249332 Sep 16 12:47:31.497391 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 300/589] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:47:31 2022] DELETE /compute/v2.1/servers/ad946bd5-7ee5-47d6-a52f-00e8511d2bd6 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:47:31.507368 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-10699223-5f01-41b9-bb68-5ec9b8c96d74 req-d1d449e2-f18a-4f6b-853b-10628aa8bc6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efea200a-0b78-42de-a9e2-febab9817590", "name": "network-vif-plugged", "status": "completed", "tag": "3fe50ad6-99ae-4c0b-a11b-3e41218b0317"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:31.536759 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-10699223-5f01-41b9-bb68-5ec9b8c96d74 req-d1d449e2-f18a-4f6b-853b-10628aa8bc6a service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:31.537541 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-10699223-5f01-41b9-bb68-5ec9b8c96d74 req-d1d449e2-f18a-4f6b-853b-10628aa8bc6a service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:31.538932 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-10699223-5f01-41b9-bb68-5ec9b8c96d74 req-d1d449e2-f18a-4f6b-853b-10628aa8bc6a service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:31.569683 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-10699223-5f01-41b9-bb68-5ec9b8c96d74 req-d1d449e2-f18a-4f6b-853b-10628aa8bc6a service nova] Creating event network-vif-plugged:3fe50ad6-99ae-4c0b-a11b-3e41218b0317 for instance efea200a-0b78-42de-a9e2-febab9817590 on n-h2-858094-4 Sep 16 12:47:31.580809 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-10699223-5f01-41b9-bb68-5ec9b8c96d74 req-d1d449e2-f18a-4f6b-853b-10628aa8bc6a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081209 Sep 16 12:47:31.585583 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 301/590] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:47:31.599137 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-eba845ef-dc10-4d24-8f81-02062c080411 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:31.601618 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-eba845ef-dc10-4d24-8f81-02062c080411 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] [instance: ad946bd5-7ee5-47d6-a52f-00e8511d2bd6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:31.620938 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eba845ef-dc10-4d24-8f81-02062c080411 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:31.622178 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eba845ef-dc10-4d24-8f81-02062c080411 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:31.622641 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eba845ef-dc10-4d24-8f81-02062c080411 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:31.623365 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eba845ef-dc10-4d24-8f81-02062c080411 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:31.623818 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eba845ef-dc10-4d24-8f81-02062c080411 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:31.624273 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eba845ef-dc10-4d24-8f81-02062c080411 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:31.672503 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:47:31.687675 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8aaaaf4e-e2f1-4ac1-8e33-4400913bcbe5 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed" status: 200 len: 1645 microversion: 2.1 time: 0.747530 Sep 16 12:47:31.700191 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 290/591] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:30 2022] GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed => generated 1645 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:31.711142 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-14f4c769-ea38-4334-a8bf-8e55b7352917 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:31.711880 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-14f4c769-ea38-4334-a8bf-8e55b7352917 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] [instance: 566f231d-345e-4665-bf9a-b61004b954ed] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:31.719439 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=100 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:47:31.721492 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14f4c769-ea38-4334-a8bf-8e55b7352917 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:31.722317 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14f4c769-ea38-4334-a8bf-8e55b7352917 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:31.722744 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14f4c769-ea38-4334-a8bf-8e55b7352917 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:31.723921 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14f4c769-ea38-4334-a8bf-8e55b7352917 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:31.724468 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14f4c769-ea38-4334-a8bf-8e55b7352917 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:31.724961 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14f4c769-ea38-4334-a8bf-8e55b7352917 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:31.963350 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-eba845ef-dc10-4d24-8f81-02062c080411 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318566be918e44a4894403f766cbd5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4b83da544e4980b1c2fe2b1f597016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:31.980670 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-eba845ef-dc10-4d24-8f81-02062c080411 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] 10.222.0.67 "GET /compute/v2.1/servers/ad946bd5-7ee5-47d6-a52f-00e8511d2bd6" status: 200 len: 1478 microversion: 2.1 time: 0.393096 Sep 16 12:47:31.982163 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 302/592] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:31 2022] GET /compute/v2.1/servers/ad946bd5-7ee5-47d6-a52f-00e8511d2bd6 => generated 1478 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:31.990611 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-07685520-66b0-4340-85fd-802e09fe68b8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:31.991556 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-07685520-66b0-4340-85fd-802e09fe68b8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: efea200a-0b78-42de-a9e2-febab9817590] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:31.998674 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07685520-66b0-4340-85fd-802e09fe68b8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:31.999182 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07685520-66b0-4340-85fd-802e09fe68b8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:32.000994 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07685520-66b0-4340-85fd-802e09fe68b8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:32.007893 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07685520-66b0-4340-85fd-802e09fe68b8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:32.016288 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-14f4c769-ea38-4334-a8bf-8e55b7352917 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed" status: 200 len: 1645 microversion: 2.1 time: 0.309051 Sep 16 12:47:32.017054 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07685520-66b0-4340-85fd-802e09fe68b8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:32.017850 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07685520-66b0-4340-85fd-802e09fe68b8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:32.018773 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 291/593] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:31 2022] GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed => generated 1645 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:47:32.046067 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-509b0d06-e5e5-4f2e-9dd5-3cf498765797 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:32.057233 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-509b0d06-e5e5-4f2e-9dd5-3cf498765797 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:32.057728 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-509b0d06-e5e5-4f2e-9dd5-3cf498765797 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:32.058172 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-509b0d06-e5e5-4f2e-9dd5-3cf498765797 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:32.058913 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-509b0d06-e5e5-4f2e-9dd5-3cf498765797 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:32.059432 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-509b0d06-e5e5-4f2e-9dd5-3cf498765797 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:32.060062 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-509b0d06-e5e5-4f2e-9dd5-3cf498765797 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:32.100390 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-509b0d06-e5e5-4f2e-9dd5-3cf498765797 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.059557 Sep 16 12:47:32.102783 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 292/594] 10.222.0.67 () {58 vars in 1176 bytes} [Fri Sep 16 12:47:32 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:47:32.122851 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5c3c2507-9e47-4d1c-9bf4-8477102e832a tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858094-4", "block_migration": true, "disk_over_commit": false}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:32.126051 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5c3c2507-9e47-4d1c-9bf4-8477102e832a tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] [instance: 566f231d-345e-4665-bf9a-b61004b954ed] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:32.146451 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5c3c2507-9e47-4d1c-9bf4-8477102e832a tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:32.148611 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5c3c2507-9e47-4d1c-9bf4-8477102e832a tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:32.152546 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5c3c2507-9e47-4d1c-9bf4-8477102e832a tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:32.153807 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5c3c2507-9e47-4d1c-9bf4-8477102e832a tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:32.155209 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5c3c2507-9e47-4d1c-9bf4-8477102e832a tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:32.155643 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5c3c2507-9e47-4d1c-9bf4-8477102e832a tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:32.252171 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-07685520-66b0-4340-85fd-802e09fe68b8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:32.267033 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-07685520-66b0-4340-85fd-802e09fe68b8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590" status: 200 len: 1312 microversion: 2.1 time: 0.283591 Sep 16 12:47:32.268221 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 303/595] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:31 2022] GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590 => generated 1312 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:32.274670 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6b50a6f5-4804-4e08-9d74-b862407e51d6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:32.276260 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6b50a6f5-4804-4e08-9d74-b862407e51d6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:32.282455 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:47:32.284513 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b50a6f5-4804-4e08-9d74-b862407e51d6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:32.285326 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b50a6f5-4804-4e08-9d74-b862407e51d6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:32.286430 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b50a6f5-4804-4e08-9d74-b862407e51d6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:32.287522 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b50a6f5-4804-4e08-9d74-b862407e51d6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:32.288327 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b50a6f5-4804-4e08-9d74-b862407e51d6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:32.288905 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b50a6f5-4804-4e08-9d74-b862407e51d6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:32.434745 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-5c3c2507-9e47-4d1c-9bf4-8477102e832a tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lazy-loading 'flavor' on Instance uuid 566f231d-345e-4665-bf9a-b61004b954ed {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:47:32.496932 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6b50a6f5-4804-4e08-9d74-b862407e51d6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:32.506900 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6b50a6f5-4804-4e08-9d74-b862407e51d6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6" status: 200 len: 1471 microversion: 2.1 time: 0.237389 Sep 16 12:47:32.507905 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 304/596] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:32 2022] GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 => generated 1471 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:32.564902 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5c3c2507-9e47-4d1c-9bf4-8477102e832a tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] [instance: 566f231d-345e-4665-bf9a-b61004b954ed] Going to try to live migrate instance to n-h1-858094-4 {{(pid=128780) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 16 12:47:33.341530 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-75e0840d-9b9f-4638-af9a-2e7fd58f976c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-764917093", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:33.440770 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-75e0840d-9b9f-4638-af9a-2e7fd58f976c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] validate_networks() for None {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:47:33.828952 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-75e0840d-9b9f-4638-af9a-2e7fd58f976c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:47:33.829571 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-75e0840d-9b9f-4638-af9a-2e7fd58f976c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:47:33.829819 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-75e0840d-9b9f-4638-af9a-2e7fd58f976c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:47:33.830229 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-75e0840d-9b9f-4638-af9a-2e7fd58f976c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:47:33.830650 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-75e0840d-9b9f-4638-af9a-2e7fd58f976c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:47:33.841106 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75e0840d-9b9f-4638-af9a-2e7fd58f976c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:33.841965 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75e0840d-9b9f-4638-af9a-2e7fd58f976c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:33.842555 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75e0840d-9b9f-4638-af9a-2e7fd58f976c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:33.843519 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75e0840d-9b9f-4638-af9a-2e7fd58f976c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:33.844411 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75e0840d-9b9f-4638-af9a-2e7fd58f976c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:33.845011 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75e0840d-9b9f-4638-af9a-2e7fd58f976c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:33.877873 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-75e0840d-9b9f-4638-af9a-2e7fd58f976c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Getting quotas for project 8c037a6456444018a6ef54314419e2f2. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:47:33.884897 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-75e0840d-9b9f-4638-af9a-2e7fd58f976c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Getting quotas for user c1928790cac542ec86add5794851f97a and project 8c037a6456444018a6ef54314419e2f2. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:47:33.904365 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-75e0840d-9b9f-4638-af9a-2e7fd58f976c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:47:33.907133 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-75e0840d-9b9f-4638-af9a-2e7fd58f976c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 8c7aea62-7b4d-400d-89fa-5411deefe490] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:47:33.965607 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-75e0840d-9b9f-4638-af9a-2e7fd58f976c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.049585 Sep 16 12:47:33.966523 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 305/597] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:47:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:47:33.973068 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cb812f1b-9d8b-4c7f-bea4-8c2d5c4533f9 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:33.973816 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cb812f1b-9d8b-4c7f-bea4-8c2d5c4533f9 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] [instance: ad946bd5-7ee5-47d6-a52f-00e8511d2bd6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:33.982106 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb812f1b-9d8b-4c7f-bea4-8c2d5c4533f9 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:33.982782 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb812f1b-9d8b-4c7f-bea4-8c2d5c4533f9 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:33.983346 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb812f1b-9d8b-4c7f-bea4-8c2d5c4533f9 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:33.985066 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb812f1b-9d8b-4c7f-bea4-8c2d5c4533f9 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:33.985655 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb812f1b-9d8b-4c7f-bea4-8c2d5c4533f9 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:33.986383 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb812f1b-9d8b-4c7f-bea4-8c2d5c4533f9 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:34.103309 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cb812f1b-9d8b-4c7f-bea4-8c2d5c4533f9 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318566be918e44a4894403f766cbd5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4b83da544e4980b1c2fe2b1f597016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:34.122926 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cb812f1b-9d8b-4c7f-bea4-8c2d5c4533f9 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] 10.222.0.67 "GET /compute/v2.1/servers/ad946bd5-7ee5-47d6-a52f-00e8511d2bd6" status: 200 len: 1436 microversion: 2.1 time: 0.154088 Sep 16 12:47:34.126718 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 306/598] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:33 2022] GET /compute/v2.1/servers/ad946bd5-7ee5-47d6-a52f-00e8511d2bd6 => generated 1436 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:34.222522 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-16f8c9b2-60b8-46e1-b9b6-1b7ea1ee1295 tempest-FloatingIPDetailsTestJSON-569140138 tempest-FloatingIPDetailsTestJSON-569140138-project] Action: 'create', calling method: .version_select at 0x7f1035caa3a0>, body: {"pool": null} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:35.190274 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5c3c2507-9e47-4d1c-9bf4-8477102e832a tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed/action" status: 202 len: 0 microversion: 2.1 time: 3.076658 Sep 16 12:47:35.191644 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 293/599] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:47:32 2022] POST /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed/action => generated 0 bytes in 3080 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 12:47:35.200756 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9b0a0a8d-d051-429c-ace9-ac5f055df838 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:35.201630 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9b0a0a8d-d051-429c-ace9-ac5f055df838 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: efea200a-0b78-42de-a9e2-febab9817590] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:35.224873 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9b0a0a8d-d051-429c-ace9-ac5f055df838 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:35.226442 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9b0a0a8d-d051-429c-ace9-ac5f055df838 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:35.226888 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9b0a0a8d-d051-429c-ace9-ac5f055df838 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:35.227635 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9b0a0a8d-d051-429c-ace9-ac5f055df838 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:35.229290 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9b0a0a8d-d051-429c-ace9-ac5f055df838 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:35.229729 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9b0a0a8d-d051-429c-ace9-ac5f055df838 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:35.625445 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9b0a0a8d-d051-429c-ace9-ac5f055df838 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:35.634699 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9b0a0a8d-d051-429c-ace9-ac5f055df838 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590" status: 200 len: 1462 microversion: 2.1 time: 0.441530 Sep 16 12:47:35.638261 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 294/600] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:35 2022] GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590 => generated 1462 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:35.719158 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7e56c111-d4d1-4aae-9099-3f6c2a4249a9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-262990515", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": [{"uuid": "0e610de6-3238-41c3-bd1a-f23917fad801"}]}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:35.812416 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-7e56c111-d4d1-4aae-9099-3f6c2a4249a9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] validate_networks() for [('0e610de6-3238-41c3-bd1a-f23917fad801', None, None, None, None, None)] {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:47:37.595565 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-16f8c9b2-60b8-46e1-b9b6-1b7ea1ee1295 tempest-FloatingIPDetailsTestJSON-569140138 tempest-FloatingIPDetailsTestJSON-569140138-project] 10.222.0.67 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.465735 Sep 16 12:47:37.597349 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 307/601] 10.222.0.67 () {60 vars in 1170 bytes} [Fri Sep 16 12:47:34 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:47:37.604942 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b8bc0966-b503-4fd8-964f-d9cac9f890b1 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:37.606360 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b8bc0966-b503-4fd8-964f-d9cac9f890b1 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:37.617161 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8bc0966-b503-4fd8-964f-d9cac9f890b1 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:37.617887 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8bc0966-b503-4fd8-964f-d9cac9f890b1 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:37.618538 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8bc0966-b503-4fd8-964f-d9cac9f890b1 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:37.620172 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8bc0966-b503-4fd8-964f-d9cac9f890b1 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:37.620864 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8bc0966-b503-4fd8-964f-d9cac9f890b1 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:37.621516 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8bc0966-b503-4fd8-964f-d9cac9f890b1 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:37.704671 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-7e56c111-d4d1-4aae-9099-3f6c2a4249a9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:47:37.705143 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-7e56c111-d4d1-4aae-9099-3f6c2a4249a9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:47:37.705807 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-7e56c111-d4d1-4aae-9099-3f6c2a4249a9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:47:37.706521 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-7e56c111-d4d1-4aae-9099-3f6c2a4249a9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:47:37.706918 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-7e56c111-d4d1-4aae-9099-3f6c2a4249a9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:47:37.716517 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7e56c111-d4d1-4aae-9099-3f6c2a4249a9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:37.717216 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7e56c111-d4d1-4aae-9099-3f6c2a4249a9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:37.717646 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7e56c111-d4d1-4aae-9099-3f6c2a4249a9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:37.718415 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7e56c111-d4d1-4aae-9099-3f6c2a4249a9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:37.719035 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7e56c111-d4d1-4aae-9099-3f6c2a4249a9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:37.719469 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7e56c111-d4d1-4aae-9099-3f6c2a4249a9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:37.746787 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-7e56c111-d4d1-4aae-9099-3f6c2a4249a9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Getting quotas for project e6fa2067c44b42b5aa940619abd8e538. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:47:37.752683 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-7e56c111-d4d1-4aae-9099-3f6c2a4249a9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Getting quotas for user 0cf11dfc3438406ba2710b06fa0fe8ff and project e6fa2067c44b42b5aa940619abd8e538. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:47:37.766650 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7e56c111-d4d1-4aae-9099-3f6c2a4249a9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:47:37.768975 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7e56c111-d4d1-4aae-9099-3f6c2a4249a9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: c077c0ae-56e2-42f7-a0e7-32e6597062c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:47:37.819588 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7e56c111-d4d1-4aae-9099-3f6c2a4249a9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.179534 Sep 16 12:47:37.820378 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 295/602] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:47:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2181 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:47:37.825120 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3181b97b-a4cd-498c-9377-c9b922ec213a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:37.825948 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3181b97b-a4cd-498c-9377-c9b922ec213a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 8c7aea62-7b4d-400d-89fa-5411deefe490] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:37.832481 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3181b97b-a4cd-498c-9377-c9b922ec213a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:37.832972 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3181b97b-a4cd-498c-9377-c9b922ec213a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:37.833404 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3181b97b-a4cd-498c-9377-c9b922ec213a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:37.834101 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3181b97b-a4cd-498c-9377-c9b922ec213a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:37.834547 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3181b97b-a4cd-498c-9377-c9b922ec213a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:37.834966 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3181b97b-a4cd-498c-9377-c9b922ec213a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:37.976740 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3181b97b-a4cd-498c-9377-c9b922ec213a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:37.990374 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3181b97b-a4cd-498c-9377-c9b922ec213a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/8c7aea62-7b4d-400d-89fa-5411deefe490" status: 200 len: 1274 microversion: 2.1 time: 0.168547 Sep 16 12:47:37.991478 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 296/603] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:37 2022] GET /compute/v2.1/servers/8c7aea62-7b4d-400d-89fa-5411deefe490 => generated 1274 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:37.998003 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-1c56e3e0-197d-4589-b736-03686fc60f7f req-11678739-abd4-4125-9e67-920f7e5ccf67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad946bd5-7ee5-47d6-a52f-00e8511d2bd6", "name": "network-vif-deleted", "tag": "f1d9e429-3d16-4f88-85c5-b9622e90e851"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:38.011793 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-1c56e3e0-197d-4589-b736-03686fc60f7f req-11678739-abd4-4125-9e67-920f7e5ccf67 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:38.012586 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-1c56e3e0-197d-4589-b736-03686fc60f7f req-11678739-abd4-4125-9e67-920f7e5ccf67 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:38.013187 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-1c56e3e0-197d-4589-b736-03686fc60f7f req-11678739-abd4-4125-9e67-920f7e5ccf67 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:38.027874 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-1c56e3e0-197d-4589-b736-03686fc60f7f req-11678739-abd4-4125-9e67-920f7e5ccf67 service nova] Creating event network-vif-deleted:f1d9e429-3d16-4f88-85c5-b9622e90e851 for instance ad946bd5-7ee5-47d6-a52f-00e8511d2bd6 on n-h1-858094-4 Sep 16 12:47:38.038051 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-1c56e3e0-197d-4589-b736-03686fc60f7f req-11678739-abd4-4125-9e67-920f7e5ccf67 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045022 Sep 16 12:47:38.039254 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 297/604] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:47:38.047368 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b8bc0966-b503-4fd8-964f-d9cac9f890b1 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:38.049353 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0a330e77-1ca6-4064-a6ad-a22299d9cc52 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:38.050473 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0a330e77-1ca6-4064-a6ad-a22299d9cc52 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] [instance: ad946bd5-7ee5-47d6-a52f-00e8511d2bd6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:38.057939 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0a330e77-1ca6-4064-a6ad-a22299d9cc52 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:38.059718 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0a330e77-1ca6-4064-a6ad-a22299d9cc52 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:38.060563 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0a330e77-1ca6-4064-a6ad-a22299d9cc52 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:38.061550 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0a330e77-1ca6-4064-a6ad-a22299d9cc52 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:38.062395 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0a330e77-1ca6-4064-a6ad-a22299d9cc52 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:38.063055 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0a330e77-1ca6-4064-a6ad-a22299d9cc52 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:38.076339 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b8bc0966-b503-4fd8-964f-d9cac9f890b1 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6" status: 200 len: 1471 microversion: 2.1 time: 0.468575 Sep 16 12:47:38.077657 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 308/605] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:37 2022] GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 => generated 1471 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:38.084751 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-0a330e77-1ca6-4064-a6ad-a22299d9cc52 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] HTTP exception thrown: Instance ad946bd5-7ee5-47d6-a52f-00e8511d2bd6 could not be found. Sep 16 12:47:38.087151 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0a330e77-1ca6-4064-a6ad-a22299d9cc52 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Request method failure captured: Sep 16 12:47:38.087151 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/ad946bd5-7ee5-47d6-a52f-00e8511d2bd6 HTTP/1.1 Sep 16 12:47:38.087151 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:47:38.087151 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:47:38.087151 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:47:38.087151 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:47:38.087151 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:47:38.087151 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:47:38.087151 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:47:38.087151 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:47:38.087151 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHBC_h7biO6kfhPxKvOAswUSz3dWH_Z_mSvSZRgQHexTeK3JR-w9ARos20-HGzAKnbiNS1bCmnvi2OvjPUdVmeyg9T5zho29OyJTG7_YhIGcVc-DUNB6zyhenKjr6rFVcPyZdBShtULty1Bu0d_wntSC8-_QNjOnxnLOO0YOeSQg91Y Sep 16 12:47:38.087151 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:47:38.087151 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:47:38.087151 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:47:38.087151 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:47:38.087151 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:47:38.087151 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:47:38.087151 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 6e4b83da544e4980b1c2fe2b1f597016 Sep 16 12:47:38.087151 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-936469481 Sep 16 12:47:38.087151 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:47:38.087151 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:47:38.088879 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6e4b83da544e4980b1c2fe2b1f597016"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6e4b83da544e4980b1c2fe2b1f597016"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6e4b83da544e4980b1c2fe2b1f597016", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6e4b83da544e4980b1c2fe2b1f597016"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:47:38.088879 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-936469481 Sep 16 12:47:38.088879 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 6e4b83da544e4980b1c2fe2b1f597016 Sep 16 12:47:38.088879 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-936469481 Sep 16 12:47:38.088879 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ServerDiagnosticsNegativeTest-936469481-project Sep 16 12:47:38.088879 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:47:38.088879 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:47:38.088879 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 318566be918e44a4894403f766cbd5cb Sep 16 12:47:38.088879 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-936469481-project Sep 16 12:47:38.088879 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:47:38.088879 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance ad946bd5-7ee5-47d6-a52f-00e8511d2bd6 could not be found. Sep 16 12:47:38.088879 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'ad946bd5-7ee5-47d6-a52f-00e8511d2bd6'} Sep 16 12:47:38.089763 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:47:38.089763 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:47:38.089763 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:47:38.089763 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:47:38.089763 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:47:38.089763 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:47:38.089763 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:47:38.089763 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:47:38.089763 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:47:38.089763 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:47:38.089763 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad946bd5-7ee5-47d6-a52f-00e8511d2bd6 could not be found. Sep 16 12:47:38.089763 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:47:38.089763 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:47:38.089763 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:47:38.089763 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:47:38.089763 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:47:38.089763 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:47:38.089763 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:47:38.089763 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:47:38.089763 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:47:38.091248 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:47:38.091248 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:47:38.091248 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:47:38.091248 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:47:38.091248 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:47:38.091248 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:47:38.091248 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:47:38.091248 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad946bd5-7ee5-47d6-a52f-00e8511d2bd6 could not be found. Sep 16 12:47:38.091248 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:47:38.091248 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:47:38.091248 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:47:38.091248 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:47:38.091248 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:47:38.091248 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:47:38.091248 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:47:38.091248 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:47:38.091248 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad946bd5-7ee5-47d6-a52f-00e8511d2bd6 could not be found. Sep 16 12:47:38.091248 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:47:38.092780 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0a330e77-1ca6-4064-a6ad-a22299d9cc52 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] Returning 404 to user: Instance ad946bd5-7ee5-47d6-a52f-00e8511d2bd6 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:47:38.093817 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0a330e77-1ca6-4064-a6ad-a22299d9cc52 tempest-ServerDiagnosticsNegativeTest-936469481 tempest-ServerDiagnosticsNegativeTest-936469481-project] 10.222.0.67 "GET /compute/v2.1/servers/ad946bd5-7ee5-47d6-a52f-00e8511d2bd6" status: 404 len: 111 microversion: 2.1 time: 0.051294 Sep 16 12:47:38.094708 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 298/606] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:38 2022] GET /compute/v2.1/servers/ad946bd5-7ee5-47d6-a52f-00e8511d2bd6 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:47:38.098128 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-22f5b08a-f86e-44a2-bbd8-50f938a84d63 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:38.099243 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-22f5b08a-f86e-44a2-bbd8-50f938a84d63 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 566f231d-345e-4665-bf9a-b61004b954ed] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:38.109677 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22f5b08a-f86e-44a2-bbd8-50f938a84d63 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:38.111928 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22f5b08a-f86e-44a2-bbd8-50f938a84d63 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:38.112798 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22f5b08a-f86e-44a2-bbd8-50f938a84d63 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:38.115144 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22f5b08a-f86e-44a2-bbd8-50f938a84d63 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:38.115844 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22f5b08a-f86e-44a2-bbd8-50f938a84d63 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:38.116654 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22f5b08a-f86e-44a2-bbd8-50f938a84d63 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:38.268337 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ae06d578-35c1-4148-9d77-c3ed159ea7ec tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:38.269184 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ae06d578-35c1-4148-9d77-c3ed159ea7ec tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] [instance: efea200a-0b78-42de-a9e2-febab9817590] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:38.275872 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ae06d578-35c1-4148-9d77-c3ed159ea7ec tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:38.276333 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ae06d578-35c1-4148-9d77-c3ed159ea7ec tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:38.276730 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ae06d578-35c1-4148-9d77-c3ed159ea7ec tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:38.277439 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ae06d578-35c1-4148-9d77-c3ed159ea7ec tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:38.277880 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ae06d578-35c1-4148-9d77-c3ed159ea7ec tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:38.278513 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ae06d578-35c1-4148-9d77-c3ed159ea7ec tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:38.502145 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-22f5b08a-f86e-44a2-bbd8-50f938a84d63 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:38.513002 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-22f5b08a-f86e-44a2-bbd8-50f938a84d63 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed" status: 200 len: 1504 microversion: 2.1 time: 0.431254 Sep 16 12:47:38.524413 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 309/607] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:38 2022] GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed => generated 1504 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:38.539873 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-66ba25b5-c90d-429d-a90a-ac25b53a73d1 tempest-FloatingIPDetailsTestJSON-569140138 tempest-FloatingIPDetailsTestJSON-569140138-project] Action: 'create', calling method: .version_select at 0x7f1036156ca0>, body: {"pool": null} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:39.605663 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ae06d578-35c1-4148-9d77-c3ed159ea7ec tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590" status: 200 len: 1613 microversion: 2.1 time: 1.502169 Sep 16 12:47:39.607239 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 299/608] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:38 2022] GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590 => generated 1613 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:39.613435 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ae93d3ee-a068-4cf8-9b8d-62a9c5a7c6b1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:39.614194 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ae93d3ee-a068-4cf8-9b8d-62a9c5a7c6b1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: c077c0ae-56e2-42f7-a0e7-32e6597062c5] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:39.621605 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ae93d3ee-a068-4cf8-9b8d-62a9c5a7c6b1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:39.622600 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ae93d3ee-a068-4cf8-9b8d-62a9c5a7c6b1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:39.623260 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ae93d3ee-a068-4cf8-9b8d-62a9c5a7c6b1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:39.624391 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ae93d3ee-a068-4cf8-9b8d-62a9c5a7c6b1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:39.627218 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ae93d3ee-a068-4cf8-9b8d-62a9c5a7c6b1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:39.627963 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ae93d3ee-a068-4cf8-9b8d-62a9c5a7c6b1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:39.806304 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ae93d3ee-a068-4cf8-9b8d-62a9c5a7c6b1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:39.847501 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ae93d3ee-a068-4cf8-9b8d-62a9c5a7c6b1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/c077c0ae-56e2-42f7-a0e7-32e6597062c5" status: 200 len: 1265 microversion: 2.1 time: 0.235624 Sep 16 12:47:39.848344 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 300/609] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:39 2022] GET /compute/v2.1/servers/c077c0ae-56e2-42f7-a0e7-32e6597062c5 => generated 1265 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:39.878468 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5cebbb1a-df95-4050-bc1c-9d89ed23868e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:39.879503 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5cebbb1a-df95-4050-bc1c-9d89ed23868e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 8c7aea62-7b4d-400d-89fa-5411deefe490] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:39.893117 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5cebbb1a-df95-4050-bc1c-9d89ed23868e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:39.894237 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5cebbb1a-df95-4050-bc1c-9d89ed23868e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:39.894872 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5cebbb1a-df95-4050-bc1c-9d89ed23868e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:39.896232 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5cebbb1a-df95-4050-bc1c-9d89ed23868e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:39.897127 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5cebbb1a-df95-4050-bc1c-9d89ed23868e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:39.898192 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5cebbb1a-df95-4050-bc1c-9d89ed23868e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:40.562340 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5cebbb1a-df95-4050-bc1c-9d89ed23868e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:40.582080 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5cebbb1a-df95-4050-bc1c-9d89ed23868e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/8c7aea62-7b4d-400d-89fa-5411deefe490" status: 200 len: 1316 microversion: 2.1 time: 0.722113 Sep 16 12:47:40.582679 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 301/610] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:39 2022] GET /compute/v2.1/servers/8c7aea62-7b4d-400d-89fa-5411deefe490 => generated 1316 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:40.589373 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d6f54736-2d83-4f9c-8d42-6e3caea02967 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:40.593685 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d6f54736-2d83-4f9c-8d42-6e3caea02967 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:40.628668 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d6f54736-2d83-4f9c-8d42-6e3caea02967 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:40.629287 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d6f54736-2d83-4f9c-8d42-6e3caea02967 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:40.630666 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d6f54736-2d83-4f9c-8d42-6e3caea02967 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:40.631415 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d6f54736-2d83-4f9c-8d42-6e3caea02967 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:40.632027 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d6f54736-2d83-4f9c-8d42-6e3caea02967 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:40.632485 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d6f54736-2d83-4f9c-8d42-6e3caea02967 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:41.043800 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d6f54736-2d83-4f9c-8d42-6e3caea02967 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:41.056349 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d6f54736-2d83-4f9c-8d42-6e3caea02967 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6" status: 200 len: 1471 microversion: 2.1 time: 0.471627 Sep 16 12:47:41.057302 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 302/611] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:40 2022] GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 => generated 1471 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:41.065602 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-11aee526-50ac-448a-b46c-b8579f9adee8 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:41.066626 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-11aee526-50ac-448a-b46c-b8579f9adee8 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 566f231d-345e-4665-bf9a-b61004b954ed] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:41.075970 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-11aee526-50ac-448a-b46c-b8579f9adee8 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:41.076656 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-11aee526-50ac-448a-b46c-b8579f9adee8 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:41.077493 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-11aee526-50ac-448a-b46c-b8579f9adee8 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:41.078296 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-11aee526-50ac-448a-b46c-b8579f9adee8 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:41.078748 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-11aee526-50ac-448a-b46c-b8579f9adee8 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:41.079468 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-11aee526-50ac-448a-b46c-b8579f9adee8 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:41.575957 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-11aee526-50ac-448a-b46c-b8579f9adee8 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:41.593341 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-11aee526-50ac-448a-b46c-b8579f9adee8 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed" status: 200 len: 1504 microversion: 2.1 time: 0.534534 Sep 16 12:47:41.594152 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 303/612] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:41 2022] GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed => generated 1504 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:41.609686 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-31360002-1d0c-49da-be60-1b0dc83cca2b tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:41.610534 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-31360002-1d0c-49da-be60-1b0dc83cca2b tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] [instance: efea200a-0b78-42de-a9e2-febab9817590] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:41.629578 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-31360002-1d0c-49da-be60-1b0dc83cca2b tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:41.631117 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-31360002-1d0c-49da-be60-1b0dc83cca2b tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:41.631888 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-31360002-1d0c-49da-be60-1b0dc83cca2b tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:41.632886 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-31360002-1d0c-49da-be60-1b0dc83cca2b tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:41.633646 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-31360002-1d0c-49da-be60-1b0dc83cca2b tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:41.634369 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-31360002-1d0c-49da-be60-1b0dc83cca2b tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:41.725928 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-31360002-1d0c-49da-be60-1b0dc83cca2b tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'eb0d7615ec7b41a9837459c5c1fb4f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80d9b2f358446a29f596a7594d182d1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:41.726881 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-31360002-1d0c-49da-be60-1b0dc83cca2b tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] [instance: efea200a-0b78-42de-a9e2-febab9817590] flavor_id is None. Assuming migration. {{(pid=128780) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 16 12:47:41.727562 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-31360002-1d0c-49da-be60-1b0dc83cca2b tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] [instance: efea200a-0b78-42de-a9e2-febab9817590] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128780) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 16 12:47:41.956568 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-31360002-1d0c-49da-be60-1b0dc83cca2b tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590/action" status: 202 len: 0 microversion: 2.1 time: 0.360852 Sep 16 12:47:41.958192 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 304/613] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:47:41 2022] POST /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:47:41.964559 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-21e3dc23-ccc3-4b7d-8bd6-72732629e43e req-b999d0f9-b494-45dd-b3ce-eb14cc0a6ebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "566f231d-345e-4665-bf9a-b61004b954ed", "name": "network-vif-unplugged", "status": "completed", "tag": "924f27c6-9b29-461f-bbff-57520beb8e29"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:42.221268 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-21e3dc23-ccc3-4b7d-8bd6-72732629e43e req-b999d0f9-b494-45dd-b3ce-eb14cc0a6ebf service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:42.221752 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-21e3dc23-ccc3-4b7d-8bd6-72732629e43e req-b999d0f9-b494-45dd-b3ce-eb14cc0a6ebf service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:42.222178 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-21e3dc23-ccc3-4b7d-8bd6-72732629e43e req-b999d0f9-b494-45dd-b3ce-eb14cc0a6ebf service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:42.236936 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-21e3dc23-ccc3-4b7d-8bd6-72732629e43e req-b999d0f9-b494-45dd-b3ce-eb14cc0a6ebf service nova] Creating event network-vif-unplugged:924f27c6-9b29-461f-bbff-57520beb8e29 for instance 566f231d-345e-4665-bf9a-b61004b954ed on n-h2-858094-4 Sep 16 12:47:42.245543 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-21e3dc23-ccc3-4b7d-8bd6-72732629e43e req-b999d0f9-b494-45dd-b3ce-eb14cc0a6ebf service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.284922 Sep 16 12:47:42.246839 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 305/614] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:47:42.254872 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-788e2f1e-83d7-4bad-ac7e-3a5da190bc67 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:42.255803 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-788e2f1e-83d7-4bad-ac7e-3a5da190bc67 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: c077c0ae-56e2-42f7-a0e7-32e6597062c5] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:42.262693 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-788e2f1e-83d7-4bad-ac7e-3a5da190bc67 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:42.263468 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-788e2f1e-83d7-4bad-ac7e-3a5da190bc67 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:42.264115 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-788e2f1e-83d7-4bad-ac7e-3a5da190bc67 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:42.266518 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-788e2f1e-83d7-4bad-ac7e-3a5da190bc67 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:42.267330 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-788e2f1e-83d7-4bad-ac7e-3a5da190bc67 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:42.267947 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-788e2f1e-83d7-4bad-ac7e-3a5da190bc67 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:42.737882 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-66ba25b5-c90d-429d-a90a-ac25b53a73d1 tempest-FloatingIPDetailsTestJSON-569140138 tempest-FloatingIPDetailsTestJSON-569140138-project] 10.222.0.67 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.200735 Sep 16 12:47:42.743903 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-788e2f1e-83d7-4bad-ac7e-3a5da190bc67 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:42.760526 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 310/615] 10.222.0.67 () {60 vars in 1170 bytes} [Fri Sep 16 12:47:38 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:47:42.772256 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-dbfd466f-48ba-471b-bad4-dc63be5cfdb5 req-e418b956-3d7e-4ade-b7b2-a655be1de7f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c077c0ae-56e2-42f7-a0e7-32e6597062c5", "tag": "45b8553e-f99f-4d12-8265-19759ca804ba"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:42.779034 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-788e2f1e-83d7-4bad-ac7e-3a5da190bc67 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/c077c0ae-56e2-42f7-a0e7-32e6597062c5" status: 200 len: 1307 microversion: 2.1 time: 0.527571 Sep 16 12:47:42.783380 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 306/616] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:42 2022] GET /compute/v2.1/servers/c077c0ae-56e2-42f7-a0e7-32e6597062c5 => generated 1307 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:42.807057 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a8f6b9e1-dbf4-45a7-ac84-d43bb74bda53 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:42.826528 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a8f6b9e1-dbf4-45a7-ac84-d43bb74bda53 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 8c7aea62-7b4d-400d-89fa-5411deefe490] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:42.826889 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dbfd466f-48ba-471b-bad4-dc63be5cfdb5 req-e418b956-3d7e-4ade-b7b2-a655be1de7f5 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:42.831681 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dbfd466f-48ba-471b-bad4-dc63be5cfdb5 req-e418b956-3d7e-4ade-b7b2-a655be1de7f5 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:42.832177 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dbfd466f-48ba-471b-bad4-dc63be5cfdb5 req-e418b956-3d7e-4ade-b7b2-a655be1de7f5 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:42.853720 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8f6b9e1-dbf4-45a7-ac84-d43bb74bda53 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:42.854554 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8f6b9e1-dbf4-45a7-ac84-d43bb74bda53 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:42.855228 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8f6b9e1-dbf4-45a7-ac84-d43bb74bda53 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:42.856271 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8f6b9e1-dbf4-45a7-ac84-d43bb74bda53 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:42.856994 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8f6b9e1-dbf4-45a7-ac84-d43bb74bda53 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:42.857894 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8f6b9e1-dbf4-45a7-ac84-d43bb74bda53 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:42.868267 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-dbfd466f-48ba-471b-bad4-dc63be5cfdb5 req-e418b956-3d7e-4ade-b7b2-a655be1de7f5 service nova] Creating event network-changed:45b8553e-f99f-4d12-8265-19759ca804ba for instance c077c0ae-56e2-42f7-a0e7-32e6597062c5 on n-h1-858094-4 Sep 16 12:47:42.870196 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:47:42.888640 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-dbfd466f-48ba-471b-bad4-dc63be5cfdb5 req-e418b956-3d7e-4ade-b7b2-a655be1de7f5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126404 Sep 16 12:47:42.897640 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 311/617] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:47:42.904822 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-adea4bdb-f6ce-4c07-82ed-40d6e2f59102 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:42.917612 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-adea4bdb-f6ce-4c07-82ed-40d6e2f59102 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: efea200a-0b78-42de-a9e2-febab9817590] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:42.927300 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-adea4bdb-f6ce-4c07-82ed-40d6e2f59102 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:42.927880 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-adea4bdb-f6ce-4c07-82ed-40d6e2f59102 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:42.928627 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-adea4bdb-f6ce-4c07-82ed-40d6e2f59102 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:42.929534 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-adea4bdb-f6ce-4c07-82ed-40d6e2f59102 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:42.929989 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-adea4bdb-f6ce-4c07-82ed-40d6e2f59102 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:42.930419 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-adea4bdb-f6ce-4c07-82ed-40d6e2f59102 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:43.236944 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a8f6b9e1-dbf4-45a7-ac84-d43bb74bda53 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:43.247468 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a8f6b9e1-dbf4-45a7-ac84-d43bb74bda53 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/8c7aea62-7b4d-400d-89fa-5411deefe490" status: 200 len: 1316 microversion: 2.1 time: 0.459788 Sep 16 12:47:43.248210 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 307/618] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:42 2022] GET /compute/v2.1/servers/8c7aea62-7b4d-400d-89fa-5411deefe490 => generated 1316 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:43.253989 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-41863166-7571-49fc-a1cc-e6888870390c tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:43.254688 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-41863166-7571-49fc-a1cc-e6888870390c tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:43.262085 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-41863166-7571-49fc-a1cc-e6888870390c tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:43.262664 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-41863166-7571-49fc-a1cc-e6888870390c tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:43.263174 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-41863166-7571-49fc-a1cc-e6888870390c tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:43.263956 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-41863166-7571-49fc-a1cc-e6888870390c tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:43.265087 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-41863166-7571-49fc-a1cc-e6888870390c tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:43.265639 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-41863166-7571-49fc-a1cc-e6888870390c tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:43.293216 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-adea4bdb-f6ce-4c07-82ed-40d6e2f59102 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:43.306871 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-adea4bdb-f6ce-4c07-82ed-40d6e2f59102 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590" status: 200 len: 1471 microversion: 2.1 time: 0.407451 Sep 16 12:47:43.307467 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 312/619] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:42 2022] GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590 => generated 1471 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:43.316106 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9faf8aef-6f0a-42a4-b31e-b9c11de51e74 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:43.316750 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9faf8aef-6f0a-42a4-b31e-b9c11de51e74 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 566f231d-345e-4665-bf9a-b61004b954ed] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:43.329111 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9faf8aef-6f0a-42a4-b31e-b9c11de51e74 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:43.329804 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9faf8aef-6f0a-42a4-b31e-b9c11de51e74 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:43.330388 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9faf8aef-6f0a-42a4-b31e-b9c11de51e74 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:43.331264 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9faf8aef-6f0a-42a4-b31e-b9c11de51e74 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:43.331709 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9faf8aef-6f0a-42a4-b31e-b9c11de51e74 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:43.332339 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9faf8aef-6f0a-42a4-b31e-b9c11de51e74 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:43.668507 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-41863166-7571-49fc-a1cc-e6888870390c tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:43.678032 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-41863166-7571-49fc-a1cc-e6888870390c tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6" status: 200 len: 1471 microversion: 2.1 time: 0.427900 Sep 16 12:47:43.679116 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 308/620] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:43 2022] GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 => generated 1471 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:43.698798 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f9196f65-4401-4636-a481-d11645a05090 tempest-FloatingIPDetailsTestJSON-569140138 tempest-FloatingIPDetailsTestJSON-569140138-project] Action: 'create', calling method: .version_select at 0x7f1035bad670>, body: {"pool": null} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:43.855320 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=16 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:47:43.897339 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:47:43.994229 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9faf8aef-6f0a-42a4-b31e-b9c11de51e74 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:44.004362 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:47:44.017614 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9faf8aef-6f0a-42a4-b31e-b9c11de51e74 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed" status: 200 len: 1504 microversion: 2.1 time: 0.708988 Sep 16 12:47:44.018448 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 313/621] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:43 2022] GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed => generated 1504 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:44.023746 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-92a12579-c619-4142-aa6d-bc0555529e25 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:44.024405 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-92a12579-c619-4142-aa6d-bc0555529e25 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: c077c0ae-56e2-42f7-a0e7-32e6597062c5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:44.031545 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92a12579-c619-4142-aa6d-bc0555529e25 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:44.032046 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92a12579-c619-4142-aa6d-bc0555529e25 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:44.032517 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92a12579-c619-4142-aa6d-bc0555529e25 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:44.033354 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92a12579-c619-4142-aa6d-bc0555529e25 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:44.033953 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92a12579-c619-4142-aa6d-bc0555529e25 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:44.034391 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92a12579-c619-4142-aa6d-bc0555529e25 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:44.331382 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-92a12579-c619-4142-aa6d-bc0555529e25 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:44.340102 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-92a12579-c619-4142-aa6d-bc0555529e25 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/c077c0ae-56e2-42f7-a0e7-32e6597062c5" status: 200 len: 1307 microversion: 2.1 time: 0.320317 Sep 16 12:47:44.340721 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 314/622] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:44 2022] GET /compute/v2.1/servers/c077c0ae-56e2-42f7-a0e7-32e6597062c5 => generated 1307 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:44.345725 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c5d44164-6f12-464f-b52e-cbeb0e42c13a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:44.346329 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c5d44164-6f12-464f-b52e-cbeb0e42c13a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 8c7aea62-7b4d-400d-89fa-5411deefe490] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:44.352941 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5d44164-6f12-464f-b52e-cbeb0e42c13a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:44.353437 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5d44164-6f12-464f-b52e-cbeb0e42c13a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:44.353866 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5d44164-6f12-464f-b52e-cbeb0e42c13a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:44.354722 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5d44164-6f12-464f-b52e-cbeb0e42c13a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:44.355352 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5d44164-6f12-464f-b52e-cbeb0e42c13a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:44.355822 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5d44164-6f12-464f-b52e-cbeb0e42c13a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:44.697895 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c5d44164-6f12-464f-b52e-cbeb0e42c13a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:44.712856 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c5d44164-6f12-464f-b52e-cbeb0e42c13a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/8c7aea62-7b4d-400d-89fa-5411deefe490" status: 200 len: 1316 microversion: 2.1 time: 0.370753 Sep 16 12:47:44.731496 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 315/623] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:44 2022] GET /compute/v2.1/servers/8c7aea62-7b4d-400d-89fa-5411deefe490 => generated 1316 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:44.744603 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-c1f62ab3-5ac0-4d50-848e-29f90626f413 req-359876fb-acab-46a4-9bb2-25ae86562555 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "566f231d-345e-4665-bf9a-b61004b954ed", "tag": "924f27c6-9b29-461f-bbff-57520beb8e29"}, {"name": "network-changed", "server_uuid": "8c7aea62-7b4d-400d-89fa-5411deefe490", "tag": "27de96a3-bf43-46c1-a8f8-afd304cea206"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:44.759911 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c1f62ab3-5ac0-4d50-848e-29f90626f413 req-359876fb-acab-46a4-9bb2-25ae86562555 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:44.760578 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c1f62ab3-5ac0-4d50-848e-29f90626f413 req-359876fb-acab-46a4-9bb2-25ae86562555 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:44.762253 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c1f62ab3-5ac0-4d50-848e-29f90626f413 req-359876fb-acab-46a4-9bb2-25ae86562555 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:44.784174 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-c1f62ab3-5ac0-4d50-848e-29f90626f413 req-359876fb-acab-46a4-9bb2-25ae86562555 service nova] Creating event network-changed:924f27c6-9b29-461f-bbff-57520beb8e29 for instance 566f231d-345e-4665-bf9a-b61004b954ed on n-h2-858094-4 Sep 16 12:47:44.784854 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-c1f62ab3-5ac0-4d50-848e-29f90626f413 req-359876fb-acab-46a4-9bb2-25ae86562555 service nova] Creating event network-changed:27de96a3-bf43-46c1-a8f8-afd304cea206 for instance 8c7aea62-7b4d-400d-89fa-5411deefe490 on n-h1-858094-4 Sep 16 12:47:44.796922 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-c1f62ab3-5ac0-4d50-848e-29f90626f413 req-359876fb-acab-46a4-9bb2-25ae86562555 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.062242 Sep 16 12:47:44.797650 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 316/624] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:47:44.803863 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6efc2891-63f4-4071-b40f-0e4aa58b1268 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:44.804785 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6efc2891-63f4-4071-b40f-0e4aa58b1268 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: efea200a-0b78-42de-a9e2-febab9817590] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:44.811631 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6efc2891-63f4-4071-b40f-0e4aa58b1268 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:44.812337 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6efc2891-63f4-4071-b40f-0e4aa58b1268 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:44.813123 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6efc2891-63f4-4071-b40f-0e4aa58b1268 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:44.814309 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6efc2891-63f4-4071-b40f-0e4aa58b1268 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:44.814745 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6efc2891-63f4-4071-b40f-0e4aa58b1268 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:44.815167 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6efc2891-63f4-4071-b40f-0e4aa58b1268 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:45.232198 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6efc2891-63f4-4071-b40f-0e4aa58b1268 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:45.255475 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6efc2891-63f4-4071-b40f-0e4aa58b1268 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590" status: 200 len: 1471 microversion: 2.1 time: 0.456158 Sep 16 12:47:45.256257 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 317/625] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:44 2022] GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590 => generated 1471 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:45.272970 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ab1a467c-4cb6-4418-8da1-52af145bbc45 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:45.272970 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ab1a467c-4cb6-4418-8da1-52af145bbc45 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:45.283544 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab1a467c-4cb6-4418-8da1-52af145bbc45 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:45.285187 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab1a467c-4cb6-4418-8da1-52af145bbc45 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:45.285187 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab1a467c-4cb6-4418-8da1-52af145bbc45 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:45.287083 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab1a467c-4cb6-4418-8da1-52af145bbc45 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:45.287083 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab1a467c-4cb6-4418-8da1-52af145bbc45 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:45.287387 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab1a467c-4cb6-4418-8da1-52af145bbc45 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:45.936390 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ab1a467c-4cb6-4418-8da1-52af145bbc45 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:45.948986 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ab1a467c-4cb6-4418-8da1-52af145bbc45 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6" status: 200 len: 1471 microversion: 2.1 time: 0.691532 Sep 16 12:47:45.950435 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 318/626] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:45 2022] GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 => generated 1471 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:45.957257 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ef1cb9fb-9c07-4a6f-9a04-b5de3a7d4c02 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:45.958354 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ef1cb9fb-9c07-4a6f-9a04-b5de3a7d4c02 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 566f231d-345e-4665-bf9a-b61004b954ed] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:45.966381 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef1cb9fb-9c07-4a6f-9a04-b5de3a7d4c02 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:45.975556 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef1cb9fb-9c07-4a6f-9a04-b5de3a7d4c02 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:45.976171 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef1cb9fb-9c07-4a6f-9a04-b5de3a7d4c02 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:45.977264 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef1cb9fb-9c07-4a6f-9a04-b5de3a7d4c02 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:45.978203 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef1cb9fb-9c07-4a6f-9a04-b5de3a7d4c02 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:45.979509 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef1cb9fb-9c07-4a6f-9a04-b5de3a7d4c02 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:46.324600 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ef1cb9fb-9c07-4a6f-9a04-b5de3a7d4c02 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:46.341243 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ef1cb9fb-9c07-4a6f-9a04-b5de3a7d4c02 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed" status: 200 len: 1504 microversion: 2.1 time: 0.389154 Sep 16 12:47:46.341940 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 319/627] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:45 2022] GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed => generated 1504 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:46.360768 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e22d8f2d-9444-46a7-9a34-50c11088657c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:46.362236 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e22d8f2d-9444-46a7-9a34-50c11088657c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: c077c0ae-56e2-42f7-a0e7-32e6597062c5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:46.371268 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e22d8f2d-9444-46a7-9a34-50c11088657c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:46.372396 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e22d8f2d-9444-46a7-9a34-50c11088657c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:46.373043 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e22d8f2d-9444-46a7-9a34-50c11088657c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:46.375373 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e22d8f2d-9444-46a7-9a34-50c11088657c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:46.376511 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e22d8f2d-9444-46a7-9a34-50c11088657c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:46.377315 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e22d8f2d-9444-46a7-9a34-50c11088657c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:46.965209 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e22d8f2d-9444-46a7-9a34-50c11088657c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:46.976303 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e22d8f2d-9444-46a7-9a34-50c11088657c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/c077c0ae-56e2-42f7-a0e7-32e6597062c5" status: 200 len: 1307 microversion: 2.1 time: 0.622522 Sep 16 12:47:46.978040 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 320/628] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:46 2022] GET /compute/v2.1/servers/c077c0ae-56e2-42f7-a0e7-32e6597062c5 => generated 1307 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:46.985495 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5ee29924-2c0f-4847-990d-e4e6aea9ebfe tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:46.986339 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5ee29924-2c0f-4847-990d-e4e6aea9ebfe tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 8c7aea62-7b4d-400d-89fa-5411deefe490] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:46.999809 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ee29924-2c0f-4847-990d-e4e6aea9ebfe tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:47.001277 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ee29924-2c0f-4847-990d-e4e6aea9ebfe tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:47.002070 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ee29924-2c0f-4847-990d-e4e6aea9ebfe tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:47.003298 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ee29924-2c0f-4847-990d-e4e6aea9ebfe tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:47.003895 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ee29924-2c0f-4847-990d-e4e6aea9ebfe tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:47.004546 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ee29924-2c0f-4847-990d-e4e6aea9ebfe tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:47.395423 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5ee29924-2c0f-4847-990d-e4e6aea9ebfe tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:47.404489 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5ee29924-2c0f-4847-990d-e4e6aea9ebfe tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/8c7aea62-7b4d-400d-89fa-5411deefe490" status: 200 len: 1316 microversion: 2.1 time: 0.424524 Sep 16 12:47:47.405930 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 321/629] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:46 2022] GET /compute/v2.1/servers/8c7aea62-7b4d-400d-89fa-5411deefe490 => generated 1316 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:47.424336 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d142a072-b850-4f98-a5fe-26350b01da46 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:47.424962 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d142a072-b850-4f98-a5fe-26350b01da46 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: efea200a-0b78-42de-a9e2-febab9817590] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:47.434024 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d142a072-b850-4f98-a5fe-26350b01da46 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:47.434960 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d142a072-b850-4f98-a5fe-26350b01da46 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:47.435728 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d142a072-b850-4f98-a5fe-26350b01da46 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:47.436694 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d142a072-b850-4f98-a5fe-26350b01da46 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:47.437609 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d142a072-b850-4f98-a5fe-26350b01da46 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:47.438257 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d142a072-b850-4f98-a5fe-26350b01da46 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:47.570888 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f9196f65-4401-4636-a481-d11645a05090 tempest-FloatingIPDetailsTestJSON-569140138 tempest-FloatingIPDetailsTestJSON-569140138-project] 10.222.0.67 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.890562 Sep 16 12:47:47.572393 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 309/630] 10.222.0.67 () {60 vars in 1170 bytes} [Fri Sep 16 12:47:43 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3892 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:47:47.578515 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-26779de8-69d5-49e1-bcb0-d28a7ca99515 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:47.579337 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-26779de8-69d5-49e1-bcb0-d28a7ca99515 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:47.585860 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-26779de8-69d5-49e1-bcb0-d28a7ca99515 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:47.586598 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-26779de8-69d5-49e1-bcb0-d28a7ca99515 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:47.587185 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-26779de8-69d5-49e1-bcb0-d28a7ca99515 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:47.588034 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-26779de8-69d5-49e1-bcb0-d28a7ca99515 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:47.588653 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-26779de8-69d5-49e1-bcb0-d28a7ca99515 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:47.589226 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-26779de8-69d5-49e1-bcb0-d28a7ca99515 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:47.728516 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=5 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:47:47.757701 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d142a072-b850-4f98-a5fe-26350b01da46 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:47.760933 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=6 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:47:47.767415 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d142a072-b850-4f98-a5fe-26350b01da46 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590" status: 200 len: 1476 microversion: 2.1 time: 0.360189 Sep 16 12:47:47.767947 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 322/631] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:47 2022] GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590 => generated 1476 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:47.772674 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d420e0d0-b8fb-4f37-a65c-58a05ae0761e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:47.773488 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d420e0d0-b8fb-4f37-a65c-58a05ae0761e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 566f231d-345e-4665-bf9a-b61004b954ed] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:47.779374 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d420e0d0-b8fb-4f37-a65c-58a05ae0761e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:47.779922 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d420e0d0-b8fb-4f37-a65c-58a05ae0761e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:47.780551 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d420e0d0-b8fb-4f37-a65c-58a05ae0761e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:47.781415 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d420e0d0-b8fb-4f37-a65c-58a05ae0761e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:47.782024 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d420e0d0-b8fb-4f37-a65c-58a05ae0761e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:47.782602 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d420e0d0-b8fb-4f37-a65c-58a05ae0761e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:47.962420 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-26779de8-69d5-49e1-bcb0-d28a7ca99515 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:47.975411 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-26779de8-69d5-49e1-bcb0-d28a7ca99515 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6" status: 200 len: 1471 microversion: 2.1 time: 0.399398 Sep 16 12:47:47.989157 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 310/632] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:47 2022] GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 => generated 1471 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:47.996873 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-12443b27-81e3-40e3-8d46-e4b3f85df87d tempest-FloatingIPDetailsTestJSON-569140138 tempest-FloatingIPDetailsTestJSON-569140138-project] Action: 'create', calling method: .version_select at 0x7f1035af0280>, body: {"pool": null} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:48.091254 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d420e0d0-b8fb-4f37-a65c-58a05ae0761e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:48.101365 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d420e0d0-b8fb-4f37-a65c-58a05ae0761e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed" status: 200 len: 1504 microversion: 2.1 time: 0.332172 Sep 16 12:47:48.102342 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 323/633] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:47 2022] GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed => generated 1504 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:48.107269 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-860ee807-1e41-4602-9e00-ef201687ac12 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:48.108682 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-860ee807-1e41-4602-9e00-ef201687ac12 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: c077c0ae-56e2-42f7-a0e7-32e6597062c5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:48.115134 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-860ee807-1e41-4602-9e00-ef201687ac12 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:48.115871 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-860ee807-1e41-4602-9e00-ef201687ac12 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:48.116551 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-860ee807-1e41-4602-9e00-ef201687ac12 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:48.117619 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-860ee807-1e41-4602-9e00-ef201687ac12 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:48.118295 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-860ee807-1e41-4602-9e00-ef201687ac12 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:48.118919 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-860ee807-1e41-4602-9e00-ef201687ac12 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:48.426719 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-860ee807-1e41-4602-9e00-ef201687ac12 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:48.435787 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-860ee807-1e41-4602-9e00-ef201687ac12 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/c077c0ae-56e2-42f7-a0e7-32e6597062c5" status: 200 len: 1307 microversion: 2.1 time: 0.332119 Sep 16 12:47:48.437134 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 324/634] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:48 2022] GET /compute/v2.1/servers/c077c0ae-56e2-42f7-a0e7-32e6597062c5 => generated 1307 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:48.457432 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3e2d78ce-84db-4166-8e74-ef87f72df3a3 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:48.458351 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3e2d78ce-84db-4166-8e74-ef87f72df3a3 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 8c7aea62-7b4d-400d-89fa-5411deefe490] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:48.466027 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e2d78ce-84db-4166-8e74-ef87f72df3a3 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:48.466748 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e2d78ce-84db-4166-8e74-ef87f72df3a3 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:48.467913 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e2d78ce-84db-4166-8e74-ef87f72df3a3 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:48.468924 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e2d78ce-84db-4166-8e74-ef87f72df3a3 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:48.469574 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e2d78ce-84db-4166-8e74-ef87f72df3a3 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:48.470140 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e2d78ce-84db-4166-8e74-ef87f72df3a3 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:48.838058 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3e2d78ce-84db-4166-8e74-ef87f72df3a3 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:48.849302 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3e2d78ce-84db-4166-8e74-ef87f72df3a3 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/8c7aea62-7b4d-400d-89fa-5411deefe490" status: 200 len: 1316 microversion: 2.1 time: 0.395375 Sep 16 12:47:48.850061 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 325/635] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:48 2022] GET /compute/v2.1/servers/8c7aea62-7b4d-400d-89fa-5411deefe490 => generated 1316 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:48.855954 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-c3c9b5de-ca24-4e1d-b9e9-a13a1e8f1786 req-d50a64b7-d3dc-454a-b3e1-b17b224502de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c077c0ae-56e2-42f7-a0e7-32e6597062c5", "name": "network-vif-plugged", "status": "completed", "tag": "45b8553e-f99f-4d12-8265-19759ca804ba"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:48.879539 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c3c9b5de-ca24-4e1d-b9e9-a13a1e8f1786 req-d50a64b7-d3dc-454a-b3e1-b17b224502de service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:48.880237 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c3c9b5de-ca24-4e1d-b9e9-a13a1e8f1786 req-d50a64b7-d3dc-454a-b3e1-b17b224502de service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:48.880797 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c3c9b5de-ca24-4e1d-b9e9-a13a1e8f1786 req-d50a64b7-d3dc-454a-b3e1-b17b224502de service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:48.895131 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-c3c9b5de-ca24-4e1d-b9e9-a13a1e8f1786 req-d50a64b7-d3dc-454a-b3e1-b17b224502de service nova] Creating event network-vif-plugged:45b8553e-f99f-4d12-8265-19759ca804ba for instance c077c0ae-56e2-42f7-a0e7-32e6597062c5 on n-h1-858094-4 Sep 16 12:47:48.900659 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-c3c9b5de-ca24-4e1d-b9e9-a13a1e8f1786 req-d50a64b7-d3dc-454a-b3e1-b17b224502de service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049147 Sep 16 12:47:48.901687 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 326/636] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:47:48.909277 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5f9934b2-5aff-4cd5-b289-eaca0df66351 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:48.910099 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5f9934b2-5aff-4cd5-b289-eaca0df66351 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: efea200a-0b78-42de-a9e2-febab9817590] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:48.925366 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f9934b2-5aff-4cd5-b289-eaca0df66351 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:48.925863 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f9934b2-5aff-4cd5-b289-eaca0df66351 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:48.926294 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f9934b2-5aff-4cd5-b289-eaca0df66351 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:48.927669 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f9934b2-5aff-4cd5-b289-eaca0df66351 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:48.928421 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f9934b2-5aff-4cd5-b289-eaca0df66351 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:48.928836 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f9934b2-5aff-4cd5-b289-eaca0df66351 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:49.251709 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5f9934b2-5aff-4cd5-b289-eaca0df66351 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:49.262860 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5f9934b2-5aff-4cd5-b289-eaca0df66351 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590" status: 200 len: 1476 microversion: 2.1 time: 0.359646 Sep 16 12:47:49.276628 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 327/637] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:48 2022] GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590 => generated 1476 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:49.286340 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-781ce9f4-5721-4244-9260-0f05bd2d60fb tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:49.287297 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-781ce9f4-5721-4244-9260-0f05bd2d60fb tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:49.294962 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-781ce9f4-5721-4244-9260-0f05bd2d60fb tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:49.296439 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-781ce9f4-5721-4244-9260-0f05bd2d60fb tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:49.296914 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-781ce9f4-5721-4244-9260-0f05bd2d60fb tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:49.297647 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-781ce9f4-5721-4244-9260-0f05bd2d60fb tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:49.298190 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-781ce9f4-5721-4244-9260-0f05bd2d60fb tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:49.298520 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-781ce9f4-5721-4244-9260-0f05bd2d60fb tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:49.989155 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-781ce9f4-5721-4244-9260-0f05bd2d60fb tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:50.003472 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-781ce9f4-5721-4244-9260-0f05bd2d60fb tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6" status: 200 len: 1471 microversion: 2.1 time: 0.725278 Sep 16 12:47:50.008823 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 328/638] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:49 2022] GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 => generated 1471 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:50.031493 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0b866a1d-e96b-4294-9834-bec27fb0ec5f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:50.032551 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0b866a1d-e96b-4294-9834-bec27fb0ec5f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 566f231d-345e-4665-bf9a-b61004b954ed] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:50.040286 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b866a1d-e96b-4294-9834-bec27fb0ec5f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:50.040916 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b866a1d-e96b-4294-9834-bec27fb0ec5f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:50.041678 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b866a1d-e96b-4294-9834-bec27fb0ec5f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:50.042606 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b866a1d-e96b-4294-9834-bec27fb0ec5f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:50.043158 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b866a1d-e96b-4294-9834-bec27fb0ec5f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:50.043676 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b866a1d-e96b-4294-9834-bec27fb0ec5f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:50.395990 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0b866a1d-e96b-4294-9834-bec27fb0ec5f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:50.407443 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0b866a1d-e96b-4294-9834-bec27fb0ec5f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed" status: 200 len: 1504 microversion: 2.1 time: 0.383730 Sep 16 12:47:50.408502 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 329/639] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:50 2022] GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed => generated 1504 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:50.418545 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f04d04d9-c303-4cf5-bea0-214732efc65c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:50.419174 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f04d04d9-c303-4cf5-bea0-214732efc65c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: c077c0ae-56e2-42f7-a0e7-32e6597062c5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:50.427418 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f04d04d9-c303-4cf5-bea0-214732efc65c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:50.428482 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f04d04d9-c303-4cf5-bea0-214732efc65c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:50.429082 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f04d04d9-c303-4cf5-bea0-214732efc65c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:50.429916 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f04d04d9-c303-4cf5-bea0-214732efc65c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:50.435223 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f04d04d9-c303-4cf5-bea0-214732efc65c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:50.436375 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f04d04d9-c303-4cf5-bea0-214732efc65c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:50.816903 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f04d04d9-c303-4cf5-bea0-214732efc65c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:50.831934 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f04d04d9-c303-4cf5-bea0-214732efc65c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/c077c0ae-56e2-42f7-a0e7-32e6597062c5" status: 200 len: 1307 microversion: 2.1 time: 0.422284 Sep 16 12:47:50.832858 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 330/640] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:50 2022] GET /compute/v2.1/servers/c077c0ae-56e2-42f7-a0e7-32e6597062c5 => generated 1307 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:50.839159 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-44549bf3-716c-45fd-9fb7-2c5956eacbd1 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:50.839968 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-44549bf3-716c-45fd-9fb7-2c5956eacbd1 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 8c7aea62-7b4d-400d-89fa-5411deefe490] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:50.847938 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44549bf3-716c-45fd-9fb7-2c5956eacbd1 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:50.848480 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44549bf3-716c-45fd-9fb7-2c5956eacbd1 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:50.849518 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44549bf3-716c-45fd-9fb7-2c5956eacbd1 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:50.850378 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44549bf3-716c-45fd-9fb7-2c5956eacbd1 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:50.851769 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44549bf3-716c-45fd-9fb7-2c5956eacbd1 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:50.852816 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44549bf3-716c-45fd-9fb7-2c5956eacbd1 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:51.076712 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-12443b27-81e3-40e3-8d46-e4b3f85df87d tempest-FloatingIPDetailsTestJSON-569140138 tempest-FloatingIPDetailsTestJSON-569140138-project] 10.222.0.67 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.086211 Sep 16 12:47:51.077454 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 311/641] 10.222.0.67 () {60 vars in 1170 bytes} [Fri Sep 16 12:47:47 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3088 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:47:51.085375 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f426e8fa-6cbf-4614-9142-ae43a5d0a2e7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:51.086486 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f426e8fa-6cbf-4614-9142-ae43a5d0a2e7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: efea200a-0b78-42de-a9e2-febab9817590] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:51.095742 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f426e8fa-6cbf-4614-9142-ae43a5d0a2e7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:51.096363 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f426e8fa-6cbf-4614-9142-ae43a5d0a2e7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:51.097054 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f426e8fa-6cbf-4614-9142-ae43a5d0a2e7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:51.097909 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f426e8fa-6cbf-4614-9142-ae43a5d0a2e7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:51.099132 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f426e8fa-6cbf-4614-9142-ae43a5d0a2e7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:51.099670 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f426e8fa-6cbf-4614-9142-ae43a5d0a2e7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:51.126257 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-44549bf3-716c-45fd-9fb7-2c5956eacbd1 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:51.134087 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:47:51.136750 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-44549bf3-716c-45fd-9fb7-2c5956eacbd1 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/8c7aea62-7b4d-400d-89fa-5411deefe490" status: 200 len: 1316 microversion: 2.1 time: 0.302505 Sep 16 12:47:51.139410 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 331/642] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:50 2022] GET /compute/v2.1/servers/8c7aea62-7b4d-400d-89fa-5411deefe490 => generated 1316 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:51.145231 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0ced2a7e-1ad4-4dff-a7a4-3a69815be6a1 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:51.146088 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0ced2a7e-1ad4-4dff-a7a4-3a69815be6a1 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:51.156587 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ced2a7e-1ad4-4dff-a7a4-3a69815be6a1 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:51.157367 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ced2a7e-1ad4-4dff-a7a4-3a69815be6a1 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:51.158044 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ced2a7e-1ad4-4dff-a7a4-3a69815be6a1 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:51.163605 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ced2a7e-1ad4-4dff-a7a4-3a69815be6a1 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:51.164387 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ced2a7e-1ad4-4dff-a7a4-3a69815be6a1 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:51.164943 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ced2a7e-1ad4-4dff-a7a4-3a69815be6a1 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:51.449152 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f426e8fa-6cbf-4614-9142-ae43a5d0a2e7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:51.457679 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f426e8fa-6cbf-4614-9142-ae43a5d0a2e7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590" status: 200 len: 1476 microversion: 2.1 time: 0.378890 Sep 16 12:47:51.458277 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 312/643] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:51 2022] GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590 => generated 1476 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:51.462963 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-bd2a6011-3d4e-4df1-9813-8313d3350906 tempest-FloatingIPDetailsTestJSON-569140138 tempest-FloatingIPDetailsTestJSON-569140138-project] Calling method '.version_select at 0x7f1035c77280>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:51.466185 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0ced2a7e-1ad4-4dff-a7a4-3a69815be6a1 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:51.477322 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0ced2a7e-1ad4-4dff-a7a4-3a69815be6a1 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6" status: 200 len: 1477 microversion: 2.1 time: 0.336571 Sep 16 12:47:51.478280 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 332/644] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:51 2022] GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 => generated 1477 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:51.485363 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6beb52d6-6164-436f-8910-a6fe35291e5a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:51.486042 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6beb52d6-6164-436f-8910-a6fe35291e5a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 566f231d-345e-4665-bf9a-b61004b954ed] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:51.493083 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6beb52d6-6164-436f-8910-a6fe35291e5a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:51.493852 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6beb52d6-6164-436f-8910-a6fe35291e5a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:51.494538 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6beb52d6-6164-436f-8910-a6fe35291e5a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:51.495337 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6beb52d6-6164-436f-8910-a6fe35291e5a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:51.495894 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6beb52d6-6164-436f-8910-a6fe35291e5a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:51.496468 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6beb52d6-6164-436f-8910-a6fe35291e5a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:51.796149 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6beb52d6-6164-436f-8910-a6fe35291e5a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:51.810989 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6beb52d6-6164-436f-8910-a6fe35291e5a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed" status: 200 len: 1504 microversion: 2.1 time: 0.329841 Sep 16 12:47:51.811767 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 333/645] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:51 2022] GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed => generated 1504 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:51.829139 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-bd2a6011-3d4e-4df1-9813-8313d3350906 tempest-FloatingIPDetailsTestJSON-569140138 tempest-FloatingIPDetailsTestJSON-569140138-project] 10.222.0.67 "GET /compute/v2.1/os-floating-ips/e2367751-18cd-429d-b448-36eb5ce5145a" status: 200 len: 142 microversion: 2.1 time: 0.369746 Sep 16 12:47:51.838272 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 313/646] 10.222.0.67 () {58 vars in 1260 bytes} [Fri Sep 16 12:47:51 2022] GET /compute/v2.1/os-floating-ips/e2367751-18cd-429d-b448-36eb5ce5145a => generated 142 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:47:51.843640 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8d601308-4bfd-4f2e-bb6b-f0fb97c85f70 tempest-FloatingIPDetailsTestJSON-569140138 tempest-FloatingIPDetailsTestJSON-569140138-project] Calling method '.version_select at 0x7f1035b93f70>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:51.855316 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a448af2e-2ce6-4fc6-b6d6-a2cbdf5dad14 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:51.856282 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a448af2e-2ce6-4fc6-b6d6-a2cbdf5dad14 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: c077c0ae-56e2-42f7-a0e7-32e6597062c5] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:51.863020 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a448af2e-2ce6-4fc6-b6d6-a2cbdf5dad14 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:51.863506 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a448af2e-2ce6-4fc6-b6d6-a2cbdf5dad14 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:51.864043 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a448af2e-2ce6-4fc6-b6d6-a2cbdf5dad14 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:51.864787 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a448af2e-2ce6-4fc6-b6d6-a2cbdf5dad14 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:51.865227 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a448af2e-2ce6-4fc6-b6d6-a2cbdf5dad14 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:51.865651 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a448af2e-2ce6-4fc6-b6d6-a2cbdf5dad14 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:52.162014 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a448af2e-2ce6-4fc6-b6d6-a2cbdf5dad14 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:52.179508 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a448af2e-2ce6-4fc6-b6d6-a2cbdf5dad14 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/c077c0ae-56e2-42f7-a0e7-32e6597062c5" status: 200 len: 1307 microversion: 2.1 time: 0.328420 Sep 16 12:47:52.189199 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 314/647] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:51 2022] GET /compute/v2.1/servers/c077c0ae-56e2-42f7-a0e7-32e6597062c5 => generated 1307 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:52.197286 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6b9624aa-d6f1-4238-a33c-058fd91f1405 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:52.198304 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6b9624aa-d6f1-4238-a33c-058fd91f1405 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 8c7aea62-7b4d-400d-89fa-5411deefe490] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:52.206576 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6b9624aa-d6f1-4238-a33c-058fd91f1405 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:52.207478 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6b9624aa-d6f1-4238-a33c-058fd91f1405 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:52.208830 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6b9624aa-d6f1-4238-a33c-058fd91f1405 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:52.209800 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6b9624aa-d6f1-4238-a33c-058fd91f1405 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:52.211083 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6b9624aa-d6f1-4238-a33c-058fd91f1405 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:52.211755 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6b9624aa-d6f1-4238-a33c-058fd91f1405 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:52.477465 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6b9624aa-d6f1-4238-a33c-058fd91f1405 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:52.485344 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6b9624aa-d6f1-4238-a33c-058fd91f1405 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/8c7aea62-7b4d-400d-89fa-5411deefe490" status: 200 len: 1316 microversion: 2.1 time: 0.294717 Sep 16 12:47:52.488774 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 315/648] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:52 2022] GET /compute/v2.1/servers/8c7aea62-7b4d-400d-89fa-5411deefe490 => generated 1316 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:52.493695 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-90298e18-c42a-4e60-92a4-0d5ae15d347f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:52.494308 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-90298e18-c42a-4e60-92a4-0d5ae15d347f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: efea200a-0b78-42de-a9e2-febab9817590] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:52.514147 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-90298e18-c42a-4e60-92a4-0d5ae15d347f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:52.514648 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-90298e18-c42a-4e60-92a4-0d5ae15d347f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:52.515089 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-90298e18-c42a-4e60-92a4-0d5ae15d347f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:52.515810 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-90298e18-c42a-4e60-92a4-0d5ae15d347f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:52.516290 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-90298e18-c42a-4e60-92a4-0d5ae15d347f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:52.516717 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-90298e18-c42a-4e60-92a4-0d5ae15d347f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:52.856373 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-90298e18-c42a-4e60-92a4-0d5ae15d347f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:52.869418 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-90298e18-c42a-4e60-92a4-0d5ae15d347f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590" status: 200 len: 1476 microversion: 2.1 time: 0.379199 Sep 16 12:47:52.870536 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 316/649] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:52 2022] GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590 => generated 1476 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:52.884218 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ebf0aad7-7fe1-4026-b5aa-3f22631fb478 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:52.888063 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ebf0aad7-7fe1-4026-b5aa-3f22631fb478 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:52.903280 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ebf0aad7-7fe1-4026-b5aa-3f22631fb478 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:52.905135 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ebf0aad7-7fe1-4026-b5aa-3f22631fb478 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:52.905883 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ebf0aad7-7fe1-4026-b5aa-3f22631fb478 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:52.906907 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ebf0aad7-7fe1-4026-b5aa-3f22631fb478 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:52.914062 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ebf0aad7-7fe1-4026-b5aa-3f22631fb478 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:52.914782 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ebf0aad7-7fe1-4026-b5aa-3f22631fb478 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:53.220958 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ebf0aad7-7fe1-4026-b5aa-3f22631fb478 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:53.222945 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8d601308-4bfd-4f2e-bb6b-f0fb97c85f70 tempest-FloatingIPDetailsTestJSON-569140138 tempest-FloatingIPDetailsTestJSON-569140138-project] 10.222.0.67 "DELETE /compute/v2.1/os-floating-ips/e2367751-18cd-429d-b448-36eb5ce5145a" status: 202 len: 0 microversion: 2.1 time: 1.383549 Sep 16 12:47:53.224145 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 334/650] 10.222.0.67 () {58 vars in 1263 bytes} [Fri Sep 16 12:47:51 2022] DELETE /compute/v2.1/os-floating-ips/e2367751-18cd-429d-b448-36eb5ce5145a => generated 0 bytes in 1386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:47:53.230840 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-83ac52fc-a136-4944-bbc9-cb8bae7feec6 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:53.231455 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-83ac52fc-a136-4944-bbc9-cb8bae7feec6 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 566f231d-345e-4665-bf9a-b61004b954ed] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:53.239684 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ebf0aad7-7fe1-4026-b5aa-3f22631fb478 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6" status: 200 len: 1477 microversion: 2.1 time: 0.367825 Sep 16 12:47:53.241092 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 317/651] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:52 2022] GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 => generated 1477 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:53.246623 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83ac52fc-a136-4944-bbc9-cb8bae7feec6 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:53.247186 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83ac52fc-a136-4944-bbc9-cb8bae7feec6 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:53.247632 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83ac52fc-a136-4944-bbc9-cb8bae7feec6 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:53.248557 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83ac52fc-a136-4944-bbc9-cb8bae7feec6 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:53.249033 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83ac52fc-a136-4944-bbc9-cb8bae7feec6 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:53.249444 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83ac52fc-a136-4944-bbc9-cb8bae7feec6 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:53.257698 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-cce95fba-9b34-4253-a6b8-40031aaf5d07 req-ab7c0e01-207f-49ef-8ade-272ed98db49e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c7aea62-7b4d-400d-89fa-5411deefe490", "name": "network-vif-plugged", "status": "completed", "tag": "27de96a3-bf43-46c1-a8f8-afd304cea206"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:53.270271 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-cce95fba-9b34-4253-a6b8-40031aaf5d07 req-ab7c0e01-207f-49ef-8ade-272ed98db49e service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:53.271538 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-cce95fba-9b34-4253-a6b8-40031aaf5d07 req-ab7c0e01-207f-49ef-8ade-272ed98db49e service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:53.272191 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-cce95fba-9b34-4253-a6b8-40031aaf5d07 req-ab7c0e01-207f-49ef-8ade-272ed98db49e service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:53.287704 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-cce95fba-9b34-4253-a6b8-40031aaf5d07 req-ab7c0e01-207f-49ef-8ade-272ed98db49e service nova] Creating event network-vif-plugged:27de96a3-bf43-46c1-a8f8-afd304cea206 for instance 8c7aea62-7b4d-400d-89fa-5411deefe490 on n-h1-858094-4 Sep 16 12:47:53.296113 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-cce95fba-9b34-4253-a6b8-40031aaf5d07 req-ab7c0e01-207f-49ef-8ade-272ed98db49e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051885 Sep 16 12:47:53.298328 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 318/652] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:47:53.309883 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c17e99ff-35fb-4e26-bdaa-ee6cfdd6e294 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:53.310891 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c17e99ff-35fb-4e26-bdaa-ee6cfdd6e294 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: c077c0ae-56e2-42f7-a0e7-32e6597062c5] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:53.319997 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c17e99ff-35fb-4e26-bdaa-ee6cfdd6e294 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:53.320732 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c17e99ff-35fb-4e26-bdaa-ee6cfdd6e294 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:53.321405 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c17e99ff-35fb-4e26-bdaa-ee6cfdd6e294 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:53.322320 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c17e99ff-35fb-4e26-bdaa-ee6cfdd6e294 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:53.323035 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c17e99ff-35fb-4e26-bdaa-ee6cfdd6e294 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:53.324862 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c17e99ff-35fb-4e26-bdaa-ee6cfdd6e294 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:53.902710 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-83ac52fc-a136-4944-bbc9-cb8bae7feec6 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:53.918932 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-83ac52fc-a136-4944-bbc9-cb8bae7feec6 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed" status: 200 len: 1494 microversion: 2.1 time: 0.693341 Sep 16 12:47:53.920247 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 335/653] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:53 2022] GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed => generated 1494 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:53.932960 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c17e99ff-35fb-4e26-bdaa-ee6cfdd6e294 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:53.943688 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ec230b5f-aebb-4b72-ab72-e4f1e39aff67 tempest-FloatingIPDetailsTestJSON-569140138 tempest-FloatingIPDetailsTestJSON-569140138-project] Calling method '.version_select at 0x7f1035bf45e0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:53.945584 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c17e99ff-35fb-4e26-bdaa-ee6cfdd6e294 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/c077c0ae-56e2-42f7-a0e7-32e6597062c5" status: 200 len: 1487 microversion: 2.1 time: 0.643224 Sep 16 12:47:53.946232 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 319/654] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:53 2022] GET /compute/v2.1/servers/c077c0ae-56e2-42f7-a0e7-32e6597062c5 => generated 1487 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:53.950885 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8730745a-fcbe-4692-a0f6-1943c8e025a2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:53.952182 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8730745a-fcbe-4692-a0f6-1943c8e025a2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 8c7aea62-7b4d-400d-89fa-5411deefe490] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:53.958520 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8730745a-fcbe-4692-a0f6-1943c8e025a2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:53.959016 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8730745a-fcbe-4692-a0f6-1943c8e025a2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:53.959457 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8730745a-fcbe-4692-a0f6-1943c8e025a2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:53.960196 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8730745a-fcbe-4692-a0f6-1943c8e025a2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:53.960650 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8730745a-fcbe-4692-a0f6-1943c8e025a2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:53.961079 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8730745a-fcbe-4692-a0f6-1943c8e025a2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:54.339975 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ec230b5f-aebb-4b72-ab72-e4f1e39aff67 tempest-FloatingIPDetailsTestJSON-569140138 tempest-FloatingIPDetailsTestJSON-569140138-project] 10.222.0.67 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.414132 Sep 16 12:47:54.341250 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 336/655] 10.222.0.67 () {58 vars in 1164 bytes} [Fri Sep 16 12:47:53 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 12:47:54.351682 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-afd707b5-c82b-44fe-b31d-970eeaa93142 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:54.352421 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-afd707b5-c82b-44fe-b31d-970eeaa93142 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: efea200a-0b78-42de-a9e2-febab9817590] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:54.360265 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afd707b5-c82b-44fe-b31d-970eeaa93142 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:54.360822 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afd707b5-c82b-44fe-b31d-970eeaa93142 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:54.361265 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afd707b5-c82b-44fe-b31d-970eeaa93142 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:54.362696 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afd707b5-c82b-44fe-b31d-970eeaa93142 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:54.363166 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afd707b5-c82b-44fe-b31d-970eeaa93142 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:54.363625 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afd707b5-c82b-44fe-b31d-970eeaa93142 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:54.409724 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8730745a-fcbe-4692-a0f6-1943c8e025a2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:54.418378 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8730745a-fcbe-4692-a0f6-1943c8e025a2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/8c7aea62-7b4d-400d-89fa-5411deefe490" status: 200 len: 1316 microversion: 2.1 time: 0.471081 Sep 16 12:47:54.419561 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 320/656] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:53 2022] GET /compute/v2.1/servers/8c7aea62-7b4d-400d-89fa-5411deefe490 => generated 1316 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:54.424622 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-10285e54-4cc7-4d8b-8311-59e869ea765a tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Calling method '.version_select at 0x7f1035e49c10>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:54.428364 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-10285e54-4cc7-4d8b-8311-59e869ea765a tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:54.428855 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-10285e54-4cc7-4d8b-8311-59e869ea765a tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:54.429294 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-10285e54-4cc7-4d8b-8311-59e869ea765a tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:54.462882 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-10285e54-4cc7-4d8b-8311-59e869ea765a tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] 10.222.0.67 "GET /compute/v2.1/os-migrations" status: 200 len: 791 microversion: 2.1 time: 0.041265 Sep 16 12:47:54.463838 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 321/657] 10.222.0.67 () {58 vars in 1143 bytes} [Fri Sep 16 12:47:54 2022] GET /compute/v2.1/os-migrations => generated 791 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:47:54.480486 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-636c0fe6-0181-4bf8-ba63-4d6c224e44d1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:54.481148 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-636c0fe6-0181-4bf8-ba63-4d6c224e44d1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: c077c0ae-56e2-42f7-a0e7-32e6597062c5] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:54.489803 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-636c0fe6-0181-4bf8-ba63-4d6c224e44d1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:54.490818 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-636c0fe6-0181-4bf8-ba63-4d6c224e44d1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:54.491503 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-636c0fe6-0181-4bf8-ba63-4d6c224e44d1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:54.492633 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-636c0fe6-0181-4bf8-ba63-4d6c224e44d1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:54.494251 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-636c0fe6-0181-4bf8-ba63-4d6c224e44d1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:54.494991 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-636c0fe6-0181-4bf8-ba63-4d6c224e44d1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:54.607627 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-afd707b5-c82b-44fe-b31d-970eeaa93142 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:54.623629 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-afd707b5-c82b-44fe-b31d-970eeaa93142 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590" status: 200 len: 1476 microversion: 2.1 time: 0.280310 Sep 16 12:47:54.624689 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 337/658] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:54 2022] GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590 => generated 1476 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:54.638281 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a219288f-0384-4ce2-96ec-0db82162b2a5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:54.639731 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a219288f-0384-4ce2-96ec-0db82162b2a5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:54.663710 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a219288f-0384-4ce2-96ec-0db82162b2a5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:54.664528 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a219288f-0384-4ce2-96ec-0db82162b2a5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:54.666229 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-636c0fe6-0181-4bf8-ba63-4d6c224e44d1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "POST /compute/v2.1/servers/c077c0ae-56e2-42f7-a0e7-32e6597062c5/action" status: 202 len: 0 microversion: 2.1 time: 0.201032 Sep 16 12:47:54.666890 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a219288f-0384-4ce2-96ec-0db82162b2a5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:54.667770 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a219288f-0384-4ce2-96ec-0db82162b2a5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:54.668779 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a219288f-0384-4ce2-96ec-0db82162b2a5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:54.674038 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a219288f-0384-4ce2-96ec-0db82162b2a5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:54.674603 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 322/659] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:47:54 2022] POST /compute/v2.1/servers/c077c0ae-56e2-42f7-a0e7-32e6597062c5/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:47:54.680479 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a73014a7-4b6a-43b0-ac9b-3f7d78931bbd tempest-FloatingIPDetailsTestJSON-569140138 tempest-FloatingIPDetailsTestJSON-569140138-project] Calling method '.version_select at 0x7f1035e49dc0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:55.048693 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a219288f-0384-4ce2-96ec-0db82162b2a5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:55.058280 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a219288f-0384-4ce2-96ec-0db82162b2a5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6" status: 200 len: 1463 microversion: 2.1 time: 0.427003 Sep 16 12:47:55.060947 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 338/660] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:54 2022] GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 => generated 1463 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:55.076719 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b948d7e9-48b4-4b12-a7d6-eaac2003b8ba tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:55.078282 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b948d7e9-48b4-4b12-a7d6-eaac2003b8ba tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] [instance: 566f231d-345e-4665-bf9a-b61004b954ed] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:55.091894 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b948d7e9-48b4-4b12-a7d6-eaac2003b8ba tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:55.094167 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b948d7e9-48b4-4b12-a7d6-eaac2003b8ba tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:55.094839 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b948d7e9-48b4-4b12-a7d6-eaac2003b8ba tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:55.098599 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b948d7e9-48b4-4b12-a7d6-eaac2003b8ba tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:55.099547 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b948d7e9-48b4-4b12-a7d6-eaac2003b8ba tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:55.102005 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b948d7e9-48b4-4b12-a7d6-eaac2003b8ba tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:55.109074 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a73014a7-4b6a-43b0-ac9b-3f7d78931bbd tempest-FloatingIPDetailsTestJSON-569140138 tempest-FloatingIPDetailsTestJSON-569140138-project] 10.222.0.67 "GET /compute/v2.1/os-floating-ips" status: 200 len: 399 microversion: 2.1 time: 0.432974 Sep 16 12:47:55.109836 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 323/661] 10.222.0.67 () {58 vars in 1149 bytes} [Fri Sep 16 12:47:54 2022] GET /compute/v2.1/os-floating-ips => generated 399 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:47:55.119556 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8caa1b2b-2bb6-4b40-9fd3-608eae03b035 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:55.119556 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8caa1b2b-2bb6-4b40-9fd3-608eae03b035 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: c077c0ae-56e2-42f7-a0e7-32e6597062c5] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:55.136513 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8caa1b2b-2bb6-4b40-9fd3-608eae03b035 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:55.137183 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8caa1b2b-2bb6-4b40-9fd3-608eae03b035 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:55.140755 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8caa1b2b-2bb6-4b40-9fd3-608eae03b035 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:55.143324 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8caa1b2b-2bb6-4b40-9fd3-608eae03b035 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:55.143920 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8caa1b2b-2bb6-4b40-9fd3-608eae03b035 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:55.148268 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8caa1b2b-2bb6-4b40-9fd3-608eae03b035 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:55.404750 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b948d7e9-48b4-4b12-a7d6-eaac2003b8ba tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed" status: 200 len: 1645 microversion: 2.1 time: 0.341066 Sep 16 12:47:55.405795 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 339/662] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:55 2022] GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed => generated 1645 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:55.410451 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1aad6906-e008-4125-afbe-c3dd8f3cbda4 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:55.411061 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1aad6906-e008-4125-afbe-c3dd8f3cbda4 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:55.426398 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1aad6906-e008-4125-afbe-c3dd8f3cbda4 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:55.429596 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1aad6906-e008-4125-afbe-c3dd8f3cbda4 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:55.430228 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1aad6906-e008-4125-afbe-c3dd8f3cbda4 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:55.432799 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1aad6906-e008-4125-afbe-c3dd8f3cbda4 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:55.433617 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1aad6906-e008-4125-afbe-c3dd8f3cbda4 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:55.434226 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1aad6906-e008-4125-afbe-c3dd8f3cbda4 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:55.464586 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8caa1b2b-2bb6-4b40-9fd3-608eae03b035 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:55.476408 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8caa1b2b-2bb6-4b40-9fd3-608eae03b035 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/c077c0ae-56e2-42f7-a0e7-32e6597062c5" status: 200 len: 1492 microversion: 2.1 time: 0.365404 Sep 16 12:47:55.476999 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 324/663] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:55 2022] GET /compute/v2.1/servers/c077c0ae-56e2-42f7-a0e7-32e6597062c5 => generated 1492 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:55.482088 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d28e0ab1-38d9-4190-a986-0c1f99cdd792 tempest-FloatingIPDetailsTestJSON-569140138 tempest-FloatingIPDetailsTestJSON-569140138-project] Calling method '.version_select at 0x7f1035e491f0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:55.778150 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1aad6906-e008-4125-afbe-c3dd8f3cbda4 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:55.786681 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1aad6906-e008-4125-afbe-c3dd8f3cbda4 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6" status: 200 len: 1463 microversion: 2.1 time: 0.379800 Sep 16 12:47:55.787551 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 340/664] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:55 2022] GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 => generated 1463 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:55.811861 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-158c04c0-797f-415f-859e-65a3061aae7e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:55.812714 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-158c04c0-797f-415f-859e-65a3061aae7e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 8c7aea62-7b4d-400d-89fa-5411deefe490] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:55.824383 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-158c04c0-797f-415f-859e-65a3061aae7e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:55.825079 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-158c04c0-797f-415f-859e-65a3061aae7e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:55.825656 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-158c04c0-797f-415f-859e-65a3061aae7e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:55.826750 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-158c04c0-797f-415f-859e-65a3061aae7e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:55.827384 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-158c04c0-797f-415f-859e-65a3061aae7e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:55.828508 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-158c04c0-797f-415f-859e-65a3061aae7e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:56.119048 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-158c04c0-797f-415f-859e-65a3061aae7e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:56.135837 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-158c04c0-797f-415f-859e-65a3061aae7e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/8c7aea62-7b4d-400d-89fa-5411deefe490" status: 200 len: 1465 microversion: 2.1 time: 0.332887 Sep 16 12:47:56.138254 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 341/665] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:55 2022] GET /compute/v2.1/servers/8c7aea62-7b4d-400d-89fa-5411deefe490 => generated 1465 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:56.147114 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0b187435-8df0-4362-b9fd-1a27490cee02 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1979244796", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": [{"uuid": "40f9024a-6954-4a0a-afdb-132e05c6d9d2"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:56.234157 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-0b187435-8df0-4362-b9fd-1a27490cee02 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] validate_networks() for [('40f9024a-6954-4a0a-afdb-132e05c6d9d2', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:47:56.717514 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d28e0ab1-38d9-4190-a986-0c1f99cdd792 tempest-FloatingIPDetailsTestJSON-569140138 tempest-FloatingIPDetailsTestJSON-569140138-project] 10.222.0.67 "DELETE /compute/v2.1/os-floating-ips/845bdd93-086a-418d-905c-88ca9e7f91c1" status: 202 len: 0 microversion: 2.1 time: 1.238852 Sep 16 12:47:56.718477 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 325/666] 10.222.0.67 () {58 vars in 1263 bytes} [Fri Sep 16 12:47:55 2022] DELETE /compute/v2.1/os-floating-ips/845bdd93-086a-418d-905c-88ca9e7f91c1 => generated 0 bytes in 1240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:47:56.723650 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-0fb4d84d-0dd6-492a-b1d8-20eddb48b59d req-9e15ea63-6c64-405e-9a7e-e02720986a25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6", "name": "network-vif-unplugged", "status": "completed", "tag": "31e589d5-4175-4617-9376-ffdea1a75308"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:56.736873 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-0fb4d84d-0dd6-492a-b1d8-20eddb48b59d req-9e15ea63-6c64-405e-9a7e-e02720986a25 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:56.737834 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-0fb4d84d-0dd6-492a-b1d8-20eddb48b59d req-9e15ea63-6c64-405e-9a7e-e02720986a25 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:56.738751 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-0fb4d84d-0dd6-492a-b1d8-20eddb48b59d req-9e15ea63-6c64-405e-9a7e-e02720986a25 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:56.752335 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-0fb4d84d-0dd6-492a-b1d8-20eddb48b59d req-9e15ea63-6c64-405e-9a7e-e02720986a25 service nova] Creating event network-vif-unplugged:31e589d5-4175-4617-9376-ffdea1a75308 for instance f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 on n-h2-858094-4 Sep 16 12:47:56.766654 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-0fb4d84d-0dd6-492a-b1d8-20eddb48b59d req-9e15ea63-6c64-405e-9a7e-e02720986a25 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046786 Sep 16 12:47:56.768866 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 326/667] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:47:56.781427 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-11c04be1-025e-495a-a2c3-d7fbbc16b8fe tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:56.782385 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-11c04be1-025e-495a-a2c3-d7fbbc16b8fe tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: efea200a-0b78-42de-a9e2-febab9817590] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:56.789226 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-11c04be1-025e-495a-a2c3-d7fbbc16b8fe tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:56.789985 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-11c04be1-025e-495a-a2c3-d7fbbc16b8fe tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:56.790424 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-11c04be1-025e-495a-a2c3-d7fbbc16b8fe tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:56.791137 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-11c04be1-025e-495a-a2c3-d7fbbc16b8fe tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:56.791745 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-11c04be1-025e-495a-a2c3-d7fbbc16b8fe tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:56.792269 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-11c04be1-025e-495a-a2c3-d7fbbc16b8fe tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:56.993838 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-0b187435-8df0-4362-b9fd-1a27490cee02 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:47:56.995668 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-0b187435-8df0-4362-b9fd-1a27490cee02 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:47:56.997004 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-0b187435-8df0-4362-b9fd-1a27490cee02 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:47:56.998148 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-0b187435-8df0-4362-b9fd-1a27490cee02 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:47:56.998908 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-0b187435-8df0-4362-b9fd-1a27490cee02 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:47:57.009729 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-11c04be1-025e-495a-a2c3-d7fbbc16b8fe tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:57.018026 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b187435-8df0-4362-b9fd-1a27490cee02 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:57.018921 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b187435-8df0-4362-b9fd-1a27490cee02 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:57.019063 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-11c04be1-025e-495a-a2c3-d7fbbc16b8fe tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590" status: 200 len: 1476 microversion: 2.1 time: 0.245969 Sep 16 12:47:57.019876 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b187435-8df0-4362-b9fd-1a27490cee02 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:57.020006 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 327/668] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:56 2022] GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590 => generated 1476 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:57.020906 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b187435-8df0-4362-b9fd-1a27490cee02 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:57.021510 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b187435-8df0-4362-b9fd-1a27490cee02 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:57.022077 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b187435-8df0-4362-b9fd-1a27490cee02 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:57.024686 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-811615e9-9430-4bcb-9ba2-642fc32c23e5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:57.027636 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-811615e9-9430-4bcb-9ba2-642fc32c23e5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:57.034599 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-811615e9-9430-4bcb-9ba2-642fc32c23e5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:57.035314 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-811615e9-9430-4bcb-9ba2-642fc32c23e5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:57.035827 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-811615e9-9430-4bcb-9ba2-642fc32c23e5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:57.036562 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-811615e9-9430-4bcb-9ba2-642fc32c23e5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:57.037015 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-811615e9-9430-4bcb-9ba2-642fc32c23e5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:57.037497 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-811615e9-9430-4bcb-9ba2-642fc32c23e5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:57.049605 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-0b187435-8df0-4362-b9fd-1a27490cee02 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Getting quotas for project dd7ec914bffb4743921e4116b0c399eb. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:47:57.062938 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-0b187435-8df0-4362-b9fd-1a27490cee02 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Getting quotas for user 745ef253e9844572a0f081955b3e9a90 and project dd7ec914bffb4743921e4116b0c399eb. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:47:57.092325 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0b187435-8df0-4362-b9fd-1a27490cee02 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:47:57.095262 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0b187435-8df0-4362-b9fd-1a27490cee02 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: a1f478b9-b8e1-40a8-9232-34eb6df9ad7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:47:57.162935 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0b187435-8df0-4362-b9fd-1a27490cee02 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.022462 Sep 16 12:47:57.168460 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 342/669] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:47:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1029 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:47:57.181142 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-811615e9-9430-4bcb-9ba2-642fc32c23e5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:47:57.181683 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-811615e9-9430-4bcb-9ba2-642fc32c23e5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:47:57.182180 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-811615e9-9430-4bcb-9ba2-642fc32c23e5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:47:57.182637 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-811615e9-9430-4bcb-9ba2-642fc32c23e5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:47:57.183054 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-811615e9-9430-4bcb-9ba2-642fc32c23e5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:47:57.252834 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:47:57.300932 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-811615e9-9430-4bcb-9ba2-642fc32c23e5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:57.311395 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-811615e9-9430-4bcb-9ba2-642fc32c23e5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:57.312101 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-811615e9-9430-4bcb-9ba2-642fc32c23e5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:57.312457 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-811615e9-9430-4bcb-9ba2-642fc32c23e5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:57.313224 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-811615e9-9430-4bcb-9ba2-642fc32c23e5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:57.313984 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-811615e9-9430-4bcb-9ba2-642fc32c23e5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:57.314737 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-811615e9-9430-4bcb-9ba2-642fc32c23e5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:57.369566 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-811615e9-9430-4bcb-9ba2-642fc32c23e5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "POST /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6/action" status: 202 len: 1067 microversion: 2.1 time: 0.348385 Sep 16 12:47:57.372065 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 328/670] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:47:57 2022] POST /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6/action => generated 1067 bytes in 351 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 16 12:47:57.380816 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c858753c-a649-4104-b45a-df53701ccb56 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:57.381963 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c858753c-a649-4104-b45a-df53701ccb56 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: c077c0ae-56e2-42f7-a0e7-32e6597062c5] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:57.389126 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c858753c-a649-4104-b45a-df53701ccb56 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:57.389633 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c858753c-a649-4104-b45a-df53701ccb56 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:57.391025 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c858753c-a649-4104-b45a-df53701ccb56 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:57.392553 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c858753c-a649-4104-b45a-df53701ccb56 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:57.393005 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c858753c-a649-4104-b45a-df53701ccb56 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:57.394086 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c858753c-a649-4104-b45a-df53701ccb56 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:57.647886 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5b8098e9-29e4-4b9b-b15d-89ceb90add97 tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:57.648551 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5b8098e9-29e4-4b9b-b15d-89ceb90add97 tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] [instance: 8c7aea62-7b4d-400d-89fa-5411deefe490] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:57.675130 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b8098e9-29e4-4b9b-b15d-89ceb90add97 tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:57.675572 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b8098e9-29e4-4b9b-b15d-89ceb90add97 tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:57.676015 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b8098e9-29e4-4b9b-b15d-89ceb90add97 tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:57.681457 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b8098e9-29e4-4b9b-b15d-89ceb90add97 tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:57.681960 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b8098e9-29e4-4b9b-b15d-89ceb90add97 tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:57.682410 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b8098e9-29e4-4b9b-b15d-89ceb90add97 tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:57.797297 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c858753c-a649-4104-b45a-df53701ccb56 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:57.811250 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c858753c-a649-4104-b45a-df53701ccb56 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/c077c0ae-56e2-42f7-a0e7-32e6597062c5" status: 200 len: 1472 microversion: 2.1 time: 0.437767 Sep 16 12:47:57.824503 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 329/671] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:57 2022] GET /compute/v2.1/servers/c077c0ae-56e2-42f7-a0e7-32e6597062c5 => generated 1472 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:57.845068 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1fc5aadf-4f65-46ba-8e80-0404a9125089 tempest-FloatingIPDetailsTestJSON-569140138 tempest-FloatingIPDetailsTestJSON-569140138-project] Calling method '.version_select at 0x7f1035ee3280>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:58.530228 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5b8098e9-29e4-4b9b-b15d-89ceb90add97 tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/8c7aea62-7b4d-400d-89fa-5411deefe490" status: 200 len: 1616 microversion: 2.1 time: 1.360415 Sep 16 12:47:58.546150 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 343/672] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:57 2022] GET /compute/v2.1/servers/8c7aea62-7b4d-400d-89fa-5411deefe490 => generated 1616 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:58.557696 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bec7f98e-0330-4abc-849e-8a350e833183 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:58.558525 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bec7f98e-0330-4abc-849e-8a350e833183 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: a1f478b9-b8e1-40a8-9232-34eb6df9ad7a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:58.564622 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:47:58.566910 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bec7f98e-0330-4abc-849e-8a350e833183 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:58.567613 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bec7f98e-0330-4abc-849e-8a350e833183 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:58.568255 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bec7f98e-0330-4abc-849e-8a350e833183 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:58.569151 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bec7f98e-0330-4abc-849e-8a350e833183 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:58.569777 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bec7f98e-0330-4abc-849e-8a350e833183 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:58.570363 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bec7f98e-0330-4abc-849e-8a350e833183 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:58.748865 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bec7f98e-0330-4abc-849e-8a350e833183 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:58.760255 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bec7f98e-0330-4abc-849e-8a350e833183 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a" status: 200 len: 1263 microversion: 2.1 time: 0.207166 Sep 16 12:47:58.777094 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 344/673] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:58 2022] GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a => generated 1263 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:58.784864 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-df1efcba-677a-46ce-9c14-0c33ea15f9e6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:58.786157 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-df1efcba-677a-46ce-9c14-0c33ea15f9e6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:58.793813 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df1efcba-677a-46ce-9c14-0c33ea15f9e6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:58.795210 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df1efcba-677a-46ce-9c14-0c33ea15f9e6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:58.796848 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df1efcba-677a-46ce-9c14-0c33ea15f9e6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:58.799174 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df1efcba-677a-46ce-9c14-0c33ea15f9e6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:58.800417 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df1efcba-677a-46ce-9c14-0c33ea15f9e6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:58.801332 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df1efcba-677a-46ce-9c14-0c33ea15f9e6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:59.086033 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-df1efcba-677a-46ce-9c14-0c33ea15f9e6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:59.097634 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-df1efcba-677a-46ce-9c14-0c33ea15f9e6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6" status: 200 len: 1472 microversion: 2.1 time: 0.318336 Sep 16 12:47:59.100301 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 345/674] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:58 2022] GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 => generated 1472 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:59.109287 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8ef0d8a0-34e9-42ae-9b78-eeadde11b281 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1283787437"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:59.113807 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8ef0d8a0-34e9-42ae-9b78-eeadde11b281 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: c077c0ae-56e2-42f7-a0e7-32e6597062c5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:59.131438 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ef0d8a0-34e9-42ae-9b78-eeadde11b281 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:59.132300 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ef0d8a0-34e9-42ae-9b78-eeadde11b281 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:59.132897 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ef0d8a0-34e9-42ae-9b78-eeadde11b281 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:59.145484 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ef0d8a0-34e9-42ae-9b78-eeadde11b281 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:59.146198 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ef0d8a0-34e9-42ae-9b78-eeadde11b281 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:59.146812 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ef0d8a0-34e9-42ae-9b78-eeadde11b281 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:59.255148 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1fc5aadf-4f65-46ba-8e80-0404a9125089 tempest-FloatingIPDetailsTestJSON-569140138 tempest-FloatingIPDetailsTestJSON-569140138-project] 10.222.0.67 "DELETE /compute/v2.1/os-floating-ips/da0c0758-616e-444d-a51f-2c9148498f32" status: 202 len: 0 microversion: 2.1 time: 1.434096 Sep 16 12:47:59.257061 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 330/675] 10.222.0.67 () {58 vars in 1263 bytes} [Fri Sep 16 12:47:57 2022] DELETE /compute/v2.1/os-floating-ips/da0c0758-616e-444d-a51f-2c9148498f32 => generated 0 bytes in 1438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:47:59.262341 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8ecdf72f-a0cb-43a8-a402-7cc40f613ef2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:59.265245 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8ecdf72f-a0cb-43a8-a402-7cc40f613ef2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: efea200a-0b78-42de-a9e2-febab9817590] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:59.274086 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8ecdf72f-a0cb-43a8-a402-7cc40f613ef2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:59.275041 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8ecdf72f-a0cb-43a8-a402-7cc40f613ef2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:59.275681 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8ecdf72f-a0cb-43a8-a402-7cc40f613ef2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:59.277333 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8ecdf72f-a0cb-43a8-a402-7cc40f613ef2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:59.278156 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8ecdf72f-a0cb-43a8-a402-7cc40f613ef2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:59.279938 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8ecdf72f-a0cb-43a8-a402-7cc40f613ef2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:59.435754 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8ef0d8a0-34e9-42ae-9b78-eeadde11b281 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "POST /compute/v2.1/servers/c077c0ae-56e2-42f7-a0e7-32e6597062c5/action" status: 202 len: 0 microversion: 2.1 time: 0.331698 Sep 16 12:47:59.441975 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 346/676] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:47:59 2022] POST /compute/v2.1/servers/c077c0ae-56e2-42f7-a0e7-32e6597062c5/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 16 12:47:59.443407 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2077c80e-158e-4657-a4ca-66ef08cacb51 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Action: 'create', calling method: .version_select at 0x7f1035edb5e0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-562317732", "policies": ["affinity"]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:59.462023 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8ecdf72f-a0cb-43a8-a402-7cc40f613ef2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:59.471110 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8ecdf72f-a0cb-43a8-a402-7cc40f613ef2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590" status: 200 len: 1476 microversion: 2.1 time: 0.212765 Sep 16 12:47:59.474612 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 331/677] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:59 2022] GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590 => generated 1476 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:59.478856 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-2077c80e-158e-4657-a4ca-66ef08cacb51 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Getting quotas for project 8c037a6456444018a6ef54314419e2f2. Resources: {'server_groups'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:47:59.481090 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-0fe16719-fc4d-4948-9e87-b1d67009698a req-e96833db-2786-411a-b338-0a683eef6cce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6", "name": "network-vif-plugged", "status": "completed", "tag": "31e589d5-4175-4617-9376-ffdea1a75308"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:47:59.485422 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-2077c80e-158e-4657-a4ca-66ef08cacb51 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Getting quotas for user c1928790cac542ec86add5794851f97a and project 8c037a6456444018a6ef54314419e2f2. Resources: {'server_groups'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:47:59.492460 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-0fe16719-fc4d-4948-9e87-b1d67009698a req-e96833db-2786-411a-b338-0a683eef6cce service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:59.493218 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-0fe16719-fc4d-4948-9e87-b1d67009698a req-e96833db-2786-411a-b338-0a683eef6cce service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:59.493649 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-0fe16719-fc4d-4948-9e87-b1d67009698a req-e96833db-2786-411a-b338-0a683eef6cce service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:59.509509 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-0fe16719-fc4d-4948-9e87-b1d67009698a req-e96833db-2786-411a-b338-0a683eef6cce service nova] Creating event network-vif-plugged:31e589d5-4175-4617-9376-ffdea1a75308 for instance f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 on n-h2-858094-4 Sep 16 12:47:59.517884 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-0fe16719-fc4d-4948-9e87-b1d67009698a req-e96833db-2786-411a-b338-0a683eef6cce service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041720 Sep 16 12:47:59.518900 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 332/678] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:47:59.526369 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-37fc3130-f89c-4f31-9473-c0990355d95a tempest-FloatingIPDetailsTestJSON-569140138 tempest-FloatingIPDetailsTestJSON-569140138-project] Calling method '.version_select at 0x7f1035c77550>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:59.568013 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-2077c80e-158e-4657-a4ca-66ef08cacb51 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Getting quotas for project 8c037a6456444018a6ef54314419e2f2. Resources: {'server_groups'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:47:59.573833 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-2077c80e-158e-4657-a4ca-66ef08cacb51 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Getting quotas for user c1928790cac542ec86add5794851f97a and project 8c037a6456444018a6ef54314419e2f2. Resources: {'server_groups'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:47:59.588052 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2077c80e-158e-4657-a4ca-66ef08cacb51 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.149712 Sep 16 12:47:59.600872 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 347/679] 10.222.0.67 () {60 vars in 1174 bytes} [Fri Sep 16 12:47:59 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:47:59.606498 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e1a8de75-4a4b-444c-a6f6-8f9d3e619bb8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f1035edb790>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:59.694162 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e1a8de75-4a4b-444c-a6f6-8f9d3e619bb8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/b7be3aa9-bb67-45cb-9262-02de0dc4a4b0" status: 200 len: 1412 microversion: 2.1 time: 0.092241 Sep 16 12:47:59.696032 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 348/680] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:47:59 2022] GET /compute/v2.1/images/b7be3aa9-bb67-45cb-9262-02de0dc4a4b0 => generated 1412 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:47:59.789854 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-54c8fad1-fe10-4c05-a6ba-877635eea5c1 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:47:59.791055 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-54c8fad1-fe10-4c05-a6ba-877635eea5c1 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: a1f478b9-b8e1-40a8-9232-34eb6df9ad7a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:47:59.803689 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54c8fad1-fe10-4c05-a6ba-877635eea5c1 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:59.804471 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54c8fad1-fe10-4c05-a6ba-877635eea5c1 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:59.805345 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54c8fad1-fe10-4c05-a6ba-877635eea5c1 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:59.806279 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54c8fad1-fe10-4c05-a6ba-877635eea5c1 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:47:59.807956 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54c8fad1-fe10-4c05-a6ba-877635eea5c1 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:47:59.814317 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54c8fad1-fe10-4c05-a6ba-877635eea5c1 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:47:59.967394 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-54c8fad1-fe10-4c05-a6ba-877635eea5c1 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:47:59.975814 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-54c8fad1-fe10-4c05-a6ba-877635eea5c1 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a" status: 200 len: 1269 microversion: 2.1 time: 0.191045 Sep 16 12:47:59.995722 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 349/681] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:47:59 2022] GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a => generated 1269 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:48:00.001286 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1dbcac38-5f14-4b0d-b151-81d23e10676b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1898252070", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "8f990c0d-f2fd-44c0-ad6d-32dadf5fc37b"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:00.084477 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-1dbcac38-5f14-4b0d-b151-81d23e10676b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] validate_networks() for None {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:48:01.334358 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-1dbcac38-5f14-4b0d-b151-81d23e10676b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:48:01.336071 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-1dbcac38-5f14-4b0d-b151-81d23e10676b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:48:01.341201 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-1dbcac38-5f14-4b0d-b151-81d23e10676b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:48:01.342891 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-1dbcac38-5f14-4b0d-b151-81d23e10676b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:48:01.343555 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-1dbcac38-5f14-4b0d-b151-81d23e10676b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:48:01.399440 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dbcac38-5f14-4b0d-b151-81d23e10676b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:01.400796 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dbcac38-5f14-4b0d-b151-81d23e10676b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:01.401857 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dbcac38-5f14-4b0d-b151-81d23e10676b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:01.403219 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dbcac38-5f14-4b0d-b151-81d23e10676b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:01.404390 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dbcac38-5f14-4b0d-b151-81d23e10676b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:01.405139 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dbcac38-5f14-4b0d-b151-81d23e10676b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:01.451251 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-1dbcac38-5f14-4b0d-b151-81d23e10676b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Getting quotas for project 8c037a6456444018a6ef54314419e2f2. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:48:01.461765 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-1dbcac38-5f14-4b0d-b151-81d23e10676b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Getting quotas for user c1928790cac542ec86add5794851f97a and project 8c037a6456444018a6ef54314419e2f2. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:48:01.520514 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1dbcac38-5f14-4b0d-b151-81d23e10676b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Going to run 2 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:48:01.523369 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1dbcac38-5f14-4b0d-b151-81d23e10676b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 8d5c44e7-c030-4a42-97fb-e838e1472456] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:48:01.625844 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-1dbcac38-5f14-4b0d-b151-81d23e10676b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128779) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 16 12:48:01.734946 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-1dbcac38-5f14-4b0d-b151-81d23e10676b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Getting quotas for project 8c037a6456444018a6ef54314419e2f2. Resources: {'server_group_members'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:48:01.828056 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-37fc3130-f89c-4f31-9473-c0990355d95a tempest-FloatingIPDetailsTestJSON-569140138 tempest-FloatingIPDetailsTestJSON-569140138-project] 10.222.0.67 "DELETE /compute/v2.1/os-floating-ips/d04f476d-f5f5-40b9-bd84-6cbe6d50ce4a" status: 202 len: 0 microversion: 2.1 time: 2.303527 Sep 16 12:48:01.830338 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 333/682] 10.222.0.67 () {58 vars in 1263 bytes} [Fri Sep 16 12:47:59 2022] DELETE /compute/v2.1/os-floating-ips/d04f476d-f5f5-40b9-bd84-6cbe6d50ce4a => generated 0 bytes in 2311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:48:01.842468 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1e22508a-e865-477e-b7d7-fb50e76994fc tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:01.845392 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-1e22508a-e865-477e-b7d7-fb50e76994fc tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:01.848376 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:48:01.862313 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1e22508a-e865-477e-b7d7-fb50e76994fc tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:01.863501 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1e22508a-e865-477e-b7d7-fb50e76994fc tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:01.865617 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1e22508a-e865-477e-b7d7-fb50e76994fc tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:01.869242 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1e22508a-e865-477e-b7d7-fb50e76994fc tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:01.884026 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1e22508a-e865-477e-b7d7-fb50e76994fc tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:01.887223 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1e22508a-e865-477e-b7d7-fb50e76994fc tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:02.077630 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-1dbcac38-5f14-4b0d-b151-81d23e10676b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Getting quotas for user c1928790cac542ec86add5794851f97a and project 8c037a6456444018a6ef54314419e2f2. Resources: {'server_group_members'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:48:02.203021 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-1dbcac38-5f14-4b0d-b151-81d23e10676b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Getting quotas for project 8c037a6456444018a6ef54314419e2f2. Resources: {'server_group_members'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:48:02.211213 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-1dbcac38-5f14-4b0d-b151-81d23e10676b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Getting quotas for user c1928790cac542ec86add5794851f97a and project 8c037a6456444018a6ef54314419e2f2. Resources: {'server_group_members'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:48:02.236800 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1dbcac38-5f14-4b0d-b151-81d23e10676b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 21107d05-79f1-476d-b921-9548eff4f2c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=8d5c44e7-c030-4a42-97fb-e838e1472456,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:48:02.330475 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-1dbcac38-5f14-4b0d-b151-81d23e10676b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Getting quotas for project 8c037a6456444018a6ef54314419e2f2. Resources: {'server_group_members'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:48:02.361282 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-1dbcac38-5f14-4b0d-b151-81d23e10676b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Getting quotas for user c1928790cac542ec86add5794851f97a and project 8c037a6456444018a6ef54314419e2f2. Resources: {'server_group_members'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:48:02.391840 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1e22508a-e865-477e-b7d7-fb50e76994fc tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:02.403303 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1e22508a-e865-477e-b7d7-fb50e76994fc tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6" status: 200 len: 1472 microversion: 2.1 time: 0.568859 Sep 16 12:48:02.416602 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 334/683] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:01 2022] GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 => generated 1472 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:02.445492 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-eb185cb8-3e66-4399-bf99-2a4ac0c673ae tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:02.446259 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-eb185cb8-3e66-4399-bf99-2a4ac0c673ae tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: efea200a-0b78-42de-a9e2-febab9817590] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:02.459032 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eb185cb8-3e66-4399-bf99-2a4ac0c673ae tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:02.461575 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eb185cb8-3e66-4399-bf99-2a4ac0c673ae tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:02.462695 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eb185cb8-3e66-4399-bf99-2a4ac0c673ae tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:02.464703 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eb185cb8-3e66-4399-bf99-2a4ac0c673ae tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:02.465529 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eb185cb8-3e66-4399-bf99-2a4ac0c673ae tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:02.468812 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-1dbcac38-5f14-4b0d-b151-81d23e10676b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Getting quotas for project 8c037a6456444018a6ef54314419e2f2. Resources: {'server_group_members'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:48:02.469667 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eb185cb8-3e66-4399-bf99-2a4ac0c673ae tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:02.484354 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:48:02.486452 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-1dbcac38-5f14-4b0d-b151-81d23e10676b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Getting quotas for user c1928790cac542ec86add5794851f97a and project 8c037a6456444018a6ef54314419e2f2. Resources: {'server_group_members'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:48:02.567101 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1dbcac38-5f14-4b0d-b151-81d23e10676b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.569549 Sep 16 12:48:02.567722 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 350/684] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:47:59 2022] POST /compute/v2.1/servers => generated 32 bytes in 2571 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 16 12:48:02.582563 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5bc5dfd1-364f-405f-a7eb-cd7b27f9b48d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f1035caa940>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:02.634169 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5bc5dfd1-364f-405f-a7eb-cd7b27f9b48d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/b7be3aa9-bb67-45cb-9262-02de0dc4a4b0" status: 200 len: 1412 microversion: 2.1 time: 0.062274 Sep 16 12:48:02.642734 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 351/685] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:48:02 2022] GET /compute/v2.1/images/b7be3aa9-bb67-45cb-9262-02de0dc4a4b0 => generated 1412 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:02.647969 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d22aad55-6e7a-4549-83c0-14042fbf0bbb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:02.648762 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d22aad55-6e7a-4549-83c0-14042fbf0bbb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: a1f478b9-b8e1-40a8-9232-34eb6df9ad7a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:02.663126 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d22aad55-6e7a-4549-83c0-14042fbf0bbb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:02.663951 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d22aad55-6e7a-4549-83c0-14042fbf0bbb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:02.664691 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d22aad55-6e7a-4549-83c0-14042fbf0bbb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:02.666347 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d22aad55-6e7a-4549-83c0-14042fbf0bbb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:02.666933 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d22aad55-6e7a-4549-83c0-14042fbf0bbb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:02.667470 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d22aad55-6e7a-4549-83c0-14042fbf0bbb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:03.086901 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-eb185cb8-3e66-4399-bf99-2a4ac0c673ae tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:03.096912 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-eb185cb8-3e66-4399-bf99-2a4ac0c673ae tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590" status: 200 len: 1476 microversion: 2.1 time: 0.676591 Sep 16 12:48:03.097285 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d22aad55-6e7a-4549-83c0-14042fbf0bbb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:03.097998 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 335/686] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:02 2022] GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590 => generated 1476 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:03.113869 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-e2270bda-6325-43fa-a7f5-3dc9f585d981 req-8629f71e-2567-483e-83b5-e662e12e3a73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1f478b9-b8e1-40a8-9232-34eb6df9ad7a", "tag": "8109ea32-2ace-4f1c-be0b-e7fa4599d05e"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:03.121864 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d22aad55-6e7a-4549-83c0-14042fbf0bbb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a" status: 200 len: 1311 microversion: 2.1 time: 0.485635 Sep 16 12:48:03.123365 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 352/687] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:02 2022] GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a => generated 1311 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:03.130159 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8c417d87-2d60-4e08-a7f6-a55f7f177a1a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:03.135776 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8c417d87-2d60-4e08-a7f6-a55f7f177a1a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:03.136981 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8c417d87-2d60-4e08-a7f6-a55f7f177a1a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Searching by: {'deleted': False, 'project_id': '8c037a6456444018a6ef54314419e2f2'} {{(pid=128779) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 12:48:03.178456 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-e2270bda-6325-43fa-a7f5-3dc9f585d981 req-8629f71e-2567-483e-83b5-e662e12e3a73 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:03.179039 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-e2270bda-6325-43fa-a7f5-3dc9f585d981 req-8629f71e-2567-483e-83b5-e662e12e3a73 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:03.179493 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-e2270bda-6325-43fa-a7f5-3dc9f585d981 req-8629f71e-2567-483e-83b5-e662e12e3a73 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:03.180036 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c417d87-2d60-4e08-a7f6-a55f7f177a1a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:03.186205 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c417d87-2d60-4e08-a7f6-a55f7f177a1a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:03.187067 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c417d87-2d60-4e08-a7f6-a55f7f177a1a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:03.188146 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c417d87-2d60-4e08-a7f6-a55f7f177a1a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:03.188852 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c417d87-2d60-4e08-a7f6-a55f7f177a1a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:03.189532 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c417d87-2d60-4e08-a7f6-a55f7f177a1a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:03.213519 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-e2270bda-6325-43fa-a7f5-3dc9f585d981 req-8629f71e-2567-483e-83b5-e662e12e3a73 service nova] Creating event network-changed:8109ea32-2ace-4f1c-be0b-e7fa4599d05e for instance a1f478b9-b8e1-40a8-9232-34eb6df9ad7a on n-h2-858094-4 Sep 16 12:48:03.227119 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-e2270bda-6325-43fa-a7f5-3dc9f585d981 req-8629f71e-2567-483e-83b5-e662e12e3a73 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127599 Sep 16 12:48:03.228808 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 336/688] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:48:03.338103 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.multi_cell_list [None req-8c417d87-2d60-4e08-a7f6-a55f7f177a1a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=128779) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 12:48:03.341690 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:48:03.441636 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8c417d87-2d60-4e08-a7f6-a55f7f177a1a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.316875 Sep 16 12:48:03.442281 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a045ca68-6fea-4ab3-a3e3-283c5527993c tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:03.442465 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a045ca68-6fea-4ab3-a3e3-283c5527993c tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:03.451253 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 353/689] 10.222.0.67 () {58 vars in 1125 bytes} [Fri Sep 16 12:48:03 2022] GET /compute/v2.1/servers => generated 1003 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:03.463406 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a9fd1fd9-03a5-46fe-ba06-6df54e52fc4e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:03.465629 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a9fd1fd9-03a5-46fe-ba06-6df54e52fc4e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 21107d05-79f1-476d-b921-9548eff4f2c4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:03.474297 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a045ca68-6fea-4ab3-a3e3-283c5527993c tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:03.475677 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a045ca68-6fea-4ab3-a3e3-283c5527993c tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:03.479436 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a045ca68-6fea-4ab3-a3e3-283c5527993c tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:03.483899 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a045ca68-6fea-4ab3-a3e3-283c5527993c tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:03.485265 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a045ca68-6fea-4ab3-a3e3-283c5527993c tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:03.485877 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a045ca68-6fea-4ab3-a3e3-283c5527993c tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:03.593857 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a9fd1fd9-03a5-46fe-ba06-6df54e52fc4e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:03.604416 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a9fd1fd9-03a5-46fe-ba06-6df54e52fc4e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/21107d05-79f1-476d-b921-9548eff4f2c4" status: 200 len: 1219 microversion: 2.1 time: 0.145297 Sep 16 12:48:03.609960 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 354/690] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:03 2022] GET /compute/v2.1/servers/21107d05-79f1-476d-b921-9548eff4f2c4 => generated 1219 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:03.651175 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e53053cc-6c9e-46b7-a9dc-5e460a602243 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f1035eaab80>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:03.843299 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e53053cc-6c9e-46b7-a9dc-5e460a602243 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/b7be3aa9-bb67-45cb-9262-02de0dc4a4b0" status: 200 len: 1412 microversion: 2.1 time: 0.196415 Sep 16 12:48:03.848155 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 355/691] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:48:03 2022] GET /compute/v2.1/images/b7be3aa9-bb67-45cb-9262-02de0dc4a4b0 => generated 1412 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:04.058234 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a045ca68-6fea-4ab3-a3e3-283c5527993c tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:04.072508 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a045ca68-6fea-4ab3-a3e3-283c5527993c tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6" status: 200 len: 1472 microversion: 2.1 time: 0.638387 Sep 16 12:48:04.079275 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 337/692] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:03 2022] GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 => generated 1472 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:04.122593 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a4ae0e17-5ebb-4bd5-a780-ce5948a380da tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:04.123472 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a4ae0e17-5ebb-4bd5-a780-ce5948a380da tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: efea200a-0b78-42de-a9e2-febab9817590] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:04.133894 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4ae0e17-5ebb-4bd5-a780-ce5948a380da tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:04.140586 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4ae0e17-5ebb-4bd5-a780-ce5948a380da tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:04.142483 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4ae0e17-5ebb-4bd5-a780-ce5948a380da tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:04.146084 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4ae0e17-5ebb-4bd5-a780-ce5948a380da tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:04.155663 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4a207093-cbe2-4064-b059-5e6950c10617 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:04.156972 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-4a207093-cbe2-4064-b059-5e6950c10617 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: a1f478b9-b8e1-40a8-9232-34eb6df9ad7a] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:04.164084 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4ae0e17-5ebb-4bd5-a780-ce5948a380da tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:04.168513 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4ae0e17-5ebb-4bd5-a780-ce5948a380da tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:04.170597 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4a207093-cbe2-4064-b059-5e6950c10617 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:04.178089 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4a207093-cbe2-4064-b059-5e6950c10617 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:04.180097 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4a207093-cbe2-4064-b059-5e6950c10617 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:04.181066 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4a207093-cbe2-4064-b059-5e6950c10617 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:04.184915 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4a207093-cbe2-4064-b059-5e6950c10617 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:04.185643 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4a207093-cbe2-4064-b059-5e6950c10617 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:05.243131 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a4ae0e17-5ebb-4bd5-a780-ce5948a380da tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:05.256093 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a4ae0e17-5ebb-4bd5-a780-ce5948a380da tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590" status: 200 len: 1476 microversion: 2.1 time: 1.137406 Sep 16 12:48:05.263894 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 356/693] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:04 2022] GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590 => generated 1476 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:05.263894 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d4e5ef34-7c20-4d1b-ab50-57667f879d83 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:05.264820 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d4e5ef34-7c20-4d1b-ab50-57667f879d83 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 21107d05-79f1-476d-b921-9548eff4f2c4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:05.281409 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4a207093-cbe2-4064-b059-5e6950c10617 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:05.295718 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4e5ef34-7c20-4d1b-ab50-57667f879d83 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:05.297099 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4a207093-cbe2-4064-b059-5e6950c10617 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a" status: 200 len: 1311 microversion: 2.1 time: 1.146074 Sep 16 12:48:05.297754 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4e5ef34-7c20-4d1b-ab50-57667f879d83 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:05.298901 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 338/694] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:04 2022] GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a => generated 1311 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:48:05.299327 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4e5ef34-7c20-4d1b-ab50-57667f879d83 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:05.300938 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4e5ef34-7c20-4d1b-ab50-57667f879d83 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:05.302329 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4e5ef34-7c20-4d1b-ab50-57667f879d83 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:05.304147 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4e5ef34-7c20-4d1b-ab50-57667f879d83 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:05.310962 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e0f0d00c-8c23-4cf5-aa01-2cb51cba02a4 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f1036074ee0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:05.411106 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e0f0d00c-8c23-4cf5-aa01-2cb51cba02a4 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/b7be3aa9-bb67-45cb-9262-02de0dc4a4b0" status: 200 len: 1412 microversion: 2.1 time: 0.109299 Sep 16 12:48:05.412097 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 339/695] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:48:05 2022] GET /compute/v2.1/images/b7be3aa9-bb67-45cb-9262-02de0dc4a4b0 => generated 1412 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:05.417276 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-640f7cf2-1d87-487a-a5af-5e1c359f6411 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:05.417913 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-640f7cf2-1d87-487a-a5af-5e1c359f6411 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:05.431646 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-640f7cf2-1d87-487a-a5af-5e1c359f6411 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:05.432684 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-640f7cf2-1d87-487a-a5af-5e1c359f6411 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:05.437017 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-640f7cf2-1d87-487a-a5af-5e1c359f6411 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:05.439938 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-640f7cf2-1d87-487a-a5af-5e1c359f6411 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:05.440854 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-640f7cf2-1d87-487a-a5af-5e1c359f6411 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:05.447028 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-640f7cf2-1d87-487a-a5af-5e1c359f6411 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:05.639419 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d4e5ef34-7c20-4d1b-ab50-57667f879d83 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:05.666262 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d4e5ef34-7c20-4d1b-ab50-57667f879d83 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/21107d05-79f1-476d-b921-9548eff4f2c4" status: 200 len: 1215 microversion: 2.1 time: 0.406270 Sep 16 12:48:05.668944 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 357/696] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:05 2022] GET /compute/v2.1/servers/21107d05-79f1-476d-b921-9548eff4f2c4 => generated 1215 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:06.289928 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ab600fac-bb50-4995-8c54-601992912346 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:06.290597 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ab600fac-bb50-4995-8c54-601992912346 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: efea200a-0b78-42de-a9e2-febab9817590] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:06.295647 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-640f7cf2-1d87-487a-a5af-5e1c359f6411 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:06.298034 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab600fac-bb50-4995-8c54-601992912346 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:06.310818 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-640f7cf2-1d87-487a-a5af-5e1c359f6411 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6" status: 200 len: 1472 microversion: 2.1 time: 0.897021 Sep 16 12:48:06.311522 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab600fac-bb50-4995-8c54-601992912346 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:06.312718 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab600fac-bb50-4995-8c54-601992912346 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:06.323017 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 340/697] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:05 2022] GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 => generated 1472 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:06.341837 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab600fac-bb50-4995-8c54-601992912346 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:06.342766 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab600fac-bb50-4995-8c54-601992912346 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:06.344278 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab600fac-bb50-4995-8c54-601992912346 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:06.347573 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-51bb0e67-12a2-45d3-a502-4486c0926b78 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:06.360264 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-51bb0e67-12a2-45d3-a502-4486c0926b78 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: a1f478b9-b8e1-40a8-9232-34eb6df9ad7a] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:06.380603 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-51bb0e67-12a2-45d3-a502-4486c0926b78 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:06.386353 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-51bb0e67-12a2-45d3-a502-4486c0926b78 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:06.387188 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-51bb0e67-12a2-45d3-a502-4486c0926b78 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:06.389094 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-51bb0e67-12a2-45d3-a502-4486c0926b78 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:06.392724 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-51bb0e67-12a2-45d3-a502-4486c0926b78 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:06.393451 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-51bb0e67-12a2-45d3-a502-4486c0926b78 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:06.873047 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ab600fac-bb50-4995-8c54-601992912346 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:06.890313 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ab600fac-bb50-4995-8c54-601992912346 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590" status: 200 len: 1476 microversion: 2.1 time: 0.604876 Sep 16 12:48:06.895287 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 358/698] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:06 2022] GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590 => generated 1476 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:48:06.923561 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f6ec7c43-61eb-48e3-bca7-38a41262e711 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f1036406ee0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:07.037574 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f6ec7c43-61eb-48e3-bca7-38a41262e711 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/b7be3aa9-bb67-45cb-9262-02de0dc4a4b0" status: 200 len: 1412 microversion: 2.1 time: 0.140028 Sep 16 12:48:07.038370 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 359/699] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:48:06 2022] GET /compute/v2.1/images/b7be3aa9-bb67-45cb-9262-02de0dc4a4b0 => generated 1412 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:07.048818 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-05785942-a213-4a3e-a2c7-e34f5a047f29 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:07.054488 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-05785942-a213-4a3e-a2c7-e34f5a047f29 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 21107d05-79f1-476d-b921-9548eff4f2c4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:07.067513 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05785942-a213-4a3e-a2c7-e34f5a047f29 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:07.068020 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05785942-a213-4a3e-a2c7-e34f5a047f29 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:07.068492 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05785942-a213-4a3e-a2c7-e34f5a047f29 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:07.069202 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05785942-a213-4a3e-a2c7-e34f5a047f29 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:07.079567 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-51bb0e67-12a2-45d3-a502-4486c0926b78 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:07.082227 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05785942-a213-4a3e-a2c7-e34f5a047f29 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:07.082681 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05785942-a213-4a3e-a2c7-e34f5a047f29 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:07.107467 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-51bb0e67-12a2-45d3-a502-4486c0926b78 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a" status: 200 len: 1311 microversion: 2.1 time: 0.766858 Sep 16 12:48:07.108095 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 341/700] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:06 2022] GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a => generated 1311 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:07.343474 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d35a6712-61b4-4c64-a6f6-70f91703b713 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:07.344093 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d35a6712-61b4-4c64-a6f6-70f91703b713 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:07.363056 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d35a6712-61b4-4c64-a6f6-70f91703b713 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:07.364277 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d35a6712-61b4-4c64-a6f6-70f91703b713 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:07.366018 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d35a6712-61b4-4c64-a6f6-70f91703b713 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:07.367428 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d35a6712-61b4-4c64-a6f6-70f91703b713 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:07.369327 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d35a6712-61b4-4c64-a6f6-70f91703b713 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:07.371369 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d35a6712-61b4-4c64-a6f6-70f91703b713 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:07.548194 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-05785942-a213-4a3e-a2c7-e34f5a047f29 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:07.566691 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-05785942-a213-4a3e-a2c7-e34f5a047f29 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/21107d05-79f1-476d-b921-9548eff4f2c4" status: 200 len: 1277 microversion: 2.1 time: 0.523278 Sep 16 12:48:07.580285 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 360/701] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:07 2022] GET /compute/v2.1/servers/21107d05-79f1-476d-b921-9548eff4f2c4 => generated 1277 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:07.618653 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-87bdd044-cce7-458c-ad52-b2191e1769b0 req-ffef7160-da90-48cb-a4b0-5f119cea2aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c077c0ae-56e2-42f7-a0e7-32e6597062c5", "name": "network-vif-plugged", "status": "completed", "tag": "45b8553e-f99f-4d12-8265-19759ca804ba"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:07.641001 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-87bdd044-cce7-458c-ad52-b2191e1769b0 req-ffef7160-da90-48cb-a4b0-5f119cea2aa0 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:07.643055 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-87bdd044-cce7-458c-ad52-b2191e1769b0 req-ffef7160-da90-48cb-a4b0-5f119cea2aa0 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:07.643787 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-87bdd044-cce7-458c-ad52-b2191e1769b0 req-ffef7160-da90-48cb-a4b0-5f119cea2aa0 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:07.660824 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-87bdd044-cce7-458c-ad52-b2191e1769b0 req-ffef7160-da90-48cb-a4b0-5f119cea2aa0 service nova] Creating event network-vif-plugged:45b8553e-f99f-4d12-8265-19759ca804ba for instance c077c0ae-56e2-42f7-a0e7-32e6597062c5 on n-h1-858094-4 Sep 16 12:48:07.672539 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-87bdd044-cce7-458c-ad52-b2191e1769b0 req-ffef7160-da90-48cb-a4b0-5f119cea2aa0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057252 Sep 16 12:48:07.674119 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 361/702] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:48:07.818884 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d35a6712-61b4-4c64-a6f6-70f91703b713 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:07.837678 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d35a6712-61b4-4c64-a6f6-70f91703b713 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6" status: 200 len: 1472 microversion: 2.1 time: 0.498585 Sep 16 12:48:07.838959 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 342/703] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:07 2022] GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 => generated 1472 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:48:07.933487 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c69b0271-acb1-4521-8cfa-84cd62422d4e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:07.936072 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c69b0271-acb1-4521-8cfa-84cd62422d4e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: efea200a-0b78-42de-a9e2-febab9817590] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:07.960418 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c69b0271-acb1-4521-8cfa-84cd62422d4e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:07.961832 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c69b0271-acb1-4521-8cfa-84cd62422d4e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:07.962585 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c69b0271-acb1-4521-8cfa-84cd62422d4e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:07.965192 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c69b0271-acb1-4521-8cfa-84cd62422d4e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:07.967273 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c69b0271-acb1-4521-8cfa-84cd62422d4e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:07.971790 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c69b0271-acb1-4521-8cfa-84cd62422d4e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:08.065996 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-dced1c25-ec05-4a7d-85d2-12bec8d4d5c0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f10361cf820>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:08.174459 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-dced1c25-ec05-4a7d-85d2-12bec8d4d5c0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/b7be3aa9-bb67-45cb-9262-02de0dc4a4b0" status: 200 len: 1412 microversion: 2.1 time: 0.122886 Sep 16 12:48:08.185242 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 343/704] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:48:08 2022] GET /compute/v2.1/images/b7be3aa9-bb67-45cb-9262-02de0dc4a4b0 => generated 1412 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:08.195261 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-923677c3-5158-451c-a571-ae3bb68277bc tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:08.198431 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-923677c3-5158-451c-a571-ae3bb68277bc tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: a1f478b9-b8e1-40a8-9232-34eb6df9ad7a] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:08.226962 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-923677c3-5158-451c-a571-ae3bb68277bc tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:08.229709 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-923677c3-5158-451c-a571-ae3bb68277bc tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:08.232592 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-923677c3-5158-451c-a571-ae3bb68277bc tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:08.236291 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-923677c3-5158-451c-a571-ae3bb68277bc tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:08.236960 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-923677c3-5158-451c-a571-ae3bb68277bc tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:08.239177 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-923677c3-5158-451c-a571-ae3bb68277bc tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:09.647792 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-923677c3-5158-451c-a571-ae3bb68277bc tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:09.658062 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-923677c3-5158-451c-a571-ae3bb68277bc tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a" status: 200 len: 1311 microversion: 2.1 time: 1.471283 Sep 16 12:48:09.686315 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 344/705] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:08 2022] GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a => generated 1311 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:09.700378 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-01960379-b960-4dba-8b92-95aa83683bea tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:09.705681 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-01960379-b960-4dba-8b92-95aa83683bea tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 21107d05-79f1-476d-b921-9548eff4f2c4] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:09.728495 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-01960379-b960-4dba-8b92-95aa83683bea tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:09.734975 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-01960379-b960-4dba-8b92-95aa83683bea tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:09.737439 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-01960379-b960-4dba-8b92-95aa83683bea tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:09.738392 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-01960379-b960-4dba-8b92-95aa83683bea tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:09.746223 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-01960379-b960-4dba-8b92-95aa83683bea tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:09.747981 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-01960379-b960-4dba-8b92-95aa83683bea tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:09.772025 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c69b0271-acb1-4521-8cfa-84cd62422d4e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:09.785936 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c69b0271-acb1-4521-8cfa-84cd62422d4e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590" status: 200 len: 1476 microversion: 2.1 time: 1.858675 Sep 16 12:48:09.789363 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 362/706] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:07 2022] GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590 => generated 1476 bytes in 1863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:09.801352 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-da104d46-fae0-4d95-88bc-0029353bf14c tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:09.810719 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-da104d46-fae0-4d95-88bc-0029353bf14c tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:09.834911 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da104d46-fae0-4d95-88bc-0029353bf14c tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:09.841042 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da104d46-fae0-4d95-88bc-0029353bf14c tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:09.841779 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da104d46-fae0-4d95-88bc-0029353bf14c tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:09.849358 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da104d46-fae0-4d95-88bc-0029353bf14c tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:09.850347 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da104d46-fae0-4d95-88bc-0029353bf14c tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:09.850960 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da104d46-fae0-4d95-88bc-0029353bf14c tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:10.751001 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-da104d46-fae0-4d95-88bc-0029353bf14c tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:10.767034 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-da104d46-fae0-4d95-88bc-0029353bf14c tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6" status: 200 len: 1472 microversion: 2.1 time: 0.976342 Sep 16 12:48:10.779874 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 363/707] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:09 2022] GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 => generated 1472 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:10.795806 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-01960379-b960-4dba-8b92-95aa83683bea tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:10.827158 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-01960379-b960-4dba-8b92-95aa83683bea tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/21107d05-79f1-476d-b921-9548eff4f2c4" status: 200 len: 1319 microversion: 2.1 time: 1.117034 Sep 16 12:48:10.830598 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 345/708] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:09 2022] GET /compute/v2.1/servers/21107d05-79f1-476d-b921-9548eff4f2c4 => generated 1319 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:10.841381 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4cf01e5f-e20f-4ee4-9c38-c05b838eef64 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f1036406d30>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:10.857993 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-df8de29d-4d95-4f4b-8d87-2957ef975a7e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:10.859993 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-df8de29d-4d95-4f4b-8d87-2957ef975a7e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: a1f478b9-b8e1-40a8-9232-34eb6df9ad7a] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:10.867582 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-df8de29d-4d95-4f4b-8d87-2957ef975a7e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:10.868431 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-df8de29d-4d95-4f4b-8d87-2957ef975a7e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:10.869099 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-df8de29d-4d95-4f4b-8d87-2957ef975a7e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:10.874044 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-df8de29d-4d95-4f4b-8d87-2957ef975a7e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:10.875165 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-df8de29d-4d95-4f4b-8d87-2957ef975a7e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:10.876001 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-df8de29d-4d95-4f4b-8d87-2957ef975a7e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:10.980087 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4cf01e5f-e20f-4ee4-9c38-c05b838eef64 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/b7be3aa9-bb67-45cb-9262-02de0dc4a4b0" status: 200 len: 1412 microversion: 2.1 time: 0.188913 Sep 16 12:48:10.984060 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 364/709] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:48:10 2022] GET /compute/v2.1/images/b7be3aa9-bb67-45cb-9262-02de0dc4a4b0 => generated 1412 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:10.994240 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-079f7177-4301-4076-9bc1-6df0ec4a8de3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:10.999334 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-079f7177-4301-4076-9bc1-6df0ec4a8de3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: efea200a-0b78-42de-a9e2-febab9817590] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:11.010935 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-079f7177-4301-4076-9bc1-6df0ec4a8de3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:11.011660 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-079f7177-4301-4076-9bc1-6df0ec4a8de3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:11.012330 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-079f7177-4301-4076-9bc1-6df0ec4a8de3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:11.018954 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-079f7177-4301-4076-9bc1-6df0ec4a8de3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:11.020322 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-079f7177-4301-4076-9bc1-6df0ec4a8de3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:11.022695 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-079f7177-4301-4076-9bc1-6df0ec4a8de3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:11.466654 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-df8de29d-4d95-4f4b-8d87-2957ef975a7e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:11.473615 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-079f7177-4301-4076-9bc1-6df0ec4a8de3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:11.475262 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-df8de29d-4d95-4f4b-8d87-2957ef975a7e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a" status: 200 len: 1311 microversion: 2.1 time: 0.632258 Sep 16 12:48:11.487297 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 346/710] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:10 2022] GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a => generated 1311 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:11.492905 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-079f7177-4301-4076-9bc1-6df0ec4a8de3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590" status: 200 len: 1475 microversion: 2.1 time: 0.507348 Sep 16 12:48:11.493491 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 365/711] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:10 2022] GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590 => generated 1475 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:11.796482 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ba84efdb-5486-44ff-a172-3ae341ccc1f3 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:11.797981 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ba84efdb-5486-44ff-a172-3ae341ccc1f3 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:11.813730 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ba84efdb-5486-44ff-a172-3ae341ccc1f3 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:11.816868 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ba84efdb-5486-44ff-a172-3ae341ccc1f3 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:11.820349 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ba84efdb-5486-44ff-a172-3ae341ccc1f3 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:11.821620 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ba84efdb-5486-44ff-a172-3ae341ccc1f3 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:11.828645 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ba84efdb-5486-44ff-a172-3ae341ccc1f3 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:11.829225 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ba84efdb-5486-44ff-a172-3ae341ccc1f3 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:11.861886 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7abec0c2-771c-475b-bb53-049389586988 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:11.863866 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7abec0c2-771c-475b-bb53-049389586988 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 21107d05-79f1-476d-b921-9548eff4f2c4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:11.881467 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7abec0c2-771c-475b-bb53-049389586988 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:11.883268 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7abec0c2-771c-475b-bb53-049389586988 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:11.886435 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7abec0c2-771c-475b-bb53-049389586988 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:11.903992 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7abec0c2-771c-475b-bb53-049389586988 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:11.905238 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7abec0c2-771c-475b-bb53-049389586988 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:11.905946 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7abec0c2-771c-475b-bb53-049389586988 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:12.261849 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ba84efdb-5486-44ff-a172-3ae341ccc1f3 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:12.271645 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ba84efdb-5486-44ff-a172-3ae341ccc1f3 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6" status: 200 len: 1472 microversion: 2.1 time: 0.480377 Sep 16 12:48:12.294346 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 347/712] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:11 2022] GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 => generated 1472 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:12.311846 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-dc641957-b7a4-4517-a235-b4b869db3bf9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f1035afdf70>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:12.474209 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-dc641957-b7a4-4517-a235-b4b869db3bf9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/b7be3aa9-bb67-45cb-9262-02de0dc4a4b0" status: 200 len: 1412 microversion: 2.1 time: 0.184335 Sep 16 12:48:12.476665 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 348/713] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:48:12 2022] GET /compute/v2.1/images/b7be3aa9-bb67-45cb-9262-02de0dc4a4b0 => generated 1412 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:12.508462 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-13e07e48-0b17-4c0d-b286-017f8bae7a72 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:12.519075 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-13e07e48-0b17-4c0d-b286-017f8bae7a72 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: a1f478b9-b8e1-40a8-9232-34eb6df9ad7a] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:12.529995 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7abec0c2-771c-475b-bb53-049389586988 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:12.539868 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-13e07e48-0b17-4c0d-b286-017f8bae7a72 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:12.540593 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-13e07e48-0b17-4c0d-b286-017f8bae7a72 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:12.541063 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-13e07e48-0b17-4c0d-b286-017f8bae7a72 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:12.542324 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-13e07e48-0b17-4c0d-b286-017f8bae7a72 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:12.542826 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-13e07e48-0b17-4c0d-b286-017f8bae7a72 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:12.550204 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-13e07e48-0b17-4c0d-b286-017f8bae7a72 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:12.560616 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7abec0c2-771c-475b-bb53-049389586988 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/21107d05-79f1-476d-b921-9548eff4f2c4" status: 200 len: 1319 microversion: 2.1 time: 0.703529 Sep 16 12:48:12.562155 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 366/714] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:11 2022] GET /compute/v2.1/servers/21107d05-79f1-476d-b921-9548eff4f2c4 => generated 1319 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:48:12.566979 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e888acf2-fe1e-45e2-8a7c-1fe0f84485a3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:12.582498 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e888acf2-fe1e-45e2-8a7c-1fe0f84485a3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: efea200a-0b78-42de-a9e2-febab9817590] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:12.599093 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e888acf2-fe1e-45e2-8a7c-1fe0f84485a3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:12.601054 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e888acf2-fe1e-45e2-8a7c-1fe0f84485a3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:12.601744 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e888acf2-fe1e-45e2-8a7c-1fe0f84485a3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:12.603079 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e888acf2-fe1e-45e2-8a7c-1fe0f84485a3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:12.603763 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e888acf2-fe1e-45e2-8a7c-1fe0f84485a3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:12.604462 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e888acf2-fe1e-45e2-8a7c-1fe0f84485a3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:13.256980 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:48:13.386685 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e888acf2-fe1e-45e2-8a7c-1fe0f84485a3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:13.399599 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e888acf2-fe1e-45e2-8a7c-1fe0f84485a3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590" status: 200 len: 1475 microversion: 2.1 time: 0.836127 Sep 16 12:48:13.404067 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 367/715] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:12 2022] GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590 => generated 1475 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:13.436912 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-13e07e48-0b17-4c0d-b286-017f8bae7a72 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:13.437520 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ac539b5b-acd0-4678-a8cd-8cb9d2b61b6e tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:13.439442 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ac539b5b-acd0-4678-a8cd-8cb9d2b61b6e tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:13.454456 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac539b5b-acd0-4678-a8cd-8cb9d2b61b6e tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:13.455884 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-13e07e48-0b17-4c0d-b286-017f8bae7a72 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a" status: 200 len: 1311 microversion: 2.1 time: 0.952725 Sep 16 12:48:13.456685 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac539b5b-acd0-4678-a8cd-8cb9d2b61b6e tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:13.460186 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac539b5b-acd0-4678-a8cd-8cb9d2b61b6e tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:13.462257 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac539b5b-acd0-4678-a8cd-8cb9d2b61b6e tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:13.463530 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac539b5b-acd0-4678-a8cd-8cb9d2b61b6e tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:13.465791 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac539b5b-acd0-4678-a8cd-8cb9d2b61b6e tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:13.475256 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 349/716] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:12 2022] GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a => generated 1311 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:13.493092 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e8380fdf-0430-490d-b2b9-fb0ee22f2c40 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f1035f3d8b0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:13.581771 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e8380fdf-0430-490d-b2b9-fb0ee22f2c40 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/b7be3aa9-bb67-45cb-9262-02de0dc4a4b0" status: 200 len: 1412 microversion: 2.1 time: 0.091308 Sep 16 12:48:13.592084 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 350/717] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:48:13 2022] GET /compute/v2.1/images/b7be3aa9-bb67-45cb-9262-02de0dc4a4b0 => generated 1412 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:13.620753 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=38 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:48:13.624408 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7a2a1d5a-a5f7-4ff0-aaf7-9bb041be4fc7 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:13.625311 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7a2a1d5a-a5f7-4ff0-aaf7-9bb041be4fc7 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 21107d05-79f1-476d-b921-9548eff4f2c4] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:13.670273 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7a2a1d5a-a5f7-4ff0-aaf7-9bb041be4fc7 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:13.678773 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7a2a1d5a-a5f7-4ff0-aaf7-9bb041be4fc7 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:13.686008 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7a2a1d5a-a5f7-4ff0-aaf7-9bb041be4fc7 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:13.686790 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7a2a1d5a-a5f7-4ff0-aaf7-9bb041be4fc7 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:13.687271 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7a2a1d5a-a5f7-4ff0-aaf7-9bb041be4fc7 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:13.687704 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7a2a1d5a-a5f7-4ff0-aaf7-9bb041be4fc7 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:14.177526 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ac539b5b-acd0-4678-a8cd-8cb9d2b61b6e tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:14.187524 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ac539b5b-acd0-4678-a8cd-8cb9d2b61b6e tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6" status: 200 len: 1472 microversion: 2.1 time: 0.780381 Sep 16 12:48:14.192021 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 368/718] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:13 2022] GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 => generated 1472 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:14.222203 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-4e969cae-e5d9-4ded-a5bf-b42ad7ee2ef8 req-8563910a-4fa0-4098-9b4f-d4790cf75e3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d5c44e7-c030-4a42-97fb-e838e1472456", "tag": "5d6e364d-d651-4c3c-b21c-27421ce4597f"}, {"server_uuid": "efea200a-0b78-42de-a9e2-febab9817590", "name": "network-vif-unplugged", "status": "completed", "tag": "3fe50ad6-99ae-4c0b-a11b-3e41218b0317"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:14.228657 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7a2a1d5a-a5f7-4ff0-aaf7-9bb041be4fc7 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:14.234473 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:48:14.268094 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7a2a1d5a-a5f7-4ff0-aaf7-9bb041be4fc7 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/21107d05-79f1-476d-b921-9548eff4f2c4" status: 200 len: 1319 microversion: 2.1 time: 0.672012 Sep 16 12:48:14.273928 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 351/719] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:13 2022] GET /compute/v2.1/servers/21107d05-79f1-476d-b921-9548eff4f2c4 => generated 1319 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:14.283567 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4e969cae-e5d9-4ded-a5bf-b42ad7ee2ef8 req-8563910a-4fa0-4098-9b4f-d4790cf75e3b service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:14.294501 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4e969cae-e5d9-4ded-a5bf-b42ad7ee2ef8 req-8563910a-4fa0-4098-9b4f-d4790cf75e3b service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:14.316929 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4e969cae-e5d9-4ded-a5bf-b42ad7ee2ef8 req-8563910a-4fa0-4098-9b4f-d4790cf75e3b service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:14.409541 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-4e969cae-e5d9-4ded-a5bf-b42ad7ee2ef8 req-8563910a-4fa0-4098-9b4f-d4790cf75e3b service nova] Creating event network-changed:5d6e364d-d651-4c3c-b21c-27421ce4597f for instance 8d5c44e7-c030-4a42-97fb-e838e1472456 on n-h2-858094-4 Sep 16 12:48:14.412934 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-4e969cae-e5d9-4ded-a5bf-b42ad7ee2ef8 req-8563910a-4fa0-4098-9b4f-d4790cf75e3b service nova] Creating event network-vif-unplugged:3fe50ad6-99ae-4c0b-a11b-3e41218b0317 for instance efea200a-0b78-42de-a9e2-febab9817590 on n-h1-858094-4 Sep 16 12:48:14.431262 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-19d04a97-2b1e-43cd-9e8a-062376ad0bfe tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:14.431887 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-19d04a97-2b1e-43cd-9e8a-062376ad0bfe tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: efea200a-0b78-42de-a9e2-febab9817590] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:14.443632 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19d04a97-2b1e-43cd-9e8a-062376ad0bfe tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:14.444376 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19d04a97-2b1e-43cd-9e8a-062376ad0bfe tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:14.481434 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19d04a97-2b1e-43cd-9e8a-062376ad0bfe tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:14.490317 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19d04a97-2b1e-43cd-9e8a-062376ad0bfe tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:14.495285 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19d04a97-2b1e-43cd-9e8a-062376ad0bfe tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:14.498376 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19d04a97-2b1e-43cd-9e8a-062376ad0bfe tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:14.543635 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [req-4e969cae-e5d9-4ded-a5bf-b42ad7ee2ef8 req-8563910a-4fa0-4098-9b4f-d4790cf75e3b service nova] Instance efea200a-0b78-42de-a9e2-febab9817590 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858094-4', 'n-h2-858094-4'} {{(pid=128779) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 12:48:14.582408 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-4e969cae-e5d9-4ded-a5bf-b42ad7ee2ef8 req-8563910a-4fa0-4098-9b4f-d4790cf75e3b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.388300 Sep 16 12:48:14.583779 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 369/720] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:48:14.606453 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-4a6e9046-dbc8-482c-b498-8d861b769ff8 req-4108d22d-86fd-438a-a883-a6b3b0493287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1f478b9-b8e1-40a8-9232-34eb6df9ad7a", "name": "network-vif-plugged", "status": "completed", "tag": "8109ea32-2ace-4f1c-be0b-e7fa4599d05e"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:14.647048 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4a6e9046-dbc8-482c-b498-8d861b769ff8 req-4108d22d-86fd-438a-a883-a6b3b0493287 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:14.652798 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4a6e9046-dbc8-482c-b498-8d861b769ff8 req-4108d22d-86fd-438a-a883-a6b3b0493287 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:14.653452 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4a6e9046-dbc8-482c-b498-8d861b769ff8 req-4108d22d-86fd-438a-a883-a6b3b0493287 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:14.681443 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-4a6e9046-dbc8-482c-b498-8d861b769ff8 req-4108d22d-86fd-438a-a883-a6b3b0493287 service nova] Creating event network-vif-plugged:8109ea32-2ace-4f1c-be0b-e7fa4599d05e for instance a1f478b9-b8e1-40a8-9232-34eb6df9ad7a on n-h2-858094-4 Sep 16 12:48:14.693893 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-4a6e9046-dbc8-482c-b498-8d861b769ff8 req-4108d22d-86fd-438a-a883-a6b3b0493287 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107937 Sep 16 12:48:14.712111 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 370/721] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:48:14.718499 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ad8c2848-76c9-4004-9aa3-91859f59e5b3 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:14.720194 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ad8c2848-76c9-4004-9aa3-91859f59e5b3 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: a1f478b9-b8e1-40a8-9232-34eb6df9ad7a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:14.739925 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad8c2848-76c9-4004-9aa3-91859f59e5b3 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:14.745871 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad8c2848-76c9-4004-9aa3-91859f59e5b3 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:14.748724 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad8c2848-76c9-4004-9aa3-91859f59e5b3 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:14.749857 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad8c2848-76c9-4004-9aa3-91859f59e5b3 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:14.750643 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad8c2848-76c9-4004-9aa3-91859f59e5b3 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:14.751296 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad8c2848-76c9-4004-9aa3-91859f59e5b3 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:15.069176 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-19d04a97-2b1e-43cd-9e8a-062376ad0bfe tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:15.083395 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-19d04a97-2b1e-43cd-9e8a-062376ad0bfe tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590" status: 200 len: 1475 microversion: 2.1 time: 0.656295 Sep 16 12:48:15.085876 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 352/722] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:14 2022] GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590 => generated 1475 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:15.098700 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1679e01f-e482-4907-bc5d-d8d7d1c5324f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f103629f1f0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:15.285267 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ad8c2848-76c9-4004-9aa3-91859f59e5b3 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:15.299197 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ad8c2848-76c9-4004-9aa3-91859f59e5b3 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a" status: 200 len: 1311 microversion: 2.1 time: 0.585388 Sep 16 12:48:15.300312 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 371/723] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:14 2022] GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a => generated 1311 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:15.305832 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-88550493-e8ed-4eef-b376-af0ee04b0994 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:15.306675 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-88550493-e8ed-4eef-b376-af0ee04b0994 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:15.325284 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88550493-e8ed-4eef-b376-af0ee04b0994 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:15.327566 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88550493-e8ed-4eef-b376-af0ee04b0994 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:15.328729 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88550493-e8ed-4eef-b376-af0ee04b0994 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:15.337263 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88550493-e8ed-4eef-b376-af0ee04b0994 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:15.338261 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88550493-e8ed-4eef-b376-af0ee04b0994 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:15.341500 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88550493-e8ed-4eef-b376-af0ee04b0994 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:15.845068 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-88550493-e8ed-4eef-b376-af0ee04b0994 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:15.877321 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-88550493-e8ed-4eef-b376-af0ee04b0994 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6" status: 200 len: 1472 microversion: 2.1 time: 0.572350 Sep 16 12:48:15.880332 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 372/724] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:15 2022] GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 => generated 1472 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:15.892317 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3e56d080-37d3-40e8-83b5-158bdb3fbefd tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:15.896435 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3e56d080-37d3-40e8-83b5-158bdb3fbefd tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 21107d05-79f1-476d-b921-9548eff4f2c4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:15.917359 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e56d080-37d3-40e8-83b5-158bdb3fbefd tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:15.919254 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e56d080-37d3-40e8-83b5-158bdb3fbefd tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:15.920090 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e56d080-37d3-40e8-83b5-158bdb3fbefd tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:15.923015 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e56d080-37d3-40e8-83b5-158bdb3fbefd tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:15.926088 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e56d080-37d3-40e8-83b5-158bdb3fbefd tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:15.928324 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e56d080-37d3-40e8-83b5-158bdb3fbefd tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:16.279171 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3e56d080-37d3-40e8-83b5-158bdb3fbefd tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:16.294134 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3e56d080-37d3-40e8-83b5-158bdb3fbefd tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/21107d05-79f1-476d-b921-9548eff4f2c4" status: 200 len: 1319 microversion: 2.1 time: 0.406269 Sep 16 12:48:16.295543 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 373/725] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:15 2022] GET /compute/v2.1/servers/21107d05-79f1-476d-b921-9548eff4f2c4 => generated 1319 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:16.304832 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fb56f232-a6ac-483d-aaab-e5abc7b67121 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:16.305825 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fb56f232-a6ac-483d-aaab-e5abc7b67121 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: efea200a-0b78-42de-a9e2-febab9817590] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:16.313490 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb56f232-a6ac-483d-aaab-e5abc7b67121 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:16.314352 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb56f232-a6ac-483d-aaab-e5abc7b67121 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:16.315007 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb56f232-a6ac-483d-aaab-e5abc7b67121 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:16.315916 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb56f232-a6ac-483d-aaab-e5abc7b67121 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:16.316780 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb56f232-a6ac-483d-aaab-e5abc7b67121 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:16.317538 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb56f232-a6ac-483d-aaab-e5abc7b67121 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:16.742939 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fb56f232-a6ac-483d-aaab-e5abc7b67121 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:16.770355 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fb56f232-a6ac-483d-aaab-e5abc7b67121 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590" status: 200 len: 1475 microversion: 2.1 time: 0.473328 Sep 16 12:48:16.791918 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 374/726] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:16 2022] GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590 => generated 1475 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:16.875520 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b7e528c3-c4f7-40fd-bddf-7e592b9c965c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:16.876597 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b7e528c3-c4f7-40fd-bddf-7e592b9c965c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: a1f478b9-b8e1-40a8-9232-34eb6df9ad7a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:16.893626 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7e528c3-c4f7-40fd-bddf-7e592b9c965c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:16.894521 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7e528c3-c4f7-40fd-bddf-7e592b9c965c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:16.895138 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7e528c3-c4f7-40fd-bddf-7e592b9c965c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:16.901559 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7e528c3-c4f7-40fd-bddf-7e592b9c965c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:16.903122 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7e528c3-c4f7-40fd-bddf-7e592b9c965c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:16.903802 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7e528c3-c4f7-40fd-bddf-7e592b9c965c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:16.991847 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:48:17.343973 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b7e528c3-c4f7-40fd-bddf-7e592b9c965c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:17.357065 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b7e528c3-c4f7-40fd-bddf-7e592b9c965c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a" status: 200 len: 1494 microversion: 2.1 time: 0.563699 Sep 16 12:48:17.359745 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 375/727] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:16 2022] GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a => generated 1494 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:17.367770 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d673cc79-90a1-4133-9beb-b1cdceaebad3 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:17.368865 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d673cc79-90a1-4133-9beb-b1cdceaebad3 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:17.390555 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d673cc79-90a1-4133-9beb-b1cdceaebad3 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:17.391617 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d673cc79-90a1-4133-9beb-b1cdceaebad3 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:17.393465 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d673cc79-90a1-4133-9beb-b1cdceaebad3 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:17.395719 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d673cc79-90a1-4133-9beb-b1cdceaebad3 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:17.397436 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d673cc79-90a1-4133-9beb-b1cdceaebad3 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:17.398085 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d673cc79-90a1-4133-9beb-b1cdceaebad3 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:17.664298 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d673cc79-90a1-4133-9beb-b1cdceaebad3 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:17.678414 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d673cc79-90a1-4133-9beb-b1cdceaebad3 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6" status: 200 len: 1472 microversion: 2.1 time: 0.316465 Sep 16 12:48:17.679376 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 376/728] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:17 2022] GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 => generated 1472 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:17.694744 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-274eb5f3-bd42-40f4-8eba-6b59b14d8115 req-4e7e4bb2-c45e-45aa-96af-8201154017ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efea200a-0b78-42de-a9e2-febab9817590", "tag": "3fe50ad6-99ae-4c0b-a11b-3e41218b0317"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:17.707190 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-274eb5f3-bd42-40f4-8eba-6b59b14d8115 req-4e7e4bb2-c45e-45aa-96af-8201154017ac service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:17.711909 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-274eb5f3-bd42-40f4-8eba-6b59b14d8115 req-4e7e4bb2-c45e-45aa-96af-8201154017ac service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:17.712696 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-274eb5f3-bd42-40f4-8eba-6b59b14d8115 req-4e7e4bb2-c45e-45aa-96af-8201154017ac service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:17.727620 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-274eb5f3-bd42-40f4-8eba-6b59b14d8115 req-4e7e4bb2-c45e-45aa-96af-8201154017ac service nova] Creating event network-changed:3fe50ad6-99ae-4c0b-a11b-3e41218b0317 for instance efea200a-0b78-42de-a9e2-febab9817590 on n-h1-858094-4 Sep 16 12:48:17.735397 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [req-274eb5f3-bd42-40f4-8eba-6b59b14d8115 req-4e7e4bb2-c45e-45aa-96af-8201154017ac service nova] Instance efea200a-0b78-42de-a9e2-febab9817590 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858094-4', 'n-h2-858094-4'} {{(pid=128779) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 12:48:17.756442 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-274eb5f3-bd42-40f4-8eba-6b59b14d8115 req-4e7e4bb2-c45e-45aa-96af-8201154017ac service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074973 Sep 16 12:48:17.757816 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 377/729] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:48:17.764210 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4677b482-bd1d-4495-b204-de987849f6a9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:17.765290 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4677b482-bd1d-4495-b204-de987849f6a9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 21107d05-79f1-476d-b921-9548eff4f2c4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:17.774339 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4677b482-bd1d-4495-b204-de987849f6a9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:17.775276 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4677b482-bd1d-4495-b204-de987849f6a9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:17.776726 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4677b482-bd1d-4495-b204-de987849f6a9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:17.777672 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4677b482-bd1d-4495-b204-de987849f6a9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:17.778297 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4677b482-bd1d-4495-b204-de987849f6a9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:17.778734 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4677b482-bd1d-4495-b204-de987849f6a9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:18.059295 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4677b482-bd1d-4495-b204-de987849f6a9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:18.078971 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4677b482-bd1d-4495-b204-de987849f6a9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/21107d05-79f1-476d-b921-9548eff4f2c4" status: 200 len: 1319 microversion: 2.1 time: 0.308679 Sep 16 12:48:18.082971 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 378/730] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:17 2022] GET /compute/v2.1/servers/21107d05-79f1-476d-b921-9548eff4f2c4 => generated 1319 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:18.092539 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3ab60289-0a17-44f9-a082-b503e66984f5 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:18.103067 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3ab60289-0a17-44f9-a082-b503e66984f5 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] [instance: a1f478b9-b8e1-40a8-9232-34eb6df9ad7a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:18.117422 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ab60289-0a17-44f9-a082-b503e66984f5 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:18.117957 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ab60289-0a17-44f9-a082-b503e66984f5 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:18.118506 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ab60289-0a17-44f9-a082-b503e66984f5 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:18.119333 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ab60289-0a17-44f9-a082-b503e66984f5 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:18.119924 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ab60289-0a17-44f9-a082-b503e66984f5 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:18.120519 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ab60289-0a17-44f9-a082-b503e66984f5 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:18.497306 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3ab60289-0a17-44f9-a082-b503e66984f5 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a" status: 200 len: 1645 microversion: 2.1 time: 0.410248 Sep 16 12:48:18.498488 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 379/731] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:18 2022] GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a => generated 1645 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:18.532933 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5e40320f-da08-41b0-9427-2707693da29f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:18.533716 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5e40320f-da08-41b0-9427-2707693da29f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: efea200a-0b78-42de-a9e2-febab9817590] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:18.543375 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e40320f-da08-41b0-9427-2707693da29f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:18.544435 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e40320f-da08-41b0-9427-2707693da29f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:18.545010 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e40320f-da08-41b0-9427-2707693da29f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:18.547244 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e40320f-da08-41b0-9427-2707693da29f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:18.547895 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e40320f-da08-41b0-9427-2707693da29f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:18.548533 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e40320f-da08-41b0-9427-2707693da29f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:18.764914 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5e40320f-da08-41b0-9427-2707693da29f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:18.774370 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5e40320f-da08-41b0-9427-2707693da29f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590" status: 200 len: 1475 microversion: 2.1 time: 0.274692 Sep 16 12:48:18.777437 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 380/732] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:18 2022] GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590 => generated 1475 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:18.784426 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-65a354bf-3aaf-485f-b689-3c4d596df920 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:18.785206 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-65a354bf-3aaf-485f-b689-3c4d596df920 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] [instance: a1f478b9-b8e1-40a8-9232-34eb6df9ad7a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:18.796840 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65a354bf-3aaf-485f-b689-3c4d596df920 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:18.797474 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65a354bf-3aaf-485f-b689-3c4d596df920 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:18.799053 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65a354bf-3aaf-485f-b689-3c4d596df920 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:18.800291 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65a354bf-3aaf-485f-b689-3c4d596df920 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:18.800526 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65a354bf-3aaf-485f-b689-3c4d596df920 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:18.801122 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65a354bf-3aaf-485f-b689-3c4d596df920 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:18.996770 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-65a354bf-3aaf-485f-b689-3c4d596df920 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a" status: 200 len: 1645 microversion: 2.1 time: 0.217635 Sep 16 12:48:19.012907 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 381/733] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:18 2022] GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a => generated 1645 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:19.017997 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d3421c05-ad03-4d8f-9401-b11250cdfe35 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:19.021344 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d3421c05-ad03-4d8f-9401-b11250cdfe35 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:19.029616 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3421c05-ad03-4d8f-9401-b11250cdfe35 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:19.030274 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3421c05-ad03-4d8f-9401-b11250cdfe35 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:19.030804 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3421c05-ad03-4d8f-9401-b11250cdfe35 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:19.031623 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3421c05-ad03-4d8f-9401-b11250cdfe35 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:19.032232 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3421c05-ad03-4d8f-9401-b11250cdfe35 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:19.033006 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3421c05-ad03-4d8f-9401-b11250cdfe35 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:19.262337 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d3421c05-ad03-4d8f-9401-b11250cdfe35 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:19.287499 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d3421c05-ad03-4d8f-9401-b11250cdfe35 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6" status: 200 len: 1472 microversion: 2.1 time: 0.273003 Sep 16 12:48:19.305290 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 382/734] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:19 2022] GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 => generated 1472 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:19.650553 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8601899c-b0e2-4762-8667-73ee42ea1fa6 tempest-AZV2TestJSON-139886617 tempest-AZV2TestJSON-139886617-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:19.652753 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8601899c-b0e2-4762-8667-73ee42ea1fa6 tempest-AZV2TestJSON-139886617 tempest-AZV2TestJSON-139886617-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:19.653254 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8601899c-b0e2-4762-8667-73ee42ea1fa6 tempest-AZV2TestJSON-139886617 tempest-AZV2TestJSON-139886617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:19.654225 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8601899c-b0e2-4762-8667-73ee42ea1fa6 tempest-AZV2TestJSON-139886617 tempest-AZV2TestJSON-139886617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:19.655883 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8601899c-b0e2-4762-8667-73ee42ea1fa6 tempest-AZV2TestJSON-139886617 tempest-AZV2TestJSON-139886617-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:19.655883 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8601899c-b0e2-4762-8667-73ee42ea1fa6 tempest-AZV2TestJSON-139886617 tempest-AZV2TestJSON-139886617-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:19.655883 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8601899c-b0e2-4762-8667-73ee42ea1fa6 tempest-AZV2TestJSON-139886617 tempest-AZV2TestJSON-139886617-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:19.723509 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8601899c-b0e2-4762-8667-73ee42ea1fa6 tempest-AZV2TestJSON-139886617 tempest-AZV2TestJSON-139886617-project] 10.222.0.67 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.416710 Sep 16 12:48:19.726613 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 383/735] 10.222.0.67 () {58 vars in 1164 bytes} [Fri Sep 16 12:48:19 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 12:48:19.738669 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f0f83143-ea65-4253-ab28-05f0002b5721 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:19.752382 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0f83143-ea65-4253-ab28-05f0002b5721 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:19.753368 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0f83143-ea65-4253-ab28-05f0002b5721 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:19.755460 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0f83143-ea65-4253-ab28-05f0002b5721 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:19.756759 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0f83143-ea65-4253-ab28-05f0002b5721 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:19.757252 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0f83143-ea65-4253-ab28-05f0002b5721 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:19.757699 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0f83143-ea65-4253-ab28-05f0002b5721 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:19.837499 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f0f83143-ea65-4253-ab28-05f0002b5721 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.109672 Sep 16 12:48:19.841415 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 384/736] 10.222.0.67 () {58 vars in 1176 bytes} [Fri Sep 16 12:48:19 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:48:19.855193 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3692e996-7210-4cac-8e80-96cc7c9782b2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:19.855861 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3692e996-7210-4cac-8e80-96cc7c9782b2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 21107d05-79f1-476d-b921-9548eff4f2c4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:19.876180 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3692e996-7210-4cac-8e80-96cc7c9782b2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:19.879450 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3692e996-7210-4cac-8e80-96cc7c9782b2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:19.880245 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3692e996-7210-4cac-8e80-96cc7c9782b2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:19.883016 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3692e996-7210-4cac-8e80-96cc7c9782b2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:19.885268 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3692e996-7210-4cac-8e80-96cc7c9782b2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:19.885933 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3692e996-7210-4cac-8e80-96cc7c9782b2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:20.270533 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3692e996-7210-4cac-8e80-96cc7c9782b2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:20.311882 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3692e996-7210-4cac-8e80-96cc7c9782b2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/21107d05-79f1-476d-b921-9548eff4f2c4" status: 200 len: 1319 microversion: 2.1 time: 0.463330 Sep 16 12:48:20.314906 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 385/737] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:19 2022] GET /compute/v2.1/servers/21107d05-79f1-476d-b921-9548eff4f2c4 => generated 1319 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:20.323074 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b7d8de91-af52-4b57-af8d-94c6e339b18d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:20.323945 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b7d8de91-af52-4b57-af8d-94c6e339b18d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: efea200a-0b78-42de-a9e2-febab9817590] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:20.337694 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7d8de91-af52-4b57-af8d-94c6e339b18d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:20.338453 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7d8de91-af52-4b57-af8d-94c6e339b18d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:20.339126 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7d8de91-af52-4b57-af8d-94c6e339b18d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:20.340041 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7d8de91-af52-4b57-af8d-94c6e339b18d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:20.341032 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7d8de91-af52-4b57-af8d-94c6e339b18d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:20.341675 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7d8de91-af52-4b57-af8d-94c6e339b18d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:20.734542 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b7d8de91-af52-4b57-af8d-94c6e339b18d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:20.745404 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b7d8de91-af52-4b57-af8d-94c6e339b18d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590" status: 200 len: 1475 microversion: 2.1 time: 0.428232 Sep 16 12:48:20.771245 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 386/738] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:20 2022] GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590 => generated 1475 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:20.784870 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7111faf7-f645-4810-b489-bfcfcf583e14 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:20.785702 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7111faf7-f645-4810-b489-bfcfcf583e14 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] [instance: a1f478b9-b8e1-40a8-9232-34eb6df9ad7a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:20.809104 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7111faf7-f645-4810-b489-bfcfcf583e14 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:20.810439 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7111faf7-f645-4810-b489-bfcfcf583e14 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:20.812692 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7111faf7-f645-4810-b489-bfcfcf583e14 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:20.819132 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7111faf7-f645-4810-b489-bfcfcf583e14 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:20.819667 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7111faf7-f645-4810-b489-bfcfcf583e14 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:20.821276 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7111faf7-f645-4810-b489-bfcfcf583e14 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:21.082081 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7111faf7-f645-4810-b489-bfcfcf583e14 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a/action" status: 202 len: 0 microversion: 2.1 time: 0.306913 Sep 16 12:48:21.093173 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 387/739] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:48:20 2022] POST /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:48:21.102515 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-d7409fcc-d774-4a97-ae77-146aa4e9ada4 req-e7e8dc53-338a-463d-b254-b43c97276848 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21107d05-79f1-476d-b921-9548eff4f2c4", "tag": "84d3e3e1-0c23-49c4-af27-80f8acbc75ae"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:21.131496 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d7409fcc-d774-4a97-ae77-146aa4e9ada4 req-e7e8dc53-338a-463d-b254-b43c97276848 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:21.131981 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d7409fcc-d774-4a97-ae77-146aa4e9ada4 req-e7e8dc53-338a-463d-b254-b43c97276848 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:21.132461 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d7409fcc-d774-4a97-ae77-146aa4e9ada4 req-e7e8dc53-338a-463d-b254-b43c97276848 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:21.192053 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-d7409fcc-d774-4a97-ae77-146aa4e9ada4 req-e7e8dc53-338a-463d-b254-b43c97276848 service nova] Creating event network-changed:84d3e3e1-0c23-49c4-af27-80f8acbc75ae for instance 21107d05-79f1-476d-b921-9548eff4f2c4 on n-h2-858094-4 Sep 16 12:48:21.220303 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-d7409fcc-d774-4a97-ae77-146aa4e9ada4 req-e7e8dc53-338a-463d-b254-b43c97276848 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125319 Sep 16 12:48:21.225445 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 388/740] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:48:21.231796 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c5305e96-8014-442c-bb0f-597111544941 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:21.250782 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c5305e96-8014-442c-bb0f-597111544941 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:21.269554 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5305e96-8014-442c-bb0f-597111544941 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:21.270120 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5305e96-8014-442c-bb0f-597111544941 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:21.270507 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5305e96-8014-442c-bb0f-597111544941 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:21.271251 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5305e96-8014-442c-bb0f-597111544941 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:21.271719 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5305e96-8014-442c-bb0f-597111544941 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:21.272164 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5305e96-8014-442c-bb0f-597111544941 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:21.759152 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c5305e96-8014-442c-bb0f-597111544941 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:21.776683 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c5305e96-8014-442c-bb0f-597111544941 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6" status: 200 len: 1472 microversion: 2.1 time: 0.549761 Sep 16 12:48:21.779499 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 389/741] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:21 2022] GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 => generated 1472 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:21.784343 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a4667694-1e90-4245-a2a3-d35804cb2167 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:21.784969 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a4667694-1e90-4245-a2a3-d35804cb2167 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] [instance: a1f478b9-b8e1-40a8-9232-34eb6df9ad7a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:21.810553 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4667694-1e90-4245-a2a3-d35804cb2167 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:21.811082 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4667694-1e90-4245-a2a3-d35804cb2167 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:21.811532 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4667694-1e90-4245-a2a3-d35804cb2167 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:21.812299 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4667694-1e90-4245-a2a3-d35804cb2167 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:21.812817 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4667694-1e90-4245-a2a3-d35804cb2167 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:21.813258 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4667694-1e90-4245-a2a3-d35804cb2167 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:22.193622 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a4667694-1e90-4245-a2a3-d35804cb2167 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a" status: 200 len: 1650 microversion: 2.1 time: 0.410389 Sep 16 12:48:22.210519 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 390/742] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:21 2022] GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a => generated 1650 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:22.231612 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b8fb2c76-8656-4aea-9dd7-adbd1e3a69da tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:22.231612 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b8fb2c76-8656-4aea-9dd7-adbd1e3a69da tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 21107d05-79f1-476d-b921-9548eff4f2c4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:22.243923 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8fb2c76-8656-4aea-9dd7-adbd1e3a69da tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:22.244559 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8fb2c76-8656-4aea-9dd7-adbd1e3a69da tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:22.247004 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8fb2c76-8656-4aea-9dd7-adbd1e3a69da tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:22.251449 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8fb2c76-8656-4aea-9dd7-adbd1e3a69da tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:22.251949 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8fb2c76-8656-4aea-9dd7-adbd1e3a69da tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:22.252420 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8fb2c76-8656-4aea-9dd7-adbd1e3a69da tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:22.663796 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b8fb2c76-8656-4aea-9dd7-adbd1e3a69da tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:22.680516 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b8fb2c76-8656-4aea-9dd7-adbd1e3a69da tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/21107d05-79f1-476d-b921-9548eff4f2c4" status: 200 len: 1319 microversion: 2.1 time: 0.468548 Sep 16 12:48:22.681940 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 391/743] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:22 2022] GET /compute/v2.1/servers/21107d05-79f1-476d-b921-9548eff4f2c4 => generated 1319 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:22.688889 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-499e5a1a-5a51-4f4b-af33-b591a6ce0bfd req-39b13d6d-ff0d-49d9-894e-16db430d6ca3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d5c44e7-c030-4a42-97fb-e838e1472456", "name": "network-vif-plugged", "status": "completed", "tag": "5d6e364d-d651-4c3c-b21c-27421ce4597f"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:22.710675 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-499e5a1a-5a51-4f4b-af33-b591a6ce0bfd req-39b13d6d-ff0d-49d9-894e-16db430d6ca3 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:22.710675 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-499e5a1a-5a51-4f4b-af33-b591a6ce0bfd req-39b13d6d-ff0d-49d9-894e-16db430d6ca3 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:22.710675 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-499e5a1a-5a51-4f4b-af33-b591a6ce0bfd req-39b13d6d-ff0d-49d9-894e-16db430d6ca3 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:22.752408 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-499e5a1a-5a51-4f4b-af33-b591a6ce0bfd req-39b13d6d-ff0d-49d9-894e-16db430d6ca3 service nova] Creating event network-vif-plugged:5d6e364d-d651-4c3c-b21c-27421ce4597f for instance 8d5c44e7-c030-4a42-97fb-e838e1472456 on n-h2-858094-4 Sep 16 12:48:22.765611 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-499e5a1a-5a51-4f4b-af33-b591a6ce0bfd req-39b13d6d-ff0d-49d9-894e-16db430d6ca3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081548 Sep 16 12:48:22.767638 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 392/744] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:48:22.796771 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5f644654-17c3-457b-8217-589ead828940 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:22.797478 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5f644654-17c3-457b-8217-589ead828940 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: efea200a-0b78-42de-a9e2-febab9817590] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:22.806708 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f644654-17c3-457b-8217-589ead828940 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:22.807200 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f644654-17c3-457b-8217-589ead828940 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:22.807636 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f644654-17c3-457b-8217-589ead828940 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:22.809387 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f644654-17c3-457b-8217-589ead828940 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:22.810726 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f644654-17c3-457b-8217-589ead828940 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:22.811319 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f644654-17c3-457b-8217-589ead828940 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:23.083506 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5f644654-17c3-457b-8217-589ead828940 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:23.096743 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5f644654-17c3-457b-8217-589ead828940 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590" status: 200 len: 1473 microversion: 2.1 time: 0.327389 Sep 16 12:48:23.097562 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 393/745] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:22 2022] GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590 => generated 1473 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:23.114052 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-88a3fef7-cda5-48ce-9b98-1013e1d27bfc tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:23.114716 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-88a3fef7-cda5-48ce-9b98-1013e1d27bfc tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:23.132718 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88a3fef7-cda5-48ce-9b98-1013e1d27bfc tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:23.133269 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88a3fef7-cda5-48ce-9b98-1013e1d27bfc tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:23.140020 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88a3fef7-cda5-48ce-9b98-1013e1d27bfc tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:23.141011 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88a3fef7-cda5-48ce-9b98-1013e1d27bfc tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:23.141746 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88a3fef7-cda5-48ce-9b98-1013e1d27bfc tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:23.142129 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88a3fef7-cda5-48ce-9b98-1013e1d27bfc tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:23.169882 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:48:23.415391 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-88a3fef7-cda5-48ce-9b98-1013e1d27bfc tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:23.424898 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-88a3fef7-cda5-48ce-9b98-1013e1d27bfc tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6" status: 200 len: 1472 microversion: 2.1 time: 0.325316 Sep 16 12:48:23.431666 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 394/746] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:23 2022] GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 => generated 1472 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:23.457886 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-64233dad-e8a5-40cf-94f8-1eee4b405c69 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:23.462298 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-64233dad-e8a5-40cf-94f8-1eee4b405c69 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] [instance: a1f478b9-b8e1-40a8-9232-34eb6df9ad7a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:23.486326 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64233dad-e8a5-40cf-94f8-1eee4b405c69 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:23.486977 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64233dad-e8a5-40cf-94f8-1eee4b405c69 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:23.490063 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64233dad-e8a5-40cf-94f8-1eee4b405c69 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:23.493588 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64233dad-e8a5-40cf-94f8-1eee4b405c69 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:23.499138 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64233dad-e8a5-40cf-94f8-1eee4b405c69 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:23.500025 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64233dad-e8a5-40cf-94f8-1eee4b405c69 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:23.780342 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-64233dad-e8a5-40cf-94f8-1eee4b405c69 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a" status: 200 len: 1630 microversion: 2.1 time: 0.335141 Sep 16 12:48:23.780342 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 395/747] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:23 2022] GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a => generated 1630 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:23.783675 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-479b06d1-7e3a-4fae-9280-5445cf20c5ce tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:23.784388 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-479b06d1-7e3a-4fae-9280-5445cf20c5ce tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 21107d05-79f1-476d-b921-9548eff4f2c4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:23.800541 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-479b06d1-7e3a-4fae-9280-5445cf20c5ce tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:23.801048 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-479b06d1-7e3a-4fae-9280-5445cf20c5ce tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:23.801487 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-479b06d1-7e3a-4fae-9280-5445cf20c5ce tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:23.806841 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-479b06d1-7e3a-4fae-9280-5445cf20c5ce tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:23.807341 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-479b06d1-7e3a-4fae-9280-5445cf20c5ce tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:23.807779 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-479b06d1-7e3a-4fae-9280-5445cf20c5ce tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:24.082788 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-479b06d1-7e3a-4fae-9280-5445cf20c5ce tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:24.096485 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-479b06d1-7e3a-4fae-9280-5445cf20c5ce tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/21107d05-79f1-476d-b921-9548eff4f2c4" status: 200 len: 1319 microversion: 2.1 time: 0.316966 Sep 16 12:48:24.108264 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 396/748] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:23 2022] GET /compute/v2.1/servers/21107d05-79f1-476d-b921-9548eff4f2c4 => generated 1319 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:24.109245 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-830dd1be-3ded-4eca-892a-6a7ad5c4d343 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858094-4", "block_migration": true, "disk_over_commit": false}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:24.111591 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-830dd1be-3ded-4eca-892a-6a7ad5c4d343 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] [instance: a1f478b9-b8e1-40a8-9232-34eb6df9ad7a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:24.130414 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-830dd1be-3ded-4eca-892a-6a7ad5c4d343 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:24.130932 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-830dd1be-3ded-4eca-892a-6a7ad5c4d343 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:24.131362 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-830dd1be-3ded-4eca-892a-6a7ad5c4d343 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:24.132090 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-830dd1be-3ded-4eca-892a-6a7ad5c4d343 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:24.132582 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-830dd1be-3ded-4eca-892a-6a7ad5c4d343 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:24.133009 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-830dd1be-3ded-4eca-892a-6a7ad5c4d343 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:24.287118 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-830dd1be-3ded-4eca-892a-6a7ad5c4d343 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lazy-loading 'flavor' on Instance uuid a1f478b9-b8e1-40a8-9232-34eb6df9ad7a {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:48:24.323594 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-830dd1be-3ded-4eca-892a-6a7ad5c4d343 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] [instance: a1f478b9-b8e1-40a8-9232-34eb6df9ad7a] Going to try to live migrate instance to n-h1-858094-4 {{(pid=128779) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 16 12:48:24.436994 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=29 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:48:25.074442 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=6 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:48:28.213190 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-830dd1be-3ded-4eca-892a-6a7ad5c4d343 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a/action" status: 202 len: 0 microversion: 2.1 time: 4.114589 Sep 16 12:48:28.217615 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 397/749] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:48:24 2022] POST /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a/action => generated 0 bytes in 4118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:48:28.222954 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d3ce272d-1b3b-4645-afd5-d7cbd7526ad7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:28.224252 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d3ce272d-1b3b-4645-afd5-d7cbd7526ad7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: efea200a-0b78-42de-a9e2-febab9817590] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:28.243631 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:48:28.272682 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3ce272d-1b3b-4645-afd5-d7cbd7526ad7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:28.275222 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3ce272d-1b3b-4645-afd5-d7cbd7526ad7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:28.276032 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3ce272d-1b3b-4645-afd5-d7cbd7526ad7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:28.280794 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3ce272d-1b3b-4645-afd5-d7cbd7526ad7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:28.282487 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3ce272d-1b3b-4645-afd5-d7cbd7526ad7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:28.285205 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3ce272d-1b3b-4645-afd5-d7cbd7526ad7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:28.689333 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d3ce272d-1b3b-4645-afd5-d7cbd7526ad7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:28.705296 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d3ce272d-1b3b-4645-afd5-d7cbd7526ad7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590" status: 200 len: 1470 microversion: 2.1 time: 0.486416 Sep 16 12:48:28.708873 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 398/750] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:28 2022] GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590 => generated 1470 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:28.740030 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d8284f02-be9a-4696-bb27-bbf65e8854c7 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:28.742035 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d8284f02-be9a-4696-bb27-bbf65e8854c7 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:28.756501 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8284f02-be9a-4696-bb27-bbf65e8854c7 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:28.760512 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8284f02-be9a-4696-bb27-bbf65e8854c7 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:28.762487 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8284f02-be9a-4696-bb27-bbf65e8854c7 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:28.763690 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8284f02-be9a-4696-bb27-bbf65e8854c7 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:28.772855 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8284f02-be9a-4696-bb27-bbf65e8854c7 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:28.774791 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8284f02-be9a-4696-bb27-bbf65e8854c7 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:29.115153 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d8284f02-be9a-4696-bb27-bbf65e8854c7 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:29.145441 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d8284f02-be9a-4696-bb27-bbf65e8854c7 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6" status: 200 len: 1478 microversion: 2.1 time: 0.415910 Sep 16 12:48:29.152420 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 399/751] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:28 2022] GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 => generated 1478 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:29.176730 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1234df75-49bd-4d27-8b63-6f31fec63168 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:29.209846 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1234df75-49bd-4d27-8b63-6f31fec63168 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 21107d05-79f1-476d-b921-9548eff4f2c4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:29.238125 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1234df75-49bd-4d27-8b63-6f31fec63168 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:29.238801 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1234df75-49bd-4d27-8b63-6f31fec63168 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:29.249077 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1234df75-49bd-4d27-8b63-6f31fec63168 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:29.250868 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1234df75-49bd-4d27-8b63-6f31fec63168 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:29.253361 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1234df75-49bd-4d27-8b63-6f31fec63168 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:29.254501 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1234df75-49bd-4d27-8b63-6f31fec63168 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:29.775548 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:48:29.892919 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1234df75-49bd-4d27-8b63-6f31fec63168 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:29.903915 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1234df75-49bd-4d27-8b63-6f31fec63168 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/21107d05-79f1-476d-b921-9548eff4f2c4" status: 200 len: 1319 microversion: 2.1 time: 0.733140 Sep 16 12:48:29.904564 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 400/752] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:29 2022] GET /compute/v2.1/servers/21107d05-79f1-476d-b921-9548eff4f2c4 => generated 1319 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:29.928059 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-47d75e60-d81b-42c1-b594-a94eeed28885 req-d106bbc8-c9ca-4a96-9959-c6be92289a53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21107d05-79f1-476d-b921-9548eff4f2c4", "name": "network-vif-plugged", "status": "completed", "tag": "84d3e3e1-0c23-49c4-af27-80f8acbc75ae"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:29.957517 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-47d75e60-d81b-42c1-b594-a94eeed28885 req-d106bbc8-c9ca-4a96-9959-c6be92289a53 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:29.958073 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-47d75e60-d81b-42c1-b594-a94eeed28885 req-d106bbc8-c9ca-4a96-9959-c6be92289a53 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:29.958565 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-47d75e60-d81b-42c1-b594-a94eeed28885 req-d106bbc8-c9ca-4a96-9959-c6be92289a53 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:29.990096 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-47d75e60-d81b-42c1-b594-a94eeed28885 req-d106bbc8-c9ca-4a96-9959-c6be92289a53 service nova] Creating event network-vif-plugged:84d3e3e1-0c23-49c4-af27-80f8acbc75ae for instance 21107d05-79f1-476d-b921-9548eff4f2c4 on n-h2-858094-4 Sep 16 12:48:30.003767 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-47d75e60-d81b-42c1-b594-a94eeed28885 req-d106bbc8-c9ca-4a96-9959-c6be92289a53 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094096 Sep 16 12:48:30.005450 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 401/753] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:48:30.016343 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-86da66e7-e87c-482d-b616-c6a71d0644ad tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:30.017102 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-86da66e7-e87c-482d-b616-c6a71d0644ad tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: a1f478b9-b8e1-40a8-9232-34eb6df9ad7a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:30.034806 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86da66e7-e87c-482d-b616-c6a71d0644ad tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:30.036016 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86da66e7-e87c-482d-b616-c6a71d0644ad tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:30.036016 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86da66e7-e87c-482d-b616-c6a71d0644ad tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:30.037182 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86da66e7-e87c-482d-b616-c6a71d0644ad tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:30.037682 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86da66e7-e87c-482d-b616-c6a71d0644ad tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:30.038113 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86da66e7-e87c-482d-b616-c6a71d0644ad tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:30.448850 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1679e01f-e482-4907-bc5d-d8d7d1c5324f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/b7be3aa9-bb67-45cb-9262-02de0dc4a4b0" status: 200 len: 1421 microversion: 2.1 time: 15.359662 Sep 16 12:48:30.468280 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 353/754] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:48:15 2022] GET /compute/v2.1/images/b7be3aa9-bb67-45cb-9262-02de0dc4a4b0 => generated 1421 bytes in 15380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:30.484736 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b32687be-619a-48d2-8cf5-a9679f1da0aa tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:30.485675 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b32687be-619a-48d2-8cf5-a9679f1da0aa tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: efea200a-0b78-42de-a9e2-febab9817590] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:30.498459 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b32687be-619a-48d2-8cf5-a9679f1da0aa tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:30.501446 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b32687be-619a-48d2-8cf5-a9679f1da0aa tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:30.501951 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b32687be-619a-48d2-8cf5-a9679f1da0aa tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:30.503117 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b32687be-619a-48d2-8cf5-a9679f1da0aa tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:30.503695 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b32687be-619a-48d2-8cf5-a9679f1da0aa tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:30.504151 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b32687be-619a-48d2-8cf5-a9679f1da0aa tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:30.596305 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-b32687be-619a-48d2-8cf5-a9679f1da0aa tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] HTTP exception thrown: Instance has not been resized. Sep 16 12:48:30.621846 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b32687be-619a-48d2-8cf5-a9679f1da0aa tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Request method failure captured: Sep 16 12:48:30.621846 n-d-858094-4 devstack@n-api.service[128780]: request: POST /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590/action HTTP/1.1 Sep 16 12:48:30.621846 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:48:30.621846 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:48:30.621846 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:48:30.621846 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 21 Sep 16 12:48:30.621846 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:48:30.621846 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:48:30.621846 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:48:30.621846 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:48:30.621846 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHBRVCNZh7s3qiWk8e7dDntjLmx7Uq1o7Yz49PjdhXkeDEhxCJvSqDNaxFYD4ZTfwTB9gBWkkSsrzbdLOsywrJgACtdvqsMnejhS1OJL2U_sNrRKxh64yJLlkXbgE9PesdSsC3g-sqzkc1hnbiJ_-JHqu8VW7vvaYO1adojxOefjq2Q Sep 16 12:48:30.621846 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:48:30.621846 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:48:30.621846 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:48:30.621846 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:48:30.621846 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:48:30.621846 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:48:30.621846 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 0b18ec5302634d2a95e51547e0019d40 Sep 16 12:48:30.621846 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-MigrationsAdminTest-25653665 Sep 16 12:48:30.621846 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:48:30.621846 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:48:30.623354 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0b18ec5302634d2a95e51547e0019d40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0b18ec5302634d2a95e51547e0019d40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0b18ec5302634d2a95e51547e0019d40", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0b18ec5302634d2a95e51547e0019d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:48:30.623354 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-MigrationsAdminTest-25653665 Sep 16 12:48:30.623354 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 0b18ec5302634d2a95e51547e0019d40 Sep 16 12:48:30.623354 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-MigrationsAdminTest-25653665 Sep 16 12:48:30.623354 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-MigrationsAdminTest-25653665-project Sep 16 12:48:30.623354 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:48:30.623354 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:48:30.623354 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: f3e2827a76d14e4a88c4562f1c0351ac Sep 16 12:48:30.623354 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-MigrationsAdminTest-25653665-project Sep 16 12:48:30.623354 n-d-858094-4 devstack@n-api.service[128780]: Sep 16 12:48:30.623354 n-d-858094-4 devstack@n-api.service[128780]: {"confirmResize": {}} Sep 16 12:48:30.623354 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:48:30.623354 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance has not been resized. Sep 16 12:48:30.623354 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'efea200a-0b78-42de-a9e2-febab9817590', 'body': {'confirmResize': {}}} Sep 16 12:48:30.624286 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:48:30.624286 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:48:30.624286 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 988, in _action_confirm_resize Sep 16 12:48:30.624286 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.compute_api.confirm_resize(context, instance) Sep 16 12:48:30.624286 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 16 12:48:30.624286 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 12:48:30.624286 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 16 12:48:30.624286 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 16 12:48:30.624286 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4032, in confirm_resize Sep 16 12:48:30.624286 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi migration = objects.Migration.get_by_instance_and_status( Sep 16 12:48:30.624286 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 12:48:30.624286 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 12:48:30.624286 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/migration.py", line 164, in get_by_instance_and_status Sep 16 12:48:30.624286 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi db_migration = db.migration_get_by_instance_and_status( Sep 16 12:48:30.624286 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 224, in wrapper Sep 16 12:48:30.624286 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Sep 16 12:48:30.624286 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 3300, in migration_get_by_instance_and_status Sep 16 12:48:30.624286 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.MigrationNotFoundByStatus(instance_id=instance_uuid, Sep 16 12:48:30.626835 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.MigrationNotFoundByStatus: Migration not found for instance efea200a-0b78-42de-a9e2-febab9817590 with status finished. Sep 16 12:48:30.626835 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:48:30.626835 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:48:30.626835 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:48:30.626835 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:48:30.626835 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:48:30.626835 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:48:30.626835 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:48:30.626835 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:48:30.626835 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:48:30.626835 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:48:30.626835 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 991, in _action_confirm_resize Sep 16 12:48:30.626835 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 16 12:48:30.626835 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Instance has not been resized. Sep 16 12:48:30.626835 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:48:30.626835 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:48:30.626835 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:48:30.626835 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:48:30.626835 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:48:30.626835 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:48:30.626835 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:48:30.630777 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:48:30.630777 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance has not been resized. Sep 16 12:48:30.630777 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:48:30.632499 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b32687be-619a-48d2-8cf5-a9679f1da0aa tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Returning 400 to user: Instance has not been resized. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:48:30.633645 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b32687be-619a-48d2-8cf5-a9679f1da0aa tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "POST /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590/action" status: 400 len: 74 microversion: 2.1 time: 0.163807 Sep 16 12:48:30.634802 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 354/755] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:48:30 2022] POST /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590/action => generated 74 bytes in 166 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 16 12:48:30.641277 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f078947a-4889-4424-b6e3-bb10bf0d96d5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:30.657232 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f078947a-4889-4424-b6e3-bb10bf0d96d5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:30.670706 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f078947a-4889-4424-b6e3-bb10bf0d96d5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:30.671739 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f078947a-4889-4424-b6e3-bb10bf0d96d5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:30.677455 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f078947a-4889-4424-b6e3-bb10bf0d96d5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:30.679770 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f078947a-4889-4424-b6e3-bb10bf0d96d5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:30.683998 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f078947a-4889-4424-b6e3-bb10bf0d96d5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:30.687132 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f078947a-4889-4424-b6e3-bb10bf0d96d5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:31.376764 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-86da66e7-e87c-482d-b616-c6a71d0644ad tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:31.393949 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-86da66e7-e87c-482d-b616-c6a71d0644ad tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a" status: 200 len: 1504 microversion: 2.1 time: 1.381724 Sep 16 12:48:31.399128 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f078947a-4889-4424-b6e3-bb10bf0d96d5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:31.408841 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f078947a-4889-4424-b6e3-bb10bf0d96d5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6" status: 200 len: 1463 microversion: 2.1 time: 0.771777 Sep 16 12:48:31.415195 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 402/756] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:30 2022] GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a => generated 1504 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:31.436148 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 355/757] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:30 2022] GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 => generated 1463 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:31.440236 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e5eee8c4-7762-48ae-bfc8-6b4621f950b5 tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Calling method '.version_select at 0x7f1035ff35e0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:31.446302 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-84579174-5e79-4e88-bafb-1a2f73c0750d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f1035a9a9d0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:31.454085 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e5eee8c4-7762-48ae-bfc8-6b4621f950b5 tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:31.458111 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e5eee8c4-7762-48ae-bfc8-6b4621f950b5 tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:31.463080 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e5eee8c4-7762-48ae-bfc8-6b4621f950b5 tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:31.505593 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e5eee8c4-7762-48ae-bfc8-6b4621f950b5 tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] 10.222.0.67 "GET /compute/v2.1/os-migrations" status: 200 len: 1178 microversion: 2.1 time: 0.079974 Sep 16 12:48:31.510559 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 356/758] 10.222.0.67 () {58 vars in 1143 bytes} [Fri Sep 16 12:48:31 2022] GET /compute/v2.1/os-migrations => generated 1178 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:31.522936 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-84579174-5e79-4e88-bafb-1a2f73c0750d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/b7be3aa9-bb67-45cb-9262-02de0dc4a4b0" status: 200 len: 1421 microversion: 2.1 time: 0.106125 Sep 16 12:48:31.528454 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 403/759] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:48:31 2022] GET /compute/v2.1/images/b7be3aa9-bb67-45cb-9262-02de0dc4a4b0 => generated 1421 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:31.545890 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-11100bc3-56b2-488a-8463-81fcd527e069 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:31.548567 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-11100bc3-56b2-488a-8463-81fcd527e069 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:31.557148 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11100bc3-56b2-488a-8463-81fcd527e069 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:31.558299 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11100bc3-56b2-488a-8463-81fcd527e069 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:31.558994 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11100bc3-56b2-488a-8463-81fcd527e069 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:31.560079 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11100bc3-56b2-488a-8463-81fcd527e069 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:31.560993 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11100bc3-56b2-488a-8463-81fcd527e069 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:31.562126 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11100bc3-56b2-488a-8463-81fcd527e069 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:31.571693 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-992ebe04-5cba-48b4-9fac-a2b46c109c28 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:31.573370 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-992ebe04-5cba-48b4-9fac-a2b46c109c28 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 21107d05-79f1-476d-b921-9548eff4f2c4] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:31.597886 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-992ebe04-5cba-48b4-9fac-a2b46c109c28 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:31.600740 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-992ebe04-5cba-48b4-9fac-a2b46c109c28 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:31.603816 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-992ebe04-5cba-48b4-9fac-a2b46c109c28 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:31.608911 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-992ebe04-5cba-48b4-9fac-a2b46c109c28 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:31.612412 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-992ebe04-5cba-48b4-9fac-a2b46c109c28 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:31.612930 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-992ebe04-5cba-48b4-9fac-a2b46c109c28 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:31.735013 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-11100bc3-56b2-488a-8463-81fcd527e069 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6/action" status: 202 len: 0 microversion: 2.1 time: 0.202321 Sep 16 12:48:31.742305 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 404/760] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:48:31 2022] POST /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:48:31.753213 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0d317bba-c0a5-44fb-846b-d8091f3779b8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f1035a08f70>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:32.004228 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-992ebe04-5cba-48b4-9fac-a2b46c109c28 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:32.015270 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-992ebe04-5cba-48b4-9fac-a2b46c109c28 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/21107d05-79f1-476d-b921-9548eff4f2c4" status: 200 len: 1319 microversion: 2.1 time: 0.488623 Sep 16 12:48:32.019434 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 357/761] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:31 2022] GET /compute/v2.1/servers/21107d05-79f1-476d-b921-9548eff4f2c4 => generated 1319 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:32.031682 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2f0702ec-e848-44eb-9b22-ece4f37b488a tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:32.032795 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-2f0702ec-e848-44eb-9b22-ece4f37b488a tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:32.055410 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2f0702ec-e848-44eb-9b22-ece4f37b488a tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:32.056179 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2f0702ec-e848-44eb-9b22-ece4f37b488a tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:32.056842 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2f0702ec-e848-44eb-9b22-ece4f37b488a tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:32.058096 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2f0702ec-e848-44eb-9b22-ece4f37b488a tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:32.060036 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2f0702ec-e848-44eb-9b22-ece4f37b488a tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:32.061337 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2f0702ec-e848-44eb-9b22-ece4f37b488a tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:32.186632 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2f0702ec-e848-44eb-9b22-ece4f37b488a tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:32.187029 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2f0702ec-e848-44eb-9b22-ece4f37b488a tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:32.188268 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2f0702ec-e848-44eb-9b22-ece4f37b488a tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:32.188747 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-2f0702ec-e848-44eb-9b22-ece4f37b488a tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lazy-loading 'fault' on Instance uuid f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:48:32.707193 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2f0702ec-e848-44eb-9b22-ece4f37b488a tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6" status: 200 len: 1597 microversion: 2.1 time: 0.685215 Sep 16 12:48:32.728618 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 358/762] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:32 2022] GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 => generated 1597 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:32.747072 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d7f92ab4-b84a-4c08-9a7c-dceba81f78c7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2118788947", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:33.028941 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0d317bba-c0a5-44fb-846b-d8091f3779b8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "DELETE /compute/v2.1/images/b7be3aa9-bb67-45cb-9262-02de0dc4a4b0" status: 204 len: 0 microversion: 2.1 time: 1.284803 Sep 16 12:48:33.030349 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 405/763] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:31 2022] DELETE /compute/v2.1/images/b7be3aa9-bb67-45cb-9262-02de0dc4a4b0 => generated 0 bytes in 1287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:48:33.036739 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-91ac247b-db44-497e-851a-7f880a541752 req-2578741f-d538-4c88-8986-80f489b98ccc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6", "name": "network-vif-unplugged", "status": "completed", "tag": "31e589d5-4175-4617-9376-ffdea1a75308"}, {"server_uuid": "efea200a-0b78-42de-a9e2-febab9817590", "name": "network-vif-plugged", "status": "completed", "tag": "3fe50ad6-99ae-4c0b-a11b-3e41218b0317"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:33.079295 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-91ac247b-db44-497e-851a-7f880a541752 req-2578741f-d538-4c88-8986-80f489b98ccc service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:33.085003 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-91ac247b-db44-497e-851a-7f880a541752 req-2578741f-d538-4c88-8986-80f489b98ccc service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:33.088256 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-91ac247b-db44-497e-851a-7f880a541752 req-2578741f-d538-4c88-8986-80f489b98ccc service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:33.108883 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-91ac247b-db44-497e-851a-7f880a541752 req-2578741f-d538-4c88-8986-80f489b98ccc service nova] Creating event network-vif-unplugged:31e589d5-4175-4617-9376-ffdea1a75308 for instance f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 on n-h2-858094-4 Sep 16 12:48:33.109749 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-91ac247b-db44-497e-851a-7f880a541752 req-2578741f-d538-4c88-8986-80f489b98ccc service nova] Creating event network-vif-plugged:3fe50ad6-99ae-4c0b-a11b-3e41218b0317 for instance efea200a-0b78-42de-a9e2-febab9817590 on n-h1-858094-4 Sep 16 12:48:33.117369 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [req-91ac247b-db44-497e-851a-7f880a541752 req-2578741f-d538-4c88-8986-80f489b98ccc service nova] Instance efea200a-0b78-42de-a9e2-febab9817590 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858094-4', 'n-h2-858094-4'} {{(pid=128779) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 12:48:33.130876 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-d7f92ab4-b84a-4c08-9a7c-dceba81f78c7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] validate_networks() for None {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:48:33.147814 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-91ac247b-db44-497e-851a-7f880a541752 req-2578741f-d538-4c88-8986-80f489b98ccc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.115812 Sep 16 12:48:33.148811 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 406/764] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:48:33.162323 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2339c38d-d203-4ba2-b0a8-d2df7e89731c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:33.163371 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2339c38d-d203-4ba2-b0a8-d2df7e89731c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: a1f478b9-b8e1-40a8-9232-34eb6df9ad7a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:33.170824 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2339c38d-d203-4ba2-b0a8-d2df7e89731c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:33.171678 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2339c38d-d203-4ba2-b0a8-d2df7e89731c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:33.173221 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2339c38d-d203-4ba2-b0a8-d2df7e89731c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:33.174182 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2339c38d-d203-4ba2-b0a8-d2df7e89731c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:33.174877 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2339c38d-d203-4ba2-b0a8-d2df7e89731c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:33.176069 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2339c38d-d203-4ba2-b0a8-d2df7e89731c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:33.727621 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2339c38d-d203-4ba2-b0a8-d2df7e89731c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:33.742590 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2339c38d-d203-4ba2-b0a8-d2df7e89731c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a" status: 200 len: 1504 microversion: 2.1 time: 0.579418 Sep 16 12:48:33.744415 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 407/765] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:33 2022] GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a => generated 1504 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:33.755920 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-24789b05-9435-4e7d-9b11-6e4ed07f921e tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:33.773167 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-24789b05-9435-4e7d-9b11-6e4ed07f921e tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:33.793605 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24789b05-9435-4e7d-9b11-6e4ed07f921e tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:33.809619 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24789b05-9435-4e7d-9b11-6e4ed07f921e tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:33.810382 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24789b05-9435-4e7d-9b11-6e4ed07f921e tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:33.812982 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24789b05-9435-4e7d-9b11-6e4ed07f921e tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:33.813652 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24789b05-9435-4e7d-9b11-6e4ed07f921e tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:33.814260 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24789b05-9435-4e7d-9b11-6e4ed07f921e tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:33.890078 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-d7f92ab4-b84a-4c08-9a7c-dceba81f78c7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:48:33.890653 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-d7f92ab4-b84a-4c08-9a7c-dceba81f78c7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:48:33.892485 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-d7f92ab4-b84a-4c08-9a7c-dceba81f78c7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:48:33.892999 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-d7f92ab4-b84a-4c08-9a7c-dceba81f78c7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:48:33.894068 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-d7f92ab4-b84a-4c08-9a7c-dceba81f78c7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:48:33.925372 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d7f92ab4-b84a-4c08-9a7c-dceba81f78c7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:33.927176 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d7f92ab4-b84a-4c08-9a7c-dceba81f78c7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:33.927873 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d7f92ab4-b84a-4c08-9a7c-dceba81f78c7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:33.928909 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d7f92ab4-b84a-4c08-9a7c-dceba81f78c7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:33.931319 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d7f92ab4-b84a-4c08-9a7c-dceba81f78c7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:33.931963 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d7f92ab4-b84a-4c08-9a7c-dceba81f78c7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:33.969302 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:48:33.975100 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-24789b05-9435-4e7d-9b11-6e4ed07f921e tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6/action" status: 202 len: 0 microversion: 2.1 time: 0.225625 Sep 16 12:48:33.976902 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 408/766] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:48:33 2022] POST /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:48:33.983517 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a97aafee-23e7-4c55-a7df-27ab4ff5e311 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:33.985074 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a97aafee-23e7-4c55-a7df-27ab4ff5e311 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: c077c0ae-56e2-42f7-a0e7-32e6597062c5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:33.993697 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a97aafee-23e7-4c55-a7df-27ab4ff5e311 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:33.994564 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a97aafee-23e7-4c55-a7df-27ab4ff5e311 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:33.996326 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a97aafee-23e7-4c55-a7df-27ab4ff5e311 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:33.998207 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a97aafee-23e7-4c55-a7df-27ab4ff5e311 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:33.998961 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a97aafee-23e7-4c55-a7df-27ab4ff5e311 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:33.999601 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a97aafee-23e7-4c55-a7df-27ab4ff5e311 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:34.001110 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-d7f92ab4-b84a-4c08-9a7c-dceba81f78c7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Getting quotas for project 0b18ec5302634d2a95e51547e0019d40. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:48:34.015564 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-d7f92ab4-b84a-4c08-9a7c-dceba81f78c7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Getting quotas for user f3e2827a76d14e4a88c4562f1c0351ac and project 0b18ec5302634d2a95e51547e0019d40. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:48:34.033706 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a97aafee-23e7-4c55-a7df-27ab4ff5e311 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: c077c0ae-56e2-42f7-a0e7-32e6597062c5] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:48:34.073441 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d7f92ab4-b84a-4c08-9a7c-dceba81f78c7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:48:34.089800 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d7f92ab4-b84a-4c08-9a7c-dceba81f78c7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:48:34.226330 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a97aafee-23e7-4c55-a7df-27ab4ff5e311 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c077c0ae-56e2-42f7-a0e7-32e6597062c5" status: 204 len: 0 microversion: 2.1 time: 0.246032 Sep 16 12:48:34.231298 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 409/767] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:48:33 2022] DELETE /compute/v2.1/servers/c077c0ae-56e2-42f7-a0e7-32e6597062c5 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:48:34.263116 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d7f92ab4-b84a-4c08-9a7c-dceba81f78c7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.546839 Sep 16 12:48:34.263773 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 359/768] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:48:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:48:34.269066 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-12065c3d-30a5-4767-84b9-611b6359003d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:34.274791 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-12065c3d-30a5-4767-84b9-611b6359003d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 21107d05-79f1-476d-b921-9548eff4f2c4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:34.288923 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-d2af66f8-b58f-4bb3-b75f-c00e6b7e8b1e req-50ec56f5-96ff-47b1-a906-e95a086e8a52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1f478b9-b8e1-40a8-9232-34eb6df9ad7a", "name": "network-vif-unplugged", "status": "completed", "tag": "8109ea32-2ace-4f1c-be0b-e7fa4599d05e"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:34.301857 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-d2af66f8-b58f-4bb3-b75f-c00e6b7e8b1e req-50ec56f5-96ff-47b1-a906-e95a086e8a52 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:34.302551 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-d2af66f8-b58f-4bb3-b75f-c00e6b7e8b1e req-50ec56f5-96ff-47b1-a906-e95a086e8a52 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:34.303141 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-d2af66f8-b58f-4bb3-b75f-c00e6b7e8b1e req-50ec56f5-96ff-47b1-a906-e95a086e8a52 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:34.312322 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12065c3d-30a5-4767-84b9-611b6359003d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:34.315040 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12065c3d-30a5-4767-84b9-611b6359003d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:34.316377 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-d2af66f8-b58f-4bb3-b75f-c00e6b7e8b1e req-50ec56f5-96ff-47b1-a906-e95a086e8a52 service nova] Creating event network-vif-unplugged:8109ea32-2ace-4f1c-be0b-e7fa4599d05e for instance a1f478b9-b8e1-40a8-9232-34eb6df9ad7a on n-h2-858094-4 Sep 16 12:48:34.319031 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12065c3d-30a5-4767-84b9-611b6359003d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:34.323886 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12065c3d-30a5-4767-84b9-611b6359003d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:34.324168 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-d2af66f8-b58f-4bb3-b75f-c00e6b7e8b1e req-50ec56f5-96ff-47b1-a906-e95a086e8a52 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039426 Sep 16 12:48:34.325636 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 360/769] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:48:34.325949 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12065c3d-30a5-4767-84b9-611b6359003d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:34.327690 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12065c3d-30a5-4767-84b9-611b6359003d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:34.332014 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-007ffa05-06f1-4313-a02c-314a10ac45c0 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:34.333110 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-007ffa05-06f1-4313-a02c-314a10ac45c0 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:34.342372 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-007ffa05-06f1-4313-a02c-314a10ac45c0 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:34.343215 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-007ffa05-06f1-4313-a02c-314a10ac45c0 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:34.343868 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-007ffa05-06f1-4313-a02c-314a10ac45c0 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:34.344862 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-007ffa05-06f1-4313-a02c-314a10ac45c0 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:34.345537 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-007ffa05-06f1-4313-a02c-314a10ac45c0 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:34.346196 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-007ffa05-06f1-4313-a02c-314a10ac45c0 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:34.765503 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-007ffa05-06f1-4313-a02c-314a10ac45c0 tempest-ServersAdminTestJSON-994823666 tempest-ServersAdminTestJSON-994823666-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6" status: 200 len: 1614 microversion: 2.1 time: 0.437192 Sep 16 12:48:34.768867 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 361/770] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:34 2022] GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 => generated 1614 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:34.775053 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-12065c3d-30a5-4767-84b9-611b6359003d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:34.788729 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-83bf670b-a187-4a3a-b7fd-37589d652b2e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:34.795752 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-12065c3d-30a5-4767-84b9-611b6359003d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/21107d05-79f1-476d-b921-9548eff4f2c4" status: 200 len: 1469 microversion: 2.1 time: 0.559412 Sep 16 12:48:34.798907 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-83bf670b-a187-4a3a-b7fd-37589d652b2e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:34.799568 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 410/771] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:34 2022] GET /compute/v2.1/servers/21107d05-79f1-476d-b921-9548eff4f2c4 => generated 1469 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:34.810929 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3cbd6bf3-54d6-477e-b901-61518f8ca36c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1876102829", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": [{"uuid": "0e610de6-3238-41c3-bd1a-f23917fad801"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:34.985689 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-3cbd6bf3-54d6-477e-b901-61518f8ca36c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] validate_networks() for [('0e610de6-3238-41c3-bd1a-f23917fad801', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:48:35.104863 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-83bf670b-a187-4a3a-b7fd-37589d652b2e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:35.123999 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-83bf670b-a187-4a3a-b7fd-37589d652b2e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1213 microversion: 2.1 time: 0.351990 Sep 16 12:48:35.131195 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 362/772] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:34 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1213 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:35.146985 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-14dbd149-789b-49dc-b771-89a994b1949f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:35.163170 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-14dbd149-789b-49dc-b771-89a994b1949f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: a1f478b9-b8e1-40a8-9232-34eb6df9ad7a] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:35.208595 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14dbd149-789b-49dc-b771-89a994b1949f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:35.208595 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14dbd149-789b-49dc-b771-89a994b1949f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:35.208595 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14dbd149-789b-49dc-b771-89a994b1949f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:35.210484 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14dbd149-789b-49dc-b771-89a994b1949f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:35.214700 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14dbd149-789b-49dc-b771-89a994b1949f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:35.217421 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14dbd149-789b-49dc-b771-89a994b1949f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:35.590941 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-14dbd149-789b-49dc-b771-89a994b1949f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:35.601440 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-14dbd149-789b-49dc-b771-89a994b1949f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a" status: 200 len: 1504 microversion: 2.1 time: 0.466866 Sep 16 12:48:35.604826 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 363/773] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:35 2022] GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a => generated 1504 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:35.617940 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7563ec40-1cff-4578-98bb-13fd4bd81a21 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:35.618442 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7563ec40-1cff-4578-98bb-13fd4bd81a21 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: e01ba46f-ddd1-47ae-90d9-4a187bf51b2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:35.647210 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7563ec40-1cff-4578-98bb-13fd4bd81a21 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:35.652698 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7563ec40-1cff-4578-98bb-13fd4bd81a21 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:35.653524 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7563ec40-1cff-4578-98bb-13fd4bd81a21 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:35.654479 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7563ec40-1cff-4578-98bb-13fd4bd81a21 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:35.655125 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7563ec40-1cff-4578-98bb-13fd4bd81a21 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:35.656858 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7563ec40-1cff-4578-98bb-13fd4bd81a21 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:35.745674 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7563ec40-1cff-4578-98bb-13fd4bd81a21 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: e01ba46f-ddd1-47ae-90d9-4a187bf51b2b] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:48:35.991008 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7563ec40-1cff-4578-98bb-13fd4bd81a21 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e01ba46f-ddd1-47ae-90d9-4a187bf51b2b" status: 204 len: 0 microversion: 2.1 time: 0.384596 Sep 16 12:48:36.002296 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 364/774] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:48:35 2022] DELETE /compute/v2.1/servers/e01ba46f-ddd1-47ae-90d9-4a187bf51b2b => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:48:36.016999 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f3fd6564-066e-4566-9afa-4e9624553435 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:36.017721 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f3fd6564-066e-4566-9afa-4e9624553435 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 8d5c44e7-c030-4a42-97fb-e838e1472456] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:36.049913 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f3fd6564-066e-4566-9afa-4e9624553435 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:36.051551 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f3fd6564-066e-4566-9afa-4e9624553435 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:36.052249 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f3fd6564-066e-4566-9afa-4e9624553435 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:36.053504 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f3fd6564-066e-4566-9afa-4e9624553435 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:36.054362 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f3fd6564-066e-4566-9afa-4e9624553435 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:36.054933 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f3fd6564-066e-4566-9afa-4e9624553435 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:36.207868 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-3cbd6bf3-54d6-477e-b901-61518f8ca36c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:48:36.210987 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-3cbd6bf3-54d6-477e-b901-61518f8ca36c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:48:36.211701 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-3cbd6bf3-54d6-477e-b901-61518f8ca36c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:48:36.213439 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-3cbd6bf3-54d6-477e-b901-61518f8ca36c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:48:36.214488 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-3cbd6bf3-54d6-477e-b901-61518f8ca36c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:48:36.239326 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3cbd6bf3-54d6-477e-b901-61518f8ca36c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:36.240228 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3cbd6bf3-54d6-477e-b901-61518f8ca36c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:36.240887 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3cbd6bf3-54d6-477e-b901-61518f8ca36c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:36.241902 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3cbd6bf3-54d6-477e-b901-61518f8ca36c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:36.242579 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3cbd6bf3-54d6-477e-b901-61518f8ca36c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:36.243206 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3cbd6bf3-54d6-477e-b901-61518f8ca36c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:36.294989 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-3cbd6bf3-54d6-477e-b901-61518f8ca36c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Getting quotas for project e6fa2067c44b42b5aa940619abd8e538. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:48:36.316048 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-3cbd6bf3-54d6-477e-b901-61518f8ca36c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Getting quotas for user 0cf11dfc3438406ba2710b06fa0fe8ff and project e6fa2067c44b42b5aa940619abd8e538. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:48:36.336249 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3cbd6bf3-54d6-477e-b901-61518f8ca36c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:48:36.343510 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3cbd6bf3-54d6-477e-b901-61518f8ca36c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:48:36.362682 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f3fd6564-066e-4566-9afa-4e9624553435 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:36.385806 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f3fd6564-066e-4566-9afa-4e9624553435 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/8d5c44e7-c030-4a42-97fb-e838e1472456" status: 200 len: 1469 microversion: 2.1 time: 0.384342 Sep 16 12:48:36.401338 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 365/775] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:35 2022] GET /compute/v2.1/servers/8d5c44e7-c030-4a42-97fb-e838e1472456 => generated 1469 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:36.405617 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3cbd6bf3-54d6-477e-b901-61518f8ca36c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.604537 Sep 16 12:48:36.406839 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 411/776] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:48:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:48:36.413831 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-043d2563-fdf6-4cf8-82a6-025ee53d609e tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:36.414678 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-043d2563-fdf6-4cf8-82a6-025ee53d609e tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: e01ba46f-ddd1-47ae-90d9-4a187bf51b2b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:36.426940 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-f1a7e7c0-db8b-4a4e-81d9-76166db051e0 req-c8c301fc-e906-428a-9853-9319ae0c9077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6", "name": "network-vif-plugged", "status": "completed", "tag": "31e589d5-4175-4617-9376-ffdea1a75308"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:36.449146 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-043d2563-fdf6-4cf8-82a6-025ee53d609e tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:36.450824 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-043d2563-fdf6-4cf8-82a6-025ee53d609e tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:36.451473 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-043d2563-fdf6-4cf8-82a6-025ee53d609e tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:36.454357 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-043d2563-fdf6-4cf8-82a6-025ee53d609e tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:36.456046 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-043d2563-fdf6-4cf8-82a6-025ee53d609e tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:36.458983 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-043d2563-fdf6-4cf8-82a6-025ee53d609e tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:36.468638 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-f1a7e7c0-db8b-4a4e-81d9-76166db051e0 req-c8c301fc-e906-428a-9853-9319ae0c9077 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:36.469492 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-f1a7e7c0-db8b-4a4e-81d9-76166db051e0 req-c8c301fc-e906-428a-9853-9319ae0c9077 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:36.470169 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-f1a7e7c0-db8b-4a4e-81d9-76166db051e0 req-c8c301fc-e906-428a-9853-9319ae0c9077 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:36.493113 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-f1a7e7c0-db8b-4a4e-81d9-76166db051e0 req-c8c301fc-e906-428a-9853-9319ae0c9077 service nova] Creating event network-vif-plugged:31e589d5-4175-4617-9376-ffdea1a75308 for instance f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 on n-h2-858094-4 Sep 16 12:48:36.509167 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-f1a7e7c0-db8b-4a4e-81d9-76166db051e0 req-c8c301fc-e906-428a-9853-9319ae0c9077 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106295 Sep 16 12:48:36.510623 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 366/777] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:48:36.522558 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-378f3d0a-dc20-4ac4-aee3-1ba6e4cc2c16 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:36.523650 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-378f3d0a-dc20-4ac4-aee3-1ba6e4cc2c16 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:36.562999 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-378f3d0a-dc20-4ac4-aee3-1ba6e4cc2c16 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:36.563785 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-378f3d0a-dc20-4ac4-aee3-1ba6e4cc2c16 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:36.564633 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-378f3d0a-dc20-4ac4-aee3-1ba6e4cc2c16 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:36.566014 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-378f3d0a-dc20-4ac4-aee3-1ba6e4cc2c16 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:36.571212 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-378f3d0a-dc20-4ac4-aee3-1ba6e4cc2c16 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:36.572515 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-378f3d0a-dc20-4ac4-aee3-1ba6e4cc2c16 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:37.105880 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-378f3d0a-dc20-4ac4-aee3-1ba6e4cc2c16 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:37.150419 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-378f3d0a-dc20-4ac4-aee3-1ba6e4cc2c16 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1265 microversion: 2.1 time: 0.638231 Sep 16 12:48:37.153503 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 367/778] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:36 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1265 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:37.163410 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-8a10d697-7614-4405-9f4d-45a81dca245f req-e48986f7-3836-4a1f-9a49-9b78317b279d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1f478b9-b8e1-40a8-9232-34eb6df9ad7a", "tag": "8109ea32-2ace-4f1c-be0b-e7fa4599d05e"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:37.191820 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-043d2563-fdf6-4cf8-82a6-025ee53d609e tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:37.198891 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-8a10d697-7614-4405-9f4d-45a81dca245f req-e48986f7-3836-4a1f-9a49-9b78317b279d service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:37.201593 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-043d2563-fdf6-4cf8-82a6-025ee53d609e tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/e01ba46f-ddd1-47ae-90d9-4a187bf51b2b" status: 200 len: 1470 microversion: 2.1 time: 0.793483 Sep 16 12:48:37.204537 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-8a10d697-7614-4405-9f4d-45a81dca245f req-e48986f7-3836-4a1f-9a49-9b78317b279d service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:37.206962 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-8a10d697-7614-4405-9f4d-45a81dca245f req-e48986f7-3836-4a1f-9a49-9b78317b279d service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:37.208350 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 412/779] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:36 2022] GET /compute/v2.1/servers/e01ba46f-ddd1-47ae-90d9-4a187bf51b2b => generated 1470 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:37.219454 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8b13263f-6130-4fe9-bc64-e713c9c0fc22 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:37.248836 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8b13263f-6130-4fe9-bc64-e713c9c0fc22 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:37.251549 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8b13263f-6130-4fe9-bc64-e713c9c0fc22 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Searching by: {'reservation_id': 'r-vkfbul5h', 'deleted': False, 'project_id': '8c037a6456444018a6ef54314419e2f2'} {{(pid=128779) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 12:48:37.253136 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-8a10d697-7614-4405-9f4d-45a81dca245f req-e48986f7-3836-4a1f-9a49-9b78317b279d service nova] Creating event network-changed:8109ea32-2ace-4f1c-be0b-e7fa4599d05e for instance a1f478b9-b8e1-40a8-9232-34eb6df9ad7a on n-h2-858094-4 Sep 16 12:48:37.261222 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b13263f-6130-4fe9-bc64-e713c9c0fc22 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:37.262211 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b13263f-6130-4fe9-bc64-e713c9c0fc22 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:37.263515 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b13263f-6130-4fe9-bc64-e713c9c0fc22 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:37.264937 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b13263f-6130-4fe9-bc64-e713c9c0fc22 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:37.265633 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b13263f-6130-4fe9-bc64-e713c9c0fc22 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:37.266240 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b13263f-6130-4fe9-bc64-e713c9c0fc22 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:37.271077 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-8a10d697-7614-4405-9f4d-45a81dca245f req-e48986f7-3836-4a1f-9a49-9b78317b279d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111556 Sep 16 12:48:37.273120 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 368/780] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:48:37.304639 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-816a18d3-7977-4680-80dc-00d56b1f99ae tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:37.310236 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-816a18d3-7977-4680-80dc-00d56b1f99ae tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:37.424459 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-816a18d3-7977-4680-80dc-00d56b1f99ae tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:37.433755 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-816a18d3-7977-4680-80dc-00d56b1f99ae tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1208 microversion: 2.1 time: 0.159116 Sep 16 12:48:37.437010 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 369/781] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:37 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1208 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:37.448304 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-452436a0-f256-4113-aa42-8ea753df8c29 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:37.449159 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-452436a0-f256-4113-aa42-8ea753df8c29 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: a1f478b9-b8e1-40a8-9232-34eb6df9ad7a] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:37.464166 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-452436a0-f256-4113-aa42-8ea753df8c29 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:37.465993 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-452436a0-f256-4113-aa42-8ea753df8c29 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:37.466511 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-452436a0-f256-4113-aa42-8ea753df8c29 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:37.470979 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-452436a0-f256-4113-aa42-8ea753df8c29 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:37.471616 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-452436a0-f256-4113-aa42-8ea753df8c29 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:37.472478 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-452436a0-f256-4113-aa42-8ea753df8c29 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:37.570010 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.multi_cell_list [None req-8b13263f-6130-4fe9-bc64-e713c9c0fc22 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128779) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 12:48:37.665364 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8b13263f-6130-4fe9-bc64-e713c9c0fc22 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:37.677087 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b13263f-6130-4fe9-bc64-e713c9c0fc22 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:37.677838 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b13263f-6130-4fe9-bc64-e713c9c0fc22 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:37.678475 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b13263f-6130-4fe9-bc64-e713c9c0fc22 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:37.718769 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-452436a0-f256-4113-aa42-8ea753df8c29 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:37.728926 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-452436a0-f256-4113-aa42-8ea753df8c29 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a" status: 200 len: 1504 microversion: 2.1 time: 0.286593 Sep 16 12:48:37.730124 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 370/782] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:37 2022] GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a => generated 1504 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:37.811287 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c402bf51-e9c3-4d35-9841-17542ca3a706 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Action: 'create', calling method: .version_select at 0x7f1035afd0d0>, body: {"keypair": {"name": "tempest-keypair-1319627263", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1QIpJ/UEGiCo+rLF84AiRVQa8dGosBK4Z8AH/N4pXaCqzfpk9ppHsTat5UuDCBiu+4mLq2l7Vv53e4K6PMmV7iqPRlycnnx5wW3etBw0kmHiFaMMn3W0+PQMXfwXezDA=="}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:37.828304 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-c402bf51-e9c3-4d35-9841-17542ca3a706 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Getting quotas for project 3e3e2fe65ad744a2ba3b757f42f1d07b. Resources: {'key_pairs'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:48:37.834580 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-c402bf51-e9c3-4d35-9841-17542ca3a706 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Getting quotas for user 3cd06a287a6b48f5a8a5ac30c0159fd9 and project 3e3e2fe65ad744a2ba3b757f42f1d07b. Resources: {'key_pairs'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:48:37.893502 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c402bf51-e9c3-4d35-9841-17542ca3a706 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.162074 Sep 16 12:48:37.894120 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 371/783] 10.222.0.67 () {60 vars in 1159 bytes} [Fri Sep 16 12:48:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:48:38.088822 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8b13263f-6130-4fe9-bc64-e713c9c0fc22 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/detail?reservation_id=r-vkfbul5h" status: 200 len: 2931 microversion: 2.1 time: 0.878932 Sep 16 12:48:38.089950 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 413/784] 10.222.0.67 () {58 vars in 1197 bytes} [Fri Sep 16 12:48:37 2022] GET /compute/v2.1/servers/detail?reservation_id=r-vkfbul5h => generated 2931 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:38.132982 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3ace41df-cb8c-47bb-b20d-dab30f6b6d5c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:38.189326 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.compute.server_groups [None req-3ace41df-cb8c-47bb-b20d-dab30f6b6d5c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Querying cell 19bb4c25-c68f-412b-8c46-4f5dc22c63ee(cell1) for 2 instances {{(pid=128779) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 16 12:48:38.190065 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ace41df-cb8c-47bb-b20d-dab30f6b6d5c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:38.190705 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ace41df-cb8c-47bb-b20d-dab30f6b6d5c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:38.191088 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ace41df-cb8c-47bb-b20d-dab30f6b6d5c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:38.217324 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9524016f-ce8c-4e21-b76a-aeead47a235a tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Action: 'create', calling method: .version_select at 0x7f1035ee6e50>, body: {"keypair": {"name": "tempest-keypair-323052697", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqP8xcYPnkrxsqrgHG5DUxiu2ojiZ+9yK3Hnz+gv0ZsL1uL/a1KY+wWAsMVpFT3ZlIeyq8vJMpiBjLQ4kx9E2RA2l+tcrfT2g8QriAYknpXQO2U4anmRgmWmE0ARsEyiQ=="}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:38.265310 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3ace41df-cb8c-47bb-b20d-dab30f6b6d5c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/os-server-groups/8f990c0d-f2fd-44c0-ad6d-32dadf5fc37b" status: 200 len: 265 microversion: 2.1 time: 0.153475 Sep 16 12:48:38.266778 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 414/785] 10.222.0.67 () {58 vars in 1263 bytes} [Fri Sep 16 12:48:38 2022] GET /compute/v2.1/os-server-groups/8f990c0d-f2fd-44c0-ad6d-32dadf5fc37b => generated 265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:48:38.276302 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-9524016f-ce8c-4e21-b76a-aeead47a235a tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Getting quotas for project 97a3e6c179c6495281c2816a1e18aa7e. Resources: {'key_pairs'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:48:38.280291 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9b2cf40e-a0d4-437a-80d9-211357dd2854 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:38.281414 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9b2cf40e-a0d4-437a-80d9-211357dd2854 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:38.293850 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-9524016f-ce8c-4e21-b76a-aeead47a235a tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Getting quotas for user 687fd28118c342529cda410e9587dfd0 and project 97a3e6c179c6495281c2816a1e18aa7e. Resources: {'key_pairs'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:48:38.301713 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b2cf40e-a0d4-437a-80d9-211357dd2854 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:38.302677 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b2cf40e-a0d4-437a-80d9-211357dd2854 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:38.303700 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b2cf40e-a0d4-437a-80d9-211357dd2854 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:38.304899 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b2cf40e-a0d4-437a-80d9-211357dd2854 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:38.305656 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b2cf40e-a0d4-437a-80d9-211357dd2854 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:38.306239 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b2cf40e-a0d4-437a-80d9-211357dd2854 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:38.369379 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9524016f-ce8c-4e21-b76a-aeead47a235a tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.473855 Sep 16 12:48:38.371274 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 372/786] 10.222.0.67 () {60 vars in 1159 bytes} [Fri Sep 16 12:48:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:48:38.376233 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-83bd9e40-1669-46d6-a64b-f5ba8c61c69e tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:38.380986 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-83bd9e40-1669-46d6-a64b-f5ba8c61c69e tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: e01ba46f-ddd1-47ae-90d9-4a187bf51b2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:38.399973 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-83bd9e40-1669-46d6-a64b-f5ba8c61c69e tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:38.400942 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-83bd9e40-1669-46d6-a64b-f5ba8c61c69e tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:38.402143 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-83bd9e40-1669-46d6-a64b-f5ba8c61c69e tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:38.403103 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-83bd9e40-1669-46d6-a64b-f5ba8c61c69e tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:38.403921 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-83bd9e40-1669-46d6-a64b-f5ba8c61c69e tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:38.404620 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-83bd9e40-1669-46d6-a64b-f5ba8c61c69e tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:38.498531 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9b2cf40e-a0d4-437a-80d9-211357dd2854 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:38.530670 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9b2cf40e-a0d4-437a-80d9-211357dd2854 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1283 microversion: 2.1 time: 0.262755 Sep 16 12:48:38.532858 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 415/787] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:38 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1283 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:38.540771 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5018f02d-1bb7-4f53-8809-bd33203061c4 tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:38.542465 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5018f02d-1bb7-4f53-8809-bd33203061c4 tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] [instance: 21107d05-79f1-476d-b921-9548eff4f2c4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:38.557275 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5018f02d-1bb7-4f53-8809-bd33203061c4 tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:38.559141 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5018f02d-1bb7-4f53-8809-bd33203061c4 tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:38.559841 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5018f02d-1bb7-4f53-8809-bd33203061c4 tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:38.560993 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5018f02d-1bb7-4f53-8809-bd33203061c4 tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:38.562931 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5018f02d-1bb7-4f53-8809-bd33203061c4 tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:38.564075 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5018f02d-1bb7-4f53-8809-bd33203061c4 tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:38.809231 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-83bd9e40-1669-46d6-a64b-f5ba8c61c69e tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:38.819824 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-83bd9e40-1669-46d6-a64b-f5ba8c61c69e tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/e01ba46f-ddd1-47ae-90d9-4a187bf51b2b" status: 200 len: 1470 microversion: 2.1 time: 0.446859 Sep 16 12:48:38.839102 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 373/788] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:38 2022] GET /compute/v2.1/servers/e01ba46f-ddd1-47ae-90d9-4a187bf51b2b => generated 1470 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:38.852141 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e9cd5a1a-e837-458f-b826-7578c78a4160 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:38.852783 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e9cd5a1a-e837-458f-b826-7578c78a4160 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:38.863541 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e9cd5a1a-e837-458f-b826-7578c78a4160 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:38.868772 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e9cd5a1a-e837-458f-b826-7578c78a4160 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:38.872303 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e9cd5a1a-e837-458f-b826-7578c78a4160 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:38.874931 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e9cd5a1a-e837-458f-b826-7578c78a4160 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:38.876308 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e9cd5a1a-e837-458f-b826-7578c78a4160 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:38.878814 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e9cd5a1a-e837-458f-b826-7578c78a4160 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:38.904765 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5018f02d-1bb7-4f53-8809-bd33203061c4 tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/21107d05-79f1-476d-b921-9548eff4f2c4" status: 200 len: 1620 microversion: 2.1 time: 0.370642 Sep 16 12:48:38.920151 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 416/789] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:38 2022] GET /compute/v2.1/servers/21107d05-79f1-476d-b921-9548eff4f2c4 => generated 1620 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:38.925413 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-fad4d810-dff9-482a-9a1b-a78baed5ef88 req-7416c5c0-2b01-403c-963c-f3c179e6ddb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c077c0ae-56e2-42f7-a0e7-32e6597062c5", "name": "network-vif-unplugged", "status": "completed", "tag": "45b8553e-f99f-4d12-8265-19759ca804ba"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:38.953040 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-fad4d810-dff9-482a-9a1b-a78baed5ef88 req-7416c5c0-2b01-403c-963c-f3c179e6ddb0 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:38.953528 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-fad4d810-dff9-482a-9a1b-a78baed5ef88 req-7416c5c0-2b01-403c-963c-f3c179e6ddb0 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:38.953965 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-fad4d810-dff9-482a-9a1b-a78baed5ef88 req-7416c5c0-2b01-403c-963c-f3c179e6ddb0 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:38.978335 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e9cd5a1a-e837-458f-b826-7578c78a4160 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:38.989655 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-fad4d810-dff9-482a-9a1b-a78baed5ef88 req-7416c5c0-2b01-403c-963c-f3c179e6ddb0 service nova] Creating event network-vif-unplugged:45b8553e-f99f-4d12-8265-19759ca804ba for instance c077c0ae-56e2-42f7-a0e7-32e6597062c5 on n-h1-858094-4 Sep 16 12:48:38.992829 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e9cd5a1a-e837-458f-b826-7578c78a4160 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1260 microversion: 2.1 time: 0.152231 Sep 16 12:48:38.995808 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 374/790] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:38 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:39.007946 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-df3c7a6b-ae7b-47bf-a2c3-44c27aab83cf tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:39.009253 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-df3c7a6b-ae7b-47bf-a2c3-44c27aab83cf tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: a1f478b9-b8e1-40a8-9232-34eb6df9ad7a] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:39.012961 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-fad4d810-dff9-482a-9a1b-a78baed5ef88 req-7416c5c0-2b01-403c-963c-f3c179e6ddb0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104700 Sep 16 12:48:39.014542 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 417/791] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:48:39.018882 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5fc9c472-d2ce-4441-9cb2-b21a9f2f7ebb tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:39.019588 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5fc9c472-d2ce-4441-9cb2-b21a9f2f7ebb tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] [instance: 8d5c44e7-c030-4a42-97fb-e838e1472456] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:39.028169 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-df3c7a6b-ae7b-47bf-a2c3-44c27aab83cf tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:39.030979 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-df3c7a6b-ae7b-47bf-a2c3-44c27aab83cf tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:39.031434 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-df3c7a6b-ae7b-47bf-a2c3-44c27aab83cf tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:39.032212 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-df3c7a6b-ae7b-47bf-a2c3-44c27aab83cf tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:39.032684 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-df3c7a6b-ae7b-47bf-a2c3-44c27aab83cf tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:39.033111 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-df3c7a6b-ae7b-47bf-a2c3-44c27aab83cf tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:39.042574 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fc9c472-d2ce-4441-9cb2-b21a9f2f7ebb tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:39.043996 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fc9c472-d2ce-4441-9cb2-b21a9f2f7ebb tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:39.047065 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fc9c472-d2ce-4441-9cb2-b21a9f2f7ebb tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:39.048720 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fc9c472-d2ce-4441-9cb2-b21a9f2f7ebb tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:39.049275 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fc9c472-d2ce-4441-9cb2-b21a9f2f7ebb tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:39.049740 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fc9c472-d2ce-4441-9cb2-b21a9f2f7ebb tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:39.457116 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-df3c7a6b-ae7b-47bf-a2c3-44c27aab83cf tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:39.464670 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:48:39.479845 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-df3c7a6b-ae7b-47bf-a2c3-44c27aab83cf tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a" status: 200 len: 1504 microversion: 2.1 time: 0.479070 Sep 16 12:48:39.482223 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 375/792] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:38 2022] GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a => generated 1504 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:39.501220 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-ea9acc10-1106-4c31-bbe9-55e270cc46b8 req-568fac9a-b46b-4939-a150-b9c92d23259c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e01ba46f-ddd1-47ae-90d9-4a187bf51b2b", "name": "network-vif-deleted", "tag": "a6fb319f-c3cf-4120-b2c2-c32144451c45"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:39.517367 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5fc9c472-d2ce-4441-9cb2-b21a9f2f7ebb tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/8d5c44e7-c030-4a42-97fb-e838e1472456" status: 200 len: 1620 microversion: 2.1 time: 0.502541 Sep 16 12:48:39.522909 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 418/793] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:39 2022] GET /compute/v2.1/servers/8d5c44e7-c030-4a42-97fb-e838e1472456 => generated 1620 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:39.525933 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-ea9acc10-1106-4c31-bbe9-55e270cc46b8 req-568fac9a-b46b-4939-a150-b9c92d23259c service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:39.529064 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-ea9acc10-1106-4c31-bbe9-55e270cc46b8 req-568fac9a-b46b-4939-a150-b9c92d23259c service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:39.529836 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-ea9acc10-1106-4c31-bbe9-55e270cc46b8 req-568fac9a-b46b-4939-a150-b9c92d23259c service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:39.537073 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-7a9ca123-7df5-4cf9-a6c2-926e3a8d7bfa req-70faf2a7-9388-410e-acc1-d002d7c0f65f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c077c0ae-56e2-42f7-a0e7-32e6597062c5", "name": "network-vif-deleted", "tag": "45b8553e-f99f-4d12-8265-19759ca804ba"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:39.559640 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7a9ca123-7df5-4cf9-a6c2-926e3a8d7bfa req-70faf2a7-9388-410e-acc1-d002d7c0f65f service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:39.565126 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7a9ca123-7df5-4cf9-a6c2-926e3a8d7bfa req-70faf2a7-9388-410e-acc1-d002d7c0f65f service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:39.565586 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7a9ca123-7df5-4cf9-a6c2-926e3a8d7bfa req-70faf2a7-9388-410e-acc1-d002d7c0f65f service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:39.580348 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-ea9acc10-1106-4c31-bbe9-55e270cc46b8 req-568fac9a-b46b-4939-a150-b9c92d23259c service nova] Creating event network-vif-deleted:a6fb319f-c3cf-4120-b2c2-c32144451c45 for instance e01ba46f-ddd1-47ae-90d9-4a187bf51b2b on n-h2-858094-4 Sep 16 12:48:39.587147 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-ea9acc10-1106-4c31-bbe9-55e270cc46b8 req-568fac9a-b46b-4939-a150-b9c92d23259c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101554 Sep 16 12:48:39.592604 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 376/794] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:48:39.604256 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-7a9ca123-7df5-4cf9-a6c2-926e3a8d7bfa req-70faf2a7-9388-410e-acc1-d002d7c0f65f service nova] Creating event network-vif-deleted:45b8553e-f99f-4d12-8265-19759ca804ba for instance c077c0ae-56e2-42f7-a0e7-32e6597062c5 on n-h1-858094-4 Sep 16 12:48:39.611397 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-7a9ca123-7df5-4cf9-a6c2-926e3a8d7bfa req-70faf2a7-9388-410e-acc1-d002d7c0f65f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087103 Sep 16 12:48:39.615196 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1d257c19-bbc5-418f-930b-08034b0e42f9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Action: 'create', calling method: .version_select at 0x7f1035f67430>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-343459161", "policies": ["anti-affinity"]}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:39.615383 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 419/795] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:48:39.628836 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-92d8902a-d011-451a-91c6-817e131bec2d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:39.632977 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-92d8902a-d011-451a-91c6-817e131bec2d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:39.645866 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92d8902a-d011-451a-91c6-817e131bec2d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:39.646376 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92d8902a-d011-451a-91c6-817e131bec2d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:39.646811 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92d8902a-d011-451a-91c6-817e131bec2d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:39.647548 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92d8902a-d011-451a-91c6-817e131bec2d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:39.647986 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92d8902a-d011-451a-91c6-817e131bec2d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:39.653486 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-1d257c19-bbc5-418f-930b-08034b0e42f9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Getting quotas for project 8c037a6456444018a6ef54314419e2f2. Resources: {'server_groups'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:48:39.654044 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92d8902a-d011-451a-91c6-817e131bec2d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:39.664276 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-1d257c19-bbc5-418f-930b-08034b0e42f9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Getting quotas for user c1928790cac542ec86add5794851f97a and project 8c037a6456444018a6ef54314419e2f2. Resources: {'server_groups'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:48:39.691959 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:48:39.811962 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-1d257c19-bbc5-418f-930b-08034b0e42f9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Getting quotas for project 8c037a6456444018a6ef54314419e2f2. Resources: {'server_groups'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:48:39.830141 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-1d257c19-bbc5-418f-930b-08034b0e42f9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Getting quotas for user c1928790cac542ec86add5794851f97a and project 8c037a6456444018a6ef54314419e2f2. Resources: {'server_groups'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:48:39.880254 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1d257c19-bbc5-418f-930b-08034b0e42f9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.285244 Sep 16 12:48:39.882681 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 377/796] 10.222.0.67 () {60 vars in 1174 bytes} [Fri Sep 16 12:48:39 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:48:39.905315 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-22906e15-1a7c-4723-a667-d0fc454d046a tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:39.921031 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-22906e15-1a7c-4723-a667-d0fc454d046a tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: e01ba46f-ddd1-47ae-90d9-4a187bf51b2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:39.952025 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-22906e15-1a7c-4723-a667-d0fc454d046a tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:39.952895 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-22906e15-1a7c-4723-a667-d0fc454d046a tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:39.953504 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-22906e15-1a7c-4723-a667-d0fc454d046a tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:39.954549 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-22906e15-1a7c-4723-a667-d0fc454d046a tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:39.955195 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-22906e15-1a7c-4723-a667-d0fc454d046a tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:39.955781 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-22906e15-1a7c-4723-a667-d0fc454d046a tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:40.028590 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-22906e15-1a7c-4723-a667-d0fc454d046a tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:40.029306 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-22906e15-1a7c-4723-a667-d0fc454d046a tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:40.029752 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-22906e15-1a7c-4723-a667-d0fc454d046a tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:40.030249 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-22906e15-1a7c-4723-a667-d0fc454d046a tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lazy-loading 'fault' on Instance uuid e01ba46f-ddd1-47ae-90d9-4a187bf51b2b {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:48:40.059560 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-92d8902a-d011-451a-91c6-817e131bec2d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:40.071984 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-92d8902a-d011-451a-91c6-817e131bec2d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1271 microversion: 2.1 time: 0.452695 Sep 16 12:48:40.087363 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 420/797] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:39 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1271 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:40.096075 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-97421220-286f-41be-a52e-da0c18b638f4 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:40.097507 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-97421220-286f-41be-a52e-da0c18b638f4 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:40.111827 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97421220-286f-41be-a52e-da0c18b638f4 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:40.114085 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97421220-286f-41be-a52e-da0c18b638f4 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:40.116315 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97421220-286f-41be-a52e-da0c18b638f4 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:40.117968 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97421220-286f-41be-a52e-da0c18b638f4 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:40.118892 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97421220-286f-41be-a52e-da0c18b638f4 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:40.124729 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97421220-286f-41be-a52e-da0c18b638f4 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:40.243014 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-22906e15-1a7c-4723-a667-d0fc454d046a tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:40.253831 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-22906e15-1a7c-4723-a667-d0fc454d046a tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/e01ba46f-ddd1-47ae-90d9-4a187bf51b2b" status: 200 len: 1304 microversion: 2.1 time: 0.369467 Sep 16 12:48:40.254423 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 378/798] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:39 2022] GET /compute/v2.1/servers/e01ba46f-ddd1-47ae-90d9-4a187bf51b2b => generated 1304 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:40.269806 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d5136205-92e0-4ecc-8b7a-7f74e9b4e36e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2017950717", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "44e9d969-be79-4b9c-97d1-8f3943b1de60"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:40.310069 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-97421220-286f-41be-a52e-da0c18b638f4 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:40.323938 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-97421220-286f-41be-a52e-da0c18b638f4 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1278 microversion: 2.1 time: 0.234499 Sep 16 12:48:40.325874 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 421/799] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:40 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1278 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:40.369368 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-d5136205-92e0-4ecc-8b7a-7f74e9b4e36e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] validate_networks() for None {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:48:40.518915 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0ea3f061-8054-4498-8f2f-a99cfd92872a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:40.520553 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0ea3f061-8054-4498-8f2f-a99cfd92872a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: a1f478b9-b8e1-40a8-9232-34eb6df9ad7a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:40.538598 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ea3f061-8054-4498-8f2f-a99cfd92872a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:40.540591 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ea3f061-8054-4498-8f2f-a99cfd92872a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:40.542380 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ea3f061-8054-4498-8f2f-a99cfd92872a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:40.543544 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ea3f061-8054-4498-8f2f-a99cfd92872a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:40.544248 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ea3f061-8054-4498-8f2f-a99cfd92872a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:40.544902 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ea3f061-8054-4498-8f2f-a99cfd92872a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:41.372612 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0ea3f061-8054-4498-8f2f-a99cfd92872a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:41.380705 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0ea3f061-8054-4498-8f2f-a99cfd92872a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a" status: 200 len: 1504 microversion: 2.1 time: 0.873897 Sep 16 12:48:41.404532 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 422/800] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:40 2022] GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a => generated 1504 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:48:41.410410 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-23b24a68-676a-4300-992e-254f4b3f1eb9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:41.411045 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-23b24a68-676a-4300-992e-254f4b3f1eb9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:41.422799 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23b24a68-676a-4300-992e-254f4b3f1eb9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:41.423458 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23b24a68-676a-4300-992e-254f4b3f1eb9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:41.423975 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23b24a68-676a-4300-992e-254f4b3f1eb9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:41.424861 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23b24a68-676a-4300-992e-254f4b3f1eb9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:41.425558 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23b24a68-676a-4300-992e-254f4b3f1eb9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:41.426452 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23b24a68-676a-4300-992e-254f4b3f1eb9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:41.595371 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-d5136205-92e0-4ecc-8b7a-7f74e9b4e36e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:48:41.596477 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-d5136205-92e0-4ecc-8b7a-7f74e9b4e36e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:48:41.597188 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-d5136205-92e0-4ecc-8b7a-7f74e9b4e36e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:48:41.597794 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-d5136205-92e0-4ecc-8b7a-7f74e9b4e36e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:48:41.598399 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-d5136205-92e0-4ecc-8b7a-7f74e9b4e36e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:48:41.657197 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d5136205-92e0-4ecc-8b7a-7f74e9b4e36e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:41.658291 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d5136205-92e0-4ecc-8b7a-7f74e9b4e36e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:41.658959 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d5136205-92e0-4ecc-8b7a-7f74e9b4e36e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:41.660074 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d5136205-92e0-4ecc-8b7a-7f74e9b4e36e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:41.660891 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d5136205-92e0-4ecc-8b7a-7f74e9b4e36e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:41.661583 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d5136205-92e0-4ecc-8b7a-7f74e9b4e36e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:41.740198 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-d5136205-92e0-4ecc-8b7a-7f74e9b4e36e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Getting quotas for project 8c037a6456444018a6ef54314419e2f2. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:48:41.748951 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-d5136205-92e0-4ecc-8b7a-7f74e9b4e36e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Getting quotas for user c1928790cac542ec86add5794851f97a and project 8c037a6456444018a6ef54314419e2f2. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:48:41.777962 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d5136205-92e0-4ecc-8b7a-7f74e9b4e36e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Going to run 2 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:48:41.780970 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d5136205-92e0-4ecc-8b7a-7f74e9b4e36e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 1bdda11e-3b22-4d78-af62-8cc9a3915a4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:48:41.819821 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-23b24a68-676a-4300-992e-254f4b3f1eb9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:41.834796 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-23b24a68-676a-4300-992e-254f4b3f1eb9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1313 microversion: 2.1 time: 0.430285 Sep 16 12:48:41.835868 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 423/801] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:41 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1313 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:41.854826 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-40306a07-d6f9-4cab-afd3-c78854297187 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:41.857725 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-40306a07-d6f9-4cab-afd3-c78854297187 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: e01ba46f-ddd1-47ae-90d9-4a187bf51b2b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:41.859381 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-d5136205-92e0-4ecc-8b7a-7f74e9b4e36e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128780) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 16 12:48:41.867802 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40306a07-d6f9-4cab-afd3-c78854297187 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:41.868360 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40306a07-d6f9-4cab-afd3-c78854297187 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:41.868805 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40306a07-d6f9-4cab-afd3-c78854297187 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:41.870063 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40306a07-d6f9-4cab-afd3-c78854297187 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:41.870514 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40306a07-d6f9-4cab-afd3-c78854297187 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:41.875319 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40306a07-d6f9-4cab-afd3-c78854297187 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:41.911280 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-d5136205-92e0-4ecc-8b7a-7f74e9b4e36e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Getting quotas for project 8c037a6456444018a6ef54314419e2f2. Resources: {'server_group_members'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:48:41.911762 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-40306a07-d6f9-4cab-afd3-c78854297187 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] HTTP exception thrown: Instance e01ba46f-ddd1-47ae-90d9-4a187bf51b2b could not be found. Sep 16 12:48:41.922940 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-40306a07-d6f9-4cab-afd3-c78854297187 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Request method failure captured: Sep 16 12:48:41.922940 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/e01ba46f-ddd1-47ae-90d9-4a187bf51b2b HTTP/1.1 Sep 16 12:48:41.922940 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:48:41.922940 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:48:41.922940 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:48:41.922940 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:48:41.922940 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:48:41.922940 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:48:41.922940 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:48:41.922940 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:48:41.922940 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHAfNfamkYff9XjWg2ezxGbAK0vGbyFfS9S6d-7riP1dxgveFnj9Pm2y1z3ZfcMqnAIylHkkDkyn5Mz2iFnulkjz1dzhgJxzCkO34Sdb26L6Tq4z2nMMp7d_MH6tVI7vv2gQD3nqH_9sirYzZQeNE-2eLG66LNbSmG2FSKjozjM6jqE Sep 16 12:48:41.922940 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:48:41.922940 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:48:41.922940 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:48:41.922940 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:48:41.922940 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:48:41.922940 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:48:41.922940 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 0709d7ec436047a39dfb8c5d92f17fa3 Sep 16 12:48:41.922940 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersAdminTestJSON-1188504796 Sep 16 12:48:41.922940 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:48:41.922940 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:48:41.924641 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0709d7ec436047a39dfb8c5d92f17fa3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0709d7ec436047a39dfb8c5d92f17fa3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0709d7ec436047a39dfb8c5d92f17fa3", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0709d7ec436047a39dfb8c5d92f17fa3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:48:41.924641 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ServersAdminTestJSON-1188504796 Sep 16 12:48:41.924641 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 0709d7ec436047a39dfb8c5d92f17fa3 Sep 16 12:48:41.924641 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersAdminTestJSON-1188504796 Sep 16 12:48:41.924641 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ServersAdminTestJSON-1188504796-project Sep 16 12:48:41.924641 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:48:41.924641 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:48:41.924641 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 8bdc5bd0969148a3ac8879ccf0f58553 Sep 16 12:48:41.924641 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ServersAdminTestJSON-1188504796-project Sep 16 12:48:41.924641 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:48:41.924641 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance e01ba46f-ddd1-47ae-90d9-4a187bf51b2b could not be found. Sep 16 12:48:41.924641 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': 'e01ba46f-ddd1-47ae-90d9-4a187bf51b2b'} Sep 16 12:48:41.925546 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:48:41.925546 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:48:41.925546 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:48:41.925546 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:48:41.925546 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:48:41.925546 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:48:41.925546 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:48:41.925546 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:48:41.925546 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:48:41.925546 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:48:41.925546 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e01ba46f-ddd1-47ae-90d9-4a187bf51b2b could not be found. Sep 16 12:48:41.925546 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:48:41.925546 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:48:41.925546 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:48:41.925546 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:48:41.925546 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:48:41.925546 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:48:41.925546 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:48:41.925546 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:48:41.925546 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:48:41.928688 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:48:41.928688 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:48:41.928688 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:48:41.928688 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:48:41.928688 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:48:41.928688 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:48:41.928688 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:48:41.928688 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e01ba46f-ddd1-47ae-90d9-4a187bf51b2b could not be found. Sep 16 12:48:41.928688 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:48:41.928688 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:48:41.928688 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:48:41.928688 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:48:41.928688 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:48:41.928688 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:48:41.928688 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:48:41.928688 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:48:41.928688 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e01ba46f-ddd1-47ae-90d9-4a187bf51b2b could not be found. Sep 16 12:48:41.928688 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:48:41.929980 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-40306a07-d6f9-4cab-afd3-c78854297187 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Returning 404 to user: Instance e01ba46f-ddd1-47ae-90d9-4a187bf51b2b could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:48:41.930066 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-d5136205-92e0-4ecc-8b7a-7f74e9b4e36e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Getting quotas for user c1928790cac542ec86add5794851f97a and project 8c037a6456444018a6ef54314419e2f2. Resources: {'server_group_members'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:48:41.930773 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-40306a07-d6f9-4cab-afd3-c78854297187 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/e01ba46f-ddd1-47ae-90d9-4a187bf51b2b" status: 404 len: 111 microversion: 2.1 time: 0.090353 Sep 16 12:48:41.935564 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 424/802] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:41 2022] GET /compute/v2.1/servers/e01ba46f-ddd1-47ae-90d9-4a187bf51b2b => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:48:41.943804 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7d666ebe-78a6-44f6-a35f-12b067ac709a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:41.944613 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7d666ebe-78a6-44f6-a35f-12b067ac709a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:41.958412 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d666ebe-78a6-44f6-a35f-12b067ac709a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:41.968842 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d666ebe-78a6-44f6-a35f-12b067ac709a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:41.969452 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d666ebe-78a6-44f6-a35f-12b067ac709a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:41.970371 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d666ebe-78a6-44f6-a35f-12b067ac709a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:41.970941 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d666ebe-78a6-44f6-a35f-12b067ac709a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:41.971536 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d666ebe-78a6-44f6-a35f-12b067ac709a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:42.028049 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-d5136205-92e0-4ecc-8b7a-7f74e9b4e36e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Getting quotas for project 8c037a6456444018a6ef54314419e2f2. Resources: {'server_group_members'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:48:42.036880 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-d5136205-92e0-4ecc-8b7a-7f74e9b4e36e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Getting quotas for user c1928790cac542ec86add5794851f97a and project 8c037a6456444018a6ef54314419e2f2. Resources: {'server_group_members'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:48:42.071942 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d5136205-92e0-4ecc-8b7a-7f74e9b4e36e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 95448444-b52b-428f-9c7c-8e0e78fc2b22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=1bdda11e-3b22-4d78-af62-8cc9a3915a4b,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:48:42.177680 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7d666ebe-78a6-44f6-a35f-12b067ac709a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:42.190680 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7d666ebe-78a6-44f6-a35f-12b067ac709a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1266 microversion: 2.1 time: 0.255795 Sep 16 12:48:42.205688 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 425/803] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:41 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:42.214013 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-828481be-3857-410c-96c1-8a13d346b89f tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:42.215202 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-828481be-3857-410c-96c1-8a13d346b89f tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: 1b320dc8-1e79-4202-8162-0a418c6b1874] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:42.222872 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-828481be-3857-410c-96c1-8a13d346b89f tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:42.223627 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-828481be-3857-410c-96c1-8a13d346b89f tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:42.224253 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-828481be-3857-410c-96c1-8a13d346b89f tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:42.226050 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-828481be-3857-410c-96c1-8a13d346b89f tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:42.226715 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-828481be-3857-410c-96c1-8a13d346b89f tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:42.227307 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-828481be-3857-410c-96c1-8a13d346b89f tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:42.233969 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:48:42.241167 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-d5136205-92e0-4ecc-8b7a-7f74e9b4e36e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Getting quotas for project 8c037a6456444018a6ef54314419e2f2. Resources: {'server_group_members'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:48:42.261559 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-d5136205-92e0-4ecc-8b7a-7f74e9b4e36e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Getting quotas for user c1928790cac542ec86add5794851f97a and project 8c037a6456444018a6ef54314419e2f2. Resources: {'server_group_members'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:48:42.270288 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-828481be-3857-410c-96c1-8a13d346b89f tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: 1b320dc8-1e79-4202-8162-0a418c6b1874] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:48:42.360089 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-d5136205-92e0-4ecc-8b7a-7f74e9b4e36e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Getting quotas for project 8c037a6456444018a6ef54314419e2f2. Resources: {'server_group_members'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:48:42.374836 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-d5136205-92e0-4ecc-8b7a-7f74e9b4e36e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Getting quotas for user c1928790cac542ec86add5794851f97a and project 8c037a6456444018a6ef54314419e2f2. Resources: {'server_group_members'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:48:42.469797 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-828481be-3857-410c-96c1-8a13d346b89f tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "DELETE /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874" status: 204 len: 0 microversion: 2.1 time: 0.262327 Sep 16 12:48:42.473034 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 426/804] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:48:42 2022] DELETE /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:48:42.492690 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9075044f-8461-4138-937f-06a36e506d40 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:42.493969 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9075044f-8461-4138-937f-06a36e506d40 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: a1f478b9-b8e1-40a8-9232-34eb6df9ad7a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:42.505436 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9075044f-8461-4138-937f-06a36e506d40 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:42.506375 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d5136205-92e0-4ecc-8b7a-7f74e9b4e36e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.250772 Sep 16 12:48:42.506561 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9075044f-8461-4138-937f-06a36e506d40 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:42.508834 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9075044f-8461-4138-937f-06a36e506d40 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:42.510214 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9075044f-8461-4138-937f-06a36e506d40 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:42.510912 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9075044f-8461-4138-937f-06a36e506d40 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:42.514518 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9075044f-8461-4138-937f-06a36e506d40 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:42.514698 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 379/805] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:48:40 2022] POST /compute/v2.1/servers => generated 32 bytes in 2257 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 16 12:48:42.518785 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fb187582-459d-44fc-9363-3d79b237f4b2 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:42.519360 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-fb187582-459d-44fc-9363-3d79b237f4b2 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: 1b320dc8-1e79-4202-8162-0a418c6b1874] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:42.540716 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fb187582-459d-44fc-9363-3d79b237f4b2 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:42.542720 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fb187582-459d-44fc-9363-3d79b237f4b2 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:42.543823 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fb187582-459d-44fc-9363-3d79b237f4b2 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:42.547811 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fb187582-459d-44fc-9363-3d79b237f4b2 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:42.549220 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fb187582-459d-44fc-9363-3d79b237f4b2 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:42.549220 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fb187582-459d-44fc-9363-3d79b237f4b2 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:43.186324 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9075044f-8461-4138-937f-06a36e506d40 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:43.199214 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9075044f-8461-4138-937f-06a36e506d40 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a" status: 200 len: 1504 microversion: 2.1 time: 0.723067 Sep 16 12:48:43.214043 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 427/806] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:42 2022] GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a => generated 1504 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:43.230236 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a09099a4-025d-43ed-8564-844b9d493aa5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:43.246923 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a09099a4-025d-43ed-8564-844b9d493aa5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:43.247968 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a09099a4-025d-43ed-8564-844b9d493aa5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Searching by: {'deleted': False, 'project_id': '8c037a6456444018a6ef54314419e2f2'} {{(pid=128779) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 12:48:43.272798 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a09099a4-025d-43ed-8564-844b9d493aa5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:43.273977 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a09099a4-025d-43ed-8564-844b9d493aa5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:43.274578 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a09099a4-025d-43ed-8564-844b9d493aa5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:43.275519 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a09099a4-025d-43ed-8564-844b9d493aa5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:43.276163 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a09099a4-025d-43ed-8564-844b9d493aa5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:43.277001 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a09099a4-025d-43ed-8564-844b9d493aa5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:43.284672 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-fb187582-459d-44fc-9363-3d79b237f4b2 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:43.298229 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-fb187582-459d-44fc-9363-3d79b237f4b2 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874" status: 200 len: 1470 microversion: 2.1 time: 0.785207 Sep 16 12:48:43.303435 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 380/807] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:42 2022] GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874 => generated 1470 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:43.308981 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.multi_cell_list [None req-a09099a4-025d-43ed-8564-844b9d493aa5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=128779) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 12:48:43.316470 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-aeb288b9-76a7-416e-bad1-2e476c61ce67 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:43.318080 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-aeb288b9-76a7-416e-bad1-2e476c61ce67 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:43.334472 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aeb288b9-76a7-416e-bad1-2e476c61ce67 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:43.335430 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aeb288b9-76a7-416e-bad1-2e476c61ce67 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:43.336483 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aeb288b9-76a7-416e-bad1-2e476c61ce67 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:43.338318 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aeb288b9-76a7-416e-bad1-2e476c61ce67 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:43.339171 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aeb288b9-76a7-416e-bad1-2e476c61ce67 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:43.340986 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aeb288b9-76a7-416e-bad1-2e476c61ce67 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:43.370376 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a09099a4-025d-43ed-8564-844b9d493aa5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 1665 microversion: 2.1 time: 0.153916 Sep 16 12:48:43.371062 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 428/808] 10.222.0.67 () {58 vars in 1125 bytes} [Fri Sep 16 12:48:43 2022] GET /compute/v2.1/servers => generated 1665 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:43.392816 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8179fe4d-92c2-4514-bc44-3dc5a5b08c24 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:43.393412 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8179fe4d-92c2-4514-bc44-3dc5a5b08c24 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:43.427638 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8179fe4d-92c2-4514-bc44-3dc5a5b08c24 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:43.428668 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8179fe4d-92c2-4514-bc44-3dc5a5b08c24 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:43.430228 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8179fe4d-92c2-4514-bc44-3dc5a5b08c24 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:43.431195 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8179fe4d-92c2-4514-bc44-3dc5a5b08c24 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:43.432763 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8179fe4d-92c2-4514-bc44-3dc5a5b08c24 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:43.434711 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8179fe4d-92c2-4514-bc44-3dc5a5b08c24 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:43.836048 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8179fe4d-92c2-4514-bc44-3dc5a5b08c24 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:43.845326 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8179fe4d-92c2-4514-bc44-3dc5a5b08c24 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1308 microversion: 2.1 time: 0.464405 Sep 16 12:48:43.846059 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 429/809] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:43 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1308 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:43.857910 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-95fb83b8-0e29-4bd1-a9e0-13f502497774 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-2066202253", "imageRef": "5f175cab-648c-4f90-afbd-b359963539b2", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "a79b9e4b-851c-466c-9c78-fcc8f1ac7081"}], "security_groups": [{"name": "tempest-securitygroup--1740064144"}], "key_name": "tempest-keypair-323052697", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:43.924654 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-aeb288b9-76a7-416e-bad1-2e476c61ce67 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:43.934411 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-aeb288b9-76a7-416e-bad1-2e476c61ce67 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1313 microversion: 2.1 time: 0.629539 Sep 16 12:48:43.943485 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 381/810] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:43 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1313 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:43.976990 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-db26c96c-2352-4dad-b333-a56e60ead0a9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:43.977916 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-db26c96c-2352-4dad-b333-a56e60ead0a9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 95448444-b52b-428f-9c7c-8e0e78fc2b22] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:43.985807 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db26c96c-2352-4dad-b333-a56e60ead0a9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:43.986567 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db26c96c-2352-4dad-b333-a56e60ead0a9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:43.987161 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db26c96c-2352-4dad-b333-a56e60ead0a9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:43.988038 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db26c96c-2352-4dad-b333-a56e60ead0a9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:43.988663 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db26c96c-2352-4dad-b333-a56e60ead0a9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:43.989258 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db26c96c-2352-4dad-b333-a56e60ead0a9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:44.157214 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-95fb83b8-0e29-4bd1-a9e0-13f502497774 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] validate_networks() for [('a79b9e4b-851c-466c-9c78-fcc8f1ac7081', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:48:44.174540 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-db26c96c-2352-4dad-b333-a56e60ead0a9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:44.183779 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-db26c96c-2352-4dad-b333-a56e60ead0a9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/95448444-b52b-428f-9c7c-8e0e78fc2b22" status: 200 len: 1223 microversion: 2.1 time: 0.210541 Sep 16 12:48:44.198805 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 382/811] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:43 2022] GET /compute/v2.1/servers/95448444-b52b-428f-9c7c-8e0e78fc2b22 => generated 1223 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:44.207159 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ee184f4d-50b5-4d82-8e99-4dfd47d1d339 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:44.208006 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ee184f4d-50b5-4d82-8e99-4dfd47d1d339 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 07365fde-3701-46a6-aba7-4c6f74e181b9] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:44.210257 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:48:44.218234 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ee184f4d-50b5-4d82-8e99-4dfd47d1d339 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:44.219261 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ee184f4d-50b5-4d82-8e99-4dfd47d1d339 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:44.219971 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ee184f4d-50b5-4d82-8e99-4dfd47d1d339 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:44.220949 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ee184f4d-50b5-4d82-8e99-4dfd47d1d339 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:44.221637 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ee184f4d-50b5-4d82-8e99-4dfd47d1d339 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:44.222292 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ee184f4d-50b5-4d82-8e99-4dfd47d1d339 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:44.264197 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ee184f4d-50b5-4d82-8e99-4dfd47d1d339 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 07365fde-3701-46a6-aba7-4c6f74e181b9] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:48:44.371446 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ee184f4d-50b5-4d82-8e99-4dfd47d1d339 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "DELETE /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9" status: 204 len: 0 microversion: 2.1 time: 0.167865 Sep 16 12:48:44.378678 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 383/812] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:48:44 2022] DELETE /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:48:44.408279 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8308eae8-289f-4712-aa58-a56632b381fb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:44.423239 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8308eae8-289f-4712-aa58-a56632b381fb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: a1f478b9-b8e1-40a8-9232-34eb6df9ad7a] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:44.448544 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8308eae8-289f-4712-aa58-a56632b381fb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:44.449691 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8308eae8-289f-4712-aa58-a56632b381fb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:44.450157 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8308eae8-289f-4712-aa58-a56632b381fb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:44.450918 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8308eae8-289f-4712-aa58-a56632b381fb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:44.453591 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8308eae8-289f-4712-aa58-a56632b381fb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:44.455787 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8308eae8-289f-4712-aa58-a56632b381fb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:44.930181 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8308eae8-289f-4712-aa58-a56632b381fb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:44.939445 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8308eae8-289f-4712-aa58-a56632b381fb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a" status: 200 len: 1504 microversion: 2.1 time: 0.558898 Sep 16 12:48:44.940044 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 384/813] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:44 2022] GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a => generated 1504 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:44.945239 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-02052a1d-cca0-48ac-a0a6-fdd68d12edd7 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:44.946060 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-02052a1d-cca0-48ac-a0a6-fdd68d12edd7 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: 1b320dc8-1e79-4202-8162-0a418c6b1874] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:44.955024 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-02052a1d-cca0-48ac-a0a6-fdd68d12edd7 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:44.955795 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-02052a1d-cca0-48ac-a0a6-fdd68d12edd7 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:44.956469 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-02052a1d-cca0-48ac-a0a6-fdd68d12edd7 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:44.957454 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-02052a1d-cca0-48ac-a0a6-fdd68d12edd7 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:44.957910 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-02052a1d-cca0-48ac-a0a6-fdd68d12edd7 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:44.958336 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-02052a1d-cca0-48ac-a0a6-fdd68d12edd7 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:45.196972 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-02052a1d-cca0-48ac-a0a6-fdd68d12edd7 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:45.206752 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-02052a1d-cca0-48ac-a0a6-fdd68d12edd7 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874" status: 200 len: 1470 microversion: 2.1 time: 0.265644 Sep 16 12:48:45.220381 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 385/814] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:44 2022] GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874 => generated 1470 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:45.220381 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-f6ae3dd9-6b88-4b60-baa5-120786e149d5 req-0eeead2d-c4c0-4988-ac2d-c5c79d092fbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6b4a601-8b6e-498e-8c17-9e689c13db74", "tag": "c82c5517-9370-47b7-870d-b1c0f066ce8a"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:45.221901 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-f6ae3dd9-6b88-4b60-baa5-120786e149d5 req-0eeead2d-c4c0-4988-ac2d-c5c79d092fbc service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:45.222861 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-f6ae3dd9-6b88-4b60-baa5-120786e149d5 req-0eeead2d-c4c0-4988-ac2d-c5c79d092fbc service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:45.223489 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-f6ae3dd9-6b88-4b60-baa5-120786e149d5 req-0eeead2d-c4c0-4988-ac2d-c5c79d092fbc service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:45.238667 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-95fb83b8-0e29-4bd1-a9e0-13f502497774 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:48:45.239099 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-95fb83b8-0e29-4bd1-a9e0-13f502497774 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:48:45.239553 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-95fb83b8-0e29-4bd1-a9e0-13f502497774 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:48:45.239968 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-95fb83b8-0e29-4bd1-a9e0-13f502497774 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:48:45.240547 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-f6ae3dd9-6b88-4b60-baa5-120786e149d5 req-0eeead2d-c4c0-4988-ac2d-c5c79d092fbc service nova] Creating event network-changed:c82c5517-9370-47b7-870d-b1c0f066ce8a for instance c6b4a601-8b6e-498e-8c17-9e689c13db74 on n-h1-858094-4 Sep 16 12:48:45.240703 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-95fb83b8-0e29-4bd1-a9e0-13f502497774 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:48:45.246342 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-f6ae3dd9-6b88-4b60-baa5-120786e149d5 req-0eeead2d-c4c0-4988-ac2d-c5c79d092fbc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037694 Sep 16 12:48:45.247205 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 386/815] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:48:45.251472 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-95fb83b8-0e29-4bd1-a9e0-13f502497774 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:45.251970 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-95fb83b8-0e29-4bd1-a9e0-13f502497774 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:45.252426 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-95fb83b8-0e29-4bd1-a9e0-13f502497774 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:45.253156 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-95fb83b8-0e29-4bd1-a9e0-13f502497774 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:45.253627 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-95fb83b8-0e29-4bd1-a9e0-13f502497774 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:45.254037 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-95fb83b8-0e29-4bd1-a9e0-13f502497774 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:45.254183 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6a763ea1-df23-4a75-b392-eb0b2681e082 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1863538698", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "1350934749", "adminPass": "***", "networks": [{"uuid": "eb8add18-d929-45d2-acc9-197a8391e875"}], "security_groups": [{"name": "tempest-securitygroup--1951644033"}], "key_name": "tempest-keypair-1023851508", "user_data": "}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:45.271448 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-95fb83b8-0e29-4bd1-a9e0-13f502497774 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Getting quotas for project 97a3e6c179c6495281c2816a1e18aa7e. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:48:45.280465 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-95fb83b8-0e29-4bd1-a9e0-13f502497774 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Getting quotas for user 687fd28118c342529cda410e9587dfd0 and project 97a3e6c179c6495281c2816a1e18aa7e. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:48:45.284003 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:48:45.298987 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-95fb83b8-0e29-4bd1-a9e0-13f502497774 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:48:45.304688 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-95fb83b8-0e29-4bd1-a9e0-13f502497774 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5f175cab-648c-4f90-afbd-b359963539b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:48:45.359321 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-95fb83b8-0e29-4bd1-a9e0-13f502497774 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.506282 Sep 16 12:48:45.360839 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 430/816] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:48:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 1509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:48:45.365597 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-9906a0d7-52bd-4dab-b684-dd9026dc6eb6 req-23ddfd8c-9a95-4b25-9e0f-5f4f2e7fc287 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dacfa868-1c8b-4918-8797-f31caee29361", "tag": "fabffdb4-d14b-4b3e-bbe3-09f69928ff1e"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:45.377455 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9906a0d7-52bd-4dab-b684-dd9026dc6eb6 req-23ddfd8c-9a95-4b25-9e0f-5f4f2e7fc287 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:45.378223 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9906a0d7-52bd-4dab-b684-dd9026dc6eb6 req-23ddfd8c-9a95-4b25-9e0f-5f4f2e7fc287 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:45.378838 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9906a0d7-52bd-4dab-b684-dd9026dc6eb6 req-23ddfd8c-9a95-4b25-9e0f-5f4f2e7fc287 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:45.386430 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-6a763ea1-df23-4a75-b392-eb0b2681e082 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] validate_networks() for [('eb8add18-d929-45d2-acc9-197a8391e875', None, None, None, None, None)] {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:48:45.389941 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-9906a0d7-52bd-4dab-b684-dd9026dc6eb6 req-23ddfd8c-9a95-4b25-9e0f-5f4f2e7fc287 service nova] Creating event network-changed:fabffdb4-d14b-4b3e-bbe3-09f69928ff1e for instance dacfa868-1c8b-4918-8797-f31caee29361 on n-h1-858094-4 Sep 16 12:48:45.395487 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-9906a0d7-52bd-4dab-b684-dd9026dc6eb6 req-23ddfd8c-9a95-4b25-9e0f-5f4f2e7fc287 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033246 Sep 16 12:48:45.396468 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 431/817] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:48:45.401825 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0f8e39e0-51a6-4203-9ec7-62b27ca3efc9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:45.402716 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0f8e39e0-51a6-4203-9ec7-62b27ca3efc9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:45.410622 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f8e39e0-51a6-4203-9ec7-62b27ca3efc9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:45.411127 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f8e39e0-51a6-4203-9ec7-62b27ca3efc9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:45.411762 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f8e39e0-51a6-4203-9ec7-62b27ca3efc9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:45.412657 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f8e39e0-51a6-4203-9ec7-62b27ca3efc9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:45.413262 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f8e39e0-51a6-4203-9ec7-62b27ca3efc9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:45.413914 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f8e39e0-51a6-4203-9ec7-62b27ca3efc9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:45.678533 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0f8e39e0-51a6-4203-9ec7-62b27ca3efc9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:45.688161 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0f8e39e0-51a6-4203-9ec7-62b27ca3efc9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1308 microversion: 2.1 time: 0.290393 Sep 16 12:48:45.689567 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 432/818] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:45 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1308 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:45.705615 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4c2100d5-7a15-4cc0-b7d1-1cd69fda63f2 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2087428797", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "3300d86a-7270-4b5f-bde5-4572289b9372"}], "security_groups": [{"name": "tempest-securitygroup--170165621"}], "key_name": "tempest-keypair-1319627263", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:46.630459 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-4c2100d5-7a15-4cc0-b7d1-1cd69fda63f2 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] validate_networks() for [('3300d86a-7270-4b5f-bde5-4572289b9372', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:48:46.937652 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-6a763ea1-df23-4a75-b392-eb0b2681e082 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:48:46.938232 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-6a763ea1-df23-4a75-b392-eb0b2681e082 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:48:46.938751 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-6a763ea1-df23-4a75-b392-eb0b2681e082 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:48:46.939409 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-6a763ea1-df23-4a75-b392-eb0b2681e082 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:48:46.940281 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-6a763ea1-df23-4a75-b392-eb0b2681e082 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:48:46.958181 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6a763ea1-df23-4a75-b392-eb0b2681e082 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:46.960734 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6a763ea1-df23-4a75-b392-eb0b2681e082 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:46.963365 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6a763ea1-df23-4a75-b392-eb0b2681e082 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:46.964888 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6a763ea1-df23-4a75-b392-eb0b2681e082 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:46.969192 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6a763ea1-df23-4a75-b392-eb0b2681e082 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:46.969844 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6a763ea1-df23-4a75-b392-eb0b2681e082 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:47.005601 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-6a763ea1-df23-4a75-b392-eb0b2681e082 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Getting quotas for project 7058e9e184834c39a5a299f481a6e62e. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:48:47.013561 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-6a763ea1-df23-4a75-b392-eb0b2681e082 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Getting quotas for user 709f71c239ca40b8b958038c9ab16f37 and project 7058e9e184834c39a5a299f481a6e62e. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:48:47.029370 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6a763ea1-df23-4a75-b392-eb0b2681e082 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:48:47.033336 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6a763ea1-df23-4a75-b392-eb0b2681e082 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 38d079dd-9676-45f7-b286-16aa78d487bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:48:47.134353 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6a763ea1-df23-4a75-b392-eb0b2681e082 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.885753 Sep 16 12:48:47.146130 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 387/819] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:48:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 1898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:48:47.153337 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-69b1d13e-582f-48b6-9040-a9d99c622ea1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:47.154153 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-69b1d13e-582f-48b6-9040-a9d99c622ea1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:47.161861 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-69b1d13e-582f-48b6-9040-a9d99c622ea1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:47.162650 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-69b1d13e-582f-48b6-9040-a9d99c622ea1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:47.164558 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-69b1d13e-582f-48b6-9040-a9d99c622ea1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:47.166441 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-69b1d13e-582f-48b6-9040-a9d99c622ea1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:47.167393 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-69b1d13e-582f-48b6-9040-a9d99c622ea1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:47.168096 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-69b1d13e-582f-48b6-9040-a9d99c622ea1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:48.100220 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-69b1d13e-582f-48b6-9040-a9d99c622ea1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:48.112760 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-69b1d13e-582f-48b6-9040-a9d99c622ea1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1313 microversion: 2.1 time: 0.964449 Sep 16 12:48:48.152642 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 388/820] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:47 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1313 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:48.159517 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e0fca53e-2d2d-4a98-9e33-02cb9a0e024c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:48.160722 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e0fca53e-2d2d-4a98-9e33-02cb9a0e024c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 95448444-b52b-428f-9c7c-8e0e78fc2b22] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:48.168062 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e0fca53e-2d2d-4a98-9e33-02cb9a0e024c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:48.169126 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e0fca53e-2d2d-4a98-9e33-02cb9a0e024c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:48.169722 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e0fca53e-2d2d-4a98-9e33-02cb9a0e024c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:48.170441 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e0fca53e-2d2d-4a98-9e33-02cb9a0e024c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:48.171652 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e0fca53e-2d2d-4a98-9e33-02cb9a0e024c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:48.172248 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e0fca53e-2d2d-4a98-9e33-02cb9a0e024c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:49.430929 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-4c2100d5-7a15-4cc0-b7d1-1cd69fda63f2 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Getting quotas for project 3e3e2fe65ad744a2ba3b757f42f1d07b. Resources: dict_keys(['metadata_items']) {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:48:49.441588 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-4c2100d5-7a15-4cc0-b7d1-1cd69fda63f2 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Getting quotas for user 3cd06a287a6b48f5a8a5ac30c0159fd9 and project 3e3e2fe65ad744a2ba3b757f42f1d07b. Resources: dict_keys(['metadata_items']) {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:48:49.479488 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-4c2100d5-7a15-4cc0-b7d1-1cd69fda63f2 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:48:49.487776 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-4c2100d5-7a15-4cc0-b7d1-1cd69fda63f2 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:48:49.488561 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-4c2100d5-7a15-4cc0-b7d1-1cd69fda63f2 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:48:49.489131 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-4c2100d5-7a15-4cc0-b7d1-1cd69fda63f2 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:48:49.489717 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-4c2100d5-7a15-4cc0-b7d1-1cd69fda63f2 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:48:49.508931 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c2100d5-7a15-4cc0-b7d1-1cd69fda63f2 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:49.510553 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c2100d5-7a15-4cc0-b7d1-1cd69fda63f2 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:49.512562 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c2100d5-7a15-4cc0-b7d1-1cd69fda63f2 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:49.523270 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c2100d5-7a15-4cc0-b7d1-1cd69fda63f2 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:49.524037 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c2100d5-7a15-4cc0-b7d1-1cd69fda63f2 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:49.525425 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c2100d5-7a15-4cc0-b7d1-1cd69fda63f2 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:49.564890 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-4c2100d5-7a15-4cc0-b7d1-1cd69fda63f2 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Getting quotas for project 3e3e2fe65ad744a2ba3b757f42f1d07b. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:48:49.577605 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-4c2100d5-7a15-4cc0-b7d1-1cd69fda63f2 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Getting quotas for user 3cd06a287a6b48f5a8a5ac30c0159fd9 and project 3e3e2fe65ad744a2ba3b757f42f1d07b. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:48:49.610412 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4c2100d5-7a15-4cc0-b7d1-1cd69fda63f2 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:48:49.622907 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4c2100d5-7a15-4cc0-b7d1-1cd69fda63f2 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] [instance: 8983b634-6da4-4830-b0f1-5835cc55083e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:48:49.735057 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4c2100d5-7a15-4cc0-b7d1-1cd69fda63f2 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 4.044051 Sep 16 12:48:49.738294 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 433/821] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:48:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 4048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:48:49.750877 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9f990f97-d52e-4f46-88b9-e4a9a0b11ed0 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:49.755804 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9f990f97-d52e-4f46-88b9-e4a9a0b11ed0 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:49.765337 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f990f97-d52e-4f46-88b9-e4a9a0b11ed0 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:49.766097 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f990f97-d52e-4f46-88b9-e4a9a0b11ed0 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:49.766848 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f990f97-d52e-4f46-88b9-e4a9a0b11ed0 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:49.768443 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f990f97-d52e-4f46-88b9-e4a9a0b11ed0 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:49.769223 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f990f97-d52e-4f46-88b9-e4a9a0b11ed0 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:49.769841 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f990f97-d52e-4f46-88b9-e4a9a0b11ed0 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:49.972485 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e0fca53e-2d2d-4a98-9e33-02cb9a0e024c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:49.983974 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e0fca53e-2d2d-4a98-9e33-02cb9a0e024c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/95448444-b52b-428f-9c7c-8e0e78fc2b22" status: 200 len: 1319 microversion: 2.1 time: 1.830234 Sep 16 12:48:49.988639 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 389/822] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:48 2022] GET /compute/v2.1/servers/95448444-b52b-428f-9c7c-8e0e78fc2b22 => generated 1319 bytes in 1836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:49.994384 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-125f741c-58b0-4037-9054-1995b24ed414 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:49.995814 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9f990f97-d52e-4f46-88b9-e4a9a0b11ed0 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fd28118c342529cda410e9587dfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a3e6c179c6495281c2816a1e18aa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:50.007957 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-125f741c-58b0-4037-9054-1995b24ed414 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: a1f478b9-b8e1-40a8-9232-34eb6df9ad7a] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:50.012387 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9f990f97-d52e-4f46-88b9-e4a9a0b11ed0 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0" status: 200 len: 1303 microversion: 2.1 time: 0.272837 Sep 16 12:48:50.013249 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 434/823] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:49 2022] GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 => generated 1303 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:50.035625 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-125f741c-58b0-4037-9054-1995b24ed414 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:50.041394 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-125f741c-58b0-4037-9054-1995b24ed414 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:50.042863 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-125f741c-58b0-4037-9054-1995b24ed414 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:50.046928 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-853357ac-3670-40a8-a926-19df6653bbe5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:50.047613 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-125f741c-58b0-4037-9054-1995b24ed414 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:50.049301 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-125f741c-58b0-4037-9054-1995b24ed414 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:50.051436 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-125f741c-58b0-4037-9054-1995b24ed414 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:50.052461 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-853357ac-3670-40a8-a926-19df6653bbe5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: 1b320dc8-1e79-4202-8162-0a418c6b1874] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:50.065251 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-853357ac-3670-40a8-a926-19df6653bbe5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:50.065992 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-853357ac-3670-40a8-a926-19df6653bbe5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:50.068247 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-853357ac-3670-40a8-a926-19df6653bbe5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:50.069758 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-853357ac-3670-40a8-a926-19df6653bbe5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:50.070448 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-853357ac-3670-40a8-a926-19df6653bbe5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:50.072968 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-853357ac-3670-40a8-a926-19df6653bbe5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:50.494701 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-853357ac-3670-40a8-a926-19df6653bbe5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:50.505384 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-853357ac-3670-40a8-a926-19df6653bbe5 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874" status: 200 len: 1428 microversion: 2.1 time: 0.478480 Sep 16 12:48:50.522305 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 435/824] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:50 2022] GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874 => generated 1428 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:50.527946 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fc8ccf18-0d7f-482f-8446-d87f30de6527 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:50.530756 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fc8ccf18-0d7f-482f-8446-d87f30de6527 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:50.537199 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc8ccf18-0d7f-482f-8446-d87f30de6527 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:50.537929 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc8ccf18-0d7f-482f-8446-d87f30de6527 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:50.539338 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc8ccf18-0d7f-482f-8446-d87f30de6527 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:50.540817 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc8ccf18-0d7f-482f-8446-d87f30de6527 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:50.541773 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc8ccf18-0d7f-482f-8446-d87f30de6527 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:50.542398 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc8ccf18-0d7f-482f-8446-d87f30de6527 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:50.738616 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-125f741c-58b0-4037-9054-1995b24ed414 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:50.752078 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-125f741c-58b0-4037-9054-1995b24ed414 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a" status: 200 len: 1504 microversion: 2.1 time: 0.761890 Sep 16 12:48:50.754177 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 390/825] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:49 2022] GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a => generated 1504 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:50.759720 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-7d62e289-f17b-4147-b09d-ddc58730a78e req-b2015dea-3ff0-4711-8a2d-4f9c9a0ed1a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b320dc8-1e79-4202-8162-0a418c6b1874", "name": "network-vif-unplugged", "status": "completed", "tag": "cbbe2856-820c-4bc2-9d0e-6836f1fe0f7c"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:50.772216 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-7d62e289-f17b-4147-b09d-ddc58730a78e req-b2015dea-3ff0-4711-8a2d-4f9c9a0ed1a9 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:50.773091 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-7d62e289-f17b-4147-b09d-ddc58730a78e req-b2015dea-3ff0-4711-8a2d-4f9c9a0ed1a9 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:50.773995 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-7d62e289-f17b-4147-b09d-ddc58730a78e req-b2015dea-3ff0-4711-8a2d-4f9c9a0ed1a9 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:50.789584 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-7d62e289-f17b-4147-b09d-ddc58730a78e req-b2015dea-3ff0-4711-8a2d-4f9c9a0ed1a9 service nova] Creating event network-vif-unplugged:cbbe2856-820c-4bc2-9d0e-6836f1fe0f7c for instance 1b320dc8-1e79-4202-8162-0a418c6b1874 on n-h1-858094-4 Sep 16 12:48:50.796505 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-7d62e289-f17b-4147-b09d-ddc58730a78e req-b2015dea-3ff0-4711-8a2d-4f9c9a0ed1a9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040758 Sep 16 12:48:50.797593 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 391/826] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:48:50.815304 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b5234235-99c4-4868-843b-189a8125c6c6 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:50.817331 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b5234235-99c4-4868-843b-189a8125c6c6 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 38d079dd-9676-45f7-b286-16aa78d487bf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:50.828220 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b5234235-99c4-4868-843b-189a8125c6c6 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:50.829827 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b5234235-99c4-4868-843b-189a8125c6c6 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:50.831159 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b5234235-99c4-4868-843b-189a8125c6c6 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:50.832147 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b5234235-99c4-4868-843b-189a8125c6c6 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:50.833524 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b5234235-99c4-4868-843b-189a8125c6c6 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:50.834989 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b5234235-99c4-4868-843b-189a8125c6c6 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:51.063374 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fc8ccf18-0d7f-482f-8446-d87f30de6527 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:51.074864 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fc8ccf18-0d7f-482f-8446-d87f30de6527 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1308 microversion: 2.1 time: 0.548684 Sep 16 12:48:51.075844 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 436/827] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:50 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1308 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:51.080710 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-e54486c6-5970-41d9-b248-f963b876b807 req-9b3ba66b-a246-4c2f-b9eb-84680465c4f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95448444-b52b-428f-9c7c-8e0e78fc2b22", "tag": "1c5c05cf-4ab1-4beb-b208-fb0941341532"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:51.110686 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e54486c6-5970-41d9-b248-f963b876b807 req-9b3ba66b-a246-4c2f-b9eb-84680465c4f2 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:51.111446 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e54486c6-5970-41d9-b248-f963b876b807 req-9b3ba66b-a246-4c2f-b9eb-84680465c4f2 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:51.113091 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e54486c6-5970-41d9-b248-f963b876b807 req-9b3ba66b-a246-4c2f-b9eb-84680465c4f2 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:51.132294 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-e54486c6-5970-41d9-b248-f963b876b807 req-9b3ba66b-a246-4c2f-b9eb-84680465c4f2 service nova] Creating event network-changed:1c5c05cf-4ab1-4beb-b208-fb0941341532 for instance 95448444-b52b-428f-9c7c-8e0e78fc2b22 on n-h2-858094-4 Sep 16 12:48:51.159263 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-e54486c6-5970-41d9-b248-f963b876b807 req-9b3ba66b-a246-4c2f-b9eb-84680465c4f2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081913 Sep 16 12:48:51.160043 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 437/828] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:48:51.164987 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e10840b7-e0f7-4446-943d-f0ce037fb2ec tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:51.168042 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e10840b7-e0f7-4446-943d-f0ce037fb2ec tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:51.178629 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e10840b7-e0f7-4446-943d-f0ce037fb2ec tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:51.180413 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e10840b7-e0f7-4446-943d-f0ce037fb2ec tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:51.182133 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e10840b7-e0f7-4446-943d-f0ce037fb2ec tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:51.183158 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e10840b7-e0f7-4446-943d-f0ce037fb2ec tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:51.184482 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e10840b7-e0f7-4446-943d-f0ce037fb2ec tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:51.185705 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e10840b7-e0f7-4446-943d-f0ce037fb2ec tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:51.380796 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-b5234235-99c4-4868-843b-189a8125c6c6 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709f71c239ca40b8b958038c9ab16f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7058e9e184834c39a5a299f481a6e62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:51.390579 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b5234235-99c4-4868-843b-189a8125c6c6 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "GET /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf" status: 200 len: 1391 microversion: 2.1 time: 0.591632 Sep 16 12:48:51.407429 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 392/829] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:50 2022] GET /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf => generated 1391 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:51.413897 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-cfdf17c1-6ba7-4459-9e0f-d7655b001de5 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:51.414881 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-cfdf17c1-6ba7-4459-9e0f-d7655b001de5 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] [instance: 8983b634-6da4-4830-b0f1-5835cc55083e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:51.422671 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cfdf17c1-6ba7-4459-9e0f-d7655b001de5 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:51.423406 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cfdf17c1-6ba7-4459-9e0f-d7655b001de5 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:51.424053 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cfdf17c1-6ba7-4459-9e0f-d7655b001de5 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:51.425258 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cfdf17c1-6ba7-4459-9e0f-d7655b001de5 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:51.426090 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cfdf17c1-6ba7-4459-9e0f-d7655b001de5 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:51.426633 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cfdf17c1-6ba7-4459-9e0f-d7655b001de5 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:51.590505 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-cfdf17c1-6ba7-4459-9e0f-d7655b001de5 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd06a287a6b48f5a8a5ac30c0159fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3e2fe65ad744a2ba3b757f42f1d07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:51.601357 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-cfdf17c1-6ba7-4459-9e0f-d7655b001de5 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] 10.222.0.67 "GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e" status: 200 len: 1322 microversion: 2.1 time: 0.192191 Sep 16 12:48:51.602696 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 393/830] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:51 2022] GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:51.610279 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-5967ac28-6a43-42a2-903f-1458ce3f3079 req-4db3ed7b-c057-4e4f-ab45-6543d11f3b1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b320dc8-1e79-4202-8162-0a418c6b1874", "name": "network-vif-deleted", "tag": "cbbe2856-820c-4bc2-9d0e-6836f1fe0f7c"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:51.625084 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-5967ac28-6a43-42a2-903f-1458ce3f3079 req-4db3ed7b-c057-4e4f-ab45-6543d11f3b1f service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:51.626272 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-5967ac28-6a43-42a2-903f-1458ce3f3079 req-4db3ed7b-c057-4e4f-ab45-6543d11f3b1f service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:51.627068 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-5967ac28-6a43-42a2-903f-1458ce3f3079 req-4db3ed7b-c057-4e4f-ab45-6543d11f3b1f service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:51.644324 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-5967ac28-6a43-42a2-903f-1458ce3f3079 req-4db3ed7b-c057-4e4f-ab45-6543d11f3b1f service nova] Creating event network-vif-deleted:cbbe2856-820c-4bc2-9d0e-6836f1fe0f7c for instance 1b320dc8-1e79-4202-8162-0a418c6b1874 on n-h1-858094-4 Sep 16 12:48:51.651460 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-5967ac28-6a43-42a2-903f-1458ce3f3079 req-4db3ed7b-c057-4e4f-ab45-6543d11f3b1f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046566 Sep 16 12:48:51.652543 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 394/831] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:48:51.657740 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-32ce3d9f-9ba2-40c0-953b-a22416e3188b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:51.658565 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-32ce3d9f-9ba2-40c0-953b-a22416e3188b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 95448444-b52b-428f-9c7c-8e0e78fc2b22] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:51.665302 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-32ce3d9f-9ba2-40c0-953b-a22416e3188b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:51.666715 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-32ce3d9f-9ba2-40c0-953b-a22416e3188b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:51.667229 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-32ce3d9f-9ba2-40c0-953b-a22416e3188b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:51.668067 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-32ce3d9f-9ba2-40c0-953b-a22416e3188b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:51.668550 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-32ce3d9f-9ba2-40c0-953b-a22416e3188b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:51.669263 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-32ce3d9f-9ba2-40c0-953b-a22416e3188b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:51.689682 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:48:51.700895 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e10840b7-e0f7-4446-943d-f0ce037fb2ec tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:51.736679 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e10840b7-e0f7-4446-943d-f0ce037fb2ec tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1313 microversion: 2.1 time: 0.575304 Sep 16 12:48:51.740160 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 438/832] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:51 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1313 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:51.756157 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-00554077-f701-4926-b90e-c587c4d12e9e tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:51.757090 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-00554077-f701-4926-b90e-c587c4d12e9e tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:51.768086 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-00554077-f701-4926-b90e-c587c4d12e9e tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:51.768745 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-00554077-f701-4926-b90e-c587c4d12e9e tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:51.769365 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-00554077-f701-4926-b90e-c587c4d12e9e tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:51.772877 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-00554077-f701-4926-b90e-c587c4d12e9e tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:51.776719 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-00554077-f701-4926-b90e-c587c4d12e9e tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:51.777372 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-00554077-f701-4926-b90e-c587c4d12e9e tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:52.251158 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-32ce3d9f-9ba2-40c0-953b-a22416e3188b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:52.263137 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-32ce3d9f-9ba2-40c0-953b-a22416e3188b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/95448444-b52b-428f-9c7c-8e0e78fc2b22" status: 200 len: 1319 microversion: 2.1 time: 0.609143 Sep 16 12:48:52.263747 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 395/833] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:51 2022] GET /compute/v2.1/servers/95448444-b52b-428f-9c7c-8e0e78fc2b22 => generated 1319 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:52.272379 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-93bb6ec7-ac0d-46ba-abcd-aa9390b630e2 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:52.273001 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-93bb6ec7-ac0d-46ba-abcd-aa9390b630e2 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: 1b320dc8-1e79-4202-8162-0a418c6b1874] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:52.280405 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-93bb6ec7-ac0d-46ba-abcd-aa9390b630e2 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:52.280896 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-93bb6ec7-ac0d-46ba-abcd-aa9390b630e2 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:52.281330 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-93bb6ec7-ac0d-46ba-abcd-aa9390b630e2 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:52.282027 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-93bb6ec7-ac0d-46ba-abcd-aa9390b630e2 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:52.283223 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-93bb6ec7-ac0d-46ba-abcd-aa9390b630e2 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:52.283812 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-93bb6ec7-ac0d-46ba-abcd-aa9390b630e2 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:52.314552 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-00554077-f701-4926-b90e-c587c4d12e9e tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fd28118c342529cda410e9587dfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a3e6c179c6495281c2816a1e18aa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:52.323168 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-00554077-f701-4926-b90e-c587c4d12e9e tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0" status: 200 len: 1371 microversion: 2.1 time: 0.581889 Sep 16 12:48:52.323756 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 439/834] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:51 2022] GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 => generated 1371 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:52.328857 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-42bbc6c0-39d6-4c49-833d-8b835f7b3e10 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:52.329520 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-42bbc6c0-39d6-4c49-833d-8b835f7b3e10 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: a1f478b9-b8e1-40a8-9232-34eb6df9ad7a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:52.349412 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-42bbc6c0-39d6-4c49-833d-8b835f7b3e10 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:52.349543 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-42bbc6c0-39d6-4c49-833d-8b835f7b3e10 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:52.349873 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-42bbc6c0-39d6-4c49-833d-8b835f7b3e10 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:52.350573 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-42bbc6c0-39d6-4c49-833d-8b835f7b3e10 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:52.354851 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-42bbc6c0-39d6-4c49-833d-8b835f7b3e10 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:52.355516 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-42bbc6c0-39d6-4c49-833d-8b835f7b3e10 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:52.424265 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-93bb6ec7-ac0d-46ba-abcd-aa9390b630e2 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:52.435899 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-93bb6ec7-ac0d-46ba-abcd-aa9390b630e2 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874" status: 200 len: 1299 microversion: 2.1 time: 0.170867 Sep 16 12:48:52.450000 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 396/835] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:52 2022] GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874 => generated 1299 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:52.459652 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-09cbaaa7-d0fc-4890-985e-6dc41048839e tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:52.460935 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-09cbaaa7-d0fc-4890-985e-6dc41048839e tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:52.467629 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-09cbaaa7-d0fc-4890-985e-6dc41048839e tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:52.468489 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-09cbaaa7-d0fc-4890-985e-6dc41048839e tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:52.469173 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-09cbaaa7-d0fc-4890-985e-6dc41048839e tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:52.470173 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-09cbaaa7-d0fc-4890-985e-6dc41048839e tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:52.470979 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-09cbaaa7-d0fc-4890-985e-6dc41048839e tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:52.471649 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-09cbaaa7-d0fc-4890-985e-6dc41048839e tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:52.626130 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-42bbc6c0-39d6-4c49-833d-8b835f7b3e10 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:52.636535 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-42bbc6c0-39d6-4c49-833d-8b835f7b3e10 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a" status: 200 len: 1479 microversion: 2.1 time: 0.311096 Sep 16 12:48:52.642554 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 440/836] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:52 2022] GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a => generated 1479 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:52.647995 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0175d8be-98c1-48eb-b58c-f981fb180fb0 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:52.650757 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0175d8be-98c1-48eb-b58c-f981fb180fb0 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 38d079dd-9676-45f7-b286-16aa78d487bf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:52.662640 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0175d8be-98c1-48eb-b58c-f981fb180fb0 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:52.663412 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0175d8be-98c1-48eb-b58c-f981fb180fb0 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:52.664032 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0175d8be-98c1-48eb-b58c-f981fb180fb0 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:52.664919 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0175d8be-98c1-48eb-b58c-f981fb180fb0 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:52.666291 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0175d8be-98c1-48eb-b58c-f981fb180fb0 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:52.667275 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0175d8be-98c1-48eb-b58c-f981fb180fb0 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:52.669733 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-09cbaaa7-d0fc-4890-985e-6dc41048839e tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:52.682361 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-09cbaaa7-d0fc-4890-985e-6dc41048839e tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1308 microversion: 2.1 time: 0.230880 Sep 16 12:48:52.697538 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 397/837] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:52 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1308 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:52.705263 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2dc7be27-38f6-4881-8fc2-73d0b0b9bfdd tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:52.706278 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-2dc7be27-38f6-4881-8fc2-73d0b0b9bfdd tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] [instance: 8983b634-6da4-4830-b0f1-5835cc55083e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:52.712862 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2dc7be27-38f6-4881-8fc2-73d0b0b9bfdd tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:52.713635 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2dc7be27-38f6-4881-8fc2-73d0b0b9bfdd tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:52.714264 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2dc7be27-38f6-4881-8fc2-73d0b0b9bfdd tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:52.715189 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2dc7be27-38f6-4881-8fc2-73d0b0b9bfdd tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:52.715832 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2dc7be27-38f6-4881-8fc2-73d0b0b9bfdd tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:52.716521 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2dc7be27-38f6-4881-8fc2-73d0b0b9bfdd tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:52.815810 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-2dc7be27-38f6-4881-8fc2-73d0b0b9bfdd tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd06a287a6b48f5a8a5ac30c0159fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3e2fe65ad744a2ba3b757f42f1d07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:52.829311 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2dc7be27-38f6-4881-8fc2-73d0b0b9bfdd tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] 10.222.0.67 "GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e" status: 200 len: 1328 microversion: 2.1 time: 0.130416 Sep 16 12:48:52.829918 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 398/838] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:52 2022] GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e => generated 1328 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:52.837503 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0746186e-b320-4ff0-b98e-52b2f06f49b4 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Calling method '.version_select at 0x7f1035afd3a0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:52.860062 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0746186e-b320-4ff0-b98e-52b2f06f49b4 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:52.860711 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0746186e-b320-4ff0-b98e-52b2f06f49b4 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:52.861178 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0746186e-b320-4ff0-b98e-52b2f06f49b4 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:52.872038 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0746186e-b320-4ff0-b98e-52b2f06f49b4 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] 10.222.0.67 "GET /compute/v2.1/os-migrations" status: 200 len: 1175 microversion: 2.1 time: 0.041045 Sep 16 12:48:52.872759 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 399/839] 10.222.0.67 () {58 vars in 1143 bytes} [Fri Sep 16 12:48:52 2022] GET /compute/v2.1/os-migrations => generated 1175 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:52.886570 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c9182340-f4c9-4ba6-bfcc-fb348b3270c0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:52.891428 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c9182340-f4c9-4ba6-bfcc-fb348b3270c0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:52.905225 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c9182340-f4c9-4ba6-bfcc-fb348b3270c0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:52.920941 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c9182340-f4c9-4ba6-bfcc-fb348b3270c0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:52.923424 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c9182340-f4c9-4ba6-bfcc-fb348b3270c0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:52.924395 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c9182340-f4c9-4ba6-bfcc-fb348b3270c0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:52.926632 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c9182340-f4c9-4ba6-bfcc-fb348b3270c0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:52.927269 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c9182340-f4c9-4ba6-bfcc-fb348b3270c0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:52.934778 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0175d8be-98c1-48eb-b58c-f981fb180fb0 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709f71c239ca40b8b958038c9ab16f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7058e9e184834c39a5a299f481a6e62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:52.949758 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0175d8be-98c1-48eb-b58c-f981fb180fb0 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "GET /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf" status: 200 len: 1391 microversion: 2.1 time: 0.311152 Sep 16 12:48:52.951319 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 441/840] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:52 2022] GET /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf => generated 1391 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:52.956738 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-aecfbec4-1dbe-4c53-a727-6bda8e84c091 req-af0bd7c6-afd1-45d9-9a55-052d572c8f14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07365fde-3701-46a6-aba7-4c6f74e181b9", "name": "network-vif-unplugged", "status": "completed", "tag": "57df8d9f-a9ff-49ba-a0ec-5581bc6e7cb6"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:52.969875 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-aecfbec4-1dbe-4c53-a727-6bda8e84c091 req-af0bd7c6-afd1-45d9-9a55-052d572c8f14 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:52.970642 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-aecfbec4-1dbe-4c53-a727-6bda8e84c091 req-af0bd7c6-afd1-45d9-9a55-052d572c8f14 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:52.971405 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-aecfbec4-1dbe-4c53-a727-6bda8e84c091 req-af0bd7c6-afd1-45d9-9a55-052d572c8f14 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:52.987320 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-aecfbec4-1dbe-4c53-a727-6bda8e84c091 req-af0bd7c6-afd1-45d9-9a55-052d572c8f14 service nova] Creating event network-vif-unplugged:57df8d9f-a9ff-49ba-a0ec-5581bc6e7cb6 for instance 07365fde-3701-46a6-aba7-4c6f74e181b9 on n-h1-858094-4 Sep 16 12:48:52.995525 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-aecfbec4-1dbe-4c53-a727-6bda8e84c091 req-af0bd7c6-afd1-45d9-9a55-052d572c8f14 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042689 Sep 16 12:48:52.996789 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 442/841] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:48:53.015001 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8fcdc813-f61a-4c2e-99a5-b8e90a688aa6 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:53.016263 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8fcdc813-f61a-4c2e-99a5-b8e90a688aa6 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] [instance: a1f478b9-b8e1-40a8-9232-34eb6df9ad7a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:53.041364 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fcdc813-f61a-4c2e-99a5-b8e90a688aa6 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:53.043193 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fcdc813-f61a-4c2e-99a5-b8e90a688aa6 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:53.055637 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fcdc813-f61a-4c2e-99a5-b8e90a688aa6 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:53.057258 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fcdc813-f61a-4c2e-99a5-b8e90a688aa6 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:53.057916 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fcdc813-f61a-4c2e-99a5-b8e90a688aa6 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:53.058522 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fcdc813-f61a-4c2e-99a5-b8e90a688aa6 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:53.366651 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c9182340-f4c9-4ba6-bfcc-fb348b3270c0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:53.387024 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c9182340-f4c9-4ba6-bfcc-fb348b3270c0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1313 microversion: 2.1 time: 0.507885 Sep 16 12:48:53.388261 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 400/842] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:52 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1313 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:53.393224 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-c25cef79-23a5-4b80-b022-2379f0caf290 req-aca7a84a-567e-49e3-bf76-7fc6a8d546ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38d079dd-9676-45f7-b286-16aa78d487bf", "tag": "3d903631-a9e4-424f-ad6d-35d838b2d04d"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:53.404033 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-c25cef79-23a5-4b80-b022-2379f0caf290 req-aca7a84a-567e-49e3-bf76-7fc6a8d546ae service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:53.404887 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-c25cef79-23a5-4b80-b022-2379f0caf290 req-aca7a84a-567e-49e3-bf76-7fc6a8d546ae service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:53.405456 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-c25cef79-23a5-4b80-b022-2379f0caf290 req-aca7a84a-567e-49e3-bf76-7fc6a8d546ae service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:53.423276 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8fcdc813-f61a-4c2e-99a5-b8e90a688aa6 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a" status: 200 len: 1630 microversion: 2.1 time: 0.424851 Sep 16 12:48:53.425319 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 443/843] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:52 2022] GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a => generated 1630 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:53.433811 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7f7cbb05-a7f9-47c9-9f29-6655b35b0b83 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:53.434432 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7f7cbb05-a7f9-47c9-9f29-6655b35b0b83 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 95448444-b52b-428f-9c7c-8e0e78fc2b22] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:53.437919 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-c25cef79-23a5-4b80-b022-2379f0caf290 req-aca7a84a-567e-49e3-bf76-7fc6a8d546ae service nova] Creating event network-changed:3d903631-a9e4-424f-ad6d-35d838b2d04d for instance 38d079dd-9676-45f7-b286-16aa78d487bf on n-h2-858094-4 Sep 16 12:48:53.452363 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-c25cef79-23a5-4b80-b022-2379f0caf290 req-aca7a84a-567e-49e3-bf76-7fc6a8d546ae service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062223 Sep 16 12:48:53.458910 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f7cbb05-a7f9-47c9-9f29-6655b35b0b83 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:53.458910 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f7cbb05-a7f9-47c9-9f29-6655b35b0b83 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:53.458910 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f7cbb05-a7f9-47c9-9f29-6655b35b0b83 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:53.459240 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f7cbb05-a7f9-47c9-9f29-6655b35b0b83 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:53.459797 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f7cbb05-a7f9-47c9-9f29-6655b35b0b83 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:53.460264 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f7cbb05-a7f9-47c9-9f29-6655b35b0b83 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:53.461029 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 401/844] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:48:53.476543 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-439ad08c-61f4-4706-a19d-52501613bce1 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:53.477715 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-439ad08c-61f4-4706-a19d-52501613bce1 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:53.494691 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-439ad08c-61f4-4706-a19d-52501613bce1 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:53.498992 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-439ad08c-61f4-4706-a19d-52501613bce1 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:53.499765 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-439ad08c-61f4-4706-a19d-52501613bce1 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:53.501000 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-439ad08c-61f4-4706-a19d-52501613bce1 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:53.502850 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-439ad08c-61f4-4706-a19d-52501613bce1 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:53.507051 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-439ad08c-61f4-4706-a19d-52501613bce1 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:53.510426 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:48:54.015800 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-439ad08c-61f4-4706-a19d-52501613bce1 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fd28118c342529cda410e9587dfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a3e6c179c6495281c2816a1e18aa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:54.036799 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-439ad08c-61f4-4706-a19d-52501613bce1 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0" status: 200 len: 1371 microversion: 2.1 time: 0.565412 Sep 16 12:48:54.037826 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 402/845] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:53 2022] GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 => generated 1371 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:54.052598 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-00750c59-34cb-4caf-a493-a946e782f0c4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Action: 'create', calling method: .version_select at 0x7f10360de280>, body: {"keypair": {"name": "tempest-keypair-654045276", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/ihC0Cd8viSsmLM6c/r3OO1HEekLR/FEmw3NKQqPlYWPB7O0QKPdxsAc+RKThq+rfvliuA59HwCW091+jitHq0C09UVfpe2Gn/hkHkz32l/qrpTNZn8ha6IcUUiiOpTA=="}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:54.113711 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-00750c59-34cb-4caf-a493-a946e782f0c4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Getting quotas for project dd7ec914bffb4743921e4116b0c399eb. Resources: {'key_pairs'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:48:54.114982 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7f7cbb05-a7f9-47c9-9f29-6655b35b0b83 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:54.131571 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7f7cbb05-a7f9-47c9-9f29-6655b35b0b83 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/95448444-b52b-428f-9c7c-8e0e78fc2b22" status: 200 len: 1319 microversion: 2.1 time: 0.700201 Sep 16 12:48:54.132949 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 444/846] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:53 2022] GET /compute/v2.1/servers/95448444-b52b-428f-9c7c-8e0e78fc2b22 => generated 1319 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:54.144699 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4cf3baac-6b7a-4397-8472-74f489c19193 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:54.145964 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-00750c59-34cb-4caf-a493-a946e782f0c4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Getting quotas for user 745ef253e9844572a0f081955b3e9a90 and project dd7ec914bffb4743921e4116b0c399eb. Resources: {'key_pairs'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:48:54.157082 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4cf3baac-6b7a-4397-8472-74f489c19193 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: 1b320dc8-1e79-4202-8162-0a418c6b1874] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:54.180448 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4cf3baac-6b7a-4397-8472-74f489c19193 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:54.182428 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4cf3baac-6b7a-4397-8472-74f489c19193 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:54.183060 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4cf3baac-6b7a-4397-8472-74f489c19193 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:54.189383 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4cf3baac-6b7a-4397-8472-74f489c19193 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:54.190265 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4cf3baac-6b7a-4397-8472-74f489c19193 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:54.191122 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4cf3baac-6b7a-4397-8472-74f489c19193 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:54.197949 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-00750c59-34cb-4caf-a493-a946e782f0c4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.158973 Sep 16 12:48:54.199037 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 403/847] 10.222.0.67 () {60 vars in 1159 bytes} [Fri Sep 16 12:48:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:48:54.221308 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-28ae1a60-21a9-43d0-a486-d62e03fd4b58 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:54.222073 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-28ae1a60-21a9-43d0-a486-d62e03fd4b58 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:54.245848 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-28ae1a60-21a9-43d0-a486-d62e03fd4b58 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:54.246330 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-28ae1a60-21a9-43d0-a486-d62e03fd4b58 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:54.246769 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-28ae1a60-21a9-43d0-a486-d62e03fd4b58 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:54.247481 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-28ae1a60-21a9-43d0-a486-d62e03fd4b58 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:54.247934 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-28ae1a60-21a9-43d0-a486-d62e03fd4b58 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:54.248385 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-28ae1a60-21a9-43d0-a486-d62e03fd4b58 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:54.262459 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4cf3baac-6b7a-4397-8472-74f489c19193 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:54.268337 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4cf3baac-6b7a-4397-8472-74f489c19193 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:54.268905 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4cf3baac-6b7a-4397-8472-74f489c19193 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:54.269500 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-4cf3baac-6b7a-4397-8472-74f489c19193 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lazy-loading 'fault' on Instance uuid 1b320dc8-1e79-4202-8162-0a418c6b1874 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:48:54.563679 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4cf3baac-6b7a-4397-8472-74f489c19193 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:54.578038 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4cf3baac-6b7a-4397-8472-74f489c19193 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874" status: 200 len: 1304 microversion: 2.1 time: 0.439390 Sep 16 12:48:54.578847 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 445/848] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:54 2022] GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874 => generated 1304 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:54.597564 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-79fcbb1b-33c1-4366-b1d2-eb670f8fcb30 req-e3c97a28-662d-4ac9-baed-ab4e85c84f14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07365fde-3701-46a6-aba7-4c6f74e181b9", "name": "network-vif-deleted", "tag": "57df8d9f-a9ff-49ba-a0ec-5581bc6e7cb6"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:54.611360 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-79fcbb1b-33c1-4366-b1d2-eb670f8fcb30 req-e3c97a28-662d-4ac9-baed-ab4e85c84f14 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:54.612228 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-79fcbb1b-33c1-4366-b1d2-eb670f8fcb30 req-e3c97a28-662d-4ac9-baed-ab4e85c84f14 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:54.613408 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-79fcbb1b-33c1-4366-b1d2-eb670f8fcb30 req-e3c97a28-662d-4ac9-baed-ab4e85c84f14 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:54.641174 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-79fcbb1b-33c1-4366-b1d2-eb670f8fcb30 req-e3c97a28-662d-4ac9-baed-ab4e85c84f14 service nova] Creating event network-vif-deleted:57df8d9f-a9ff-49ba-a0ec-5581bc6e7cb6 for instance 07365fde-3701-46a6-aba7-4c6f74e181b9 on n-h1-858094-4 Sep 16 12:48:54.655056 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-79fcbb1b-33c1-4366-b1d2-eb670f8fcb30 req-e3c97a28-662d-4ac9-baed-ab4e85c84f14 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059130 Sep 16 12:48:54.657159 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 446/849] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:48:54.672561 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-730c8ea5-c34d-4f73-95e5-4069ec8abf37 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:54.676097 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-730c8ea5-c34d-4f73-95e5-4069ec8abf37 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] [instance: 8983b634-6da4-4830-b0f1-5835cc55083e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:54.694647 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-730c8ea5-c34d-4f73-95e5-4069ec8abf37 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:54.695770 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-730c8ea5-c34d-4f73-95e5-4069ec8abf37 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:54.696305 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-730c8ea5-c34d-4f73-95e5-4069ec8abf37 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:54.697256 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-730c8ea5-c34d-4f73-95e5-4069ec8abf37 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:54.698290 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-730c8ea5-c34d-4f73-95e5-4069ec8abf37 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:54.699011 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-730c8ea5-c34d-4f73-95e5-4069ec8abf37 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:54.828631 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-730c8ea5-c34d-4f73-95e5-4069ec8abf37 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd06a287a6b48f5a8a5ac30c0159fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3e2fe65ad744a2ba3b757f42f1d07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:54.858906 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-730c8ea5-c34d-4f73-95e5-4069ec8abf37 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] 10.222.0.67 "GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e" status: 200 len: 1328 microversion: 2.1 time: 0.200118 Sep 16 12:48:54.860210 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 447/850] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:54 2022] GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e => generated 1328 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:54.868798 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fb55ea19-a8cd-4b46-81ff-872ae0435d0d tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:54.869477 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fb55ea19-a8cd-4b46-81ff-872ae0435d0d tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 38d079dd-9676-45f7-b286-16aa78d487bf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:54.879797 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb55ea19-a8cd-4b46-81ff-872ae0435d0d tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:54.880900 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb55ea19-a8cd-4b46-81ff-872ae0435d0d tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:54.886020 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb55ea19-a8cd-4b46-81ff-872ae0435d0d tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:54.888965 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb55ea19-a8cd-4b46-81ff-872ae0435d0d tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:54.889517 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb55ea19-a8cd-4b46-81ff-872ae0435d0d tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:54.890182 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb55ea19-a8cd-4b46-81ff-872ae0435d0d tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:54.911137 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-28ae1a60-21a9-43d0-a486-d62e03fd4b58 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:54.931684 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-28ae1a60-21a9-43d0-a486-d62e03fd4b58 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1308 microversion: 2.1 time: 0.728922 Sep 16 12:48:54.932509 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 404/851] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:54 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1308 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:54.940024 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-23d491fd-242c-40da-9e45-edc988792ab2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:54.947741 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-23d491fd-242c-40da-9e45-edc988792ab2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:54.963577 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-23d491fd-242c-40da-9e45-edc988792ab2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:54.964073 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-23d491fd-242c-40da-9e45-edc988792ab2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:54.964535 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-23d491fd-242c-40da-9e45-edc988792ab2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:54.965245 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-23d491fd-242c-40da-9e45-edc988792ab2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:54.965699 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-23d491fd-242c-40da-9e45-edc988792ab2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:54.966123 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-23d491fd-242c-40da-9e45-edc988792ab2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:55.326593 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fb55ea19-a8cd-4b46-81ff-872ae0435d0d tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709f71c239ca40b8b958038c9ab16f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7058e9e184834c39a5a299f481a6e62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:55.339993 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fb55ea19-a8cd-4b46-81ff-872ae0435d0d tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "GET /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf" status: 200 len: 1391 microversion: 2.1 time: 0.478101 Sep 16 12:48:55.352150 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 448/852] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:54 2022] GET /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf => generated 1391 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:55.352150 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-23b6749d-ed3e-439a-9cb8-1cb433d3b454 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:55.352150 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-23b6749d-ed3e-439a-9cb8-1cb433d3b454 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:55.361740 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-23d491fd-242c-40da-9e45-edc988792ab2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:55.381215 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23b6749d-ed3e-439a-9cb8-1cb433d3b454 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:55.381215 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23b6749d-ed3e-439a-9cb8-1cb433d3b454 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:55.381215 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23b6749d-ed3e-439a-9cb8-1cb433d3b454 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:55.381215 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23b6749d-ed3e-439a-9cb8-1cb433d3b454 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:55.381647 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23b6749d-ed3e-439a-9cb8-1cb433d3b454 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:55.381647 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23b6749d-ed3e-439a-9cb8-1cb433d3b454 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:55.381794 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-23d491fd-242c-40da-9e45-edc988792ab2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1313 microversion: 2.1 time: 0.441018 Sep 16 12:48:55.381794 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 405/853] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:54 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1313 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:55.393871 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6910c6ec-f42b-4d2c-aeaf-724792bad11f tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:55.395508 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6910c6ec-f42b-4d2c-aeaf-724792bad11f tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 95448444-b52b-428f-9c7c-8e0e78fc2b22] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:55.411632 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6910c6ec-f42b-4d2c-aeaf-724792bad11f tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:55.415627 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6910c6ec-f42b-4d2c-aeaf-724792bad11f tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:55.415627 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6910c6ec-f42b-4d2c-aeaf-724792bad11f tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:55.417534 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6910c6ec-f42b-4d2c-aeaf-724792bad11f tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:55.418124 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6910c6ec-f42b-4d2c-aeaf-724792bad11f tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:55.418726 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6910c6ec-f42b-4d2c-aeaf-724792bad11f tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:55.739814 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6910c6ec-f42b-4d2c-aeaf-724792bad11f tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:55.749589 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6910c6ec-f42b-4d2c-aeaf-724792bad11f tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/95448444-b52b-428f-9c7c-8e0e78fc2b22" status: 200 len: 1319 microversion: 2.1 time: 0.370222 Sep 16 12:48:55.750349 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 406/854] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:55 2022] GET /compute/v2.1/servers/95448444-b52b-428f-9c7c-8e0e78fc2b22 => generated 1319 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:55.755904 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0e7475c5-c7ff-4fdd-a2ae-9686e4e53faa tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:55.756988 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0e7475c5-c7ff-4fdd-a2ae-9686e4e53faa tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: 1b320dc8-1e79-4202-8162-0a418c6b1874] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:55.776716 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0e7475c5-c7ff-4fdd-a2ae-9686e4e53faa tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:55.777584 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0e7475c5-c7ff-4fdd-a2ae-9686e4e53faa tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:55.777920 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0e7475c5-c7ff-4fdd-a2ae-9686e4e53faa tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:55.779049 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0e7475c5-c7ff-4fdd-a2ae-9686e4e53faa tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:55.779974 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0e7475c5-c7ff-4fdd-a2ae-9686e4e53faa tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:55.780243 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0e7475c5-c7ff-4fdd-a2ae-9686e4e53faa tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:55.806611 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-23b6749d-ed3e-439a-9cb8-1cb433d3b454 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fd28118c342529cda410e9587dfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a3e6c179c6495281c2816a1e18aa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:55.819361 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0e7475c5-c7ff-4fdd-a2ae-9686e4e53faa tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:55.819830 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0e7475c5-c7ff-4fdd-a2ae-9686e4e53faa tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:55.820305 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0e7475c5-c7ff-4fdd-a2ae-9686e4e53faa tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:55.820772 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-0e7475c5-c7ff-4fdd-a2ae-9686e4e53faa tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lazy-loading 'fault' on Instance uuid 1b320dc8-1e79-4202-8162-0a418c6b1874 {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:48:55.822860 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-23b6749d-ed3e-439a-9cb8-1cb433d3b454 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0" status: 200 len: 1371 microversion: 2.1 time: 0.479481 Sep 16 12:48:55.823818 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 449/855] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:55 2022] GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 => generated 1371 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:55.882337 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b22ede6f-600d-4eb6-9f3a-c35233eb703a tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:55.883278 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b22ede6f-600d-4eb6-9f3a-c35233eb703a tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] [instance: 8983b634-6da4-4830-b0f1-5835cc55083e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:55.895816 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b22ede6f-600d-4eb6-9f3a-c35233eb703a tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:55.896555 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b22ede6f-600d-4eb6-9f3a-c35233eb703a tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:55.897096 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b22ede6f-600d-4eb6-9f3a-c35233eb703a tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:55.897841 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b22ede6f-600d-4eb6-9f3a-c35233eb703a tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:55.898296 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b22ede6f-600d-4eb6-9f3a-c35233eb703a tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:55.898899 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b22ede6f-600d-4eb6-9f3a-c35233eb703a tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:55.950906 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0e7475c5-c7ff-4fdd-a2ae-9686e4e53faa tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:55.969865 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0e7475c5-c7ff-4fdd-a2ae-9686e4e53faa tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874" status: 200 len: 1304 microversion: 2.1 time: 0.218170 Sep 16 12:48:55.971500 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 407/856] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:55 2022] GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874 => generated 1304 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:55.977193 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8b5a5eaa-b860-4239-b624-8571160da5d5 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:55.979205 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8b5a5eaa-b860-4239-b624-8571160da5d5 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:55.996856 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8b5a5eaa-b860-4239-b624-8571160da5d5 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:55.997351 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8b5a5eaa-b860-4239-b624-8571160da5d5 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:55.997781 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8b5a5eaa-b860-4239-b624-8571160da5d5 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:55.998474 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8b5a5eaa-b860-4239-b624-8571160da5d5 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:55.999094 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8b5a5eaa-b860-4239-b624-8571160da5d5 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:55.999702 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8b5a5eaa-b860-4239-b624-8571160da5d5 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:56.190554 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b22ede6f-600d-4eb6-9f3a-c35233eb703a tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd06a287a6b48f5a8a5ac30c0159fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3e2fe65ad744a2ba3b757f42f1d07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:56.203880 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b22ede6f-600d-4eb6-9f3a-c35233eb703a tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] 10.222.0.67 "GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e" status: 200 len: 1395 microversion: 2.1 time: 0.326040 Sep 16 12:48:56.204672 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 450/857] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:55 2022] GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e => generated 1395 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:48:56.213632 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-ee812b93-307d-4e7f-bb16-82a2dbe54873 req-69e81e68-a06e-4733-b5b8-74880355a483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95448444-b52b-428f-9c7c-8e0e78fc2b22", "name": "network-vif-plugged", "status": "completed", "tag": "1c5c05cf-4ab1-4beb-b208-fb0941341532"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:56.229074 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ee812b93-307d-4e7f-bb16-82a2dbe54873 req-69e81e68-a06e-4733-b5b8-74880355a483 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:56.230018 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ee812b93-307d-4e7f-bb16-82a2dbe54873 req-69e81e68-a06e-4733-b5b8-74880355a483 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:56.230715 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ee812b93-307d-4e7f-bb16-82a2dbe54873 req-69e81e68-a06e-4733-b5b8-74880355a483 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:56.249537 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-ee812b93-307d-4e7f-bb16-82a2dbe54873 req-69e81e68-a06e-4733-b5b8-74880355a483 service nova] Creating event network-vif-plugged:1c5c05cf-4ab1-4beb-b208-fb0941341532 for instance 95448444-b52b-428f-9c7c-8e0e78fc2b22 on n-h2-858094-4 Sep 16 12:48:56.255052 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-ee812b93-307d-4e7f-bb16-82a2dbe54873 req-69e81e68-a06e-4733-b5b8-74880355a483 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048720 Sep 16 12:48:56.255931 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 451/858] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:48:56.281879 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-0beeb042-65ba-4872-a1f1-91e9349ca133 req-4dbffd1e-84de-4a6b-85a1-10f252ab346a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d16466e6-cdcd-43d7-bc01-bdf3249fdcf0", "tag": "9fe525ed-e767-4d78-8eff-93ca2a0eb98f"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:56.298082 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0beeb042-65ba-4872-a1f1-91e9349ca133 req-4dbffd1e-84de-4a6b-85a1-10f252ab346a service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:56.298468 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0beeb042-65ba-4872-a1f1-91e9349ca133 req-4dbffd1e-84de-4a6b-85a1-10f252ab346a service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:56.299144 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0beeb042-65ba-4872-a1f1-91e9349ca133 req-4dbffd1e-84de-4a6b-85a1-10f252ab346a service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:56.323975 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8b5a5eaa-b860-4239-b624-8571160da5d5 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:56.331770 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-0beeb042-65ba-4872-a1f1-91e9349ca133 req-4dbffd1e-84de-4a6b-85a1-10f252ab346a service nova] Creating event network-changed:9fe525ed-e767-4d78-8eff-93ca2a0eb98f for instance d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 on n-h1-858094-4 Sep 16 12:48:56.336375 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8b5a5eaa-b860-4239-b624-8571160da5d5 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1308 microversion: 2.1 time: 0.363532 Sep 16 12:48:56.338319 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 408/859] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:55 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1308 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:56.341194 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-0beeb042-65ba-4872-a1f1-91e9349ca133 req-4dbffd1e-84de-4a6b-85a1-10f252ab346a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075546 Sep 16 12:48:56.341960 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 452/860] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:48:56.367936 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-93b7bb50-8bde-4745-bceb-c2d95dba1826 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:56.368583 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-93b7bb50-8bde-4745-bceb-c2d95dba1826 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 38d079dd-9676-45f7-b286-16aa78d487bf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:56.374944 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-93b7bb50-8bde-4745-bceb-c2d95dba1826 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:56.375435 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-93b7bb50-8bde-4745-bceb-c2d95dba1826 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:56.375869 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-93b7bb50-8bde-4745-bceb-c2d95dba1826 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:56.376618 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-93b7bb50-8bde-4745-bceb-c2d95dba1826 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:56.377074 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-93b7bb50-8bde-4745-bceb-c2d95dba1826 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:56.377495 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-93b7bb50-8bde-4745-bceb-c2d95dba1826 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:56.406267 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-784b6ad1-c802-4e66-810c-09e4ee4bd2c4 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:56.407219 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-784b6ad1-c802-4e66-810c-09e4ee4bd2c4 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:56.414292 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-784b6ad1-c802-4e66-810c-09e4ee4bd2c4 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:56.415029 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-784b6ad1-c802-4e66-810c-09e4ee4bd2c4 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:56.415998 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-784b6ad1-c802-4e66-810c-09e4ee4bd2c4 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:56.416775 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-784b6ad1-c802-4e66-810c-09e4ee4bd2c4 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:56.417416 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-784b6ad1-c802-4e66-810c-09e4ee4bd2c4 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:56.418038 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-784b6ad1-c802-4e66-810c-09e4ee4bd2c4 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:56.915904 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-93b7bb50-8bde-4745-bceb-c2d95dba1826 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709f71c239ca40b8b958038c9ab16f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7058e9e184834c39a5a299f481a6e62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:56.935868 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-784b6ad1-c802-4e66-810c-09e4ee4bd2c4 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:56.939871 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-93b7bb50-8bde-4745-bceb-c2d95dba1826 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "GET /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf" status: 200 len: 1391 microversion: 2.1 time: 0.566701 Sep 16 12:48:56.940932 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 409/861] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:56 2022] GET /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf => generated 1391 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:56.953458 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5a527bbe-c7e5-4489-b20e-bde5b65a67b4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:56.954862 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5a527bbe-c7e5-4489-b20e-bde5b65a67b4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 95448444-b52b-428f-9c7c-8e0e78fc2b22] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:56.959890 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-784b6ad1-c802-4e66-810c-09e4ee4bd2c4 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1313 microversion: 2.1 time: 0.558471 Sep 16 12:48:56.960783 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 453/862] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:56 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1313 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:56.966769 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-0e2e43d1-3463-493a-961c-c24f5db0bf16 req-b3e72352-889b-4dad-863f-216ed0b7d1dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bdda11e-3b22-4d78-af62-8cc9a3915a4b", "tag": "e3afd82f-9e91-4967-8755-5ee2e7d21714"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:56.972743 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5a527bbe-c7e5-4489-b20e-bde5b65a67b4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:56.979531 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5a527bbe-c7e5-4489-b20e-bde5b65a67b4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:56.980093 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5a527bbe-c7e5-4489-b20e-bde5b65a67b4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:56.980950 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5a527bbe-c7e5-4489-b20e-bde5b65a67b4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:56.981704 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5a527bbe-c7e5-4489-b20e-bde5b65a67b4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:56.982368 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5a527bbe-c7e5-4489-b20e-bde5b65a67b4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:56.990412 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=6 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:48:56.998297 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0e2e43d1-3463-493a-961c-c24f5db0bf16 req-b3e72352-889b-4dad-863f-216ed0b7d1dc service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:56.998783 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0e2e43d1-3463-493a-961c-c24f5db0bf16 req-b3e72352-889b-4dad-863f-216ed0b7d1dc service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:56.999359 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0e2e43d1-3463-493a-961c-c24f5db0bf16 req-b3e72352-889b-4dad-863f-216ed0b7d1dc service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:57.020914 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-0e2e43d1-3463-493a-961c-c24f5db0bf16 req-b3e72352-889b-4dad-863f-216ed0b7d1dc service nova] Creating event network-changed:e3afd82f-9e91-4967-8755-5ee2e7d21714 for instance 1bdda11e-3b22-4d78-af62-8cc9a3915a4b on n-h1-858094-4 Sep 16 12:48:57.029661 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-0e2e43d1-3463-493a-961c-c24f5db0bf16 req-b3e72352-889b-4dad-863f-216ed0b7d1dc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065831 Sep 16 12:48:57.031554 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 454/863] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:48:57.040820 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-83145905-0b55-4b02-a2d8-6de8211c8494 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:57.041775 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-83145905-0b55-4b02-a2d8-6de8211c8494 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:57.053171 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83145905-0b55-4b02-a2d8-6de8211c8494 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:57.054132 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83145905-0b55-4b02-a2d8-6de8211c8494 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:57.054578 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83145905-0b55-4b02-a2d8-6de8211c8494 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:57.055373 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83145905-0b55-4b02-a2d8-6de8211c8494 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:57.056366 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83145905-0b55-4b02-a2d8-6de8211c8494 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:57.056804 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83145905-0b55-4b02-a2d8-6de8211c8494 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:57.206309 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5a527bbe-c7e5-4489-b20e-bde5b65a67b4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:57.215439 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5a527bbe-c7e5-4489-b20e-bde5b65a67b4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/95448444-b52b-428f-9c7c-8e0e78fc2b22" status: 200 len: 1319 microversion: 2.1 time: 0.271228 Sep 16 12:48:57.224582 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 410/864] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:56 2022] GET /compute/v2.1/servers/95448444-b52b-428f-9c7c-8e0e78fc2b22 => generated 1319 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:57.239764 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-83145905-0b55-4b02-a2d8-6de8211c8494 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fd28118c342529cda410e9587dfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a3e6c179c6495281c2816a1e18aa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:57.245702 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a0a976b9-2489-4842-acf5-a2a6ad249a65 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:57.246312 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a0a976b9-2489-4842-acf5-a2a6ad249a65 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: 1b320dc8-1e79-4202-8162-0a418c6b1874] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:57.248786 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-83145905-0b55-4b02-a2d8-6de8211c8494 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0" status: 200 len: 1371 microversion: 2.1 time: 0.214652 Sep 16 12:48:57.249883 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 455/865] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:57 2022] GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 => generated 1371 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:57.252626 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a0a976b9-2489-4842-acf5-a2a6ad249a65 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:57.253351 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a0a976b9-2489-4842-acf5-a2a6ad249a65 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:57.254010 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a0a976b9-2489-4842-acf5-a2a6ad249a65 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:57.254923 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a0a976b9-2489-4842-acf5-a2a6ad249a65 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:57.255155 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-57ef2306-b714-4dfb-a330-12d876e03d6c tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:57.255767 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-57ef2306-b714-4dfb-a330-12d876e03d6c tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] [instance: 8983b634-6da4-4830-b0f1-5835cc55083e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:57.256000 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a0a976b9-2489-4842-acf5-a2a6ad249a65 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:57.256640 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a0a976b9-2489-4842-acf5-a2a6ad249a65 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:57.262237 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-57ef2306-b714-4dfb-a330-12d876e03d6c tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:57.263030 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-57ef2306-b714-4dfb-a330-12d876e03d6c tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:57.263473 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-57ef2306-b714-4dfb-a330-12d876e03d6c tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:57.264277 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-57ef2306-b714-4dfb-a330-12d876e03d6c tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:57.264740 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-57ef2306-b714-4dfb-a330-12d876e03d6c tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:57.265166 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-57ef2306-b714-4dfb-a330-12d876e03d6c tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:57.324089 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a0a976b9-2489-4842-acf5-a2a6ad249a65 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:57.325566 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a0a976b9-2489-4842-acf5-a2a6ad249a65 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:57.326359 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a0a976b9-2489-4842-acf5-a2a6ad249a65 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:57.327068 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-a0a976b9-2489-4842-acf5-a2a6ad249a65 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lazy-loading 'fault' on Instance uuid 1b320dc8-1e79-4202-8162-0a418c6b1874 {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:48:57.447633 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a0a976b9-2489-4842-acf5-a2a6ad249a65 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:57.460739 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a0a976b9-2489-4842-acf5-a2a6ad249a65 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874" status: 200 len: 1304 microversion: 2.1 time: 0.224782 Sep 16 12:48:57.462215 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 411/866] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:57 2022] GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874 => generated 1304 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:57.473920 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-367fe8c5-03fb-4721-a543-a97353cad44c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:57.475333 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-367fe8c5-03fb-4721-a543-a97353cad44c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:57.488412 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-367fe8c5-03fb-4721-a543-a97353cad44c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:57.488902 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-367fe8c5-03fb-4721-a543-a97353cad44c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:57.493722 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-367fe8c5-03fb-4721-a543-a97353cad44c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:57.494649 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-367fe8c5-03fb-4721-a543-a97353cad44c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:57.495108 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-367fe8c5-03fb-4721-a543-a97353cad44c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:57.495531 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-367fe8c5-03fb-4721-a543-a97353cad44c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:57.573371 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-57ef2306-b714-4dfb-a330-12d876e03d6c tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd06a287a6b48f5a8a5ac30c0159fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3e2fe65ad744a2ba3b757f42f1d07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:57.585081 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-57ef2306-b714-4dfb-a330-12d876e03d6c tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] 10.222.0.67 "GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e" status: 200 len: 1395 microversion: 2.1 time: 0.333970 Sep 16 12:48:57.587054 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 456/867] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:57 2022] GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e => generated 1395 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:57.752463 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-367fe8c5-03fb-4721-a543-a97353cad44c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:57.762801 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-367fe8c5-03fb-4721-a543-a97353cad44c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1308 microversion: 2.1 time: 0.296845 Sep 16 12:48:57.764013 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 412/868] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:57 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1308 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:57.967497 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7c4dd150-be0d-4d38-8fa3-034cc3a3a205 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:57.968411 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7c4dd150-be0d-4d38-8fa3-034cc3a3a205 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 38d079dd-9676-45f7-b286-16aa78d487bf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:57.986267 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9b152cd6-65ae-4230-90af-ed71aad6942a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:57.987509 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9b152cd6-65ae-4230-90af-ed71aad6942a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:57.993948 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c4dd150-be0d-4d38-8fa3-034cc3a3a205 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:57.997892 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c4dd150-be0d-4d38-8fa3-034cc3a3a205 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:57.999623 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9b152cd6-65ae-4230-90af-ed71aad6942a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:58.001523 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c4dd150-be0d-4d38-8fa3-034cc3a3a205 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:58.003932 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c4dd150-be0d-4d38-8fa3-034cc3a3a205 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:58.004751 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c4dd150-be0d-4d38-8fa3-034cc3a3a205 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:58.005028 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9b152cd6-65ae-4230-90af-ed71aad6942a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:58.005708 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9b152cd6-65ae-4230-90af-ed71aad6942a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:58.006687 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c4dd150-be0d-4d38-8fa3-034cc3a3a205 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:58.013706 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9b152cd6-65ae-4230-90af-ed71aad6942a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:58.014845 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9b152cd6-65ae-4230-90af-ed71aad6942a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:58.016163 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9b152cd6-65ae-4230-90af-ed71aad6942a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:58.492144 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9b152cd6-65ae-4230-90af-ed71aad6942a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:58.496779 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=100 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:48:58.507600 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9b152cd6-65ae-4230-90af-ed71aad6942a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1313 microversion: 2.1 time: 0.526495 Sep 16 12:48:58.516277 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 413/869] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:57 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1313 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:58.526128 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7c4dd150-be0d-4d38-8fa3-034cc3a3a205 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709f71c239ca40b8b958038c9ab16f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7058e9e184834c39a5a299f481a6e62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:58.546200 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7c4dd150-be0d-4d38-8fa3-034cc3a3a205 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "GET /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf" status: 200 len: 1391 microversion: 2.1 time: 0.583181 Sep 16 12:48:58.547194 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3faa4cc4-d3ae-4940-84ab-ec1bca7790f4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:58.548772 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3faa4cc4-d3ae-4940-84ab-ec1bca7790f4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 95448444-b52b-428f-9c7c-8e0e78fc2b22] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:58.549895 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 457/870] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:57 2022] GET /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf => generated 1391 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:58.568663 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6288928f-3bb8-4933-a529-c01e75a1588d tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:58.575790 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6288928f-3bb8-4933-a529-c01e75a1588d tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:58.576835 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3faa4cc4-d3ae-4940-84ab-ec1bca7790f4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:58.577623 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3faa4cc4-d3ae-4940-84ab-ec1bca7790f4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:58.578664 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3faa4cc4-d3ae-4940-84ab-ec1bca7790f4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:58.580302 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3faa4cc4-d3ae-4940-84ab-ec1bca7790f4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:58.585714 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3faa4cc4-d3ae-4940-84ab-ec1bca7790f4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:58.586824 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3faa4cc4-d3ae-4940-84ab-ec1bca7790f4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:58.609501 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6288928f-3bb8-4933-a529-c01e75a1588d tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:58.614221 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6288928f-3bb8-4933-a529-c01e75a1588d tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:58.620090 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6288928f-3bb8-4933-a529-c01e75a1588d tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:58.623541 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6288928f-3bb8-4933-a529-c01e75a1588d tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:58.627537 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6288928f-3bb8-4933-a529-c01e75a1588d tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:58.631897 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6288928f-3bb8-4933-a529-c01e75a1588d tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:59.089540 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3faa4cc4-d3ae-4940-84ab-ec1bca7790f4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:59.096656 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6288928f-3bb8-4933-a529-c01e75a1588d tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fd28118c342529cda410e9587dfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a3e6c179c6495281c2816a1e18aa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:59.103741 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3faa4cc4-d3ae-4940-84ab-ec1bca7790f4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/95448444-b52b-428f-9c7c-8e0e78fc2b22" status: 200 len: 1469 microversion: 2.1 time: 0.582467 Sep 16 12:48:59.107266 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6288928f-3bb8-4933-a529-c01e75a1588d tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0" status: 200 len: 1371 microversion: 2.1 time: 0.553183 Sep 16 12:48:59.121785 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 414/871] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:58 2022] GET /compute/v2.1/servers/95448444-b52b-428f-9c7c-8e0e78fc2b22 => generated 1469 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:59.124792 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 458/872] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:58 2022] GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 => generated 1371 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:59.143788 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fdab7396-ac2b-4668-98b3-573e265a4d87 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-313396558", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": [{"uuid": "40f9024a-6954-4a0a-afdb-132e05c6d9d2"}], "security_groups": [{"name": "tempest-securitygroup--1431351144"}], "key_name": "tempest-keypair-654045276", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:59.145148 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-4d5c7591-0139-4511-9879-5b3c9a3a7599 req-c307a545-b1af-4339-a7b5-69dec99d8f6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6b4a601-8b6e-498e-8c17-9e689c13db74", "name": "network-vif-plugged", "status": "completed", "tag": "c82c5517-9370-47b7-870d-b1c0f066ce8a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:59.173560 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4d5c7591-0139-4511-9879-5b3c9a3a7599 req-c307a545-b1af-4339-a7b5-69dec99d8f6e service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:59.174375 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4d5c7591-0139-4511-9879-5b3c9a3a7599 req-c307a545-b1af-4339-a7b5-69dec99d8f6e service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:59.174962 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4d5c7591-0139-4511-9879-5b3c9a3a7599 req-c307a545-b1af-4339-a7b5-69dec99d8f6e service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:59.192369 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-4d5c7591-0139-4511-9879-5b3c9a3a7599 req-c307a545-b1af-4339-a7b5-69dec99d8f6e service nova] Creating event network-vif-plugged:c82c5517-9370-47b7-870d-b1c0f066ce8a for instance c6b4a601-8b6e-498e-8c17-9e689c13db74 on n-h1-858094-4 Sep 16 12:48:59.216426 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-4d5c7591-0139-4511-9879-5b3c9a3a7599 req-c307a545-b1af-4339-a7b5-69dec99d8f6e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077831 Sep 16 12:48:59.217132 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 459/873] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:48:59.222515 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-01251be3-fc4f-4893-93c3-53ea7611dac6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:59.223154 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-01251be3-fc4f-4893-93c3-53ea7611dac6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: 1b320dc8-1e79-4202-8162-0a418c6b1874] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:59.235992 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01251be3-fc4f-4893-93c3-53ea7611dac6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:59.236526 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01251be3-fc4f-4893-93c3-53ea7611dac6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:59.236952 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01251be3-fc4f-4893-93c3-53ea7611dac6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:59.237657 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01251be3-fc4f-4893-93c3-53ea7611dac6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:59.251693 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01251be3-fc4f-4893-93c3-53ea7611dac6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:59.252269 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01251be3-fc4f-4893-93c3-53ea7611dac6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:59.334246 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01251be3-fc4f-4893-93c3-53ea7611dac6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:59.334790 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01251be3-fc4f-4893-93c3-53ea7611dac6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:59.335233 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01251be3-fc4f-4893-93c3-53ea7611dac6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:59.337074 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-01251be3-fc4f-4893-93c3-53ea7611dac6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lazy-loading 'fault' on Instance uuid 1b320dc8-1e79-4202-8162-0a418c6b1874 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:48:59.406293 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-01251be3-fc4f-4893-93c3-53ea7611dac6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:59.408474 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-fdab7396-ac2b-4668-98b3-573e265a4d87 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] validate_networks() for [('40f9024a-6954-4a0a-afdb-132e05c6d9d2', None, None, None, None, None)] {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:48:59.414542 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-01251be3-fc4f-4893-93c3-53ea7611dac6 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874" status: 200 len: 1304 microversion: 2.1 time: 0.196102 Sep 16 12:48:59.431259 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 460/874] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:59 2022] GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874 => generated 1304 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:59.437072 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-08061a8c-db26-4524-915c-fa87bb6cf6ea tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:59.437684 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-08061a8c-db26-4524-915c-fa87bb6cf6ea tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] [instance: 8983b634-6da4-4830-b0f1-5835cc55083e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:59.444220 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08061a8c-db26-4524-915c-fa87bb6cf6ea tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:59.444769 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08061a8c-db26-4524-915c-fa87bb6cf6ea tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:59.445345 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08061a8c-db26-4524-915c-fa87bb6cf6ea tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:59.446682 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08061a8c-db26-4524-915c-fa87bb6cf6ea tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:59.447145 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08061a8c-db26-4524-915c-fa87bb6cf6ea tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:59.447601 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08061a8c-db26-4524-915c-fa87bb6cf6ea tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:59.540061 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=10 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:48:59.592775 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=24 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:48:59.669668 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-08061a8c-db26-4524-915c-fa87bb6cf6ea tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd06a287a6b48f5a8a5ac30c0159fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3e2fe65ad744a2ba3b757f42f1d07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:48:59.679579 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-08061a8c-db26-4524-915c-fa87bb6cf6ea tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] 10.222.0.67 "GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e" status: 200 len: 1395 microversion: 2.1 time: 0.247097 Sep 16 12:48:59.680727 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 461/875] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:59 2022] GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e => generated 1395 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:48:59.689287 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-bc2748a1-95d6-4ac3-b34b-d4866c09363d req-9dda8048-667d-4094-a249-449f685de1a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8983b634-6da4-4830-b0f1-5835cc55083e", "tag": "f5de57d0-58b1-4bb4-be3d-a6d88fd93f21"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:48:59.699987 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bc2748a1-95d6-4ac3-b34b-d4866c09363d req-9dda8048-667d-4094-a249-449f685de1a1 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:59.700505 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bc2748a1-95d6-4ac3-b34b-d4866c09363d req-9dda8048-667d-4094-a249-449f685de1a1 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:59.700940 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bc2748a1-95d6-4ac3-b34b-d4866c09363d req-9dda8048-667d-4094-a249-449f685de1a1 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:59.718133 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-bc2748a1-95d6-4ac3-b34b-d4866c09363d req-9dda8048-667d-4094-a249-449f685de1a1 service nova] Creating event network-changed:f5de57d0-58b1-4bb4-be3d-a6d88fd93f21 for instance 8983b634-6da4-4830-b0f1-5835cc55083e on n-h2-858094-4 Sep 16 12:48:59.723396 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-bc2748a1-95d6-4ac3-b34b-d4866c09363d req-9dda8048-667d-4094-a249-449f685de1a1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041271 Sep 16 12:48:59.724093 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 462/876] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:48:59.731100 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7da69b69-be4f-4db3-8338-0ed73cb80924 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:48:59.732157 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7da69b69-be4f-4db3-8338-0ed73cb80924 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:48:59.735180 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:48:59.739123 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:48:59.745702 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7da69b69-be4f-4db3-8338-0ed73cb80924 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:59.747526 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7da69b69-be4f-4db3-8338-0ed73cb80924 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:59.748780 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7da69b69-be4f-4db3-8338-0ed73cb80924 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:48:59.749849 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7da69b69-be4f-4db3-8338-0ed73cb80924 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:48:59.750551 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7da69b69-be4f-4db3-8338-0ed73cb80924 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:48:59.751197 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7da69b69-be4f-4db3-8338-0ed73cb80924 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:00.025192 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7da69b69-be4f-4db3-8338-0ed73cb80924 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:00.041707 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7da69b69-be4f-4db3-8338-0ed73cb80924 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1308 microversion: 2.1 time: 0.316102 Sep 16 12:49:00.042323 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 463/877] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:48:59 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1308 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:00.061686 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c2cb9ef3-a6bf-4e2b-bdbb-e73ab4a5c0a1 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:00.062297 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c2cb9ef3-a6bf-4e2b-bdbb-e73ab4a5c0a1 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 1bdda11e-3b22-4d78-af62-8cc9a3915a4b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:00.080659 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2cb9ef3-a6bf-4e2b-bdbb-e73ab4a5c0a1 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:00.081071 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2cb9ef3-a6bf-4e2b-bdbb-e73ab4a5c0a1 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:00.081504 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2cb9ef3-a6bf-4e2b-bdbb-e73ab4a5c0a1 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:00.082216 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2cb9ef3-a6bf-4e2b-bdbb-e73ab4a5c0a1 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:00.082663 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2cb9ef3-a6bf-4e2b-bdbb-e73ab4a5c0a1 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:00.083080 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2cb9ef3-a6bf-4e2b-bdbb-e73ab4a5c0a1 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:00.097459 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:49:00.126471 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-fdab7396-ac2b-4668-98b3-573e265a4d87 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:49:00.127595 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-fdab7396-ac2b-4668-98b3-573e265a4d87 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:49:00.128364 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-fdab7396-ac2b-4668-98b3-573e265a4d87 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:49:00.128997 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-fdab7396-ac2b-4668-98b3-573e265a4d87 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:49:00.129667 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-fdab7396-ac2b-4668-98b3-573e265a4d87 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:49:00.140606 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=59 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:49:00.142406 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fdab7396-ac2b-4668-98b3-573e265a4d87 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:00.143008 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fdab7396-ac2b-4668-98b3-573e265a4d87 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:00.144752 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fdab7396-ac2b-4668-98b3-573e265a4d87 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:00.145427 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fdab7396-ac2b-4668-98b3-573e265a4d87 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:00.145990 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fdab7396-ac2b-4668-98b3-573e265a4d87 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:00.146535 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fdab7396-ac2b-4668-98b3-573e265a4d87 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:00.178872 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-fdab7396-ac2b-4668-98b3-573e265a4d87 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Getting quotas for project dd7ec914bffb4743921e4116b0c399eb. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:49:00.201670 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-fdab7396-ac2b-4668-98b3-573e265a4d87 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Getting quotas for user 745ef253e9844572a0f081955b3e9a90 and project dd7ec914bffb4743921e4116b0c399eb. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:49:00.220174 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-fdab7396-ac2b-4668-98b3-573e265a4d87 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:49:00.223954 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-fdab7396-ac2b-4668-98b3-573e265a4d87 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:49:00.296378 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-fdab7396-ac2b-4668-98b3-573e265a4d87 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.163697 Sep 16 12:49:00.304171 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 415/878] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:48:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 1172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:49:00.311148 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-63e7bc92-523c-43a3-9eb4-d3e3eb6aa609 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:00.312027 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-63e7bc92-523c-43a3-9eb4-d3e3eb6aa609 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:00.321260 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-63e7bc92-523c-43a3-9eb4-d3e3eb6aa609 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:00.322735 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-63e7bc92-523c-43a3-9eb4-d3e3eb6aa609 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:00.323531 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-63e7bc92-523c-43a3-9eb4-d3e3eb6aa609 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:00.324673 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-63e7bc92-523c-43a3-9eb4-d3e3eb6aa609 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:00.326282 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-63e7bc92-523c-43a3-9eb4-d3e3eb6aa609 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:00.327162 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-63e7bc92-523c-43a3-9eb4-d3e3eb6aa609 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:00.524619 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c2cb9ef3-a6bf-4e2b-bdbb-e73ab4a5c0a1 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:00.539275 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c2cb9ef3-a6bf-4e2b-bdbb-e73ab4a5c0a1 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b" status: 200 len: 1319 microversion: 2.1 time: 0.495797 Sep 16 12:49:00.540808 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 464/879] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:00 2022] GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b => generated 1319 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:00.562812 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7823a5b3-0595-4502-9501-9d8502123109 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:00.564378 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7823a5b3-0595-4502-9501-9d8502123109 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 38d079dd-9676-45f7-b286-16aa78d487bf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:00.588835 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7823a5b3-0595-4502-9501-9d8502123109 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:00.593160 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7823a5b3-0595-4502-9501-9d8502123109 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:00.593758 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7823a5b3-0595-4502-9501-9d8502123109 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:00.596537 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7823a5b3-0595-4502-9501-9d8502123109 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:00.597029 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7823a5b3-0595-4502-9501-9d8502123109 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:00.597464 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7823a5b3-0595-4502-9501-9d8502123109 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:00.676895 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-63e7bc92-523c-43a3-9eb4-d3e3eb6aa609 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:00.685549 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-63e7bc92-523c-43a3-9eb4-d3e3eb6aa609 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1313 microversion: 2.1 time: 0.378747 Sep 16 12:49:00.686797 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 416/880] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:00 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1313 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:00.702841 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-bd0f37c2-dd8e-4106-bcd7-b7dda930fd64 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:00.703455 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-bd0f37c2-dd8e-4106-bcd7-b7dda930fd64 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:00.732937 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bd0f37c2-dd8e-4106-bcd7-b7dda930fd64 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:00.733577 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bd0f37c2-dd8e-4106-bcd7-b7dda930fd64 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:00.734131 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bd0f37c2-dd8e-4106-bcd7-b7dda930fd64 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:00.735332 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bd0f37c2-dd8e-4106-bcd7-b7dda930fd64 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:00.735910 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bd0f37c2-dd8e-4106-bcd7-b7dda930fd64 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:00.736503 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bd0f37c2-dd8e-4106-bcd7-b7dda930fd64 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:00.936649 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7823a5b3-0595-4502-9501-9d8502123109 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709f71c239ca40b8b958038c9ab16f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7058e9e184834c39a5a299f481a6e62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:00.955184 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7823a5b3-0595-4502-9501-9d8502123109 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "GET /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf" status: 200 len: 1391 microversion: 2.1 time: 0.413111 Sep 16 12:49:00.957909 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 465/881] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:00 2022] GET /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf => generated 1391 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:00.969492 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c0edd775-d855-4e44-9510-03b046348305 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:00.970382 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c0edd775-d855-4e44-9510-03b046348305 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:01.070220 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c0edd775-d855-4e44-9510-03b046348305 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:01.089887 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c0edd775-d855-4e44-9510-03b046348305 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1233 microversion: 2.1 time: 0.128712 Sep 16 12:49:01.103619 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 466/882] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:00 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1233 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:01.103939 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-bd0f37c2-dd8e-4106-bcd7-b7dda930fd64 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fd28118c342529cda410e9587dfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a3e6c179c6495281c2816a1e18aa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:01.103939 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-bd0f37c2-dd8e-4106-bcd7-b7dda930fd64 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0" status: 200 len: 1371 microversion: 2.1 time: 0.411981 Sep 16 12:49:01.104167 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8ef48f5d-d875-41cf-95cd-6f2e7c19ffcd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:01.104261 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 417/883] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:00 2022] GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 => generated 1371 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:01.110332 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a39496b7-67a1-4291-89ea-b34f19c0e1a3 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:01.110332 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a39496b7-67a1-4291-89ea-b34f19c0e1a3 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] [instance: 8983b634-6da4-4830-b0f1-5835cc55083e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:01.113134 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8ef48f5d-d875-41cf-95cd-6f2e7c19ffcd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: 1b320dc8-1e79-4202-8162-0a418c6b1874] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:01.125692 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ef48f5d-d875-41cf-95cd-6f2e7c19ffcd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:01.127850 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a39496b7-67a1-4291-89ea-b34f19c0e1a3 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:01.128932 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a39496b7-67a1-4291-89ea-b34f19c0e1a3 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:01.129616 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a39496b7-67a1-4291-89ea-b34f19c0e1a3 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:01.130558 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a39496b7-67a1-4291-89ea-b34f19c0e1a3 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:01.131212 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a39496b7-67a1-4291-89ea-b34f19c0e1a3 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:01.131837 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a39496b7-67a1-4291-89ea-b34f19c0e1a3 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:01.133764 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ef48f5d-d875-41cf-95cd-6f2e7c19ffcd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:01.134441 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ef48f5d-d875-41cf-95cd-6f2e7c19ffcd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:01.136917 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ef48f5d-d875-41cf-95cd-6f2e7c19ffcd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:01.137645 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ef48f5d-d875-41cf-95cd-6f2e7c19ffcd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:01.138658 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ef48f5d-d875-41cf-95cd-6f2e7c19ffcd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:01.222598 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ef48f5d-d875-41cf-95cd-6f2e7c19ffcd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:01.223583 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ef48f5d-d875-41cf-95cd-6f2e7c19ffcd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:01.224265 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ef48f5d-d875-41cf-95cd-6f2e7c19ffcd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:01.224937 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-8ef48f5d-d875-41cf-95cd-6f2e7c19ffcd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lazy-loading 'fault' on Instance uuid 1b320dc8-1e79-4202-8162-0a418c6b1874 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:49:01.320457 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8ef48f5d-d875-41cf-95cd-6f2e7c19ffcd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:01.339654 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8ef48f5d-d875-41cf-95cd-6f2e7c19ffcd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874" status: 200 len: 1304 microversion: 2.1 time: 0.247653 Sep 16 12:49:01.340499 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 467/884] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:01 2022] GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874 => generated 1304 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:01.361782 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5bdddfbc-e3c9-4738-8344-eaf35cff234d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:01.362218 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5bdddfbc-e3c9-4738-8344-eaf35cff234d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:01.387573 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bdddfbc-e3c9-4738-8344-eaf35cff234d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:01.388332 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bdddfbc-e3c9-4738-8344-eaf35cff234d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:01.397169 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bdddfbc-e3c9-4738-8344-eaf35cff234d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:01.397169 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bdddfbc-e3c9-4738-8344-eaf35cff234d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:01.397169 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bdddfbc-e3c9-4738-8344-eaf35cff234d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:01.397169 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bdddfbc-e3c9-4738-8344-eaf35cff234d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:01.480798 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a39496b7-67a1-4291-89ea-b34f19c0e1a3 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd06a287a6b48f5a8a5ac30c0159fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3e2fe65ad744a2ba3b757f42f1d07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:01.492614 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a39496b7-67a1-4291-89ea-b34f19c0e1a3 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] 10.222.0.67 "GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e" status: 200 len: 1395 microversion: 2.1 time: 0.388954 Sep 16 12:49:01.500004 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 418/885] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:01 2022] GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e => generated 1395 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:01.507739 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-930cd78c-8208-403c-af7a-7601cd2d91d6 req-ca0131af-2b79-40a4-9591-b30606e04b7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38d079dd-9676-45f7-b286-16aa78d487bf", "name": "network-vif-plugged", "status": "completed", "tag": "3d903631-a9e4-424f-ad6d-35d838b2d04d"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:49:01.546979 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-930cd78c-8208-403c-af7a-7601cd2d91d6 req-ca0131af-2b79-40a4-9591-b30606e04b7e service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:01.547481 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-930cd78c-8208-403c-af7a-7601cd2d91d6 req-ca0131af-2b79-40a4-9591-b30606e04b7e service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:01.547921 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-930cd78c-8208-403c-af7a-7601cd2d91d6 req-ca0131af-2b79-40a4-9591-b30606e04b7e service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:01.576111 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-930cd78c-8208-403c-af7a-7601cd2d91d6 req-ca0131af-2b79-40a4-9591-b30606e04b7e service nova] Creating event network-vif-plugged:3d903631-a9e4-424f-ad6d-35d838b2d04d for instance 38d079dd-9676-45f7-b286-16aa78d487bf on n-h2-858094-4 Sep 16 12:49:01.591226 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-930cd78c-8208-403c-af7a-7601cd2d91d6 req-ca0131af-2b79-40a4-9591-b30606e04b7e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084632 Sep 16 12:49:01.593683 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 419/886] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:49:01.602388 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3aaba61a-6adb-46a4-9ef4-5a7fa4a8c557 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:01.608767 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3aaba61a-6adb-46a4-9ef4-5a7fa4a8c557 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 1bdda11e-3b22-4d78-af62-8cc9a3915a4b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:01.621432 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3aaba61a-6adb-46a4-9ef4-5a7fa4a8c557 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:01.622013 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3aaba61a-6adb-46a4-9ef4-5a7fa4a8c557 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:01.622514 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3aaba61a-6adb-46a4-9ef4-5a7fa4a8c557 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:01.625351 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3aaba61a-6adb-46a4-9ef4-5a7fa4a8c557 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:01.625918 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3aaba61a-6adb-46a4-9ef4-5a7fa4a8c557 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:01.626350 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3aaba61a-6adb-46a4-9ef4-5a7fa4a8c557 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:01.778099 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5bdddfbc-e3c9-4738-8344-eaf35cff234d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:01.802843 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5bdddfbc-e3c9-4738-8344-eaf35cff234d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1308 microversion: 2.1 time: 0.445305 Sep 16 12:49:01.806197 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 468/887] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:01 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1308 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:01.831309 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a5398408-3f35-467f-bfec-498986d43439 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:01.836808 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a5398408-3f35-467f-bfec-498986d43439 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:01.860654 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5398408-3f35-467f-bfec-498986d43439 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:01.869504 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5398408-3f35-467f-bfec-498986d43439 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:01.870341 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5398408-3f35-467f-bfec-498986d43439 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:01.874764 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5398408-3f35-467f-bfec-498986d43439 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:01.875559 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5398408-3f35-467f-bfec-498986d43439 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:01.876440 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5398408-3f35-467f-bfec-498986d43439 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:02.029468 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3aaba61a-6adb-46a4-9ef4-5a7fa4a8c557 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:02.045130 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3aaba61a-6adb-46a4-9ef4-5a7fa4a8c557 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b" status: 200 len: 1319 microversion: 2.1 time: 0.449845 Sep 16 12:49:02.045750 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 420/888] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:01 2022] GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b => generated 1319 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:02.050681 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5d4b66eb-9d9c-4cba-81a9-a4f6caf2e2d8 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:02.051297 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5d4b66eb-9d9c-4cba-81a9-a4f6caf2e2d8 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 38d079dd-9676-45f7-b286-16aa78d487bf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:02.063492 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5d4b66eb-9d9c-4cba-81a9-a4f6caf2e2d8 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:02.071705 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5d4b66eb-9d9c-4cba-81a9-a4f6caf2e2d8 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:02.072276 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5d4b66eb-9d9c-4cba-81a9-a4f6caf2e2d8 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:02.073033 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5d4b66eb-9d9c-4cba-81a9-a4f6caf2e2d8 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:02.073505 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5d4b66eb-9d9c-4cba-81a9-a4f6caf2e2d8 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:02.073969 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5d4b66eb-9d9c-4cba-81a9-a4f6caf2e2d8 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:02.123799 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a5398408-3f35-467f-bfec-498986d43439 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:02.140192 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a5398408-3f35-467f-bfec-498986d43439 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1313 microversion: 2.1 time: 0.331096 Sep 16 12:49:02.157364 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 469/889] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:01 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:02.162445 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-313482ce-67f2-4550-b223-3797cb56d7fb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:02.163061 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-313482ce-67f2-4550-b223-3797cb56d7fb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:02.185813 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-313482ce-67f2-4550-b223-3797cb56d7fb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:02.186410 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-313482ce-67f2-4550-b223-3797cb56d7fb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:02.187052 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-313482ce-67f2-4550-b223-3797cb56d7fb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:02.187851 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-313482ce-67f2-4550-b223-3797cb56d7fb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:02.188586 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-313482ce-67f2-4550-b223-3797cb56d7fb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:02.189099 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-313482ce-67f2-4550-b223-3797cb56d7fb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:02.277456 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5d4b66eb-9d9c-4cba-81a9-a4f6caf2e2d8 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709f71c239ca40b8b958038c9ab16f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7058e9e184834c39a5a299f481a6e62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:02.287893 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5d4b66eb-9d9c-4cba-81a9-a4f6caf2e2d8 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "GET /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf" status: 200 len: 1391 microversion: 2.1 time: 0.241059 Sep 16 12:49:02.309598 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 421/890] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:02 2022] GET /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf => generated 1391 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:02.315467 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2bb0f8c2-4e63-447d-8ac6-60ee8d524594 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:02.315993 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-313482ce-67f2-4550-b223-3797cb56d7fb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:02.316742 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-2bb0f8c2-4e63-447d-8ac6-60ee8d524594 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:02.329223 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2bb0f8c2-4e63-447d-8ac6-60ee8d524594 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:02.330428 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-313482ce-67f2-4550-b223-3797cb56d7fb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1237 microversion: 2.1 time: 0.170910 Sep 16 12:49:02.331083 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2bb0f8c2-4e63-447d-8ac6-60ee8d524594 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:02.331753 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2bb0f8c2-4e63-447d-8ac6-60ee8d524594 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:02.332393 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 470/891] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:02 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1237 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:02.333985 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2bb0f8c2-4e63-447d-8ac6-60ee8d524594 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:02.336414 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2bb0f8c2-4e63-447d-8ac6-60ee8d524594 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:02.336899 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2bb0f8c2-4e63-447d-8ac6-60ee8d524594 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:02.368917 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e68dee48-5816-4e86-9699-64f5c8798789 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:02.369607 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e68dee48-5816-4e86-9699-64f5c8798789 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: 1b320dc8-1e79-4202-8162-0a418c6b1874] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:02.379424 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e68dee48-5816-4e86-9699-64f5c8798789 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:02.379846 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e68dee48-5816-4e86-9699-64f5c8798789 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:02.380326 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e68dee48-5816-4e86-9699-64f5c8798789 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:02.381749 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e68dee48-5816-4e86-9699-64f5c8798789 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:02.382209 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e68dee48-5816-4e86-9699-64f5c8798789 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:02.382886 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e68dee48-5816-4e86-9699-64f5c8798789 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:02.427697 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e68dee48-5816-4e86-9699-64f5c8798789 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:02.427697 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e68dee48-5816-4e86-9699-64f5c8798789 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:02.427697 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e68dee48-5816-4e86-9699-64f5c8798789 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:02.427697 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-e68dee48-5816-4e86-9699-64f5c8798789 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lazy-loading 'fault' on Instance uuid 1b320dc8-1e79-4202-8162-0a418c6b1874 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:49:02.503845 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e68dee48-5816-4e86-9699-64f5c8798789 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:02.517118 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e68dee48-5816-4e86-9699-64f5c8798789 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874" status: 200 len: 1304 microversion: 2.1 time: 0.153588 Sep 16 12:49:02.521791 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 471/892] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:02 2022] GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874 => generated 1304 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:02.550992 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d24b4335-1252-46a3-8408-17a8271aa253 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:02.552202 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d24b4335-1252-46a3-8408-17a8271aa253 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] [instance: 8983b634-6da4-4830-b0f1-5835cc55083e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:02.560948 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d24b4335-1252-46a3-8408-17a8271aa253 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:02.564991 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d24b4335-1252-46a3-8408-17a8271aa253 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:02.565866 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d24b4335-1252-46a3-8408-17a8271aa253 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:02.566788 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d24b4335-1252-46a3-8408-17a8271aa253 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:02.567249 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d24b4335-1252-46a3-8408-17a8271aa253 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:02.567682 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d24b4335-1252-46a3-8408-17a8271aa253 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:02.598777 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-2bb0f8c2-4e63-447d-8ac6-60ee8d524594 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fd28118c342529cda410e9587dfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a3e6c179c6495281c2816a1e18aa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:02.611463 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2bb0f8c2-4e63-447d-8ac6-60ee8d524594 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0" status: 200 len: 1371 microversion: 2.1 time: 0.297080 Sep 16 12:49:02.630261 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 422/893] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:02 2022] GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 => generated 1371 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:02.754274 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d24b4335-1252-46a3-8408-17a8271aa253 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd06a287a6b48f5a8a5ac30c0159fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3e2fe65ad744a2ba3b757f42f1d07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:02.763407 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d24b4335-1252-46a3-8408-17a8271aa253 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] 10.222.0.67 "GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e" status: 200 len: 1395 microversion: 2.1 time: 0.221771 Sep 16 12:49:02.764616 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 472/894] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:02 2022] GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e => generated 1395 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:02.836990 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-86e466c1-fee9-42d3-bd67-c2da4661d8be tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:02.837616 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-86e466c1-fee9-42d3-bd67-c2da4661d8be tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:02.844256 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-86e466c1-fee9-42d3-bd67-c2da4661d8be tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:02.844754 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-86e466c1-fee9-42d3-bd67-c2da4661d8be tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:02.845193 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-86e466c1-fee9-42d3-bd67-c2da4661d8be tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:02.845904 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-86e466c1-fee9-42d3-bd67-c2da4661d8be tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:02.846359 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-86e466c1-fee9-42d3-bd67-c2da4661d8be tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:02.846783 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-86e466c1-fee9-42d3-bd67-c2da4661d8be tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:03.016477 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-86e466c1-fee9-42d3-bd67-c2da4661d8be tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:03.025695 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-86e466c1-fee9-42d3-bd67-c2da4661d8be tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1308 microversion: 2.1 time: 0.192770 Sep 16 12:49:03.026288 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 423/895] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:02 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1308 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:03.072317 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-02db99d2-c026-49ad-bde9-a6934cd0c4ea tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:03.072975 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-02db99d2-c026-49ad-bde9-a6934cd0c4ea tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 1bdda11e-3b22-4d78-af62-8cc9a3915a4b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:03.079639 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02db99d2-c026-49ad-bde9-a6934cd0c4ea tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:03.080139 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02db99d2-c026-49ad-bde9-a6934cd0c4ea tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:03.080758 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02db99d2-c026-49ad-bde9-a6934cd0c4ea tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:03.081708 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02db99d2-c026-49ad-bde9-a6934cd0c4ea tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:03.082159 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02db99d2-c026-49ad-bde9-a6934cd0c4ea tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:03.082585 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02db99d2-c026-49ad-bde9-a6934cd0c4ea tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:03.166742 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e41e248c-1774-4a4a-8405-4cf58d73e1c3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:03.167278 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e41e248c-1774-4a4a-8405-4cf58d73e1c3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:03.173570 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e41e248c-1774-4a4a-8405-4cf58d73e1c3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:03.174057 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e41e248c-1774-4a4a-8405-4cf58d73e1c3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:03.174482 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e41e248c-1774-4a4a-8405-4cf58d73e1c3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:03.175440 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e41e248c-1774-4a4a-8405-4cf58d73e1c3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:03.175882 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e41e248c-1774-4a4a-8405-4cf58d73e1c3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:03.176331 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e41e248c-1774-4a4a-8405-4cf58d73e1c3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:03.264917 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-02db99d2-c026-49ad-bde9-a6934cd0c4ea tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:03.272843 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-02db99d2-c026-49ad-bde9-a6934cd0c4ea tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b" status: 200 len: 1319 microversion: 2.1 time: 0.205085 Sep 16 12:49:03.274073 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 473/896] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:03 2022] GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b => generated 1319 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:03.316876 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6d795191-bb2a-4ecf-b9aa-f6d2ab16a6d0 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:03.317577 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6d795191-bb2a-4ecf-b9aa-f6d2ab16a6d0 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 38d079dd-9676-45f7-b286-16aa78d487bf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:03.324718 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d795191-bb2a-4ecf-b9aa-f6d2ab16a6d0 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:03.324718 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d795191-bb2a-4ecf-b9aa-f6d2ab16a6d0 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:03.325248 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d795191-bb2a-4ecf-b9aa-f6d2ab16a6d0 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:03.326006 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d795191-bb2a-4ecf-b9aa-f6d2ab16a6d0 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:03.326587 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d795191-bb2a-4ecf-b9aa-f6d2ab16a6d0 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:03.327106 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d795191-bb2a-4ecf-b9aa-f6d2ab16a6d0 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:03.337287 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e41e248c-1774-4a4a-8405-4cf58d73e1c3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:03.345021 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e41e248c-1774-4a4a-8405-4cf58d73e1c3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1313 microversion: 2.1 time: 0.183609 Sep 16 12:49:03.345868 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 424/897] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:03 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:03.369539 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9ecd8aa7-be3e-42c7-8d6a-c842efd5c9a6 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:03.370176 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9ecd8aa7-be3e-42c7-8d6a-c842efd5c9a6 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:03.376635 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9ecd8aa7-be3e-42c7-8d6a-c842efd5c9a6 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:03.377056 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9ecd8aa7-be3e-42c7-8d6a-c842efd5c9a6 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:03.377819 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9ecd8aa7-be3e-42c7-8d6a-c842efd5c9a6 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:03.378188 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9ecd8aa7-be3e-42c7-8d6a-c842efd5c9a6 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:03.378812 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9ecd8aa7-be3e-42c7-8d6a-c842efd5c9a6 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:03.379093 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9ecd8aa7-be3e-42c7-8d6a-c842efd5c9a6 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:03.463078 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9ecd8aa7-be3e-42c7-8d6a-c842efd5c9a6 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:03.470713 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9ecd8aa7-be3e-42c7-8d6a-c842efd5c9a6 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1237 microversion: 2.1 time: 0.105862 Sep 16 12:49:03.471453 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 425/898] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:03 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1237 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:03.493368 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6d795191-bb2a-4ecf-b9aa-f6d2ab16a6d0 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709f71c239ca40b8b958038c9ab16f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7058e9e184834c39a5a299f481a6e62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:03.501780 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6d795191-bb2a-4ecf-b9aa-f6d2ab16a6d0 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "GET /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf" status: 200 len: 1589 microversion: 2.1 time: 0.188859 Sep 16 12:49:03.502343 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 474/899] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:03 2022] GET /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf => generated 1589 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:03.525422 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8ca148a6-804a-44ba-abaa-386359acfeb7 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:03.525850 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8ca148a6-804a-44ba-abaa-386359acfeb7 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 38d079dd-9676-45f7-b286-16aa78d487bf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:03.531839 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8ca148a6-804a-44ba-abaa-386359acfeb7 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:03.532354 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8ca148a6-804a-44ba-abaa-386359acfeb7 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:03.532791 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8ca148a6-804a-44ba-abaa-386359acfeb7 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:03.533490 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8ca148a6-804a-44ba-abaa-386359acfeb7 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:03.534285 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8ca148a6-804a-44ba-abaa-386359acfeb7 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:03.535857 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8ca148a6-804a-44ba-abaa-386359acfeb7 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:03.553622 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-75864420-f6bd-4785-b1e3-78dc06c120bd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:03.554228 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-75864420-f6bd-4785-b1e3-78dc06c120bd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: 1b320dc8-1e79-4202-8162-0a418c6b1874] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:03.560901 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75864420-f6bd-4785-b1e3-78dc06c120bd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:03.561383 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75864420-f6bd-4785-b1e3-78dc06c120bd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:03.561821 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75864420-f6bd-4785-b1e3-78dc06c120bd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:03.562508 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75864420-f6bd-4785-b1e3-78dc06c120bd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:03.562957 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75864420-f6bd-4785-b1e3-78dc06c120bd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:03.563374 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75864420-f6bd-4785-b1e3-78dc06c120bd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:03.596426 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75864420-f6bd-4785-b1e3-78dc06c120bd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:03.596907 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75864420-f6bd-4785-b1e3-78dc06c120bd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:03.597336 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75864420-f6bd-4785-b1e3-78dc06c120bd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:03.597779 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-75864420-f6bd-4785-b1e3-78dc06c120bd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lazy-loading 'fault' on Instance uuid 1b320dc8-1e79-4202-8162-0a418c6b1874 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:49:03.615707 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8ca148a6-804a-44ba-abaa-386359acfeb7 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "GET /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095234 Sep 16 12:49:03.616387 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 426/900] 10.222.0.67 () {58 vars in 1275 bytes} [Fri Sep 16 12:49:03 2022] GET /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:49:03.620918 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-4935c65f-cd0c-4e53-bf0f-a1e4df7ee599 req-e04d9ebe-6282-47f4-89f7-853f2c358bfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dacfa868-1c8b-4918-8797-f31caee29361", "name": "network-vif-plugged", "status": "completed", "tag": "fabffdb4-d14b-4b3e-bbe3-09f69928ff1e"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:49:03.632411 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-4935c65f-cd0c-4e53-bf0f-a1e4df7ee599 req-e04d9ebe-6282-47f4-89f7-853f2c358bfd service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:03.632915 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-4935c65f-cd0c-4e53-bf0f-a1e4df7ee599 req-e04d9ebe-6282-47f4-89f7-853f2c358bfd service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:03.633328 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-4935c65f-cd0c-4e53-bf0f-a1e4df7ee599 req-e04d9ebe-6282-47f4-89f7-853f2c358bfd service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:03.645446 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-4935c65f-cd0c-4e53-bf0f-a1e4df7ee599 req-e04d9ebe-6282-47f4-89f7-853f2c358bfd service nova] Creating event network-vif-plugged:fabffdb4-d14b-4b3e-bbe3-09f69928ff1e for instance dacfa868-1c8b-4918-8797-f31caee29361 on n-h1-858094-4 Sep 16 12:49:03.647464 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-75864420-f6bd-4785-b1e3-78dc06c120bd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:03.651227 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-4935c65f-cd0c-4e53-bf0f-a1e4df7ee599 req-e04d9ebe-6282-47f4-89f7-853f2c358bfd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033576 Sep 16 12:49:03.651686 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 427/901] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:49:03.657613 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8e490992-f21d-4c16-a756-6c81c1dc6b88 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:03.658470 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8e490992-f21d-4c16-a756-6c81c1dc6b88 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:03.659721 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-75864420-f6bd-4785-b1e3-78dc06c120bd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874" status: 200 len: 1304 microversion: 2.1 time: 0.110183 Sep 16 12:49:03.660395 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 475/902] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:03 2022] GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874 => generated 1304 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:03.666190 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8e490992-f21d-4c16-a756-6c81c1dc6b88 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:03.666685 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8e490992-f21d-4c16-a756-6c81c1dc6b88 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:03.667106 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8e490992-f21d-4c16-a756-6c81c1dc6b88 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:03.667859 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8e490992-f21d-4c16-a756-6c81c1dc6b88 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:03.668413 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8e490992-f21d-4c16-a756-6c81c1dc6b88 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:03.668852 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8e490992-f21d-4c16-a756-6c81c1dc6b88 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:03.787409 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d677cd9d-2c1a-479b-b919-c050d761d538 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:03.788017 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d677cd9d-2c1a-479b-b919-c050d761d538 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] [instance: 8983b634-6da4-4830-b0f1-5835cc55083e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:03.795229 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d677cd9d-2c1a-479b-b919-c050d761d538 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:03.795769 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d677cd9d-2c1a-479b-b919-c050d761d538 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:03.796430 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d677cd9d-2c1a-479b-b919-c050d761d538 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:03.797135 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d677cd9d-2c1a-479b-b919-c050d761d538 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:03.797587 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d677cd9d-2c1a-479b-b919-c050d761d538 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:03.798008 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d677cd9d-2c1a-479b-b919-c050d761d538 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:03.812230 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8e490992-f21d-4c16-a756-6c81c1dc6b88 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fd28118c342529cda410e9587dfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a3e6c179c6495281c2816a1e18aa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:03.821536 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8e490992-f21d-4c16-a756-6c81c1dc6b88 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0" status: 200 len: 1371 microversion: 2.1 time: 0.167922 Sep 16 12:49:03.822465 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 428/903] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:03 2022] GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:03.933677 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d677cd9d-2c1a-479b-b919-c050d761d538 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd06a287a6b48f5a8a5ac30c0159fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3e2fe65ad744a2ba3b757f42f1d07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:03.941576 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d677cd9d-2c1a-479b-b919-c050d761d538 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] 10.222.0.67 "GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e" status: 200 len: 1395 microversion: 2.1 time: 0.158399 Sep 16 12:49:03.942321 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 476/904] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:03 2022] GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e => generated 1395 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:04.050416 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9bab906b-ac7a-4db8-bf42-917b1bd20b8c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:04.051404 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9bab906b-ac7a-4db8-bf42-917b1bd20b8c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:04.059205 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9bab906b-ac7a-4db8-bf42-917b1bd20b8c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:04.059693 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9bab906b-ac7a-4db8-bf42-917b1bd20b8c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:04.060350 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9bab906b-ac7a-4db8-bf42-917b1bd20b8c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:04.061487 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9bab906b-ac7a-4db8-bf42-917b1bd20b8c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:04.061936 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9bab906b-ac7a-4db8-bf42-917b1bd20b8c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:04.062349 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9bab906b-ac7a-4db8-bf42-917b1bd20b8c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:04.211161 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9bab906b-ac7a-4db8-bf42-917b1bd20b8c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:04.221272 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9bab906b-ac7a-4db8-bf42-917b1bd20b8c tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1308 microversion: 2.1 time: 0.175230 Sep 16 12:49:04.228486 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 429/905] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:04 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1308 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:04.296541 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-973d7763-a298-4de8-8e0e-d18a223dca6e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:04.297154 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-973d7763-a298-4de8-8e0e-d18a223dca6e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 1bdda11e-3b22-4d78-af62-8cc9a3915a4b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:04.304071 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-973d7763-a298-4de8-8e0e-d18a223dca6e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:04.304604 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-973d7763-a298-4de8-8e0e-d18a223dca6e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:04.305616 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-973d7763-a298-4de8-8e0e-d18a223dca6e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:04.306323 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-973d7763-a298-4de8-8e0e-d18a223dca6e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:04.306780 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-973d7763-a298-4de8-8e0e-d18a223dca6e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:04.307208 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-973d7763-a298-4de8-8e0e-d18a223dca6e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:04.372814 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-bbd76635-7c5d-4493-ace1-33f402f728ba tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:04.373548 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-bbd76635-7c5d-4493-ace1-33f402f728ba tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:04.380899 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bbd76635-7c5d-4493-ace1-33f402f728ba tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:04.380899 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bbd76635-7c5d-4493-ace1-33f402f728ba tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:04.381253 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bbd76635-7c5d-4493-ace1-33f402f728ba tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:04.381728 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bbd76635-7c5d-4493-ace1-33f402f728ba tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:04.382185 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bbd76635-7c5d-4493-ace1-33f402f728ba tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:04.382610 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bbd76635-7c5d-4493-ace1-33f402f728ba tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:04.491096 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-973d7763-a298-4de8-8e0e-d18a223dca6e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:04.499638 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-973d7763-a298-4de8-8e0e-d18a223dca6e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b" status: 200 len: 1319 microversion: 2.1 time: 0.207054 Sep 16 12:49:04.500603 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 477/906] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:04 2022] GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:04.505250 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e8b40f2a-b743-4968-8d67-f1b9930866c4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:04.505862 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e8b40f2a-b743-4968-8d67-f1b9930866c4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:04.512823 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8b40f2a-b743-4968-8d67-f1b9930866c4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:04.513322 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8b40f2a-b743-4968-8d67-f1b9930866c4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:04.513766 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8b40f2a-b743-4968-8d67-f1b9930866c4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:04.514479 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8b40f2a-b743-4968-8d67-f1b9930866c4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:04.514937 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8b40f2a-b743-4968-8d67-f1b9930866c4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:04.515368 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8b40f2a-b743-4968-8d67-f1b9930866c4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:04.546591 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-bbd76635-7c5d-4493-ace1-33f402f728ba tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:04.555821 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-bbd76635-7c5d-4493-ace1-33f402f728ba tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1313 microversion: 2.1 time: 0.186426 Sep 16 12:49:04.556936 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 430/907] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:04 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:04.578994 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e8b40f2a-b743-4968-8d67-f1b9930866c4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:04.588329 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e8b40f2a-b743-4968-8d67-f1b9930866c4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1237 microversion: 2.1 time: 0.086511 Sep 16 12:49:04.589384 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 478/908] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:04 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1237 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:04.683550 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e1d78fa5-3487-4564-be80-63604689fe4b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:04.684190 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e1d78fa5-3487-4564-be80-63604689fe4b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: 1b320dc8-1e79-4202-8162-0a418c6b1874] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:04.690226 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1d78fa5-3487-4564-be80-63604689fe4b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:04.690768 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1d78fa5-3487-4564-be80-63604689fe4b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:04.691209 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1d78fa5-3487-4564-be80-63604689fe4b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:04.691904 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1d78fa5-3487-4564-be80-63604689fe4b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:04.692381 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1d78fa5-3487-4564-be80-63604689fe4b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:04.692807 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1d78fa5-3487-4564-be80-63604689fe4b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:04.723970 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1d78fa5-3487-4564-be80-63604689fe4b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:04.724497 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1d78fa5-3487-4564-be80-63604689fe4b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:04.724935 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1d78fa5-3487-4564-be80-63604689fe4b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:04.725388 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-e1d78fa5-3487-4564-be80-63604689fe4b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lazy-loading 'fault' on Instance uuid 1b320dc8-1e79-4202-8162-0a418c6b1874 {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:49:04.767757 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e1d78fa5-3487-4564-be80-63604689fe4b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:04.775692 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e1d78fa5-3487-4564-be80-63604689fe4b tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874" status: 200 len: 1304 microversion: 2.1 time: 0.096674 Sep 16 12:49:04.776300 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 431/909] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:04 2022] GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:04.845413 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-79f385d2-adef-4df9-a8d7-87abf81bab23 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:04.846202 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-79f385d2-adef-4df9-a8d7-87abf81bab23 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:04.853600 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79f385d2-adef-4df9-a8d7-87abf81bab23 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:04.854097 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79f385d2-adef-4df9-a8d7-87abf81bab23 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:04.854537 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79f385d2-adef-4df9-a8d7-87abf81bab23 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:04.855258 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79f385d2-adef-4df9-a8d7-87abf81bab23 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:04.855716 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79f385d2-adef-4df9-a8d7-87abf81bab23 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:04.856161 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79f385d2-adef-4df9-a8d7-87abf81bab23 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:04.967181 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-abe13853-3cc1-4ef0-bbfa-02f9eeeefe54 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:04.968690 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-abe13853-3cc1-4ef0-bbfa-02f9eeeefe54 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] [instance: 8983b634-6da4-4830-b0f1-5835cc55083e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:04.977698 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-abe13853-3cc1-4ef0-bbfa-02f9eeeefe54 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:04.978491 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-abe13853-3cc1-4ef0-bbfa-02f9eeeefe54 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:04.978935 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-abe13853-3cc1-4ef0-bbfa-02f9eeeefe54 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:04.979645 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-abe13853-3cc1-4ef0-bbfa-02f9eeeefe54 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:04.980099 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-abe13853-3cc1-4ef0-bbfa-02f9eeeefe54 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:04.980557 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-abe13853-3cc1-4ef0-bbfa-02f9eeeefe54 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:05.002030 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=100 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:49:05.008696 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-79f385d2-adef-4df9-a8d7-87abf81bab23 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fd28118c342529cda410e9587dfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a3e6c179c6495281c2816a1e18aa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:05.017042 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-79f385d2-adef-4df9-a8d7-87abf81bab23 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0" status: 200 len: 1371 microversion: 2.1 time: 0.175558 Sep 16 12:49:05.025772 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 479/910] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:04 2022] GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 => generated 1371 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:05.076270 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-496fd199-13d0-4aa5-8dc1-33320007f567 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:05.076898 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-496fd199-13d0-4aa5-8dc1-33320007f567 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 38d079dd-9676-45f7-b286-16aa78d487bf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:05.083270 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-496fd199-13d0-4aa5-8dc1-33320007f567 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:05.083767 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-496fd199-13d0-4aa5-8dc1-33320007f567 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:05.084239 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-496fd199-13d0-4aa5-8dc1-33320007f567 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:05.085026 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-496fd199-13d0-4aa5-8dc1-33320007f567 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:05.085492 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-496fd199-13d0-4aa5-8dc1-33320007f567 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:05.086525 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-496fd199-13d0-4aa5-8dc1-33320007f567 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:05.139256 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-abe13853-3cc1-4ef0-bbfa-02f9eeeefe54 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd06a287a6b48f5a8a5ac30c0159fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3e2fe65ad744a2ba3b757f42f1d07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:05.147134 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-abe13853-3cc1-4ef0-bbfa-02f9eeeefe54 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] 10.222.0.67 "GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e" status: 200 len: 1395 microversion: 2.1 time: 0.183827 Sep 16 12:49:05.156215 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 432/911] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:04 2022] GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e => generated 1395 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:05.156215 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-7964c2c2-a62b-4ff0-8c01-1269786ecc22 req-43a63eb0-cb27-440c-afac-b85c630ed5c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38d079dd-9676-45f7-b286-16aa78d487bf", "tag": "3d903631-a9e4-424f-ad6d-35d838b2d04d"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:49:05.164940 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-7964c2c2-a62b-4ff0-8c01-1269786ecc22 req-43a63eb0-cb27-440c-afac-b85c630ed5c1 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:05.165843 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-7964c2c2-a62b-4ff0-8c01-1269786ecc22 req-43a63eb0-cb27-440c-afac-b85c630ed5c1 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:05.166311 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-7964c2c2-a62b-4ff0-8c01-1269786ecc22 req-43a63eb0-cb27-440c-afac-b85c630ed5c1 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:05.178373 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-7964c2c2-a62b-4ff0-8c01-1269786ecc22 req-43a63eb0-cb27-440c-afac-b85c630ed5c1 service nova] Creating event network-changed:3d903631-a9e4-424f-ad6d-35d838b2d04d for instance 38d079dd-9676-45f7-b286-16aa78d487bf on n-h2-858094-4 Sep 16 12:49:05.183864 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-7964c2c2-a62b-4ff0-8c01-1269786ecc22 req-43a63eb0-cb27-440c-afac-b85c630ed5c1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034215 Sep 16 12:49:05.184589 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 433/912] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:49:05.245877 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a52af2b0-28d3-4e06-847c-1fd76d18cac0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:05.246931 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a52af2b0-28d3-4e06-847c-1fd76d18cac0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:05.248754 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-496fd199-13d0-4aa5-8dc1-33320007f567 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709f71c239ca40b8b958038c9ab16f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7058e9e184834c39a5a299f481a6e62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:05.255132 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a52af2b0-28d3-4e06-847c-1fd76d18cac0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:05.255876 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a52af2b0-28d3-4e06-847c-1fd76d18cac0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:05.256538 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a52af2b0-28d3-4e06-847c-1fd76d18cac0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:05.257634 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a52af2b0-28d3-4e06-847c-1fd76d18cac0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:05.258209 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:49:05.258357 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a52af2b0-28d3-4e06-847c-1fd76d18cac0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:05.259056 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a52af2b0-28d3-4e06-847c-1fd76d18cac0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:05.265685 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-496fd199-13d0-4aa5-8dc1-33320007f567 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "GET /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf" status: 200 len: 1589 microversion: 2.1 time: 0.193444 Sep 16 12:49:05.266731 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 480/913] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:05 2022] GET /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf => generated 1589 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:05.412788 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a52af2b0-28d3-4e06-847c-1fd76d18cac0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:05.421305 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a52af2b0-28d3-4e06-847c-1fd76d18cac0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1308 microversion: 2.1 time: 0.180125 Sep 16 12:49:05.422151 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 434/914] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:05 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1308 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:05.523143 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7930a4f1-6fc9-4a79-af4a-4cdbe38b48a5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:05.524623 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7930a4f1-6fc9-4a79-af4a-4cdbe38b48a5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 1bdda11e-3b22-4d78-af62-8cc9a3915a4b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:05.531424 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7930a4f1-6fc9-4a79-af4a-4cdbe38b48a5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:05.532080 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7930a4f1-6fc9-4a79-af4a-4cdbe38b48a5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:05.532552 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7930a4f1-6fc9-4a79-af4a-4cdbe38b48a5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:05.533337 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7930a4f1-6fc9-4a79-af4a-4cdbe38b48a5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:05.533798 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7930a4f1-6fc9-4a79-af4a-4cdbe38b48a5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:05.534243 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7930a4f1-6fc9-4a79-af4a-4cdbe38b48a5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:05.578914 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9d3855b8-2aec-46c4-94ee-2dba8f9762a0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:05.579868 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9d3855b8-2aec-46c4-94ee-2dba8f9762a0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:05.586642 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9d3855b8-2aec-46c4-94ee-2dba8f9762a0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:05.587142 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9d3855b8-2aec-46c4-94ee-2dba8f9762a0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:05.587588 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9d3855b8-2aec-46c4-94ee-2dba8f9762a0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:05.588335 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9d3855b8-2aec-46c4-94ee-2dba8f9762a0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:05.588791 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9d3855b8-2aec-46c4-94ee-2dba8f9762a0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:05.589218 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9d3855b8-2aec-46c4-94ee-2dba8f9762a0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:05.739259 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7930a4f1-6fc9-4a79-af4a-4cdbe38b48a5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:05.753393 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7930a4f1-6fc9-4a79-af4a-4cdbe38b48a5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b" status: 200 len: 1319 microversion: 2.1 time: 0.233807 Sep 16 12:49:05.755350 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 481/915] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:05 2022] GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:05.763796 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-87c7a348-1a7c-4a18-9650-779174ab3ddf tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:05.764761 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-87c7a348-1a7c-4a18-9650-779174ab3ddf tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:05.777678 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9d3855b8-2aec-46c4-94ee-2dba8f9762a0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:05.782628 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87c7a348-1a7c-4a18-9650-779174ab3ddf tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:05.787407 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9d3855b8-2aec-46c4-94ee-2dba8f9762a0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1313 microversion: 2.1 time: 0.212222 Sep 16 12:49:05.788043 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 435/916] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:05 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:05.789896 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87c7a348-1a7c-4a18-9650-779174ab3ddf tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:05.790350 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87c7a348-1a7c-4a18-9650-779174ab3ddf tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:05.791078 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87c7a348-1a7c-4a18-9650-779174ab3ddf tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:05.791525 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87c7a348-1a7c-4a18-9650-779174ab3ddf tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:05.791944 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87c7a348-1a7c-4a18-9650-779174ab3ddf tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:05.800379 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-fea0dd14-fc15-4d88-ab18-527f91b6f99d req-cd01ec7e-31d1-4394-b1c4-715d36024e6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8983b634-6da4-4830-b0f1-5835cc55083e", "name": "network-vif-plugged", "status": "completed", "tag": "f5de57d0-58b1-4bb4-be3d-a6d88fd93f21"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:49:05.812968 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-fea0dd14-fc15-4d88-ab18-527f91b6f99d req-cd01ec7e-31d1-4394-b1c4-715d36024e6a service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:05.813612 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-fea0dd14-fc15-4d88-ab18-527f91b6f99d req-cd01ec7e-31d1-4394-b1c4-715d36024e6a service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:05.814053 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-fea0dd14-fc15-4d88-ab18-527f91b6f99d req-cd01ec7e-31d1-4394-b1c4-715d36024e6a service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:05.831127 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-fea0dd14-fc15-4d88-ab18-527f91b6f99d req-cd01ec7e-31d1-4394-b1c4-715d36024e6a service nova] Creating event network-vif-plugged:f5de57d0-58b1-4bb4-be3d-a6d88fd93f21 for instance 8983b634-6da4-4830-b0f1-5835cc55083e on n-h2-858094-4 Sep 16 12:49:05.838410 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-fea0dd14-fc15-4d88-ab18-527f91b6f99d req-cd01ec7e-31d1-4394-b1c4-715d36024e6a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049118 Sep 16 12:49:05.839302 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 436/917] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:49:05.844286 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-44beddae-edce-4459-a84b-5aaeccf7eed3 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:05.844995 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-44beddae-edce-4459-a84b-5aaeccf7eed3 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: 1b320dc8-1e79-4202-8162-0a418c6b1874] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:05.854498 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-44beddae-edce-4459-a84b-5aaeccf7eed3 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:05.855011 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-44beddae-edce-4459-a84b-5aaeccf7eed3 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:05.856258 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-44beddae-edce-4459-a84b-5aaeccf7eed3 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:05.857509 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-44beddae-edce-4459-a84b-5aaeccf7eed3 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:05.858549 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-44beddae-edce-4459-a84b-5aaeccf7eed3 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:05.859365 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-44beddae-edce-4459-a84b-5aaeccf7eed3 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:05.879902 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-87c7a348-1a7c-4a18-9650-779174ab3ddf tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:05.890069 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-87c7a348-1a7c-4a18-9650-779174ab3ddf tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1237 microversion: 2.1 time: 0.132310 Sep 16 12:49:05.891209 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 482/918] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:05 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1237 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:05.899696 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-44beddae-edce-4459-a84b-5aaeccf7eed3 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:05.900749 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-44beddae-edce-4459-a84b-5aaeccf7eed3 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:05.901351 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-44beddae-edce-4459-a84b-5aaeccf7eed3 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:05.902007 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-44beddae-edce-4459-a84b-5aaeccf7eed3 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lazy-loading 'fault' on Instance uuid 1b320dc8-1e79-4202-8162-0a418c6b1874 {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:49:05.958063 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-44beddae-edce-4459-a84b-5aaeccf7eed3 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:05.972971 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-44beddae-edce-4459-a84b-5aaeccf7eed3 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874" status: 200 len: 1304 microversion: 2.1 time: 0.132635 Sep 16 12:49:05.975505 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 437/919] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:05 2022] GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874 => generated 1304 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:06.040622 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c2a0f391-fbe0-4d1d-a92c-c77e35e1e90d tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:06.041378 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c2a0f391-fbe0-4d1d-a92c-c77e35e1e90d tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:06.047751 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2a0f391-fbe0-4d1d-a92c-c77e35e1e90d tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:06.048340 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2a0f391-fbe0-4d1d-a92c-c77e35e1e90d tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:06.048774 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2a0f391-fbe0-4d1d-a92c-c77e35e1e90d tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:06.049534 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2a0f391-fbe0-4d1d-a92c-c77e35e1e90d tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:06.050330 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2a0f391-fbe0-4d1d-a92c-c77e35e1e90d tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:06.050753 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2a0f391-fbe0-4d1d-a92c-c77e35e1e90d tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:06.172791 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-da8a706d-41f7-4655-b396-1d575adf9f38 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:06.173738 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-da8a706d-41f7-4655-b396-1d575adf9f38 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] [instance: 8983b634-6da4-4830-b0f1-5835cc55083e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:06.181427 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-da8a706d-41f7-4655-b396-1d575adf9f38 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:06.182045 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-da8a706d-41f7-4655-b396-1d575adf9f38 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:06.182556 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-da8a706d-41f7-4655-b396-1d575adf9f38 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:06.183416 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-da8a706d-41f7-4655-b396-1d575adf9f38 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:06.184157 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-da8a706d-41f7-4655-b396-1d575adf9f38 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:06.184553 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-da8a706d-41f7-4655-b396-1d575adf9f38 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:06.206622 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c2a0f391-fbe0-4d1d-a92c-c77e35e1e90d tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fd28118c342529cda410e9587dfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a3e6c179c6495281c2816a1e18aa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:06.218304 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c2a0f391-fbe0-4d1d-a92c-c77e35e1e90d tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0" status: 200 len: 1371 microversion: 2.1 time: 0.183059 Sep 16 12:49:06.219299 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 483/920] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:06 2022] GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 => generated 1371 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:06.328527 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-da8a706d-41f7-4655-b396-1d575adf9f38 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd06a287a6b48f5a8a5ac30c0159fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3e2fe65ad744a2ba3b757f42f1d07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:06.337557 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-da8a706d-41f7-4655-b396-1d575adf9f38 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] 10.222.0.67 "GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e" status: 200 len: 1395 microversion: 2.1 time: 0.169042 Sep 16 12:49:06.338060 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 438/921] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:06 2022] GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e => generated 1395 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:06.444568 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4709ab17-c460-46a1-8886-52a67ef102c0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:06.445173 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4709ab17-c460-46a1-8886-52a67ef102c0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:06.452044 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4709ab17-c460-46a1-8886-52a67ef102c0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:06.452558 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4709ab17-c460-46a1-8886-52a67ef102c0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:06.452988 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4709ab17-c460-46a1-8886-52a67ef102c0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:06.453711 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4709ab17-c460-46a1-8886-52a67ef102c0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:06.454151 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4709ab17-c460-46a1-8886-52a67ef102c0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:06.454567 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4709ab17-c460-46a1-8886-52a67ef102c0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:06.591304 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4709ab17-c460-46a1-8886-52a67ef102c0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:06.599184 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4709ab17-c460-46a1-8886-52a67ef102c0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1308 microversion: 2.1 time: 0.158405 Sep 16 12:49:06.599746 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 484/922] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:06 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1308 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:06.780439 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-92ce98b9-c410-44ed-8a53-a6a167d9a23f tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:06.781042 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-92ce98b9-c410-44ed-8a53-a6a167d9a23f tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 1bdda11e-3b22-4d78-af62-8cc9a3915a4b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:06.787608 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92ce98b9-c410-44ed-8a53-a6a167d9a23f tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:06.788029 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92ce98b9-c410-44ed-8a53-a6a167d9a23f tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:06.788488 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92ce98b9-c410-44ed-8a53-a6a167d9a23f tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:06.789709 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92ce98b9-c410-44ed-8a53-a6a167d9a23f tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:06.790383 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92ce98b9-c410-44ed-8a53-a6a167d9a23f tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:06.790731 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92ce98b9-c410-44ed-8a53-a6a167d9a23f tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:06.812205 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5ddde57c-09b5-4faa-a82a-ed53e6627d81 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:06.813222 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5ddde57c-09b5-4faa-a82a-ed53e6627d81 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:06.819498 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ddde57c-09b5-4faa-a82a-ed53e6627d81 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:06.820302 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ddde57c-09b5-4faa-a82a-ed53e6627d81 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:06.820892 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ddde57c-09b5-4faa-a82a-ed53e6627d81 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:06.822316 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ddde57c-09b5-4faa-a82a-ed53e6627d81 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:06.822850 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ddde57c-09b5-4faa-a82a-ed53e6627d81 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:06.823430 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ddde57c-09b5-4faa-a82a-ed53e6627d81 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:07.230749 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5ddde57c-09b5-4faa-a82a-ed53e6627d81 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:07.236356 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-92ce98b9-c410-44ed-8a53-a6a167d9a23f tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:07.240971 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5ddde57c-09b5-4faa-a82a-ed53e6627d81 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1313 microversion: 2.1 time: 0.433104 Sep 16 12:49:07.242769 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 485/923] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:06 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1313 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:07.251155 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-92ce98b9-c410-44ed-8a53-a6a167d9a23f tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b" status: 200 len: 1319 microversion: 2.1 time: 0.474369 Sep 16 12:49:07.252497 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 439/924] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:06 2022] GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b => generated 1319 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:07.255400 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4b7d294a-cdff-4143-861c-36435a99911c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:07.256029 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4b7d294a-cdff-4143-861c-36435a99911c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:07.260497 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-064052dc-94e3-4a27-ba79-aaa3a20cee62 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:07.261515 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-064052dc-94e3-4a27-ba79-aaa3a20cee62 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: 1b320dc8-1e79-4202-8162-0a418c6b1874] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:07.264594 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b7d294a-cdff-4143-861c-36435a99911c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:07.265145 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b7d294a-cdff-4143-861c-36435a99911c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:07.267342 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b7d294a-cdff-4143-861c-36435a99911c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:07.268072 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b7d294a-cdff-4143-861c-36435a99911c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:07.269332 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b7d294a-cdff-4143-861c-36435a99911c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:07.269938 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b7d294a-cdff-4143-861c-36435a99911c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:07.275598 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-064052dc-94e3-4a27-ba79-aaa3a20cee62 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:07.276957 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-064052dc-94e3-4a27-ba79-aaa3a20cee62 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:07.277501 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-064052dc-94e3-4a27-ba79-aaa3a20cee62 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:07.278320 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-064052dc-94e3-4a27-ba79-aaa3a20cee62 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:07.278882 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-064052dc-94e3-4a27-ba79-aaa3a20cee62 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:07.279606 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-064052dc-94e3-4a27-ba79-aaa3a20cee62 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:07.317260 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-064052dc-94e3-4a27-ba79-aaa3a20cee62 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:07.317973 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-064052dc-94e3-4a27-ba79-aaa3a20cee62 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:07.318538 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-064052dc-94e3-4a27-ba79-aaa3a20cee62 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:07.319179 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-064052dc-94e3-4a27-ba79-aaa3a20cee62 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lazy-loading 'fault' on Instance uuid 1b320dc8-1e79-4202-8162-0a418c6b1874 {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:49:07.357960 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4b7d294a-cdff-4143-861c-36435a99911c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:07.363464 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4b7d294a-cdff-4143-861c-36435a99911c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1229 microversion: 2.1 time: 0.117084 Sep 16 12:49:07.364048 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 486/925] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:07 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1229 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:07.371550 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-05fa5fe4-1d85-4585-8319-959a3a3328b4 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:07.372185 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-05fa5fe4-1d85-4585-8319-959a3a3328b4 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:07.382381 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05fa5fe4-1d85-4585-8319-959a3a3328b4 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:07.383560 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05fa5fe4-1d85-4585-8319-959a3a3328b4 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:07.384021 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05fa5fe4-1d85-4585-8319-959a3a3328b4 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:07.384796 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05fa5fe4-1d85-4585-8319-959a3a3328b4 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:07.385281 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05fa5fe4-1d85-4585-8319-959a3a3328b4 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:07.385716 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05fa5fe4-1d85-4585-8319-959a3a3328b4 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:07.385868 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-064052dc-94e3-4a27-ba79-aaa3a20cee62 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:07.394651 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-064052dc-94e3-4a27-ba79-aaa3a20cee62 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874" status: 200 len: 1304 microversion: 2.1 time: 0.139653 Sep 16 12:49:07.395351 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 440/926] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:07 2022] GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874 => generated 1304 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:07.400381 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b1a29d54-554a-4b9c-aea8-049e7b0c2a49 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:07.400993 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b1a29d54-554a-4b9c-aea8-049e7b0c2a49 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] [instance: 8983b634-6da4-4830-b0f1-5835cc55083e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:07.407125 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b1a29d54-554a-4b9c-aea8-049e7b0c2a49 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:07.407623 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b1a29d54-554a-4b9c-aea8-049e7b0c2a49 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:07.408042 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b1a29d54-554a-4b9c-aea8-049e7b0c2a49 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:07.408756 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b1a29d54-554a-4b9c-aea8-049e7b0c2a49 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:07.409228 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b1a29d54-554a-4b9c-aea8-049e7b0c2a49 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:07.409626 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b1a29d54-554a-4b9c-aea8-049e7b0c2a49 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:07.598586 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-05fa5fe4-1d85-4585-8319-959a3a3328b4 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fd28118c342529cda410e9587dfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a3e6c179c6495281c2816a1e18aa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:07.613434 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-05fa5fe4-1d85-4585-8319-959a3a3328b4 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0" status: 200 len: 1371 microversion: 2.1 time: 0.244181 Sep 16 12:49:07.614239 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 487/927] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:07 2022] GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 => generated 1371 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:07.628173 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-b1a29d54-554a-4b9c-aea8-049e7b0c2a49 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd06a287a6b48f5a8a5ac30c0159fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3e2fe65ad744a2ba3b757f42f1d07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:07.638304 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4c3eb98c-f496-4447-a561-42d2bb0b22d5 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:07.638919 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4c3eb98c-f496-4447-a561-42d2bb0b22d5 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:07.641485 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b1a29d54-554a-4b9c-aea8-049e7b0c2a49 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] 10.222.0.67 "GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e" status: 200 len: 1395 microversion: 2.1 time: 0.242085 Sep 16 12:49:07.642123 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 441/928] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:07 2022] GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e => generated 1395 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:07.662562 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c3eb98c-f496-4447-a561-42d2bb0b22d5 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:07.663053 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c3eb98c-f496-4447-a561-42d2bb0b22d5 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:07.663499 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c3eb98c-f496-4447-a561-42d2bb0b22d5 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:07.664432 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c3eb98c-f496-4447-a561-42d2bb0b22d5 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:07.664916 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c3eb98c-f496-4447-a561-42d2bb0b22d5 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:07.665312 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c3eb98c-f496-4447-a561-42d2bb0b22d5 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:07.986658 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4c3eb98c-f496-4447-a561-42d2bb0b22d5 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:07.995377 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4c3eb98c-f496-4447-a561-42d2bb0b22d5 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1308 microversion: 2.1 time: 0.362597 Sep 16 12:49:07.995962 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 488/929] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:07 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1308 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:08.278514 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-eb710324-1a79-47f9-bb5b-e4c5b6ff36df tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:08.279833 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-eb710324-1a79-47f9-bb5b-e4c5b6ff36df tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:08.284460 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fed26582-7476-4197-bbc2-726333efb830 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:08.285091 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fed26582-7476-4197-bbc2-726333efb830 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 1bdda11e-3b22-4d78-af62-8cc9a3915a4b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:08.291651 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eb710324-1a79-47f9-bb5b-e4c5b6ff36df tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:08.292600 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eb710324-1a79-47f9-bb5b-e4c5b6ff36df tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:08.293101 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fed26582-7476-4197-bbc2-726333efb830 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:08.293549 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eb710324-1a79-47f9-bb5b-e4c5b6ff36df tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:08.294098 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fed26582-7476-4197-bbc2-726333efb830 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:08.294639 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eb710324-1a79-47f9-bb5b-e4c5b6ff36df tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:08.294836 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fed26582-7476-4197-bbc2-726333efb830 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:08.295406 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eb710324-1a79-47f9-bb5b-e4c5b6ff36df tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:08.295550 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fed26582-7476-4197-bbc2-726333efb830 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:08.295883 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fed26582-7476-4197-bbc2-726333efb830 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:08.296069 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eb710324-1a79-47f9-bb5b-e4c5b6ff36df tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:08.296328 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fed26582-7476-4197-bbc2-726333efb830 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:08.940442 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-eb710324-1a79-47f9-bb5b-e4c5b6ff36df tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:08.950880 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-eb710324-1a79-47f9-bb5b-e4c5b6ff36df tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1313 microversion: 2.1 time: 0.676929 Sep 16 12:49:08.951839 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fed26582-7476-4197-bbc2-726333efb830 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:08.954959 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 442/930] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:08 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1313 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:08.957500 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8e42aa63-551d-48ad-ba90-756b11b798eb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:08.958358 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8e42aa63-551d-48ad-ba90-756b11b798eb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:08.965944 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fed26582-7476-4197-bbc2-726333efb830 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b" status: 200 len: 1319 microversion: 2.1 time: 0.686073 Sep 16 12:49:08.966687 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8e42aa63-551d-48ad-ba90-756b11b798eb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:08.967326 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8e42aa63-551d-48ad-ba90-756b11b798eb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:08.967946 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8e42aa63-551d-48ad-ba90-756b11b798eb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:08.969078 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8e42aa63-551d-48ad-ba90-756b11b798eb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:08.969890 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8e42aa63-551d-48ad-ba90-756b11b798eb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:08.970452 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8e42aa63-551d-48ad-ba90-756b11b798eb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:08.980498 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 489/931] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:08 2022] GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b => generated 1319 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:08.987283 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-626c6725-64e8-4b87-b381-0093f1ed1bfd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:08.987533 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-626c6725-64e8-4b87-b381-0093f1ed1bfd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: 1b320dc8-1e79-4202-8162-0a418c6b1874] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:08.995577 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-626c6725-64e8-4b87-b381-0093f1ed1bfd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:08.996342 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-626c6725-64e8-4b87-b381-0093f1ed1bfd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:08.997127 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-626c6725-64e8-4b87-b381-0093f1ed1bfd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:08.997870 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-626c6725-64e8-4b87-b381-0093f1ed1bfd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:08.998334 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-626c6725-64e8-4b87-b381-0093f1ed1bfd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:08.998831 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-626c6725-64e8-4b87-b381-0093f1ed1bfd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:09.034694 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-626c6725-64e8-4b87-b381-0093f1ed1bfd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:09.035183 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-626c6725-64e8-4b87-b381-0093f1ed1bfd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:09.035615 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-626c6725-64e8-4b87-b381-0093f1ed1bfd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:09.036074 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-626c6725-64e8-4b87-b381-0093f1ed1bfd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lazy-loading 'fault' on Instance uuid 1b320dc8-1e79-4202-8162-0a418c6b1874 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:49:09.045165 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8e42aa63-551d-48ad-ba90-756b11b798eb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:09.054061 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8e42aa63-551d-48ad-ba90-756b11b798eb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1229 microversion: 2.1 time: 0.100404 Sep 16 12:49:09.055465 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 443/932] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:08 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1229 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:09.060531 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e4c0e27e-040e-4462-ba35-1adaac308594 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:09.061144 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e4c0e27e-040e-4462-ba35-1adaac308594 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:09.067435 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e4c0e27e-040e-4462-ba35-1adaac308594 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:09.067966 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e4c0e27e-040e-4462-ba35-1adaac308594 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:09.068633 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e4c0e27e-040e-4462-ba35-1adaac308594 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:09.069342 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e4c0e27e-040e-4462-ba35-1adaac308594 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:09.069793 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e4c0e27e-040e-4462-ba35-1adaac308594 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:09.070269 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e4c0e27e-040e-4462-ba35-1adaac308594 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:09.087268 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-626c6725-64e8-4b87-b381-0093f1ed1bfd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:09.096733 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-626c6725-64e8-4b87-b381-0093f1ed1bfd tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874" status: 200 len: 1304 microversion: 2.1 time: 0.114222 Sep 16 12:49:09.097322 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 490/933] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:08 2022] GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874 => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:09.103099 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5e1f3c4a-650d-4b20-b6f3-e0518351f85b tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:09.103721 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5e1f3c4a-650d-4b20-b6f3-e0518351f85b tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] [instance: 8983b634-6da4-4830-b0f1-5835cc55083e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:09.110056 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e1f3c4a-650d-4b20-b6f3-e0518351f85b tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:09.110550 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e1f3c4a-650d-4b20-b6f3-e0518351f85b tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:09.111206 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e1f3c4a-650d-4b20-b6f3-e0518351f85b tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:09.111925 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e1f3c4a-650d-4b20-b6f3-e0518351f85b tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:09.112588 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e1f3c4a-650d-4b20-b6f3-e0518351f85b tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:09.113028 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e1f3c4a-650d-4b20-b6f3-e0518351f85b tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:09.263779 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e4c0e27e-040e-4462-ba35-1adaac308594 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fd28118c342529cda410e9587dfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a3e6c179c6495281c2816a1e18aa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:09.274693 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e4c0e27e-040e-4462-ba35-1adaac308594 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0" status: 200 len: 1371 microversion: 2.1 time: 0.217691 Sep 16 12:49:09.275411 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 444/934] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:09 2022] GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 => generated 1371 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:09.280411 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5fa46bce-49a9-4af6-bd31-6355d7d008a9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:09.281148 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5fa46bce-49a9-4af6-bd31-6355d7d008a9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:09.289541 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5fa46bce-49a9-4af6-bd31-6355d7d008a9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:09.290034 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5fa46bce-49a9-4af6-bd31-6355d7d008a9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:09.290465 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5fa46bce-49a9-4af6-bd31-6355d7d008a9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:09.291159 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5fa46bce-49a9-4af6-bd31-6355d7d008a9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:09.291602 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5fa46bce-49a9-4af6-bd31-6355d7d008a9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:09.292015 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5fa46bce-49a9-4af6-bd31-6355d7d008a9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:09.294284 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5e1f3c4a-650d-4b20-b6f3-e0518351f85b tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd06a287a6b48f5a8a5ac30c0159fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3e2fe65ad744a2ba3b757f42f1d07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:09.302573 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5e1f3c4a-650d-4b20-b6f3-e0518351f85b tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] 10.222.0.67 "GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e" status: 200 len: 1577 microversion: 2.1 time: 0.204070 Sep 16 12:49:09.303151 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 491/935] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:09 2022] GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e => generated 1577 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:09.330689 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-de74ff53-9240-4f29-a471-66531c81ed7c tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:09.331332 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-de74ff53-9240-4f29-a471-66531c81ed7c tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] [instance: 8983b634-6da4-4830-b0f1-5835cc55083e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:09.338423 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de74ff53-9240-4f29-a471-66531c81ed7c tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:09.338912 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de74ff53-9240-4f29-a471-66531c81ed7c tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:09.339356 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de74ff53-9240-4f29-a471-66531c81ed7c tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:09.340064 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de74ff53-9240-4f29-a471-66531c81ed7c tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:09.340697 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de74ff53-9240-4f29-a471-66531c81ed7c tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:09.341129 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de74ff53-9240-4f29-a471-66531c81ed7c tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:09.507623 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-de74ff53-9240-4f29-a471-66531c81ed7c tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] 10.222.0.67 "GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.180807 Sep 16 12:49:09.508806 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 492/936] 10.222.0.67 () {58 vars in 1275 bytes} [Fri Sep 16 12:49:09 2022] GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e/os-interface => generated 285 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:49:09.564583 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5fa46bce-49a9-4af6-bd31-6355d7d008a9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:09.574033 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5fa46bce-49a9-4af6-bd31-6355d7d008a9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1488 microversion: 2.1 time: 0.297581 Sep 16 12:49:09.574616 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 445/937] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:09 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1488 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:09.600576 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2fb77eaa-bd8f-46a1-ac1d-6147c2dddc5f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:49:09.607423 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2fb77eaa-bd8f-46a1-ac1d-6147c2dddc5f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:09.607916 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2fb77eaa-bd8f-46a1-ac1d-6147c2dddc5f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:09.608375 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2fb77eaa-bd8f-46a1-ac1d-6147c2dddc5f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:09.671348 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2fb77eaa-bd8f-46a1-ac1d-6147c2dddc5f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Going to try to stop instance {{(pid=128779) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 16 12:49:09.718408 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2fb77eaa-bd8f-46a1-ac1d-6147c2dddc5f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "POST /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361/action" status: 202 len: 0 microversion: 2.1 time: 0.121880 Sep 16 12:49:09.719389 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 493/938] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:49:09 2022] POST /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:49:09.729301 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0cfcb0af-8ed1-4cc5-b3d3-8cd0f94cfbbc tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:09.730072 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0cfcb0af-8ed1-4cc5-b3d3-8cd0f94cfbbc tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:09.737638 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0cfcb0af-8ed1-4cc5-b3d3-8cd0f94cfbbc tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:09.738291 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0cfcb0af-8ed1-4cc5-b3d3-8cd0f94cfbbc tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:09.738940 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0cfcb0af-8ed1-4cc5-b3d3-8cd0f94cfbbc tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:09.739751 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0cfcb0af-8ed1-4cc5-b3d3-8cd0f94cfbbc tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:09.740315 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0cfcb0af-8ed1-4cc5-b3d3-8cd0f94cfbbc tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:09.740874 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0cfcb0af-8ed1-4cc5-b3d3-8cd0f94cfbbc tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:09.895120 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0cfcb0af-8ed1-4cc5-b3d3-8cd0f94cfbbc tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:09.907331 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0cfcb0af-8ed1-4cc5-b3d3-8cd0f94cfbbc tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1498 microversion: 2.1 time: 0.183513 Sep 16 12:49:09.908335 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 446/939] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:09 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1498 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:09.994433 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-26c882af-c406-4e3d-a61c-374a38cc4970 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:09.995052 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-97db83dd-02cf-4190-a3e8-6fb2f61e4fad tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:09.996588 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-97db83dd-02cf-4190-a3e8-6fb2f61e4fad tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 1bdda11e-3b22-4d78-af62-8cc9a3915a4b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:09.997441 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-26c882af-c406-4e3d-a61c-374a38cc4970 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:10.014047 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-97db83dd-02cf-4190-a3e8-6fb2f61e4fad tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:10.014392 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-97db83dd-02cf-4190-a3e8-6fb2f61e4fad tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:10.014817 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-97db83dd-02cf-4190-a3e8-6fb2f61e4fad tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:10.015537 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-97db83dd-02cf-4190-a3e8-6fb2f61e4fad tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:10.016309 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-97db83dd-02cf-4190-a3e8-6fb2f61e4fad tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:10.017247 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26c882af-c406-4e3d-a61c-374a38cc4970 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:10.017976 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26c882af-c406-4e3d-a61c-374a38cc4970 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:10.018609 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26c882af-c406-4e3d-a61c-374a38cc4970 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:10.019812 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26c882af-c406-4e3d-a61c-374a38cc4970 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:10.020554 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26c882af-c406-4e3d-a61c-374a38cc4970 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:10.021217 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26c882af-c406-4e3d-a61c-374a38cc4970 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:10.021919 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-97db83dd-02cf-4190-a3e8-6fb2f61e4fad tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:10.158929 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:49:10.212769 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=5 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:49:10.281387 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-97db83dd-02cf-4190-a3e8-6fb2f61e4fad tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:10.282507 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-26c882af-c406-4e3d-a61c-374a38cc4970 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:10.291355 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-26c882af-c406-4e3d-a61c-374a38cc4970 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1462 microversion: 2.1 time: 0.310138 Sep 16 12:49:10.292269 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 494/940] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:09 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1462 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:10.297213 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-87686788-2e20-4652-b4c0-bf484db78a3d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:10.297824 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-87686788-2e20-4652-b4c0-bf484db78a3d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:10.304971 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-97db83dd-02cf-4190-a3e8-6fb2f61e4fad tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b" status: 200 len: 1319 microversion: 2.1 time: 0.318041 Sep 16 12:49:10.312345 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87686788-2e20-4652-b4c0-bf484db78a3d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:10.312761 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 447/941] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:09 2022] GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b => generated 1319 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:10.313279 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87686788-2e20-4652-b4c0-bf484db78a3d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:10.313878 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87686788-2e20-4652-b4c0-bf484db78a3d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:10.314598 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87686788-2e20-4652-b4c0-bf484db78a3d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:10.315058 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87686788-2e20-4652-b4c0-bf484db78a3d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:10.315481 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87686788-2e20-4652-b4c0-bf484db78a3d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:10.321909 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d954d58d-1a32-42f5-a5c0-c681e454267d tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:10.323213 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d954d58d-1a32-42f5-a5c0-c681e454267d tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: 1b320dc8-1e79-4202-8162-0a418c6b1874] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:10.332791 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d954d58d-1a32-42f5-a5c0-c681e454267d tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:10.333689 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d954d58d-1a32-42f5-a5c0-c681e454267d tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:10.334328 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d954d58d-1a32-42f5-a5c0-c681e454267d tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:10.335188 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d954d58d-1a32-42f5-a5c0-c681e454267d tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:10.335759 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d954d58d-1a32-42f5-a5c0-c681e454267d tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:10.336802 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d954d58d-1a32-42f5-a5c0-c681e454267d tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:10.397499 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d954d58d-1a32-42f5-a5c0-c681e454267d tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:10.398380 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d954d58d-1a32-42f5-a5c0-c681e454267d tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:10.399012 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d954d58d-1a32-42f5-a5c0-c681e454267d tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:10.399657 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-d954d58d-1a32-42f5-a5c0-c681e454267d tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lazy-loading 'fault' on Instance uuid 1b320dc8-1e79-4202-8162-0a418c6b1874 {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:49:10.522814 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-87686788-2e20-4652-b4c0-bf484db78a3d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:10.535476 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-87686788-2e20-4652-b4c0-bf484db78a3d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1229 microversion: 2.1 time: 0.241918 Sep 16 12:49:10.537043 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 495/942] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:10 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1229 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:10.543162 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9776b98d-7ab7-482b-983f-50b28f93ecc2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:10.543791 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9776b98d-7ab7-482b-983f-50b28f93ecc2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:10.559891 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9776b98d-7ab7-482b-983f-50b28f93ecc2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:10.560492 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9776b98d-7ab7-482b-983f-50b28f93ecc2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:10.560931 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9776b98d-7ab7-482b-983f-50b28f93ecc2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:10.561676 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9776b98d-7ab7-482b-983f-50b28f93ecc2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:10.562138 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9776b98d-7ab7-482b-983f-50b28f93ecc2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:10.562736 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9776b98d-7ab7-482b-983f-50b28f93ecc2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:10.564764 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d954d58d-1a32-42f5-a5c0-c681e454267d tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:10.575583 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d954d58d-1a32-42f5-a5c0-c681e454267d tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874" status: 200 len: 1304 microversion: 2.1 time: 0.258256 Sep 16 12:49:10.576922 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 448/943] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:10 2022] GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874 => generated 1304 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:10.602056 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:49:10.603516 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f625b804-6e46-4a84-b3fe-524f8063b52f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:49:10.606227 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f625b804-6e46-4a84-b3fe-524f8063b52f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:10.613416 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f625b804-6e46-4a84-b3fe-524f8063b52f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:10.614543 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f625b804-6e46-4a84-b3fe-524f8063b52f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:10.614543 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f625b804-6e46-4a84-b3fe-524f8063b52f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:10.615135 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f625b804-6e46-4a84-b3fe-524f8063b52f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:10.617573 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f625b804-6e46-4a84-b3fe-524f8063b52f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:10.618191 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f625b804-6e46-4a84-b3fe-524f8063b52f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:10.706422 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=100 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:49:10.738930 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f625b804-6e46-4a84-b3fe-524f8063b52f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:10.745873 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f625b804-6e46-4a84-b3fe-524f8063b52f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Old instance type m1.heat2, new instance type m1.heat {{(pid=128780) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 16 12:49:10.753172 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-f625b804-6e46-4a84-b3fe-524f8063b52f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:49:10.753593 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-f625b804-6e46-4a84-b3fe-524f8063b52f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:49:10.754069 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-f625b804-6e46-4a84-b3fe-524f8063b52f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:49:10.754483 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-f625b804-6e46-4a84-b3fe-524f8063b52f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:49:10.754906 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-f625b804-6e46-4a84-b3fe-524f8063b52f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:49:10.875175 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9776b98d-7ab7-482b-983f-50b28f93ecc2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fd28118c342529cda410e9587dfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a3e6c179c6495281c2816a1e18aa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:10.880498 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f625b804-6e46-4a84-b3fe-524f8063b52f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "POST /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74/action" status: 202 len: 0 microversion: 2.1 time: 0.282259 Sep 16 12:49:10.881786 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 449/944] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:49:10 2022] POST /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:49:10.883851 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9776b98d-7ab7-482b-983f-50b28f93ecc2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0" status: 200 len: 1371 microversion: 2.1 time: 0.345349 Sep 16 12:49:10.888755 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-27343ccf-685a-432b-b7aa-5cb28340adc9 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:10.889688 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-27343ccf-685a-432b-b7aa-5cb28340adc9 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] [instance: 8983b634-6da4-4830-b0f1-5835cc55083e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:10.898425 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-27343ccf-685a-432b-b7aa-5cb28340adc9 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:10.899232 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-27343ccf-685a-432b-b7aa-5cb28340adc9 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:10.899501 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 496/945] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:10 2022] GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 => generated 1371 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:10.900318 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-27343ccf-685a-432b-b7aa-5cb28340adc9 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:10.901781 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-27343ccf-685a-432b-b7aa-5cb28340adc9 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:10.902564 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-27343ccf-685a-432b-b7aa-5cb28340adc9 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:10.903425 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-27343ccf-685a-432b-b7aa-5cb28340adc9 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:10.906203 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-ca09b4fa-bf93-45dc-aaaa-43ffb31ae3c5 req-36052565-6696-44e8-8238-1d3b153a4a80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8983b634-6da4-4830-b0f1-5835cc55083e", "tag": "f5de57d0-58b1-4bb4-be3d-a6d88fd93f21"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:49:10.917001 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ca09b4fa-bf93-45dc-aaaa-43ffb31ae3c5 req-36052565-6696-44e8-8238-1d3b153a4a80 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:10.917581 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ca09b4fa-bf93-45dc-aaaa-43ffb31ae3c5 req-36052565-6696-44e8-8238-1d3b153a4a80 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:10.918083 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ca09b4fa-bf93-45dc-aaaa-43ffb31ae3c5 req-36052565-6696-44e8-8238-1d3b153a4a80 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:10.934459 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-ca09b4fa-bf93-45dc-aaaa-43ffb31ae3c5 req-36052565-6696-44e8-8238-1d3b153a4a80 service nova] Creating event network-changed:f5de57d0-58b1-4bb4-be3d-a6d88fd93f21 for instance 8983b634-6da4-4830-b0f1-5835cc55083e on n-h2-858094-4 Sep 16 12:49:10.939729 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-ca09b4fa-bf93-45dc-aaaa-43ffb31ae3c5 req-36052565-6696-44e8-8238-1d3b153a4a80 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038475 Sep 16 12:49:10.940846 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 497/946] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:49:10.947594 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-55c03d27-1cdd-4d9f-ac82-ca7822324324 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:10.947594 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-55c03d27-1cdd-4d9f-ac82-ca7822324324 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:10.953854 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-55c03d27-1cdd-4d9f-ac82-ca7822324324 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:10.954351 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-55c03d27-1cdd-4d9f-ac82-ca7822324324 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:10.954788 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-55c03d27-1cdd-4d9f-ac82-ca7822324324 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:10.955501 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-55c03d27-1cdd-4d9f-ac82-ca7822324324 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:10.956006 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-55c03d27-1cdd-4d9f-ac82-ca7822324324 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:10.956538 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-55c03d27-1cdd-4d9f-ac82-ca7822324324 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:11.076609 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:49:11.671259 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-27343ccf-685a-432b-b7aa-5cb28340adc9 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd06a287a6b48f5a8a5ac30c0159fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3e2fe65ad744a2ba3b757f42f1d07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:11.688757 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-27343ccf-685a-432b-b7aa-5cb28340adc9 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] 10.222.0.67 "GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e" status: 200 len: 1577 microversion: 2.1 time: 0.805222 Sep 16 12:49:11.689348 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 450/947] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:10 2022] GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e => generated 1577 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:11.694046 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-bcccf274-1f21-4c5c-950c-13f2bd2c0df5 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:11.695515 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-bcccf274-1f21-4c5c-950c-13f2bd2c0df5 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:11.707637 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-55c03d27-1cdd-4d9f-ac82-ca7822324324 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:11.716308 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bcccf274-1f21-4c5c-950c-13f2bd2c0df5 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:11.718914 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-55c03d27-1cdd-4d9f-ac82-ca7822324324 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1471 microversion: 2.1 time: 0.776718 Sep 16 12:49:11.728971 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bcccf274-1f21-4c5c-950c-13f2bd2c0df5 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:11.730189 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 498/948] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:10 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1471 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:11.731027 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bcccf274-1f21-4c5c-950c-13f2bd2c0df5 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:11.732027 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bcccf274-1f21-4c5c-950c-13f2bd2c0df5 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:11.737038 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1376d5a9-d803-4ae8-a87e-31b5c6e03487 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:11.737637 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1376d5a9-d803-4ae8-a87e-31b5c6e03487 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 1bdda11e-3b22-4d78-af62-8cc9a3915a4b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:11.738392 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bcccf274-1f21-4c5c-950c-13f2bd2c0df5 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:11.738828 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bcccf274-1f21-4c5c-950c-13f2bd2c0df5 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:11.766394 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1376d5a9-d803-4ae8-a87e-31b5c6e03487 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:11.767784 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1376d5a9-d803-4ae8-a87e-31b5c6e03487 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:11.770556 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1376d5a9-d803-4ae8-a87e-31b5c6e03487 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:11.771409 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1376d5a9-d803-4ae8-a87e-31b5c6e03487 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:11.772006 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1376d5a9-d803-4ae8-a87e-31b5c6e03487 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:11.776052 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1376d5a9-d803-4ae8-a87e-31b5c6e03487 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:12.227905 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-bcccf274-1f21-4c5c-950c-13f2bd2c0df5 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:12.239858 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-bcccf274-1f21-4c5c-950c-13f2bd2c0df5 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1498 microversion: 2.1 time: 0.549101 Sep 16 12:49:12.241223 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 451/949] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:11 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1498 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:12.258308 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-13fca0f0-21f6-47a1-b2e3-17174cbab5d0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:12.261400 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-13fca0f0-21f6-47a1-b2e3-17174cbab5d0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:12.269905 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:49:12.278156 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-13fca0f0-21f6-47a1-b2e3-17174cbab5d0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:12.278887 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-13fca0f0-21f6-47a1-b2e3-17174cbab5d0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:12.279479 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-13fca0f0-21f6-47a1-b2e3-17174cbab5d0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:12.280395 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-13fca0f0-21f6-47a1-b2e3-17174cbab5d0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:12.280965 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-13fca0f0-21f6-47a1-b2e3-17174cbab5d0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:12.282068 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-13fca0f0-21f6-47a1-b2e3-17174cbab5d0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:12.438541 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-13fca0f0-21f6-47a1-b2e3-17174cbab5d0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:12.447042 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-13fca0f0-21f6-47a1-b2e3-17174cbab5d0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1291 microversion: 2.1 time: 0.198489 Sep 16 12:49:12.448190 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 452/950] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:12 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1291 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:12.451116 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1376d5a9-d803-4ae8-a87e-31b5c6e03487 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:12.453688 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-62de1e0f-ce9f-45bb-bfbe-4daa2e812039 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:12.454516 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-62de1e0f-ce9f-45bb-bfbe-4daa2e812039 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: 1b320dc8-1e79-4202-8162-0a418c6b1874] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:12.478172 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1376d5a9-d803-4ae8-a87e-31b5c6e03487 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b" status: 200 len: 1319 microversion: 2.1 time: 0.742845 Sep 16 12:49:12.481154 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 499/951] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:11 2022] GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b => generated 1319 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:12.489679 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-02673d19-a72f-4c93-adee-563999b17070 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:12.490952 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-02673d19-a72f-4c93-adee-563999b17070 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:12.491246 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62de1e0f-ce9f-45bb-bfbe-4daa2e812039 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:12.491933 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62de1e0f-ce9f-45bb-bfbe-4daa2e812039 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:12.492422 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62de1e0f-ce9f-45bb-bfbe-4daa2e812039 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:12.493658 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62de1e0f-ce9f-45bb-bfbe-4daa2e812039 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:12.494322 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62de1e0f-ce9f-45bb-bfbe-4daa2e812039 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:12.495098 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62de1e0f-ce9f-45bb-bfbe-4daa2e812039 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:12.503544 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02673d19-a72f-4c93-adee-563999b17070 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:12.505138 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02673d19-a72f-4c93-adee-563999b17070 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:12.506030 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02673d19-a72f-4c93-adee-563999b17070 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:12.508340 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02673d19-a72f-4c93-adee-563999b17070 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:12.509789 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02673d19-a72f-4c93-adee-563999b17070 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:12.511407 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02673d19-a72f-4c93-adee-563999b17070 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:12.527985 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-62de1e0f-ce9f-45bb-bfbe-4daa2e812039 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] HTTP exception thrown: Instance 1b320dc8-1e79-4202-8162-0a418c6b1874 could not be found. Sep 16 12:49:12.531914 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-62de1e0f-ce9f-45bb-bfbe-4daa2e812039 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Request method failure captured: Sep 16 12:49:12.531914 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874 HTTP/1.1 Sep 16 12:49:12.531914 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:49:12.531914 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:49:12.531914 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:49:12.531914 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:49:12.531914 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:49:12.531914 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:49:12.531914 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:49:12.531914 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:49:12.531914 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHAfNfamkYff9XjWg2ezxGbAK0vGbyFfS9S6d-7riP1dxgveFnj9Pm2y1z3ZfcMqnAIylHkkDkyn5Mz2iFnulkjz1dzhgJxzCkO34Sdb26L6Tq4z2nMMp7d_MH6tVI7vv2gQD3nqH_9sirYzZQeNE-2eLG66LNbSmG2FSKjozjM6jqE Sep 16 12:49:12.531914 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:49:12.531914 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:49:12.531914 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:49:12.531914 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:49:12.531914 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:49:12.531914 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:49:12.531914 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 0709d7ec436047a39dfb8c5d92f17fa3 Sep 16 12:49:12.531914 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ServersAdminTestJSON-1188504796 Sep 16 12:49:12.531914 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:49:12.531914 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:49:12.534897 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0709d7ec436047a39dfb8c5d92f17fa3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0709d7ec436047a39dfb8c5d92f17fa3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0709d7ec436047a39dfb8c5d92f17fa3", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0709d7ec436047a39dfb8c5d92f17fa3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:49:12.534897 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ServersAdminTestJSON-1188504796 Sep 16 12:49:12.534897 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 0709d7ec436047a39dfb8c5d92f17fa3 Sep 16 12:49:12.534897 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ServersAdminTestJSON-1188504796 Sep 16 12:49:12.534897 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ServersAdminTestJSON-1188504796-project Sep 16 12:49:12.534897 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:49:12.534897 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:49:12.534897 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 8bdc5bd0969148a3ac8879ccf0f58553 Sep 16 12:49:12.534897 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ServersAdminTestJSON-1188504796-project Sep 16 12:49:12.534897 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:49:12.534897 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance 1b320dc8-1e79-4202-8162-0a418c6b1874 could not be found. Sep 16 12:49:12.534897 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '1b320dc8-1e79-4202-8162-0a418c6b1874'} Sep 16 12:49:12.537303 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:49:12.537303 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:49:12.537303 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:49:12.537303 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:49:12.537303 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:49:12.537303 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:49:12.537303 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:49:12.537303 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:49:12.537303 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:49:12.537303 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:49:12.537303 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b320dc8-1e79-4202-8162-0a418c6b1874 could not be found. Sep 16 12:49:12.537303 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:49:12.537303 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:49:12.537303 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:49:12.537303 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:49:12.537303 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:49:12.537303 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:49:12.537303 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:49:12.537303 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:49:12.537303 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:49:12.541327 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:49:12.541327 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:49:12.541327 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:49:12.541327 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:49:12.541327 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:49:12.541327 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:49:12.541327 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:49:12.541327 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b320dc8-1e79-4202-8162-0a418c6b1874 could not be found. Sep 16 12:49:12.541327 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:49:12.541327 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:49:12.541327 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:49:12.541327 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:49:12.541327 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:49:12.541327 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:49:12.541327 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:49:12.541327 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:49:12.541327 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b320dc8-1e79-4202-8162-0a418c6b1874 could not be found. Sep 16 12:49:12.541327 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:49:12.548764 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-62de1e0f-ce9f-45bb-bfbe-4daa2e812039 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Returning 404 to user: Instance 1b320dc8-1e79-4202-8162-0a418c6b1874 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:49:12.548764 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-62de1e0f-ce9f-45bb-bfbe-4daa2e812039 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874" status: 404 len: 111 microversion: 2.1 time: 0.093049 Sep 16 12:49:12.548764 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 453/952] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:12 2022] GET /compute/v2.1/servers/1b320dc8-1e79-4202-8162-0a418c6b1874 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:49:12.558398 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1b6d11d0-bca4-4aeb-bc00-8771f353c614 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:12.559267 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-1b6d11d0-bca4-4aeb-bc00-8771f353c614 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:12.570000 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1b6d11d0-bca4-4aeb-bc00-8771f353c614 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:12.570580 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1b6d11d0-bca4-4aeb-bc00-8771f353c614 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:12.571292 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1b6d11d0-bca4-4aeb-bc00-8771f353c614 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:12.572518 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1b6d11d0-bca4-4aeb-bc00-8771f353c614 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:12.573258 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1b6d11d0-bca4-4aeb-bc00-8771f353c614 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:12.573981 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1b6d11d0-bca4-4aeb-bc00-8771f353c614 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:12.607046 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-1b6d11d0-bca4-4aeb-bc00-8771f353c614 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:49:12.690960 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1b6d11d0-bca4-4aeb-bc00-8771f353c614 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6" status: 204 len: 0 microversion: 2.1 time: 0.140910 Sep 16 12:49:12.691888 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 454/953] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:49:12 2022] DELETE /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:49:12.692306 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-02673d19-a72f-4c93-adee-563999b17070 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fd28118c342529cda410e9587dfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a3e6c179c6495281c2816a1e18aa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:12.700011 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f9bac6b1-0c96-4738-8d70-c10a1575349a tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:12.700399 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-02673d19-a72f-4c93-adee-563999b17070 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0" status: 200 len: 1371 microversion: 2.1 time: 0.217585 Sep 16 12:49:12.700750 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f9bac6b1-0c96-4738-8d70-c10a1575349a tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:12.709873 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 500/954] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:12 2022] GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 => generated 1371 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:12.710074 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f9bac6b1-0c96-4738-8d70-c10a1575349a tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:12.710074 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f9bac6b1-0c96-4738-8d70-c10a1575349a tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:12.710074 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f9bac6b1-0c96-4738-8d70-c10a1575349a tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:12.710074 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f9bac6b1-0c96-4738-8d70-c10a1575349a tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:12.710999 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f9bac6b1-0c96-4738-8d70-c10a1575349a tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:12.710999 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f9bac6b1-0c96-4738-8d70-c10a1575349a tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:12.757487 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-65e23782-8c27-4ac4-87c1-52f82cc75dff tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:12.758373 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-65e23782-8c27-4ac4-87c1-52f82cc75dff tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:12.764680 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65e23782-8c27-4ac4-87c1-52f82cc75dff tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:12.765173 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65e23782-8c27-4ac4-87c1-52f82cc75dff tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:12.765612 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65e23782-8c27-4ac4-87c1-52f82cc75dff tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:12.766342 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65e23782-8c27-4ac4-87c1-52f82cc75dff tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:12.766791 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65e23782-8c27-4ac4-87c1-52f82cc75dff tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:12.767216 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65e23782-8c27-4ac4-87c1-52f82cc75dff tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:12.889573 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f9bac6b1-0c96-4738-8d70-c10a1575349a tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:12.901230 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f9bac6b1-0c96-4738-8d70-c10a1575349a tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6" status: 200 len: 1469 microversion: 2.1 time: 0.205230 Sep 16 12:49:12.902271 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 455/955] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:12 2022] GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 => generated 1469 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:12.936685 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-65e23782-8c27-4ac4-87c1-52f82cc75dff tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:12.945878 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-65e23782-8c27-4ac4-87c1-52f82cc75dff tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1471 microversion: 2.1 time: 0.192278 Sep 16 12:49:12.946628 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 501/956] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:12 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1471 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:13.268281 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5e37cf75-35a2-47d6-bafd-3f017359ffff tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:13.268884 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5e37cf75-35a2-47d6-bafd-3f017359ffff tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:13.275434 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5e37cf75-35a2-47d6-bafd-3f017359ffff tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:13.275919 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5e37cf75-35a2-47d6-bafd-3f017359ffff tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:13.276390 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5e37cf75-35a2-47d6-bafd-3f017359ffff tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:13.277078 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5e37cf75-35a2-47d6-bafd-3f017359ffff tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:13.277515 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5e37cf75-35a2-47d6-bafd-3f017359ffff tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:13.277929 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5e37cf75-35a2-47d6-bafd-3f017359ffff tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:13.412810 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5e37cf75-35a2-47d6-bafd-3f017359ffff tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:13.421214 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5e37cf75-35a2-47d6-bafd-3f017359ffff tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1498 microversion: 2.1 time: 0.156780 Sep 16 12:49:13.421793 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 456/957] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:13 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1498 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:13.487005 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bce9c991-027e-4de0-974b-88637772909e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:13.487651 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bce9c991-027e-4de0-974b-88637772909e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:13.494428 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bce9c991-027e-4de0-974b-88637772909e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:13.494914 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bce9c991-027e-4de0-974b-88637772909e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:13.495349 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bce9c991-027e-4de0-974b-88637772909e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:13.496040 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bce9c991-027e-4de0-974b-88637772909e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:13.496520 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bce9c991-027e-4de0-974b-88637772909e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:13.496943 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bce9c991-027e-4de0-974b-88637772909e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:13.509280 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-20451328-833e-476d-8331-88e4c2169c73 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:13.509818 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-20451328-833e-476d-8331-88e4c2169c73 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 1bdda11e-3b22-4d78-af62-8cc9a3915a4b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:13.516511 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-20451328-833e-476d-8331-88e4c2169c73 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:13.516828 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-20451328-833e-476d-8331-88e4c2169c73 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:13.517318 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-20451328-833e-476d-8331-88e4c2169c73 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:13.518066 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-20451328-833e-476d-8331-88e4c2169c73 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:13.518518 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-20451328-833e-476d-8331-88e4c2169c73 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:13.518944 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-20451328-833e-476d-8331-88e4c2169c73 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:13.568172 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bce9c991-027e-4de0-974b-88637772909e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:13.576468 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bce9c991-027e-4de0-974b-88637772909e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1291 microversion: 2.1 time: 0.093327 Sep 16 12:49:13.577057 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 502/958] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:13 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1291 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:13.668103 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-20451328-833e-476d-8331-88e4c2169c73 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:13.677239 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-20451328-833e-476d-8331-88e4c2169c73 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b" status: 200 len: 1319 microversion: 2.1 time: 0.172782 Sep 16 12:49:13.677808 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 457/959] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:13 2022] GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:13.724835 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c6cff469-1707-4834-a972-6b4c40f2592f tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:13.725556 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c6cff469-1707-4834-a972-6b4c40f2592f tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:13.733308 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6cff469-1707-4834-a972-6b4c40f2592f tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:13.733783 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6cff469-1707-4834-a972-6b4c40f2592f tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:13.734208 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6cff469-1707-4834-a972-6b4c40f2592f tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:13.734895 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6cff469-1707-4834-a972-6b4c40f2592f tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:13.735351 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6cff469-1707-4834-a972-6b4c40f2592f tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:13.735763 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6cff469-1707-4834-a972-6b4c40f2592f tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:13.865401 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c6cff469-1707-4834-a972-6b4c40f2592f tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fd28118c342529cda410e9587dfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a3e6c179c6495281c2816a1e18aa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:13.873862 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c6cff469-1707-4834-a972-6b4c40f2592f tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0" status: 200 len: 1371 microversion: 2.1 time: 0.153315 Sep 16 12:49:13.874472 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 503/960] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:13 2022] GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:13.930251 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5f1d825a-d8f5-47f1-9e38-ba5a8e140f40 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:13.930871 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5f1d825a-d8f5-47f1-9e38-ba5a8e140f40 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:13.937152 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5f1d825a-d8f5-47f1-9e38-ba5a8e140f40 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:13.937637 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5f1d825a-d8f5-47f1-9e38-ba5a8e140f40 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:13.938069 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5f1d825a-d8f5-47f1-9e38-ba5a8e140f40 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:13.938755 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5f1d825a-d8f5-47f1-9e38-ba5a8e140f40 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:13.939236 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5f1d825a-d8f5-47f1-9e38-ba5a8e140f40 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:13.939653 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5f1d825a-d8f5-47f1-9e38-ba5a8e140f40 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:13.969689 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-75340a44-d3ed-4e0d-a2f7-ec2adac9fd8e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:13.970296 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-75340a44-d3ed-4e0d-a2f7-ec2adac9fd8e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:13.977308 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75340a44-d3ed-4e0d-a2f7-ec2adac9fd8e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:13.977795 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75340a44-d3ed-4e0d-a2f7-ec2adac9fd8e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:13.978225 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75340a44-d3ed-4e0d-a2f7-ec2adac9fd8e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:13.978922 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75340a44-d3ed-4e0d-a2f7-ec2adac9fd8e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:13.979377 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75340a44-d3ed-4e0d-a2f7-ec2adac9fd8e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:13.979797 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75340a44-d3ed-4e0d-a2f7-ec2adac9fd8e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:14.128697 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5f1d825a-d8f5-47f1-9e38-ba5a8e140f40 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:14.137121 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5f1d825a-d8f5-47f1-9e38-ba5a8e140f40 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6" status: 200 len: 1469 microversion: 2.1 time: 0.211603 Sep 16 12:49:14.138460 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 458/961] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:13 2022] GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 => generated 1469 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:14.157228 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-75340a44-d3ed-4e0d-a2f7-ec2adac9fd8e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:14.165594 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-75340a44-d3ed-4e0d-a2f7-ec2adac9fd8e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1471 microversion: 2.1 time: 0.199716 Sep 16 12:49:14.166163 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 504/962] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:13 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1471 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:14.450339 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-38e8004d-4457-47fa-bc1e-36b9716d6dd3 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:14.450850 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-38e8004d-4457-47fa-bc1e-36b9716d6dd3 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:14.457562 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-38e8004d-4457-47fa-bc1e-36b9716d6dd3 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:14.458037 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-38e8004d-4457-47fa-bc1e-36b9716d6dd3 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:14.458464 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-38e8004d-4457-47fa-bc1e-36b9716d6dd3 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:14.459133 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-38e8004d-4457-47fa-bc1e-36b9716d6dd3 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:14.459573 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-38e8004d-4457-47fa-bc1e-36b9716d6dd3 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:14.459987 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-38e8004d-4457-47fa-bc1e-36b9716d6dd3 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:14.595277 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-38e8004d-4457-47fa-bc1e-36b9716d6dd3 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:14.600675 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4ce2724a-1ab4-44f2-b43b-b62b1fdad477 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:14.601301 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4ce2724a-1ab4-44f2-b43b-b62b1fdad477 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:14.604329 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-38e8004d-4457-47fa-bc1e-36b9716d6dd3 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1498 microversion: 2.1 time: 0.157819 Sep 16 12:49:14.605429 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 459/963] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:14 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1498 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:14.607950 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ce2724a-1ab4-44f2-b43b-b62b1fdad477 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:14.608693 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ce2724a-1ab4-44f2-b43b-b62b1fdad477 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:14.609127 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ce2724a-1ab4-44f2-b43b-b62b1fdad477 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:14.609829 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ce2724a-1ab4-44f2-b43b-b62b1fdad477 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:14.610280 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ce2724a-1ab4-44f2-b43b-b62b1fdad477 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:14.610729 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ce2724a-1ab4-44f2-b43b-b62b1fdad477 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:14.674170 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4ce2724a-1ab4-44f2-b43b-b62b1fdad477 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:14.683157 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4ce2724a-1ab4-44f2-b43b-b62b1fdad477 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1291 microversion: 2.1 time: 0.086234 Sep 16 12:49:14.683742 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 505/964] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:14 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1291 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:14.705312 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ab699f69-d025-4437-90b6-ed9ff6d2a79e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:14.705876 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ab699f69-d025-4437-90b6-ed9ff6d2a79e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 1bdda11e-3b22-4d78-af62-8cc9a3915a4b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:14.711759 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ab699f69-d025-4437-90b6-ed9ff6d2a79e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:14.712280 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ab699f69-d025-4437-90b6-ed9ff6d2a79e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:14.712709 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ab699f69-d025-4437-90b6-ed9ff6d2a79e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:14.713420 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ab699f69-d025-4437-90b6-ed9ff6d2a79e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:14.713858 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ab699f69-d025-4437-90b6-ed9ff6d2a79e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:14.714269 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ab699f69-d025-4437-90b6-ed9ff6d2a79e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:14.843992 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ab699f69-d025-4437-90b6-ed9ff6d2a79e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:14.852356 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ab699f69-d025-4437-90b6-ed9ff6d2a79e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b" status: 200 len: 1319 microversion: 2.1 time: 0.150828 Sep 16 12:49:14.853226 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 460/965] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:14 2022] GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:14.898624 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-90392d64-054f-4da0-9ba7-b790c2d23e34 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:14.899446 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-90392d64-054f-4da0-9ba7-b790c2d23e34 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:14.915576 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90392d64-054f-4da0-9ba7-b790c2d23e34 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:14.916457 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90392d64-054f-4da0-9ba7-b790c2d23e34 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:14.917181 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90392d64-054f-4da0-9ba7-b790c2d23e34 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:14.918445 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90392d64-054f-4da0-9ba7-b790c2d23e34 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:14.919094 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90392d64-054f-4da0-9ba7-b790c2d23e34 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:14.919722 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90392d64-054f-4da0-9ba7-b790c2d23e34 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:14.971922 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-f29c7e75-d506-4fd4-be7a-dd631d416aac req-e678e5e6-c1ac-4060-981d-696a2358076d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6", "name": "network-vif-deleted", "tag": "31e589d5-4175-4617-9376-ffdea1a75308"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:49:14.982381 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-f29c7e75-d506-4fd4-be7a-dd631d416aac req-e678e5e6-c1ac-4060-981d-696a2358076d service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:14.983160 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-f29c7e75-d506-4fd4-be7a-dd631d416aac req-e678e5e6-c1ac-4060-981d-696a2358076d service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:14.983619 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-f29c7e75-d506-4fd4-be7a-dd631d416aac req-e678e5e6-c1ac-4060-981d-696a2358076d service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:14.998873 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-f29c7e75-d506-4fd4-be7a-dd631d416aac req-e678e5e6-c1ac-4060-981d-696a2358076d service nova] Creating event network-vif-deleted:31e589d5-4175-4617-9376-ffdea1a75308 for instance f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 on n-h2-858094-4 Sep 16 12:49:15.004158 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-f29c7e75-d506-4fd4-be7a-dd631d416aac req-e678e5e6-c1ac-4060-981d-696a2358076d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037236 Sep 16 12:49:15.004959 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 461/966] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:49:15.163999 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-04b14cca-dbf0-4a9f-905a-7ca7d3f45d11 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:15.164890 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-04b14cca-dbf0-4a9f-905a-7ca7d3f45d11 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:15.172311 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-04b14cca-dbf0-4a9f-905a-7ca7d3f45d11 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:15.172766 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-04b14cca-dbf0-4a9f-905a-7ca7d3f45d11 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:15.173204 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-04b14cca-dbf0-4a9f-905a-7ca7d3f45d11 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:15.173915 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-04b14cca-dbf0-4a9f-905a-7ca7d3f45d11 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:15.174369 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-04b14cca-dbf0-4a9f-905a-7ca7d3f45d11 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:15.175062 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-04b14cca-dbf0-4a9f-905a-7ca7d3f45d11 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:15.211439 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-04b14cca-dbf0-4a9f-905a-7ca7d3f45d11 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:15.211839 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-04b14cca-dbf0-4a9f-905a-7ca7d3f45d11 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:15.212325 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-04b14cca-dbf0-4a9f-905a-7ca7d3f45d11 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:15.212851 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-04b14cca-dbf0-4a9f-905a-7ca7d3f45d11 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lazy-loading 'fault' on Instance uuid f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:49:15.345947 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-04b14cca-dbf0-4a9f-905a-7ca7d3f45d11 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdc5bd0969148a3ac8879ccf0f58553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0709d7ec436047a39dfb8c5d92f17fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:15.356035 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-04b14cca-dbf0-4a9f-905a-7ca7d3f45d11 tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6" status: 200 len: 1304 microversion: 2.1 time: 0.197768 Sep 16 12:49:15.357331 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 462/967] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:15 2022] GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 => generated 1304 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:15.362057 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e96fc241-821b-46e3-8c07-ceae507439e3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:15.362872 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e96fc241-821b-46e3-8c07-ceae507439e3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:15.371463 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e96fc241-821b-46e3-8c07-ceae507439e3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:15.371952 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e96fc241-821b-46e3-8c07-ceae507439e3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:15.372562 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e96fc241-821b-46e3-8c07-ceae507439e3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:15.373271 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e96fc241-821b-46e3-8c07-ceae507439e3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:15.373713 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e96fc241-821b-46e3-8c07-ceae507439e3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:15.374134 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e96fc241-821b-46e3-8c07-ceae507439e3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:15.456685 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-90392d64-054f-4da0-9ba7-b790c2d23e34 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fd28118c342529cda410e9587dfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a3e6c179c6495281c2816a1e18aa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:15.467543 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-90392d64-054f-4da0-9ba7-b790c2d23e34 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0" status: 200 len: 1371 microversion: 2.1 time: 0.574479 Sep 16 12:49:15.468149 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 506/968] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:14 2022] GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 => generated 1371 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:15.530112 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e96fc241-821b-46e3-8c07-ceae507439e3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:15.537933 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e96fc241-821b-46e3-8c07-ceae507439e3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1471 microversion: 2.1 time: 0.179636 Sep 16 12:49:15.552143 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 463/969] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:15 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1471 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:15.626801 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ae8e1e10-5d6c-4ada-bfee-bc9baebb8262 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:15.627416 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ae8e1e10-5d6c-4ada-bfee-bc9baebb8262 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:15.637583 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae8e1e10-5d6c-4ada-bfee-bc9baebb8262 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:15.638591 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae8e1e10-5d6c-4ada-bfee-bc9baebb8262 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:15.639374 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae8e1e10-5d6c-4ada-bfee-bc9baebb8262 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:15.640675 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae8e1e10-5d6c-4ada-bfee-bc9baebb8262 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:15.641606 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae8e1e10-5d6c-4ada-bfee-bc9baebb8262 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:15.642390 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae8e1e10-5d6c-4ada-bfee-bc9baebb8262 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:15.709940 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9fcf98cf-4e59-413c-b279-91e1c0de4b12 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:15.711096 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9fcf98cf-4e59-413c-b279-91e1c0de4b12 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:15.725787 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9fcf98cf-4e59-413c-b279-91e1c0de4b12 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:15.726575 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9fcf98cf-4e59-413c-b279-91e1c0de4b12 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:15.727370 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9fcf98cf-4e59-413c-b279-91e1c0de4b12 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:15.728694 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9fcf98cf-4e59-413c-b279-91e1c0de4b12 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:15.729738 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9fcf98cf-4e59-413c-b279-91e1c0de4b12 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:15.730949 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9fcf98cf-4e59-413c-b279-91e1c0de4b12 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:15.739550 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:49:15.840713 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9fcf98cf-4e59-413c-b279-91e1c0de4b12 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:15.848892 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9fcf98cf-4e59-413c-b279-91e1c0de4b12 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1291 microversion: 2.1 time: 0.145437 Sep 16 12:49:15.849617 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 464/970] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:15 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1291 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:15.864840 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ae8e1e10-5d6c-4ada-bfee-bc9baebb8262 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:15.873114 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ae8e1e10-5d6c-4ada-bfee-bc9baebb8262 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1498 microversion: 2.1 time: 0.250117 Sep 16 12:49:15.873688 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 507/971] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:15 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1498 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:15.876463 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-304a4542-17e7-4a59-884b-8ba937dd8bb2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:15.877099 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-304a4542-17e7-4a59-884b-8ba937dd8bb2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 1bdda11e-3b22-4d78-af62-8cc9a3915a4b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:15.884294 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-304a4542-17e7-4a59-884b-8ba937dd8bb2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:15.884810 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-304a4542-17e7-4a59-884b-8ba937dd8bb2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:15.885246 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-304a4542-17e7-4a59-884b-8ba937dd8bb2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:15.885940 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-304a4542-17e7-4a59-884b-8ba937dd8bb2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:15.886390 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-304a4542-17e7-4a59-884b-8ba937dd8bb2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:15.886811 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-304a4542-17e7-4a59-884b-8ba937dd8bb2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:16.031011 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-304a4542-17e7-4a59-884b-8ba937dd8bb2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:16.039560 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-304a4542-17e7-4a59-884b-8ba937dd8bb2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b" status: 200 len: 1319 microversion: 2.1 time: 0.166788 Sep 16 12:49:16.040292 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 465/972] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:15 2022] GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:16.384473 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1ade60ce-a313-4b8c-87e5-0a00331456da tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:16.385092 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1ade60ce-a313-4b8c-87e5-0a00331456da tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] [instance: f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:16.387437 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:49:16.393323 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ade60ce-a313-4b8c-87e5-0a00331456da tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:16.393819 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ade60ce-a313-4b8c-87e5-0a00331456da tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:16.394258 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ade60ce-a313-4b8c-87e5-0a00331456da tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:16.394961 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ade60ce-a313-4b8c-87e5-0a00331456da tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:16.395463 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ade60ce-a313-4b8c-87e5-0a00331456da tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:16.395886 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ade60ce-a313-4b8c-87e5-0a00331456da tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:16.409734 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-1ade60ce-a313-4b8c-87e5-0a00331456da tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] HTTP exception thrown: Instance f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 could not be found. Sep 16 12:49:16.411385 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1ade60ce-a313-4b8c-87e5-0a00331456da tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Request method failure captured: Sep 16 12:49:16.411385 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 HTTP/1.1 Sep 16 12:49:16.411385 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:49:16.411385 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:49:16.411385 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:49:16.411385 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:49:16.411385 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:49:16.411385 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:49:16.411385 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:49:16.411385 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:49:16.411385 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHAfNfamkYff9XjWg2ezxGbAK0vGbyFfS9S6d-7riP1dxgveFnj9Pm2y1z3ZfcMqnAIylHkkDkyn5Mz2iFnulkjz1dzhgJxzCkO34Sdb26L6Tq4z2nMMp7d_MH6tVI7vv2gQD3nqH_9sirYzZQeNE-2eLG66LNbSmG2FSKjozjM6jqE Sep 16 12:49:16.411385 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:49:16.411385 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:49:16.411385 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:49:16.411385 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:49:16.411385 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:49:16.411385 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:49:16.411385 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 0709d7ec436047a39dfb8c5d92f17fa3 Sep 16 12:49:16.411385 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersAdminTestJSON-1188504796 Sep 16 12:49:16.411385 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:49:16.411385 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:49:16.412897 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0709d7ec436047a39dfb8c5d92f17fa3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0709d7ec436047a39dfb8c5d92f17fa3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0709d7ec436047a39dfb8c5d92f17fa3", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0709d7ec436047a39dfb8c5d92f17fa3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:49:16.412897 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ServersAdminTestJSON-1188504796 Sep 16 12:49:16.412897 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 0709d7ec436047a39dfb8c5d92f17fa3 Sep 16 12:49:16.412897 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersAdminTestJSON-1188504796 Sep 16 12:49:16.412897 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ServersAdminTestJSON-1188504796-project Sep 16 12:49:16.412897 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:49:16.412897 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:49:16.412897 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 8bdc5bd0969148a3ac8879ccf0f58553 Sep 16 12:49:16.412897 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ServersAdminTestJSON-1188504796-project Sep 16 12:49:16.412897 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:49:16.412897 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 could not be found. Sep 16 12:49:16.412897 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': 'f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6'} Sep 16 12:49:16.413903 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:49:16.413903 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:49:16.413903 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:49:16.413903 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:49:16.413903 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:49:16.413903 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:49:16.413903 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:49:16.413903 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:49:16.413903 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:49:16.413903 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:49:16.413903 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 could not be found. Sep 16 12:49:16.413903 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:49:16.413903 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:49:16.413903 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:49:16.413903 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:49:16.413903 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:49:16.413903 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:49:16.413903 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:49:16.413903 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:49:16.413903 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:49:16.415419 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:49:16.415419 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:49:16.415419 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:49:16.415419 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:49:16.415419 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:49:16.415419 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:49:16.415419 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:49:16.415419 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 could not be found. Sep 16 12:49:16.415419 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:49:16.415419 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:49:16.415419 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:49:16.415419 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:49:16.415419 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:49:16.415419 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:49:16.415419 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:49:16.415419 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:49:16.415419 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 could not be found. Sep 16 12:49:16.415419 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:49:16.416846 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1ade60ce-a313-4b8c-87e5-0a00331456da tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] Returning 404 to user: Instance f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:49:16.416846 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1ade60ce-a313-4b8c-87e5-0a00331456da tempest-ServersAdminTestJSON-1188504796 tempest-ServersAdminTestJSON-1188504796-project] 10.222.0.67 "GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6" status: 404 len: 111 microversion: 2.1 time: 0.032955 Sep 16 12:49:16.416846 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 508/973] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:16 2022] GET /compute/v2.1/servers/f47fa6b2-e78b-4310-97af-d8c0c4b8a3e6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:49:16.490526 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0ecc603c-5150-4adc-96cf-b4479e4fbb4c tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:16.491177 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0ecc603c-5150-4adc-96cf-b4479e4fbb4c tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:16.498958 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0ecc603c-5150-4adc-96cf-b4479e4fbb4c tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:16.499371 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0ecc603c-5150-4adc-96cf-b4479e4fbb4c tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:16.499808 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0ecc603c-5150-4adc-96cf-b4479e4fbb4c tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:16.500637 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0ecc603c-5150-4adc-96cf-b4479e4fbb4c tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:16.501037 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0ecc603c-5150-4adc-96cf-b4479e4fbb4c tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:16.501457 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0ecc603c-5150-4adc-96cf-b4479e4fbb4c tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:16.562669 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5c812a70-1e2f-45a0-9003-85be0f747822 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:16.563910 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5c812a70-1e2f-45a0-9003-85be0f747822 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:16.570625 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c812a70-1e2f-45a0-9003-85be0f747822 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:16.571354 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c812a70-1e2f-45a0-9003-85be0f747822 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:16.571964 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c812a70-1e2f-45a0-9003-85be0f747822 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:16.572738 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c812a70-1e2f-45a0-9003-85be0f747822 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:16.573163 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c812a70-1e2f-45a0-9003-85be0f747822 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:16.573590 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c812a70-1e2f-45a0-9003-85be0f747822 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:16.707114 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0ecc603c-5150-4adc-96cf-b4479e4fbb4c tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fd28118c342529cda410e9587dfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a3e6c179c6495281c2816a1e18aa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:16.716170 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0ecc603c-5150-4adc-96cf-b4479e4fbb4c tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0" status: 200 len: 1371 microversion: 2.1 time: 0.229348 Sep 16 12:49:16.717297 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 466/974] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:16 2022] GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 => generated 1371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:16.756569 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5c812a70-1e2f-45a0-9003-85be0f747822 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:16.764532 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5c812a70-1e2f-45a0-9003-85be0f747822 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1471 microversion: 2.1 time: 0.206099 Sep 16 12:49:16.765106 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 509/975] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:16 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1471 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:16.873135 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1e38f250-24a9-4962-a6e9-d719a00a6af0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:16.873869 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-1e38f250-24a9-4962-a6e9-d719a00a6af0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:16.880431 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1e38f250-24a9-4962-a6e9-d719a00a6af0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:16.880929 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1e38f250-24a9-4962-a6e9-d719a00a6af0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:16.881553 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1e38f250-24a9-4962-a6e9-d719a00a6af0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:16.882577 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1e38f250-24a9-4962-a6e9-d719a00a6af0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:16.883032 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1e38f250-24a9-4962-a6e9-d719a00a6af0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:16.883773 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1e38f250-24a9-4962-a6e9-d719a00a6af0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:16.896887 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-795194a2-adb9-445a-8518-36c34ba7244a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:16.897491 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-795194a2-adb9-445a-8518-36c34ba7244a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:16.904191 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-795194a2-adb9-445a-8518-36c34ba7244a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:16.904682 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-795194a2-adb9-445a-8518-36c34ba7244a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:16.905113 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-795194a2-adb9-445a-8518-36c34ba7244a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:16.905806 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-795194a2-adb9-445a-8518-36c34ba7244a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:16.906250 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-795194a2-adb9-445a-8518-36c34ba7244a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:16.906667 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-795194a2-adb9-445a-8518-36c34ba7244a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:16.981651 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1e38f250-24a9-4962-a6e9-d719a00a6af0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:16.991120 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1e38f250-24a9-4962-a6e9-d719a00a6af0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1291 microversion: 2.1 time: 0.122108 Sep 16 12:49:16.992165 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 467/976] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:16 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1291 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:17.063913 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-389797f7-33ad-4975-8ef1-76f8e9cb58a2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:17.064555 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-389797f7-33ad-4975-8ef1-76f8e9cb58a2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 1bdda11e-3b22-4d78-af62-8cc9a3915a4b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:17.071289 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-389797f7-33ad-4975-8ef1-76f8e9cb58a2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:17.071929 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-389797f7-33ad-4975-8ef1-76f8e9cb58a2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:17.072598 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-389797f7-33ad-4975-8ef1-76f8e9cb58a2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:17.073296 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-389797f7-33ad-4975-8ef1-76f8e9cb58a2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:17.073919 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-389797f7-33ad-4975-8ef1-76f8e9cb58a2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:17.074324 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-389797f7-33ad-4975-8ef1-76f8e9cb58a2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:17.083390 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-795194a2-adb9-445a-8518-36c34ba7244a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:17.095071 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-795194a2-adb9-445a-8518-36c34ba7244a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1498 microversion: 2.1 time: 0.201915 Sep 16 12:49:17.098231 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 510/977] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:16 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1498 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:17.243452 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-389797f7-33ad-4975-8ef1-76f8e9cb58a2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:17.251852 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-389797f7-33ad-4975-8ef1-76f8e9cb58a2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b" status: 200 len: 1319 microversion: 2.1 time: 0.192565 Sep 16 12:49:17.252470 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 468/978] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:17 2022] GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:17.742647 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-41bb6e3a-8322-4713-af08-f6ab0d5a5e71 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:17.744354 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-41bb6e3a-8322-4713-af08-f6ab0d5a5e71 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:17.753393 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41bb6e3a-8322-4713-af08-f6ab0d5a5e71 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:17.754210 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41bb6e3a-8322-4713-af08-f6ab0d5a5e71 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:17.755615 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41bb6e3a-8322-4713-af08-f6ab0d5a5e71 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:17.757104 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41bb6e3a-8322-4713-af08-f6ab0d5a5e71 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:17.758596 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41bb6e3a-8322-4713-af08-f6ab0d5a5e71 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:17.759596 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41bb6e3a-8322-4713-af08-f6ab0d5a5e71 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:17.797976 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a97d081b-339e-47c9-95ef-4e1eb401341e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:17.798701 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a97d081b-339e-47c9-95ef-4e1eb401341e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:17.815025 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a97d081b-339e-47c9-95ef-4e1eb401341e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:17.816509 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a97d081b-339e-47c9-95ef-4e1eb401341e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:17.817722 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a97d081b-339e-47c9-95ef-4e1eb401341e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:17.823799 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a97d081b-339e-47c9-95ef-4e1eb401341e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:17.824608 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a97d081b-339e-47c9-95ef-4e1eb401341e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:17.825129 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a97d081b-339e-47c9-95ef-4e1eb401341e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:18.261972 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-41bb6e3a-8322-4713-af08-f6ab0d5a5e71 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fd28118c342529cda410e9587dfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a3e6c179c6495281c2816a1e18aa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:18.270637 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-41bb6e3a-8322-4713-af08-f6ab0d5a5e71 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0" status: 200 len: 1371 microversion: 2.1 time: 0.535149 Sep 16 12:49:18.271680 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 511/979] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:17 2022] GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 => generated 1371 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:18.290587 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-9cd734ab-b670-4df3-a736-2ddafad688d1 req-edc6e7b0-6d8c-41e7-8de4-022de8885c13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bdda11e-3b22-4d78-af62-8cc9a3915a4b", "name": "network-vif-plugged", "status": "completed", "tag": "e3afd82f-9e91-4967-8755-5ee2e7d21714"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:49:18.305340 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9cd734ab-b670-4df3-a736-2ddafad688d1 req-edc6e7b0-6d8c-41e7-8de4-022de8885c13 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:18.306033 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9cd734ab-b670-4df3-a736-2ddafad688d1 req-edc6e7b0-6d8c-41e7-8de4-022de8885c13 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:18.306303 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9cd734ab-b670-4df3-a736-2ddafad688d1 req-edc6e7b0-6d8c-41e7-8de4-022de8885c13 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:18.318590 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-9cd734ab-b670-4df3-a736-2ddafad688d1 req-edc6e7b0-6d8c-41e7-8de4-022de8885c13 service nova] Creating event network-vif-plugged:e3afd82f-9e91-4967-8755-5ee2e7d21714 for instance 1bdda11e-3b22-4d78-af62-8cc9a3915a4b on n-h1-858094-4 Sep 16 12:49:18.325010 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-9cd734ab-b670-4df3-a736-2ddafad688d1 req-edc6e7b0-6d8c-41e7-8de4-022de8885c13 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050934 Sep 16 12:49:18.325928 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 512/980] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:49:18.332568 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ca3064ad-b6c7-422c-98e4-16ec405d25d7 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:18.333515 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ca3064ad-b6c7-422c-98e4-16ec405d25d7 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:18.339039 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a97d081b-339e-47c9-95ef-4e1eb401341e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:18.341397 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca3064ad-b6c7-422c-98e4-16ec405d25d7 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:18.341882 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca3064ad-b6c7-422c-98e4-16ec405d25d7 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:18.343297 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca3064ad-b6c7-422c-98e4-16ec405d25d7 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:18.344019 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca3064ad-b6c7-422c-98e4-16ec405d25d7 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:18.344504 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca3064ad-b6c7-422c-98e4-16ec405d25d7 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:18.344928 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca3064ad-b6c7-422c-98e4-16ec405d25d7 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:18.349248 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a97d081b-339e-47c9-95ef-4e1eb401341e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1471 microversion: 2.1 time: 0.565361 Sep 16 12:49:18.349844 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 469/981] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:17 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1471 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:18.356092 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b6591b5f-214f-43e3-948e-cf2e5e24c355 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:18.357084 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b6591b5f-214f-43e3-948e-cf2e5e24c355 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:18.364750 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b6591b5f-214f-43e3-948e-cf2e5e24c355 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:18.365574 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b6591b5f-214f-43e3-948e-cf2e5e24c355 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:18.366007 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b6591b5f-214f-43e3-948e-cf2e5e24c355 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:18.367255 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b6591b5f-214f-43e3-948e-cf2e5e24c355 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:18.367869 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b6591b5f-214f-43e3-948e-cf2e5e24c355 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:18.368505 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b6591b5f-214f-43e3-948e-cf2e5e24c355 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:18.522924 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ca3064ad-b6c7-422c-98e4-16ec405d25d7 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:18.533354 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ca3064ad-b6c7-422c-98e4-16ec405d25d7 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1291 microversion: 2.1 time: 0.205769 Sep 16 12:49:18.533979 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 513/982] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:18 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1291 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:18.540804 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-679cb58f-c41e-4a45-9e54-19e5a28ee98c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:18.542123 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-679cb58f-c41e-4a45-9e54-19e5a28ee98c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 1bdda11e-3b22-4d78-af62-8cc9a3915a4b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:18.554425 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-679cb58f-c41e-4a45-9e54-19e5a28ee98c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:18.555415 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-679cb58f-c41e-4a45-9e54-19e5a28ee98c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:18.556080 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-679cb58f-c41e-4a45-9e54-19e5a28ee98c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:18.557473 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-679cb58f-c41e-4a45-9e54-19e5a28ee98c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:18.558261 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-679cb58f-c41e-4a45-9e54-19e5a28ee98c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:18.559201 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-679cb58f-c41e-4a45-9e54-19e5a28ee98c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:18.859641 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-b6591b5f-214f-43e3-948e-cf2e5e24c355 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:18.869816 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b6591b5f-214f-43e3-948e-cf2e5e24c355 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1498 microversion: 2.1 time: 0.518049 Sep 16 12:49:18.870979 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 470/983] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:18 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1498 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:19.035946 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-679cb58f-c41e-4a45-9e54-19e5a28ee98c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:19.046407 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-679cb58f-c41e-4a45-9e54-19e5a28ee98c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b" status: 200 len: 1319 microversion: 2.1 time: 0.511070 Sep 16 12:49:19.047276 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 514/984] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:18 2022] GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b => generated 1319 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:19.214839 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-16bce1af-963e-4cf7-83d8-ccb673d2d9e6 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-1080425858", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": "none"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:49:19.277643 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-16bce1af-963e-4cf7-83d8-ccb673d2d9e6 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:49:19.278160 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-16bce1af-963e-4cf7-83d8-ccb673d2d9e6 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:49:19.278667 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-16bce1af-963e-4cf7-83d8-ccb673d2d9e6 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:49:19.279149 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-16bce1af-963e-4cf7-83d8-ccb673d2d9e6 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:49:19.279572 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-16bce1af-963e-4cf7-83d8-ccb673d2d9e6 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:49:19.289082 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-16bce1af-963e-4cf7-83d8-ccb673d2d9e6 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:19.289553 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-16bce1af-963e-4cf7-83d8-ccb673d2d9e6 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:19.290094 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-16bce1af-963e-4cf7-83d8-ccb673d2d9e6 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:19.290784 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-16bce1af-963e-4cf7-83d8-ccb673d2d9e6 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:19.291234 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-16bce1af-963e-4cf7-83d8-ccb673d2d9e6 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:19.291656 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-16bce1af-963e-4cf7-83d8-ccb673d2d9e6 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:19.295594 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-da712c91-3276-452a-9493-e4a6d26e8bf0 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:19.296425 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-da712c91-3276-452a-9493-e4a6d26e8bf0 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:19.302979 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da712c91-3276-452a-9493-e4a6d26e8bf0 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:19.304379 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da712c91-3276-452a-9493-e4a6d26e8bf0 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:19.305105 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da712c91-3276-452a-9493-e4a6d26e8bf0 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:19.305918 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da712c91-3276-452a-9493-e4a6d26e8bf0 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:19.306438 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da712c91-3276-452a-9493-e4a6d26e8bf0 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:19.307083 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da712c91-3276-452a-9493-e4a6d26e8bf0 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:19.311665 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:49:19.311843 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-16bce1af-963e-4cf7-83d8-ccb673d2d9e6 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Getting quotas for project 2f4fa02f470647fea7d4732332e71a2d. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:49:19.317419 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-16bce1af-963e-4cf7-83d8-ccb673d2d9e6 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Getting quotas for user 691336b67d6040f3aefad86397238f8c and project 2f4fa02f470647fea7d4732332e71a2d. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:49:19.332638 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-16bce1af-963e-4cf7-83d8-ccb673d2d9e6 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:49:19.335521 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-16bce1af-963e-4cf7-83d8-ccb673d2d9e6 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:49:19.391223 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-16bce1af-963e-4cf7-83d8-ccb673d2d9e6 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.329896 Sep 16 12:49:19.392361 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 471/985] 10.222.0.67 () {62 vars in 1188 bytes} [Fri Sep 16 12:49:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 332 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 16 12:49:19.401799 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fcc84ac2-054e-4b30-a186-fe8aa45cfe4b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:19.402586 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-fcc84ac2-054e-4b30-a186-fe8aa45cfe4b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:19.410128 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fcc84ac2-054e-4b30-a186-fe8aa45cfe4b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:19.410706 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fcc84ac2-054e-4b30-a186-fe8aa45cfe4b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:19.411142 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fcc84ac2-054e-4b30-a186-fe8aa45cfe4b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:19.411845 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fcc84ac2-054e-4b30-a186-fe8aa45cfe4b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:19.412342 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fcc84ac2-054e-4b30-a186-fe8aa45cfe4b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:19.412798 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fcc84ac2-054e-4b30-a186-fe8aa45cfe4b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:19.630920 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-da712c91-3276-452a-9493-e4a6d26e8bf0 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fd28118c342529cda410e9587dfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a3e6c179c6495281c2816a1e18aa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:19.641421 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-da712c91-3276-452a-9493-e4a6d26e8bf0 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0" status: 200 len: 1371 microversion: 2.1 time: 0.350049 Sep 16 12:49:19.656748 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 515/986] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:19 2022] GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 => generated 1371 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:19.668473 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2e290a2f-a1cb-4115-a313-736d2e748676 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:19.669517 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2e290a2f-a1cb-4115-a313-736d2e748676 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:19.770830 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-fcc84ac2-054e-4b30-a186-fe8aa45cfe4b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:19.774739 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2e290a2f-a1cb-4115-a313-736d2e748676 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:19.781713 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-fcc84ac2-054e-4b30-a186-fe8aa45cfe4b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1471 microversion: 2.1 time: 0.388074 Sep 16 12:49:19.787482 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2e290a2f-a1cb-4115-a313-736d2e748676 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:19.790563 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2e290a2f-a1cb-4115-a313-736d2e748676 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:19.797665 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 472/987] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:19 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1471 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:19.802148 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2e290a2f-a1cb-4115-a313-736d2e748676 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1454 microversion: 2.91 time: 0.143333 Sep 16 12:49:19.803208 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 516/988] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:49:19 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1454 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:49:19.822300 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d29e5ebb-7f26-4503-85de-a2c24578d61b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:19.823008 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d29e5ebb-7f26-4503-85de-a2c24578d61b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:19.840297 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d29e5ebb-7f26-4503-85de-a2c24578d61b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:19.840837 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d29e5ebb-7f26-4503-85de-a2c24578d61b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:19.843969 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d29e5ebb-7f26-4503-85de-a2c24578d61b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:19.844748 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d29e5ebb-7f26-4503-85de-a2c24578d61b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:19.845421 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d29e5ebb-7f26-4503-85de-a2c24578d61b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:19.845856 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d29e5ebb-7f26-4503-85de-a2c24578d61b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:19.896355 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f4ff5c6b-95ad-4090-87ac-7d7db379337a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:19.897499 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f4ff5c6b-95ad-4090-87ac-7d7db379337a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:19.906235 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4ff5c6b-95ad-4090-87ac-7d7db379337a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:19.907039 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4ff5c6b-95ad-4090-87ac-7d7db379337a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:19.908555 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4ff5c6b-95ad-4090-87ac-7d7db379337a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:19.909338 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4ff5c6b-95ad-4090-87ac-7d7db379337a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:19.909831 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4ff5c6b-95ad-4090-87ac-7d7db379337a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:19.910249 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4ff5c6b-95ad-4090-87ac-7d7db379337a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:20.160454 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d29e5ebb-7f26-4503-85de-a2c24578d61b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:20.171169 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d29e5ebb-7f26-4503-85de-a2c24578d61b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1359 microversion: 2.1 time: 0.372298 Sep 16 12:49:20.171813 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 473/989] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:19 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1359 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:20.177086 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-71c389e4-69ae-4e63-a150-1addfce66bc2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:20.177715 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-71c389e4-69ae-4e63-a150-1addfce66bc2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 1bdda11e-3b22-4d78-af62-8cc9a3915a4b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:20.184226 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-71c389e4-69ae-4e63-a150-1addfce66bc2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:20.184722 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-71c389e4-69ae-4e63-a150-1addfce66bc2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:20.185154 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-71c389e4-69ae-4e63-a150-1addfce66bc2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:20.185862 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-71c389e4-69ae-4e63-a150-1addfce66bc2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:20.186311 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-71c389e4-69ae-4e63-a150-1addfce66bc2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:20.186728 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-71c389e4-69ae-4e63-a150-1addfce66bc2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:20.226158 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f4ff5c6b-95ad-4090-87ac-7d7db379337a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:20.234110 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f4ff5c6b-95ad-4090-87ac-7d7db379337a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1498 microversion: 2.1 time: 0.343413 Sep 16 12:49:20.234699 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 517/990] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:19 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1498 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:20.425950 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-71c389e4-69ae-4e63-a150-1addfce66bc2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:20.436720 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-71c389e4-69ae-4e63-a150-1addfce66bc2 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b" status: 200 len: 1319 microversion: 2.1 time: 0.263381 Sep 16 12:49:20.437420 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 474/991] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:20 2022] GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:20.612223 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-b552f1da-2628-43ec-a229-301872743646 req-5983ef5e-a8c8-4c05-b592-43f92264d4ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3085e02c-a09e-4bc5-a8c4-87ab1cedfc16", "tag": "065308fc-710e-4f14-b3d0-e976788d4def"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:49:20.639724 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b552f1da-2628-43ec-a229-301872743646 req-5983ef5e-a8c8-4c05-b592-43f92264d4ba service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:20.644351 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b552f1da-2628-43ec-a229-301872743646 req-5983ef5e-a8c8-4c05-b592-43f92264d4ba service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:20.645023 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b552f1da-2628-43ec-a229-301872743646 req-5983ef5e-a8c8-4c05-b592-43f92264d4ba service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:20.657620 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-b552f1da-2628-43ec-a229-301872743646 req-5983ef5e-a8c8-4c05-b592-43f92264d4ba service nova] Creating event network-changed:065308fc-710e-4f14-b3d0-e976788d4def for instance 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 on n-h1-858094-4 Sep 16 12:49:20.663406 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-b552f1da-2628-43ec-a229-301872743646 req-5983ef5e-a8c8-4c05-b592-43f92264d4ba service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060473 Sep 16 12:49:20.664588 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 518/992] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:49:20.672900 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9c76cf4a-9691-49b1-a947-469bd835a33e tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:20.673516 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9c76cf4a-9691-49b1-a947-469bd835a33e tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:20.680786 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9c76cf4a-9691-49b1-a947-469bd835a33e tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:20.681282 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9c76cf4a-9691-49b1-a947-469bd835a33e tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:20.681720 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9c76cf4a-9691-49b1-a947-469bd835a33e tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:20.682423 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9c76cf4a-9691-49b1-a947-469bd835a33e tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:20.682883 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9c76cf4a-9691-49b1-a947-469bd835a33e tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:20.683310 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9c76cf4a-9691-49b1-a947-469bd835a33e tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:20.824558 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dc40d885-1a4e-4eea-a865-264b78f48f80 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:20.825395 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dc40d885-1a4e-4eea-a865-264b78f48f80 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:20.831677 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc40d885-1a4e-4eea-a865-264b78f48f80 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:20.832092 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc40d885-1a4e-4eea-a865-264b78f48f80 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:20.832545 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc40d885-1a4e-4eea-a865-264b78f48f80 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:20.833239 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc40d885-1a4e-4eea-a865-264b78f48f80 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:20.834098 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc40d885-1a4e-4eea-a865-264b78f48f80 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:20.834098 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc40d885-1a4e-4eea-a865-264b78f48f80 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:20.862238 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9c76cf4a-9691-49b1-a947-469bd835a33e tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fd28118c342529cda410e9587dfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a3e6c179c6495281c2816a1e18aa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:20.873331 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9c76cf4a-9691-49b1-a947-469bd835a33e tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0" status: 200 len: 1371 microversion: 2.1 time: 0.204499 Sep 16 12:49:20.874062 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 475/993] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:20 2022] GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 => generated 1371 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:20.878925 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-dbd90a56-beb8-44ae-874b-71521227ba51 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:20.879532 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-dbd90a56-beb8-44ae-874b-71521227ba51 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:20.886167 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dbd90a56-beb8-44ae-874b-71521227ba51 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:20.886955 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dbd90a56-beb8-44ae-874b-71521227ba51 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:20.887389 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dbd90a56-beb8-44ae-874b-71521227ba51 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:20.888164 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dbd90a56-beb8-44ae-874b-71521227ba51 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:20.888990 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dbd90a56-beb8-44ae-874b-71521227ba51 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:20.889404 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dbd90a56-beb8-44ae-874b-71521227ba51 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:21.028997 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-dbd90a56-beb8-44ae-874b-71521227ba51 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:21.040877 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-dbd90a56-beb8-44ae-874b-71521227ba51 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:21.042445 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-dbd90a56-beb8-44ae-874b-71521227ba51 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:21.048839 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-dbd90a56-beb8-44ae-874b-71521227ba51 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1506 microversion: 2.91 time: 0.173492 Sep 16 12:49:21.062227 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 476/994] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:49:20 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1506 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:49:21.111733 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dc40d885-1a4e-4eea-a865-264b78f48f80 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:21.125384 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dc40d885-1a4e-4eea-a865-264b78f48f80 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1476 microversion: 2.1 time: 0.306168 Sep 16 12:49:21.127988 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 519/995] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:20 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1476 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:21.198526 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-51be34fb-97f9-4d19-b87a-f9a922a021de tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:21.199152 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-51be34fb-97f9-4d19-b87a-f9a922a021de tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:21.205143 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-51be34fb-97f9-4d19-b87a-f9a922a021de tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:21.205632 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-51be34fb-97f9-4d19-b87a-f9a922a021de tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:21.206068 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-51be34fb-97f9-4d19-b87a-f9a922a021de tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:21.206768 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-51be34fb-97f9-4d19-b87a-f9a922a021de tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:21.207326 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-51be34fb-97f9-4d19-b87a-f9a922a021de tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:21.207754 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-51be34fb-97f9-4d19-b87a-f9a922a021de tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:21.258565 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b010de08-553d-4915-a021-6c80a25c9dd8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:21.259184 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b010de08-553d-4915-a021-6c80a25c9dd8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:21.265384 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b010de08-553d-4915-a021-6c80a25c9dd8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:21.265873 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b010de08-553d-4915-a021-6c80a25c9dd8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:21.266312 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b010de08-553d-4915-a021-6c80a25c9dd8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:21.267011 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b010de08-553d-4915-a021-6c80a25c9dd8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:21.267469 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b010de08-553d-4915-a021-6c80a25c9dd8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:21.267922 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b010de08-553d-4915-a021-6c80a25c9dd8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:21.733340 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-51be34fb-97f9-4d19-b87a-f9a922a021de tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:21.741467 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-51be34fb-97f9-4d19-b87a-f9a922a021de tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1359 microversion: 2.1 time: 0.549925 Sep 16 12:49:21.742059 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 477/996] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:21 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1359 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:21.746700 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-261788c2-a828-4070-8302-f800ff4a8f40 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:21.747307 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-261788c2-a828-4070-8302-f800ff4a8f40 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 1bdda11e-3b22-4d78-af62-8cc9a3915a4b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:21.753347 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-261788c2-a828-4070-8302-f800ff4a8f40 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:21.753823 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-261788c2-a828-4070-8302-f800ff4a8f40 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:21.754256 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-261788c2-a828-4070-8302-f800ff4a8f40 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:21.754931 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-261788c2-a828-4070-8302-f800ff4a8f40 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:21.755376 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-261788c2-a828-4070-8302-f800ff4a8f40 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:21.755789 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-261788c2-a828-4070-8302-f800ff4a8f40 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:21.760673 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b010de08-553d-4915-a021-6c80a25c9dd8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:21.768270 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b010de08-553d-4915-a021-6c80a25c9dd8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1498 microversion: 2.1 time: 0.514051 Sep 16 12:49:21.768846 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 520/997] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:21 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1498 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:21.888547 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-261788c2-a828-4070-8302-f800ff4a8f40 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:21.898523 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-462ac4f3-fdbe-47e9-8e81-5d00d497d98b tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:21.898726 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-261788c2-a828-4070-8302-f800ff4a8f40 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b" status: 200 len: 1468 microversion: 2.1 time: 0.155492 Sep 16 12:49:21.899118 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-462ac4f3-fdbe-47e9-8e81-5d00d497d98b tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:21.899245 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 478/998] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:21 2022] GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b => generated 1468 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:21.905783 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-462ac4f3-fdbe-47e9-8e81-5d00d497d98b tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:21.906262 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-462ac4f3-fdbe-47e9-8e81-5d00d497d98b tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:21.906702 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-462ac4f3-fdbe-47e9-8e81-5d00d497d98b tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:21.907398 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-462ac4f3-fdbe-47e9-8e81-5d00d497d98b tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:21.907900 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-462ac4f3-fdbe-47e9-8e81-5d00d497d98b tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:21.908297 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-462ac4f3-fdbe-47e9-8e81-5d00d497d98b tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:21.921616 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b9498fbe-4260-471e-92bb-c8fddc86342c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:21.927001 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-b9498fbe-4260-471e-92bb-c8fddc86342c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:21.927872 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b9498fbe-4260-471e-92bb-c8fddc86342c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Searching by: {'reservation_id': 'r-lhqr6zww', 'deleted': False, 'project_id': '8c037a6456444018a6ef54314419e2f2'} {{(pid=128780) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 12:49:21.935432 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b9498fbe-4260-471e-92bb-c8fddc86342c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:21.935914 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b9498fbe-4260-471e-92bb-c8fddc86342c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:21.936381 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b9498fbe-4260-471e-92bb-c8fddc86342c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:21.937115 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b9498fbe-4260-471e-92bb-c8fddc86342c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:21.937566 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b9498fbe-4260-471e-92bb-c8fddc86342c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:21.938032 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b9498fbe-4260-471e-92bb-c8fddc86342c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:22.033405 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.multi_cell_list [None req-b9498fbe-4260-471e-92bb-c8fddc86342c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128780) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 12:49:22.044576 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-462ac4f3-fdbe-47e9-8e81-5d00d497d98b tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fd28118c342529cda410e9587dfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a3e6c179c6495281c2816a1e18aa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:22.052546 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-462ac4f3-fdbe-47e9-8e81-5d00d497d98b tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0" status: 200 len: 1371 microversion: 2.1 time: 0.157843 Sep 16 12:49:22.053360 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 521/999] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:21 2022] GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:22.078676 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6ef0837a-8622-4431-8758-918ed8894699 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:22.079314 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6ef0837a-8622-4431-8758-918ed8894699 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:22.085609 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ef0837a-8622-4431-8758-918ed8894699 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:22.086193 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ef0837a-8622-4431-8758-918ed8894699 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:22.086579 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ef0837a-8622-4431-8758-918ed8894699 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:22.087272 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ef0837a-8622-4431-8758-918ed8894699 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:22.087730 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ef0837a-8622-4431-8758-918ed8894699 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:22.088183 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ef0837a-8622-4431-8758-918ed8894699 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:22.102725 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-b9498fbe-4260-471e-92bb-c8fddc86342c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:22.109910 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b9498fbe-4260-471e-92bb-c8fddc86342c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:22.110392 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b9498fbe-4260-471e-92bb-c8fddc86342c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:22.110827 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b9498fbe-4260-471e-92bb-c8fddc86342c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:22.225873 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6ef0837a-8622-4431-8758-918ed8894699 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:22.235228 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6ef0837a-8622-4431-8758-918ed8894699 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:22.236719 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6ef0837a-8622-4431-8758-918ed8894699 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:22.242189 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6ef0837a-8622-4431-8758-918ed8894699 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1512 microversion: 2.91 time: 0.167203 Sep 16 12:49:22.243013 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 522/1000] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:49:22 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:49:22.248239 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2e62bb7a-6e09-47b2-805f-c704d4bd0df1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:22.249086 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2e62bb7a-6e09-47b2-805f-c704d4bd0df1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:22.256347 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e62bb7a-6e09-47b2-805f-c704d4bd0df1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:22.257094 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e62bb7a-6e09-47b2-805f-c704d4bd0df1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:22.257550 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e62bb7a-6e09-47b2-805f-c704d4bd0df1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:22.258491 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e62bb7a-6e09-47b2-805f-c704d4bd0df1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:22.258956 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e62bb7a-6e09-47b2-805f-c704d4bd0df1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:22.259630 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e62bb7a-6e09-47b2-805f-c704d4bd0df1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:22.277172 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b9498fbe-4260-471e-92bb-c8fddc86342c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/detail?reservation_id=r-lhqr6zww" status: 200 len: 2930 microversion: 2.1 time: 0.359121 Sep 16 12:49:22.278036 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 479/1001] 10.222.0.67 () {58 vars in 1197 bytes} [Fri Sep 16 12:49:21 2022] GET /compute/v2.1/servers/detail?reservation_id=r-lhqr6zww => generated 2930 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:22.304262 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-99dfc85c-19de-4be8-8dde-9f426596c357 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:22.320324 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.compute.server_groups [None req-99dfc85c-19de-4be8-8dde-9f426596c357 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Querying cell 19bb4c25-c68f-412b-8c46-4f5dc22c63ee(cell1) for 2 instances {{(pid=128780) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 16 12:49:22.321923 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-99dfc85c-19de-4be8-8dde-9f426596c357 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:22.322629 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-99dfc85c-19de-4be8-8dde-9f426596c357 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:22.323310 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-99dfc85c-19de-4be8-8dde-9f426596c357 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:22.357206 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-99dfc85c-19de-4be8-8dde-9f426596c357 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/os-server-groups/44e9d969-be79-4b9c-97d1-8f3943b1de60" status: 200 len: 270 microversion: 2.1 time: 0.057538 Sep 16 12:49:22.357949 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 480/1002] 10.222.0.67 () {58 vars in 1263 bytes} [Fri Sep 16 12:49:22 2022] GET /compute/v2.1/os-server-groups/44e9d969-be79-4b9c-97d1-8f3943b1de60 => generated 270 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:49:22.372589 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9766ee97-c2f1-4168-8d71-2a79306f541a tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:22.373214 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9766ee97-c2f1-4168-8d71-2a79306f541a tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] [instance: 95448444-b52b-428f-9c7c-8e0e78fc2b22] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:22.379452 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9766ee97-c2f1-4168-8d71-2a79306f541a tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:22.379934 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9766ee97-c2f1-4168-8d71-2a79306f541a tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:22.380391 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9766ee97-c2f1-4168-8d71-2a79306f541a tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:22.381103 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9766ee97-c2f1-4168-8d71-2a79306f541a tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:22.381596 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9766ee97-c2f1-4168-8d71-2a79306f541a tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:22.382014 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9766ee97-c2f1-4168-8d71-2a79306f541a tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:22.386352 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=100 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:49:22.418366 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2e62bb7a-6e09-47b2-805f-c704d4bd0df1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:22.430026 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2e62bb7a-6e09-47b2-805f-c704d4bd0df1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1476 microversion: 2.1 time: 0.185761 Sep 16 12:49:22.440384 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 523/1003] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:22 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1476 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:22.440384 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-8f566d0a-a552-437a-80b9-38f54c7fd6ec req-f0e7a2fb-3f19-4de7-a64b-0ce0aaf7d5d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d16466e6-cdcd-43d7-bc01-bdf3249fdcf0", "name": "network-vif-plugged", "status": "completed", "tag": "9fe525ed-e767-4d78-8eff-93ca2a0eb98f"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:49:22.446689 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8f566d0a-a552-437a-80b9-38f54c7fd6ec req-f0e7a2fb-3f19-4de7-a64b-0ce0aaf7d5d3 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:22.447444 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8f566d0a-a552-437a-80b9-38f54c7fd6ec req-f0e7a2fb-3f19-4de7-a64b-0ce0aaf7d5d3 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:22.447869 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8f566d0a-a552-437a-80b9-38f54c7fd6ec req-f0e7a2fb-3f19-4de7-a64b-0ce0aaf7d5d3 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:22.467364 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-8f566d0a-a552-437a-80b9-38f54c7fd6ec req-f0e7a2fb-3f19-4de7-a64b-0ce0aaf7d5d3 service nova] Creating event network-vif-plugged:9fe525ed-e767-4d78-8eff-93ca2a0eb98f for instance d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 on n-h1-858094-4 Sep 16 12:49:22.472509 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-8f566d0a-a552-437a-80b9-38f54c7fd6ec req-f0e7a2fb-3f19-4de7-a64b-0ce0aaf7d5d3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040288 Sep 16 12:49:22.473426 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 524/1004] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:49:22.542990 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9766ee97-c2f1-4168-8d71-2a79306f541a tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/95448444-b52b-428f-9c7c-8e0e78fc2b22" status: 200 len: 1620 microversion: 2.1 time: 0.178064 Sep 16 12:49:22.543559 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 481/1005] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:22 2022] GET /compute/v2.1/servers/95448444-b52b-428f-9c7c-8e0e78fc2b22 => generated 1620 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:22.565668 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4f8d7fde-01b1-4bb5-80b9-b5c74998bf09 tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:22.566363 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4f8d7fde-01b1-4bb5-80b9-b5c74998bf09 tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] [instance: 1bdda11e-3b22-4d78-af62-8cc9a3915a4b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:22.573239 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f8d7fde-01b1-4bb5-80b9-b5c74998bf09 tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:22.573723 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f8d7fde-01b1-4bb5-80b9-b5c74998bf09 tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:22.574154 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f8d7fde-01b1-4bb5-80b9-b5c74998bf09 tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:22.574837 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f8d7fde-01b1-4bb5-80b9-b5c74998bf09 tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:22.575280 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f8d7fde-01b1-4bb5-80b9-b5c74998bf09 tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:22.575696 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f8d7fde-01b1-4bb5-80b9-b5c74998bf09 tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:22.705500 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4f8d7fde-01b1-4bb5-80b9-b5c74998bf09 tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b" status: 200 len: 1619 microversion: 2.1 time: 0.143825 Sep 16 12:49:22.706063 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 525/1006] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:22 2022] GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b => generated 1619 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:22.764162 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fbbb967b-4f09-420a-9fca-39d5da52a812 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:22.764883 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-fbbb967b-4f09-420a-9fca-39d5da52a812 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:22.770866 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fbbb967b-4f09-420a-9fca-39d5da52a812 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:22.771358 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fbbb967b-4f09-420a-9fca-39d5da52a812 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:22.771811 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fbbb967b-4f09-420a-9fca-39d5da52a812 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:22.773085 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fbbb967b-4f09-420a-9fca-39d5da52a812 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:22.773543 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fbbb967b-4f09-420a-9fca-39d5da52a812 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:22.773960 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fbbb967b-4f09-420a-9fca-39d5da52a812 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:22.792433 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f3e17847-4b2d-490f-8b83-59b79058a8d8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:22.792972 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f3e17847-4b2d-490f-8b83-59b79058a8d8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:22.799544 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3e17847-4b2d-490f-8b83-59b79058a8d8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:22.800038 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3e17847-4b2d-490f-8b83-59b79058a8d8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:22.800520 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3e17847-4b2d-490f-8b83-59b79058a8d8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:22.801324 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3e17847-4b2d-490f-8b83-59b79058a8d8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:22.801694 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3e17847-4b2d-490f-8b83-59b79058a8d8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:22.802123 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3e17847-4b2d-490f-8b83-59b79058a8d8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:22.965477 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-fbbb967b-4f09-420a-9fca-39d5da52a812 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:22.973228 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-fbbb967b-4f09-420a-9fca-39d5da52a812 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1359 microversion: 2.1 time: 0.212802 Sep 16 12:49:22.973807 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 482/1007] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:22 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1359 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:22.978389 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9908090b-1ce6-4cf8-bd98-75987278a8dd tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-118408659", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "8c7aea62-7b4d-400d-89fa-5411deefe490"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:49:22.988302 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f3e17847-4b2d-490f-8b83-59b79058a8d8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:22.997619 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f3e17847-4b2d-490f-8b83-59b79058a8d8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1498 microversion: 2.1 time: 0.209236 Sep 16 12:49:22.999381 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 526/1008] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:22 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1498 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:23.038091 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-9908090b-1ce6-4cf8-bd98-75987278a8dd tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] validate_networks() for None {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:49:23.076929 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6fa9cf93-788f-4841-bea6-e4ad73474706 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:23.077538 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6fa9cf93-788f-4841-bea6-e4ad73474706 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:23.086001 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6fa9cf93-788f-4841-bea6-e4ad73474706 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:23.086592 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6fa9cf93-788f-4841-bea6-e4ad73474706 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:23.087117 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6fa9cf93-788f-4841-bea6-e4ad73474706 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:23.087916 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6fa9cf93-788f-4841-bea6-e4ad73474706 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:23.088475 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6fa9cf93-788f-4841-bea6-e4ad73474706 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:23.088927 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6fa9cf93-788f-4841-bea6-e4ad73474706 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:23.292437 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6fa9cf93-788f-4841-bea6-e4ad73474706 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fd28118c342529cda410e9587dfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a3e6c179c6495281c2816a1e18aa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:23.301032 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6fa9cf93-788f-4841-bea6-e4ad73474706 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0" status: 200 len: 1371 microversion: 2.1 time: 0.228247 Sep 16 12:49:23.301633 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 527/1009] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:23 2022] GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 => generated 1371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:23.307440 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a442d769-d876-4d5a-b738-192eb71698ef tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:23.308039 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a442d769-d876-4d5a-b738-192eb71698ef tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:23.314354 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a442d769-d876-4d5a-b738-192eb71698ef tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:23.314839 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a442d769-d876-4d5a-b738-192eb71698ef tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:23.315271 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a442d769-d876-4d5a-b738-192eb71698ef tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:23.315966 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a442d769-d876-4d5a-b738-192eb71698ef tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:23.316462 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a442d769-d876-4d5a-b738-192eb71698ef tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:23.316881 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a442d769-d876-4d5a-b738-192eb71698ef tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:23.351070 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-9908090b-1ce6-4cf8-bd98-75987278a8dd tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:49:23.351479 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-9908090b-1ce6-4cf8-bd98-75987278a8dd tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:49:23.351945 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-9908090b-1ce6-4cf8-bd98-75987278a8dd tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:49:23.352391 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-9908090b-1ce6-4cf8-bd98-75987278a8dd tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:49:23.352793 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-9908090b-1ce6-4cf8-bd98-75987278a8dd tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:49:23.362792 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9908090b-1ce6-4cf8-bd98-75987278a8dd tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:23.363301 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9908090b-1ce6-4cf8-bd98-75987278a8dd tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:23.363725 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9908090b-1ce6-4cf8-bd98-75987278a8dd tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:23.364472 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9908090b-1ce6-4cf8-bd98-75987278a8dd tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:23.365078 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9908090b-1ce6-4cf8-bd98-75987278a8dd tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:23.365805 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9908090b-1ce6-4cf8-bd98-75987278a8dd tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:23.383612 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-9908090b-1ce6-4cf8-bd98-75987278a8dd tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Getting quotas for project 8c037a6456444018a6ef54314419e2f2. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:49:23.389188 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-9908090b-1ce6-4cf8-bd98-75987278a8dd tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Getting quotas for user c1928790cac542ec86add5794851f97a and project 8c037a6456444018a6ef54314419e2f2. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:49:23.393219 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a442d769-d876-4d5a-b738-192eb71698ef tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:23.400066 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:49:23.405019 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9908090b-1ce6-4cf8-bd98-75987278a8dd tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:49:23.405468 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a442d769-d876-4d5a-b738-192eb71698ef tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:23.407222 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9908090b-1ce6-4cf8-bd98-75987278a8dd tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: dd98275b-2759-4880-b280-fc6fc1614e93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:49:23.408022 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a442d769-d876-4d5a-b738-192eb71698ef tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:23.415301 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a442d769-d876-4d5a-b738-192eb71698ef tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1512 microversion: 2.91 time: 0.112663 Sep 16 12:49:23.415879 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 528/1010] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:49:23 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1512 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:49:23.454914 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a53cdfc5-d759-4d32-947d-5462aaa936e7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:23.455624 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a53cdfc5-d759-4d32-947d-5462aaa936e7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:23.461863 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a53cdfc5-d759-4d32-947d-5462aaa936e7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:23.462348 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a53cdfc5-d759-4d32-947d-5462aaa936e7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:23.462781 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a53cdfc5-d759-4d32-947d-5462aaa936e7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:23.463481 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a53cdfc5-d759-4d32-947d-5462aaa936e7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:23.463937 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a53cdfc5-d759-4d32-947d-5462aaa936e7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:23.464392 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a53cdfc5-d759-4d32-947d-5462aaa936e7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:23.469398 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9908090b-1ce6-4cf8-bd98-75987278a8dd tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.494343 Sep 16 12:49:23.470074 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 483/1011] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:49:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:49:23.485320 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c31ba95d-4b0d-4a1d-acfd-ef392f5a944e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:23.486065 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c31ba95d-4b0d-4a1d-acfd-ef392f5a944e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: dd98275b-2759-4880-b280-fc6fc1614e93] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:23.585483 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c31ba95d-4b0d-4a1d-acfd-ef392f5a944e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:23.598669 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c31ba95d-4b0d-4a1d-acfd-ef392f5a944e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/dd98275b-2759-4880-b280-fc6fc1614e93" status: 200 len: 1216 microversion: 2.1 time: 0.118590 Sep 16 12:49:23.620287 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 484/1012] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:23 2022] GET /compute/v2.1/servers/dd98275b-2759-4880-b280-fc6fc1614e93 => generated 1216 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:23.688404 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a53cdfc5-d759-4d32-947d-5462aaa936e7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:23.702205 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a53cdfc5-d759-4d32-947d-5462aaa936e7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1476 microversion: 2.1 time: 0.251933 Sep 16 12:49:23.703203 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 529/1013] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:23 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1476 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:23.998424 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-bf1104c7-b500-4c75-8f5f-ef731b381ffa tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:23.999065 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-bf1104c7-b500-4c75-8f5f-ef731b381ffa tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:24.008564 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bf1104c7-b500-4c75-8f5f-ef731b381ffa tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:24.009062 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bf1104c7-b500-4c75-8f5f-ef731b381ffa tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:24.009486 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bf1104c7-b500-4c75-8f5f-ef731b381ffa tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:24.010190 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bf1104c7-b500-4c75-8f5f-ef731b381ffa tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:24.010903 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bf1104c7-b500-4c75-8f5f-ef731b381ffa tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:24.011089 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bf1104c7-b500-4c75-8f5f-ef731b381ffa tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:24.027778 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0f29731e-692e-4caa-9802-07f1b58ba506 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:24.029023 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0f29731e-692e-4caa-9802-07f1b58ba506 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:24.045942 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f29731e-692e-4caa-9802-07f1b58ba506 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:24.049703 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f29731e-692e-4caa-9802-07f1b58ba506 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:24.049703 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f29731e-692e-4caa-9802-07f1b58ba506 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:24.049703 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f29731e-692e-4caa-9802-07f1b58ba506 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:24.049703 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f29731e-692e-4caa-9802-07f1b58ba506 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:24.050147 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f29731e-692e-4caa-9802-07f1b58ba506 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:24.318045 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-bf1104c7-b500-4c75-8f5f-ef731b381ffa tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:24.327622 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-bf1104c7-b500-4c75-8f5f-ef731b381ffa tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1359 microversion: 2.1 time: 0.334557 Sep 16 12:49:24.328237 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 485/1014] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:23 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1359 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:24.340849 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-68b5a003-77a6-4ba1-b3df-227989c5931a tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:24.341491 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-68b5a003-77a6-4ba1-b3df-227989c5931a tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:24.347693 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-68b5a003-77a6-4ba1-b3df-227989c5931a tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:24.348216 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-68b5a003-77a6-4ba1-b3df-227989c5931a tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:24.348656 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-68b5a003-77a6-4ba1-b3df-227989c5931a tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:24.349543 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-68b5a003-77a6-4ba1-b3df-227989c5931a tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:24.350513 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-68b5a003-77a6-4ba1-b3df-227989c5931a tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:24.350932 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-68b5a003-77a6-4ba1-b3df-227989c5931a tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:24.363240 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0f29731e-692e-4caa-9802-07f1b58ba506 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:24.373314 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0f29731e-692e-4caa-9802-07f1b58ba506 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1498 microversion: 2.1 time: 0.349494 Sep 16 12:49:24.374253 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 530/1015] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:24 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1498 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:24.446019 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-56b791ca-7a35-44f8-bd81-f583f4dfcc34 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:24.446796 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-56b791ca-7a35-44f8-bd81-f583f4dfcc34 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:24.453417 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56b791ca-7a35-44f8-bd81-f583f4dfcc34 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:24.454058 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56b791ca-7a35-44f8-bd81-f583f4dfcc34 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:24.454575 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56b791ca-7a35-44f8-bd81-f583f4dfcc34 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:24.455353 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56b791ca-7a35-44f8-bd81-f583f4dfcc34 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:24.456062 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56b791ca-7a35-44f8-bd81-f583f4dfcc34 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:24.456486 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56b791ca-7a35-44f8-bd81-f583f4dfcc34 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:24.495160 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-68b5a003-77a6-4ba1-b3df-227989c5931a tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fd28118c342529cda410e9587dfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a3e6c179c6495281c2816a1e18aa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:24.505610 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-68b5a003-77a6-4ba1-b3df-227989c5931a tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0" status: 200 len: 1371 microversion: 2.1 time: 0.175851 Sep 16 12:49:24.506221 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 486/1016] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:24 2022] GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:24.529771 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-56b791ca-7a35-44f8-bd81-f583f4dfcc34 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:24.538648 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-56b791ca-7a35-44f8-bd81-f583f4dfcc34 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:24.540192 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-56b791ca-7a35-44f8-bd81-f583f4dfcc34 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:24.545767 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-56b791ca-7a35-44f8-bd81-f583f4dfcc34 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1533 microversion: 2.91 time: 0.104783 Sep 16 12:49:24.546342 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 531/1017] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:49:24 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1533 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:49:24.620544 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0df03e89-845e-4eb7-ae2c-790d7c187654 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:24.621187 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0df03e89-845e-4eb7-ae2c-790d7c187654 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:24.627206 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0df03e89-845e-4eb7-ae2c-790d7c187654 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:24.627633 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0df03e89-845e-4eb7-ae2c-790d7c187654 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:24.628067 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0df03e89-845e-4eb7-ae2c-790d7c187654 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:24.628775 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0df03e89-845e-4eb7-ae2c-790d7c187654 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:24.629223 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0df03e89-845e-4eb7-ae2c-790d7c187654 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:24.629643 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0df03e89-845e-4eb7-ae2c-790d7c187654 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:24.641235 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7f34d10f-62c9-4aa1-916b-3d0174535fde tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:24.641937 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7f34d10f-62c9-4aa1-916b-3d0174535fde tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: dd98275b-2759-4880-b280-fc6fc1614e93] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:24.648702 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f34d10f-62c9-4aa1-916b-3d0174535fde tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:24.649190 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f34d10f-62c9-4aa1-916b-3d0174535fde tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:24.649629 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f34d10f-62c9-4aa1-916b-3d0174535fde tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:24.650323 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f34d10f-62c9-4aa1-916b-3d0174535fde tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:24.650782 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f34d10f-62c9-4aa1-916b-3d0174535fde tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:24.651207 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f34d10f-62c9-4aa1-916b-3d0174535fde tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:24.719110 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7f34d10f-62c9-4aa1-916b-3d0174535fde tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:24.728486 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7f34d10f-62c9-4aa1-916b-3d0174535fde tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/dd98275b-2759-4880-b280-fc6fc1614e93" status: 200 len: 1268 microversion: 2.1 time: 0.090988 Sep 16 12:49:24.729071 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 532/1018] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:24 2022] GET /compute/v2.1/servers/dd98275b-2759-4880-b280-fc6fc1614e93 => generated 1268 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:24.733501 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5ad844bf-2964-4c32-9118-8a361f582c0f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:24.734276 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5ad844bf-2964-4c32-9118-8a361f582c0f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:24.740566 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ad844bf-2964-4c32-9118-8a361f582c0f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:24.741216 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ad844bf-2964-4c32-9118-8a361f582c0f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:24.741851 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ad844bf-2964-4c32-9118-8a361f582c0f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:24.742697 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ad844bf-2964-4c32-9118-8a361f582c0f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:24.743156 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ad844bf-2964-4c32-9118-8a361f582c0f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:24.743581 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ad844bf-2964-4c32-9118-8a361f582c0f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:24.754326 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-0df03e89-845e-4eb7-ae2c-790d7c187654 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Lazy-loading 'services' on Instance uuid e1f493c8-0adf-4575-8fbd-4591f72c5e6d {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:49:24.810599 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0df03e89-845e-4eb7-ae2c-790d7c187654 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1938 microversion: 2.91 time: 0.241519 Sep 16 12:49:24.811400 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 487/1019] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:49:24 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1938 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:49:24.838187 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7b9c5cae-5cf3-451c-9127-9c145a2cb7b0 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:24.838800 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7b9c5cae-5cf3-451c-9127-9c145a2cb7b0 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:24.845981 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7b9c5cae-5cf3-451c-9127-9c145a2cb7b0 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:24.846470 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7b9c5cae-5cf3-451c-9127-9c145a2cb7b0 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:24.846934 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7b9c5cae-5cf3-451c-9127-9c145a2cb7b0 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:24.848039 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7b9c5cae-5cf3-451c-9127-9c145a2cb7b0 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:24.849013 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7b9c5cae-5cf3-451c-9127-9c145a2cb7b0 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:24.849432 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7b9c5cae-5cf3-451c-9127-9c145a2cb7b0 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:24.962108 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5ad844bf-2964-4c32-9118-8a361f582c0f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:24.965100 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-7b9c5cae-5cf3-451c-9127-9c145a2cb7b0 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Lazy-loading 'services' on Instance uuid e1f493c8-0adf-4575-8fbd-4591f72c5e6d {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:49:24.970862 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5ad844bf-2964-4c32-9118-8a361f582c0f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1476 microversion: 2.1 time: 0.240764 Sep 16 12:49:24.988332 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 533/1020] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:24 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1476 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:25.005677 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7b9c5cae-5cf3-451c-9127-9c145a2cb7b0 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1938 microversion: 2.91 time: 0.171188 Sep 16 12:49:25.005677 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 488/1021] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:49:24 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1938 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:49:25.032738 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e8f43bd0-2cd8-4e6b-817d-49e0fb523c28 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:25.036693 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8f43bd0-2cd8-4e6b-817d-49e0fb523c28 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:25.037342 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8f43bd0-2cd8-4e6b-817d-49e0fb523c28 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:25.039128 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8f43bd0-2cd8-4e6b-817d-49e0fb523c28 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:25.040035 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8f43bd0-2cd8-4e6b-817d-49e0fb523c28 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:25.040683 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8f43bd0-2cd8-4e6b-817d-49e0fb523c28 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:25.041461 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8f43bd0-2cd8-4e6b-817d-49e0fb523c28 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:25.049717 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:49:25.073173 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e8f43bd0-2cd8-4e6b-817d-49e0fb523c28 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.044664 Sep 16 12:49:25.074035 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 534/1022] 10.222.0.67 () {60 vars in 1217 bytes} [Fri Sep 16 12:49:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 12:49:25.087254 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9a71a949-9fbb-44d9-93fd-835cf16999fe tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:49:25.087822 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9a71a949-9fbb-44d9-93fd-835cf16999fe tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:25.096995 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9a71a949-9fbb-44d9-93fd-835cf16999fe tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:25.097474 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9a71a949-9fbb-44d9-93fd-835cf16999fe tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:25.098085 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9a71a949-9fbb-44d9-93fd-835cf16999fe tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:25.098981 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9a71a949-9fbb-44d9-93fd-835cf16999fe tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:25.099463 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9a71a949-9fbb-44d9-93fd-835cf16999fe tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:25.099876 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9a71a949-9fbb-44d9-93fd-835cf16999fe tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:25.125418 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-9a71a949-9fbb-44d9-93fd-835cf16999fe tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lazy-loading 'flavor' on Instance uuid e1f493c8-0adf-4575-8fbd-4591f72c5e6d {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:49:25.352775 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d06edf78-2070-4443-ac1b-7c4afd38c0b4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:25.353765 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d06edf78-2070-4443-ac1b-7c4afd38c0b4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:25.360043 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d06edf78-2070-4443-ac1b-7c4afd38c0b4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:25.360581 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d06edf78-2070-4443-ac1b-7c4afd38c0b4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:25.361014 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d06edf78-2070-4443-ac1b-7c4afd38c0b4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:25.361856 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d06edf78-2070-4443-ac1b-7c4afd38c0b4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:25.362181 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d06edf78-2070-4443-ac1b-7c4afd38c0b4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:25.362783 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d06edf78-2070-4443-ac1b-7c4afd38c0b4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:25.378814 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9a71a949-9fbb-44d9-93fd-835cf16999fe tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "POST /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d/action" status: 202 len: 0 microversion: 2.91 time: 0.296015 Sep 16 12:49:25.379901 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 489/1023] 10.222.0.67 () {62 vars in 1319 bytes} [Fri Sep 16 12:49:25 2022] POST /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 16 12:49:25.390198 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e0e9993c-356e-4dff-af81-04522babcfe3 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:25.391172 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e0e9993c-356e-4dff-af81-04522babcfe3 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:25.401669 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e0e9993c-356e-4dff-af81-04522babcfe3 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:25.402415 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e0e9993c-356e-4dff-af81-04522babcfe3 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:25.403024 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e0e9993c-356e-4dff-af81-04522babcfe3 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:25.405133 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e0e9993c-356e-4dff-af81-04522babcfe3 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:25.405886 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e0e9993c-356e-4dff-af81-04522babcfe3 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:25.406481 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e0e9993c-356e-4dff-af81-04522babcfe3 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:25.502822 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e0e9993c-356e-4dff-af81-04522babcfe3 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:25.511837 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e0e9993c-356e-4dff-af81-04522babcfe3 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:25.513322 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e0e9993c-356e-4dff-af81-04522babcfe3 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:25.518704 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e0e9993c-356e-4dff-af81-04522babcfe3 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.133745 Sep 16 12:49:25.519618 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 490/1024] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:49:25 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:49:25.527140 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8516ac84-1cb8-40e0-84fb-708edec74419 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:25.528199 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8516ac84-1cb8-40e0-84fb-708edec74419 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:25.535439 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8516ac84-1cb8-40e0-84fb-708edec74419 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:25.536195 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8516ac84-1cb8-40e0-84fb-708edec74419 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:25.536793 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8516ac84-1cb8-40e0-84fb-708edec74419 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:25.538302 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8516ac84-1cb8-40e0-84fb-708edec74419 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:25.538957 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8516ac84-1cb8-40e0-84fb-708edec74419 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:25.539544 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8516ac84-1cb8-40e0-84fb-708edec74419 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:25.546249 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d06edf78-2070-4443-ac1b-7c4afd38c0b4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:25.556572 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d06edf78-2070-4443-ac1b-7c4afd38c0b4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1359 microversion: 2.1 time: 0.208994 Sep 16 12:49:25.557951 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 535/1025] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:25 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1359 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:25.572977 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-82077a20-6715-4621-98f0-2f43feead821 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:25.575346 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-82077a20-6715-4621-98f0-2f43feead821 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:25.583858 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82077a20-6715-4621-98f0-2f43feead821 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:25.585489 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82077a20-6715-4621-98f0-2f43feead821 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:25.586030 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82077a20-6715-4621-98f0-2f43feead821 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:25.586926 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82077a20-6715-4621-98f0-2f43feead821 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:25.587475 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82077a20-6715-4621-98f0-2f43feead821 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:25.588067 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82077a20-6715-4621-98f0-2f43feead821 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:25.853957 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8516ac84-1cb8-40e0-84fb-708edec74419 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:25.863177 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8516ac84-1cb8-40e0-84fb-708edec74419 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1498 microversion: 2.1 time: 0.342284 Sep 16 12:49:25.876568 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 491/1026] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:25 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1498 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:25.886510 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7e9cb5ad-01d3-459a-b0c5-e0cf13d164fc tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:25.887647 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7e9cb5ad-01d3-459a-b0c5-e0cf13d164fc tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: dd98275b-2759-4880-b280-fc6fc1614e93] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:25.897099 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7e9cb5ad-01d3-459a-b0c5-e0cf13d164fc tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:25.897990 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7e9cb5ad-01d3-459a-b0c5-e0cf13d164fc tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:25.899015 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7e9cb5ad-01d3-459a-b0c5-e0cf13d164fc tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:25.900166 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7e9cb5ad-01d3-459a-b0c5-e0cf13d164fc tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:25.900806 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-82077a20-6715-4621-98f0-2f43feead821 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fd28118c342529cda410e9587dfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a3e6c179c6495281c2816a1e18aa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:25.901095 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7e9cb5ad-01d3-459a-b0c5-e0cf13d164fc tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:25.901786 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7e9cb5ad-01d3-459a-b0c5-e0cf13d164fc tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:25.914985 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-82077a20-6715-4621-98f0-2f43feead821 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0" status: 200 len: 1371 microversion: 2.1 time: 0.352090 Sep 16 12:49:25.915637 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 536/1027] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:25 2022] GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 => generated 1371 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:25.995641 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-243351fb-71d3-401d-b809-670990ff1eac tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:25.997005 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-243351fb-71d3-401d-b809-670990ff1eac tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:26.004003 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-243351fb-71d3-401d-b809-670990ff1eac tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:26.004003 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-243351fb-71d3-401d-b809-670990ff1eac tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:26.004319 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-243351fb-71d3-401d-b809-670990ff1eac tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:26.004963 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-243351fb-71d3-401d-b809-670990ff1eac tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:26.005424 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-243351fb-71d3-401d-b809-670990ff1eac tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:26.017264 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-243351fb-71d3-401d-b809-670990ff1eac tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:26.224890 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7e9cb5ad-01d3-459a-b0c5-e0cf13d164fc tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:26.238070 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7e9cb5ad-01d3-459a-b0c5-e0cf13d164fc tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/dd98275b-2759-4880-b280-fc6fc1614e93" status: 200 len: 1316 microversion: 2.1 time: 0.372924 Sep 16 12:49:26.238925 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 492/1028] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:25 2022] GET /compute/v2.1/servers/dd98275b-2759-4880-b280-fc6fc1614e93 => generated 1316 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:26.293237 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-243351fb-71d3-401d-b809-670990ff1eac tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:26.306466 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-243351fb-71d3-401d-b809-670990ff1eac tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1476 microversion: 2.1 time: 0.314429 Sep 16 12:49:26.307778 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 537/1029] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:25 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1476 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:26.549704 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-71f1a092-a23c-40f1-bb94-42b8c2022149 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:26.550240 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-71f1a092-a23c-40f1-bb94-42b8c2022149 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:26.557776 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-71f1a092-a23c-40f1-bb94-42b8c2022149 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:26.558491 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-71f1a092-a23c-40f1-bb94-42b8c2022149 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:26.559071 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-71f1a092-a23c-40f1-bb94-42b8c2022149 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:26.559924 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-71f1a092-a23c-40f1-bb94-42b8c2022149 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:26.560422 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-71f1a092-a23c-40f1-bb94-42b8c2022149 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:26.561029 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-71f1a092-a23c-40f1-bb94-42b8c2022149 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:26.581431 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d3a4d9db-c246-49aa-9196-769012a7c27a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:26.582963 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d3a4d9db-c246-49aa-9196-769012a7c27a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:26.609914 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3a4d9db-c246-49aa-9196-769012a7c27a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:26.611082 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3a4d9db-c246-49aa-9196-769012a7c27a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:26.611703 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3a4d9db-c246-49aa-9196-769012a7c27a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:26.613742 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3a4d9db-c246-49aa-9196-769012a7c27a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:26.614376 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3a4d9db-c246-49aa-9196-769012a7c27a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:26.615338 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3a4d9db-c246-49aa-9196-769012a7c27a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:26.670216 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-71f1a092-a23c-40f1-bb94-42b8c2022149 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:26.679901 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-71f1a092-a23c-40f1-bb94-42b8c2022149 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:26.687508 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-71f1a092-a23c-40f1-bb94-42b8c2022149 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:26.696871 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-71f1a092-a23c-40f1-bb94-42b8c2022149 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.151529 Sep 16 12:49:26.700414 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 493/1030] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:49:26 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:49:26.786617 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d3a4d9db-c246-49aa-9196-769012a7c27a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:26.795520 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d3a4d9db-c246-49aa-9196-769012a7c27a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1359 microversion: 2.1 time: 0.218266 Sep 16 12:49:26.796710 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 538/1031] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:26 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1359 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:26.848215 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-aef9723a-b72e-404d-9392-4c0d1699f308 req-13cf2886-3f14-411c-b09c-06506a42aa56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd98275b-2759-4880-b280-fc6fc1614e93", "tag": "65db34e4-9d56-4846-9f39-709aa1748071"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:49:26.864549 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-aef9723a-b72e-404d-9392-4c0d1699f308 req-13cf2886-3f14-411c-b09c-06506a42aa56 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:26.866004 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-aef9723a-b72e-404d-9392-4c0d1699f308 req-13cf2886-3f14-411c-b09c-06506a42aa56 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:26.867305 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-aef9723a-b72e-404d-9392-4c0d1699f308 req-13cf2886-3f14-411c-b09c-06506a42aa56 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:26.883648 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-aef9723a-b72e-404d-9392-4c0d1699f308 req-13cf2886-3f14-411c-b09c-06506a42aa56 service nova] Creating event network-changed:65db34e4-9d56-4846-9f39-709aa1748071 for instance dd98275b-2759-4880-b280-fc6fc1614e93 on n-h2-858094-4 Sep 16 12:49:26.891853 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-330f44a2-c0d8-44ca-b3b9-80fae408dceb tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:26.892926 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-330f44a2-c0d8-44ca-b3b9-80fae408dceb tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:26.900033 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-330f44a2-c0d8-44ca-b3b9-80fae408dceb tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:26.900292 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-aef9723a-b72e-404d-9392-4c0d1699f308 req-13cf2886-3f14-411c-b09c-06506a42aa56 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055144 Sep 16 12:49:26.900801 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-330f44a2-c0d8-44ca-b3b9-80fae408dceb tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:26.901356 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-330f44a2-c0d8-44ca-b3b9-80fae408dceb tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:26.902043 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 494/1032] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:49:26.902172 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-330f44a2-c0d8-44ca-b3b9-80fae408dceb tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:26.902730 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-330f44a2-c0d8-44ca-b3b9-80fae408dceb tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:26.903216 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-330f44a2-c0d8-44ca-b3b9-80fae408dceb tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:26.942116 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6e98fad7-ca44-4e35-8d28-fbf2fb2edfb2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:26.943040 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6e98fad7-ca44-4e35-8d28-fbf2fb2edfb2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:26.949766 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6e98fad7-ca44-4e35-8d28-fbf2fb2edfb2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:26.950426 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6e98fad7-ca44-4e35-8d28-fbf2fb2edfb2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:26.950722 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6e98fad7-ca44-4e35-8d28-fbf2fb2edfb2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:26.951417 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6e98fad7-ca44-4e35-8d28-fbf2fb2edfb2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:26.951879 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6e98fad7-ca44-4e35-8d28-fbf2fb2edfb2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:26.952333 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6e98fad7-ca44-4e35-8d28-fbf2fb2edfb2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:27.144571 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-330f44a2-c0d8-44ca-b3b9-80fae408dceb tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:27.153890 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-330f44a2-c0d8-44ca-b3b9-80fae408dceb tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1498 microversion: 2.1 time: 0.267539 Sep 16 12:49:27.154472 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 539/1033] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:26 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1498 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:27.219022 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6e98fad7-ca44-4e35-8d28-fbf2fb2edfb2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fd28118c342529cda410e9587dfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a3e6c179c6495281c2816a1e18aa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:27.227171 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6e98fad7-ca44-4e35-8d28-fbf2fb2edfb2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0" status: 200 len: 1556 microversion: 2.1 time: 0.289394 Sep 16 12:49:27.227803 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 495/1034] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:26 2022] GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 => generated 1556 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:27.249811 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c2fbbe41-2c21-4502-9878-d7986056022f tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:27.250310 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c2fbbe41-2c21-4502-9878-d7986056022f tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:27.256962 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2fbbe41-2c21-4502-9878-d7986056022f tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:27.257692 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2fbbe41-2c21-4502-9878-d7986056022f tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:27.263433 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5a582fcd-6a68-4bbb-b3a3-87afbc1e8760 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:27.264054 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5a582fcd-6a68-4bbb-b3a3-87afbc1e8760 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: dd98275b-2759-4880-b280-fc6fc1614e93] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:27.267199 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2fbbe41-2c21-4502-9878-d7986056022f tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:27.267970 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2fbbe41-2c21-4502-9878-d7986056022f tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:27.268631 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2fbbe41-2c21-4502-9878-d7986056022f tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:27.269240 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2fbbe41-2c21-4502-9878-d7986056022f tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:27.270692 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5a582fcd-6a68-4bbb-b3a3-87afbc1e8760 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:27.271256 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5a582fcd-6a68-4bbb-b3a3-87afbc1e8760 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:27.272333 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5a582fcd-6a68-4bbb-b3a3-87afbc1e8760 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:27.273667 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5a582fcd-6a68-4bbb-b3a3-87afbc1e8760 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:27.274356 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5a582fcd-6a68-4bbb-b3a3-87afbc1e8760 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:27.274884 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5a582fcd-6a68-4bbb-b3a3-87afbc1e8760 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:27.434351 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c2fbbe41-2c21-4502-9878-d7986056022f tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.188379 Sep 16 12:49:27.434951 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 540/1035] 10.222.0.67 () {58 vars in 1275 bytes} [Fri Sep 16 12:49:27 2022] GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0/os-interface => generated 284 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:49:27.439768 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-423e98bf-f7d2-4b3f-871d-d0c5e0da24c8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:27.440782 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-423e98bf-f7d2-4b3f-871d-d0c5e0da24c8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:27.447804 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-423e98bf-f7d2-4b3f-871d-d0c5e0da24c8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:27.448331 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-423e98bf-f7d2-4b3f-871d-d0c5e0da24c8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:27.448767 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-423e98bf-f7d2-4b3f-871d-d0c5e0da24c8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:27.449773 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-423e98bf-f7d2-4b3f-871d-d0c5e0da24c8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:27.453339 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-423e98bf-f7d2-4b3f-871d-d0c5e0da24c8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:27.453339 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-423e98bf-f7d2-4b3f-871d-d0c5e0da24c8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:27.591688 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5a582fcd-6a68-4bbb-b3a3-87afbc1e8760 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:27.602979 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5a582fcd-6a68-4bbb-b3a3-87afbc1e8760 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/dd98275b-2759-4880-b280-fc6fc1614e93" status: 200 len: 1316 microversion: 2.1 time: 0.343246 Sep 16 12:49:27.604196 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 496/1036] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:27 2022] GET /compute/v2.1/servers/dd98275b-2759-4880-b280-fc6fc1614e93 => generated 1316 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:27.718451 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-423e98bf-f7d2-4b3f-871d-d0c5e0da24c8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:27.729588 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b6d3a502-6613-4940-a5f5-50f01842d30f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:27.730589 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b6d3a502-6613-4940-a5f5-50f01842d30f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:27.739584 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-423e98bf-f7d2-4b3f-871d-d0c5e0da24c8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1476 microversion: 2.1 time: 0.303577 Sep 16 12:49:27.742478 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b6d3a502-6613-4940-a5f5-50f01842d30f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:27.743150 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b6d3a502-6613-4940-a5f5-50f01842d30f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:27.751174 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 541/1037] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:27 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1476 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:27.752667 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b6d3a502-6613-4940-a5f5-50f01842d30f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:27.754385 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b6d3a502-6613-4940-a5f5-50f01842d30f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:27.755778 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b6d3a502-6613-4940-a5f5-50f01842d30f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:27.758697 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b6d3a502-6613-4940-a5f5-50f01842d30f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:27.779202 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:49:27.821897 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2eb4b09c-3f52-48a8-af55-7a184740e331 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:27.822705 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2eb4b09c-3f52-48a8-af55-7a184740e331 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:27.828867 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2eb4b09c-3f52-48a8-af55-7a184740e331 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:27.829599 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2eb4b09c-3f52-48a8-af55-7a184740e331 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:27.830357 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2eb4b09c-3f52-48a8-af55-7a184740e331 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:27.831030 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2eb4b09c-3f52-48a8-af55-7a184740e331 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:27.831561 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2eb4b09c-3f52-48a8-af55-7a184740e331 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:27.832062 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2eb4b09c-3f52-48a8-af55-7a184740e331 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:27.846610 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-b6d3a502-6613-4940-a5f5-50f01842d30f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:27.858358 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-b6d3a502-6613-4940-a5f5-50f01842d30f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:27.861379 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-b6d3a502-6613-4940-a5f5-50f01842d30f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:27.870025 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b6d3a502-6613-4940-a5f5-50f01842d30f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.144701 Sep 16 12:49:27.872187 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 497/1038] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:49:27 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:49:27.978322 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2eb4b09c-3f52-48a8-af55-7a184740e331 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:27.986031 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2eb4b09c-3f52-48a8-af55-7a184740e331 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1359 microversion: 2.1 time: 0.170182 Sep 16 12:49:27.986674 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 542/1039] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:27 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:28.178468 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c2f3078b-82f1-4d72-9c39-e2b0637057e1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:28.179600 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c2f3078b-82f1-4d72-9c39-e2b0637057e1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:28.186658 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c2f3078b-82f1-4d72-9c39-e2b0637057e1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:28.187362 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c2f3078b-82f1-4d72-9c39-e2b0637057e1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:28.187795 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c2f3078b-82f1-4d72-9c39-e2b0637057e1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:28.188525 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c2f3078b-82f1-4d72-9c39-e2b0637057e1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:28.189128 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c2f3078b-82f1-4d72-9c39-e2b0637057e1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:28.189565 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c2f3078b-82f1-4d72-9c39-e2b0637057e1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:28.327629 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c2f3078b-82f1-4d72-9c39-e2b0637057e1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:28.335964 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c2f3078b-82f1-4d72-9c39-e2b0637057e1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1498 microversion: 2.1 time: 0.162146 Sep 16 12:49:28.348870 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 498/1040] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:28 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1498 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:28.626928 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0fa0e837-c3c3-43c2-927c-36007ea0dba5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:28.627997 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0fa0e837-c3c3-43c2-927c-36007ea0dba5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: dd98275b-2759-4880-b280-fc6fc1614e93] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:28.634668 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fa0e837-c3c3-43c2-927c-36007ea0dba5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:28.635667 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fa0e837-c3c3-43c2-927c-36007ea0dba5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:28.635837 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fa0e837-c3c3-43c2-927c-36007ea0dba5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:28.636675 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fa0e837-c3c3-43c2-927c-36007ea0dba5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:28.637229 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fa0e837-c3c3-43c2-927c-36007ea0dba5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:28.637996 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fa0e837-c3c3-43c2-927c-36007ea0dba5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:28.766768 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-75c2508e-b6b4-4af0-8f65-d50d1f075877 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:28.767400 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-75c2508e-b6b4-4af0-8f65-d50d1f075877 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:28.778139 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-75c2508e-b6b4-4af0-8f65-d50d1f075877 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:28.778640 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-75c2508e-b6b4-4af0-8f65-d50d1f075877 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:28.779359 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-75c2508e-b6b4-4af0-8f65-d50d1f075877 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:28.780081 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-75c2508e-b6b4-4af0-8f65-d50d1f075877 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:28.781069 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0fa0e837-c3c3-43c2-927c-36007ea0dba5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:28.788411 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-75c2508e-b6b4-4af0-8f65-d50d1f075877 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:28.788776 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-75c2508e-b6b4-4af0-8f65-d50d1f075877 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:28.791125 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0fa0e837-c3c3-43c2-927c-36007ea0dba5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/dd98275b-2759-4880-b280-fc6fc1614e93" status: 200 len: 1316 microversion: 2.1 time: 0.168080 Sep 16 12:49:28.792200 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 543/1041] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:28 2022] GET /compute/v2.1/servers/dd98275b-2759-4880-b280-fc6fc1614e93 => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:28.901372 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-50904b77-7946-4005-ada0-6a0d98def73a tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:28.902297 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-50904b77-7946-4005-ada0-6a0d98def73a tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:28.917104 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50904b77-7946-4005-ada0-6a0d98def73a tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:28.919989 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50904b77-7946-4005-ada0-6a0d98def73a tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:28.920690 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50904b77-7946-4005-ada0-6a0d98def73a tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:28.923693 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50904b77-7946-4005-ada0-6a0d98def73a tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:28.924648 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50904b77-7946-4005-ada0-6a0d98def73a tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:28.926888 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50904b77-7946-4005-ada0-6a0d98def73a tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:28.958210 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-75c2508e-b6b4-4af0-8f65-d50d1f075877 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:28.967674 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-75c2508e-b6b4-4af0-8f65-d50d1f075877 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1476 microversion: 2.1 time: 0.205309 Sep 16 12:49:28.976336 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 499/1042] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:28 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1476 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:28.981358 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-c9e7bb8b-5bcf-45f0-a3d4-32b532ef2b26 req-0268cd36-f6e2-48d6-ae6e-fa24f8f1de02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d16466e6-cdcd-43d7-bc01-bdf3249fdcf0", "tag": "9fe525ed-e767-4d78-8eff-93ca2a0eb98f"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:49:28.991923 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-c9e7bb8b-5bcf-45f0-a3d4-32b532ef2b26 req-0268cd36-f6e2-48d6-ae6e-fa24f8f1de02 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:28.992876 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-c9e7bb8b-5bcf-45f0-a3d4-32b532ef2b26 req-0268cd36-f6e2-48d6-ae6e-fa24f8f1de02 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:28.993520 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-c9e7bb8b-5bcf-45f0-a3d4-32b532ef2b26 req-0268cd36-f6e2-48d6-ae6e-fa24f8f1de02 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:29.012433 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-c9e7bb8b-5bcf-45f0-a3d4-32b532ef2b26 req-0268cd36-f6e2-48d6-ae6e-fa24f8f1de02 service nova] Creating event network-changed:9fe525ed-e767-4d78-8eff-93ca2a0eb98f for instance d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 on n-h1-858094-4 Sep 16 12:49:29.018136 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-c9e7bb8b-5bcf-45f0-a3d4-32b532ef2b26 req-0268cd36-f6e2-48d6-ae6e-fa24f8f1de02 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040256 Sep 16 12:49:29.018845 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-50904b77-7946-4005-ada0-6a0d98def73a tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:29.019174 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 500/1043] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:49:29.025802 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a7a0ce38-eaf4-4ed5-a2d4-808903b4a2ae tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:29.026582 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a7a0ce38-eaf4-4ed5-a2d4-808903b4a2ae tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:29.030356 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-50904b77-7946-4005-ada0-6a0d98def73a tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:29.032197 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-50904b77-7946-4005-ada0-6a0d98def73a tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:29.035110 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a7a0ce38-eaf4-4ed5-a2d4-808903b4a2ae tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:29.035417 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a7a0ce38-eaf4-4ed5-a2d4-808903b4a2ae tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:29.035923 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a7a0ce38-eaf4-4ed5-a2d4-808903b4a2ae tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:29.036731 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a7a0ce38-eaf4-4ed5-a2d4-808903b4a2ae tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:29.037452 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a7a0ce38-eaf4-4ed5-a2d4-808903b4a2ae tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:29.038299 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a7a0ce38-eaf4-4ed5-a2d4-808903b4a2ae tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:29.038426 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-50904b77-7946-4005-ada0-6a0d98def73a tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.142953 Sep 16 12:49:29.039135 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 544/1044] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:49:28 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:49:29.302414 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a7a0ce38-eaf4-4ed5-a2d4-808903b4a2ae tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:29.316926 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a7a0ce38-eaf4-4ed5-a2d4-808903b4a2ae tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1359 microversion: 2.1 time: 0.296451 Sep 16 12:49:29.320441 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 501/1045] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:29 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1359 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:29.360756 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5870f10d-43bb-4303-9f45-81104e305ec8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:29.361476 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5870f10d-43bb-4303-9f45-81104e305ec8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:29.369453 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5870f10d-43bb-4303-9f45-81104e305ec8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:29.370304 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5870f10d-43bb-4303-9f45-81104e305ec8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:29.370982 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5870f10d-43bb-4303-9f45-81104e305ec8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:29.371913 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5870f10d-43bb-4303-9f45-81104e305ec8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:29.372557 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5870f10d-43bb-4303-9f45-81104e305ec8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:29.373090 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5870f10d-43bb-4303-9f45-81104e305ec8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:29.510910 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5870f10d-43bb-4303-9f45-81104e305ec8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:29.518804 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5870f10d-43bb-4303-9f45-81104e305ec8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1498 microversion: 2.1 time: 0.162251 Sep 16 12:49:29.519397 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 545/1046] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:29 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1498 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:29.814903 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b8163165-9d0a-471b-a89c-8b5373a211f5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:29.815518 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b8163165-9d0a-471b-a89c-8b5373a211f5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: dd98275b-2759-4880-b280-fc6fc1614e93] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:29.821616 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b8163165-9d0a-471b-a89c-8b5373a211f5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:29.822132 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b8163165-9d0a-471b-a89c-8b5373a211f5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:29.822573 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b8163165-9d0a-471b-a89c-8b5373a211f5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:29.823261 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b8163165-9d0a-471b-a89c-8b5373a211f5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:29.823713 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b8163165-9d0a-471b-a89c-8b5373a211f5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:29.824146 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b8163165-9d0a-471b-a89c-8b5373a211f5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:29.991094 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-65adb54a-4434-48fb-9d6e-7abf03a9520c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:29.992051 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-65adb54a-4434-48fb-9d6e-7abf03a9520c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:29.995649 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:49:30.000418 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65adb54a-4434-48fb-9d6e-7abf03a9520c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:30.001024 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65adb54a-4434-48fb-9d6e-7abf03a9520c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:30.001577 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65adb54a-4434-48fb-9d6e-7abf03a9520c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:30.002397 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65adb54a-4434-48fb-9d6e-7abf03a9520c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:30.002908 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65adb54a-4434-48fb-9d6e-7abf03a9520c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:30.003400 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65adb54a-4434-48fb-9d6e-7abf03a9520c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:30.041489 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-b8163165-9d0a-471b-a89c-8b5373a211f5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:30.050773 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b8163165-9d0a-471b-a89c-8b5373a211f5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/dd98275b-2759-4880-b280-fc6fc1614e93" status: 200 len: 1316 microversion: 2.1 time: 0.239690 Sep 16 12:49:30.051339 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 502/1047] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:29 2022] GET /compute/v2.1/servers/dd98275b-2759-4880-b280-fc6fc1614e93 => generated 1316 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:30.070162 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f6023ab1-d876-4f02-9c12-eebfc903fae4 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:30.070771 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f6023ab1-d876-4f02-9c12-eebfc903fae4 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:30.077895 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f6023ab1-d876-4f02-9c12-eebfc903fae4 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:30.078374 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f6023ab1-d876-4f02-9c12-eebfc903fae4 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:30.078816 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f6023ab1-d876-4f02-9c12-eebfc903fae4 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:30.079563 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f6023ab1-d876-4f02-9c12-eebfc903fae4 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:30.080015 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f6023ab1-d876-4f02-9c12-eebfc903fae4 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:30.080505 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f6023ab1-d876-4f02-9c12-eebfc903fae4 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:30.162464 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f6023ab1-d876-4f02-9c12-eebfc903fae4 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:30.166026 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-65adb54a-4434-48fb-9d6e-7abf03a9520c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:30.170741 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f6023ab1-d876-4f02-9c12-eebfc903fae4 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:30.172204 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f6023ab1-d876-4f02-9c12-eebfc903fae4 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:30.174779 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-65adb54a-4434-48fb-9d6e-7abf03a9520c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1476 microversion: 2.1 time: 0.187644 Sep 16 12:49:30.175692 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 546/1048] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:29 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1476 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:30.178101 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f6023ab1-d876-4f02-9c12-eebfc903fae4 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.114707 Sep 16 12:49:30.178492 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 503/1049] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:49:30 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:49:30.335742 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-e8215c55-9393-43ec-8ffe-bd2a194886c4 req-2ac0922b-86b8-48c1-af62-f2a1faa4d9ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3085e02c-a09e-4bc5-a8c4-87ab1cedfc16", "name": "network-vif-plugged", "status": "completed", "tag": "065308fc-710e-4f14-b3d0-e976788d4def"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:49:30.341435 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e4a22dbd-c38c-47ec-bf51-b59ac489b849 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:30.342180 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e4a22dbd-c38c-47ec-bf51-b59ac489b849 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:30.346613 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e8215c55-9393-43ec-8ffe-bd2a194886c4 req-2ac0922b-86b8-48c1-af62-f2a1faa4d9ff service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:30.347115 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e8215c55-9393-43ec-8ffe-bd2a194886c4 req-2ac0922b-86b8-48c1-af62-f2a1faa4d9ff service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:30.347819 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e8215c55-9393-43ec-8ffe-bd2a194886c4 req-2ac0922b-86b8-48c1-af62-f2a1faa4d9ff service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:30.349407 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e4a22dbd-c38c-47ec-bf51-b59ac489b849 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:30.350080 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e4a22dbd-c38c-47ec-bf51-b59ac489b849 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:30.350921 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e4a22dbd-c38c-47ec-bf51-b59ac489b849 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:30.352020 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e4a22dbd-c38c-47ec-bf51-b59ac489b849 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:30.352575 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e4a22dbd-c38c-47ec-bf51-b59ac489b849 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:30.353863 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e4a22dbd-c38c-47ec-bf51-b59ac489b849 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:30.360327 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-e8215c55-9393-43ec-8ffe-bd2a194886c4 req-2ac0922b-86b8-48c1-af62-f2a1faa4d9ff service nova] Creating event network-vif-plugged:065308fc-710e-4f14-b3d0-e976788d4def for instance 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 on n-h1-858094-4 Sep 16 12:49:30.365386 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-e8215c55-9393-43ec-8ffe-bd2a194886c4 req-2ac0922b-86b8-48c1-af62-f2a1faa4d9ff service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034026 Sep 16 12:49:30.367855 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 547/1050] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:49:30.493123 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e4a22dbd-c38c-47ec-bf51-b59ac489b849 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:30.500772 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e4a22dbd-c38c-47ec-bf51-b59ac489b849 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1359 microversion: 2.1 time: 0.163177 Sep 16 12:49:30.501361 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 504/1051] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:30 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:30.542107 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-08389bae-aad9-47d4-8218-db22c81dcb35 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:30.542795 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-08389bae-aad9-47d4-8218-db22c81dcb35 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:30.549708 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08389bae-aad9-47d4-8218-db22c81dcb35 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:30.550094 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08389bae-aad9-47d4-8218-db22c81dcb35 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:30.550528 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08389bae-aad9-47d4-8218-db22c81dcb35 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:30.551236 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08389bae-aad9-47d4-8218-db22c81dcb35 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:30.551690 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08389bae-aad9-47d4-8218-db22c81dcb35 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:30.553318 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08389bae-aad9-47d4-8218-db22c81dcb35 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:30.727117 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-08389bae-aad9-47d4-8218-db22c81dcb35 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:30.734875 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-08389bae-aad9-47d4-8218-db22c81dcb35 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1498 microversion: 2.1 time: 0.197105 Sep 16 12:49:30.735447 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 548/1052] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:30 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1498 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:31.073735 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-cfa8c8cb-f27c-46d3-af6b-eb5d0c3dd328 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:31.074391 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-cfa8c8cb-f27c-46d3-af6b-eb5d0c3dd328 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: dd98275b-2759-4880-b280-fc6fc1614e93] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:31.080390 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cfa8c8cb-f27c-46d3-af6b-eb5d0c3dd328 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:31.080876 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cfa8c8cb-f27c-46d3-af6b-eb5d0c3dd328 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:31.081315 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cfa8c8cb-f27c-46d3-af6b-eb5d0c3dd328 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:31.082006 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cfa8c8cb-f27c-46d3-af6b-eb5d0c3dd328 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:31.082531 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cfa8c8cb-f27c-46d3-af6b-eb5d0c3dd328 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:31.082957 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cfa8c8cb-f27c-46d3-af6b-eb5d0c3dd328 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:31.198914 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-90deb41a-9609-484b-89c7-3854d1a0e127 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:31.199716 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-90deb41a-9609-484b-89c7-3854d1a0e127 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:31.206765 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90deb41a-9609-484b-89c7-3854d1a0e127 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:31.207249 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90deb41a-9609-484b-89c7-3854d1a0e127 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:31.207707 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90deb41a-9609-484b-89c7-3854d1a0e127 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:31.208414 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90deb41a-9609-484b-89c7-3854d1a0e127 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:31.209380 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90deb41a-9609-484b-89c7-3854d1a0e127 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:31.210030 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90deb41a-9609-484b-89c7-3854d1a0e127 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:31.223057 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-cfa8c8cb-f27c-46d3-af6b-eb5d0c3dd328 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:31.234831 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-cfa8c8cb-f27c-46d3-af6b-eb5d0c3dd328 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/dd98275b-2759-4880-b280-fc6fc1614e93" status: 200 len: 1316 microversion: 2.1 time: 0.164861 Sep 16 12:49:31.235425 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 505/1053] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:31 2022] GET /compute/v2.1/servers/dd98275b-2759-4880-b280-fc6fc1614e93 => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:31.244968 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-67708290-ea44-47e4-8d8b-16cde12dd27c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:31.245931 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-67708290-ea44-47e4-8d8b-16cde12dd27c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:31.252267 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-67708290-ea44-47e4-8d8b-16cde12dd27c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:31.252760 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-67708290-ea44-47e4-8d8b-16cde12dd27c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:31.253197 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-67708290-ea44-47e4-8d8b-16cde12dd27c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:31.253898 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-67708290-ea44-47e4-8d8b-16cde12dd27c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:31.254353 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-67708290-ea44-47e4-8d8b-16cde12dd27c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:31.254775 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-67708290-ea44-47e4-8d8b-16cde12dd27c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:31.333019 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-67708290-ea44-47e4-8d8b-16cde12dd27c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:31.341775 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-67708290-ea44-47e4-8d8b-16cde12dd27c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:31.343224 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-67708290-ea44-47e4-8d8b-16cde12dd27c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:31.348801 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-67708290-ea44-47e4-8d8b-16cde12dd27c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.107628 Sep 16 12:49:31.349368 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 506/1054] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:49:31 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:49:31.363900 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-90deb41a-9609-484b-89c7-3854d1a0e127 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:31.371701 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-90deb41a-9609-484b-89c7-3854d1a0e127 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1476 microversion: 2.1 time: 0.176636 Sep 16 12:49:31.372294 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 549/1055] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:31 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1476 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:31.525461 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f9e6088c-6dcd-4f4a-91f6-07ba1fb2402c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:31.526221 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f9e6088c-6dcd-4f4a-91f6-07ba1fb2402c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:31.532835 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f9e6088c-6dcd-4f4a-91f6-07ba1fb2402c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:31.533347 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f9e6088c-6dcd-4f4a-91f6-07ba1fb2402c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:31.533783 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f9e6088c-6dcd-4f4a-91f6-07ba1fb2402c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:31.534537 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f9e6088c-6dcd-4f4a-91f6-07ba1fb2402c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:31.534993 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f9e6088c-6dcd-4f4a-91f6-07ba1fb2402c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:31.535444 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f9e6088c-6dcd-4f4a-91f6-07ba1fb2402c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:31.668349 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f9e6088c-6dcd-4f4a-91f6-07ba1fb2402c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:31.676103 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f9e6088c-6dcd-4f4a-91f6-07ba1fb2402c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1359 microversion: 2.1 time: 0.155193 Sep 16 12:49:31.676705 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 507/1056] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:31 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:31.759222 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c952d234-fe28-42b6-9c77-63afbe261c77 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:31.759831 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c952d234-fe28-42b6-9c77-63afbe261c77 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:31.765816 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c952d234-fe28-42b6-9c77-63afbe261c77 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:31.766300 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c952d234-fe28-42b6-9c77-63afbe261c77 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:31.766738 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c952d234-fe28-42b6-9c77-63afbe261c77 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:31.767420 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c952d234-fe28-42b6-9c77-63afbe261c77 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:31.767873 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c952d234-fe28-42b6-9c77-63afbe261c77 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:31.768332 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c952d234-fe28-42b6-9c77-63afbe261c77 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:31.897719 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c952d234-fe28-42b6-9c77-63afbe261c77 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:31.905454 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c952d234-fe28-42b6-9c77-63afbe261c77 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1498 microversion: 2.1 time: 0.150675 Sep 16 12:49:31.906022 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 550/1057] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:31 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1498 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:32.258927 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6d3bc1ad-396b-473f-b757-f966f711f68a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:32.259523 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6d3bc1ad-396b-473f-b757-f966f711f68a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: dd98275b-2759-4880-b280-fc6fc1614e93] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:32.266193 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6d3bc1ad-396b-473f-b757-f966f711f68a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:32.266684 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6d3bc1ad-396b-473f-b757-f966f711f68a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:32.268284 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6d3bc1ad-396b-473f-b757-f966f711f68a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:32.268511 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6d3bc1ad-396b-473f-b757-f966f711f68a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:32.268963 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6d3bc1ad-396b-473f-b757-f966f711f68a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:32.269474 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6d3bc1ad-396b-473f-b757-f966f711f68a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:32.377507 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-aba6b7b7-f9e2-4762-b841-2c9ad688c949 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:32.378112 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-aba6b7b7-f9e2-4762-b841-2c9ad688c949 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:32.380563 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:49:32.386259 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aba6b7b7-f9e2-4762-b841-2c9ad688c949 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:32.386819 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aba6b7b7-f9e2-4762-b841-2c9ad688c949 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:32.387428 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aba6b7b7-f9e2-4762-b841-2c9ad688c949 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:32.388381 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aba6b7b7-f9e2-4762-b841-2c9ad688c949 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:32.388849 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aba6b7b7-f9e2-4762-b841-2c9ad688c949 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:32.389507 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aba6b7b7-f9e2-4762-b841-2c9ad688c949 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:32.408828 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6d3bc1ad-396b-473f-b757-f966f711f68a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:32.417286 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6d3bc1ad-396b-473f-b757-f966f711f68a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/dd98275b-2759-4880-b280-fc6fc1614e93" status: 200 len: 1316 microversion: 2.1 time: 0.163126 Sep 16 12:49:32.417878 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 508/1058] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:32 2022] GET /compute/v2.1/servers/dd98275b-2759-4880-b280-fc6fc1614e93 => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:32.422783 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7a76e627-5c21-49a4-97f4-8b2f107de1fa tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:32.429413 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7a76e627-5c21-49a4-97f4-8b2f107de1fa tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:32.440841 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7a76e627-5c21-49a4-97f4-8b2f107de1fa tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:32.441335 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7a76e627-5c21-49a4-97f4-8b2f107de1fa tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:32.441773 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7a76e627-5c21-49a4-97f4-8b2f107de1fa tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:32.442474 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7a76e627-5c21-49a4-97f4-8b2f107de1fa tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:32.442934 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7a76e627-5c21-49a4-97f4-8b2f107de1fa tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:32.443352 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7a76e627-5c21-49a4-97f4-8b2f107de1fa tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:32.458021 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-aba6b7b7-f9e2-4762-b841-2c9ad688c949 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:32.466680 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-aba6b7b7-f9e2-4762-b841-2c9ad688c949 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:32.468148 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-aba6b7b7-f9e2-4762-b841-2c9ad688c949 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:32.473222 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-aba6b7b7-f9e2-4762-b841-2c9ad688c949 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.099741 Sep 16 12:49:32.473804 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 551/1059] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:49:32 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:49:32.581732 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7a76e627-5c21-49a4-97f4-8b2f107de1fa tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:32.592551 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7a76e627-5c21-49a4-97f4-8b2f107de1fa tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1476 microversion: 2.1 time: 0.173605 Sep 16 12:49:32.593536 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 509/1060] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:32 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1476 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:32.699022 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f8f923c6-8809-4a5d-bc07-448a148c0c1b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:32.699686 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f8f923c6-8809-4a5d-bc07-448a148c0c1b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:32.705885 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8f923c6-8809-4a5d-bc07-448a148c0c1b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:32.706450 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8f923c6-8809-4a5d-bc07-448a148c0c1b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:32.706952 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8f923c6-8809-4a5d-bc07-448a148c0c1b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:32.707712 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8f923c6-8809-4a5d-bc07-448a148c0c1b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:32.708269 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8f923c6-8809-4a5d-bc07-448a148c0c1b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:32.709314 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8f923c6-8809-4a5d-bc07-448a148c0c1b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:32.730659 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:49:32.929384 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-78112c78-f40a-42cd-9963-7e29f4b2620f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:32.930108 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-78112c78-f40a-42cd-9963-7e29f4b2620f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:32.936816 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-78112c78-f40a-42cd-9963-7e29f4b2620f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:32.937302 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-78112c78-f40a-42cd-9963-7e29f4b2620f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:32.937732 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-78112c78-f40a-42cd-9963-7e29f4b2620f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:32.938434 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-78112c78-f40a-42cd-9963-7e29f4b2620f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:32.938942 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-78112c78-f40a-42cd-9963-7e29f4b2620f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:32.939364 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-78112c78-f40a-42cd-9963-7e29f4b2620f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:33.143241 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f8f923c6-8809-4a5d-bc07-448a148c0c1b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:33.151385 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f8f923c6-8809-4a5d-bc07-448a148c0c1b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1542 microversion: 2.1 time: 0.456406 Sep 16 12:49:33.151959 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 552/1061] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:32 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1542 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:33.174976 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0e2b369c-e253-4c0a-bc74-e87c0d638357 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:33.175472 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0e2b369c-e253-4c0a-bc74-e87c0d638357 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:33.182232 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e2b369c-e253-4c0a-bc74-e87c0d638357 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:33.182714 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e2b369c-e253-4c0a-bc74-e87c0d638357 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:33.183146 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e2b369c-e253-4c0a-bc74-e87c0d638357 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:33.183836 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e2b369c-e253-4c0a-bc74-e87c0d638357 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:33.184336 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e2b369c-e253-4c0a-bc74-e87c0d638357 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:33.184743 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e2b369c-e253-4c0a-bc74-e87c0d638357 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:33.238218 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-78112c78-f40a-42cd-9963-7e29f4b2620f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:33.246773 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-78112c78-f40a-42cd-9963-7e29f4b2620f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1498 microversion: 2.1 time: 0.321314 Sep 16 12:49:33.247519 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 510/1062] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:32 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1498 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:33.272727 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0e2b369c-e253-4c0a-bc74-e87c0d638357 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101974 Sep 16 12:49:33.273322 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 553/1063] 10.222.0.67 () {58 vars in 1275 bytes} [Fri Sep 16 12:49:33 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:49:33.442299 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8e9925eb-e4db-415d-9cc0-5c6336c29b7d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:33.442892 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8e9925eb-e4db-415d-9cc0-5c6336c29b7d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: dd98275b-2759-4880-b280-fc6fc1614e93] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:33.445763 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=6 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:49:33.451157 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8e9925eb-e4db-415d-9cc0-5c6336c29b7d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:33.451643 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8e9925eb-e4db-415d-9cc0-5c6336c29b7d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:33.452065 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8e9925eb-e4db-415d-9cc0-5c6336c29b7d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:33.452786 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8e9925eb-e4db-415d-9cc0-5c6336c29b7d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:33.453234 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8e9925eb-e4db-415d-9cc0-5c6336c29b7d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:33.453652 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8e9925eb-e4db-415d-9cc0-5c6336c29b7d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:33.501804 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c5926acf-ee02-4954-8322-2ced9818f720 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:33.502413 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c5926acf-ee02-4954-8322-2ced9818f720 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:33.508656 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5926acf-ee02-4954-8322-2ced9818f720 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:33.509220 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5926acf-ee02-4954-8322-2ced9818f720 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:33.509580 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5926acf-ee02-4954-8322-2ced9818f720 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:33.510286 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5926acf-ee02-4954-8322-2ced9818f720 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:33.510740 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5926acf-ee02-4954-8322-2ced9818f720 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:33.511169 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5926acf-ee02-4954-8322-2ced9818f720 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:33.593064 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=16 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:49:33.608495 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c5926acf-ee02-4954-8322-2ced9818f720 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:33.617952 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c5926acf-ee02-4954-8322-2ced9818f720 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:33.619424 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c5926acf-ee02-4954-8322-2ced9818f720 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:33.624670 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c5926acf-ee02-4954-8322-2ced9818f720 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.127301 Sep 16 12:49:33.625246 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 554/1064] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:49:33 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:49:33.629728 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-39b590e2-d21a-413d-a743-8d66c64ae1fc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:33.630336 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-39b590e2-d21a-413d-a743-8d66c64ae1fc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:33.636542 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39b590e2-d21a-413d-a743-8d66c64ae1fc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:33.637029 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39b590e2-d21a-413d-a743-8d66c64ae1fc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:33.637462 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39b590e2-d21a-413d-a743-8d66c64ae1fc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:33.638160 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39b590e2-d21a-413d-a743-8d66c64ae1fc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:33.638600 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39b590e2-d21a-413d-a743-8d66c64ae1fc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:33.639020 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39b590e2-d21a-413d-a743-8d66c64ae1fc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:33.743517 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8e9925eb-e4db-415d-9cc0-5c6336c29b7d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:33.751117 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8e9925eb-e4db-415d-9cc0-5c6336c29b7d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/dd98275b-2759-4880-b280-fc6fc1614e93" status: 200 len: 1316 microversion: 2.1 time: 0.312600 Sep 16 12:49:33.751697 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 511/1065] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:33 2022] GET /compute/v2.1/servers/dd98275b-2759-4880-b280-fc6fc1614e93 => generated 1316 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:33.909168 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-39b590e2-d21a-413d-a743-8d66c64ae1fc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:33.917355 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-39b590e2-d21a-413d-a743-8d66c64ae1fc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1476 microversion: 2.1 time: 0.291036 Sep 16 12:49:33.917940 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 555/1066] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:33 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1476 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:34.258092 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-e4bfd26f-b0df-440c-ab96-8da71e7956c5 req-a19f296d-dbfa-47ae-9457-2e25879ef6f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd98275b-2759-4880-b280-fc6fc1614e93", "name": "network-vif-plugged", "status": "completed", "tag": "65db34e4-9d56-4846-9f39-709aa1748071"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:49:34.270388 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-e4bfd26f-b0df-440c-ab96-8da71e7956c5 req-a19f296d-dbfa-47ae-9457-2e25879ef6f9 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:34.270815 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-29b15fce-c15a-4326-b887-5aab2d2567ef tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:34.271031 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-e4bfd26f-b0df-440c-ab96-8da71e7956c5 req-a19f296d-dbfa-47ae-9457-2e25879ef6f9 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:34.271688 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-e4bfd26f-b0df-440c-ab96-8da71e7956c5 req-a19f296d-dbfa-47ae-9457-2e25879ef6f9 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:34.271956 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-29b15fce-c15a-4326-b887-5aab2d2567ef tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:34.278470 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29b15fce-c15a-4326-b887-5aab2d2567ef tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:34.279026 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29b15fce-c15a-4326-b887-5aab2d2567ef tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:34.279755 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29b15fce-c15a-4326-b887-5aab2d2567ef tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:34.280560 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29b15fce-c15a-4326-b887-5aab2d2567ef tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:34.281134 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29b15fce-c15a-4326-b887-5aab2d2567ef tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:34.281628 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29b15fce-c15a-4326-b887-5aab2d2567ef tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:34.289289 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-e4bfd26f-b0df-440c-ab96-8da71e7956c5 req-a19f296d-dbfa-47ae-9457-2e25879ef6f9 service nova] Creating event network-vif-plugged:65db34e4-9d56-4846-9f39-709aa1748071 for instance dd98275b-2759-4880-b280-fc6fc1614e93 on n-h2-858094-4 Sep 16 12:49:34.299166 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-e4bfd26f-b0df-440c-ab96-8da71e7956c5 req-a19f296d-dbfa-47ae-9457-2e25879ef6f9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049235 Sep 16 12:49:34.301963 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 512/1067] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:49:34.507704 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-29b15fce-c15a-4326-b887-5aab2d2567ef tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:34.515984 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-29b15fce-c15a-4326-b887-5aab2d2567ef tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1498 microversion: 2.1 time: 0.249755 Sep 16 12:49:34.517246 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 556/1068] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:34 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1498 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:34.532592 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-c50f1137-f7b5-4ad9-b6ef-561dc44a9f58 req-c09f637e-791e-451c-bf48-6242deec6c8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3085e02c-a09e-4bc5-a8c4-87ab1cedfc16", "tag": "065308fc-710e-4f14-b3d0-e976788d4def"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:49:34.543719 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-c50f1137-f7b5-4ad9-b6ef-561dc44a9f58 req-c09f637e-791e-451c-bf48-6242deec6c8a service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:34.544196 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-c50f1137-f7b5-4ad9-b6ef-561dc44a9f58 req-c09f637e-791e-451c-bf48-6242deec6c8a service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:34.544628 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-c50f1137-f7b5-4ad9-b6ef-561dc44a9f58 req-c09f637e-791e-451c-bf48-6242deec6c8a service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:34.556497 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-c50f1137-f7b5-4ad9-b6ef-561dc44a9f58 req-c09f637e-791e-451c-bf48-6242deec6c8a service nova] Creating event network-changed:065308fc-710e-4f14-b3d0-e976788d4def for instance 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 on n-h1-858094-4 Sep 16 12:49:34.562085 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-c50f1137-f7b5-4ad9-b6ef-561dc44a9f58 req-c09f637e-791e-451c-bf48-6242deec6c8a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033402 Sep 16 12:49:34.562773 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 513/1069] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:49:34.653943 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-47c5be41-93a2-4505-a33d-27fde1251c69 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:34.654464 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-47c5be41-93a2-4505-a33d-27fde1251c69 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:34.661507 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47c5be41-93a2-4505-a33d-27fde1251c69 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:34.664996 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47c5be41-93a2-4505-a33d-27fde1251c69 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:34.665445 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47c5be41-93a2-4505-a33d-27fde1251c69 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:34.666203 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47c5be41-93a2-4505-a33d-27fde1251c69 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:34.666648 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47c5be41-93a2-4505-a33d-27fde1251c69 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:34.667066 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47c5be41-93a2-4505-a33d-27fde1251c69 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:34.754675 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-47c5be41-93a2-4505-a33d-27fde1251c69 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:34.763505 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-47c5be41-93a2-4505-a33d-27fde1251c69 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:34.764982 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-47c5be41-93a2-4505-a33d-27fde1251c69 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:34.775303 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3eba69ad-b9d5-4001-bba3-a5c92922aa0e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:34.776012 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3eba69ad-b9d5-4001-bba3-a5c92922aa0e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: dd98275b-2759-4880-b280-fc6fc1614e93] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:34.779614 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-47c5be41-93a2-4505-a33d-27fde1251c69 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.130054 Sep 16 12:49:34.783064 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 557/1070] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:49:34 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:49:34.785593 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3eba69ad-b9d5-4001-bba3-a5c92922aa0e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:34.787395 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3eba69ad-b9d5-4001-bba3-a5c92922aa0e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:34.788032 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3eba69ad-b9d5-4001-bba3-a5c92922aa0e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:34.788954 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3eba69ad-b9d5-4001-bba3-a5c92922aa0e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:34.790082 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3eba69ad-b9d5-4001-bba3-a5c92922aa0e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:34.790679 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3eba69ad-b9d5-4001-bba3-a5c92922aa0e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:34.942053 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fd1fc628-8ef6-40c1-820f-32246157069b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:34.943011 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fd1fc628-8ef6-40c1-820f-32246157069b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:34.949937 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd1fc628-8ef6-40c1-820f-32246157069b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:34.950504 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd1fc628-8ef6-40c1-820f-32246157069b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:34.951020 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd1fc628-8ef6-40c1-820f-32246157069b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:34.952067 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd1fc628-8ef6-40c1-820f-32246157069b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:34.952646 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd1fc628-8ef6-40c1-820f-32246157069b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:34.953148 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd1fc628-8ef6-40c1-820f-32246157069b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:35.028830 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3eba69ad-b9d5-4001-bba3-a5c92922aa0e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:35.037500 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3eba69ad-b9d5-4001-bba3-a5c92922aa0e tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/dd98275b-2759-4880-b280-fc6fc1614e93" status: 200 len: 1316 microversion: 2.1 time: 0.265861 Sep 16 12:49:35.050028 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:49:35.051610 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 514/1071] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:34 2022] GET /compute/v2.1/servers/dd98275b-2759-4880-b280-fc6fc1614e93 => generated 1316 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:35.179407 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fd1fc628-8ef6-40c1-820f-32246157069b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:35.187973 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fd1fc628-8ef6-40c1-820f-32246157069b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1476 microversion: 2.1 time: 0.250135 Sep 16 12:49:35.188924 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 558/1072] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:34 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1476 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:35.541547 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b886aca4-b35b-4f6a-848a-3c4d41e5072f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:35.542166 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b886aca4-b35b-4f6a-848a-3c4d41e5072f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:35.549397 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b886aca4-b35b-4f6a-848a-3c4d41e5072f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:35.549882 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b886aca4-b35b-4f6a-848a-3c4d41e5072f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:35.550320 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b886aca4-b35b-4f6a-848a-3c4d41e5072f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:35.551009 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b886aca4-b35b-4f6a-848a-3c4d41e5072f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:35.551462 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b886aca4-b35b-4f6a-848a-3c4d41e5072f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:35.551888 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b886aca4-b35b-4f6a-848a-3c4d41e5072f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:35.695579 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-b886aca4-b35b-4f6a-848a-3c4d41e5072f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:35.704551 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b886aca4-b35b-4f6a-848a-3c4d41e5072f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1498 microversion: 2.1 time: 0.166753 Sep 16 12:49:35.705073 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 515/1073] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:35 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1498 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:35.808839 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3c1a42d5-ddd5-4c80-b567-fe388918ee50 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:35.810267 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3c1a42d5-ddd5-4c80-b567-fe388918ee50 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:35.817020 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c1a42d5-ddd5-4c80-b567-fe388918ee50 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:35.817512 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c1a42d5-ddd5-4c80-b567-fe388918ee50 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:35.817952 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c1a42d5-ddd5-4c80-b567-fe388918ee50 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:35.818696 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c1a42d5-ddd5-4c80-b567-fe388918ee50 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:35.819149 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c1a42d5-ddd5-4c80-b567-fe388918ee50 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:35.819577 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c1a42d5-ddd5-4c80-b567-fe388918ee50 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:35.895232 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3c1a42d5-ddd5-4c80-b567-fe388918ee50 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:35.904651 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3c1a42d5-ddd5-4c80-b567-fe388918ee50 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:35.906123 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3c1a42d5-ddd5-4c80-b567-fe388918ee50 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:35.911703 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3c1a42d5-ddd5-4c80-b567-fe388918ee50 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.106664 Sep 16 12:49:35.912963 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 559/1074] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:49:35 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:49:36.060595 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5a70bf19-b79c-4400-98cd-54ccc963ad53 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:36.061195 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5a70bf19-b79c-4400-98cd-54ccc963ad53 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: dd98275b-2759-4880-b280-fc6fc1614e93] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:36.067085 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5a70bf19-b79c-4400-98cd-54ccc963ad53 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:36.067561 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5a70bf19-b79c-4400-98cd-54ccc963ad53 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:36.068550 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5a70bf19-b79c-4400-98cd-54ccc963ad53 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:36.069232 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5a70bf19-b79c-4400-98cd-54ccc963ad53 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:36.069696 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5a70bf19-b79c-4400-98cd-54ccc963ad53 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:36.070109 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5a70bf19-b79c-4400-98cd-54ccc963ad53 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:36.074146 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=100 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:49:36.203542 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5a70bf19-b79c-4400-98cd-54ccc963ad53 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:36.211556 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-571b610c-4b98-4770-ad1e-81b0d5c3192b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:36.212194 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-571b610c-4b98-4770-ad1e-81b0d5c3192b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:36.212540 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5a70bf19-b79c-4400-98cd-54ccc963ad53 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/dd98275b-2759-4880-b280-fc6fc1614e93" status: 200 len: 1466 microversion: 2.1 time: 0.155707 Sep 16 12:49:36.213130 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 516/1075] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:36 2022] GET /compute/v2.1/servers/dd98275b-2759-4880-b280-fc6fc1614e93 => generated 1466 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:36.218244 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-571b610c-4b98-4770-ad1e-81b0d5c3192b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:36.218666 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-571b610c-4b98-4770-ad1e-81b0d5c3192b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:36.219102 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-571b610c-4b98-4770-ad1e-81b0d5c3192b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:36.219799 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-571b610c-4b98-4770-ad1e-81b0d5c3192b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:36.220280 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-571b610c-4b98-4770-ad1e-81b0d5c3192b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:36.220706 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-571b610c-4b98-4770-ad1e-81b0d5c3192b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:36.234653 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e4ddbec0-1734-4be4-a13a-7ed2d6dd89db tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:36.235268 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e4ddbec0-1734-4be4-a13a-7ed2d6dd89db tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] [instance: dd98275b-2759-4880-b280-fc6fc1614e93] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:36.242487 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e4ddbec0-1734-4be4-a13a-7ed2d6dd89db tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:36.242969 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e4ddbec0-1734-4be4-a13a-7ed2d6dd89db tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:36.243415 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e4ddbec0-1734-4be4-a13a-7ed2d6dd89db tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:36.244109 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e4ddbec0-1734-4be4-a13a-7ed2d6dd89db tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:36.244598 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e4ddbec0-1734-4be4-a13a-7ed2d6dd89db tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:36.245024 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e4ddbec0-1734-4be4-a13a-7ed2d6dd89db tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:36.413222 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-571b610c-4b98-4770-ad1e-81b0d5c3192b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:36.420906 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-571b610c-4b98-4770-ad1e-81b0d5c3192b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1476 microversion: 2.1 time: 0.213706 Sep 16 12:49:36.421614 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 560/1076] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:36 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1476 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:36.426567 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e4ddbec0-1734-4be4-a13a-7ed2d6dd89db tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/dd98275b-2759-4880-b280-fc6fc1614e93" status: 200 len: 1617 microversion: 2.1 time: 0.195484 Sep 16 12:49:36.427819 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 517/1077] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:36 2022] GET /compute/v2.1/servers/dd98275b-2759-4880-b280-fc6fc1614e93 => generated 1617 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:36.489412 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-260a8663-d7fd-42b4-8428-73133916ef3d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1388993049", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["8c7aea62-7b4d-400d-89fa-5411deefe490"]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:49:36.544048 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-260a8663-d7fd-42b4-8428-73133916ef3d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] validate_networks() for None {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:49:36.728034 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7777a32c-e60c-4a1f-b58d-b5f1e37f0eae tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:36.728755 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7777a32c-e60c-4a1f-b58d-b5f1e37f0eae tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:36.735894 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7777a32c-e60c-4a1f-b58d-b5f1e37f0eae tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:36.736503 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7777a32c-e60c-4a1f-b58d-b5f1e37f0eae tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:36.736986 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7777a32c-e60c-4a1f-b58d-b5f1e37f0eae tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:36.737738 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7777a32c-e60c-4a1f-b58d-b5f1e37f0eae tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:36.738271 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7777a32c-e60c-4a1f-b58d-b5f1e37f0eae tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:36.738906 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7777a32c-e60c-4a1f-b58d-b5f1e37f0eae tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:36.770330 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-260a8663-d7fd-42b4-8428-73133916ef3d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:49:36.770760 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-260a8663-d7fd-42b4-8428-73133916ef3d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:49:36.771310 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-260a8663-d7fd-42b4-8428-73133916ef3d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:49:36.771748 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-260a8663-d7fd-42b4-8428-73133916ef3d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:49:36.772192 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-260a8663-d7fd-42b4-8428-73133916ef3d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:49:36.781205 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-260a8663-d7fd-42b4-8428-73133916ef3d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:36.781665 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-260a8663-d7fd-42b4-8428-73133916ef3d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:36.782089 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-260a8663-d7fd-42b4-8428-73133916ef3d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:36.782821 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-260a8663-d7fd-42b4-8428-73133916ef3d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:36.785914 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-260a8663-d7fd-42b4-8428-73133916ef3d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:36.785914 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-260a8663-d7fd-42b4-8428-73133916ef3d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:36.802058 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-260a8663-d7fd-42b4-8428-73133916ef3d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Getting quotas for project 8c037a6456444018a6ef54314419e2f2. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:49:36.808385 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-260a8663-d7fd-42b4-8428-73133916ef3d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Getting quotas for user c1928790cac542ec86add5794851f97a and project 8c037a6456444018a6ef54314419e2f2. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:49:36.821466 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-260a8663-d7fd-42b4-8428-73133916ef3d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:49:36.823845 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-260a8663-d7fd-42b4-8428-73133916ef3d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: f6c03f63-cad2-4937-9963-7b180cca34f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:49:36.874146 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-260a8663-d7fd-42b4-8428-73133916ef3d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.388446 Sep 16 12:49:36.874966 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 561/1078] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:49:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 390 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:49:36.883023 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7777a32c-e60c-4a1f-b58d-b5f1e37f0eae tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:36.887204 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d92ce54c-d859-40e4-8265-9d16da9ae2ea tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:36.887965 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d92ce54c-d859-40e4-8265-9d16da9ae2ea tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: f6c03f63-cad2-4937-9963-7b180cca34f5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:36.892342 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7777a32c-e60c-4a1f-b58d-b5f1e37f0eae tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1498 microversion: 2.1 time: 0.168486 Sep 16 12:49:36.905228 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 518/1079] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:36 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1498 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:36.941092 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ac75a648-a2c1-4823-8b57-cbb3a76a3611 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:36.942114 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ac75a648-a2c1-4823-8b57-cbb3a76a3611 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:36.947307 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d92ce54c-d859-40e4-8265-9d16da9ae2ea tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:36.955547 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d92ce54c-d859-40e4-8265-9d16da9ae2ea tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5" status: 200 len: 1217 microversion: 2.1 time: 0.072886 Sep 16 12:49:36.956487 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 562/1080] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:36 2022] GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5 => generated 1217 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:36.962262 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ac75a648-a2c1-4823-8b57-cbb3a76a3611 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:36.965857 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ac75a648-a2c1-4823-8b57-cbb3a76a3611 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:36.966742 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ac75a648-a2c1-4823-8b57-cbb3a76a3611 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:36.967474 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ac75a648-a2c1-4823-8b57-cbb3a76a3611 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:36.969100 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ac75a648-a2c1-4823-8b57-cbb3a76a3611 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:36.969541 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ac75a648-a2c1-4823-8b57-cbb3a76a3611 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:37.038936 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ac75a648-a2c1-4823-8b57-cbb3a76a3611 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:37.047591 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ac75a648-a2c1-4823-8b57-cbb3a76a3611 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:37.049394 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ac75a648-a2c1-4823-8b57-cbb3a76a3611 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:37.054710 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ac75a648-a2c1-4823-8b57-cbb3a76a3611 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.117716 Sep 16 12:49:37.062794 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 519/1081] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:49:36 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:49:37.446351 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-373f457f-19cc-425c-a598-5cf687c7db4b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:37.446960 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-373f457f-19cc-425c-a598-5cf687c7db4b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:37.453199 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-373f457f-19cc-425c-a598-5cf687c7db4b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:37.453684 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-373f457f-19cc-425c-a598-5cf687c7db4b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:37.454113 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-373f457f-19cc-425c-a598-5cf687c7db4b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:37.454829 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-373f457f-19cc-425c-a598-5cf687c7db4b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:37.455464 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-373f457f-19cc-425c-a598-5cf687c7db4b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:37.455881 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-373f457f-19cc-425c-a598-5cf687c7db4b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:37.597681 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-373f457f-19cc-425c-a598-5cf687c7db4b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:37.606457 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-373f457f-19cc-425c-a598-5cf687c7db4b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1476 microversion: 2.1 time: 0.164991 Sep 16 12:49:37.607060 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 563/1082] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:37 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1476 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:37.923908 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9c12ff5d-515d-4f0f-ad67-27637f7730b6 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:37.924552 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9c12ff5d-515d-4f0f-ad67-27637f7730b6 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:37.931932 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9c12ff5d-515d-4f0f-ad67-27637f7730b6 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:37.932519 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9c12ff5d-515d-4f0f-ad67-27637f7730b6 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:37.932960 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9c12ff5d-515d-4f0f-ad67-27637f7730b6 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:37.933646 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9c12ff5d-515d-4f0f-ad67-27637f7730b6 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:37.934100 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9c12ff5d-515d-4f0f-ad67-27637f7730b6 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:37.934524 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9c12ff5d-515d-4f0f-ad67-27637f7730b6 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:37.978996 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7b49c880-a2a3-420f-a832-c1f1c6699c3a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:37.979579 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7b49c880-a2a3-420f-a832-c1f1c6699c3a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: f6c03f63-cad2-4937-9963-7b180cca34f5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:37.986282 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b49c880-a2a3-420f-a832-c1f1c6699c3a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:37.986736 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b49c880-a2a3-420f-a832-c1f1c6699c3a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:37.987167 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b49c880-a2a3-420f-a832-c1f1c6699c3a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:37.987857 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b49c880-a2a3-420f-a832-c1f1c6699c3a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:37.988343 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b49c880-a2a3-420f-a832-c1f1c6699c3a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:37.988760 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b49c880-a2a3-420f-a832-c1f1c6699c3a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:38.071885 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7b49c880-a2a3-420f-a832-c1f1c6699c3a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:38.079855 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7b49c880-a2a3-420f-a832-c1f1c6699c3a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5" status: 200 len: 1269 microversion: 2.1 time: 0.104723 Sep 16 12:49:38.095519 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 564/1083] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:37 2022] GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5 => generated 1269 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:38.095519 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ae2bf8f9-18d4-4471-b9c8-70b3288d8b80 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:38.095519 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ae2bf8f9-18d4-4471-b9c8-70b3288d8b80 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:38.095519 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae2bf8f9-18d4-4471-b9c8-70b3288d8b80 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:38.096185 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae2bf8f9-18d4-4471-b9c8-70b3288d8b80 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:38.096185 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae2bf8f9-18d4-4471-b9c8-70b3288d8b80 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:38.096185 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae2bf8f9-18d4-4471-b9c8-70b3288d8b80 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:38.096185 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae2bf8f9-18d4-4471-b9c8-70b3288d8b80 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:38.096614 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae2bf8f9-18d4-4471-b9c8-70b3288d8b80 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:38.106279 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9c12ff5d-515d-4f0f-ad67-27637f7730b6 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:38.116671 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9c12ff5d-515d-4f0f-ad67-27637f7730b6 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1498 microversion: 2.1 time: 0.196800 Sep 16 12:49:38.117258 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 520/1084] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:37 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1498 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:38.161956 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ae2bf8f9-18d4-4471-b9c8-70b3288d8b80 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:38.170374 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ae2bf8f9-18d4-4471-b9c8-70b3288d8b80 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:38.171794 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ae2bf8f9-18d4-4471-b9c8-70b3288d8b80 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:38.176957 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ae2bf8f9-18d4-4471-b9c8-70b3288d8b80 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.095551 Sep 16 12:49:38.178217 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 565/1085] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:49:38 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:49:38.629938 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b85a5e13-be0d-4dc4-af92-7e182f67167e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:38.630551 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b85a5e13-be0d-4dc4-af92-7e182f67167e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:38.636794 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b85a5e13-be0d-4dc4-af92-7e182f67167e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:38.637283 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b85a5e13-be0d-4dc4-af92-7e182f67167e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:38.637722 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b85a5e13-be0d-4dc4-af92-7e182f67167e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:38.638425 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b85a5e13-be0d-4dc4-af92-7e182f67167e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:38.638881 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b85a5e13-be0d-4dc4-af92-7e182f67167e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:38.639306 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b85a5e13-be0d-4dc4-af92-7e182f67167e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:38.776452 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-b85a5e13-be0d-4dc4-af92-7e182f67167e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:38.784330 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b85a5e13-be0d-4dc4-af92-7e182f67167e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1476 microversion: 2.1 time: 0.158362 Sep 16 12:49:38.785036 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 521/1086] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:38 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1476 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:39.104643 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-44a3446b-9b10-493c-98c6-da6c0a0e7196 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:39.105965 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-44a3446b-9b10-493c-98c6-da6c0a0e7196 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: f6c03f63-cad2-4937-9963-7b180cca34f5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:39.121894 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44a3446b-9b10-493c-98c6-da6c0a0e7196 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:39.122651 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44a3446b-9b10-493c-98c6-da6c0a0e7196 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:39.123528 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44a3446b-9b10-493c-98c6-da6c0a0e7196 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:39.124691 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44a3446b-9b10-493c-98c6-da6c0a0e7196 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:39.125367 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44a3446b-9b10-493c-98c6-da6c0a0e7196 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:39.126143 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44a3446b-9b10-493c-98c6-da6c0a0e7196 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:39.141035 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ec7d021c-bb73-42bb-89f1-5cf62268a89b tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:39.141568 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ec7d021c-bb73-42bb-89f1-5cf62268a89b tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:39.144284 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:49:39.152373 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ec7d021c-bb73-42bb-89f1-5cf62268a89b tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:39.153113 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ec7d021c-bb73-42bb-89f1-5cf62268a89b tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:39.153790 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ec7d021c-bb73-42bb-89f1-5cf62268a89b tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:39.154677 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ec7d021c-bb73-42bb-89f1-5cf62268a89b tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:39.155293 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ec7d021c-bb73-42bb-89f1-5cf62268a89b tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:39.155876 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ec7d021c-bb73-42bb-89f1-5cf62268a89b tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:39.360764 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-44a3446b-9b10-493c-98c6-da6c0a0e7196 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:39.363957 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ec7d021c-bb73-42bb-89f1-5cf62268a89b tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:39.369995 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-44a3446b-9b10-493c-98c6-da6c0a0e7196 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5" status: 200 len: 1317 microversion: 2.1 time: 0.270267 Sep 16 12:49:39.371146 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 566/1087] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:39 2022] GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5 => generated 1317 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:39.372654 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ec7d021c-bb73-42bb-89f1-5cf62268a89b tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1498 microversion: 2.1 time: 0.235456 Sep 16 12:49:39.373252 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 522/1088] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:39 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1498 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:39.377461 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a937b8c8-0bb6-4eaf-b3c8-690763375079 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:39.378379 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a937b8c8-0bb6-4eaf-b3c8-690763375079 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:39.386932 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a937b8c8-0bb6-4eaf-b3c8-690763375079 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:39.387781 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a937b8c8-0bb6-4eaf-b3c8-690763375079 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:39.388462 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a937b8c8-0bb6-4eaf-b3c8-690763375079 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:39.389518 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a937b8c8-0bb6-4eaf-b3c8-690763375079 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:39.390109 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a937b8c8-0bb6-4eaf-b3c8-690763375079 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:39.390634 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a937b8c8-0bb6-4eaf-b3c8-690763375079 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:39.471087 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a937b8c8-0bb6-4eaf-b3c8-690763375079 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:39.481611 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a937b8c8-0bb6-4eaf-b3c8-690763375079 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:39.483481 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a937b8c8-0bb6-4eaf-b3c8-690763375079 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:39.489207 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a937b8c8-0bb6-4eaf-b3c8-690763375079 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.116509 Sep 16 12:49:39.491100 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 567/1089] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:49:39 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:49:39.760330 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-264b1ef6-5047-4252-aefc-b3a408d830ba req-64a07188-ee33-4734-8b8e-eeb250f9cce6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6c03f63-cad2-4937-9963-7b180cca34f5", "tag": "d45dadfe-c229-4c51-b2e6-ad9d273fe116"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:49:39.771821 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-264b1ef6-5047-4252-aefc-b3a408d830ba req-64a07188-ee33-4734-8b8e-eeb250f9cce6 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:39.772459 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-264b1ef6-5047-4252-aefc-b3a408d830ba req-64a07188-ee33-4734-8b8e-eeb250f9cce6 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:39.772960 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-264b1ef6-5047-4252-aefc-b3a408d830ba req-64a07188-ee33-4734-8b8e-eeb250f9cce6 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:39.784890 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-264b1ef6-5047-4252-aefc-b3a408d830ba req-64a07188-ee33-4734-8b8e-eeb250f9cce6 service nova] Creating event network-changed:d45dadfe-c229-4c51-b2e6-ad9d273fe116 for instance f6c03f63-cad2-4937-9963-7b180cca34f5 on n-h2-858094-4 Sep 16 12:49:39.790548 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-264b1ef6-5047-4252-aefc-b3a408d830ba req-64a07188-ee33-4734-8b8e-eeb250f9cce6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035761 Sep 16 12:49:39.791311 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 523/1090] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:49:39.808434 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a5973fea-d4f7-4082-a5ea-2d66da8db3a3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:39.809701 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a5973fea-d4f7-4082-a5ea-2d66da8db3a3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:39.815657 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5973fea-d4f7-4082-a5ea-2d66da8db3a3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:39.816159 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5973fea-d4f7-4082-a5ea-2d66da8db3a3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:39.816604 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5973fea-d4f7-4082-a5ea-2d66da8db3a3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:39.817314 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5973fea-d4f7-4082-a5ea-2d66da8db3a3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:39.818020 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5973fea-d4f7-4082-a5ea-2d66da8db3a3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:39.818459 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5973fea-d4f7-4082-a5ea-2d66da8db3a3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:39.957719 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a5973fea-d4f7-4082-a5ea-2d66da8db3a3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:39.966835 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a5973fea-d4f7-4082-a5ea-2d66da8db3a3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1476 microversion: 2.1 time: 0.162398 Sep 16 12:49:39.967422 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 568/1091] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:39 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1476 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:40.397147 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-94ebd4d6-6517-435d-a0db-6f2ed6637ddf tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:40.397837 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6131c07e-bf72-4c63-99c1-8d259ebad08d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:40.398205 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-94ebd4d6-6517-435d-a0db-6f2ed6637ddf tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: f6c03f63-cad2-4937-9963-7b180cca34f5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:40.398309 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6131c07e-bf72-4c63-99c1-8d259ebad08d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:40.404370 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94ebd4d6-6517-435d-a0db-6f2ed6637ddf tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:40.404864 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94ebd4d6-6517-435d-a0db-6f2ed6637ddf tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:40.405297 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94ebd4d6-6517-435d-a0db-6f2ed6637ddf tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:40.405413 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6131c07e-bf72-4c63-99c1-8d259ebad08d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:40.405877 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6131c07e-bf72-4c63-99c1-8d259ebad08d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:40.406001 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94ebd4d6-6517-435d-a0db-6f2ed6637ddf tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:40.406315 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6131c07e-bf72-4c63-99c1-8d259ebad08d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:40.406424 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94ebd4d6-6517-435d-a0db-6f2ed6637ddf tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:40.406829 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94ebd4d6-6517-435d-a0db-6f2ed6637ddf tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:40.407011 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6131c07e-bf72-4c63-99c1-8d259ebad08d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:40.407470 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6131c07e-bf72-4c63-99c1-8d259ebad08d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:40.407894 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6131c07e-bf72-4c63-99c1-8d259ebad08d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:40.604473 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-94ebd4d6-6517-435d-a0db-6f2ed6637ddf tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:40.609049 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6131c07e-bf72-4c63-99c1-8d259ebad08d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:40.612317 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-94ebd4d6-6517-435d-a0db-6f2ed6637ddf tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5" status: 200 len: 1317 microversion: 2.1 time: 0.219199 Sep 16 12:49:40.612887 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 569/1092] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:40 2022] GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5 => generated 1317 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:40.618622 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-786c0946-8329-43ba-8c0d-77f743848bba tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:40.619150 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-786c0946-8329-43ba-8c0d-77f743848bba tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:40.626327 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-786c0946-8329-43ba-8c0d-77f743848bba tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:40.626904 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-786c0946-8329-43ba-8c0d-77f743848bba tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:40.627469 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-786c0946-8329-43ba-8c0d-77f743848bba tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:40.628360 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-786c0946-8329-43ba-8c0d-77f743848bba tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:40.628970 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-786c0946-8329-43ba-8c0d-77f743848bba tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:40.629403 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-786c0946-8329-43ba-8c0d-77f743848bba tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:40.630740 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6131c07e-bf72-4c63-99c1-8d259ebad08d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1498 microversion: 2.1 time: 0.237412 Sep 16 12:49:40.631532 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 524/1093] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:40 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1498 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:40.696324 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-786c0946-8329-43ba-8c0d-77f743848bba tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:40.704428 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-786c0946-8329-43ba-8c0d-77f743848bba tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:40.705869 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-786c0946-8329-43ba-8c0d-77f743848bba tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:40.710712 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-786c0946-8329-43ba-8c0d-77f743848bba tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.096893 Sep 16 12:49:40.711274 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 570/1094] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:49:40 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:49:40.990085 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5c73a7a4-ba42-470a-b155-5223f2f4e010 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:40.990764 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5c73a7a4-ba42-470a-b155-5223f2f4e010 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:40.996761 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5c73a7a4-ba42-470a-b155-5223f2f4e010 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:40.997264 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5c73a7a4-ba42-470a-b155-5223f2f4e010 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:40.997693 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5c73a7a4-ba42-470a-b155-5223f2f4e010 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:40.998366 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5c73a7a4-ba42-470a-b155-5223f2f4e010 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:40.998809 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5c73a7a4-ba42-470a-b155-5223f2f4e010 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:40.999222 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5c73a7a4-ba42-470a-b155-5223f2f4e010 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:41.135089 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5c73a7a4-ba42-470a-b155-5223f2f4e010 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:41.142964 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5c73a7a4-ba42-470a-b155-5223f2f4e010 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1476 microversion: 2.1 time: 0.156970 Sep 16 12:49:41.143570 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 525/1095] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:40 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1476 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:41.635613 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-16d2ba92-1f18-4fa0-88f4-ce29794b40a8 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:41.636192 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-16d2ba92-1f18-4fa0-88f4-ce29794b40a8 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: f6c03f63-cad2-4937-9963-7b180cca34f5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:41.643316 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16d2ba92-1f18-4fa0-88f4-ce29794b40a8 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:41.643604 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16d2ba92-1f18-4fa0-88f4-ce29794b40a8 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:41.644016 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16d2ba92-1f18-4fa0-88f4-ce29794b40a8 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:41.644762 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16d2ba92-1f18-4fa0-88f4-ce29794b40a8 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:41.645219 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16d2ba92-1f18-4fa0-88f4-ce29794b40a8 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:41.646265 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16d2ba92-1f18-4fa0-88f4-ce29794b40a8 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:41.656903 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c07b899b-7a69-4ac1-b345-02d392fda2b8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:41.658020 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c07b899b-7a69-4ac1-b345-02d392fda2b8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:41.663083 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:49:41.668544 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c07b899b-7a69-4ac1-b345-02d392fda2b8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:41.669257 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c07b899b-7a69-4ac1-b345-02d392fda2b8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:41.669756 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c07b899b-7a69-4ac1-b345-02d392fda2b8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:41.670524 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c07b899b-7a69-4ac1-b345-02d392fda2b8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:41.671663 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c07b899b-7a69-4ac1-b345-02d392fda2b8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:41.671663 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c07b899b-7a69-4ac1-b345-02d392fda2b8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:41.865777 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-16d2ba92-1f18-4fa0-88f4-ce29794b40a8 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:41.869892 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c07b899b-7a69-4ac1-b345-02d392fda2b8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:41.873862 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-16d2ba92-1f18-4fa0-88f4-ce29794b40a8 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5" status: 200 len: 1317 microversion: 2.1 time: 0.242335 Sep 16 12:49:41.874462 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 571/1096] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:41 2022] GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5 => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:41.879280 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-63e21fb8-c980-4eb8-9cbd-7b5484d5c615 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:41.880557 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-63e21fb8-c980-4eb8-9cbd-7b5484d5c615 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:41.885835 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c07b899b-7a69-4ac1-b345-02d392fda2b8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 200 len: 1475 microversion: 2.1 time: 0.233886 Sep 16 12:49:41.887261 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 526/1097] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:41 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 1475 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:41.887378 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63e21fb8-c980-4eb8-9cbd-7b5484d5c615 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:41.887805 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63e21fb8-c980-4eb8-9cbd-7b5484d5c615 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:41.888684 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63e21fb8-c980-4eb8-9cbd-7b5484d5c615 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:41.889892 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63e21fb8-c980-4eb8-9cbd-7b5484d5c615 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:41.890470 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63e21fb8-c980-4eb8-9cbd-7b5484d5c615 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:41.891052 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63e21fb8-c980-4eb8-9cbd-7b5484d5c615 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:41.910348 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ce28f335-d060-4ec0-85d4-055b76a58a81 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1790013816"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:49:41.912933 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ce28f335-d060-4ec0-85d4-055b76a58a81 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:41.919210 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce28f335-d060-4ec0-85d4-055b76a58a81 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:41.919701 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce28f335-d060-4ec0-85d4-055b76a58a81 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:41.920153 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce28f335-d060-4ec0-85d4-055b76a58a81 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:41.920869 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce28f335-d060-4ec0-85d4-055b76a58a81 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:41.921322 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce28f335-d060-4ec0-85d4-055b76a58a81 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:41.921744 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce28f335-d060-4ec0-85d4-055b76a58a81 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:41.969764 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-63e21fb8-c980-4eb8-9cbd-7b5484d5c615 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:41.979377 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-63e21fb8-c980-4eb8-9cbd-7b5484d5c615 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:41.981105 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-63e21fb8-c980-4eb8-9cbd-7b5484d5c615 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:41.988359 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-63e21fb8-c980-4eb8-9cbd-7b5484d5c615 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.112108 Sep 16 12:49:41.994117 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 572/1098] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:49:41 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:49:42.144903 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ce28f335-d060-4ec0-85d4-055b76a58a81 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "POST /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361/action" status: 202 len: 0 microversion: 2.1 time: 0.238268 Sep 16 12:49:42.146153 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 527/1099] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:49:41 2022] POST /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Sep 16 12:49:42.157188 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6aaf600d-720a-4e71-9b32-9e933f56020a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f10357d6280>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:42.169013 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-388f5cda-e2c9-4a08-87a4-33b0660d6ecd tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:42.169733 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-388f5cda-e2c9-4a08-87a4-33b0660d6ecd tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:42.178121 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-388f5cda-e2c9-4a08-87a4-33b0660d6ecd tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:42.178777 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-388f5cda-e2c9-4a08-87a4-33b0660d6ecd tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:42.179215 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-388f5cda-e2c9-4a08-87a4-33b0660d6ecd tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:42.179988 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-388f5cda-e2c9-4a08-87a4-33b0660d6ecd tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:42.180493 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-388f5cda-e2c9-4a08-87a4-33b0660d6ecd tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:42.180893 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-388f5cda-e2c9-4a08-87a4-33b0660d6ecd tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:42.210123 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6aaf600d-720a-4e71-9b32-9e933f56020a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4" status: 200 len: 1412 microversion: 2.1 time: 0.057357 Sep 16 12:49:42.211137 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 573/1100] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:49:42 2022] GET /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4 => generated 1412 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:42.360369 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-388f5cda-e2c9-4a08-87a4-33b0660d6ecd tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:42.371477 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-388f5cda-e2c9-4a08-87a4-33b0660d6ecd tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1476 microversion: 2.1 time: 0.207992 Sep 16 12:49:42.372067 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 528/1101] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:42 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1476 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:42.898052 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6dafb5bd-2d0d-408a-a132-df58b06a24cf tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:42.898662 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6dafb5bd-2d0d-408a-a132-df58b06a24cf tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: f6c03f63-cad2-4937-9963-7b180cca34f5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:42.905050 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6dafb5bd-2d0d-408a-a132-df58b06a24cf tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:42.905546 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6dafb5bd-2d0d-408a-a132-df58b06a24cf tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:42.905982 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6dafb5bd-2d0d-408a-a132-df58b06a24cf tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:42.906679 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6dafb5bd-2d0d-408a-a132-df58b06a24cf tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:42.907128 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6dafb5bd-2d0d-408a-a132-df58b06a24cf tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:42.907635 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6dafb5bd-2d0d-408a-a132-df58b06a24cf tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:43.018879 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-62fe0331-a46f-413e-934d-fb6e334c4b11 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:43.019690 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-62fe0331-a46f-413e-934d-fb6e334c4b11 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:43.026590 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62fe0331-a46f-413e-934d-fb6e334c4b11 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:43.027237 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62fe0331-a46f-413e-934d-fb6e334c4b11 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:43.027726 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62fe0331-a46f-413e-934d-fb6e334c4b11 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:43.028533 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62fe0331-a46f-413e-934d-fb6e334c4b11 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:43.029058 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62fe0331-a46f-413e-934d-fb6e334c4b11 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:43.029554 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62fe0331-a46f-413e-934d-fb6e334c4b11 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:43.048816 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6dafb5bd-2d0d-408a-a132-df58b06a24cf tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:43.057334 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6dafb5bd-2d0d-408a-a132-df58b06a24cf tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5" status: 200 len: 1317 microversion: 2.1 time: 0.164455 Sep 16 12:49:43.060173 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 574/1102] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:42 2022] GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:43.099653 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-62fe0331-a46f-413e-934d-fb6e334c4b11 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:43.108824 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-62fe0331-a46f-413e-934d-fb6e334c4b11 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:43.110313 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-62fe0331-a46f-413e-934d-fb6e334c4b11 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:43.116813 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-62fe0331-a46f-413e-934d-fb6e334c4b11 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.101710 Sep 16 12:49:43.117795 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 529/1103] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:49:43 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:49:43.227396 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-797cdb6c-f761-4994-a61c-b63d59a29536 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f10357c34c0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:43.275561 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-797cdb6c-f761-4994-a61c-b63d59a29536 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4" status: 200 len: 1412 microversion: 2.1 time: 0.053056 Sep 16 12:49:43.276155 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 575/1104] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:49:43 2022] GET /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4 => generated 1412 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:43.301541 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-92085c17-a027-4ec5-8042-e50fe20bc401 req-031c0b4e-40f8-4009-9fd7-ed653689834e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6b4a601-8b6e-498e-8c17-9e689c13db74", "name": "network-vif-unplugged", "status": "completed", "tag": "c82c5517-9370-47b7-870d-b1c0f066ce8a"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:49:43.311050 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-92085c17-a027-4ec5-8042-e50fe20bc401 req-031c0b4e-40f8-4009-9fd7-ed653689834e service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:43.311536 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-92085c17-a027-4ec5-8042-e50fe20bc401 req-031c0b4e-40f8-4009-9fd7-ed653689834e service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:43.311964 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-92085c17-a027-4ec5-8042-e50fe20bc401 req-031c0b4e-40f8-4009-9fd7-ed653689834e service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:43.325066 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-92085c17-a027-4ec5-8042-e50fe20bc401 req-031c0b4e-40f8-4009-9fd7-ed653689834e service nova] Creating event network-vif-unplugged:c82c5517-9370-47b7-870d-b1c0f066ce8a for instance c6b4a601-8b6e-498e-8c17-9e689c13db74 on n-h2-858094-4 Sep 16 12:49:43.333476 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [req-92085c17-a027-4ec5-8042-e50fe20bc401 req-031c0b4e-40f8-4009-9fd7-ed653689834e service nova] Instance c6b4a601-8b6e-498e-8c17-9e689c13db74 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858094-4', 'n-h2-858094-4'} {{(pid=128780) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 12:49:43.344792 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-92085c17-a027-4ec5-8042-e50fe20bc401 req-031c0b4e-40f8-4009-9fd7-ed653689834e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047405 Sep 16 12:49:43.345397 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 530/1105] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:49:43.394694 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1729310a-a3cc-4268-97ff-040fab7a2018 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:43.395310 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1729310a-a3cc-4268-97ff-040fab7a2018 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:43.402063 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1729310a-a3cc-4268-97ff-040fab7a2018 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:43.402549 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1729310a-a3cc-4268-97ff-040fab7a2018 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:43.402987 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1729310a-a3cc-4268-97ff-040fab7a2018 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:43.403684 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1729310a-a3cc-4268-97ff-040fab7a2018 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:43.404153 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1729310a-a3cc-4268-97ff-040fab7a2018 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:43.404669 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1729310a-a3cc-4268-97ff-040fab7a2018 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:43.540065 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1729310a-a3cc-4268-97ff-040fab7a2018 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:43.548261 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1729310a-a3cc-4268-97ff-040fab7a2018 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1475 microversion: 2.1 time: 0.157424 Sep 16 12:49:43.549104 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 576/1106] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:43 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1475 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:44.083020 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f2580cc6-170a-4a5b-a528-c461cf5bedd4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:44.084333 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f2580cc6-170a-4a5b-a528-c461cf5bedd4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: f6c03f63-cad2-4937-9963-7b180cca34f5] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:44.091723 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f2580cc6-170a-4a5b-a528-c461cf5bedd4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:44.092249 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f2580cc6-170a-4a5b-a528-c461cf5bedd4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:44.092683 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f2580cc6-170a-4a5b-a528-c461cf5bedd4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:44.093381 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f2580cc6-170a-4a5b-a528-c461cf5bedd4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:44.093831 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f2580cc6-170a-4a5b-a528-c461cf5bedd4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:44.094250 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f2580cc6-170a-4a5b-a528-c461cf5bedd4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:44.149731 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1855a813-9e43-4c71-8740-cb3676ffa1ee tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:44.151106 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1855a813-9e43-4c71-8740-cb3676ffa1ee tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:44.157964 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1855a813-9e43-4c71-8740-cb3676ffa1ee tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:44.158452 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1855a813-9e43-4c71-8740-cb3676ffa1ee tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:44.158909 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1855a813-9e43-4c71-8740-cb3676ffa1ee tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:44.159633 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1855a813-9e43-4c71-8740-cb3676ffa1ee tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:44.160247 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1855a813-9e43-4c71-8740-cb3676ffa1ee tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:44.160669 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1855a813-9e43-4c71-8740-cb3676ffa1ee tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:44.241317 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1855a813-9e43-4c71-8740-cb3676ffa1ee tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:44.251620 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1855a813-9e43-4c71-8740-cb3676ffa1ee tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:44.253502 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1855a813-9e43-4c71-8740-cb3676ffa1ee tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:44.259764 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1855a813-9e43-4c71-8740-cb3676ffa1ee tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.115673 Sep 16 12:49:44.260588 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 577/1107] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:49:44 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:49:44.263617 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f2580cc6-170a-4a5b-a528-c461cf5bedd4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:44.271579 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f2580cc6-170a-4a5b-a528-c461cf5bedd4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5" status: 200 len: 1317 microversion: 2.1 time: 0.193829 Sep 16 12:49:44.272181 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 531/1108] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:44 2022] GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5 => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:44.291621 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2544d93b-0fce-45be-9319-d6d7e47d8bfe tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f1035723b80>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:44.334975 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2544d93b-0fce-45be-9319-d6d7e47d8bfe tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4" status: 200 len: 1412 microversion: 2.1 time: 0.047097 Sep 16 12:49:44.335553 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 578/1109] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:49:44 2022] GET /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4 => generated 1412 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:44.572026 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9b87ee44-b3ac-4be8-9bdf-db960141eeea tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:44.572570 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9b87ee44-b3ac-4be8-9bdf-db960141eeea tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:44.578596 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9b87ee44-b3ac-4be8-9bdf-db960141eeea tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:44.579075 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9b87ee44-b3ac-4be8-9bdf-db960141eeea tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:44.579499 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9b87ee44-b3ac-4be8-9bdf-db960141eeea tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:44.580203 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9b87ee44-b3ac-4be8-9bdf-db960141eeea tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:44.580645 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9b87ee44-b3ac-4be8-9bdf-db960141eeea tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:44.581063 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9b87ee44-b3ac-4be8-9bdf-db960141eeea tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:44.781319 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-626b2977-c7c9-44b0-85c4-41eb3c913c49 req-17a971af-654a-446b-884b-8d7efa082719 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6c03f63-cad2-4937-9963-7b180cca34f5", "name": "network-vif-plugged", "status": "completed", "tag": "d45dadfe-c229-4c51-b2e6-ad9d273fe116"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:49:44.794835 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-626b2977-c7c9-44b0-85c4-41eb3c913c49 req-17a971af-654a-446b-884b-8d7efa082719 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:44.795546 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-626b2977-c7c9-44b0-85c4-41eb3c913c49 req-17a971af-654a-446b-884b-8d7efa082719 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:44.796179 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-626b2977-c7c9-44b0-85c4-41eb3c913c49 req-17a971af-654a-446b-884b-8d7efa082719 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:44.799420 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:49:44.810863 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-626b2977-c7c9-44b0-85c4-41eb3c913c49 req-17a971af-654a-446b-884b-8d7efa082719 service nova] Creating event network-vif-plugged:d45dadfe-c229-4c51-b2e6-ad9d273fe116 for instance f6c03f63-cad2-4937-9963-7b180cca34f5 on n-h2-858094-4 Sep 16 12:49:44.817143 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-626b2977-c7c9-44b0-85c4-41eb3c913c49 req-17a971af-654a-446b-884b-8d7efa082719 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039658 Sep 16 12:49:44.818391 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 579/1110] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:49:44.916735 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9b87ee44-b3ac-4be8-9bdf-db960141eeea tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:44.924978 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9b87ee44-b3ac-4be8-9bdf-db960141eeea tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1473 microversion: 2.1 time: 0.356953 Sep 16 12:49:44.925566 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 532/1111] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:44 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1473 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:45.290042 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d1ac6a2f-07de-49a8-827a-b02961765c6f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:45.290730 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d1ac6a2f-07de-49a8-827a-b02961765c6f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:45.294859 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-19f2a6fe-24e4-47e5-8443-ac18ae850114 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:45.295223 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-19f2a6fe-24e4-47e5-8443-ac18ae850114 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: f6c03f63-cad2-4937-9963-7b180cca34f5] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:45.297561 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1ac6a2f-07de-49a8-827a-b02961765c6f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:45.298047 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1ac6a2f-07de-49a8-827a-b02961765c6f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:45.298738 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1ac6a2f-07de-49a8-827a-b02961765c6f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:45.299437 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1ac6a2f-07de-49a8-827a-b02961765c6f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:45.299883 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1ac6a2f-07de-49a8-827a-b02961765c6f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:45.300334 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1ac6a2f-07de-49a8-827a-b02961765c6f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:45.302988 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19f2a6fe-24e4-47e5-8443-ac18ae850114 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:45.303500 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19f2a6fe-24e4-47e5-8443-ac18ae850114 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:45.303937 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19f2a6fe-24e4-47e5-8443-ac18ae850114 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:45.304659 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19f2a6fe-24e4-47e5-8443-ac18ae850114 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:45.305114 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19f2a6fe-24e4-47e5-8443-ac18ae850114 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:45.305538 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19f2a6fe-24e4-47e5-8443-ac18ae850114 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:45.395926 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d1ac6a2f-07de-49a8-827a-b02961765c6f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:45.404313 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d1ac6a2f-07de-49a8-827a-b02961765c6f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:45.405743 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d1ac6a2f-07de-49a8-827a-b02961765c6f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:45.410544 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d1ac6a2f-07de-49a8-827a-b02961765c6f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.126509 Sep 16 12:49:45.411714 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 580/1112] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:49:45 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:49:45.418734 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f3adeee9-bc81-40d1-898b-3d7da9f7cb70 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f10357d6ee0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:45.465205 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-19f2a6fe-24e4-47e5-8443-ac18ae850114 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:45.467674 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f3adeee9-bc81-40d1-898b-3d7da9f7cb70 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4" status: 200 len: 1412 microversion: 2.1 time: 0.054797 Sep 16 12:49:45.468274 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 581/1113] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:49:45 2022] GET /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4 => generated 1412 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:45.472900 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-e8b33b1c-46c6-44e8-869a-6460f0e424c4 req-fd534503-ec63-4fa0-b55d-d11aeca1b6bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6b4a601-8b6e-498e-8c17-9e689c13db74", "tag": "c82c5517-9370-47b7-870d-b1c0f066ce8a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:49:45.473178 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-19f2a6fe-24e4-47e5-8443-ac18ae850114 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5" status: 200 len: 1317 microversion: 2.1 time: 0.182562 Sep 16 12:49:45.474542 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 533/1114] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:45 2022] GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5 => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:45.483289 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e8b33b1c-46c6-44e8-869a-6460f0e424c4 req-fd534503-ec63-4fa0-b55d-d11aeca1b6bf service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:45.483757 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e8b33b1c-46c6-44e8-869a-6460f0e424c4 req-fd534503-ec63-4fa0-b55d-d11aeca1b6bf service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:45.484281 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e8b33b1c-46c6-44e8-869a-6460f0e424c4 req-fd534503-ec63-4fa0-b55d-d11aeca1b6bf service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:45.496056 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-e8b33b1c-46c6-44e8-869a-6460f0e424c4 req-fd534503-ec63-4fa0-b55d-d11aeca1b6bf service nova] Creating event network-changed:c82c5517-9370-47b7-870d-b1c0f066ce8a for instance c6b4a601-8b6e-498e-8c17-9e689c13db74 on n-h2-858094-4 Sep 16 12:49:45.501345 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [req-e8b33b1c-46c6-44e8-869a-6460f0e424c4 req-fd534503-ec63-4fa0-b55d-d11aeca1b6bf service nova] Instance c6b4a601-8b6e-498e-8c17-9e689c13db74 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858094-4', 'n-h2-858094-4'} {{(pid=128779) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 12:49:45.512653 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-e8b33b1c-46c6-44e8-869a-6460f0e424c4 req-fd534503-ec63-4fa0-b55d-d11aeca1b6bf service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042956 Sep 16 12:49:45.513250 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 582/1115] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:49:45.950013 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f5f3033d-0c1c-4356-b741-554025ca12a1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:45.950654 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f5f3033d-0c1c-4356-b741-554025ca12a1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:45.956709 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f5f3033d-0c1c-4356-b741-554025ca12a1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:45.958364 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f5f3033d-0c1c-4356-b741-554025ca12a1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:45.958364 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f5f3033d-0c1c-4356-b741-554025ca12a1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:45.959158 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f5f3033d-0c1c-4356-b741-554025ca12a1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:45.959624 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f5f3033d-0c1c-4356-b741-554025ca12a1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:45.960113 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f5f3033d-0c1c-4356-b741-554025ca12a1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:46.444372 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a4adb507-a517-429a-ac09-9f8c6b147d3b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:46.445787 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a4adb507-a517-429a-ac09-9f8c6b147d3b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:46.459148 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4adb507-a517-429a-ac09-9f8c6b147d3b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:46.461654 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4adb507-a517-429a-ac09-9f8c6b147d3b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:46.464942 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f5f3033d-0c1c-4356-b741-554025ca12a1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:46.467676 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4adb507-a517-429a-ac09-9f8c6b147d3b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:46.471442 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4adb507-a517-429a-ac09-9f8c6b147d3b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:46.472208 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4adb507-a517-429a-ac09-9f8c6b147d3b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:46.472798 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4adb507-a517-429a-ac09-9f8c6b147d3b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:46.473415 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f5f3033d-0c1c-4356-b741-554025ca12a1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1473 microversion: 2.1 time: 0.527216 Sep 16 12:49:46.484195 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 534/1116] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:45 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1473 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:46.484762 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6b09074c-d46b-42c4-b11f-825eb2f70d63 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f10354d7f70>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:46.560952 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6b09074c-d46b-42c4-b11f-825eb2f70d63 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4" status: 200 len: 1412 microversion: 2.1 time: 0.080787 Sep 16 12:49:46.561617 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 535/1117] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:49:46 2022] GET /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4 => generated 1412 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:46.570994 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3de6b207-6a01-4e32-8b73-15017f56c461 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:46.570994 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3de6b207-6a01-4e32-8b73-15017f56c461 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: f6c03f63-cad2-4937-9963-7b180cca34f5] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:46.578663 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3de6b207-6a01-4e32-8b73-15017f56c461 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:46.580913 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3de6b207-6a01-4e32-8b73-15017f56c461 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:46.581393 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3de6b207-6a01-4e32-8b73-15017f56c461 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:46.582160 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3de6b207-6a01-4e32-8b73-15017f56c461 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:46.582660 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3de6b207-6a01-4e32-8b73-15017f56c461 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:46.584721 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3de6b207-6a01-4e32-8b73-15017f56c461 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:46.618639 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a4adb507-a517-429a-ac09-9f8c6b147d3b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:46.633076 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a4adb507-a517-429a-ac09-9f8c6b147d3b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:46.636508 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a4adb507-a517-429a-ac09-9f8c6b147d3b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:46.650853 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a4adb507-a517-429a-ac09-9f8c6b147d3b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.214884 Sep 16 12:49:46.651455 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 583/1118] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:49:46 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:49:46.768946 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3de6b207-6a01-4e32-8b73-15017f56c461 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:46.777579 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3de6b207-6a01-4e32-8b73-15017f56c461 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5" status: 200 len: 1317 microversion: 2.1 time: 0.214693 Sep 16 12:49:46.778223 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 536/1119] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:46 2022] GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5 => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:47.502030 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6462977d-66f3-4400-9026-763e8da36e72 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:47.502646 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6462977d-66f3-4400-9026-763e8da36e72 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:47.504659 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:49:47.505334 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=8 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:49:47.511836 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6462977d-66f3-4400-9026-763e8da36e72 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:47.512362 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6462977d-66f3-4400-9026-763e8da36e72 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:47.512807 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6462977d-66f3-4400-9026-763e8da36e72 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:47.513507 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6462977d-66f3-4400-9026-763e8da36e72 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:47.513962 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6462977d-66f3-4400-9026-763e8da36e72 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:47.514388 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6462977d-66f3-4400-9026-763e8da36e72 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:47.576367 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8d90040d-1f7d-45ac-b1c4-351a1069dbd4 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f1035440670>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:47.628327 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8d90040d-1f7d-45ac-b1c4-351a1069dbd4 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4" status: 200 len: 1412 microversion: 2.1 time: 0.055846 Sep 16 12:49:47.628905 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 537/1120] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:49:47 2022] GET /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4 => generated 1412 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:47.652878 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6462977d-66f3-4400-9026-763e8da36e72 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:47.660498 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6462977d-66f3-4400-9026-763e8da36e72 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1470 microversion: 2.1 time: 0.162456 Sep 16 12:49:47.661602 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 584/1121] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:47 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1470 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:47.683927 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-33d3c1af-cfd3-4f3e-b25c-6a8301d2d047 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:49:47.684167 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-bab9a684-420a-40a3-ac2f-e1248c2d730a tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:47.684482 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-33d3c1af-cfd3-4f3e-b25c-6a8301d2d047 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:47.684835 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-bab9a684-420a-40a3-ac2f-e1248c2d730a tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:47.691456 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33d3c1af-cfd3-4f3e-b25c-6a8301d2d047 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:47.691628 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bab9a684-420a-40a3-ac2f-e1248c2d730a tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:47.691950 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33d3c1af-cfd3-4f3e-b25c-6a8301d2d047 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:47.692076 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bab9a684-420a-40a3-ac2f-e1248c2d730a tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:47.692430 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33d3c1af-cfd3-4f3e-b25c-6a8301d2d047 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:47.692536 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bab9a684-420a-40a3-ac2f-e1248c2d730a tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:47.693158 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33d3c1af-cfd3-4f3e-b25c-6a8301d2d047 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:47.693284 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bab9a684-420a-40a3-ac2f-e1248c2d730a tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:47.693647 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bab9a684-420a-40a3-ac2f-e1248c2d730a tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:47.693794 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33d3c1af-cfd3-4f3e-b25c-6a8301d2d047 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:47.694079 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bab9a684-420a-40a3-ac2f-e1248c2d730a tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:47.694213 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33d3c1af-cfd3-4f3e-b25c-6a8301d2d047 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:47.758781 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-bab9a684-420a-40a3-ac2f-e1248c2d730a tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:47.758937 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-33d3c1af-cfd3-4f3e-b25c-6a8301d2d047 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "POST /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74/action" status: 204 len: 0 microversion: 2.1 time: 0.078594 Sep 16 12:49:47.759583 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 585/1122] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:49:47 2022] POST /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 12:49:47.767652 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-bab9a684-420a-40a3-ac2f-e1248c2d730a tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:47.768324 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f8456912-d3ab-4b8e-94a2-7f565b7a7e14 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:47.769099 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f8456912-d3ab-4b8e-94a2-7f565b7a7e14 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:47.769214 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-bab9a684-420a-40a3-ac2f-e1248c2d730a tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:47.774792 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:49:47.774996 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-bab9a684-420a-40a3-ac2f-e1248c2d730a tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.094765 Sep 16 12:49:47.788173 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 538/1123] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:49:47 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:49:47.788388 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8456912-d3ab-4b8e-94a2-7f565b7a7e14 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:47.788388 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8456912-d3ab-4b8e-94a2-7f565b7a7e14 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:47.788388 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8456912-d3ab-4b8e-94a2-7f565b7a7e14 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:47.788388 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8456912-d3ab-4b8e-94a2-7f565b7a7e14 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:47.788736 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8456912-d3ab-4b8e-94a2-7f565b7a7e14 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:47.788736 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8456912-d3ab-4b8e-94a2-7f565b7a7e14 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:47.801465 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4eb1c0ff-6c0a-4cd6-b584-975b071f1e53 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:47.802725 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-4eb1c0ff-6c0a-4cd6-b584-975b071f1e53 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: f6c03f63-cad2-4937-9963-7b180cca34f5] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:47.808774 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4eb1c0ff-6c0a-4cd6-b584-975b071f1e53 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:47.809423 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4eb1c0ff-6c0a-4cd6-b584-975b071f1e53 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:47.809822 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4eb1c0ff-6c0a-4cd6-b584-975b071f1e53 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:47.810528 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4eb1c0ff-6c0a-4cd6-b584-975b071f1e53 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:47.810979 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4eb1c0ff-6c0a-4cd6-b584-975b071f1e53 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:47.811402 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4eb1c0ff-6c0a-4cd6-b584-975b071f1e53 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:48.121803 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f8456912-d3ab-4b8e-94a2-7f565b7a7e14 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:48.135186 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4eb1c0ff-6c0a-4cd6-b584-975b071f1e53 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:48.139034 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f8456912-d3ab-4b8e-94a2-7f565b7a7e14 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1470 microversion: 2.1 time: 0.370289 Sep 16 12:49:48.139667 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 586/1124] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:47 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1470 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:48.143971 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4eb1c0ff-6c0a-4cd6-b584-975b071f1e53 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5" status: 200 len: 1317 microversion: 2.1 time: 0.346529 Sep 16 12:49:48.144605 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 539/1125] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:47 2022] GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5 => generated 1317 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:48.481812 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-762b7691-4329-45db-8ca2-72bb4ae3dbaf req-4ad8948a-ba75-4c7d-b733-b6f66880d0da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dacfa868-1c8b-4918-8797-f31caee29361", "name": "network-vif-plugged", "status": "completed", "tag": "fabffdb4-d14b-4b3e-bbe3-09f69928ff1e"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:49:48.499419 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-762b7691-4329-45db-8ca2-72bb4ae3dbaf req-4ad8948a-ba75-4c7d-b733-b6f66880d0da service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:48.500666 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-762b7691-4329-45db-8ca2-72bb4ae3dbaf req-4ad8948a-ba75-4c7d-b733-b6f66880d0da service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:48.501952 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-762b7691-4329-45db-8ca2-72bb4ae3dbaf req-4ad8948a-ba75-4c7d-b733-b6f66880d0da service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:48.540412 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-762b7691-4329-45db-8ca2-72bb4ae3dbaf req-4ad8948a-ba75-4c7d-b733-b6f66880d0da service nova] Creating event network-vif-plugged:fabffdb4-d14b-4b3e-bbe3-09f69928ff1e for instance dacfa868-1c8b-4918-8797-f31caee29361 on n-h1-858094-4 Sep 16 12:49:48.546991 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-762b7691-4329-45db-8ca2-72bb4ae3dbaf req-4ad8948a-ba75-4c7d-b733-b6f66880d0da service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070305 Sep 16 12:49:48.547613 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 587/1126] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:49:48.646055 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1f053f7d-f654-4f5f-a2c9-60be2c97472b tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f1035788ee0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:48.701784 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1f053f7d-f654-4f5f-a2c9-60be2c97472b tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4" status: 200 len: 1412 microversion: 2.1 time: 0.060094 Sep 16 12:49:48.701784 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 540/1127] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:49:48 2022] GET /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4 => generated 1412 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:48.806167 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bea53b15-5703-4f9b-b430-2b3b9795fb8c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:48.806898 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bea53b15-5703-4f9b-b430-2b3b9795fb8c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:48.824032 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bea53b15-5703-4f9b-b430-2b3b9795fb8c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:48.824569 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bea53b15-5703-4f9b-b430-2b3b9795fb8c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:48.825011 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bea53b15-5703-4f9b-b430-2b3b9795fb8c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:48.825722 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bea53b15-5703-4f9b-b430-2b3b9795fb8c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:48.826189 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bea53b15-5703-4f9b-b430-2b3b9795fb8c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:48.826641 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bea53b15-5703-4f9b-b430-2b3b9795fb8c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:48.894622 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bea53b15-5703-4f9b-b430-2b3b9795fb8c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:48.909891 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bea53b15-5703-4f9b-b430-2b3b9795fb8c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:48.912199 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bea53b15-5703-4f9b-b430-2b3b9795fb8c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:48.918758 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bea53b15-5703-4f9b-b430-2b3b9795fb8c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.117507 Sep 16 12:49:48.919342 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 588/1128] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:49:48 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:49:49.163579 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9082a616-e52a-4bde-a038-ca5ca0192aa2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:49.164433 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9082a616-e52a-4bde-a038-ca5ca0192aa2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:49.167047 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-684b2ba7-a159-4926-aeda-be1466e06fae tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:49.167958 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-684b2ba7-a159-4926-aeda-be1466e06fae tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: f6c03f63-cad2-4937-9963-7b180cca34f5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:49.171720 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9082a616-e52a-4bde-a038-ca5ca0192aa2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:49.172250 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9082a616-e52a-4bde-a038-ca5ca0192aa2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:49.172698 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9082a616-e52a-4bde-a038-ca5ca0192aa2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:49.173674 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9082a616-e52a-4bde-a038-ca5ca0192aa2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:49.174142 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9082a616-e52a-4bde-a038-ca5ca0192aa2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:49.174372 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-684b2ba7-a159-4926-aeda-be1466e06fae tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:49.174568 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9082a616-e52a-4bde-a038-ca5ca0192aa2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:49.174861 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-684b2ba7-a159-4926-aeda-be1466e06fae tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:49.175301 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-684b2ba7-a159-4926-aeda-be1466e06fae tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:49.175996 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-684b2ba7-a159-4926-aeda-be1466e06fae tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:49.177251 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-684b2ba7-a159-4926-aeda-be1466e06fae tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:49.177844 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-684b2ba7-a159-4926-aeda-be1466e06fae tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:49.376296 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-684b2ba7-a159-4926-aeda-be1466e06fae tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:49.380593 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9082a616-e52a-4bde-a038-ca5ca0192aa2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:49.384469 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-684b2ba7-a159-4926-aeda-be1466e06fae tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5" status: 200 len: 1467 microversion: 2.1 time: 0.221099 Sep 16 12:49:49.385044 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 589/1129] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:49 2022] GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5 => generated 1467 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:49.388323 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9082a616-e52a-4bde-a038-ca5ca0192aa2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1470 microversion: 2.1 time: 0.229383 Sep 16 12:49:49.388893 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 541/1130] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:49 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1470 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:49.406644 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c192790e-55f3-45db-a067-8de2148241e5 tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:49.407246 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c192790e-55f3-45db-a067-8de2148241e5 tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] [instance: f6c03f63-cad2-4937-9963-7b180cca34f5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:49.414072 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c192790e-55f3-45db-a067-8de2148241e5 tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:49.414552 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c192790e-55f3-45db-a067-8de2148241e5 tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:49.414983 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c192790e-55f3-45db-a067-8de2148241e5 tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:49.415673 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c192790e-55f3-45db-a067-8de2148241e5 tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:49.416138 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c192790e-55f3-45db-a067-8de2148241e5 tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:49.416564 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c192790e-55f3-45db-a067-8de2148241e5 tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:49.558448 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c192790e-55f3-45db-a067-8de2148241e5 tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5" status: 200 len: 1618 microversion: 2.1 time: 0.154917 Sep 16 12:49:49.559475 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 590/1131] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:49 2022] GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5 => generated 1618 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:49.624137 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2bfdb194-8d43-4b6f-a8e8-4bba80f5fb9a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-706191126", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "8c7aea62-7b4d-400d-89fa-5411deefe490"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:49:49.674512 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-2bfdb194-8d43-4b6f-a8e8-4bba80f5fb9a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] validate_networks() for None {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:49:49.718581 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-09799dd2-112c-4658-a640-b6c944f7c3e9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f10357a2040>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:49.770899 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-09799dd2-112c-4658-a640-b6c944f7c3e9 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4" status: 200 len: 1412 microversion: 2.1 time: 0.057012 Sep 16 12:49:49.771578 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 591/1132] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:49:49 2022] GET /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4 => generated 1412 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:49.949043 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-2bfdb194-8d43-4b6f-a8e8-4bba80f5fb9a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:49:49.951011 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-2bfdb194-8d43-4b6f-a8e8-4bba80f5fb9a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:49:49.952707 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3685c109-a6ab-4b37-88e2-83d228510795 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:49.953506 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3685c109-a6ab-4b37-88e2-83d228510795 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:49.953774 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-2bfdb194-8d43-4b6f-a8e8-4bba80f5fb9a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:49:49.956541 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-2bfdb194-8d43-4b6f-a8e8-4bba80f5fb9a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:49:49.957197 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-2bfdb194-8d43-4b6f-a8e8-4bba80f5fb9a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:49:49.963954 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3685c109-a6ab-4b37-88e2-83d228510795 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:49.964485 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3685c109-a6ab-4b37-88e2-83d228510795 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:49.964925 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3685c109-a6ab-4b37-88e2-83d228510795 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:49.965665 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3685c109-a6ab-4b37-88e2-83d228510795 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:49.966123 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3685c109-a6ab-4b37-88e2-83d228510795 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:49.966572 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3685c109-a6ab-4b37-88e2-83d228510795 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:49.969689 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2bfdb194-8d43-4b6f-a8e8-4bba80f5fb9a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:49.970265 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2bfdb194-8d43-4b6f-a8e8-4bba80f5fb9a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:49.970898 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2bfdb194-8d43-4b6f-a8e8-4bba80f5fb9a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:49.971810 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2bfdb194-8d43-4b6f-a8e8-4bba80f5fb9a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:49.972502 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2bfdb194-8d43-4b6f-a8e8-4bba80f5fb9a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:49.972934 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2bfdb194-8d43-4b6f-a8e8-4bba80f5fb9a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:49.992391 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-2bfdb194-8d43-4b6f-a8e8-4bba80f5fb9a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Getting quotas for project 8c037a6456444018a6ef54314419e2f2. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:49:49.997954 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-2bfdb194-8d43-4b6f-a8e8-4bba80f5fb9a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Getting quotas for user c1928790cac542ec86add5794851f97a and project 8c037a6456444018a6ef54314419e2f2. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:49:50.011791 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-2bfdb194-8d43-4b6f-a8e8-4bba80f5fb9a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:49:50.014324 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-2bfdb194-8d43-4b6f-a8e8-4bba80f5fb9a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 96ff60ae-143a-4ae5-9c18-aff09a5c80cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:49:50.071356 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3685c109-a6ab-4b37-88e2-83d228510795 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:50.073985 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2bfdb194-8d43-4b6f-a8e8-4bba80f5fb9a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.453723 Sep 16 12:49:50.075570 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 542/1133] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:49:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 456 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:49:50.086174 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3685c109-a6ab-4b37-88e2-83d228510795 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:50.088372 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-223f4183-30fb-42dd-8fc7-00bc56cc7d4a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:50.088993 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-223f4183-30fb-42dd-8fc7-00bc56cc7d4a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 96ff60ae-143a-4ae5-9c18-aff09a5c80cd] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:50.104914 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3685c109-a6ab-4b37-88e2-83d228510795 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:50.113323 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3685c109-a6ab-4b37-88e2-83d228510795 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.165665 Sep 16 12:49:50.115697 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 592/1134] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:49:49 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:49:50.158741 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-223f4183-30fb-42dd-8fc7-00bc56cc7d4a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:50.171226 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-223f4183-30fb-42dd-8fc7-00bc56cc7d4a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd" status: 200 len: 1216 microversion: 2.1 time: 0.086775 Sep 16 12:49:50.180519 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 543/1135] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:50 2022] GET /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd => generated 1216 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:50.413991 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-11390660-21cd-4eed-adf9-1610943fbe2c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:50.414602 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-11390660-21cd-4eed-adf9-1610943fbe2c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:50.421921 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11390660-21cd-4eed-adf9-1610943fbe2c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:50.422684 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11390660-21cd-4eed-adf9-1610943fbe2c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:50.423500 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11390660-21cd-4eed-adf9-1610943fbe2c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:50.424153 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11390660-21cd-4eed-adf9-1610943fbe2c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:50.424612 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11390660-21cd-4eed-adf9-1610943fbe2c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:50.425034 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11390660-21cd-4eed-adf9-1610943fbe2c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:50.444082 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:49:50.563568 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-49142777-8c98-4815-8e97-6688ef6589ad req-d51a050e-a099-4996-94f4-c03eb262e321 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6b4a601-8b6e-498e-8c17-9e689c13db74", "name": "network-vif-plugged", "status": "completed", "tag": "c82c5517-9370-47b7-870d-b1c0f066ce8a"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:49:50.575507 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-49142777-8c98-4815-8e97-6688ef6589ad req-d51a050e-a099-4996-94f4-c03eb262e321 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:50.576369 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-49142777-8c98-4815-8e97-6688ef6589ad req-d51a050e-a099-4996-94f4-c03eb262e321 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:50.576997 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-49142777-8c98-4815-8e97-6688ef6589ad req-d51a050e-a099-4996-94f4-c03eb262e321 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:50.589676 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-49142777-8c98-4815-8e97-6688ef6589ad req-d51a050e-a099-4996-94f4-c03eb262e321 service nova] Creating event network-vif-plugged:c82c5517-9370-47b7-870d-b1c0f066ce8a for instance c6b4a601-8b6e-498e-8c17-9e689c13db74 on n-h2-858094-4 Sep 16 12:49:50.596490 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-49142777-8c98-4815-8e97-6688ef6589ad req-d51a050e-a099-4996-94f4-c03eb262e321 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036536 Sep 16 12:49:50.597380 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 544/1136] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:49:50.603143 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-11390660-21cd-4eed-adf9-1610943fbe2c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:50.618316 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-11390660-21cd-4eed-adf9-1610943fbe2c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1462 microversion: 2.1 time: 0.209657 Sep 16 12:49:50.619512 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 593/1137] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:50 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1462 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:50.650257 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4f93ffc5-a13e-43cd-b412-37cdb155530f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:50.655913 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-4f93ffc5-a13e-43cd-b412-37cdb155530f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:50.669339 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4f93ffc5-a13e-43cd-b412-37cdb155530f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:50.673827 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4f93ffc5-a13e-43cd-b412-37cdb155530f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:50.674390 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4f93ffc5-a13e-43cd-b412-37cdb155530f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:50.675213 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4f93ffc5-a13e-43cd-b412-37cdb155530f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:50.675768 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4f93ffc5-a13e-43cd-b412-37cdb155530f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:50.677717 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4f93ffc5-a13e-43cd-b412-37cdb155530f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:50.787027 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-831bc653-42e4-45d7-a9f3-2f561edc76c7 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f1035768c10>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:50.865061 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-831bc653-42e4-45d7-a9f3-2f561edc76c7 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4" status: 200 len: 1412 microversion: 2.1 time: 0.080637 Sep 16 12:49:50.866706 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 594/1138] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:49:50 2022] GET /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4 => generated 1412 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:50.917753 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4f93ffc5-a13e-43cd-b412-37cdb155530f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:50.927807 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4f93ffc5-a13e-43cd-b412-37cdb155530f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1462 microversion: 2.1 time: 0.284464 Sep 16 12:49:50.944827 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 545/1139] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:50 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1462 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:50.956006 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-190d9998-43af-40bf-9afc-0f1bc32dacc9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Action: 'create', calling method: .version_select at 0x7f10357233a0>, body: {"keypair": {"name": "tempest-keypair-2047555437", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkzSjqmxioUpo1+b9Vg/pnsPTOywIHvIQmu5YIqXf5Lek3MlYUgHx1Yv3nX1WNDxZvnT0cgbPfJFsRml86PJQpXD9yiQ7LnqBXDs4q3oqgV+vuVSrG08kywpbkVC/RA0A=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:49:50.977853 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-190d9998-43af-40bf-9afc-0f1bc32dacc9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Getting quotas for project 0b18ec5302634d2a95e51547e0019d40. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:49:50.984095 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-190d9998-43af-40bf-9afc-0f1bc32dacc9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Getting quotas for user f3e2827a76d14e4a88c4562f1c0351ac and project 0b18ec5302634d2a95e51547e0019d40. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:49:51.021773 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-190d9998-43af-40bf-9afc-0f1bc32dacc9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.069530 Sep 16 12:49:51.023121 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 595/1140] 10.222.0.67 () {60 vars in 1159 bytes} [Fri Sep 16 12:49:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:49:51.148150 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-04f3e66b-8903-45f5-beb0-a4f7df7caaf1 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:51.149440 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-04f3e66b-8903-45f5-beb0-a4f7df7caaf1 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:51.156512 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-04f3e66b-8903-45f5-beb0-a4f7df7caaf1 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:51.157274 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-04f3e66b-8903-45f5-beb0-a4f7df7caaf1 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:51.157949 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-04f3e66b-8903-45f5-beb0-a4f7df7caaf1 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:51.159040 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-04f3e66b-8903-45f5-beb0-a4f7df7caaf1 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:51.159733 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-04f3e66b-8903-45f5-beb0-a4f7df7caaf1 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:51.160964 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-04f3e66b-8903-45f5-beb0-a4f7df7caaf1 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:51.196175 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-83ee0a82-bafb-4ce2-a7a4-c00fecfd14d5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:51.197219 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-83ee0a82-bafb-4ce2-a7a4-c00fecfd14d5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 96ff60ae-143a-4ae5-9c18-aff09a5c80cd] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:51.221591 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83ee0a82-bafb-4ce2-a7a4-c00fecfd14d5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:51.222102 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83ee0a82-bafb-4ce2-a7a4-c00fecfd14d5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:51.225907 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83ee0a82-bafb-4ce2-a7a4-c00fecfd14d5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:51.227959 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83ee0a82-bafb-4ce2-a7a4-c00fecfd14d5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:51.228478 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83ee0a82-bafb-4ce2-a7a4-c00fecfd14d5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:51.231125 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83ee0a82-bafb-4ce2-a7a4-c00fecfd14d5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:51.363064 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-83ee0a82-bafb-4ce2-a7a4-c00fecfd14d5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:51.369891 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-04f3e66b-8903-45f5-beb0-a4f7df7caaf1 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:51.372718 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-83ee0a82-bafb-4ce2-a7a4-c00fecfd14d5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd" status: 200 len: 1268 microversion: 2.1 time: 0.180928 Sep 16 12:49:51.389241 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 596/1141] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:51 2022] GET /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd => generated 1268 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:51.394251 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-04f3e66b-8903-45f5-beb0-a4f7df7caaf1 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:51.394251 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-04f3e66b-8903-45f5-beb0-a4f7df7caaf1 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:51.399947 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-04f3e66b-8903-45f5-beb0-a4f7df7caaf1 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.258948 Sep 16 12:49:51.401503 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 546/1142] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:49:51 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:49:51.883351 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0d023a3b-ac8f-4d94-9d5b-0b6e6c15b969 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f10360ed9d0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:51.967303 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0d023a3b-ac8f-4d94-9d5b-0b6e6c15b969 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4" status: 200 len: 1412 microversion: 2.1 time: 0.089715 Sep 16 12:49:51.977401 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 597/1143] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:49:51 2022] GET /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4 => generated 1412 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:52.403387 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4265b980-0437-4d26-84fe-3c3ae5fa1d14 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:52.404245 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-4265b980-0437-4d26-84fe-3c3ae5fa1d14 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 96ff60ae-143a-4ae5-9c18-aff09a5c80cd] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:52.420754 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4265b980-0437-4d26-84fe-3c3ae5fa1d14 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:52.421538 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4265b980-0437-4d26-84fe-3c3ae5fa1d14 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:52.422090 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4265b980-0437-4d26-84fe-3c3ae5fa1d14 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:52.423192 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4265b980-0437-4d26-84fe-3c3ae5fa1d14 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:52.423752 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4265b980-0437-4d26-84fe-3c3ae5fa1d14 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:52.430348 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d73b9cc0-6fed-436c-8a0a-8d1c153cd740 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:52.431417 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d73b9cc0-6fed-436c-8a0a-8d1c153cd740 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:52.436579 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4265b980-0437-4d26-84fe-3c3ae5fa1d14 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:52.444022 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d73b9cc0-6fed-436c-8a0a-8d1c153cd740 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:52.445404 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d73b9cc0-6fed-436c-8a0a-8d1c153cd740 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:52.447903 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d73b9cc0-6fed-436c-8a0a-8d1c153cd740 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:52.449458 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d73b9cc0-6fed-436c-8a0a-8d1c153cd740 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:52.452342 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d73b9cc0-6fed-436c-8a0a-8d1c153cd740 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:52.453062 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d73b9cc0-6fed-436c-8a0a-8d1c153cd740 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:52.549759 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4265b980-0437-4d26-84fe-3c3ae5fa1d14 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:52.558757 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4265b980-0437-4d26-84fe-3c3ae5fa1d14 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd" status: 200 len: 1274 microversion: 2.1 time: 0.159409 Sep 16 12:49:52.562035 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 547/1144] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:52 2022] GET /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd => generated 1274 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:52.639463 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d73b9cc0-6fed-436c-8a0a-8d1c153cd740 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:52.659071 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d73b9cc0-6fed-436c-8a0a-8d1c153cd740 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:52.662637 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d73b9cc0-6fed-436c-8a0a-8d1c153cd740 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:52.680612 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d73b9cc0-6fed-436c-8a0a-8d1c153cd740 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.255072 Sep 16 12:49:52.684455 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 598/1145] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:49:52 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:49:52.939282 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-02d38f23-efba-4e75-909e-e748c9f33eed tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Calling method '.version_select at 0x7f103572c700>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:52.943840 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-02d38f23-efba-4e75-909e-e748c9f33eed tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:52.944747 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-02d38f23-efba-4e75-909e-e748c9f33eed tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:52.945407 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-02d38f23-efba-4e75-909e-e748c9f33eed tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:52.961168 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-02d38f23-efba-4e75-909e-e748c9f33eed tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] 10.222.0.67 "GET /compute/v2.1/os-migrations" status: 200 len: 1570 microversion: 2.1 time: 0.020203 Sep 16 12:49:52.962582 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 548/1146] 10.222.0.67 () {58 vars in 1143 bytes} [Fri Sep 16 12:49:52 2022] GET /compute/v2.1/os-migrations => generated 1570 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:52.985800 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e23b8f44-1f01-45e5-a867-f972a7d643c1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f103542b4c0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:52.986034 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4f769ddc-07a4-46bc-843a-b9e826fdda97 tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:53.013310 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4f769ddc-07a4-46bc-843a-b9e826fdda97 tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031354 Sep 16 12:49:53.022032 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 599/1147] 10.222.0.67 () {58 vars in 1137 bytes} [Fri Sep 16 12:49:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:49:53.036800 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-39c7f1bf-9eba-4560-8747-35e907e620f0 tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-2017932822", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:49:53.065975 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e23b8f44-1f01-45e5-a867-f972a7d643c1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4" status: 200 len: 1412 microversion: 2.1 time: 0.082114 Sep 16 12:49:53.076179 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 549/1148] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:49:52 2022] GET /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4 => generated 1412 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:53.085819 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-39c7f1bf-9eba-4560-8747-35e907e620f0 tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.055313 Sep 16 12:49:53.087079 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 600/1149] 10.222.0.67 () {60 vars in 1146 bytes} [Fri Sep 16 12:49:53 2022] POST /compute/v2.1/flavors => generated 499 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:49:53.099287 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-025e0004-7fe7-46dc-b552-3182865be9c8 tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:53.119403 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-025e0004-7fe7-46dc-b552-3182865be9c8 tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.024332 Sep 16 12:49:53.121526 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 550/1150] 10.222.0.67 () {58 vars in 1182 bytes} [Fri Sep 16 12:49:53 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 12:49:53.437360 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d950ed9e-82b9-4f16-8e4d-60e20ad4840c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-144598372", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "2c986fa9-53ef-4e69-8dea-d107da49319f"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:49:53.523037 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-d950ed9e-82b9-4f16-8e4d-60e20ad4840c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] validate_networks() for None {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:49:53.586643 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-63176721-7a92-4cdf-b4bc-3fd744875e11 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:53.588034 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-63176721-7a92-4cdf-b4bc-3fd744875e11 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 96ff60ae-143a-4ae5-9c18-aff09a5c80cd] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:53.594523 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-63176721-7a92-4cdf-b4bc-3fd744875e11 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:53.595240 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-63176721-7a92-4cdf-b4bc-3fd744875e11 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:53.595867 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-63176721-7a92-4cdf-b4bc-3fd744875e11 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:53.596762 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-63176721-7a92-4cdf-b4bc-3fd744875e11 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:53.597374 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-63176721-7a92-4cdf-b4bc-3fd744875e11 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:53.598675 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-63176721-7a92-4cdf-b4bc-3fd744875e11 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:53.914058 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-63176721-7a92-4cdf-b4bc-3fd744875e11 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:53.922163 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-63176721-7a92-4cdf-b4bc-3fd744875e11 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd" status: 200 len: 1316 microversion: 2.1 time: 0.340551 Sep 16 12:49:53.923234 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 551/1151] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:53 2022] GET /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd => generated 1316 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:53.928816 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e79d2aaf-437f-4c79-8467-3eadca9dce24 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:53.929643 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e79d2aaf-437f-4c79-8467-3eadca9dce24 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:53.939284 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e79d2aaf-437f-4c79-8467-3eadca9dce24 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:53.940074 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e79d2aaf-437f-4c79-8467-3eadca9dce24 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:53.940554 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e79d2aaf-437f-4c79-8467-3eadca9dce24 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:53.941291 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e79d2aaf-437f-4c79-8467-3eadca9dce24 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:53.941816 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e79d2aaf-437f-4c79-8467-3eadca9dce24 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:53.942474 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e79d2aaf-437f-4c79-8467-3eadca9dce24 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:54.091768 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-d950ed9e-82b9-4f16-8e4d-60e20ad4840c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:49:54.091768 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-d950ed9e-82b9-4f16-8e4d-60e20ad4840c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:49:54.091768 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-d950ed9e-82b9-4f16-8e4d-60e20ad4840c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:49:54.092391 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-d950ed9e-82b9-4f16-8e4d-60e20ad4840c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:49:54.092579 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-d950ed9e-82b9-4f16-8e4d-60e20ad4840c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:49:54.095992 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e79d2aaf-437f-4c79-8467-3eadca9dce24 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:54.105709 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e79d2aaf-437f-4c79-8467-3eadca9dce24 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:54.107166 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e79d2aaf-437f-4c79-8467-3eadca9dce24 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:54.108029 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d950ed9e-82b9-4f16-8e4d-60e20ad4840c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:54.108545 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d950ed9e-82b9-4f16-8e4d-60e20ad4840c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:54.109204 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d950ed9e-82b9-4f16-8e4d-60e20ad4840c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:54.110061 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d950ed9e-82b9-4f16-8e4d-60e20ad4840c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:54.110527 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d950ed9e-82b9-4f16-8e4d-60e20ad4840c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:54.111424 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d950ed9e-82b9-4f16-8e4d-60e20ad4840c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:54.122180 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e79d2aaf-437f-4c79-8467-3eadca9dce24 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.197142 Sep 16 12:49:54.124536 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 552/1152] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:49:53 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:49:54.130047 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a93bcceb-5746-4e83-9a3a-017b28165d45 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f1035463f70>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:54.161803 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-d950ed9e-82b9-4f16-8e4d-60e20ad4840c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Getting quotas for project 0b18ec5302634d2a95e51547e0019d40. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:49:54.175205 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-d950ed9e-82b9-4f16-8e4d-60e20ad4840c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Getting quotas for user f3e2827a76d14e4a88c4562f1c0351ac and project 0b18ec5302634d2a95e51547e0019d40. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:49:54.193044 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a93bcceb-5746-4e83-9a3a-017b28165d45 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4" status: 200 len: 1412 microversion: 2.1 time: 0.066732 Sep 16 12:49:54.197704 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d950ed9e-82b9-4f16-8e4d-60e20ad4840c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:49:54.200909 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d950ed9e-82b9-4f16-8e4d-60e20ad4840c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:49:54.201586 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 553/1153] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:49:54 2022] GET /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4 => generated 1412 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:54.257349 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d950ed9e-82b9-4f16-8e4d-60e20ad4840c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.825346 Sep 16 12:49:54.261325 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 601/1154] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:49:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:49:54.272815 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7ac1d098-55cc-4615-afdb-1d5f6af307ab tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:54.273984 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7ac1d098-55cc-4615-afdb-1d5f6af307ab tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:54.293573 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-4c36ed68-e9f7-4688-8149-67198bfe92ff req-ea17bb75-ef71-4925-9aab-605976677049 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96ff60ae-143a-4ae5-9c18-aff09a5c80cd", "tag": "86268f4b-8663-42c1-8d76-59058c635845"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:49:54.312914 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4c36ed68-e9f7-4688-8149-67198bfe92ff req-ea17bb75-ef71-4925-9aab-605976677049 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:54.313489 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4c36ed68-e9f7-4688-8149-67198bfe92ff req-ea17bb75-ef71-4925-9aab-605976677049 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:54.313941 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4c36ed68-e9f7-4688-8149-67198bfe92ff req-ea17bb75-ef71-4925-9aab-605976677049 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:54.326641 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-4c36ed68-e9f7-4688-8149-67198bfe92ff req-ea17bb75-ef71-4925-9aab-605976677049 service nova] Creating event network-changed:86268f4b-8663-42c1-8d76-59058c635845 for instance 96ff60ae-143a-4ae5-9c18-aff09a5c80cd on n-h1-858094-4 Sep 16 12:49:54.360957 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-4c36ed68-e9f7-4688-8149-67198bfe92ff req-ea17bb75-ef71-4925-9aab-605976677049 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076185 Sep 16 12:49:54.362783 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 602/1155] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:49:54.396431 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7ac1d098-55cc-4615-afdb-1d5f6af307ab tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:54.405481 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7ac1d098-55cc-4615-afdb-1d5f6af307ab tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1278 microversion: 2.1 time: 0.137403 Sep 16 12:49:54.406352 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 554/1156] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:54 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1278 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:54.949247 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f08a9037-36a6-47bd-b1f6-c50f0c86ed49 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:54.950232 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f08a9037-36a6-47bd-b1f6-c50f0c86ed49 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 96ff60ae-143a-4ae5-9c18-aff09a5c80cd] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:54.964356 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f08a9037-36a6-47bd-b1f6-c50f0c86ed49 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:54.967920 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f08a9037-36a6-47bd-b1f6-c50f0c86ed49 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:54.968578 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f08a9037-36a6-47bd-b1f6-c50f0c86ed49 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:54.970154 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f08a9037-36a6-47bd-b1f6-c50f0c86ed49 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:54.971550 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f08a9037-36a6-47bd-b1f6-c50f0c86ed49 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:54.973778 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f08a9037-36a6-47bd-b1f6-c50f0c86ed49 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:55.155483 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-cc86c240-0562-4ba8-bece-28c2f35b0249 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:55.156085 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-cc86c240-0562-4ba8-bece-28c2f35b0249 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:55.166740 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cc86c240-0562-4ba8-bece-28c2f35b0249 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:55.167059 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f08a9037-36a6-47bd-b1f6-c50f0c86ed49 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:55.167528 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cc86c240-0562-4ba8-bece-28c2f35b0249 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:55.167676 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cc86c240-0562-4ba8-bece-28c2f35b0249 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:55.168439 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cc86c240-0562-4ba8-bece-28c2f35b0249 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:55.168898 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cc86c240-0562-4ba8-bece-28c2f35b0249 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:55.169326 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cc86c240-0562-4ba8-bece-28c2f35b0249 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:55.177917 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f08a9037-36a6-47bd-b1f6-c50f0c86ed49 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd" status: 200 len: 1316 microversion: 2.1 time: 0.232893 Sep 16 12:49:55.179607 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 603/1157] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:54 2022] GET /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd => generated 1316 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:55.211998 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d992081b-12fa-4561-a838-af48ea050557 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f1035761700>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:55.288416 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d992081b-12fa-4561-a838-af48ea050557 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4" status: 200 len: 1412 microversion: 2.1 time: 0.081525 Sep 16 12:49:55.289946 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 604/1158] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:49:55 2022] GET /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4 => generated 1412 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:55.315135 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-cc86c240-0562-4ba8-bece-28c2f35b0249 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:55.328426 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-cc86c240-0562-4ba8-bece-28c2f35b0249 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:55.330190 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-cc86c240-0562-4ba8-bece-28c2f35b0249 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:55.349067 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-cc86c240-0562-4ba8-bece-28c2f35b0249 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.196687 Sep 16 12:49:55.350268 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 555/1159] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:49:55 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:49:55.429928 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6ece7d1c-d726-426f-903f-b760c0055b65 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:55.430550 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6ece7d1c-d726-426f-903f-b760c0055b65 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:55.438022 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ece7d1c-d726-426f-903f-b760c0055b65 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:55.438518 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ece7d1c-d726-426f-903f-b760c0055b65 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:55.438962 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ece7d1c-d726-426f-903f-b760c0055b65 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:55.439672 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ece7d1c-d726-426f-903f-b760c0055b65 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:55.440179 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ece7d1c-d726-426f-903f-b760c0055b65 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:55.440906 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ece7d1c-d726-426f-903f-b760c0055b65 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:55.527126 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6ece7d1c-d726-426f-903f-b760c0055b65 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:55.536769 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6ece7d1c-d726-426f-903f-b760c0055b65 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1330 microversion: 2.1 time: 0.110879 Sep 16 12:49:55.537543 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 605/1160] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:55 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1330 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:56.213001 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fce21283-bb46-4833-a30a-840707414cf3 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:56.214284 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-fce21283-bb46-4833-a30a-840707414cf3 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 96ff60ae-143a-4ae5-9c18-aff09a5c80cd] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:56.230295 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fce21283-bb46-4833-a30a-840707414cf3 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:56.231310 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fce21283-bb46-4833-a30a-840707414cf3 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:56.233414 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fce21283-bb46-4833-a30a-840707414cf3 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:56.234597 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fce21283-bb46-4833-a30a-840707414cf3 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:56.235537 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fce21283-bb46-4833-a30a-840707414cf3 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:56.236183 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fce21283-bb46-4833-a30a-840707414cf3 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:56.305997 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b1fd4744-163a-429c-b7ab-78b6de682fb3 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f1035761e50>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:56.387637 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b1fd4744-163a-429c-b7ab-78b6de682fb3 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4" status: 200 len: 1412 microversion: 2.1 time: 0.082985 Sep 16 12:49:56.388275 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 606/1161] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:49:56 2022] GET /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4 => generated 1412 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:56.412926 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1c820b6d-07b4-47bc-b581-314a33199733 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:56.415064 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1c820b6d-07b4-47bc-b581-314a33199733 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:56.433361 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c820b6d-07b4-47bc-b581-314a33199733 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:56.434175 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c820b6d-07b4-47bc-b581-314a33199733 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:56.436732 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c820b6d-07b4-47bc-b581-314a33199733 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:56.437784 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c820b6d-07b4-47bc-b581-314a33199733 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:56.438930 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c820b6d-07b4-47bc-b581-314a33199733 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:56.440928 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c820b6d-07b4-47bc-b581-314a33199733 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:56.449561 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-fce21283-bb46-4833-a30a-840707414cf3 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:56.459689 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-fce21283-bb46-4833-a30a-840707414cf3 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd" status: 200 len: 1316 microversion: 2.1 time: 0.259414 Sep 16 12:49:56.474637 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 556/1162] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:56 2022] GET /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd => generated 1316 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:56.493632 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-928996a2-a746-46fa-aa39-01bdb2ba5c79 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:56.499730 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-928996a2-a746-46fa-aa39-01bdb2ba5c79 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3cd06a287a6b48f5a8a5ac30c0159fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3e2fe65ad744a2ba3b757f42f1d07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:56.500856 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-928996a2-a746-46fa-aa39-01bdb2ba5c79 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Searching by: {'deleted': False, 'project_id': '3e3e2fe65ad744a2ba3b757f42f1d07b'} {{(pid=128780) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 12:49:56.508392 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-928996a2-a746-46fa-aa39-01bdb2ba5c79 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:56.509183 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-928996a2-a746-46fa-aa39-01bdb2ba5c79 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:56.509957 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-928996a2-a746-46fa-aa39-01bdb2ba5c79 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:56.511593 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-928996a2-a746-46fa-aa39-01bdb2ba5c79 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:56.512780 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-928996a2-a746-46fa-aa39-01bdb2ba5c79 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:56.514311 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-928996a2-a746-46fa-aa39-01bdb2ba5c79 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:56.612496 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1c820b6d-07b4-47bc-b581-314a33199733 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:56.627474 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1c820b6d-07b4-47bc-b581-314a33199733 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:56.632357 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1c820b6d-07b4-47bc-b581-314a33199733 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:56.639233 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1c820b6d-07b4-47bc-b581-314a33199733 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.237931 Sep 16 12:49:56.639997 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 607/1163] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:49:56 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:49:56.646172 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5d68c8af-3a13-411c-b4c1-db4855c1e1d1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:56.649002 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5d68c8af-3a13-411c-b4c1-db4855c1e1d1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:56.662650 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d68c8af-3a13-411c-b4c1-db4855c1e1d1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:56.663414 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d68c8af-3a13-411c-b4c1-db4855c1e1d1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:56.667047 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d68c8af-3a13-411c-b4c1-db4855c1e1d1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:56.668016 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d68c8af-3a13-411c-b4c1-db4855c1e1d1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:56.668668 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d68c8af-3a13-411c-b4c1-db4855c1e1d1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:56.668917 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.multi_cell_list [None req-928996a2-a746-46fa-aa39-01bdb2ba5c79 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128780) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 12:49:56.670511 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d68c8af-3a13-411c-b4c1-db4855c1e1d1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:56.761755 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-928996a2-a746-46fa-aa39-01bdb2ba5c79 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.272666 Sep 16 12:49:56.762655 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 557/1164] 10.222.0.67 () {58 vars in 1125 bytes} [Fri Sep 16 12:49:56 2022] GET /compute/v2.1/servers => generated 334 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:49:56.777034 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-140f24d2-7223-458b-b6c6-e40f1cbe653f tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:56.784257 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-140f24d2-7223-458b-b6c6-e40f1cbe653f tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3cd06a287a6b48f5a8a5ac30c0159fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3e2fe65ad744a2ba3b757f42f1d07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:56.785106 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5d68c8af-3a13-411c-b4c1-db4855c1e1d1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:56.786594 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-140f24d2-7223-458b-b6c6-e40f1cbe653f tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Searching by: {'deleted': False, 'project_id': '3e3e2fe65ad744a2ba3b757f42f1d07b'} {{(pid=128780) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 12:49:56.795797 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-140f24d2-7223-458b-b6c6-e40f1cbe653f tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:56.796359 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-140f24d2-7223-458b-b6c6-e40f1cbe653f tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:56.796643 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5d68c8af-3a13-411c-b4c1-db4855c1e1d1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1336 microversion: 2.1 time: 0.155361 Sep 16 12:49:56.796775 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-140f24d2-7223-458b-b6c6-e40f1cbe653f tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:56.797382 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 608/1165] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:56 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1336 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:56.799549 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-140f24d2-7223-458b-b6c6-e40f1cbe653f tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:56.800056 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-140f24d2-7223-458b-b6c6-e40f1cbe653f tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:56.801767 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-140f24d2-7223-458b-b6c6-e40f1cbe653f tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:56.835338 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.multi_cell_list [None req-140f24d2-7223-458b-b6c6-e40f1cbe653f tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128780) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 12:49:56.852638 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=100 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:49:56.881419 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-140f24d2-7223-458b-b6c6-e40f1cbe653f tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd06a287a6b48f5a8a5ac30c0159fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3e2fe65ad744a2ba3b757f42f1d07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:56.890325 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-140f24d2-7223-458b-b6c6-e40f1cbe653f tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:56.891357 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-140f24d2-7223-458b-b6c6-e40f1cbe653f tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:56.892387 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-140f24d2-7223-458b-b6c6-e40f1cbe653f tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:57.052504 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-140f24d2-7223-458b-b6c6-e40f1cbe653f tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] 10.222.0.67 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 0.280099 Sep 16 12:49:57.057347 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 558/1166] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:49:56 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:57.079959 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2567a5c7-3fac-43d6-8a0f-0d03061ca8f1 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:57.091086 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2567a5c7-3fac-43d6-8a0f-0d03061ca8f1 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016246 Sep 16 12:49:57.100059 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 609/1167] 10.222.0.67 () {58 vars in 1137 bytes} [Fri Sep 16 12:49:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:49:57.406689 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-20b56bac-955c-4535-ac9a-b88d6ddd033f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f103542b940>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:57.472081 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-20b56bac-955c-4535-ac9a-b88d6ddd033f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4" status: 200 len: 1412 microversion: 2.1 time: 0.071725 Sep 16 12:49:57.473105 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 559/1168] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:49:57 2022] GET /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4 => generated 1412 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:57.497043 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5f7ef3bc-9894-402a-a65f-23a24f547181 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:57.504781 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5f7ef3bc-9894-402a-a65f-23a24f547181 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 96ff60ae-143a-4ae5-9c18-aff09a5c80cd] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:57.522303 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f7ef3bc-9894-402a-a65f-23a24f547181 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:57.523381 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f7ef3bc-9894-402a-a65f-23a24f547181 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:57.525935 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f7ef3bc-9894-402a-a65f-23a24f547181 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:57.527392 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f7ef3bc-9894-402a-a65f-23a24f547181 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:57.529663 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f7ef3bc-9894-402a-a65f-23a24f547181 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:57.530257 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f7ef3bc-9894-402a-a65f-23a24f547181 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:57.671261 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-dc0af756-da91-4812-83ec-2390a29d0894 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:57.672081 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-dc0af756-da91-4812-83ec-2390a29d0894 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] [instance: 8983b634-6da4-4830-b0f1-5835cc55083e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:57.690805 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dc0af756-da91-4812-83ec-2390a29d0894 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:57.692510 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dc0af756-da91-4812-83ec-2390a29d0894 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:57.693381 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dc0af756-da91-4812-83ec-2390a29d0894 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:57.697730 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dc0af756-da91-4812-83ec-2390a29d0894 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:57.698451 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dc0af756-da91-4812-83ec-2390a29d0894 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:57.700027 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dc0af756-da91-4812-83ec-2390a29d0894 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:57.762233 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-dc0af756-da91-4812-83ec-2390a29d0894 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] [instance: 8983b634-6da4-4830-b0f1-5835cc55083e] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:49:57.823026 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5f7ef3bc-9894-402a-a65f-23a24f547181 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:57.836465 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5f7ef3bc-9894-402a-a65f-23a24f547181 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd" status: 200 len: 1316 microversion: 2.1 time: 0.351705 Sep 16 12:49:57.848741 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 610/1169] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:57 2022] GET /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd => generated 1316 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:57.853968 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9ae11aa6-8762-469c-b6c5-1d6300fc03a4 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:57.853968 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9ae11aa6-8762-469c-b6c5-1d6300fc03a4 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:57.867892 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ae11aa6-8762-469c-b6c5-1d6300fc03a4 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:57.869898 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ae11aa6-8762-469c-b6c5-1d6300fc03a4 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:57.870359 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ae11aa6-8762-469c-b6c5-1d6300fc03a4 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:57.871093 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ae11aa6-8762-469c-b6c5-1d6300fc03a4 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:57.871635 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ae11aa6-8762-469c-b6c5-1d6300fc03a4 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:57.875981 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ae11aa6-8762-469c-b6c5-1d6300fc03a4 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:57.982770 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9ae11aa6-8762-469c-b6c5-1d6300fc03a4 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:57.982926 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-dc0af756-da91-4812-83ec-2390a29d0894 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] 10.222.0.67 "DELETE /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e" status: 204 len: 0 microversion: 2.1 time: 0.315733 Sep 16 12:49:57.983482 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 560/1170] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:49:57 2022] DELETE /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:49:57.996246 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c0f3904b-be2f-4596-8bd5-ed81c30f8b33 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:57.996246 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c0f3904b-be2f-4596-8bd5-ed81c30f8b33 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:57.996246 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:49:57.997519 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c0f3904b-be2f-4596-8bd5-ed81c30f8b33 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:57.998017 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c0f3904b-be2f-4596-8bd5-ed81c30f8b33 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:57.998448 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c0f3904b-be2f-4596-8bd5-ed81c30f8b33 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:57.999153 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c0f3904b-be2f-4596-8bd5-ed81c30f8b33 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:57.999604 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c0f3904b-be2f-4596-8bd5-ed81c30f8b33 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:58.000018 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c0f3904b-be2f-4596-8bd5-ed81c30f8b33 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:58.019676 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9ae11aa6-8762-469c-b6c5-1d6300fc03a4 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:58.027109 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9ae11aa6-8762-469c-b6c5-1d6300fc03a4 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:58.040792 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9ae11aa6-8762-469c-b6c5-1d6300fc03a4 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1560 microversion: 2.91 time: 0.201945 Sep 16 12:49:58.054050 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 611/1171] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:49:57 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1560 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:49:58.061460 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5c4dd0a2-c896-40b5-9693-52f2b99af016 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:58.062071 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5c4dd0a2-c896-40b5-9693-52f2b99af016 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] [instance: 8983b634-6da4-4830-b0f1-5835cc55083e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:58.073778 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c4dd0a2-c896-40b5-9693-52f2b99af016 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:58.074299 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c4dd0a2-c896-40b5-9693-52f2b99af016 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:58.074891 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c4dd0a2-c896-40b5-9693-52f2b99af016 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:58.075617 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c4dd0a2-c896-40b5-9693-52f2b99af016 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:58.076076 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c4dd0a2-c896-40b5-9693-52f2b99af016 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:58.076532 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c4dd0a2-c896-40b5-9693-52f2b99af016 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:58.262920 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c0f3904b-be2f-4596-8bd5-ed81c30f8b33 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:58.272906 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c0f3904b-be2f-4596-8bd5-ed81c30f8b33 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1378 microversion: 2.1 time: 0.288072 Sep 16 12:49:58.274585 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 561/1172] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:57 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1378 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:58.345910 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5c4dd0a2-c896-40b5-9693-52f2b99af016 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd06a287a6b48f5a8a5ac30c0159fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3e2fe65ad744a2ba3b757f42f1d07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:58.358412 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5c4dd0a2-c896-40b5-9693-52f2b99af016 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] 10.222.0.67 "GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e" status: 200 len: 1701 microversion: 2.1 time: 0.304530 Sep 16 12:49:58.360741 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 612/1173] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:58 2022] GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e => generated 1701 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:58.487553 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4e90c631-ed14-4dee-8de2-4caac6cf5c69 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f1035788b80>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:58.553818 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4e90c631-ed14-4dee-8de2-4caac6cf5c69 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4" status: 200 len: 1412 microversion: 2.1 time: 0.068735 Sep 16 12:49:58.562452 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 562/1174] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:49:58 2022] GET /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4 => generated 1412 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:58.725652 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-1aaf025f-56c5-4a46-8852-4c1edfd879bd req-a4229aa1-97b1-44a6-99fa-f8c1216929a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a439c4ea-46f5-4571-9d87-96a91a6359f7", "tag": "76e2deeb-80ac-4c0d-98b8-96091a5ab0d2"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:49:58.744759 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1aaf025f-56c5-4a46-8852-4c1edfd879bd req-a4229aa1-97b1-44a6-99fa-f8c1216929a1 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:58.745687 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1aaf025f-56c5-4a46-8852-4c1edfd879bd req-a4229aa1-97b1-44a6-99fa-f8c1216929a1 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:58.746914 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1aaf025f-56c5-4a46-8852-4c1edfd879bd req-a4229aa1-97b1-44a6-99fa-f8c1216929a1 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:58.766005 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-1aaf025f-56c5-4a46-8852-4c1edfd879bd req-a4229aa1-97b1-44a6-99fa-f8c1216929a1 service nova] Creating event network-changed:76e2deeb-80ac-4c0d-98b8-96091a5ab0d2 for instance a439c4ea-46f5-4571-9d87-96a91a6359f7 on n-h2-858094-4 Sep 16 12:49:58.774423 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-1aaf025f-56c5-4a46-8852-4c1edfd879bd req-a4229aa1-97b1-44a6-99fa-f8c1216929a1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057513 Sep 16 12:49:58.775882 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 613/1175] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:49:58.862887 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-61ff5016-5ee3-46e8-bf9c-11e1d2090d26 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:58.864364 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-61ff5016-5ee3-46e8-bf9c-11e1d2090d26 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 96ff60ae-143a-4ae5-9c18-aff09a5c80cd] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:58.875013 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-61ff5016-5ee3-46e8-bf9c-11e1d2090d26 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:58.875764 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-61ff5016-5ee3-46e8-bf9c-11e1d2090d26 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:58.876414 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-61ff5016-5ee3-46e8-bf9c-11e1d2090d26 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:58.877290 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-61ff5016-5ee3-46e8-bf9c-11e1d2090d26 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:58.877929 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-61ff5016-5ee3-46e8-bf9c-11e1d2090d26 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:58.878514 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-61ff5016-5ee3-46e8-bf9c-11e1d2090d26 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:58.908083 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-79d842bc-52a7-495c-a5bc-54e8d2afb215 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:58.917034 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-79d842bc-52a7-495c-a5bc-54e8d2afb215 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 38d079dd-9676-45f7-b286-16aa78d487bf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:58.930097 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79d842bc-52a7-495c-a5bc-54e8d2afb215 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:58.930929 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79d842bc-52a7-495c-a5bc-54e8d2afb215 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:58.931517 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79d842bc-52a7-495c-a5bc-54e8d2afb215 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:58.932400 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79d842bc-52a7-495c-a5bc-54e8d2afb215 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:58.935169 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79d842bc-52a7-495c-a5bc-54e8d2afb215 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:58.935795 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79d842bc-52a7-495c-a5bc-54e8d2afb215 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:58.984506 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-79d842bc-52a7-495c-a5bc-54e8d2afb215 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 38d079dd-9676-45f7-b286-16aa78d487bf] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:49:59.103618 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-61ff5016-5ee3-46e8-bf9c-11e1d2090d26 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:59.119637 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-61ff5016-5ee3-46e8-bf9c-11e1d2090d26 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd" status: 200 len: 1316 microversion: 2.1 time: 0.261130 Sep 16 12:49:59.132288 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 563/1176] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:58 2022] GET /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd => generated 1316 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:59.132288 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1e54fa51-8fe8-4993-a6b8-9636b20639af tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:59.132288 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-1e54fa51-8fe8-4993-a6b8-9636b20639af tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:59.146265 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1e54fa51-8fe8-4993-a6b8-9636b20639af tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:59.146980 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1e54fa51-8fe8-4993-a6b8-9636b20639af tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:59.147602 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1e54fa51-8fe8-4993-a6b8-9636b20639af tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:59.148474 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1e54fa51-8fe8-4993-a6b8-9636b20639af tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:59.149520 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1e54fa51-8fe8-4993-a6b8-9636b20639af tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:59.150107 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1e54fa51-8fe8-4993-a6b8-9636b20639af tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:59.188334 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-79d842bc-52a7-495c-a5bc-54e8d2afb215 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "DELETE /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf" status: 204 len: 0 microversion: 2.1 time: 0.285360 Sep 16 12:49:59.193240 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 614/1177] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:49:58 2022] DELETE /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:49:59.208697 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8a4691ff-72a9-4d08-8f2e-ad812d71a76d tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:59.209772 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8a4691ff-72a9-4d08-8f2e-ad812d71a76d tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 38d079dd-9676-45f7-b286-16aa78d487bf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:59.217254 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a4691ff-72a9-4d08-8f2e-ad812d71a76d tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:59.218200 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a4691ff-72a9-4d08-8f2e-ad812d71a76d tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:59.218827 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a4691ff-72a9-4d08-8f2e-ad812d71a76d tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:59.219821 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a4691ff-72a9-4d08-8f2e-ad812d71a76d tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:59.220483 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a4691ff-72a9-4d08-8f2e-ad812d71a76d tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:59.221070 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a4691ff-72a9-4d08-8f2e-ad812d71a76d tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:59.235170 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1e54fa51-8fe8-4993-a6b8-9636b20639af tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:59.249447 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1e54fa51-8fe8-4993-a6b8-9636b20639af tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:59.258400 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1e54fa51-8fe8-4993-a6b8-9636b20639af tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:59.265160 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1e54fa51-8fe8-4993-a6b8-9636b20639af tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1560 microversion: 2.91 time: 0.142544 Sep 16 12:49:59.276219 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 564/1178] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:49:59 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1560 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:49:59.302211 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-65da5037-2908-4c48-b6f2-5e4dec56c3c9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:59.303376 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-65da5037-2908-4c48-b6f2-5e4dec56c3c9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:59.313176 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-65da5037-2908-4c48-b6f2-5e4dec56c3c9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:59.313683 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-65da5037-2908-4c48-b6f2-5e4dec56c3c9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:59.314129 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-65da5037-2908-4c48-b6f2-5e4dec56c3c9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:59.314907 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-65da5037-2908-4c48-b6f2-5e4dec56c3c9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:59.315381 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-65da5037-2908-4c48-b6f2-5e4dec56c3c9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:59.315844 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-65da5037-2908-4c48-b6f2-5e4dec56c3c9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:59.780699 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8a4691ff-72a9-4d08-8f2e-ad812d71a76d tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709f71c239ca40b8b958038c9ab16f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7058e9e184834c39a5a299f481a6e62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:59.797324 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8a4691ff-72a9-4d08-8f2e-ad812d71a76d tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "GET /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf" status: 200 len: 1714 microversion: 2.1 time: 0.592005 Sep 16 12:49:59.813254 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 615/1179] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:59 2022] GET /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf => generated 1714 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:49:59.822696 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-65da5037-2908-4c48-b6f2-5e4dec56c3c9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:49:59.827875 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-72839534-1477-4b6c-8d2a-a9f8db42416b tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:59.828802 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-72839534-1477-4b6c-8d2a-a9f8db42416b tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] [instance: 8983b634-6da4-4830-b0f1-5835cc55083e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:49:59.833638 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-65da5037-2908-4c48-b6f2-5e4dec56c3c9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1378 microversion: 2.1 time: 0.538358 Sep 16 12:49:59.849609 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72839534-1477-4b6c-8d2a-a9f8db42416b tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:59.849609 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72839534-1477-4b6c-8d2a-a9f8db42416b tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:59.849609 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72839534-1477-4b6c-8d2a-a9f8db42416b tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:59.849609 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72839534-1477-4b6c-8d2a-a9f8db42416b tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:49:59.850094 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72839534-1477-4b6c-8d2a-a9f8db42416b tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:49:59.850094 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72839534-1477-4b6c-8d2a-a9f8db42416b tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:49:59.851323 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 565/1180] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:59 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1378 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:49:59.856934 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f6322c95-a61b-492f-955f-29aca3dfa2e8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f103542bb80>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:49:59.918674 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f6322c95-a61b-492f-955f-29aca3dfa2e8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4" status: 200 len: 1412 microversion: 2.1 time: 0.065950 Sep 16 12:49:59.933729 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 566/1181] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:49:59 2022] GET /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4 => generated 1412 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:00.030228 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-72839534-1477-4b6c-8d2a-a9f8db42416b tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd06a287a6b48f5a8a5ac30c0159fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3e2fe65ad744a2ba3b757f42f1d07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:00.046593 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-72839534-1477-4b6c-8d2a-a9f8db42416b tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] 10.222.0.67 "GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e" status: 200 len: 1701 microversion: 2.1 time: 0.224149 Sep 16 12:50:00.055928 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 616/1182] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:49:59 2022] GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e => generated 1701 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:00.147203 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-54f04dc7-9883-4a61-8e3c-afc3ebd454d6 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:00.148397 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-54f04dc7-9883-4a61-8e3c-afc3ebd454d6 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 96ff60ae-143a-4ae5-9c18-aff09a5c80cd] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:00.161876 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-54f04dc7-9883-4a61-8e3c-afc3ebd454d6 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:00.162460 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-54f04dc7-9883-4a61-8e3c-afc3ebd454d6 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:00.162965 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-54f04dc7-9883-4a61-8e3c-afc3ebd454d6 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:00.163765 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-54f04dc7-9883-4a61-8e3c-afc3ebd454d6 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:00.164338 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-54f04dc7-9883-4a61-8e3c-afc3ebd454d6 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:00.164853 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-54f04dc7-9883-4a61-8e3c-afc3ebd454d6 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:00.298413 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c230b762-0b8f-4320-8403-c6b349e677e9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:00.299422 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c230b762-0b8f-4320-8403-c6b349e677e9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:00.309758 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c230b762-0b8f-4320-8403-c6b349e677e9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:00.310590 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c230b762-0b8f-4320-8403-c6b349e677e9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:00.311342 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c230b762-0b8f-4320-8403-c6b349e677e9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:00.313447 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c230b762-0b8f-4320-8403-c6b349e677e9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:00.314161 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c230b762-0b8f-4320-8403-c6b349e677e9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:00.314844 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c230b762-0b8f-4320-8403-c6b349e677e9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:00.413648 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c230b762-0b8f-4320-8403-c6b349e677e9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:00.419334 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-54f04dc7-9883-4a61-8e3c-afc3ebd454d6 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:00.424331 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c230b762-0b8f-4320-8403-c6b349e677e9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:00.427167 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c230b762-0b8f-4320-8403-c6b349e677e9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:00.430731 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-54f04dc7-9883-4a61-8e3c-afc3ebd454d6 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd" status: 200 len: 1316 microversion: 2.1 time: 0.288069 Sep 16 12:50:00.444240 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c230b762-0b8f-4320-8403-c6b349e677e9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1560 microversion: 2.91 time: 0.140485 Sep 16 12:50:00.444240 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 617/1183] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:50:00 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1560 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:50:00.445838 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 567/1184] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:00 2022] GET /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd => generated 1316 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:00.831550 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-067c44b2-c19a-4169-9492-8f8ac8ce37bd tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:00.832839 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-067c44b2-c19a-4169-9492-8f8ac8ce37bd tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 38d079dd-9676-45f7-b286-16aa78d487bf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:00.842484 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-067c44b2-c19a-4169-9492-8f8ac8ce37bd tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:00.843137 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-067c44b2-c19a-4169-9492-8f8ac8ce37bd tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:00.843677 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-067c44b2-c19a-4169-9492-8f8ac8ce37bd tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:00.844688 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-067c44b2-c19a-4169-9492-8f8ac8ce37bd tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:00.845460 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-067c44b2-c19a-4169-9492-8f8ac8ce37bd tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:00.846109 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-067c44b2-c19a-4169-9492-8f8ac8ce37bd tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:00.866168 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:50:00.868230 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1a7ecf8a-d6de-4e6d-a2b0-ad73d8edf1e2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:00.869405 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-1a7ecf8a-d6de-4e6d-a2b0-ad73d8edf1e2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:00.879590 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1a7ecf8a-d6de-4e6d-a2b0-ad73d8edf1e2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:00.880572 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1a7ecf8a-d6de-4e6d-a2b0-ad73d8edf1e2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:00.881196 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1a7ecf8a-d6de-4e6d-a2b0-ad73d8edf1e2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:00.882084 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1a7ecf8a-d6de-4e6d-a2b0-ad73d8edf1e2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:00.882691 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1a7ecf8a-d6de-4e6d-a2b0-ad73d8edf1e2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:00.883549 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1a7ecf8a-d6de-4e6d-a2b0-ad73d8edf1e2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:01.125694 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-067c44b2-c19a-4169-9492-8f8ac8ce37bd tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709f71c239ca40b8b958038c9ab16f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7058e9e184834c39a5a299f481a6e62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:01.129352 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1a7ecf8a-d6de-4e6d-a2b0-ad73d8edf1e2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:01.148303 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1a7ecf8a-d6de-4e6d-a2b0-ad73d8edf1e2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1378 microversion: 2.1 time: 0.286461 Sep 16 12:50:01.149401 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 568/1185] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:00 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1378 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:50:01.151893 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-067c44b2-c19a-4169-9492-8f8ac8ce37bd tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "GET /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf" status: 200 len: 1714 microversion: 2.1 time: 0.322420 Sep 16 12:50:01.153137 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 618/1186] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:00 2022] GET /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf => generated 1714 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:01.168802 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a8fbbbf1-4b93-48b4-9a5c-236a132ec943 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f10354690d0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:01.171849 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-630f7b05-b938-46b2-b93b-3f615b00fe5a tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:01.174658 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-630f7b05-b938-46b2-b93b-3f615b00fe5a tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] [instance: 8983b634-6da4-4830-b0f1-5835cc55083e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:01.185234 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:50:01.189982 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-630f7b05-b938-46b2-b93b-3f615b00fe5a tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:01.190540 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-630f7b05-b938-46b2-b93b-3f615b00fe5a tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:01.191062 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-630f7b05-b938-46b2-b93b-3f615b00fe5a tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:01.191886 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-630f7b05-b938-46b2-b93b-3f615b00fe5a tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:01.192460 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-630f7b05-b938-46b2-b93b-3f615b00fe5a tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:01.193196 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-630f7b05-b938-46b2-b93b-3f615b00fe5a tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:01.361431 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a8fbbbf1-4b93-48b4-9a5c-236a132ec943 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4" status: 200 len: 1412 microversion: 2.1 time: 0.205147 Sep 16 12:50:01.368346 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 569/1187] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:50:01 2022] GET /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4 => generated 1412 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:01.455355 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-40927384-6f15-48fb-8864-0004a29563df tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:01.456141 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-40927384-6f15-48fb-8864-0004a29563df tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 96ff60ae-143a-4ae5-9c18-aff09a5c80cd] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:01.473864 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-40927384-6f15-48fb-8864-0004a29563df tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:01.474374 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-40927384-6f15-48fb-8864-0004a29563df tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:01.474818 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-40927384-6f15-48fb-8864-0004a29563df tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:01.475541 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-40927384-6f15-48fb-8864-0004a29563df tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:01.476094 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-40927384-6f15-48fb-8864-0004a29563df tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:01.476547 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-40927384-6f15-48fb-8864-0004a29563df tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:01.588001 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-630f7b05-b938-46b2-b93b-3f615b00fe5a tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd06a287a6b48f5a8a5ac30c0159fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3e2fe65ad744a2ba3b757f42f1d07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:01.597031 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-630f7b05-b938-46b2-b93b-3f615b00fe5a tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] 10.222.0.67 "GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e" status: 200 len: 1701 microversion: 2.1 time: 0.441874 Sep 16 12:50:01.600000 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 619/1188] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:01 2022] GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e => generated 1701 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:01.604987 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9f47b37c-975a-4681-aa0b-835b65c77da2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:01.606762 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9f47b37c-975a-4681-aa0b-835b65c77da2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:01.625018 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f47b37c-975a-4681-aa0b-835b65c77da2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:01.625554 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f47b37c-975a-4681-aa0b-835b65c77da2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:01.625938 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f47b37c-975a-4681-aa0b-835b65c77da2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:01.632245 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f47b37c-975a-4681-aa0b-835b65c77da2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:01.632749 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f47b37c-975a-4681-aa0b-835b65c77da2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:01.633329 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f47b37c-975a-4681-aa0b-835b65c77da2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:01.786422 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9f47b37c-975a-4681-aa0b-835b65c77da2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:01.800835 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9f47b37c-975a-4681-aa0b-835b65c77da2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:01.802644 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9f47b37c-975a-4681-aa0b-835b65c77da2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:01.813774 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9f47b37c-975a-4681-aa0b-835b65c77da2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1555 microversion: 2.91 time: 0.212406 Sep 16 12:50:01.842822 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 620/1189] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:50:01 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1555 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:50:01.900501 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-40927384-6f15-48fb-8864-0004a29563df tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:01.910286 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-40927384-6f15-48fb-8864-0004a29563df tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd" status: 200 len: 1316 microversion: 2.1 time: 0.459395 Sep 16 12:50:01.911921 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 570/1190] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:01 2022] GET /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd => generated 1316 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:02.174163 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7162f45f-6579-4058-ac0f-d027d2e245fb tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:02.174777 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7162f45f-6579-4058-ac0f-d027d2e245fb tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:02.184411 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a6c466a8-af00-41b0-afc1-42a8714d65d4 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:02.184964 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a6c466a8-af00-41b0-afc1-42a8714d65d4 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 38d079dd-9676-45f7-b286-16aa78d487bf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:02.189977 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7162f45f-6579-4058-ac0f-d027d2e245fb tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:02.190482 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7162f45f-6579-4058-ac0f-d027d2e245fb tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:02.191014 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7162f45f-6579-4058-ac0f-d027d2e245fb tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:02.191776 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7162f45f-6579-4058-ac0f-d027d2e245fb tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:02.192232 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7162f45f-6579-4058-ac0f-d027d2e245fb tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:02.192520 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a6c466a8-af00-41b0-afc1-42a8714d65d4 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:02.192697 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7162f45f-6579-4058-ac0f-d027d2e245fb tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:02.193018 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a6c466a8-af00-41b0-afc1-42a8714d65d4 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:02.193826 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a6c466a8-af00-41b0-afc1-42a8714d65d4 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:02.194553 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a6c466a8-af00-41b0-afc1-42a8714d65d4 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:02.195009 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a6c466a8-af00-41b0-afc1-42a8714d65d4 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:02.195438 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a6c466a8-af00-41b0-afc1-42a8714d65d4 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:02.497432 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7162f45f-6579-4058-ac0f-d027d2e245fb tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:02.506634 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7162f45f-6579-4058-ac0f-d027d2e245fb tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1378 microversion: 2.1 time: 0.336480 Sep 16 12:50:02.509227 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 621/1191] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:02 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1378 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:02.518962 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bb55a8f3-aa61-4c2e-b2dd-2ae21e7b2ece tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f1035713940>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:02.520792 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a6c466a8-af00-41b0-afc1-42a8714d65d4 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709f71c239ca40b8b958038c9ab16f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7058e9e184834c39a5a299f481a6e62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:02.547323 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a6c466a8-af00-41b0-afc1-42a8714d65d4 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "GET /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf" status: 200 len: 1714 microversion: 2.1 time: 0.368057 Sep 16 12:50:02.552958 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 571/1192] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:02 2022] GET /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf => generated 1714 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:02.624690 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-057d4057-b9b7-451c-b798-f7a2d93d280c tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:02.625325 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-057d4057-b9b7-451c-b798-f7a2d93d280c tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] [instance: 8983b634-6da4-4830-b0f1-5835cc55083e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:02.633937 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-057d4057-b9b7-451c-b798-f7a2d93d280c tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:02.634608 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-057d4057-b9b7-451c-b798-f7a2d93d280c tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:02.635290 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-057d4057-b9b7-451c-b798-f7a2d93d280c tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:02.636890 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-057d4057-b9b7-451c-b798-f7a2d93d280c tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:02.637617 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-057d4057-b9b7-451c-b798-f7a2d93d280c tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:02.638251 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-057d4057-b9b7-451c-b798-f7a2d93d280c tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:02.671911 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bb55a8f3-aa61-4c2e-b2dd-2ae21e7b2ece tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4" status: 200 len: 1421 microversion: 2.1 time: 0.161393 Sep 16 12:50:02.683014 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 622/1193] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:50:02 2022] GET /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4 => generated 1421 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:02.691395 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9057987a-8660-4b85-8d8b-59bd9afae0bd tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f10357c34c0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:02.763673 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9057987a-8660-4b85-8d8b-59bd9afae0bd tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4" status: 200 len: 1421 microversion: 2.1 time: 0.079386 Sep 16 12:50:02.764744 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 623/1194] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:50:02 2022] GET /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4 => generated 1421 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:02.780270 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c1d51687-046f-4a41-8824-08277697a8de tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f10356ef670>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:02.896309 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-057d4057-b9b7-451c-b798-f7a2d93d280c tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd06a287a6b48f5a8a5ac30c0159fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3e2fe65ad744a2ba3b757f42f1d07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:02.908501 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-057d4057-b9b7-451c-b798-f7a2d93d280c tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] 10.222.0.67 "GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e" status: 200 len: 1701 microversion: 2.1 time: 0.287784 Sep 16 12:50:02.917871 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 572/1195] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:02 2022] GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e => generated 1701 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:02.947220 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-140e8b44-db9a-47fb-98f6-7aa67d78a67b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:02.947750 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-140e8b44-db9a-47fb-98f6-7aa67d78a67b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:02.962845 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-140e8b44-db9a-47fb-98f6-7aa67d78a67b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:02.963350 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-140e8b44-db9a-47fb-98f6-7aa67d78a67b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:02.963785 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-140e8b44-db9a-47fb-98f6-7aa67d78a67b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:02.965264 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-140e8b44-db9a-47fb-98f6-7aa67d78a67b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:02.965915 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-140e8b44-db9a-47fb-98f6-7aa67d78a67b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:02.966512 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-140e8b44-db9a-47fb-98f6-7aa67d78a67b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:03.071572 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-140e8b44-db9a-47fb-98f6-7aa67d78a67b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:03.091807 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-140e8b44-db9a-47fb-98f6-7aa67d78a67b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:03.094881 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-140e8b44-db9a-47fb-98f6-7aa67d78a67b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:03.103008 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-140e8b44-db9a-47fb-98f6-7aa67d78a67b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1555 microversion: 2.91 time: 0.181253 Sep 16 12:50:03.103997 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 573/1196] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:50:02 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1555 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:50:03.110411 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1b475424-0927-4404-addf-cfcb605e9350 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:03.113433 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-1b475424-0927-4404-addf-cfcb605e9350 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 96ff60ae-143a-4ae5-9c18-aff09a5c80cd] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:03.126066 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1b475424-0927-4404-addf-cfcb605e9350 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:03.126936 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1b475424-0927-4404-addf-cfcb605e9350 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:03.127519 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1b475424-0927-4404-addf-cfcb605e9350 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:03.129805 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1b475424-0927-4404-addf-cfcb605e9350 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:03.130865 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1b475424-0927-4404-addf-cfcb605e9350 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:03.131522 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1b475424-0927-4404-addf-cfcb605e9350 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:03.400744 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1b475424-0927-4404-addf-cfcb605e9350 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:03.414327 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1b475424-0927-4404-addf-cfcb605e9350 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd" status: 200 len: 1316 microversion: 2.1 time: 0.308331 Sep 16 12:50:03.415069 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 574/1197] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:03 2022] GET /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd => generated 1316 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:03.420081 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-27b8036e-7bf6-4670-931e-5f7747733451 req-bd1b87c3-da73-47dc-b922-0316945ecb5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96ff60ae-143a-4ae5-9c18-aff09a5c80cd", "name": "network-vif-plugged", "status": "completed", "tag": "86268f4b-8663-42c1-8d76-59058c635845"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:50:03.438219 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-27b8036e-7bf6-4670-931e-5f7747733451 req-bd1b87c3-da73-47dc-b922-0316945ecb5b service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:03.438737 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-27b8036e-7bf6-4670-931e-5f7747733451 req-bd1b87c3-da73-47dc-b922-0316945ecb5b service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:03.439184 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-27b8036e-7bf6-4670-931e-5f7747733451 req-bd1b87c3-da73-47dc-b922-0316945ecb5b service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:03.467607 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-27b8036e-7bf6-4670-931e-5f7747733451 req-bd1b87c3-da73-47dc-b922-0316945ecb5b service nova] Creating event network-vif-plugged:86268f4b-8663-42c1-8d76-59058c635845 for instance 96ff60ae-143a-4ae5-9c18-aff09a5c80cd on n-h1-858094-4 Sep 16 12:50:03.478575 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-27b8036e-7bf6-4670-931e-5f7747733451 req-bd1b87c3-da73-47dc-b922-0316945ecb5b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057915 Sep 16 12:50:03.483268 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 575/1198] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:50:03.561435 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e050d66c-bb74-4275-9683-4dc59532bfbc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:03.566517 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e050d66c-bb74-4275-9683-4dc59532bfbc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:03.590485 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e050d66c-bb74-4275-9683-4dc59532bfbc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:03.591324 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e050d66c-bb74-4275-9683-4dc59532bfbc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:03.592227 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e050d66c-bb74-4275-9683-4dc59532bfbc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:03.594529 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e050d66c-bb74-4275-9683-4dc59532bfbc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:03.595308 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e050d66c-bb74-4275-9683-4dc59532bfbc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:03.595912 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e050d66c-bb74-4275-9683-4dc59532bfbc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:03.730376 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c1d51687-046f-4a41-8824-08277697a8de tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "DELETE /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4" status: 204 len: 0 microversion: 2.1 time: 0.953943 Sep 16 12:50:03.734161 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 624/1199] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:02 2022] DELETE /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4 => generated 0 bytes in 955 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:50:03.739981 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5a240c61-df37-4c29-b6ba-01313aef7fb6 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:03.740661 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5a240c61-df37-4c29-b6ba-01313aef7fb6 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 38d079dd-9676-45f7-b286-16aa78d487bf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:03.752495 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a240c61-df37-4c29-b6ba-01313aef7fb6 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:03.752805 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a240c61-df37-4c29-b6ba-01313aef7fb6 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:03.753919 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a240c61-df37-4c29-b6ba-01313aef7fb6 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:03.758016 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a240c61-df37-4c29-b6ba-01313aef7fb6 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:03.758633 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a240c61-df37-4c29-b6ba-01313aef7fb6 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:03.759180 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a240c61-df37-4c29-b6ba-01313aef7fb6 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:03.996896 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e050d66c-bb74-4275-9683-4dc59532bfbc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:04.006722 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e050d66c-bb74-4275-9683-4dc59532bfbc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1378 microversion: 2.1 time: 0.463532 Sep 16 12:50:04.012352 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 576/1200] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:03 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1378 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:04.017426 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d2b88649-7fbd-4ac9-9af1-bffcfcd83d38 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:04.021649 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d2b88649-7fbd-4ac9-9af1-bffcfcd83d38 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:04.033822 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d2b88649-7fbd-4ac9-9af1-bffcfcd83d38 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:04.034040 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d2b88649-7fbd-4ac9-9af1-bffcfcd83d38 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:04.035028 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d2b88649-7fbd-4ac9-9af1-bffcfcd83d38 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:04.035726 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d2b88649-7fbd-4ac9-9af1-bffcfcd83d38 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:04.036196 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d2b88649-7fbd-4ac9-9af1-bffcfcd83d38 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:04.040259 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d2b88649-7fbd-4ac9-9af1-bffcfcd83d38 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:04.054234 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5a240c61-df37-4c29-b6ba-01313aef7fb6 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709f71c239ca40b8b958038c9ab16f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7058e9e184834c39a5a299f481a6e62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:04.065908 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5a240c61-df37-4c29-b6ba-01313aef7fb6 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "GET /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf" status: 200 len: 1714 microversion: 2.1 time: 0.330321 Sep 16 12:50:04.078127 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 625/1201] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:03 2022] GET /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf => generated 1714 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:04.084996 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5e9d3b49-e876-41e3-82a5-b55718ad8088 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:04.093329 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5e9d3b49-e876-41e3-82a5-b55718ad8088 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] [instance: 8983b634-6da4-4830-b0f1-5835cc55083e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:04.102544 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e9d3b49-e876-41e3-82a5-b55718ad8088 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:04.104054 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e9d3b49-e876-41e3-82a5-b55718ad8088 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:04.104728 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e9d3b49-e876-41e3-82a5-b55718ad8088 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:04.107553 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d2b88649-7fbd-4ac9-9af1-bffcfcd83d38 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:50:04.108593 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e9d3b49-e876-41e3-82a5-b55718ad8088 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:04.109192 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e9d3b49-e876-41e3-82a5-b55718ad8088 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:04.109642 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e9d3b49-e876-41e3-82a5-b55718ad8088 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:04.111906 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:50:04.150096 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:50:04.186179 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=10 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:50:04.220556 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5e9d3b49-e876-41e3-82a5-b55718ad8088 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd06a287a6b48f5a8a5ac30c0159fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3e2fe65ad744a2ba3b757f42f1d07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:04.229942 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5e9d3b49-e876-41e3-82a5-b55718ad8088 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] 10.222.0.67 "GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e" status: 200 len: 1634 microversion: 2.1 time: 0.150459 Sep 16 12:50:04.235100 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 626/1202] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:04 2022] GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e => generated 1634 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:04.241525 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-29ef24af-5da7-4731-a566-d68254cfcd42 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:04.242532 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-29ef24af-5da7-4731-a566-d68254cfcd42 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:04.243643 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d2b88649-7fbd-4ac9-9af1-bffcfcd83d38 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "DELETE /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 204 len: 0 microversion: 2.1 time: 0.229286 Sep 16 12:50:04.248737 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 577/1203] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:50:04 2022] DELETE /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:50:04.278650 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29ef24af-5da7-4731-a566-d68254cfcd42 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:04.279173 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29ef24af-5da7-4731-a566-d68254cfcd42 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:04.279613 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29ef24af-5da7-4731-a566-d68254cfcd42 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:04.281484 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29ef24af-5da7-4731-a566-d68254cfcd42 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:04.281986 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29ef24af-5da7-4731-a566-d68254cfcd42 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:04.282504 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29ef24af-5da7-4731-a566-d68254cfcd42 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:04.406307 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-29ef24af-5da7-4731-a566-d68254cfcd42 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:04.423588 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-29ef24af-5da7-4731-a566-d68254cfcd42 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:04.435851 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-29ef24af-5da7-4731-a566-d68254cfcd42 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:04.450684 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-29ef24af-5da7-4731-a566-d68254cfcd42 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1555 microversion: 2.91 time: 0.212045 Sep 16 12:50:04.451354 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 627/1204] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:50:04 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1555 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:50:04.454004 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8c8f976d-d975-4bc4-a08e-783355c17f92 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:04.455245 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8c8f976d-d975-4bc4-a08e-783355c17f92 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 96ff60ae-143a-4ae5-9c18-aff09a5c80cd] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:04.463526 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8c8f976d-d975-4bc4-a08e-783355c17f92 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:04.464465 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8c8f976d-d975-4bc4-a08e-783355c17f92 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:04.465157 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8c8f976d-d975-4bc4-a08e-783355c17f92 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:04.466797 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8c8f976d-d975-4bc4-a08e-783355c17f92 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:04.468063 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8c8f976d-d975-4bc4-a08e-783355c17f92 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:04.468782 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8c8f976d-d975-4bc4-a08e-783355c17f92 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:04.549653 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0887eb49-9018-4665-b89b-c8d38cddd3e2 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1160482926", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": [{"uuid": "0e610de6-3238-41c3-bd1a-f23917fad801"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:50:04.731861 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-0887eb49-9018-4665-b89b-c8d38cddd3e2 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] validate_networks() for [('0e610de6-3238-41c3-bd1a-f23917fad801', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:50:04.868889 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8c8f976d-d975-4bc4-a08e-783355c17f92 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:04.885413 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8c8f976d-d975-4bc4-a08e-783355c17f92 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd" status: 200 len: 1316 microversion: 2.1 time: 0.449692 Sep 16 12:50:04.886022 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 578/1205] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:04 2022] GET /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd => generated 1316 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:50:04.903964 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-b026d25e-21f6-416d-80d5-e4bb2c665300 req-a096bb2a-1aa7-4f98-adf1-e7b40908fc56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8983b634-6da4-4830-b0f1-5835cc55083e", "name": "network-vif-deleted", "tag": "f5de57d0-58b1-4bb4-be3d-a6d88fd93f21"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:50:04.947889 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-b026d25e-21f6-416d-80d5-e4bb2c665300 req-a096bb2a-1aa7-4f98-adf1-e7b40908fc56 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:04.952255 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-b026d25e-21f6-416d-80d5-e4bb2c665300 req-a096bb2a-1aa7-4f98-adf1-e7b40908fc56 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:04.963466 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-b026d25e-21f6-416d-80d5-e4bb2c665300 req-a096bb2a-1aa7-4f98-adf1-e7b40908fc56 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:04.998839 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-b026d25e-21f6-416d-80d5-e4bb2c665300 req-a096bb2a-1aa7-4f98-adf1-e7b40908fc56 service nova] Creating event network-vif-deleted:f5de57d0-58b1-4bb4-be3d-a6d88fd93f21 for instance 8983b634-6da4-4830-b0f1-5835cc55083e on n-h2-858094-4 Sep 16 12:50:05.007475 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-b026d25e-21f6-416d-80d5-e4bb2c665300 req-a096bb2a-1aa7-4f98-adf1-e7b40908fc56 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115132 Sep 16 12:50:05.008386 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 579/1206] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:50:05.049495 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2b24d412-e0e2-44e0-993f-ae16df17b976 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:05.053306 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-2b24d412-e0e2-44e0-993f-ae16df17b976 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:05.071577 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2b24d412-e0e2-44e0-993f-ae16df17b976 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:05.073978 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2b24d412-e0e2-44e0-993f-ae16df17b976 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:05.076303 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2b24d412-e0e2-44e0-993f-ae16df17b976 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:05.078125 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2b24d412-e0e2-44e0-993f-ae16df17b976 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:05.080611 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2b24d412-e0e2-44e0-993f-ae16df17b976 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:05.082748 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2b24d412-e0e2-44e0-993f-ae16df17b976 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:05.481243 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-2b24d412-e0e2-44e0-993f-ae16df17b976 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:05.490709 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2b24d412-e0e2-44e0-993f-ae16df17b976 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1378 microversion: 2.1 time: 0.448443 Sep 16 12:50:05.493610 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 580/1207] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:05 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1378 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:05.500821 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-aea66f25-fe8d-4137-ad0e-f2da4fd394b5 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:05.501432 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-aea66f25-fe8d-4137-ad0e-f2da4fd394b5 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 38d079dd-9676-45f7-b286-16aa78d487bf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:05.515350 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aea66f25-fe8d-4137-ad0e-f2da4fd394b5 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:05.515855 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aea66f25-fe8d-4137-ad0e-f2da4fd394b5 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:05.516397 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aea66f25-fe8d-4137-ad0e-f2da4fd394b5 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:05.528191 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aea66f25-fe8d-4137-ad0e-f2da4fd394b5 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:05.530156 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aea66f25-fe8d-4137-ad0e-f2da4fd394b5 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:05.534910 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aea66f25-fe8d-4137-ad0e-f2da4fd394b5 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:05.615950 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aea66f25-fe8d-4137-ad0e-f2da4fd394b5 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:05.618816 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aea66f25-fe8d-4137-ad0e-f2da4fd394b5 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:05.619288 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aea66f25-fe8d-4137-ad0e-f2da4fd394b5 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:05.619760 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-aea66f25-fe8d-4137-ad0e-f2da4fd394b5 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lazy-loading 'fault' on Instance uuid 38d079dd-9676-45f7-b286-16aa78d487bf {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:50:05.765844 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-0887eb49-9018-4665-b89b-c8d38cddd3e2 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:50:05.766927 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-0887eb49-9018-4665-b89b-c8d38cddd3e2 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:50:05.767605 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-0887eb49-9018-4665-b89b-c8d38cddd3e2 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:50:05.768222 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-0887eb49-9018-4665-b89b-c8d38cddd3e2 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:50:05.769038 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-0887eb49-9018-4665-b89b-c8d38cddd3e2 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:50:05.793715 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0887eb49-9018-4665-b89b-c8d38cddd3e2 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:05.794502 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0887eb49-9018-4665-b89b-c8d38cddd3e2 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:05.795129 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0887eb49-9018-4665-b89b-c8d38cddd3e2 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:05.796056 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0887eb49-9018-4665-b89b-c8d38cddd3e2 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:05.796717 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0887eb49-9018-4665-b89b-c8d38cddd3e2 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:05.797316 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0887eb49-9018-4665-b89b-c8d38cddd3e2 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:05.841035 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-0887eb49-9018-4665-b89b-c8d38cddd3e2 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Getting quotas for project e6fa2067c44b42b5aa940619abd8e538. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:50:05.841960 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-aea66f25-fe8d-4137-ad0e-f2da4fd394b5 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709f71c239ca40b8b958038c9ab16f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7058e9e184834c39a5a299f481a6e62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:05.848797 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-0887eb49-9018-4665-b89b-c8d38cddd3e2 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Getting quotas for user 0cf11dfc3438406ba2710b06fa0fe8ff and project e6fa2067c44b42b5aa940619abd8e538. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:50:05.854687 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-aea66f25-fe8d-4137-ad0e-f2da4fd394b5 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "GET /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf" status: 200 len: 1355 microversion: 2.1 time: 0.360034 Sep 16 12:50:05.855285 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 581/1208] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:05 2022] GET /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf => generated 1355 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:05.870944 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5e52e6f0-da9a-4a81-9926-d03f2dbb6741 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:05.870944 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5e52e6f0-da9a-4a81-9926-d03f2dbb6741 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] [instance: 8983b634-6da4-4830-b0f1-5835cc55083e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:05.877275 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5e52e6f0-da9a-4a81-9926-d03f2dbb6741 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:05.877528 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5e52e6f0-da9a-4a81-9926-d03f2dbb6741 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:05.877899 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5e52e6f0-da9a-4a81-9926-d03f2dbb6741 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:05.879522 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5e52e6f0-da9a-4a81-9926-d03f2dbb6741 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:05.879965 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5e52e6f0-da9a-4a81-9926-d03f2dbb6741 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:05.880420 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5e52e6f0-da9a-4a81-9926-d03f2dbb6741 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:05.883853 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0887eb49-9018-4665-b89b-c8d38cddd3e2 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:50:05.886529 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0887eb49-9018-4665-b89b-c8d38cddd3e2 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:50:05.942826 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0887eb49-9018-4665-b89b-c8d38cddd3e2 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.397964 Sep 16 12:50:05.951614 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 628/1209] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:50:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1407 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:50:05.958141 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-32c36732-5710-4ea8-9d7a-e0af81944000 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:05.959038 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-32c36732-5710-4ea8-9d7a-e0af81944000 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:05.968670 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32c36732-5710-4ea8-9d7a-e0af81944000 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:05.969441 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32c36732-5710-4ea8-9d7a-e0af81944000 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:05.970491 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32c36732-5710-4ea8-9d7a-e0af81944000 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:05.971683 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32c36732-5710-4ea8-9d7a-e0af81944000 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:05.973188 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32c36732-5710-4ea8-9d7a-e0af81944000 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:05.973831 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32c36732-5710-4ea8-9d7a-e0af81944000 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:05.988514 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5e52e6f0-da9a-4a81-9926-d03f2dbb6741 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:05.989468 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5e52e6f0-da9a-4a81-9926-d03f2dbb6741 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:05.990090 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5e52e6f0-da9a-4a81-9926-d03f2dbb6741 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:05.995672 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-5e52e6f0-da9a-4a81-9926-d03f2dbb6741 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lazy-loading 'fault' on Instance uuid 8983b634-6da4-4830-b0f1-5835cc55083e {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:50:06.128104 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5e52e6f0-da9a-4a81-9926-d03f2dbb6741 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd06a287a6b48f5a8a5ac30c0159fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3e2fe65ad744a2ba3b757f42f1d07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:06.141868 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-32c36732-5710-4ea8-9d7a-e0af81944000 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:06.150810 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5e52e6f0-da9a-4a81-9926-d03f2dbb6741 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] 10.222.0.67 "GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e" status: 200 len: 1360 microversion: 2.1 time: 0.293464 Sep 16 12:50:06.160235 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-32c36732-5710-4ea8-9d7a-e0af81944000 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:06.162047 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-32c36732-5710-4ea8-9d7a-e0af81944000 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:06.167966 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 582/1210] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:05 2022] GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e => generated 1360 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:06.171479 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-32c36732-5710-4ea8-9d7a-e0af81944000 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1555 microversion: 2.91 time: 0.217202 Sep 16 12:50:06.186557 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 629/1211] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:50:05 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1555 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:50:06.199479 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dcda8152-e9c2-4bac-be4f-8e63247d6820 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:06.200448 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dcda8152-e9c2-4bac-be4f-8e63247d6820 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:06.204113 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6025adb7-1c4c-43e5-8cbe-f46a4ae58cd7 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:06.208018 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6025adb7-1c4c-43e5-8cbe-f46a4ae58cd7 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 96ff60ae-143a-4ae5-9c18-aff09a5c80cd] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:06.231760 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6025adb7-1c4c-43e5-8cbe-f46a4ae58cd7 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:06.232892 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6025adb7-1c4c-43e5-8cbe-f46a4ae58cd7 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:06.234305 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6025adb7-1c4c-43e5-8cbe-f46a4ae58cd7 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:06.235380 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6025adb7-1c4c-43e5-8cbe-f46a4ae58cd7 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:06.236090 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6025adb7-1c4c-43e5-8cbe-f46a4ae58cd7 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:06.236768 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6025adb7-1c4c-43e5-8cbe-f46a4ae58cd7 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:06.306978 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dcda8152-e9c2-4bac-be4f-8e63247d6820 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:06.320863 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dcda8152-e9c2-4bac-be4f-8e63247d6820 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac" status: 200 len: 1208 microversion: 2.1 time: 0.131313 Sep 16 12:50:06.338038 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 630/1212] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:06 2022] GET /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac => generated 1208 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:06.515786 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c103a30e-eee0-4b07-b6e6-d0b9c4f00479 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:06.516480 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c103a30e-eee0-4b07-b6e6-d0b9c4f00479 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:06.531619 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c103a30e-eee0-4b07-b6e6-d0b9c4f00479 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:06.537781 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c103a30e-eee0-4b07-b6e6-d0b9c4f00479 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:06.538649 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c103a30e-eee0-4b07-b6e6-d0b9c4f00479 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:06.540734 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c103a30e-eee0-4b07-b6e6-d0b9c4f00479 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:06.541566 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c103a30e-eee0-4b07-b6e6-d0b9c4f00479 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:06.543518 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c103a30e-eee0-4b07-b6e6-d0b9c4f00479 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:06.817183 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=6 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:50:06.879054 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=12 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:50:07.249409 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6025adb7-1c4c-43e5-8cbe-f46a4ae58cd7 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:07.269787 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6025adb7-1c4c-43e5-8cbe-f46a4ae58cd7 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd" status: 200 len: 1316 microversion: 2.1 time: 1.100628 Sep 16 12:50:07.270600 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 583/1213] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:06 2022] GET /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd => generated 1316 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:07.281410 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f45ed1e5-a0e7-4c73-ae25-26810805fce2 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:07.285041 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f45ed1e5-a0e7-4c73-ae25-26810805fce2 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 38d079dd-9676-45f7-b286-16aa78d487bf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:07.295771 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f45ed1e5-a0e7-4c73-ae25-26810805fce2 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:07.301647 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f45ed1e5-a0e7-4c73-ae25-26810805fce2 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:07.303833 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f45ed1e5-a0e7-4c73-ae25-26810805fce2 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:07.308972 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f45ed1e5-a0e7-4c73-ae25-26810805fce2 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:07.309743 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f45ed1e5-a0e7-4c73-ae25-26810805fce2 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:07.310186 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f45ed1e5-a0e7-4c73-ae25-26810805fce2 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:07.340554 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c103a30e-eee0-4b07-b6e6-d0b9c4f00479 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:07.359656 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c103a30e-eee0-4b07-b6e6-d0b9c4f00479 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1378 microversion: 2.1 time: 0.847585 Sep 16 12:50:07.365775 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-f45ed1e5-a0e7-4c73-ae25-26810805fce2 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] HTTP exception thrown: Instance 38d079dd-9676-45f7-b286-16aa78d487bf could not be found. Sep 16 12:50:07.367936 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f45ed1e5-a0e7-4c73-ae25-26810805fce2 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Request method failure captured: Sep 16 12:50:07.367936 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf HTTP/1.1 Sep 16 12:50:07.367936 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:50:07.367936 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:50:07.367936 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:50:07.367936 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:50:07.367936 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:50:07.367936 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:50:07.367936 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:50:07.367936 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:50:07.367936 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHAdXBA3G5MIJPMFvQ22OA7-JW4DF3Vr5Co2BEJlI0HyaRudLGvMywS5ScfQh3FkixqTPupO_dgQu4WAFwnyVbe-3sbrVx3W0bL4qZiuyo38tu1dlWq0MINeqO8NX8crJ3xm6MyJEQN1XJ0GwjhAM_st7IXPxZhd9ayEgqmH-tC7txU Sep 16 12:50:07.367936 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:50:07.367936 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:50:07.367936 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:50:07.367936 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:50:07.367936 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:50:07.367936 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:50:07.367936 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 7058e9e184834c39a5a299f481a6e62e Sep 16 12:50:07.367936 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-985301388 Sep 16 12:50:07.367936 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:50:07.367936 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:50:07.369678 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7058e9e184834c39a5a299f481a6e62e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7058e9e184834c39a5a299f481a6e62e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7058e9e184834c39a5a299f481a6e62e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7058e9e184834c39a5a299f481a6e62e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:50:07.369678 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-985301388 Sep 16 12:50:07.369678 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 7058e9e184834c39a5a299f481a6e62e Sep 16 12:50:07.369678 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-985301388 Sep 16 12:50:07.369678 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ServersWithSpecificFlavorTestJSON-985301388-project Sep 16 12:50:07.369678 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:50:07.369678 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:50:07.369678 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 709f71c239ca40b8b958038c9ab16f37 Sep 16 12:50:07.369678 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-985301388-project Sep 16 12:50:07.369678 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:50:07.369678 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance 38d079dd-9676-45f7-b286-16aa78d487bf could not be found. Sep 16 12:50:07.369678 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '38d079dd-9676-45f7-b286-16aa78d487bf'} Sep 16 12:50:07.370535 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:50:07.370535 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:07.370535 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:50:07.370535 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:50:07.370535 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:50:07.370535 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:50:07.370535 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:50:07.370535 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:50:07.370535 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:50:07.370535 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:50:07.370535 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38d079dd-9676-45f7-b286-16aa78d487bf could not be found. Sep 16 12:50:07.370535 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:07.370535 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:50:07.370535 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:07.370535 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:07.370535 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:50:07.370535 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:50:07.370535 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:50:07.370535 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:50:07.370535 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:50:07.372590 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:50:07.372590 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:50:07.372590 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:50:07.372590 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:50:07.372590 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:50:07.372590 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:50:07.372590 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:50:07.372590 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38d079dd-9676-45f7-b286-16aa78d487bf could not be found. Sep 16 12:50:07.372590 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:07.372590 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:50:07.372590 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:07.372590 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:07.372590 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:50:07.372590 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:50:07.372590 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:50:07.372590 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:50:07.372590 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38d079dd-9676-45f7-b286-16aa78d487bf could not be found. Sep 16 12:50:07.372590 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:07.375084 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f45ed1e5-a0e7-4c73-ae25-26810805fce2 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Returning 404 to user: Instance 38d079dd-9676-45f7-b286-16aa78d487bf could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:50:07.375084 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f45ed1e5-a0e7-4c73-ae25-26810805fce2 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "GET /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf" status: 404 len: 111 microversion: 2.1 time: 0.097948 Sep 16 12:50:07.375421 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 584/1214] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:07 2022] GET /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:50:07.382564 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 631/1215] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:06 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1378 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:50:07.409768 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-de3260f9-17ee-466a-b46a-ff95ced55e4d req-455fd42d-83e9-4090-bd42-acc9ed780a44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38d079dd-9676-45f7-b286-16aa78d487bf", "name": "network-vif-deleted", "tag": "3d903631-a9e4-424f-ad6d-35d838b2d04d"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:50:07.414820 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f29c1b8b-3184-480d-aff0-bf37aacff63e tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:07.420012 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f29c1b8b-3184-480d-aff0-bf37aacff63e tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] [instance: 8983b634-6da4-4830-b0f1-5835cc55083e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:07.453276 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f29c1b8b-3184-480d-aff0-bf37aacff63e tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:07.453763 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-de3260f9-17ee-466a-b46a-ff95ced55e4d req-455fd42d-83e9-4090-bd42-acc9ed780a44 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:07.454099 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f29c1b8b-3184-480d-aff0-bf37aacff63e tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:07.454559 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f29c1b8b-3184-480d-aff0-bf37aacff63e tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:07.454969 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-de3260f9-17ee-466a-b46a-ff95ced55e4d req-455fd42d-83e9-4090-bd42-acc9ed780a44 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:07.455551 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f29c1b8b-3184-480d-aff0-bf37aacff63e tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:07.455946 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-de3260f9-17ee-466a-b46a-ff95ced55e4d req-455fd42d-83e9-4090-bd42-acc9ed780a44 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:07.456169 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f29c1b8b-3184-480d-aff0-bf37aacff63e tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:07.456697 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f29c1b8b-3184-480d-aff0-bf37aacff63e tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:07.472471 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-de3260f9-17ee-466a-b46a-ff95ced55e4d req-455fd42d-83e9-4090-bd42-acc9ed780a44 service nova] Creating event network-vif-deleted:3d903631-a9e4-424f-ad6d-35d838b2d04d for instance 38d079dd-9676-45f7-b286-16aa78d487bf on n-h2-858094-4 Sep 16 12:50:07.478885 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-de3260f9-17ee-466a-b46a-ff95ced55e4d req-455fd42d-83e9-4090-bd42-acc9ed780a44 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101646 Sep 16 12:50:07.482873 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-f29c1b8b-3184-480d-aff0-bf37aacff63e tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] HTTP exception thrown: Instance 8983b634-6da4-4830-b0f1-5835cc55083e could not be found. Sep 16 12:50:07.485347 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 585/1216] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:50:07.485553 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f29c1b8b-3184-480d-aff0-bf37aacff63e tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Request method failure captured: Sep 16 12:50:07.485553 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e HTTP/1.1 Sep 16 12:50:07.485553 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:50:07.485553 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:50:07.485553 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:50:07.485553 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:50:07.485553 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:50:07.485553 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:50:07.485553 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:50:07.485553 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:50:07.485553 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHCkBc5PDCRttQa-b4vZ_yiVR6bIhy8x029VnSQRsZmHtGUE9z4T-lwPj4xjLiEPiG4EKfTHFOVskRJUO7-WFZz5lycWqD3qC_4OjmbMYJFudu2nJoFzkMgPPG4N7OGp0CIxgLupWJIUa34qbUYmN4utAxf-Qt4idJhgkPKgZ7JmYgY Sep 16 12:50:07.485553 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:50:07.485553 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:50:07.485553 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:50:07.485553 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:50:07.485553 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:50:07.485553 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:50:07.485553 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 3e3e2fe65ad744a2ba3b757f42f1d07b Sep 16 12:50:07.485553 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersTestJSON-971196439 Sep 16 12:50:07.485553 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:50:07.485553 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:50:07.487196 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3e3e2fe65ad744a2ba3b757f42f1d07b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3e3e2fe65ad744a2ba3b757f42f1d07b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3e3e2fe65ad744a2ba3b757f42f1d07b", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3e3e2fe65ad744a2ba3b757f42f1d07b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:50:07.487196 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ServersTestJSON-971196439 Sep 16 12:50:07.487196 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 3e3e2fe65ad744a2ba3b757f42f1d07b Sep 16 12:50:07.487196 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersTestJSON-971196439 Sep 16 12:50:07.487196 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ServersTestJSON-971196439-project Sep 16 12:50:07.487196 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:50:07.487196 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:50:07.487196 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 3cd06a287a6b48f5a8a5ac30c0159fd9 Sep 16 12:50:07.487196 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ServersTestJSON-971196439-project Sep 16 12:50:07.487196 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:50:07.487196 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 8983b634-6da4-4830-b0f1-5835cc55083e could not be found. Sep 16 12:50:07.487196 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '8983b634-6da4-4830-b0f1-5835cc55083e'} Sep 16 12:50:07.488724 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:50:07.488724 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:07.488724 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:50:07.488724 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:50:07.488724 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:50:07.488724 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:50:07.488724 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:50:07.488724 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:50:07.488724 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:50:07.488724 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:50:07.488724 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8983b634-6da4-4830-b0f1-5835cc55083e could not be found. Sep 16 12:50:07.488724 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:50:07.488724 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:50:07.488724 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:50:07.488724 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:07.488724 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:50:07.488724 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:50:07.488724 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:50:07.488724 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:50:07.488724 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:50:07.493549 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:50:07.493549 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:50:07.493549 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:50:07.493549 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:50:07.493549 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:50:07.493549 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:50:07.493549 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:50:07.493549 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8983b634-6da4-4830-b0f1-5835cc55083e could not be found. Sep 16 12:50:07.493549 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:50:07.493549 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:50:07.493549 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:50:07.493549 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:07.493549 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:50:07.493549 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:50:07.493549 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:50:07.493549 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:50:07.493549 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8983b634-6da4-4830-b0f1-5835cc55083e could not be found. Sep 16 12:50:07.493549 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:50:07.494757 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f29c1b8b-3184-480d-aff0-bf37aacff63e tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Returning 404 to user: Instance 8983b634-6da4-4830-b0f1-5835cc55083e could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:50:07.494757 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f29c1b8b-3184-480d-aff0-bf37aacff63e tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] 10.222.0.67 "GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e" status: 404 len: 111 microversion: 2.1 time: 0.088192 Sep 16 12:50:07.494757 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 632/1217] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:07 2022] GET /compute/v2.1/servers/8983b634-6da4-4830-b0f1-5835cc55083e => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:50:07.502748 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7c5f4e89-690c-4bdf-958b-852058ee1d50 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:07.504701 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7c5f4e89-690c-4bdf-958b-852058ee1d50 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:07.504898 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4dfa238d-5b80-4d48-bddd-8a8dee44369f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:07.505863 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4dfa238d-5b80-4d48-bddd-8a8dee44369f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:07.513925 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7c5f4e89-690c-4bdf-958b-852058ee1d50 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:07.514723 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7c5f4e89-690c-4bdf-958b-852058ee1d50 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:07.516677 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7c5f4e89-690c-4bdf-958b-852058ee1d50 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:07.517632 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4dfa238d-5b80-4d48-bddd-8a8dee44369f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:07.517862 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7c5f4e89-690c-4bdf-958b-852058ee1d50 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:07.518136 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4dfa238d-5b80-4d48-bddd-8a8dee44369f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:07.518672 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4dfa238d-5b80-4d48-bddd-8a8dee44369f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:07.519080 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7c5f4e89-690c-4bdf-958b-852058ee1d50 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:07.519690 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7c5f4e89-690c-4bdf-958b-852058ee1d50 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:07.523319 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4dfa238d-5b80-4d48-bddd-8a8dee44369f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:07.526401 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4dfa238d-5b80-4d48-bddd-8a8dee44369f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:07.527732 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4dfa238d-5b80-4d48-bddd-8a8dee44369f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:07.715818 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4dfa238d-5b80-4d48-bddd-8a8dee44369f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:07.727375 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4dfa238d-5b80-4d48-bddd-8a8dee44369f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac" status: 200 len: 1204 microversion: 2.1 time: 0.233877 Sep 16 12:50:07.734060 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 633/1218] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:07 2022] GET /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac => generated 1204 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:07.739604 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e948cc6f-5a1d-4b48-9df1-079b06ac8815 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:07.740102 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e948cc6f-5a1d-4b48-9df1-079b06ac8815 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 07365fde-3701-46a6-aba7-4c6f74e181b9] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:07.766166 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7c5f4e89-690c-4bdf-958b-852058ee1d50 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:07.767653 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e948cc6f-5a1d-4b48-9df1-079b06ac8815 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:07.768396 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e948cc6f-5a1d-4b48-9df1-079b06ac8815 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:07.769195 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e948cc6f-5a1d-4b48-9df1-079b06ac8815 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:07.771130 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e948cc6f-5a1d-4b48-9df1-079b06ac8815 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:07.771708 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e948cc6f-5a1d-4b48-9df1-079b06ac8815 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:07.774953 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e948cc6f-5a1d-4b48-9df1-079b06ac8815 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:07.779428 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7c5f4e89-690c-4bdf-958b-852058ee1d50 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:07.784635 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7c5f4e89-690c-4bdf-958b-852058ee1d50 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:07.795655 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7c5f4e89-690c-4bdf-958b-852058ee1d50 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1555 microversion: 2.91 time: 0.297904 Sep 16 12:50:07.798884 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-e948cc6f-5a1d-4b48-9df1-079b06ac8815 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] HTTP exception thrown: Instance 07365fde-3701-46a6-aba7-4c6f74e181b9 could not be found. Sep 16 12:50:07.801767 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 586/1219] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:50:07 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1555 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:50:07.802496 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e948cc6f-5a1d-4b48-9df1-079b06ac8815 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Request method failure captured: Sep 16 12:50:07.802496 n-d-858094-4 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9 HTTP/1.1 Sep 16 12:50:07.802496 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:50:07.802496 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:50:07.802496 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:50:07.802496 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:50:07.802496 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:50:07.802496 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:50:07.802496 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:50:07.802496 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:50:07.802496 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHAdXBA3G5MIJPMFvQ22OA7-JW4DF3Vr5Co2BEJlI0HyaRudLGvMywS5ScfQh3FkixqTPupO_dgQu4WAFwnyVbe-3sbrVx3W0bL4qZiuyo38tu1dlWq0MINeqO8NX8crJ3xm6MyJEQN1XJ0GwjhAM_st7IXPxZhd9ayEgqmH-tC7txU Sep 16 12:50:07.802496 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:50:07.802496 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:50:07.802496 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:50:07.802496 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:50:07.802496 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:50:07.802496 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:50:07.802496 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 7058e9e184834c39a5a299f481a6e62e Sep 16 12:50:07.802496 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-985301388 Sep 16 12:50:07.802496 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:50:07.802496 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:50:07.803809 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7058e9e184834c39a5a299f481a6e62e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7058e9e184834c39a5a299f481a6e62e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7058e9e184834c39a5a299f481a6e62e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7058e9e184834c39a5a299f481a6e62e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:50:07.803809 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-985301388 Sep 16 12:50:07.803809 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 7058e9e184834c39a5a299f481a6e62e Sep 16 12:50:07.803809 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-985301388 Sep 16 12:50:07.803809 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ServersWithSpecificFlavorTestJSON-985301388-project Sep 16 12:50:07.803809 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:50:07.803809 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:50:07.803809 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 709f71c239ca40b8b958038c9ab16f37 Sep 16 12:50:07.803809 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-985301388-project Sep 16 12:50:07.803809 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:50:07.803809 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 07365fde-3701-46a6-aba7-4c6f74e181b9 could not be found. Sep 16 12:50:07.803809 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '07365fde-3701-46a6-aba7-4c6f74e181b9'} Sep 16 12:50:07.804605 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:50:07.804605 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:07.804605 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:50:07.804605 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:50:07.804605 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:50:07.804605 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:50:07.804605 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:50:07.804605 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:50:07.804605 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:50:07.804605 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:50:07.804605 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07365fde-3701-46a6-aba7-4c6f74e181b9 could not be found. Sep 16 12:50:07.804605 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:50:07.804605 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:50:07.804605 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:50:07.804605 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:07.804605 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:50:07.804605 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:50:07.804605 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:50:07.804605 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:50:07.804605 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:50:07.805788 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:50:07.805788 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 12:50:07.805788 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 12:50:07.805788 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 12:50:07.805788 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 12:50:07.805788 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:50:07.805788 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:50:07.805788 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:50:07.805788 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:50:07.805788 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07365fde-3701-46a6-aba7-4c6f74e181b9 could not be found. Sep 16 12:50:07.805788 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:50:07.805788 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:50:07.805788 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:50:07.805788 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:07.805788 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:50:07.805788 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:50:07.805788 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:50:07.805788 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:50:07.805788 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07365fde-3701-46a6-aba7-4c6f74e181b9 could not be found. Sep 16 12:50:07.805788 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:50:07.808553 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-24c19b9d-c474-40ba-9f08-f2417da38704 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] Calling method '.version_select at 0x7f10358b1310>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:07.809814 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e948cc6f-5a1d-4b48-9df1-079b06ac8815 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Returning 404 to user: Instance 07365fde-3701-46a6-aba7-4c6f74e181b9 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:50:07.810760 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e948cc6f-5a1d-4b48-9df1-079b06ac8815 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "DELETE /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9" status: 404 len: 111 microversion: 2.1 time: 0.075732 Sep 16 12:50:07.811708 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 634/1220] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:50:07 2022] DELETE /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:50:07.823196 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-addca907-3306-46a4-b7c5-2928dc1106ad tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:07.846058 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-addca907-3306-46a4-b7c5-2928dc1106ad tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 07365fde-3701-46a6-aba7-4c6f74e181b9] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:07.858146 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-addca907-3306-46a4-b7c5-2928dc1106ad tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:07.860693 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-addca907-3306-46a4-b7c5-2928dc1106ad tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:07.861654 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-addca907-3306-46a4-b7c5-2928dc1106ad tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:07.865334 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-addca907-3306-46a4-b7c5-2928dc1106ad tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:07.867671 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-addca907-3306-46a4-b7c5-2928dc1106ad tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:07.868639 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-addca907-3306-46a4-b7c5-2928dc1106ad tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:07.884419 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-24c19b9d-c474-40ba-9f08-f2417da38704 tempest-ServersTestJSON-971196439 tempest-ServersTestJSON-971196439-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1319627263" status: 202 len: 0 microversion: 2.1 time: 0.079419 Sep 16 12:50:07.885107 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 587/1221] 10.222.0.67 () {58 vars in 1221 bytes} [Fri Sep 16 12:50:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1319627263 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:50:07.919649 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-addca907-3306-46a4-b7c5-2928dc1106ad tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] HTTP exception thrown: Instance 07365fde-3701-46a6-aba7-4c6f74e181b9 could not be found. Sep 16 12:50:07.926663 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-addca907-3306-46a4-b7c5-2928dc1106ad tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Request method failure captured: Sep 16 12:50:07.926663 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9 HTTP/1.1 Sep 16 12:50:07.926663 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:50:07.926663 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:50:07.926663 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:50:07.926663 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:50:07.926663 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:50:07.926663 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:50:07.926663 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:50:07.926663 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:50:07.926663 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHAdXBA3G5MIJPMFvQ22OA7-JW4DF3Vr5Co2BEJlI0HyaRudLGvMywS5ScfQh3FkixqTPupO_dgQu4WAFwnyVbe-3sbrVx3W0bL4qZiuyo38tu1dlWq0MINeqO8NX8crJ3xm6MyJEQN1XJ0GwjhAM_st7IXPxZhd9ayEgqmH-tC7txU Sep 16 12:50:07.926663 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:50:07.926663 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:50:07.926663 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:50:07.926663 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:50:07.926663 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:50:07.926663 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:50:07.926663 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 7058e9e184834c39a5a299f481a6e62e Sep 16 12:50:07.926663 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-985301388 Sep 16 12:50:07.926663 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:50:07.926663 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:50:07.928460 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7058e9e184834c39a5a299f481a6e62e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7058e9e184834c39a5a299f481a6e62e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7058e9e184834c39a5a299f481a6e62e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7058e9e184834c39a5a299f481a6e62e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:50:07.928460 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-985301388 Sep 16 12:50:07.928460 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 7058e9e184834c39a5a299f481a6e62e Sep 16 12:50:07.928460 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-985301388 Sep 16 12:50:07.928460 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ServersWithSpecificFlavorTestJSON-985301388-project Sep 16 12:50:07.928460 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:50:07.928460 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:50:07.928460 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 709f71c239ca40b8b958038c9ab16f37 Sep 16 12:50:07.928460 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-985301388-project Sep 16 12:50:07.928460 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:50:07.928460 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 07365fde-3701-46a6-aba7-4c6f74e181b9 could not be found. Sep 16 12:50:07.928460 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '07365fde-3701-46a6-aba7-4c6f74e181b9'} Sep 16 12:50:07.929338 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:50:07.929338 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:07.929338 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:50:07.929338 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:50:07.929338 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:50:07.929338 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:50:07.929338 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:50:07.929338 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:50:07.929338 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:50:07.929338 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:50:07.929338 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07365fde-3701-46a6-aba7-4c6f74e181b9 could not be found. Sep 16 12:50:07.929338 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:50:07.929338 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:50:07.929338 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:50:07.929338 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:07.929338 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:50:07.929338 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:50:07.929338 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:50:07.929338 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:50:07.929338 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:50:07.930878 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:50:07.930878 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:50:07.930878 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:50:07.930878 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:50:07.930878 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:50:07.930878 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:50:07.930878 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:50:07.930878 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07365fde-3701-46a6-aba7-4c6f74e181b9 could not be found. Sep 16 12:50:07.930878 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:50:07.930878 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:50:07.930878 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:50:07.930878 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:07.930878 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:50:07.930878 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:50:07.930878 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:50:07.930878 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:50:07.930878 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07365fde-3701-46a6-aba7-4c6f74e181b9 could not be found. Sep 16 12:50:07.930878 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:50:07.935161 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-addca907-3306-46a4-b7c5-2928dc1106ad tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Returning 404 to user: Instance 07365fde-3701-46a6-aba7-4c6f74e181b9 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:50:07.941770 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-addca907-3306-46a4-b7c5-2928dc1106ad tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9" status: 404 len: 111 microversion: 2.1 time: 0.125222 Sep 16 12:50:07.943964 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 635/1222] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:07 2022] GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 12:50:07.952557 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-af91e0a8-2033-42ca-b329-243bec50c289 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '.version_select at 0x7f10358228b0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:07.996367 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-af91e0a8-2033-42ca-b329-243bec50c289 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1023851508" status: 202 len: 0 microversion: 2.1 time: 0.047686 Sep 16 12:50:07.997743 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 588/1223] 10.222.0.67 () {58 vars in 1221 bytes} [Fri Sep 16 12:50:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1023851508 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:50:08.053976 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-2a189049-a474-4b12-a5fa-a254f1abc91a req-494e2c8e-9c9e-43cf-9f71-ff3710e61dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dacfa868-1c8b-4918-8797-f31caee29361", "name": "network-vif-deleted", "tag": "fabffdb4-d14b-4b3e-bbe3-09f69928ff1e"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:50:08.078429 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2a189049-a474-4b12-a5fa-a254f1abc91a req-494e2c8e-9c9e-43cf-9f71-ff3710e61dc9 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:08.084336 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2a189049-a474-4b12-a5fa-a254f1abc91a req-494e2c8e-9c9e-43cf-9f71-ff3710e61dc9 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:08.085178 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2a189049-a474-4b12-a5fa-a254f1abc91a req-494e2c8e-9c9e-43cf-9f71-ff3710e61dc9 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:08.151392 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-2a189049-a474-4b12-a5fa-a254f1abc91a req-494e2c8e-9c9e-43cf-9f71-ff3710e61dc9 service nova] Creating event network-vif-deleted:fabffdb4-d14b-4b3e-bbe3-09f69928ff1e for instance dacfa868-1c8b-4918-8797-f31caee29361 on n-h1-858094-4 Sep 16 12:50:08.246353 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-2a189049-a474-4b12-a5fa-a254f1abc91a req-494e2c8e-9c9e-43cf-9f71-ff3710e61dc9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.196479 Sep 16 12:50:08.247274 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 636/1224] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:50:08.298112 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-72389fa4-f0eb-44c1-9cd4-b35c8fea201c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:08.298899 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-72389fa4-f0eb-44c1-9cd4-b35c8fea201c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 96ff60ae-143a-4ae5-9c18-aff09a5c80cd] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:08.313623 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-72389fa4-f0eb-44c1-9cd4-b35c8fea201c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:08.314396 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-72389fa4-f0eb-44c1-9cd4-b35c8fea201c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:08.315099 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-72389fa4-f0eb-44c1-9cd4-b35c8fea201c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:08.342856 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-72389fa4-f0eb-44c1-9cd4-b35c8fea201c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:08.346684 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-72389fa4-f0eb-44c1-9cd4-b35c8fea201c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:08.349330 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-72389fa4-f0eb-44c1-9cd4-b35c8fea201c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:08.426330 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6dc945a5-2e8b-40eb-8505-5fb4efd8fce9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:08.429685 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6dc945a5-2e8b-40eb-8505-5fb4efd8fce9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:08.448482 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6dc945a5-2e8b-40eb-8505-5fb4efd8fce9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:08.449247 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6dc945a5-2e8b-40eb-8505-5fb4efd8fce9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:08.449935 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6dc945a5-2e8b-40eb-8505-5fb4efd8fce9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:08.450880 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6dc945a5-2e8b-40eb-8505-5fb4efd8fce9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:08.451569 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6dc945a5-2e8b-40eb-8505-5fb4efd8fce9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:08.453013 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6dc945a5-2e8b-40eb-8505-5fb4efd8fce9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:09.170300 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6dc945a5-2e8b-40eb-8505-5fb4efd8fce9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:09.179689 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6dc945a5-2e8b-40eb-8505-5fb4efd8fce9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1378 microversion: 2.1 time: 0.758718 Sep 16 12:50:09.184039 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 637/1225] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:08 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1378 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:09.209617 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d89985a8-1bee-47ff-8086-0922d72deb77 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:09.211749 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d89985a8-1bee-47ff-8086-0922d72deb77 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:09.229330 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d89985a8-1bee-47ff-8086-0922d72deb77 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:09.230398 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d89985a8-1bee-47ff-8086-0922d72deb77 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:09.231802 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d89985a8-1bee-47ff-8086-0922d72deb77 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:09.233612 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d89985a8-1bee-47ff-8086-0922d72deb77 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:09.234745 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d89985a8-1bee-47ff-8086-0922d72deb77 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:09.235634 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d89985a8-1bee-47ff-8086-0922d72deb77 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:09.287963 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-72389fa4-f0eb-44c1-9cd4-b35c8fea201c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:09.298637 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-72389fa4-f0eb-44c1-9cd4-b35c8fea201c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd" status: 200 len: 1465 microversion: 2.1 time: 1.007602 Sep 16 12:50:09.299448 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 589/1226] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:08 2022] GET /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd => generated 1465 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:09.311181 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-20d1f997-bad5-459a-bbc3-41dca85c235b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:09.317850 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-20d1f997-bad5-459a-bbc3-41dca85c235b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:09.330579 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-20d1f997-bad5-459a-bbc3-41dca85c235b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:09.335483 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-20d1f997-bad5-459a-bbc3-41dca85c235b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:09.336350 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-20d1f997-bad5-459a-bbc3-41dca85c235b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:09.337408 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-20d1f997-bad5-459a-bbc3-41dca85c235b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:09.340929 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-20d1f997-bad5-459a-bbc3-41dca85c235b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:09.341789 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-20d1f997-bad5-459a-bbc3-41dca85c235b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:09.398446 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d89985a8-1bee-47ff-8086-0922d72deb77 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:09.418302 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d89985a8-1bee-47ff-8086-0922d72deb77 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac" status: 200 len: 1266 microversion: 2.1 time: 0.225863 Sep 16 12:50:09.419119 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 638/1227] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:09 2022] GET /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:09.435926 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8e412a64-d5bd-4a96-b083-27e89b9b11bb tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:09.437900 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8e412a64-d5bd-4a96-b083-27e89b9b11bb tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] [instance: 96ff60ae-143a-4ae5-9c18-aff09a5c80cd] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:09.451709 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8e412a64-d5bd-4a96-b083-27e89b9b11bb tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:09.452916 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-20d1f997-bad5-459a-bbc3-41dca85c235b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:09.457226 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8e412a64-d5bd-4a96-b083-27e89b9b11bb tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:09.459902 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8e412a64-d5bd-4a96-b083-27e89b9b11bb tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:09.460823 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8e412a64-d5bd-4a96-b083-27e89b9b11bb tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:09.462929 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8e412a64-d5bd-4a96-b083-27e89b9b11bb tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:09.463537 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8e412a64-d5bd-4a96-b083-27e89b9b11bb tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:09.473401 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-20d1f997-bad5-459a-bbc3-41dca85c235b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:09.475395 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-20d1f997-bad5-459a-bbc3-41dca85c235b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:09.482245 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-20d1f997-bad5-459a-bbc3-41dca85c235b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1555 microversion: 2.91 time: 0.181912 Sep 16 12:50:09.483136 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 590/1228] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:50:09 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1555 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:50:09.662638 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9c131f59-296a-46ff-ab58-7ad6521f6fc2 tempest-ServersWithSpecificFlavorTestJSON-648082716 tempest-ServersWithSpecificFlavorTestJSON-648082716-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:09.699015 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9c131f59-296a-46ff-ab58-7ad6521f6fc2 tempest-ServersWithSpecificFlavorTestJSON-648082716 tempest-ServersWithSpecificFlavorTestJSON-648082716-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1411872597" status: 202 len: 0 microversion: 2.1 time: 0.040530 Sep 16 12:50:09.699623 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 591/1229] 10.222.0.67 () {58 vars in 1161 bytes} [Fri Sep 16 12:50:09 2022] DELETE /compute/v2.1/flavors/1411872597 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 12:50:09.708396 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-21fb8f5a-ba1f-426a-8bfd-16c7144ca8e5 tempest-ServersWithSpecificFlavorTestJSON-648082716 tempest-ServersWithSpecificFlavorTestJSON-648082716-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:09.744976 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-21fb8f5a-ba1f-426a-8bfd-16c7144ca8e5 tempest-ServersWithSpecificFlavorTestJSON-648082716 tempest-ServersWithSpecificFlavorTestJSON-648082716-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5895 microversion: 2.1 time: 0.040757 Sep 16 12:50:09.756940 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 592/1230] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:50:09 2022] GET /compute/v2.1/flavors/detail => generated 5895 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:50:09.765809 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8e412a64-d5bd-4a96-b083-27e89b9b11bb tempest-ServersOnMultiNodesTest-11797491 tempest-ServersOnMultiNodesTest-11797491-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd" status: 200 len: 1616 microversion: 2.1 time: 0.345374 Sep 16 12:50:09.767086 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 639/1231] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:09 2022] GET /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd => generated 1616 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:09.792444 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-038ba707-ecb3-4cad-a6f5-a5db10050ce2 tempest-ServersWithSpecificFlavorTestJSON-648082716 tempest-ServersWithSpecificFlavorTestJSON-648082716-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:09.801258 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-108ecc5c-995b-4af3-91a1-72b4a22ed01d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:09.802348 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-108ecc5c-995b-4af3-91a1-72b4a22ed01d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 96ff60ae-143a-4ae5-9c18-aff09a5c80cd] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:09.810018 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-108ecc5c-995b-4af3-91a1-72b4a22ed01d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:09.810799 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-108ecc5c-995b-4af3-91a1-72b4a22ed01d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:09.811672 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-108ecc5c-995b-4af3-91a1-72b4a22ed01d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:09.812633 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-108ecc5c-995b-4af3-91a1-72b4a22ed01d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:09.813868 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-108ecc5c-995b-4af3-91a1-72b4a22ed01d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:09.814526 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-108ecc5c-995b-4af3-91a1-72b4a22ed01d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:09.821227 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-038ba707-ecb3-4cad-a6f5-a5db10050ce2 tempest-ServersWithSpecificFlavorTestJSON-648082716 tempest-ServersWithSpecificFlavorTestJSON-648082716-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1350934749" status: 202 len: 0 microversion: 2.1 time: 0.032328 Sep 16 12:50:09.822197 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 593/1232] 10.222.0.67 () {58 vars in 1161 bytes} [Fri Sep 16 12:50:09 2022] DELETE /compute/v2.1/flavors/1350934749 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:50:09.830164 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e475389d-9bfe-4e8b-a3b9-7f1604fd5031 tempest-ServersWithSpecificFlavorTestJSON-648082716 tempest-ServersWithSpecificFlavorTestJSON-648082716-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:09.865682 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e475389d-9bfe-4e8b-a3b9-7f1604fd5031 tempest-ServersWithSpecificFlavorTestJSON-648082716 tempest-ServersWithSpecificFlavorTestJSON-648082716-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5480 microversion: 2.1 time: 0.039160 Sep 16 12:50:09.866670 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 594/1233] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:50:09 2022] GET /compute/v2.1/flavors/detail => generated 5480 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:50:09.877423 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-108ecc5c-995b-4af3-91a1-72b4a22ed01d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 96ff60ae-143a-4ae5-9c18-aff09a5c80cd] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:50:09.894803 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-516addfe-c4d1-4427-8328-d090b5d42a41 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:09.895687 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-516addfe-c4d1-4427-8328-d090b5d42a41 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 38d079dd-9676-45f7-b286-16aa78d487bf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:09.902458 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-516addfe-c4d1-4427-8328-d090b5d42a41 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:09.903227 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-516addfe-c4d1-4427-8328-d090b5d42a41 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:09.903956 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-516addfe-c4d1-4427-8328-d090b5d42a41 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:09.904909 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-516addfe-c4d1-4427-8328-d090b5d42a41 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:09.905760 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-516addfe-c4d1-4427-8328-d090b5d42a41 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:09.906398 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-516addfe-c4d1-4427-8328-d090b5d42a41 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:09.922663 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-516addfe-c4d1-4427-8328-d090b5d42a41 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] HTTP exception thrown: Instance 38d079dd-9676-45f7-b286-16aa78d487bf could not be found. Sep 16 12:50:09.925475 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-516addfe-c4d1-4427-8328-d090b5d42a41 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Request method failure captured: Sep 16 12:50:09.925475 n-d-858094-4 devstack@n-api.service[128780]: request: DELETE /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf HTTP/1.1 Sep 16 12:50:09.925475 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:50:09.925475 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:50:09.925475 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:50:09.925475 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:50:09.925475 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:50:09.925475 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:50:09.925475 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:50:09.925475 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:50:09.925475 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHAdXBA3G5MIJPMFvQ22OA7-JW4DF3Vr5Co2BEJlI0HyaRudLGvMywS5ScfQh3FkixqTPupO_dgQu4WAFwnyVbe-3sbrVx3W0bL4qZiuyo38tu1dlWq0MINeqO8NX8crJ3xm6MyJEQN1XJ0GwjhAM_st7IXPxZhd9ayEgqmH-tC7txU Sep 16 12:50:09.925475 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:50:09.925475 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:50:09.925475 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:50:09.925475 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:50:09.925475 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:50:09.925475 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:50:09.925475 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 7058e9e184834c39a5a299f481a6e62e Sep 16 12:50:09.925475 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-985301388 Sep 16 12:50:09.925475 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:50:09.925475 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:50:09.926887 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7058e9e184834c39a5a299f481a6e62e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7058e9e184834c39a5a299f481a6e62e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7058e9e184834c39a5a299f481a6e62e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7058e9e184834c39a5a299f481a6e62e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:50:09.926887 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-985301388 Sep 16 12:50:09.926887 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 7058e9e184834c39a5a299f481a6e62e Sep 16 12:50:09.926887 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-985301388 Sep 16 12:50:09.926887 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ServersWithSpecificFlavorTestJSON-985301388-project Sep 16 12:50:09.926887 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:50:09.926887 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:50:09.926887 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 709f71c239ca40b8b958038c9ab16f37 Sep 16 12:50:09.926887 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-985301388-project Sep 16 12:50:09.926887 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:50:09.926887 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance 38d079dd-9676-45f7-b286-16aa78d487bf could not be found. Sep 16 12:50:09.926887 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '38d079dd-9676-45f7-b286-16aa78d487bf'} Sep 16 12:50:09.927650 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:50:09.927650 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:09.927650 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:50:09.927650 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:50:09.927650 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:50:09.927650 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:50:09.927650 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:50:09.927650 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:50:09.927650 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:50:09.927650 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:50:09.927650 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38d079dd-9676-45f7-b286-16aa78d487bf could not be found. Sep 16 12:50:09.927650 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:09.927650 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:50:09.927650 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:09.927650 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:09.927650 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:50:09.927650 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:50:09.927650 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:50:09.927650 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:50:09.927650 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:50:09.928886 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:50:09.928886 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 12:50:09.928886 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 12:50:09.928886 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 12:50:09.928886 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 12:50:09.928886 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:50:09.928886 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:50:09.928886 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:50:09.928886 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:50:09.928886 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38d079dd-9676-45f7-b286-16aa78d487bf could not be found. Sep 16 12:50:09.928886 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:09.928886 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:50:09.928886 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:09.928886 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:09.928886 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:50:09.928886 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:50:09.928886 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:50:09.928886 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:50:09.928886 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38d079dd-9676-45f7-b286-16aa78d487bf could not be found. Sep 16 12:50:09.928886 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:09.931323 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-516addfe-c4d1-4427-8328-d090b5d42a41 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Returning 404 to user: Instance 38d079dd-9676-45f7-b286-16aa78d487bf could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:50:09.932618 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-516addfe-c4d1-4427-8328-d090b5d42a41 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "DELETE /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf" status: 404 len: 111 microversion: 2.1 time: 0.041822 Sep 16 12:50:09.933792 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 595/1234] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:50:09 2022] DELETE /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 12:50:09.943793 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a37d9e19-9f2b-4b13-b177-e475e81eebf8 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:09.944929 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a37d9e19-9f2b-4b13-b177-e475e81eebf8 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 38d079dd-9676-45f7-b286-16aa78d487bf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:09.952856 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a37d9e19-9f2b-4b13-b177-e475e81eebf8 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:09.953760 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a37d9e19-9f2b-4b13-b177-e475e81eebf8 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:09.954447 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a37d9e19-9f2b-4b13-b177-e475e81eebf8 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:09.955458 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a37d9e19-9f2b-4b13-b177-e475e81eebf8 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:09.956264 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a37d9e19-9f2b-4b13-b177-e475e81eebf8 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:09.957555 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a37d9e19-9f2b-4b13-b177-e475e81eebf8 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:09.980037 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-a37d9e19-9f2b-4b13-b177-e475e81eebf8 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] HTTP exception thrown: Instance 38d079dd-9676-45f7-b286-16aa78d487bf could not be found. Sep 16 12:50:09.982619 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a37d9e19-9f2b-4b13-b177-e475e81eebf8 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Request method failure captured: Sep 16 12:50:09.982619 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf HTTP/1.1 Sep 16 12:50:09.982619 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:50:09.982619 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:50:09.982619 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:50:09.982619 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:50:09.982619 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:50:09.982619 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:50:09.982619 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:50:09.982619 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:50:09.982619 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHAdXBA3G5MIJPMFvQ22OA7-JW4DF3Vr5Co2BEJlI0HyaRudLGvMywS5ScfQh3FkixqTPupO_dgQu4WAFwnyVbe-3sbrVx3W0bL4qZiuyo38tu1dlWq0MINeqO8NX8crJ3xm6MyJEQN1XJ0GwjhAM_st7IXPxZhd9ayEgqmH-tC7txU Sep 16 12:50:09.982619 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:50:09.982619 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:50:09.982619 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:50:09.982619 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:50:09.982619 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:50:09.982619 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:50:09.982619 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 7058e9e184834c39a5a299f481a6e62e Sep 16 12:50:09.982619 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-985301388 Sep 16 12:50:09.982619 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:50:09.982619 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:50:09.988369 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7058e9e184834c39a5a299f481a6e62e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7058e9e184834c39a5a299f481a6e62e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7058e9e184834c39a5a299f481a6e62e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7058e9e184834c39a5a299f481a6e62e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:50:09.988369 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-985301388 Sep 16 12:50:09.988369 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 7058e9e184834c39a5a299f481a6e62e Sep 16 12:50:09.988369 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-985301388 Sep 16 12:50:09.988369 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ServersWithSpecificFlavorTestJSON-985301388-project Sep 16 12:50:09.988369 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:50:09.988369 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:50:09.988369 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 709f71c239ca40b8b958038c9ab16f37 Sep 16 12:50:09.988369 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-985301388-project Sep 16 12:50:09.988369 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:50:09.988369 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance 38d079dd-9676-45f7-b286-16aa78d487bf could not be found. Sep 16 12:50:09.988369 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '38d079dd-9676-45f7-b286-16aa78d487bf'} Sep 16 12:50:09.989282 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:50:09.989282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:09.989282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:50:09.989282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:50:09.989282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:50:09.989282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:50:09.989282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:50:09.989282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:50:09.989282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:50:09.989282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:50:09.989282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38d079dd-9676-45f7-b286-16aa78d487bf could not be found. Sep 16 12:50:09.989282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:09.989282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:50:09.989282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:09.989282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:09.989282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:50:09.989282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:50:09.989282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:50:09.989282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:50:09.989282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:50:09.990658 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:50:09.990658 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:50:09.990658 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:50:09.990658 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:50:09.990658 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:50:09.990658 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:50:09.990658 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:50:09.990658 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38d079dd-9676-45f7-b286-16aa78d487bf could not be found. Sep 16 12:50:09.990658 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:09.990658 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:50:09.990658 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:09.990658 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:09.990658 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:50:09.990658 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:50:09.990658 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:50:09.990658 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:50:09.990658 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38d079dd-9676-45f7-b286-16aa78d487bf could not be found. Sep 16 12:50:09.990658 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:09.993915 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a37d9e19-9f2b-4b13-b177-e475e81eebf8 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Returning 404 to user: Instance 38d079dd-9676-45f7-b286-16aa78d487bf could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:50:09.995259 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a37d9e19-9f2b-4b13-b177-e475e81eebf8 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "GET /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf" status: 404 len: 111 microversion: 2.1 time: 0.055619 Sep 16 12:50:09.996573 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 596/1235] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:09 2022] GET /compute/v2.1/servers/38d079dd-9676-45f7-b286-16aa78d487bf => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:50:10.019461 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-274d42e5-04ce-4899-a6a4-f6534183c692 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:10.020574 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-274d42e5-04ce-4899-a6a4-f6534183c692 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 07365fde-3701-46a6-aba7-4c6f74e181b9] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:10.028378 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-274d42e5-04ce-4899-a6a4-f6534183c692 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:10.029698 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-274d42e5-04ce-4899-a6a4-f6534183c692 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:10.030578 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-274d42e5-04ce-4899-a6a4-f6534183c692 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:10.031665 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-274d42e5-04ce-4899-a6a4-f6534183c692 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:10.032394 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-274d42e5-04ce-4899-a6a4-f6534183c692 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:10.033061 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-274d42e5-04ce-4899-a6a4-f6534183c692 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:10.054558 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:50:10.061707 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-274d42e5-04ce-4899-a6a4-f6534183c692 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] HTTP exception thrown: Instance 07365fde-3701-46a6-aba7-4c6f74e181b9 could not be found. Sep 16 12:50:10.067016 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-274d42e5-04ce-4899-a6a4-f6534183c692 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Request method failure captured: Sep 16 12:50:10.067016 n-d-858094-4 devstack@n-api.service[128780]: request: DELETE /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9 HTTP/1.1 Sep 16 12:50:10.067016 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:50:10.067016 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:50:10.067016 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:50:10.067016 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:50:10.067016 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:50:10.067016 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:50:10.067016 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:50:10.067016 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:50:10.067016 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHAdXBA3G5MIJPMFvQ22OA7-JW4DF3Vr5Co2BEJlI0HyaRudLGvMywS5ScfQh3FkixqTPupO_dgQu4WAFwnyVbe-3sbrVx3W0bL4qZiuyo38tu1dlWq0MINeqO8NX8crJ3xm6MyJEQN1XJ0GwjhAM_st7IXPxZhd9ayEgqmH-tC7txU Sep 16 12:50:10.067016 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:50:10.067016 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:50:10.067016 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:50:10.067016 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:50:10.067016 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:50:10.067016 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:50:10.067016 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 7058e9e184834c39a5a299f481a6e62e Sep 16 12:50:10.067016 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-985301388 Sep 16 12:50:10.067016 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:50:10.067016 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:50:10.068535 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7058e9e184834c39a5a299f481a6e62e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7058e9e184834c39a5a299f481a6e62e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7058e9e184834c39a5a299f481a6e62e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7058e9e184834c39a5a299f481a6e62e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:50:10.068535 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-985301388 Sep 16 12:50:10.068535 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 7058e9e184834c39a5a299f481a6e62e Sep 16 12:50:10.068535 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-985301388 Sep 16 12:50:10.068535 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ServersWithSpecificFlavorTestJSON-985301388-project Sep 16 12:50:10.068535 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:50:10.068535 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:50:10.068535 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 709f71c239ca40b8b958038c9ab16f37 Sep 16 12:50:10.068535 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-985301388-project Sep 16 12:50:10.068535 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:50:10.068535 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance 07365fde-3701-46a6-aba7-4c6f74e181b9 could not be found. Sep 16 12:50:10.068535 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '07365fde-3701-46a6-aba7-4c6f74e181b9'} Sep 16 12:50:10.069292 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:50:10.069292 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:10.069292 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:50:10.069292 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:50:10.069292 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:50:10.069292 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:50:10.069292 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:50:10.069292 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:50:10.069292 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:50:10.069292 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:50:10.069292 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07365fde-3701-46a6-aba7-4c6f74e181b9 could not be found. Sep 16 12:50:10.069292 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:10.069292 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:50:10.069292 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:10.069292 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:10.069292 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:50:10.069292 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:50:10.069292 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:50:10.069292 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:50:10.069292 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:50:10.071112 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:50:10.071112 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 12:50:10.071112 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 12:50:10.071112 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 12:50:10.071112 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 12:50:10.071112 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:50:10.071112 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:50:10.071112 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:50:10.071112 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:50:10.071112 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07365fde-3701-46a6-aba7-4c6f74e181b9 could not be found. Sep 16 12:50:10.071112 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:10.071112 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:50:10.071112 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:10.071112 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:10.071112 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:50:10.071112 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:50:10.071112 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:50:10.071112 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:50:10.071112 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07365fde-3701-46a6-aba7-4c6f74e181b9 could not be found. Sep 16 12:50:10.071112 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:10.073484 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-274d42e5-04ce-4899-a6a4-f6534183c692 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Returning 404 to user: Instance 07365fde-3701-46a6-aba7-4c6f74e181b9 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:50:10.073484 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-274d42e5-04ce-4899-a6a4-f6534183c692 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "DELETE /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9" status: 404 len: 111 microversion: 2.1 time: 0.054682 Sep 16 12:50:10.075682 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 597/1236] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:50:10 2022] DELETE /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:50:10.080714 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-37af374b-1ebc-4a6c-bdf8-faf6313f35d9 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:10.081424 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-37af374b-1ebc-4a6c-bdf8-faf6313f35d9 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] [instance: 07365fde-3701-46a6-aba7-4c6f74e181b9] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:10.101739 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:DELETE=8 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:50:10.108969 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-37af374b-1ebc-4a6c-bdf8-faf6313f35d9 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:10.109817 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-37af374b-1ebc-4a6c-bdf8-faf6313f35d9 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:10.110884 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-37af374b-1ebc-4a6c-bdf8-faf6313f35d9 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:10.111829 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-37af374b-1ebc-4a6c-bdf8-faf6313f35d9 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:10.112546 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-37af374b-1ebc-4a6c-bdf8-faf6313f35d9 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:10.113351 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-37af374b-1ebc-4a6c-bdf8-faf6313f35d9 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:10.114729 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-108ecc5c-995b-4af3-91a1-72b4a22ed01d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "DELETE /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd" status: 204 len: 0 microversion: 2.1 time: 0.317687 Sep 16 12:50:10.117489 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 640/1237] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:50:09 2022] DELETE /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:50:10.137459 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e99a27fb-2e00-45a8-bd84-974f8fb61060 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:10.139288 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e99a27fb-2e00-45a8-bd84-974f8fb61060 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 96ff60ae-143a-4ae5-9c18-aff09a5c80cd] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:10.147916 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e99a27fb-2e00-45a8-bd84-974f8fb61060 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:10.149932 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e99a27fb-2e00-45a8-bd84-974f8fb61060 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:10.150120 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-37af374b-1ebc-4a6c-bdf8-faf6313f35d9 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] HTTP exception thrown: Instance 07365fde-3701-46a6-aba7-4c6f74e181b9 could not be found. Sep 16 12:50:10.150725 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e99a27fb-2e00-45a8-bd84-974f8fb61060 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:10.151702 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e99a27fb-2e00-45a8-bd84-974f8fb61060 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:10.152552 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e99a27fb-2e00-45a8-bd84-974f8fb61060 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:10.153132 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-37af374b-1ebc-4a6c-bdf8-faf6313f35d9 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Request method failure captured: Sep 16 12:50:10.153132 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9 HTTP/1.1 Sep 16 12:50:10.153132 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:50:10.153132 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:50:10.153132 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:50:10.153132 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:50:10.153132 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:50:10.153132 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:50:10.153132 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:50:10.153132 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:50:10.153132 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHAdXBA3G5MIJPMFvQ22OA7-JW4DF3Vr5Co2BEJlI0HyaRudLGvMywS5ScfQh3FkixqTPupO_dgQu4WAFwnyVbe-3sbrVx3W0bL4qZiuyo38tu1dlWq0MINeqO8NX8crJ3xm6MyJEQN1XJ0GwjhAM_st7IXPxZhd9ayEgqmH-tC7txU Sep 16 12:50:10.153132 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:50:10.153132 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:50:10.153132 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:50:10.153132 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:50:10.153132 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:50:10.153132 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:50:10.153132 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 7058e9e184834c39a5a299f481a6e62e Sep 16 12:50:10.153132 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-985301388 Sep 16 12:50:10.153132 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:50:10.153132 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:50:10.154506 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7058e9e184834c39a5a299f481a6e62e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7058e9e184834c39a5a299f481a6e62e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7058e9e184834c39a5a299f481a6e62e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7058e9e184834c39a5a299f481a6e62e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:50:10.154506 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-985301388 Sep 16 12:50:10.154506 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 7058e9e184834c39a5a299f481a6e62e Sep 16 12:50:10.154506 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-985301388 Sep 16 12:50:10.154506 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ServersWithSpecificFlavorTestJSON-985301388-project Sep 16 12:50:10.154506 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:50:10.154506 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:50:10.154506 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 709f71c239ca40b8b958038c9ab16f37 Sep 16 12:50:10.154506 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-985301388-project Sep 16 12:50:10.154506 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:50:10.154506 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance 07365fde-3701-46a6-aba7-4c6f74e181b9 could not be found. Sep 16 12:50:10.154506 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '07365fde-3701-46a6-aba7-4c6f74e181b9'} Sep 16 12:50:10.155286 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:50:10.155286 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:10.155286 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:50:10.155286 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:50:10.155286 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:50:10.155286 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:50:10.155286 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:50:10.155286 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:50:10.155286 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:50:10.155286 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:50:10.155286 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07365fde-3701-46a6-aba7-4c6f74e181b9 could not be found. Sep 16 12:50:10.155286 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:10.155286 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:50:10.155286 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:10.155286 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:10.155286 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:50:10.155286 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:50:10.155286 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:50:10.155286 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:50:10.155286 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:50:10.157077 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:50:10.157077 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:50:10.157077 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:50:10.157077 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:50:10.157077 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:50:10.157077 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:50:10.157077 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:50:10.157077 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07365fde-3701-46a6-aba7-4c6f74e181b9 could not be found. Sep 16 12:50:10.157077 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:10.157077 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:50:10.157077 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:10.157077 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:10.157077 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:50:10.157077 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:50:10.157077 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:50:10.157077 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:50:10.157077 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07365fde-3701-46a6-aba7-4c6f74e181b9 could not be found. Sep 16 12:50:10.157077 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:10.158406 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-37af374b-1ebc-4a6c-bdf8-faf6313f35d9 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] Returning 404 to user: Instance 07365fde-3701-46a6-aba7-4c6f74e181b9 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:50:10.158406 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-37af374b-1ebc-4a6c-bdf8-faf6313f35d9 tempest-ServersWithSpecificFlavorTestJSON-985301388 tempest-ServersWithSpecificFlavorTestJSON-985301388-project] 10.222.0.67 "GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9" status: 404 len: 111 microversion: 2.1 time: 0.077923 Sep 16 12:50:10.158406 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 598/1238] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:10 2022] GET /compute/v2.1/servers/07365fde-3701-46a6-aba7-4c6f74e181b9 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:50:10.159537 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e99a27fb-2e00-45a8-bd84-974f8fb61060 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:10.292655 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-bff6fd45-02aa-49d7-83ca-ac156af955ed tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:10.296567 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-bff6fd45-02aa-49d7-83ca-ac156af955ed tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:10.327926 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bff6fd45-02aa-49d7-83ca-ac156af955ed tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:10.333816 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bff6fd45-02aa-49d7-83ca-ac156af955ed tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:10.336381 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bff6fd45-02aa-49d7-83ca-ac156af955ed tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:10.338551 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bff6fd45-02aa-49d7-83ca-ac156af955ed tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:10.340004 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bff6fd45-02aa-49d7-83ca-ac156af955ed tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:10.342042 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bff6fd45-02aa-49d7-83ca-ac156af955ed tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:11.146853 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-bff6fd45-02aa-49d7-83ca-ac156af955ed tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:11.157903 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-bff6fd45-02aa-49d7-83ca-ac156af955ed tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1378 microversion: 2.1 time: 0.879552 Sep 16 12:50:11.169580 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 599/1239] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:10 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1378 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:11.176046 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-46bdab89-1b50-4594-ad77-6f2f14057a09 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:11.176988 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-46bdab89-1b50-4594-ad77-6f2f14057a09 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:11.182390 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e99a27fb-2e00-45a8-bd84-974f8fb61060 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:11.184521 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-46bdab89-1b50-4594-ad77-6f2f14057a09 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:11.185250 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-46bdab89-1b50-4594-ad77-6f2f14057a09 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:11.187226 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-46bdab89-1b50-4594-ad77-6f2f14057a09 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:11.188388 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-46bdab89-1b50-4594-ad77-6f2f14057a09 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:11.189294 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-46bdab89-1b50-4594-ad77-6f2f14057a09 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:11.190569 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-46bdab89-1b50-4594-ad77-6f2f14057a09 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:11.193658 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e99a27fb-2e00-45a8-bd84-974f8fb61060 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd" status: 200 len: 1471 microversion: 2.1 time: 1.071714 Sep 16 12:50:11.212694 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 641/1240] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:10 2022] GET /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd => generated 1471 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:50:11.225634 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dc43389e-5525-48fa-8ea7-122fc25b38dc tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:11.226350 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dc43389e-5525-48fa-8ea7-122fc25b38dc tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:11.236501 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc43389e-5525-48fa-8ea7-122fc25b38dc tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:11.237965 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc43389e-5525-48fa-8ea7-122fc25b38dc tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:11.238949 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc43389e-5525-48fa-8ea7-122fc25b38dc tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:11.239752 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc43389e-5525-48fa-8ea7-122fc25b38dc tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:11.240312 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc43389e-5525-48fa-8ea7-122fc25b38dc tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:11.240939 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc43389e-5525-48fa-8ea7-122fc25b38dc tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:11.382085 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dc43389e-5525-48fa-8ea7-122fc25b38dc tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:11.406358 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dc43389e-5525-48fa-8ea7-122fc25b38dc tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:11.413534 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dc43389e-5525-48fa-8ea7-122fc25b38dc tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:11.428609 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dc43389e-5525-48fa-8ea7-122fc25b38dc tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1555 microversion: 2.91 time: 0.213584 Sep 16 12:50:11.430592 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 642/1241] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:50:11 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1555 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:50:11.437977 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-4550822e-4293-46cd-bef7-7627c66023f7 req-8105b3ef-6183-4968-9537-ba774a4a7d8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a439c4ea-46f5-4571-9d87-96a91a6359f7", "name": "network-vif-plugged", "status": "completed", "tag": "76e2deeb-80ac-4c0d-98b8-96091a5ab0d2"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:50:11.480610 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4550822e-4293-46cd-bef7-7627c66023f7 req-8105b3ef-6183-4968-9537-ba774a4a7d8b service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:11.482248 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4550822e-4293-46cd-bef7-7627c66023f7 req-8105b3ef-6183-4968-9537-ba774a4a7d8b service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:11.483349 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4550822e-4293-46cd-bef7-7627c66023f7 req-8105b3ef-6183-4968-9537-ba774a4a7d8b service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:11.522839 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-4550822e-4293-46cd-bef7-7627c66023f7 req-8105b3ef-6183-4968-9537-ba774a4a7d8b service nova] Creating event network-vif-plugged:76e2deeb-80ac-4c0d-98b8-96091a5ab0d2 for instance a439c4ea-46f5-4571-9d87-96a91a6359f7 on n-h2-858094-4 Sep 16 12:50:11.536697 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-4550822e-4293-46cd-bef7-7627c66023f7 req-8105b3ef-6183-4968-9537-ba774a4a7d8b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101607 Sep 16 12:50:11.541268 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 643/1242] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:50:11.709616 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-46bdab89-1b50-4594-ad77-6f2f14057a09 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:11.728655 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-46bdab89-1b50-4594-ad77-6f2f14057a09 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac" status: 200 len: 1308 microversion: 2.1 time: 0.556808 Sep 16 12:50:11.729745 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 600/1243] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:11 2022] GET /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac => generated 1308 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:12.211154 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0a53a783-ff1a-446a-b8f2-7c1083669b51 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:12.211865 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0a53a783-ff1a-446a-b8f2-7c1083669b51 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:12.223524 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-bbdf8eb7-609b-4007-8ad6-c630db780cc9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:12.234307 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-bbdf8eb7-609b-4007-8ad6-c630db780cc9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 96ff60ae-143a-4ae5-9c18-aff09a5c80cd] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:12.250148 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a53a783-ff1a-446a-b8f2-7c1083669b51 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:12.250653 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a53a783-ff1a-446a-b8f2-7c1083669b51 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:12.251104 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a53a783-ff1a-446a-b8f2-7c1083669b51 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:12.251908 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a53a783-ff1a-446a-b8f2-7c1083669b51 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:12.252412 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a53a783-ff1a-446a-b8f2-7c1083669b51 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:12.252887 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a53a783-ff1a-446a-b8f2-7c1083669b51 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:12.258950 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bbdf8eb7-609b-4007-8ad6-c630db780cc9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:12.259453 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bbdf8eb7-609b-4007-8ad6-c630db780cc9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:12.259896 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bbdf8eb7-609b-4007-8ad6-c630db780cc9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:12.260657 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bbdf8eb7-609b-4007-8ad6-c630db780cc9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:12.261119 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bbdf8eb7-609b-4007-8ad6-c630db780cc9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:12.261544 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bbdf8eb7-609b-4007-8ad6-c630db780cc9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:13.022808 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0a53a783-ff1a-446a-b8f2-7c1083669b51 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:13.040797 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0a53a783-ff1a-446a-b8f2-7c1083669b51 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1378 microversion: 2.1 time: 0.834690 Sep 16 12:50:13.044451 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 644/1244] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:12 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1378 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:50:13.064651 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3eabac8c-4d6e-4d49-8a08-e4b9fd6131f2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:13.066235 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3eabac8c-4d6e-4d49-8a08-e4b9fd6131f2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:13.082433 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3eabac8c-4d6e-4d49-8a08-e4b9fd6131f2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:13.083202 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3eabac8c-4d6e-4d49-8a08-e4b9fd6131f2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:13.083856 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3eabac8c-4d6e-4d49-8a08-e4b9fd6131f2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:13.084814 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3eabac8c-4d6e-4d49-8a08-e4b9fd6131f2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:13.091278 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-bbdf8eb7-609b-4007-8ad6-c630db780cc9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:13.092616 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3eabac8c-4d6e-4d49-8a08-e4b9fd6131f2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:13.093513 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3eabac8c-4d6e-4d49-8a08-e4b9fd6131f2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:13.103162 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-bbdf8eb7-609b-4007-8ad6-c630db780cc9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd" status: 200 len: 1471 microversion: 2.1 time: 0.883983 Sep 16 12:50:13.104327 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 601/1245] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:12 2022] GET /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd => generated 1471 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:50:13.115708 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-45443ab9-784f-4aad-a2b1-86f140fdccd1 req-63681209-e8c5-4814-bab4-548d56582e43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7725f9a0-ac02-47ad-a67f-a9d42c2a6aac", "tag": "e749f518-c322-429e-b87d-fb7a8eccab82"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:50:13.134606 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-45443ab9-784f-4aad-a2b1-86f140fdccd1 req-63681209-e8c5-4814-bab4-548d56582e43 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:13.135094 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-45443ab9-784f-4aad-a2b1-86f140fdccd1 req-63681209-e8c5-4814-bab4-548d56582e43 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:13.135537 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-45443ab9-784f-4aad-a2b1-86f140fdccd1 req-63681209-e8c5-4814-bab4-548d56582e43 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:13.160837 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-45443ab9-784f-4aad-a2b1-86f140fdccd1 req-63681209-e8c5-4814-bab4-548d56582e43 service nova] Creating event network-changed:e749f518-c322-429e-b87d-fb7a8eccab82 for instance 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac on n-h2-858094-4 Sep 16 12:50:13.170115 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-45443ab9-784f-4aad-a2b1-86f140fdccd1 req-63681209-e8c5-4814-bab4-548d56582e43 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064576 Sep 16 12:50:13.171417 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 602/1246] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:50:13.179478 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-27d1b4d3-e207-4977-b5d0-ab64d288fcc4 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:13.180466 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-27d1b4d3-e207-4977-b5d0-ab64d288fcc4 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:13.190657 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-27d1b4d3-e207-4977-b5d0-ab64d288fcc4 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:13.191482 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-27d1b4d3-e207-4977-b5d0-ab64d288fcc4 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:13.192152 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-27d1b4d3-e207-4977-b5d0-ab64d288fcc4 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:13.193059 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-27d1b4d3-e207-4977-b5d0-ab64d288fcc4 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:13.193708 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-27d1b4d3-e207-4977-b5d0-ab64d288fcc4 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:13.194287 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-27d1b4d3-e207-4977-b5d0-ab64d288fcc4 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:13.217007 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:50:13.344771 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3eabac8c-4d6e-4d49-8a08-e4b9fd6131f2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:13.363466 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3eabac8c-4d6e-4d49-8a08-e4b9fd6131f2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:13.368539 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3eabac8c-4d6e-4d49-8a08-e4b9fd6131f2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:13.376965 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3eabac8c-4d6e-4d49-8a08-e4b9fd6131f2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1555 microversion: 2.91 time: 0.331161 Sep 16 12:50:13.378098 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 645/1247] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:50:13 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1555 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:50:13.607233 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-27d1b4d3-e207-4977-b5d0-ab64d288fcc4 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:13.621841 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-27d1b4d3-e207-4977-b5d0-ab64d288fcc4 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac" status: 200 len: 1308 microversion: 2.1 time: 0.448721 Sep 16 12:50:13.623934 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 603/1248] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:13 2022] GET /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac => generated 1308 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:14.001778 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-15589ad2-b7d8-40c0-9159-bd0fec8b7f83 req-af792899-4e54-46da-84f7-c69692165033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96ff60ae-143a-4ae5-9c18-aff09a5c80cd", "name": "network-vif-deleted", "tag": "86268f4b-8663-42c1-8d76-59058c635845"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:50:14.063853 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-15589ad2-b7d8-40c0-9159-bd0fec8b7f83 req-af792899-4e54-46da-84f7-c69692165033 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:14.068350 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-15589ad2-b7d8-40c0-9159-bd0fec8b7f83 req-af792899-4e54-46da-84f7-c69692165033 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:14.068634 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f49f6f3d-599e-4cf4-a7f0-e7393d01c84b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:14.068634 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f49f6f3d-599e-4cf4-a7f0-e7393d01c84b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:14.070407 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-15589ad2-b7d8-40c0-9159-bd0fec8b7f83 req-af792899-4e54-46da-84f7-c69692165033 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:14.081181 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f49f6f3d-599e-4cf4-a7f0-e7393d01c84b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:14.081615 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f49f6f3d-599e-4cf4-a7f0-e7393d01c84b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:14.097175 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f49f6f3d-599e-4cf4-a7f0-e7393d01c84b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:14.108175 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f49f6f3d-599e-4cf4-a7f0-e7393d01c84b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:14.109986 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f49f6f3d-599e-4cf4-a7f0-e7393d01c84b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:14.111435 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-15589ad2-b7d8-40c0-9159-bd0fec8b7f83 req-af792899-4e54-46da-84f7-c69692165033 service nova] Creating event network-vif-deleted:86268f4b-8663-42c1-8d76-59058c635845 for instance 96ff60ae-143a-4ae5-9c18-aff09a5c80cd on n-h1-858094-4 Sep 16 12:50:14.113750 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f49f6f3d-599e-4cf4-a7f0-e7393d01c84b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:14.144713 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-15589ad2-b7d8-40c0-9159-bd0fec8b7f83 req-af792899-4e54-46da-84f7-c69692165033 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146721 Sep 16 12:50:14.153422 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 646/1249] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:50:14.194381 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-19615f45-ff7b-44e9-aac9-2707737291c9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:14.196815 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-19615f45-ff7b-44e9-aac9-2707737291c9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 96ff60ae-143a-4ae5-9c18-aff09a5c80cd] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:14.223482 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19615f45-ff7b-44e9-aac9-2707737291c9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:14.223990 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19615f45-ff7b-44e9-aac9-2707737291c9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:14.224471 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19615f45-ff7b-44e9-aac9-2707737291c9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:14.225199 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19615f45-ff7b-44e9-aac9-2707737291c9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:14.225654 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19615f45-ff7b-44e9-aac9-2707737291c9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:14.226075 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19615f45-ff7b-44e9-aac9-2707737291c9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:14.314252 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19615f45-ff7b-44e9-aac9-2707737291c9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:14.314740 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19615f45-ff7b-44e9-aac9-2707737291c9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:14.317204 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19615f45-ff7b-44e9-aac9-2707737291c9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:14.317204 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-19615f45-ff7b-44e9-aac9-2707737291c9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lazy-loading 'fault' on Instance uuid 96ff60ae-143a-4ae5-9c18-aff09a5c80cd {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:50:14.483553 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-19615f45-ff7b-44e9-aac9-2707737291c9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:14.498693 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-19615f45-ff7b-44e9-aac9-2707737291c9 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd" status: 200 len: 1306 microversion: 2.1 time: 0.339783 Sep 16 12:50:14.499297 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 647/1250] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:14 2022] GET /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd => generated 1306 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:14.529537 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c0119b16-c2e0-429b-8d23-d8b0c029e8f9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:14.531961 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c0119b16-c2e0-429b-8d23-d8b0c029e8f9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:14.542732 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0119b16-c2e0-429b-8d23-d8b0c029e8f9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:14.545142 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0119b16-c2e0-429b-8d23-d8b0c029e8f9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:14.546011 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0119b16-c2e0-429b-8d23-d8b0c029e8f9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:14.550495 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0119b16-c2e0-429b-8d23-d8b0c029e8f9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:14.551287 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0119b16-c2e0-429b-8d23-d8b0c029e8f9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:14.552006 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0119b16-c2e0-429b-8d23-d8b0c029e8f9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:15.144790 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c0119b16-c2e0-429b-8d23-d8b0c029e8f9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:15.161556 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c0119b16-c2e0-429b-8d23-d8b0c029e8f9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:15.163637 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c0119b16-c2e0-429b-8d23-d8b0c029e8f9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:15.199142 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c0119b16-c2e0-429b-8d23-d8b0c029e8f9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1555 microversion: 2.91 time: 0.684320 Sep 16 12:50:15.201303 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 648/1251] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:50:14 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1555 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:50:15.253271 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f49f6f3d-599e-4cf4-a7f0-e7393d01c84b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:15.259472 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a5c9c5dc-5816-443e-9f31-1bb10d1c505a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:15.261237 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a5c9c5dc-5816-443e-9f31-1bb10d1c505a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:15.271814 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f49f6f3d-599e-4cf4-a7f0-e7393d01c84b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1378 microversion: 2.1 time: 1.207601 Sep 16 12:50:15.274309 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 604/1252] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:14 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1378 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:50:15.290228 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5c9c5dc-5816-443e-9f31-1bb10d1c505a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:15.290557 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5c9c5dc-5816-443e-9f31-1bb10d1c505a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:15.300542 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5c9c5dc-5816-443e-9f31-1bb10d1c505a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:15.302140 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5c9c5dc-5816-443e-9f31-1bb10d1c505a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:15.302908 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5c9c5dc-5816-443e-9f31-1bb10d1c505a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:15.303538 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5c9c5dc-5816-443e-9f31-1bb10d1c505a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:15.526415 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-afba819c-f5ff-4d31-84a1-b7f19f6d0289 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:15.527162 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-afba819c-f5ff-4d31-84a1-b7f19f6d0289 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 96ff60ae-143a-4ae5-9c18-aff09a5c80cd] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:15.540176 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-afba819c-f5ff-4d31-84a1-b7f19f6d0289 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:15.540835 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-afba819c-f5ff-4d31-84a1-b7f19f6d0289 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:15.541549 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-afba819c-f5ff-4d31-84a1-b7f19f6d0289 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:15.542951 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-afba819c-f5ff-4d31-84a1-b7f19f6d0289 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:15.543932 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-afba819c-f5ff-4d31-84a1-b7f19f6d0289 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:15.545799 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-afba819c-f5ff-4d31-84a1-b7f19f6d0289 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:15.591967 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-afba819c-f5ff-4d31-84a1-b7f19f6d0289 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] HTTP exception thrown: Instance 96ff60ae-143a-4ae5-9c18-aff09a5c80cd could not be found. Sep 16 12:50:15.598858 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-afba819c-f5ff-4d31-84a1-b7f19f6d0289 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Request method failure captured: Sep 16 12:50:15.598858 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd HTTP/1.1 Sep 16 12:50:15.598858 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:50:15.598858 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:50:15.598858 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:50:15.598858 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:50:15.598858 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:50:15.598858 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:50:15.598858 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:50:15.598858 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:50:15.598858 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHBjUf33JuiB067clS1pRc16KayMcfeeik_2N8qe1xVSws5r9dYJMo_cNLvp1lekO_QhmumFAa7ZdFpMFE4TUtIimhBv92jzTfY_v-8Zx2FEsNx-tLPQhXJ5HSs2Mpeu7Bs3Mkhe9HBesD1Uxdgz5IaUm8Ssa3r2ZDecZ2Zv1_45ono Sep 16 12:50:15.598858 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:50:15.598858 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:50:15.598858 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:50:15.598858 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:50:15.598858 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:50:15.598858 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:50:15.598858 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 8c037a6456444018a6ef54314419e2f2 Sep 16 12:50:15.598858 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ServersOnMultiNodesTest-1155904382 Sep 16 12:50:15.598858 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:50:15.598858 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:50:15.600623 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c037a6456444018a6ef54314419e2f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8c037a6456444018a6ef54314419e2f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8c037a6456444018a6ef54314419e2f2", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c037a6456444018a6ef54314419e2f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:50:15.600623 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ServersOnMultiNodesTest-1155904382 Sep 16 12:50:15.600623 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 8c037a6456444018a6ef54314419e2f2 Sep 16 12:50:15.600623 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1155904382 Sep 16 12:50:15.600623 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ServersOnMultiNodesTest-1155904382-project Sep 16 12:50:15.600623 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:50:15.600623 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:50:15.600623 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: c1928790cac542ec86add5794851f97a Sep 16 12:50:15.600623 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ServersOnMultiNodesTest-1155904382-project Sep 16 12:50:15.600623 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:50:15.600623 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance 96ff60ae-143a-4ae5-9c18-aff09a5c80cd could not be found. Sep 16 12:50:15.600623 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '96ff60ae-143a-4ae5-9c18-aff09a5c80cd'} Sep 16 12:50:15.601553 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:50:15.601553 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:15.601553 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:50:15.601553 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:50:15.601553 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:50:15.601553 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:50:15.601553 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:50:15.601553 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:50:15.601553 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:50:15.601553 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:50:15.601553 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96ff60ae-143a-4ae5-9c18-aff09a5c80cd could not be found. Sep 16 12:50:15.601553 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:15.601553 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:50:15.601553 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:15.601553 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:15.601553 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:50:15.601553 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:50:15.601553 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:50:15.601553 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:50:15.601553 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:50:15.602787 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:50:15.602787 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:50:15.602787 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:50:15.602787 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:50:15.602787 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:50:15.602787 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:50:15.602787 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:50:15.602787 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96ff60ae-143a-4ae5-9c18-aff09a5c80cd could not be found. Sep 16 12:50:15.602787 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:15.602787 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:50:15.602787 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:15.602787 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:15.602787 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:50:15.602787 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:50:15.602787 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:50:15.602787 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:50:15.602787 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96ff60ae-143a-4ae5-9c18-aff09a5c80cd could not be found. Sep 16 12:50:15.602787 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:15.603904 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-afba819c-f5ff-4d31-84a1-b7f19f6d0289 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Returning 404 to user: Instance 96ff60ae-143a-4ae5-9c18-aff09a5c80cd could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:50:15.603904 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-afba819c-f5ff-4d31-84a1-b7f19f6d0289 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd" status: 404 len: 111 microversion: 2.1 time: 0.079500 Sep 16 12:50:15.604054 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 605/1253] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:15 2022] GET /compute/v2.1/servers/96ff60ae-143a-4ae5-9c18-aff09a5c80cd => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:50:15.615566 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6eef0282-4ceb-4b86-982f-1dd15307aada tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:15.616079 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6eef0282-4ceb-4b86-982f-1dd15307aada tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: f6c03f63-cad2-4937-9963-7b180cca34f5] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:15.628458 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6eef0282-4ceb-4b86-982f-1dd15307aada tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:15.645205 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6eef0282-4ceb-4b86-982f-1dd15307aada tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:15.645952 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6eef0282-4ceb-4b86-982f-1dd15307aada tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:15.647817 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6eef0282-4ceb-4b86-982f-1dd15307aada tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:15.648879 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6eef0282-4ceb-4b86-982f-1dd15307aada tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:15.649391 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6eef0282-4ceb-4b86-982f-1dd15307aada tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:15.696417 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6eef0282-4ceb-4b86-982f-1dd15307aada tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: f6c03f63-cad2-4937-9963-7b180cca34f5] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:50:15.813379 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:50:15.838070 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a5c9c5dc-5816-443e-9f31-1bb10d1c505a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:15.854606 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a5c9c5dc-5816-443e-9f31-1bb10d1c505a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac" status: 200 len: 1308 microversion: 2.1 time: 0.612515 Sep 16 12:50:15.857090 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 649/1254] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:15 2022] GET /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac => generated 1308 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:15.918609 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6eef0282-4ceb-4b86-982f-1dd15307aada tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5" status: 204 len: 0 microversion: 2.1 time: 0.310613 Sep 16 12:50:15.924720 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 606/1255] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:50:15 2022] DELETE /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:50:15.930191 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-76b6a9f2-ea70-426e-8a8f-22be1adad66d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:15.931558 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-76b6a9f2-ea70-426e-8a8f-22be1adad66d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: f6c03f63-cad2-4937-9963-7b180cca34f5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:15.952054 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76b6a9f2-ea70-426e-8a8f-22be1adad66d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:15.952732 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76b6a9f2-ea70-426e-8a8f-22be1adad66d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:15.953283 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76b6a9f2-ea70-426e-8a8f-22be1adad66d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:15.954130 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76b6a9f2-ea70-426e-8a8f-22be1adad66d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:15.954713 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76b6a9f2-ea70-426e-8a8f-22be1adad66d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:15.955266 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76b6a9f2-ea70-426e-8a8f-22be1adad66d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:16.270921 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f14260ef-bc2c-452a-99e4-0889d5732b0f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:16.271902 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f14260ef-bc2c-452a-99e4-0889d5732b0f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:16.289404 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f14260ef-bc2c-452a-99e4-0889d5732b0f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:16.291240 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f14260ef-bc2c-452a-99e4-0889d5732b0f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:16.292458 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f14260ef-bc2c-452a-99e4-0889d5732b0f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:16.296212 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f14260ef-bc2c-452a-99e4-0889d5732b0f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:16.297901 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f14260ef-bc2c-452a-99e4-0889d5732b0f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:16.299386 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f14260ef-bc2c-452a-99e4-0889d5732b0f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:16.312310 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-76b6a9f2-ea70-426e-8a8f-22be1adad66d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:16.318738 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=8 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:50:16.321452 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-76b6a9f2-ea70-426e-8a8f-22be1adad66d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5" status: 200 len: 1473 microversion: 2.1 time: 0.395316 Sep 16 12:50:16.333295 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 650/1256] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:15 2022] GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5 => generated 1473 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:16.338412 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-360b29b2-9397-4249-85ec-1c8ecd9b7ec4 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:16.339040 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-360b29b2-9397-4249-85ec-1c8ecd9b7ec4 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:16.368360 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-360b29b2-9397-4249-85ec-1c8ecd9b7ec4 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:16.368981 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-360b29b2-9397-4249-85ec-1c8ecd9b7ec4 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:16.374892 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-360b29b2-9397-4249-85ec-1c8ecd9b7ec4 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:16.375839 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-360b29b2-9397-4249-85ec-1c8ecd9b7ec4 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:16.376350 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-360b29b2-9397-4249-85ec-1c8ecd9b7ec4 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:16.376784 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-360b29b2-9397-4249-85ec-1c8ecd9b7ec4 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:16.445507 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f14260ef-bc2c-452a-99e4-0889d5732b0f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:16.463681 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f14260ef-bc2c-452a-99e4-0889d5732b0f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:16.465195 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f14260ef-bc2c-452a-99e4-0889d5732b0f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:16.470761 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f14260ef-bc2c-452a-99e4-0889d5732b0f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1555 microversion: 2.91 time: 0.219058 Sep 16 12:50:16.472321 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 607/1257] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:50:16 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1555 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:50:16.751368 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-360b29b2-9397-4249-85ec-1c8ecd9b7ec4 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:16.773479 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-360b29b2-9397-4249-85ec-1c8ecd9b7ec4 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1528 microversion: 2.1 time: 0.438786 Sep 16 12:50:16.774939 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 651/1258] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:16 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1528 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:16.797739 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8d73ac45-1c48-4407-8234-e82df40dd33f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:16.798716 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8d73ac45-1c48-4407-8234-e82df40dd33f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:16.807793 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8d73ac45-1c48-4407-8234-e82df40dd33f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:16.808754 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8d73ac45-1c48-4407-8234-e82df40dd33f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:16.809421 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8d73ac45-1c48-4407-8234-e82df40dd33f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:16.813585 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8d73ac45-1c48-4407-8234-e82df40dd33f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:16.814479 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8d73ac45-1c48-4407-8234-e82df40dd33f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:16.815736 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8d73ac45-1c48-4407-8234-e82df40dd33f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:16.884340 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-23cff489-dfe2-4c6c-987d-13ccde46c309 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:16.886782 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-23cff489-dfe2-4c6c-987d-13ccde46c309 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:16.911085 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23cff489-dfe2-4c6c-987d-13ccde46c309 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:16.911843 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23cff489-dfe2-4c6c-987d-13ccde46c309 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:16.912469 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23cff489-dfe2-4c6c-987d-13ccde46c309 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:16.913239 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23cff489-dfe2-4c6c-987d-13ccde46c309 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:16.913841 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23cff489-dfe2-4c6c-987d-13ccde46c309 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:16.914272 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23cff489-dfe2-4c6c-987d-13ccde46c309 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:17.261247 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-23cff489-dfe2-4c6c-987d-13ccde46c309 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:17.270223 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-23cff489-dfe2-4c6c-987d-13ccde46c309 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac" status: 200 len: 1308 microversion: 2.1 time: 0.393595 Sep 16 12:50:17.277839 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8d73ac45-1c48-4407-8234-e82df40dd33f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:17.283138 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 652/1259] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:16 2022] GET /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac => generated 1308 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:17.288678 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8d73ac45-1c48-4407-8234-e82df40dd33f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1528 microversion: 2.1 time: 0.495343 Sep 16 12:50:17.300703 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 608/1260] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:16 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1528 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:17.319038 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-83814252-abd0-4829-b990-c88c254725b2 tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:17.350525 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-83814252-abd0-4829-b990-c88c254725b2 tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/2c986fa9-53ef-4e69-8dea-d107da49319f" status: 202 len: 0 microversion: 2.1 time: 0.030741 Sep 16 12:50:17.356159 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-94eee17b-b484-4fab-8ccd-be4316dcd612 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:17.356649 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-94eee17b-b484-4fab-8ccd-be4316dcd612 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: f6c03f63-cad2-4937-9963-7b180cca34f5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:17.364036 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 609/1261] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:50:17 2022] DELETE /compute/v2.1/flavors/2c986fa9-53ef-4e69-8dea-d107da49319f => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:50:17.377292 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c91965a2-3f7e-49f4-b1dc-aa37fe5fbd0a tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:17.379817 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94eee17b-b484-4fab-8ccd-be4316dcd612 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:17.380423 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94eee17b-b484-4fab-8ccd-be4316dcd612 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:17.380882 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94eee17b-b484-4fab-8ccd-be4316dcd612 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:17.381976 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94eee17b-b484-4fab-8ccd-be4316dcd612 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:17.388495 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94eee17b-b484-4fab-8ccd-be4316dcd612 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:17.389139 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94eee17b-b484-4fab-8ccd-be4316dcd612 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:17.412908 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c91965a2-3f7e-49f4-b1dc-aa37fe5fbd0a tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047713 Sep 16 12:50:17.414166 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 610/1262] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:50:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:17.434943 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-49fa826a-b016-4b45-95c8-7d7907768a55 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:50:17.437888 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-49fa826a-b016-4b45-95c8-7d7907768a55 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:17.451982 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-49fa826a-b016-4b45-95c8-7d7907768a55 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:17.458999 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-49fa826a-b016-4b45-95c8-7d7907768a55 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:17.459686 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-49fa826a-b016-4b45-95c8-7d7907768a55 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:17.460584 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-49fa826a-b016-4b45-95c8-7d7907768a55 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:17.465120 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-49fa826a-b016-4b45-95c8-7d7907768a55 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:17.465730 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-49fa826a-b016-4b45-95c8-7d7907768a55 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:17.553538 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-49fa826a-b016-4b45-95c8-7d7907768a55 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:17.568625 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-49fa826a-b016-4b45-95c8-7d7907768a55 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Old instance type tempest-test_resize_flavor_-2017932822, new instance type m1.heat {{(pid=128780) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 16 12:50:17.630035 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-49fa826a-b016-4b45-95c8-7d7907768a55 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:50:17.630944 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-49fa826a-b016-4b45-95c8-7d7907768a55 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:50:17.631897 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-49fa826a-b016-4b45-95c8-7d7907768a55 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:50:17.632759 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-49fa826a-b016-4b45-95c8-7d7907768a55 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:50:17.633613 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-49fa826a-b016-4b45-95c8-7d7907768a55 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:50:17.675525 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-94eee17b-b484-4fab-8ccd-be4316dcd612 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:17.685384 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-94eee17b-b484-4fab-8ccd-be4316dcd612 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5" status: 200 len: 1473 microversion: 2.1 time: 0.333681 Sep 16 12:50:17.686032 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 653/1263] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:17 2022] GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5 => generated 1473 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:17.701343 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fea99447-78be-44dc-8f37-a8f710a6574c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:17.702276 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fea99447-78be-44dc-8f37-a8f710a6574c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:17.704500 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:50:17.721074 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fea99447-78be-44dc-8f37-a8f710a6574c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:17.721879 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fea99447-78be-44dc-8f37-a8f710a6574c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:17.722497 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fea99447-78be-44dc-8f37-a8f710a6574c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:17.723442 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fea99447-78be-44dc-8f37-a8f710a6574c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:17.724767 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fea99447-78be-44dc-8f37-a8f710a6574c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:17.725894 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fea99447-78be-44dc-8f37-a8f710a6574c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:17.881000 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fea99447-78be-44dc-8f37-a8f710a6574c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:17.882816 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-49fa826a-b016-4b45-95c8-7d7907768a55 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "POST /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7/action" status: 202 len: 0 microversion: 2.1 time: 0.452058 Sep 16 12:50:17.884242 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 611/1264] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:50:17 2022] POST /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7/action => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:50:17.898777 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fea99447-78be-44dc-8f37-a8f710a6574c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:17.902494 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fea99447-78be-44dc-8f37-a8f710a6574c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:17.902787 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-599770f3-e9aa-43ec-8ef9-e8aa7fa4825f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:17.903732 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-599770f3-e9aa-43ec-8ef9-e8aa7fa4825f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:17.914654 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fea99447-78be-44dc-8f37-a8f710a6574c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1555 microversion: 2.91 time: 0.217145 Sep 16 12:50:17.919158 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-599770f3-e9aa-43ec-8ef9-e8aa7fa4825f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:17.919907 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-599770f3-e9aa-43ec-8ef9-e8aa7fa4825f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:17.920544 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-599770f3-e9aa-43ec-8ef9-e8aa7fa4825f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:17.921427 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-599770f3-e9aa-43ec-8ef9-e8aa7fa4825f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:17.921710 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 654/1265] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:50:17 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1555 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:50:17.922478 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-599770f3-e9aa-43ec-8ef9-e8aa7fa4825f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:17.923053 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-599770f3-e9aa-43ec-8ef9-e8aa7fa4825f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:18.281315 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-599770f3-e9aa-43ec-8ef9-e8aa7fa4825f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:18.295652 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-599770f3-e9aa-43ec-8ef9-e8aa7fa4825f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1537 microversion: 2.1 time: 0.404013 Sep 16 12:50:18.308148 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 612/1266] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:17 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1537 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:18.313623 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0cce9949-d0f0-487a-a259-a52a96dae366 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:18.314515 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0cce9949-d0f0-487a-a259-a52a96dae366 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:18.334138 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0cce9949-d0f0-487a-a259-a52a96dae366 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:18.334509 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0cce9949-d0f0-487a-a259-a52a96dae366 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:18.334933 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0cce9949-d0f0-487a-a259-a52a96dae366 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:18.335642 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0cce9949-d0f0-487a-a259-a52a96dae366 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:18.336099 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0cce9949-d0f0-487a-a259-a52a96dae366 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:18.336553 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0cce9949-d0f0-487a-a259-a52a96dae366 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:18.543573 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0cce9949-d0f0-487a-a259-a52a96dae366 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:18.557098 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0cce9949-d0f0-487a-a259-a52a96dae366 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac" status: 200 len: 1308 microversion: 2.1 time: 0.247161 Sep 16 12:50:18.572723 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 655/1267] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:18 2022] GET /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac => generated 1308 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:18.716879 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8244a928-33a7-4cb2-82da-7f5050955746 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:18.717891 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8244a928-33a7-4cb2-82da-7f5050955746 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: f6c03f63-cad2-4937-9963-7b180cca34f5] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:18.732111 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8244a928-33a7-4cb2-82da-7f5050955746 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:18.733018 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8244a928-33a7-4cb2-82da-7f5050955746 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:18.733609 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8244a928-33a7-4cb2-82da-7f5050955746 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:18.734501 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8244a928-33a7-4cb2-82da-7f5050955746 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:18.744724 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8244a928-33a7-4cb2-82da-7f5050955746 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:18.745525 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8244a928-33a7-4cb2-82da-7f5050955746 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:18.951351 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-17440e7d-24ae-447f-8cbd-d6ffcf1a85e9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:18.952835 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-17440e7d-24ae-447f-8cbd-d6ffcf1a85e9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:18.961223 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17440e7d-24ae-447f-8cbd-d6ffcf1a85e9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:18.962077 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17440e7d-24ae-447f-8cbd-d6ffcf1a85e9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:18.962686 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17440e7d-24ae-447f-8cbd-d6ffcf1a85e9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:18.963558 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17440e7d-24ae-447f-8cbd-d6ffcf1a85e9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:18.964537 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17440e7d-24ae-447f-8cbd-d6ffcf1a85e9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:18.965129 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17440e7d-24ae-447f-8cbd-d6ffcf1a85e9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:19.301790 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-17440e7d-24ae-447f-8cbd-d6ffcf1a85e9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:19.323907 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-17440e7d-24ae-447f-8cbd-d6ffcf1a85e9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:19.326240 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-17440e7d-24ae-447f-8cbd-d6ffcf1a85e9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:19.339599 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-17440e7d-24ae-447f-8cbd-d6ffcf1a85e9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1555 microversion: 2.91 time: 0.396538 Sep 16 12:50:19.351681 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 656/1268] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:50:18 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1555 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:50:19.358522 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8783ea66-8ab2-42ce-a42a-db89d2482836 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:19.367041 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8783ea66-8ab2-42ce-a42a-db89d2482836 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:19.383216 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8783ea66-8ab2-42ce-a42a-db89d2482836 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:19.388990 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8783ea66-8ab2-42ce-a42a-db89d2482836 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:19.389941 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8783ea66-8ab2-42ce-a42a-db89d2482836 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:19.390992 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8783ea66-8ab2-42ce-a42a-db89d2482836 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:19.392637 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8783ea66-8ab2-42ce-a42a-db89d2482836 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:19.394088 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8783ea66-8ab2-42ce-a42a-db89d2482836 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:19.428635 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8244a928-33a7-4cb2-82da-7f5050955746 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:19.443666 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8244a928-33a7-4cb2-82da-7f5050955746 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5" status: 200 len: 1473 microversion: 2.1 time: 0.737527 Sep 16 12:50:19.465136 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 613/1269] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:18 2022] GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5 => generated 1473 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:19.583209 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7c6e1167-ea2e-4aa1-bd04-75f9d61ea9da tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:19.583845 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7c6e1167-ea2e-4aa1-bd04-75f9d61ea9da tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:19.593160 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7c6e1167-ea2e-4aa1-bd04-75f9d61ea9da tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:19.593918 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8783ea66-8ab2-42ce-a42a-db89d2482836 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:19.595381 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7c6e1167-ea2e-4aa1-bd04-75f9d61ea9da tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:19.596619 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7c6e1167-ea2e-4aa1-bd04-75f9d61ea9da tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:19.601903 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7c6e1167-ea2e-4aa1-bd04-75f9d61ea9da tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:19.602875 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7c6e1167-ea2e-4aa1-bd04-75f9d61ea9da tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:19.603411 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8783ea66-8ab2-42ce-a42a-db89d2482836 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1537 microversion: 2.1 time: 0.250155 Sep 16 12:50:19.604354 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 657/1270] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:19 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1537 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:19.604789 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7c6e1167-ea2e-4aa1-bd04-75f9d61ea9da tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:19.871191 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7c6e1167-ea2e-4aa1-bd04-75f9d61ea9da tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:19.884670 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7c6e1167-ea2e-4aa1-bd04-75f9d61ea9da tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac" status: 200 len: 1308 microversion: 2.1 time: 0.307166 Sep 16 12:50:19.899223 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 614/1271] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:19 2022] GET /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac => generated 1308 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:20.378689 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-32ed3026-f085-46ed-a2fd-0ed4e2a62651 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:20.380207 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-32ed3026-f085-46ed-a2fd-0ed4e2a62651 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:20.388491 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32ed3026-f085-46ed-a2fd-0ed4e2a62651 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:20.389355 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32ed3026-f085-46ed-a2fd-0ed4e2a62651 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:20.389879 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32ed3026-f085-46ed-a2fd-0ed4e2a62651 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:20.390592 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32ed3026-f085-46ed-a2fd-0ed4e2a62651 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:20.391041 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32ed3026-f085-46ed-a2fd-0ed4e2a62651 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:20.391461 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32ed3026-f085-46ed-a2fd-0ed4e2a62651 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:20.411299 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:50:20.471941 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b0a1cce5-625f-43ee-8213-7b49c2e387ae tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:20.476505 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-32ed3026-f085-46ed-a2fd-0ed4e2a62651 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:20.481090 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b0a1cce5-625f-43ee-8213-7b49c2e387ae tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: f6c03f63-cad2-4937-9963-7b180cca34f5] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:20.491106 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-32ed3026-f085-46ed-a2fd-0ed4e2a62651 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:20.493818 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-32ed3026-f085-46ed-a2fd-0ed4e2a62651 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:20.496932 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b0a1cce5-625f-43ee-8213-7b49c2e387ae tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:20.498602 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b0a1cce5-625f-43ee-8213-7b49c2e387ae tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:20.499429 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b0a1cce5-625f-43ee-8213-7b49c2e387ae tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:20.500318 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-32ed3026-f085-46ed-a2fd-0ed4e2a62651 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1555 microversion: 2.91 time: 0.127266 Sep 16 12:50:20.500729 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b0a1cce5-625f-43ee-8213-7b49c2e387ae tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:20.501729 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b0a1cce5-625f-43ee-8213-7b49c2e387ae tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:20.503055 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b0a1cce5-625f-43ee-8213-7b49c2e387ae tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:20.511209 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 658/1272] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:50:20 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1555 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:50:20.632719 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-35224e5d-3e05-4d96-ba5c-b8274dc2f8f1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:20.634231 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-35224e5d-3e05-4d96-ba5c-b8274dc2f8f1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:20.654308 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35224e5d-3e05-4d96-ba5c-b8274dc2f8f1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:20.659171 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35224e5d-3e05-4d96-ba5c-b8274dc2f8f1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:20.661198 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35224e5d-3e05-4d96-ba5c-b8274dc2f8f1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:20.664394 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35224e5d-3e05-4d96-ba5c-b8274dc2f8f1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:20.665220 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35224e5d-3e05-4d96-ba5c-b8274dc2f8f1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:20.666045 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35224e5d-3e05-4d96-ba5c-b8274dc2f8f1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:20.777397 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-b0a1cce5-625f-43ee-8213-7b49c2e387ae tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:20.787017 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b0a1cce5-625f-43ee-8213-7b49c2e387ae tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5" status: 200 len: 1473 microversion: 2.1 time: 0.321095 Sep 16 12:50:20.793988 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 615/1273] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:20 2022] GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5 => generated 1473 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:20.911973 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6dad55ad-5357-47c8-a56a-55ca160d4eba tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:20.912809 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6dad55ad-5357-47c8-a56a-55ca160d4eba tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:20.926491 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6dad55ad-5357-47c8-a56a-55ca160d4eba tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:20.937564 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6dad55ad-5357-47c8-a56a-55ca160d4eba tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:20.938272 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6dad55ad-5357-47c8-a56a-55ca160d4eba tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:20.939252 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6dad55ad-5357-47c8-a56a-55ca160d4eba tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:20.940500 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6dad55ad-5357-47c8-a56a-55ca160d4eba tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:20.941170 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6dad55ad-5357-47c8-a56a-55ca160d4eba tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:21.139380 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-35224e5d-3e05-4d96-ba5c-b8274dc2f8f1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:21.155552 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-35224e5d-3e05-4d96-ba5c-b8274dc2f8f1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1537 microversion: 2.1 time: 0.530018 Sep 16 12:50:21.159051 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 659/1274] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:20 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1537 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:21.237720 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-acae86d8-5dd9-48e5-a0c8-d043d35a46f4 req-2093bb0b-eb10-4dee-8dc4-34487b405548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6c03f63-cad2-4937-9963-7b180cca34f5", "name": "network-vif-deleted", "tag": "d45dadfe-c229-4c51-b2e6-ad9d273fe116"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:50:21.249710 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-acae86d8-5dd9-48e5-a0c8-d043d35a46f4 req-2093bb0b-eb10-4dee-8dc4-34487b405548 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:21.250651 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-acae86d8-5dd9-48e5-a0c8-d043d35a46f4 req-2093bb0b-eb10-4dee-8dc4-34487b405548 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:21.251303 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-acae86d8-5dd9-48e5-a0c8-d043d35a46f4 req-2093bb0b-eb10-4dee-8dc4-34487b405548 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:21.266118 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-acae86d8-5dd9-48e5-a0c8-d043d35a46f4 req-2093bb0b-eb10-4dee-8dc4-34487b405548 service nova] Creating event network-vif-deleted:d45dadfe-c229-4c51-b2e6-ad9d273fe116 for instance f6c03f63-cad2-4937-9963-7b180cca34f5 on n-h2-858094-4 Sep 16 12:50:21.273453 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-acae86d8-5dd9-48e5-a0c8-d043d35a46f4 req-2093bb0b-eb10-4dee-8dc4-34487b405548 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040854 Sep 16 12:50:21.274341 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 660/1275] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:50:21.340239 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6dad55ad-5357-47c8-a56a-55ca160d4eba tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:21.375308 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6dad55ad-5357-47c8-a56a-55ca160d4eba tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac" status: 200 len: 1308 microversion: 2.1 time: 0.460405 Sep 16 12:50:21.378919 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 616/1276] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:20 2022] GET /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac => generated 1308 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:50:21.543869 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4fecfc32-928e-4dde-8357-fe576bea91e2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:21.548172 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4fecfc32-928e-4dde-8357-fe576bea91e2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:21.603114 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fecfc32-928e-4dde-8357-fe576bea91e2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:21.603629 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fecfc32-928e-4dde-8357-fe576bea91e2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:21.612980 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fecfc32-928e-4dde-8357-fe576bea91e2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:21.619980 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fecfc32-928e-4dde-8357-fe576bea91e2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:21.621795 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fecfc32-928e-4dde-8357-fe576bea91e2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:21.622262 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fecfc32-928e-4dde-8357-fe576bea91e2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:21.786658 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4fecfc32-928e-4dde-8357-fe576bea91e2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:21.815891 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3fa30f95-e2d8-46b8-8490-0095e2eb0364 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:21.817401 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3fa30f95-e2d8-46b8-8490-0095e2eb0364 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: f6c03f63-cad2-4937-9963-7b180cca34f5] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:21.817890 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4fecfc32-928e-4dde-8357-fe576bea91e2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:21.821745 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4fecfc32-928e-4dde-8357-fe576bea91e2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:21.825077 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3fa30f95-e2d8-46b8-8490-0095e2eb0364 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:21.826078 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3fa30f95-e2d8-46b8-8490-0095e2eb0364 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:21.826704 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3fa30f95-e2d8-46b8-8490-0095e2eb0364 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:21.827601 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3fa30f95-e2d8-46b8-8490-0095e2eb0364 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:21.828477 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3fa30f95-e2d8-46b8-8490-0095e2eb0364 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:21.829076 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3fa30f95-e2d8-46b8-8490-0095e2eb0364 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:21.840655 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4fecfc32-928e-4dde-8357-fe576bea91e2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1537 microversion: 2.91 time: 0.301726 Sep 16 12:50:21.843876 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 661/1277] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:50:21 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1537 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:50:21.898959 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3fa30f95-e2d8-46b8-8490-0095e2eb0364 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:21.899723 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3fa30f95-e2d8-46b8-8490-0095e2eb0364 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:21.900377 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3fa30f95-e2d8-46b8-8490-0095e2eb0364 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:21.901068 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-3fa30f95-e2d8-46b8-8490-0095e2eb0364 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lazy-loading 'fault' on Instance uuid f6c03f63-cad2-4937-9963-7b180cca34f5 {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:50:22.016323 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3fa30f95-e2d8-46b8-8490-0095e2eb0364 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:22.029033 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3fa30f95-e2d8-46b8-8490-0095e2eb0364 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5" status: 200 len: 1307 microversion: 2.1 time: 0.217110 Sep 16 12:50:22.030071 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 617/1278] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:21 2022] GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5 => generated 1307 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:50:22.056729 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-dcf646e4-4300-4565-8281-d84df789b69e req-358a1e26-e96e-4442-a030-4ebc6c1d6900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7725f9a0-ac02-47ad-a67f-a9d42c2a6aac", "name": "network-vif-plugged", "status": "completed", "tag": "e749f518-c322-429e-b87d-fb7a8eccab82"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:50:22.075357 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dcf646e4-4300-4565-8281-d84df789b69e req-358a1e26-e96e-4442-a030-4ebc6c1d6900 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:22.076805 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dcf646e4-4300-4565-8281-d84df789b69e req-358a1e26-e96e-4442-a030-4ebc6c1d6900 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:22.077429 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dcf646e4-4300-4565-8281-d84df789b69e req-358a1e26-e96e-4442-a030-4ebc6c1d6900 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:22.091856 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-dcf646e4-4300-4565-8281-d84df789b69e req-358a1e26-e96e-4442-a030-4ebc6c1d6900 service nova] Creating event network-vif-plugged:e749f518-c322-429e-b87d-fb7a8eccab82 for instance 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac on n-h2-858094-4 Sep 16 12:50:22.101128 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-dcf646e4-4300-4565-8281-d84df789b69e req-358a1e26-e96e-4442-a030-4ebc6c1d6900 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047941 Sep 16 12:50:22.104707 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 662/1279] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:50:22.203072 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-abc3441f-c54a-4f58-a491-93003acb1875 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:22.204036 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-abc3441f-c54a-4f58-a491-93003acb1875 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:22.219790 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-abc3441f-c54a-4f58-a491-93003acb1875 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:22.227524 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-abc3441f-c54a-4f58-a491-93003acb1875 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:22.228317 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-abc3441f-c54a-4f58-a491-93003acb1875 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:22.229250 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-abc3441f-c54a-4f58-a491-93003acb1875 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:22.229893 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-abc3441f-c54a-4f58-a491-93003acb1875 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:22.230507 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-abc3441f-c54a-4f58-a491-93003acb1875 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:22.402502 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8c70c0bc-ef2f-4c1e-a14b-5dd123b4c385 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:22.403223 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8c70c0bc-ef2f-4c1e-a14b-5dd123b4c385 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:22.422275 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c70c0bc-ef2f-4c1e-a14b-5dd123b4c385 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:22.423312 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c70c0bc-ef2f-4c1e-a14b-5dd123b4c385 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:22.424170 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c70c0bc-ef2f-4c1e-a14b-5dd123b4c385 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:22.426481 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c70c0bc-ef2f-4c1e-a14b-5dd123b4c385 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:22.427125 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c70c0bc-ef2f-4c1e-a14b-5dd123b4c385 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:22.429058 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c70c0bc-ef2f-4c1e-a14b-5dd123b4c385 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:22.935068 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-abc3441f-c54a-4f58-a491-93003acb1875 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:22.947487 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-abc3441f-c54a-4f58-a491-93003acb1875 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1537 microversion: 2.1 time: 0.748425 Sep 16 12:50:22.961840 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 618/1280] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:22 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1537 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:22.971364 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3d455c3d-c246-45dc-ad1c-38b666f8f24a tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:22.972091 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3d455c3d-c246-45dc-ad1c-38b666f8f24a tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:22.978785 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3d455c3d-c246-45dc-ad1c-38b666f8f24a tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:22.979636 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3d455c3d-c246-45dc-ad1c-38b666f8f24a tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:22.980409 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3d455c3d-c246-45dc-ad1c-38b666f8f24a tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:22.981758 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3d455c3d-c246-45dc-ad1c-38b666f8f24a tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:22.982499 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3d455c3d-c246-45dc-ad1c-38b666f8f24a tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:22.983187 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3d455c3d-c246-45dc-ad1c-38b666f8f24a tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:23.011833 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:50:23.037708 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8c70c0bc-ef2f-4c1e-a14b-5dd123b4c385 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:23.049022 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8c70c0bc-ef2f-4c1e-a14b-5dd123b4c385 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac" status: 200 len: 1308 microversion: 2.1 time: 0.650356 Sep 16 12:50:23.049830 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 663/1281] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:22 2022] GET /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac => generated 1308 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:50:23.058651 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0c5321e3-d2d2-4d9b-a58a-91018f6e4135 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:23.059503 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0c5321e3-d2d2-4d9b-a58a-91018f6e4135 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: f6c03f63-cad2-4937-9963-7b180cca34f5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:23.068400 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c5321e3-d2d2-4d9b-a58a-91018f6e4135 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:23.069377 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c5321e3-d2d2-4d9b-a58a-91018f6e4135 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:23.070052 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c5321e3-d2d2-4d9b-a58a-91018f6e4135 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:23.071198 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c5321e3-d2d2-4d9b-a58a-91018f6e4135 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:23.073027 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c5321e3-d2d2-4d9b-a58a-91018f6e4135 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:23.073742 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c5321e3-d2d2-4d9b-a58a-91018f6e4135 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:23.118508 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c5321e3-d2d2-4d9b-a58a-91018f6e4135 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:23.119985 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c5321e3-d2d2-4d9b-a58a-91018f6e4135 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:23.120739 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c5321e3-d2d2-4d9b-a58a-91018f6e4135 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:23.125809 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3d455c3d-c246-45dc-ad1c-38b666f8f24a tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:23.139927 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-0c5321e3-d2d2-4d9b-a58a-91018f6e4135 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lazy-loading 'fault' on Instance uuid f6c03f63-cad2-4937-9963-7b180cca34f5 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:50:23.140181 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3d455c3d-c246-45dc-ad1c-38b666f8f24a tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:23.142502 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3d455c3d-c246-45dc-ad1c-38b666f8f24a tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:23.158486 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3d455c3d-c246-45dc-ad1c-38b666f8f24a tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1537 microversion: 2.91 time: 0.194644 Sep 16 12:50:23.164017 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 619/1282] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:50:22 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1537 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:50:23.237959 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0c5321e3-d2d2-4d9b-a58a-91018f6e4135 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:23.246466 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0c5321e3-d2d2-4d9b-a58a-91018f6e4135 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5" status: 200 len: 1307 microversion: 2.1 time: 0.191859 Sep 16 12:50:23.260581 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 664/1283] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:23 2022] GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5 => generated 1307 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:23.979707 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fda4e41d-8942-482d-9964-1482968950ad tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:23.980446 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-fda4e41d-8942-482d-9964-1482968950ad tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:24.003862 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fda4e41d-8942-482d-9964-1482968950ad tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:24.004785 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fda4e41d-8942-482d-9964-1482968950ad tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:24.005832 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fda4e41d-8942-482d-9964-1482968950ad tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:24.007149 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fda4e41d-8942-482d-9964-1482968950ad tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:24.008351 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fda4e41d-8942-482d-9964-1482968950ad tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:24.009435 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fda4e41d-8942-482d-9964-1482968950ad tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:24.084697 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5f3cf998-a9d5-44ca-b66a-e2e03d58b453 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:24.085816 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5f3cf998-a9d5-44ca-b66a-e2e03d58b453 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:24.098107 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f3cf998-a9d5-44ca-b66a-e2e03d58b453 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:24.098896 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f3cf998-a9d5-44ca-b66a-e2e03d58b453 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:24.099645 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f3cf998-a9d5-44ca-b66a-e2e03d58b453 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:24.100885 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f3cf998-a9d5-44ca-b66a-e2e03d58b453 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:24.101952 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f3cf998-a9d5-44ca-b66a-e2e03d58b453 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:24.102978 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f3cf998-a9d5-44ca-b66a-e2e03d58b453 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:24.455144 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-fda4e41d-8942-482d-9964-1482968950ad tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:24.471688 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-fda4e41d-8942-482d-9964-1482968950ad tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1537 microversion: 2.1 time: 0.498395 Sep 16 12:50:24.488459 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 620/1284] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:23 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1537 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:24.488459 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e5489c25-2701-437d-b865-6d20b6a55745 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:24.488459 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e5489c25-2701-437d-b865-6d20b6a55745 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:24.488459 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e5489c25-2701-437d-b865-6d20b6a55745 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:24.488915 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e5489c25-2701-437d-b865-6d20b6a55745 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:24.488915 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e5489c25-2701-437d-b865-6d20b6a55745 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:24.488915 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e5489c25-2701-437d-b865-6d20b6a55745 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:24.488915 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e5489c25-2701-437d-b865-6d20b6a55745 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:24.489221 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e5489c25-2701-437d-b865-6d20b6a55745 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:24.501970 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5f3cf998-a9d5-44ca-b66a-e2e03d58b453 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:24.510742 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5f3cf998-a9d5-44ca-b66a-e2e03d58b453 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac" status: 200 len: 1308 microversion: 2.1 time: 0.434254 Sep 16 12:50:24.511631 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 665/1285] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:24 2022] GET /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac => generated 1308 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:50:24.516428 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7c394f3b-dd99-4556-98aa-33f496c486af tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:24.517054 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7c394f3b-dd99-4556-98aa-33f496c486af tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: f6c03f63-cad2-4937-9963-7b180cca34f5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:24.524251 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c394f3b-dd99-4556-98aa-33f496c486af tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:24.524752 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c394f3b-dd99-4556-98aa-33f496c486af tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:24.525361 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c394f3b-dd99-4556-98aa-33f496c486af tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:24.526087 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c394f3b-dd99-4556-98aa-33f496c486af tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:24.526548 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c394f3b-dd99-4556-98aa-33f496c486af tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:24.526970 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c394f3b-dd99-4556-98aa-33f496c486af tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:24.584074 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e5489c25-2701-437d-b865-6d20b6a55745 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:24.606807 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c394f3b-dd99-4556-98aa-33f496c486af tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:24.607168 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e5489c25-2701-437d-b865-6d20b6a55745 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:24.608432 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c394f3b-dd99-4556-98aa-33f496c486af tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:24.609402 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c394f3b-dd99-4556-98aa-33f496c486af tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:24.610476 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-7c394f3b-dd99-4556-98aa-33f496c486af tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lazy-loading 'fault' on Instance uuid f6c03f63-cad2-4937-9963-7b180cca34f5 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:50:24.613567 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e5489c25-2701-437d-b865-6d20b6a55745 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:24.630159 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e5489c25-2701-437d-b865-6d20b6a55745 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1540 microversion: 2.91 time: 0.154148 Sep 16 12:50:24.631699 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 621/1286] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:50:24 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1540 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:50:24.659554 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f7df4b72-db09-4920-a1a9-3d48aefac7be tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-858094-4"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:50:24.663651 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f7df4b72-db09-4920-a1a9-3d48aefac7be tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:24.670810 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f7df4b72-db09-4920-a1a9-3d48aefac7be tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:24.671548 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f7df4b72-db09-4920-a1a9-3d48aefac7be tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:24.672499 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f7df4b72-db09-4920-a1a9-3d48aefac7be tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:24.674058 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f7df4b72-db09-4920-a1a9-3d48aefac7be tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:24.674808 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f7df4b72-db09-4920-a1a9-3d48aefac7be tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:24.675698 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f7df4b72-db09-4920-a1a9-3d48aefac7be tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:24.686292 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7c394f3b-dd99-4556-98aa-33f496c486af tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:24.719931 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7c394f3b-dd99-4556-98aa-33f496c486af tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5" status: 200 len: 1307 microversion: 2.1 time: 0.200321 Sep 16 12:50:24.751993 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f7df4b72-db09-4920-a1a9-3d48aefac7be tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-858094-4". {{(pid=128780) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 16 12:50:24.766852 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 666/1287] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:24 2022] GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5 => generated 1307 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:24.878271 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f7df4b72-db09-4920-a1a9-3d48aefac7be tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d/action" status: 202 len: 0 microversion: 2.91 time: 0.223262 Sep 16 12:50:24.879134 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 622/1288] 10.222.0.67 () {62 vars in 1319 bytes} [Fri Sep 16 12:50:24 2022] POST /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 16 12:50:24.891655 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9b7dd76d-8880-4314-99e6-279e13c57254 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:24.893426 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9b7dd76d-8880-4314-99e6-279e13c57254 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:24.901504 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b7dd76d-8880-4314-99e6-279e13c57254 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:24.902202 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b7dd76d-8880-4314-99e6-279e13c57254 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:24.903258 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b7dd76d-8880-4314-99e6-279e13c57254 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:24.904568 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b7dd76d-8880-4314-99e6-279e13c57254 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:24.905510 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b7dd76d-8880-4314-99e6-279e13c57254 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:24.906249 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b7dd76d-8880-4314-99e6-279e13c57254 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:25.072957 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9b7dd76d-8880-4314-99e6-279e13c57254 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:25.085785 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9b7dd76d-8880-4314-99e6-279e13c57254 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:25.089459 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9b7dd76d-8880-4314-99e6-279e13c57254 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:25.097941 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9b7dd76d-8880-4314-99e6-279e13c57254 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1548 microversion: 2.91 time: 0.213472 Sep 16 12:50:25.099560 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 667/1289] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:50:24 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1548 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:50:25.503151 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-db7e2ae7-ae75-423e-a4e1-4b04c7538ea3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:25.507138 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-db7e2ae7-ae75-423e-a4e1-4b04c7538ea3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:25.529200 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db7e2ae7-ae75-423e-a4e1-4b04c7538ea3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:25.534053 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db7e2ae7-ae75-423e-a4e1-4b04c7538ea3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:25.542193 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8219281e-151e-4827-8c7a-70a90d0e0324 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:25.545313 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8219281e-151e-4827-8c7a-70a90d0e0324 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:25.553142 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db7e2ae7-ae75-423e-a4e1-4b04c7538ea3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:25.555910 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db7e2ae7-ae75-423e-a4e1-4b04c7538ea3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:25.558762 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db7e2ae7-ae75-423e-a4e1-4b04c7538ea3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:25.559469 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db7e2ae7-ae75-423e-a4e1-4b04c7538ea3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:25.572505 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8219281e-151e-4827-8c7a-70a90d0e0324 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:25.577876 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8219281e-151e-4827-8c7a-70a90d0e0324 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:25.578180 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8219281e-151e-4827-8c7a-70a90d0e0324 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:25.579438 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8219281e-151e-4827-8c7a-70a90d0e0324 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:25.597405 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8219281e-151e-4827-8c7a-70a90d0e0324 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:25.598610 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8219281e-151e-4827-8c7a-70a90d0e0324 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:26.128430 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-db7e2ae7-ae75-423e-a4e1-4b04c7538ea3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:26.152633 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-db7e2ae7-ae75-423e-a4e1-4b04c7538ea3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1542 microversion: 2.1 time: 0.650453 Sep 16 12:50:26.152633 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 623/1290] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:25 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1542 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:26.157469 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c50f28aa-c844-4077-831f-dc5e48967691 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:26.159434 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c50f28aa-c844-4077-831f-dc5e48967691 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: f6c03f63-cad2-4937-9963-7b180cca34f5] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:26.167532 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c50f28aa-c844-4077-831f-dc5e48967691 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:26.168459 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c50f28aa-c844-4077-831f-dc5e48967691 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:26.169074 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c50f28aa-c844-4077-831f-dc5e48967691 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:26.170217 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c50f28aa-c844-4077-831f-dc5e48967691 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:26.171060 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c50f28aa-c844-4077-831f-dc5e48967691 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:26.172622 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c50f28aa-c844-4077-831f-dc5e48967691 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:26.190710 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-c50f28aa-c844-4077-831f-dc5e48967691 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] HTTP exception thrown: Instance f6c03f63-cad2-4937-9963-7b180cca34f5 could not be found. Sep 16 12:50:26.194039 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c50f28aa-c844-4077-831f-dc5e48967691 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Request method failure captured: Sep 16 12:50:26.194039 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5 HTTP/1.1 Sep 16 12:50:26.194039 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:50:26.194039 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:50:26.194039 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:50:26.194039 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:50:26.194039 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:50:26.194039 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:50:26.194039 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:50:26.194039 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:50:26.194039 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHBjUf33JuiB067clS1pRc16KayMcfeeik_2N8qe1xVSws5r9dYJMo_cNLvp1lekO_QhmumFAa7ZdFpMFE4TUtIimhBv92jzTfY_v-8Zx2FEsNx-tLPQhXJ5HSs2Mpeu7Bs3Mkhe9HBesD1Uxdgz5IaUm8Ssa3r2ZDecZ2Zv1_45ono Sep 16 12:50:26.194039 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:50:26.194039 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:50:26.194039 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:50:26.194039 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:50:26.194039 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:50:26.194039 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:50:26.194039 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 8c037a6456444018a6ef54314419e2f2 Sep 16 12:50:26.194039 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ServersOnMultiNodesTest-1155904382 Sep 16 12:50:26.194039 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:50:26.194039 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:50:26.195881 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c037a6456444018a6ef54314419e2f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8c037a6456444018a6ef54314419e2f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8c037a6456444018a6ef54314419e2f2", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c037a6456444018a6ef54314419e2f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:50:26.195881 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ServersOnMultiNodesTest-1155904382 Sep 16 12:50:26.195881 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 8c037a6456444018a6ef54314419e2f2 Sep 16 12:50:26.195881 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1155904382 Sep 16 12:50:26.195881 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ServersOnMultiNodesTest-1155904382-project Sep 16 12:50:26.195881 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:50:26.195881 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:50:26.195881 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: c1928790cac542ec86add5794851f97a Sep 16 12:50:26.195881 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ServersOnMultiNodesTest-1155904382-project Sep 16 12:50:26.195881 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:50:26.195881 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance f6c03f63-cad2-4937-9963-7b180cca34f5 could not be found. Sep 16 12:50:26.195881 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'f6c03f63-cad2-4937-9963-7b180cca34f5'} Sep 16 12:50:26.196923 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:50:26.196923 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:26.196923 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:50:26.196923 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:50:26.196923 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:50:26.196923 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:50:26.196923 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:50:26.196923 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:50:26.196923 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:50:26.196923 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:50:26.196923 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6c03f63-cad2-4937-9963-7b180cca34f5 could not be found. Sep 16 12:50:26.196923 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:26.196923 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:50:26.196923 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:26.196923 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:26.196923 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:50:26.196923 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:50:26.196923 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:50:26.196923 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:50:26.196923 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:50:26.199534 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:50:26.199534 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:50:26.199534 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:50:26.199534 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:50:26.199534 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:50:26.199534 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:50:26.199534 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:50:26.199534 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6c03f63-cad2-4937-9963-7b180cca34f5 could not be found. Sep 16 12:50:26.199534 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:26.199534 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:50:26.199534 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:26.199534 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:26.199534 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:50:26.199534 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:50:26.199534 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:50:26.199534 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:50:26.199534 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6c03f63-cad2-4937-9963-7b180cca34f5 could not be found. Sep 16 12:50:26.199534 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:26.201706 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8219281e-151e-4827-8c7a-70a90d0e0324 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:26.203338 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c50f28aa-c844-4077-831f-dc5e48967691 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Returning 404 to user: Instance f6c03f63-cad2-4937-9963-7b180cca34f5 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:50:26.204738 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c50f28aa-c844-4077-831f-dc5e48967691 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5" status: 404 len: 111 microversion: 2.1 time: 0.051998 Sep 16 12:50:26.206440 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 624/1291] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:26 2022] GET /compute/v2.1/servers/f6c03f63-cad2-4937-9963-7b180cca34f5 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:50:26.212844 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5e0dc2d3-8156-4c03-bc4b-07e883f33a26 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:26.214390 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5e0dc2d3-8156-4c03-bc4b-07e883f33a26 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:26.218060 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8219281e-151e-4827-8c7a-70a90d0e0324 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac" status: 200 len: 1308 microversion: 2.1 time: 0.680046 Sep 16 12:50:26.219015 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 668/1292] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:25 2022] GET /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac => generated 1308 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:26.228041 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-42db53ee-d664-49fe-b5d9-e46acafe0deb tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:26.228712 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-42db53ee-d664-49fe-b5d9-e46acafe0deb tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: dd98275b-2759-4880-b280-fc6fc1614e93] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:26.238727 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-42db53ee-d664-49fe-b5d9-e46acafe0deb tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:26.239964 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-42db53ee-d664-49fe-b5d9-e46acafe0deb tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:26.240447 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5e0dc2d3-8156-4c03-bc4b-07e883f33a26 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:26.241155 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5e0dc2d3-8156-4c03-bc4b-07e883f33a26 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:26.241909 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-42db53ee-d664-49fe-b5d9-e46acafe0deb tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:26.242032 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5e0dc2d3-8156-4c03-bc4b-07e883f33a26 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:26.243362 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-42db53ee-d664-49fe-b5d9-e46acafe0deb tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:26.244204 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-42db53ee-d664-49fe-b5d9-e46acafe0deb tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:26.244930 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-42db53ee-d664-49fe-b5d9-e46acafe0deb tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:26.250871 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5e0dc2d3-8156-4c03-bc4b-07e883f33a26 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:26.252091 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5e0dc2d3-8156-4c03-bc4b-07e883f33a26 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:26.257053 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5e0dc2d3-8156-4c03-bc4b-07e883f33a26 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:26.311740 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-42db53ee-d664-49fe-b5d9-e46acafe0deb tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: dd98275b-2759-4880-b280-fc6fc1614e93] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:50:26.591568 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-42db53ee-d664-49fe-b5d9-e46acafe0deb tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "DELETE /compute/v2.1/servers/dd98275b-2759-4880-b280-fc6fc1614e93" status: 204 len: 0 microversion: 2.1 time: 0.370195 Sep 16 12:50:26.592641 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 669/1293] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:50:26 2022] DELETE /compute/v2.1/servers/dd98275b-2759-4880-b280-fc6fc1614e93 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:50:26.593563 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5e0dc2d3-8156-4c03-bc4b-07e883f33a26 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:26.610893 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5e0dc2d3-8156-4c03-bc4b-07e883f33a26 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:26.615192 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5e0dc2d3-8156-4c03-bc4b-07e883f33a26 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:26.615415 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-70f0fe52-be28-4489-8cc9-75b038273a20 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:26.615990 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-70f0fe52-be28-4489-8cc9-75b038273a20 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: dd98275b-2759-4880-b280-fc6fc1614e93] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:26.625410 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70f0fe52-be28-4489-8cc9-75b038273a20 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:26.626039 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70f0fe52-be28-4489-8cc9-75b038273a20 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:26.631817 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5e0dc2d3-8156-4c03-bc4b-07e883f33a26 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1548 microversion: 2.91 time: 0.423788 Sep 16 12:50:26.632361 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70f0fe52-be28-4489-8cc9-75b038273a20 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:26.632483 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 625/1294] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:50:26 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1548 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:50:26.633395 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70f0fe52-be28-4489-8cc9-75b038273a20 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:26.634066 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70f0fe52-be28-4489-8cc9-75b038273a20 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:26.634660 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70f0fe52-be28-4489-8cc9-75b038273a20 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:27.061633 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-70f0fe52-be28-4489-8cc9-75b038273a20 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:27.074012 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-70f0fe52-be28-4489-8cc9-75b038273a20 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/dd98275b-2759-4880-b280-fc6fc1614e93" status: 200 len: 1472 microversion: 2.1 time: 0.474204 Sep 16 12:50:27.076873 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 670/1295] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:26 2022] GET /compute/v2.1/servers/dd98275b-2759-4880-b280-fc6fc1614e93 => generated 1472 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:50:27.190696 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-410e2297-2034-4343-b458-1141e3c9b20e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:27.191324 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-410e2297-2034-4343-b458-1141e3c9b20e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:27.198047 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-410e2297-2034-4343-b458-1141e3c9b20e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:27.198545 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-410e2297-2034-4343-b458-1141e3c9b20e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:27.198984 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-410e2297-2034-4343-b458-1141e3c9b20e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:27.199701 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-410e2297-2034-4343-b458-1141e3c9b20e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:27.200429 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-410e2297-2034-4343-b458-1141e3c9b20e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:27.200857 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-410e2297-2034-4343-b458-1141e3c9b20e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:27.259351 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-16765f19-355b-4f79-9106-a5eb2793ab96 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:27.262545 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-16765f19-355b-4f79-9106-a5eb2793ab96 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:27.274023 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16765f19-355b-4f79-9106-a5eb2793ab96 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:27.274835 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16765f19-355b-4f79-9106-a5eb2793ab96 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:27.275560 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16765f19-355b-4f79-9106-a5eb2793ab96 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:27.276691 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16765f19-355b-4f79-9106-a5eb2793ab96 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:27.277337 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16765f19-355b-4f79-9106-a5eb2793ab96 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:27.277933 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16765f19-355b-4f79-9106-a5eb2793ab96 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:27.673188 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-410e2297-2034-4343-b458-1141e3c9b20e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:27.684614 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-410e2297-2034-4343-b458-1141e3c9b20e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1542 microversion: 2.1 time: 0.497772 Sep 16 12:50:27.686830 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 626/1296] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:27 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1542 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:27.697972 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-16765f19-355b-4f79-9106-a5eb2793ab96 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:27.712737 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-09b85c7e-111b-467b-86dd-a6bc56d20fd2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:27.713777 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-09b85c7e-111b-467b-86dd-a6bc56d20fd2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:27.714825 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-16765f19-355b-4f79-9106-a5eb2793ab96 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac" status: 200 len: 1489 microversion: 2.1 time: 0.463388 Sep 16 12:50:27.732157 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 671/1297] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:27 2022] GET /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac => generated 1489 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:27.739020 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-09b85c7e-111b-467b-86dd-a6bc56d20fd2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:27.739940 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-09b85c7e-111b-467b-86dd-a6bc56d20fd2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:27.740813 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-09b85c7e-111b-467b-86dd-a6bc56d20fd2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:27.741851 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-09b85c7e-111b-467b-86dd-a6bc56d20fd2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:27.748590 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-09b85c7e-111b-467b-86dd-a6bc56d20fd2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:27.749751 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-09b85c7e-111b-467b-86dd-a6bc56d20fd2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:27.762823 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-18c74b6f-a395-4ed3-8d6a-53bfd49fa9a1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:50:27.764025 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-18c74b6f-a395-4ed3-8d6a-53bfd49fa9a1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:27.809256 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18c74b6f-a395-4ed3-8d6a-53bfd49fa9a1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:27.811811 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18c74b6f-a395-4ed3-8d6a-53bfd49fa9a1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:27.812761 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18c74b6f-a395-4ed3-8d6a-53bfd49fa9a1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:27.813768 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18c74b6f-a395-4ed3-8d6a-53bfd49fa9a1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:27.814442 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18c74b6f-a395-4ed3-8d6a-53bfd49fa9a1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:27.814872 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18c74b6f-a395-4ed3-8d6a-53bfd49fa9a1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:27.866244 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-18c74b6f-a395-4ed3-8d6a-53bfd49fa9a1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lazy-loading 'flavor' on Instance uuid 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:50:27.905447 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-09b85c7e-111b-467b-86dd-a6bc56d20fd2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:27.922261 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-09b85c7e-111b-467b-86dd-a6bc56d20fd2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:27.924534 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-09b85c7e-111b-467b-86dd-a6bc56d20fd2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:27.938326 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-09b85c7e-111b-467b-86dd-a6bc56d20fd2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1490 microversion: 2.91 time: 0.250164 Sep 16 12:50:27.953385 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 627/1298] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:50:27 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1490 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:50:27.999147 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:50:28.025097 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-18c74b6f-a395-4ed3-8d6a-53bfd49fa9a1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "POST /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac/action" status: 202 len: 0 microversion: 2.1 time: 0.274842 Sep 16 12:50:28.026993 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 672/1299] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:50:27 2022] POST /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:50:28.037644 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1d6c178e-c13f-4548-bf0b-263b487bf45e tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:28.039195 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-1d6c178e-c13f-4548-bf0b-263b487bf45e tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:28.054905 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1d6c178e-c13f-4548-bf0b-263b487bf45e tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:28.056469 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1d6c178e-c13f-4548-bf0b-263b487bf45e tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:28.057397 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1d6c178e-c13f-4548-bf0b-263b487bf45e tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:28.059256 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1d6c178e-c13f-4548-bf0b-263b487bf45e tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:28.060070 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1d6c178e-c13f-4548-bf0b-263b487bf45e tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:28.060935 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1d6c178e-c13f-4548-bf0b-263b487bf45e tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:28.114619 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9fab4fe7-ef30-484b-9ed7-85bbdff5b28a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:28.118451 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9fab4fe7-ef30-484b-9ed7-85bbdff5b28a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: dd98275b-2759-4880-b280-fc6fc1614e93] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:28.138543 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9fab4fe7-ef30-484b-9ed7-85bbdff5b28a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:28.139684 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9fab4fe7-ef30-484b-9ed7-85bbdff5b28a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:28.150742 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9fab4fe7-ef30-484b-9ed7-85bbdff5b28a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:28.151805 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9fab4fe7-ef30-484b-9ed7-85bbdff5b28a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:28.152543 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9fab4fe7-ef30-484b-9ed7-85bbdff5b28a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:28.153364 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9fab4fe7-ef30-484b-9ed7-85bbdff5b28a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:28.814386 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1d6c178e-c13f-4548-bf0b-263b487bf45e tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:28.827730 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1d6c178e-c13f-4548-bf0b-263b487bf45e tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac" status: 200 len: 1497 microversion: 2.1 time: 0.795737 Sep 16 12:50:28.828370 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 628/1300] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:28 2022] GET /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac => generated 1497 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:28.865517 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f2f8c3d9-6829-4248-9331-5716f1892708 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:28.866153 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f2f8c3d9-6829-4248-9331-5716f1892708 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:28.874273 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f2f8c3d9-6829-4248-9331-5716f1892708 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:28.874766 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f2f8c3d9-6829-4248-9331-5716f1892708 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:28.875454 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f2f8c3d9-6829-4248-9331-5716f1892708 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:28.876632 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f2f8c3d9-6829-4248-9331-5716f1892708 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:28.878018 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f2f8c3d9-6829-4248-9331-5716f1892708 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:28.878688 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f2f8c3d9-6829-4248-9331-5716f1892708 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:28.912586 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9fab4fe7-ef30-484b-9ed7-85bbdff5b28a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:28.932717 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9fab4fe7-ef30-484b-9ed7-85bbdff5b28a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/dd98275b-2759-4880-b280-fc6fc1614e93" status: 200 len: 1472 microversion: 2.1 time: 0.828167 Sep 16 12:50:28.933651 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 673/1301] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:28 2022] GET /compute/v2.1/servers/dd98275b-2759-4880-b280-fc6fc1614e93 => generated 1472 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:28.973600 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2e42cb20-72ea-4bf6-b5c4-dc7917a0f39f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:28.974585 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2e42cb20-72ea-4bf6-b5c4-dc7917a0f39f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:28.989107 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e42cb20-72ea-4bf6-b5c4-dc7917a0f39f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:28.991638 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e42cb20-72ea-4bf6-b5c4-dc7917a0f39f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:28.995534 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e42cb20-72ea-4bf6-b5c4-dc7917a0f39f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:28.997418 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e42cb20-72ea-4bf6-b5c4-dc7917a0f39f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:28.998603 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e42cb20-72ea-4bf6-b5c4-dc7917a0f39f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:29.007015 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e42cb20-72ea-4bf6-b5c4-dc7917a0f39f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:29.224747 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2e42cb20-72ea-4bf6-b5c4-dc7917a0f39f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:29.245231 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f2f8c3d9-6829-4248-9331-5716f1892708 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:29.255322 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f2f8c3d9-6829-4248-9331-5716f1892708 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1542 microversion: 2.1 time: 0.400672 Sep 16 12:50:29.260702 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2e42cb20-72ea-4bf6-b5c4-dc7917a0f39f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:29.266638 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2e42cb20-72ea-4bf6-b5c4-dc7917a0f39f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:29.277589 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2e42cb20-72ea-4bf6-b5c4-dc7917a0f39f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1546 microversion: 2.91 time: 0.310162 Sep 16 12:50:29.296814 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 674/1302] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:50:28 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1546 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:50:29.299168 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 629/1303] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:28 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1542 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:29.852087 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4bdebbe0-768a-411a-8f03-7a6020afa3fb tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:29.852745 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4bdebbe0-768a-411a-8f03-7a6020afa3fb tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:29.865929 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4bdebbe0-768a-411a-8f03-7a6020afa3fb tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:29.866437 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4bdebbe0-768a-411a-8f03-7a6020afa3fb tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:29.867156 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4bdebbe0-768a-411a-8f03-7a6020afa3fb tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:29.868150 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4bdebbe0-768a-411a-8f03-7a6020afa3fb tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:29.869112 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4bdebbe0-768a-411a-8f03-7a6020afa3fb tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:29.870578 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4bdebbe0-768a-411a-8f03-7a6020afa3fb tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:29.959445 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3018f5fe-a264-402a-819f-7c20edfe8a30 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:29.961829 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3018f5fe-a264-402a-819f-7c20edfe8a30 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: dd98275b-2759-4880-b280-fc6fc1614e93] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:29.972509 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3018f5fe-a264-402a-819f-7c20edfe8a30 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:29.973314 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3018f5fe-a264-402a-819f-7c20edfe8a30 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:29.973960 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3018f5fe-a264-402a-819f-7c20edfe8a30 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:29.974882 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3018f5fe-a264-402a-819f-7c20edfe8a30 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:29.975524 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3018f5fe-a264-402a-819f-7c20edfe8a30 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:29.976143 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3018f5fe-a264-402a-819f-7c20edfe8a30 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:30.148980 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3018f5fe-a264-402a-819f-7c20edfe8a30 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:30.162097 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3018f5fe-a264-402a-819f-7c20edfe8a30 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/dd98275b-2759-4880-b280-fc6fc1614e93" status: 200 len: 1430 microversion: 2.1 time: 0.206910 Sep 16 12:50:30.163051 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 630/1304] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:29 2022] GET /compute/v2.1/servers/dd98275b-2759-4880-b280-fc6fc1614e93 => generated 1430 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:30.388532 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4bdebbe0-768a-411a-8f03-7a6020afa3fb tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:30.405013 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4bdebbe0-768a-411a-8f03-7a6020afa3fb tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac" status: 200 len: 1480 microversion: 2.1 time: 0.556768 Sep 16 12:50:30.409263 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 675/1305] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:29 2022] GET /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac => generated 1480 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:50:30.426146 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2f1e55f0-357f-493a-a3d5-2f96db170332 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:30.427134 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2f1e55f0-357f-493a-a3d5-2f96db170332 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:30.435564 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f1e55f0-357f-493a-a3d5-2f96db170332 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:30.438388 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f1e55f0-357f-493a-a3d5-2f96db170332 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:30.439748 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f1e55f0-357f-493a-a3d5-2f96db170332 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:30.445835 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f1e55f0-357f-493a-a3d5-2f96db170332 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:30.446481 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f1e55f0-357f-493a-a3d5-2f96db170332 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:30.447341 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f1e55f0-357f-493a-a3d5-2f96db170332 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:30.644760 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2f1e55f0-357f-493a-a3d5-2f96db170332 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:30.668676 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2f1e55f0-357f-493a-a3d5-2f96db170332 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:30.670319 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2f1e55f0-357f-493a-a3d5-2f96db170332 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:30.698531 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2f1e55f0-357f-493a-a3d5-2f96db170332 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1546 microversion: 2.91 time: 0.287619 Sep 16 12:50:30.699735 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 676/1306] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:50:30 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1546 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:50:30.717033 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ed502f0c-ad3e-4a69-9d88-91710ab4e85f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:30.717982 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ed502f0c-ad3e-4a69-9d88-91710ab4e85f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:30.734611 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-f0c994ca-2153-4161-81f0-14dd22580429 req-bdf415ef-38d8-4858-bfbd-5a1420fda1b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd98275b-2759-4880-b280-fc6fc1614e93", "name": "network-vif-deleted", "tag": "65db34e4-9d56-4846-9f39-709aa1748071"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:50:30.748022 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed502f0c-ad3e-4a69-9d88-91710ab4e85f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:30.748835 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed502f0c-ad3e-4a69-9d88-91710ab4e85f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:30.750267 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed502f0c-ad3e-4a69-9d88-91710ab4e85f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:30.752358 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed502f0c-ad3e-4a69-9d88-91710ab4e85f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:30.759938 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed502f0c-ad3e-4a69-9d88-91710ab4e85f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:30.760914 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed502f0c-ad3e-4a69-9d88-91710ab4e85f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:30.808226 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-f0c994ca-2153-4161-81f0-14dd22580429 req-bdf415ef-38d8-4858-bfbd-5a1420fda1b7 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:30.808744 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-f0c994ca-2153-4161-81f0-14dd22580429 req-bdf415ef-38d8-4858-bfbd-5a1420fda1b7 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:30.819828 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-f0c994ca-2153-4161-81f0-14dd22580429 req-bdf415ef-38d8-4858-bfbd-5a1420fda1b7 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:30.867966 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-f0c994ca-2153-4161-81f0-14dd22580429 req-bdf415ef-38d8-4858-bfbd-5a1420fda1b7 service nova] Creating event network-vif-deleted:65db34e4-9d56-4846-9f39-709aa1748071 for instance dd98275b-2759-4880-b280-fc6fc1614e93 on n-h2-858094-4 Sep 16 12:50:30.880696 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-f0c994ca-2153-4161-81f0-14dd22580429 req-bdf415ef-38d8-4858-bfbd-5a1420fda1b7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.694949 Sep 16 12:50:30.883016 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 631/1307] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:50:30.895943 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fdf530b6-bf38-4fe8-bb23-dca41f05ee42 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1496539813"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:50:30.899245 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-fdf530b6-bf38-4fe8-bb23-dca41f05ee42 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:30.915890 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:50:30.918338 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fdf530b6-bf38-4fe8-bb23-dca41f05ee42 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:30.919100 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fdf530b6-bf38-4fe8-bb23-dca41f05ee42 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:30.920914 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fdf530b6-bf38-4fe8-bb23-dca41f05ee42 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:30.923413 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fdf530b6-bf38-4fe8-bb23-dca41f05ee42 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:30.924289 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fdf530b6-bf38-4fe8-bb23-dca41f05ee42 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:30.924973 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fdf530b6-bf38-4fe8-bb23-dca41f05ee42 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:31.616198 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-fdf530b6-bf38-4fe8-bb23-dca41f05ee42 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "POST /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac/action" status: 202 len: 0 microversion: 2.1 time: 0.725693 Sep 16 12:50:31.627361 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 632/1308] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:50:30 2022] POST /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac/action => generated 0 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 16 12:50:31.675194 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-38904b09-0f78-43e4-831f-3e4257c94d17 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:31.675925 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-38904b09-0f78-43e4-831f-3e4257c94d17 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: dd98275b-2759-4880-b280-fc6fc1614e93] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:31.715758 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ed502f0c-ad3e-4a69-9d88-91710ab4e85f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:31.736001 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-38904b09-0f78-43e4-831f-3e4257c94d17 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:31.738359 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-38904b09-0f78-43e4-831f-3e4257c94d17 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:31.739453 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-38904b09-0f78-43e4-831f-3e4257c94d17 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:31.740269 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-38904b09-0f78-43e4-831f-3e4257c94d17 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:31.750701 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-38904b09-0f78-43e4-831f-3e4257c94d17 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:31.755998 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ed502f0c-ad3e-4a69-9d88-91710ab4e85f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1542 microversion: 2.1 time: 1.051948 Sep 16 12:50:31.757177 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-38904b09-0f78-43e4-831f-3e4257c94d17 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:31.758329 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 677/1309] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:30 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1542 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:31.778826 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f82b2241-c95e-4f01-946d-a59a0c685c66 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f1035768ca0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:31.906418 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f82b2241-c95e-4f01-946d-a59a0c685c66 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/5e802ae3-4c4e-4e51-b808-64dd163e6b3c" status: 200 len: 1438 microversion: 2.1 time: 0.136990 Sep 16 12:50:31.911663 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 678/1310] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:50:31 2022] GET /compute/v2.1/images/5e802ae3-4c4e-4e51-b808-64dd163e6b3c => generated 1438 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:31.939528 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-38904b09-0f78-43e4-831f-3e4257c94d17 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:31.940598 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-38904b09-0f78-43e4-831f-3e4257c94d17 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:31.941505 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-38904b09-0f78-43e4-831f-3e4257c94d17 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:31.942223 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-38904b09-0f78-43e4-831f-3e4257c94d17 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lazy-loading 'fault' on Instance uuid dd98275b-2759-4880-b280-fc6fc1614e93 {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:50:31.960577 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d0865662-4fae-4388-a554-40b38a5835cd tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:31.961201 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d0865662-4fae-4388-a554-40b38a5835cd tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:32.008203 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0865662-4fae-4388-a554-40b38a5835cd tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:32.008994 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0865662-4fae-4388-a554-40b38a5835cd tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:32.009778 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0865662-4fae-4388-a554-40b38a5835cd tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:32.016981 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0865662-4fae-4388-a554-40b38a5835cd tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:32.017997 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0865662-4fae-4388-a554-40b38a5835cd tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:32.018707 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0865662-4fae-4388-a554-40b38a5835cd tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:32.024515 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-38904b09-0f78-43e4-831f-3e4257c94d17 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:32.061044 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-38904b09-0f78-43e4-831f-3e4257c94d17 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/dd98275b-2759-4880-b280-fc6fc1614e93" status: 200 len: 1306 microversion: 2.1 time: 0.426345 Sep 16 12:50:32.065409 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 633/1311] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:31 2022] GET /compute/v2.1/servers/dd98275b-2759-4880-b280-fc6fc1614e93 => generated 1306 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:32.391302 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d0865662-4fae-4388-a554-40b38a5835cd tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:32.449449 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d0865662-4fae-4388-a554-40b38a5835cd tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:32.457729 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d0865662-4fae-4388-a554-40b38a5835cd tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:32.482865 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d0865662-4fae-4388-a554-40b38a5835cd tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1546 microversion: 2.91 time: 0.564643 Sep 16 12:50:32.484055 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 679/1312] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:50:31 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1546 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:50:32.823202 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3f69e110-ba84-45a8-9443-e0f8f8f1e4b7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:32.824756 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3f69e110-ba84-45a8-9443-e0f8f8f1e4b7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:32.851386 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3f69e110-ba84-45a8-9443-e0f8f8f1e4b7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:32.853748 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3f69e110-ba84-45a8-9443-e0f8f8f1e4b7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:32.855754 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3f69e110-ba84-45a8-9443-e0f8f8f1e4b7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:32.869843 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3f69e110-ba84-45a8-9443-e0f8f8f1e4b7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:32.875147 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3f69e110-ba84-45a8-9443-e0f8f8f1e4b7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:32.875898 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3f69e110-ba84-45a8-9443-e0f8f8f1e4b7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:32.927698 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-412019a1-ba51-4f44-992b-11ca4ed40148 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f10356658b0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:32.960891 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:50:33.062259 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-412019a1-ba51-4f44-992b-11ca4ed40148 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/5e802ae3-4c4e-4e51-b808-64dd163e6b3c" status: 200 len: 1438 microversion: 2.1 time: 0.140116 Sep 16 12:50:33.084977 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 680/1313] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:50:32 2022] GET /compute/v2.1/images/5e802ae3-4c4e-4e51-b808-64dd163e6b3c => generated 1438 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:33.130864 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-83e4a371-96c5-4b62-a91e-762808855ac4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:33.132071 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-83e4a371-96c5-4b62-a91e-762808855ac4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: dd98275b-2759-4880-b280-fc6fc1614e93] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:33.178341 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83e4a371-96c5-4b62-a91e-762808855ac4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:33.179175 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83e4a371-96c5-4b62-a91e-762808855ac4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:33.179819 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83e4a371-96c5-4b62-a91e-762808855ac4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:33.180823 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83e4a371-96c5-4b62-a91e-762808855ac4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:33.181537 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83e4a371-96c5-4b62-a91e-762808855ac4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:33.182206 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83e4a371-96c5-4b62-a91e-762808855ac4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:33.214671 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-83e4a371-96c5-4b62-a91e-762808855ac4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] HTTP exception thrown: Instance dd98275b-2759-4880-b280-fc6fc1614e93 could not be found. Sep 16 12:50:33.216813 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-83e4a371-96c5-4b62-a91e-762808855ac4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Request method failure captured: Sep 16 12:50:33.216813 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/dd98275b-2759-4880-b280-fc6fc1614e93 HTTP/1.1 Sep 16 12:50:33.216813 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:50:33.216813 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:50:33.216813 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:50:33.216813 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:50:33.216813 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:50:33.216813 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:50:33.216813 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:50:33.216813 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:50:33.216813 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHBjUf33JuiB067clS1pRc16KayMcfeeik_2N8qe1xVSws5r9dYJMo_cNLvp1lekO_QhmumFAa7ZdFpMFE4TUtIimhBv92jzTfY_v-8Zx2FEsNx-tLPQhXJ5HSs2Mpeu7Bs3Mkhe9HBesD1Uxdgz5IaUm8Ssa3r2ZDecZ2Zv1_45ono Sep 16 12:50:33.216813 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:50:33.216813 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:50:33.216813 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:50:33.216813 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:50:33.216813 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:50:33.216813 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:50:33.216813 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 8c037a6456444018a6ef54314419e2f2 Sep 16 12:50:33.216813 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersOnMultiNodesTest-1155904382 Sep 16 12:50:33.216813 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:50:33.216813 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:50:33.218451 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c037a6456444018a6ef54314419e2f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8c037a6456444018a6ef54314419e2f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8c037a6456444018a6ef54314419e2f2", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c037a6456444018a6ef54314419e2f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:50:33.218451 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ServersOnMultiNodesTest-1155904382 Sep 16 12:50:33.218451 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 8c037a6456444018a6ef54314419e2f2 Sep 16 12:50:33.218451 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1155904382 Sep 16 12:50:33.218451 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ServersOnMultiNodesTest-1155904382-project Sep 16 12:50:33.218451 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:50:33.218451 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:50:33.218451 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: c1928790cac542ec86add5794851f97a Sep 16 12:50:33.218451 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ServersOnMultiNodesTest-1155904382-project Sep 16 12:50:33.218451 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:50:33.218451 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance dd98275b-2759-4880-b280-fc6fc1614e93 could not be found. Sep 16 12:50:33.218451 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': 'dd98275b-2759-4880-b280-fc6fc1614e93'} Sep 16 12:50:33.219362 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:50:33.219362 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:33.219362 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:50:33.219362 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:50:33.219362 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:50:33.219362 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:50:33.219362 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:50:33.219362 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:50:33.219362 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:50:33.219362 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:50:33.219362 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd98275b-2759-4880-b280-fc6fc1614e93 could not be found. Sep 16 12:50:33.219362 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:50:33.219362 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:50:33.219362 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:50:33.219362 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:33.219362 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:50:33.219362 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:50:33.219362 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:50:33.219362 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:50:33.219362 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:50:33.221491 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:50:33.221491 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:50:33.221491 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:50:33.221491 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:50:33.221491 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:50:33.221491 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:50:33.221491 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:50:33.221491 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd98275b-2759-4880-b280-fc6fc1614e93 could not be found. Sep 16 12:50:33.221491 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:50:33.221491 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:50:33.221491 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:50:33.221491 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:33.221491 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:50:33.221491 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:50:33.221491 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:50:33.221491 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:50:33.221491 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd98275b-2759-4880-b280-fc6fc1614e93 could not be found. Sep 16 12:50:33.221491 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:50:33.223808 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-83e4a371-96c5-4b62-a91e-762808855ac4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Returning 404 to user: Instance dd98275b-2759-4880-b280-fc6fc1614e93 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:50:33.224925 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-83e4a371-96c5-4b62-a91e-762808855ac4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/dd98275b-2759-4880-b280-fc6fc1614e93" status: 404 len: 111 microversion: 2.1 time: 0.113893 Sep 16 12:50:33.225738 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 681/1314] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:33 2022] GET /compute/v2.1/servers/dd98275b-2759-4880-b280-fc6fc1614e93 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:50:33.236021 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dff18dcc-ce49-4d69-9d4c-04ed4fa5dc7d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:33.237121 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dff18dcc-ce49-4d69-9d4c-04ed4fa5dc7d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 1bdda11e-3b22-4d78-af62-8cc9a3915a4b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:33.245641 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dff18dcc-ce49-4d69-9d4c-04ed4fa5dc7d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:33.247211 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dff18dcc-ce49-4d69-9d4c-04ed4fa5dc7d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:33.247843 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dff18dcc-ce49-4d69-9d4c-04ed4fa5dc7d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:33.248980 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dff18dcc-ce49-4d69-9d4c-04ed4fa5dc7d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:33.250403 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dff18dcc-ce49-4d69-9d4c-04ed4fa5dc7d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:33.251057 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dff18dcc-ce49-4d69-9d4c-04ed4fa5dc7d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:33.289398 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dff18dcc-ce49-4d69-9d4c-04ed4fa5dc7d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 1bdda11e-3b22-4d78-af62-8cc9a3915a4b] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:50:33.509439 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dff18dcc-ce49-4d69-9d4c-04ed4fa5dc7d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "DELETE /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b" status: 204 len: 0 microversion: 2.1 time: 0.275987 Sep 16 12:50:33.514165 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 682/1315] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:50:33 2022] DELETE /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:50:33.536757 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0da17072-f2ed-4175-81c1-68dee2c5365e tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:33.537487 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0da17072-f2ed-4175-81c1-68dee2c5365e tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:33.562486 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0da17072-f2ed-4175-81c1-68dee2c5365e tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:33.562997 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0da17072-f2ed-4175-81c1-68dee2c5365e tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:33.571414 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0da17072-f2ed-4175-81c1-68dee2c5365e tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:33.574973 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0da17072-f2ed-4175-81c1-68dee2c5365e tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:33.575858 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0da17072-f2ed-4175-81c1-68dee2c5365e tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:33.577211 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0da17072-f2ed-4175-81c1-68dee2c5365e tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:33.832026 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0da17072-f2ed-4175-81c1-68dee2c5365e tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:33.847722 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0da17072-f2ed-4175-81c1-68dee2c5365e tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:33.849717 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0da17072-f2ed-4175-81c1-68dee2c5365e tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:33.869061 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0da17072-f2ed-4175-81c1-68dee2c5365e tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1546 microversion: 2.91 time: 0.353149 Sep 16 12:50:33.870385 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 683/1316] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:50:33 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1546 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:50:33.877560 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a7585651-5ffb-4688-b2b9-abbeca6a6781 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:33.878445 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a7585651-5ffb-4688-b2b9-abbeca6a6781 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 95448444-b52b-428f-9c7c-8e0e78fc2b22] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:33.887877 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7585651-5ffb-4688-b2b9-abbeca6a6781 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:33.888871 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7585651-5ffb-4688-b2b9-abbeca6a6781 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:33.889562 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7585651-5ffb-4688-b2b9-abbeca6a6781 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:33.891216 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7585651-5ffb-4688-b2b9-abbeca6a6781 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:33.892023 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7585651-5ffb-4688-b2b9-abbeca6a6781 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:33.892761 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7585651-5ffb-4688-b2b9-abbeca6a6781 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:33.950633 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3f69e110-ba84-45a8-9443-e0f8f8f1e4b7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:33.951193 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a7585651-5ffb-4688-b2b9-abbeca6a6781 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 95448444-b52b-428f-9c7c-8e0e78fc2b22] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:50:33.989001 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3f69e110-ba84-45a8-9443-e0f8f8f1e4b7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1542 microversion: 2.1 time: 1.165462 Sep 16 12:50:33.991675 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 634/1317] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:32 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1542 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:34.094106 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c06ce326-3a0a-4294-a755-4c6d6baecece tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f1035de5b80>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:34.158785 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a7585651-5ffb-4688-b2b9-abbeca6a6781 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "DELETE /compute/v2.1/servers/95448444-b52b-428f-9c7c-8e0e78fc2b22" status: 204 len: 0 microversion: 2.1 time: 0.283932 Sep 16 12:50:34.166359 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 684/1318] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:50:33 2022] DELETE /compute/v2.1/servers/95448444-b52b-428f-9c7c-8e0e78fc2b22 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:50:34.180373 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b518874b-b13f-4d85-9d10-63c435391a06 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:34.190452 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b518874b-b13f-4d85-9d10-63c435391a06 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 1bdda11e-3b22-4d78-af62-8cc9a3915a4b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:34.209273 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b518874b-b13f-4d85-9d10-63c435391a06 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:34.209507 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c06ce326-3a0a-4294-a755-4c6d6baecece tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/5e802ae3-4c4e-4e51-b808-64dd163e6b3c" status: 200 len: 1438 microversion: 2.1 time: 0.120588 Sep 16 12:50:34.210014 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 635/1319] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:50:34 2022] GET /compute/v2.1/images/5e802ae3-4c4e-4e51-b808-64dd163e6b3c => generated 1438 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:34.210653 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b518874b-b13f-4d85-9d10-63c435391a06 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:34.211557 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b518874b-b13f-4d85-9d10-63c435391a06 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:34.213659 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b518874b-b13f-4d85-9d10-63c435391a06 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:34.214341 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b518874b-b13f-4d85-9d10-63c435391a06 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:34.226599 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b518874b-b13f-4d85-9d10-63c435391a06 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:34.717297 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b518874b-b13f-4d85-9d10-63c435391a06 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:34.729658 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b518874b-b13f-4d85-9d10-63c435391a06 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b" status: 200 len: 1474 microversion: 2.1 time: 0.557937 Sep 16 12:50:34.730237 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 685/1320] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:34 2022] GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b => generated 1474 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:34.908549 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-cd6317a3-752c-4921-9e48-94b715a769e7 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:34.909181 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-cd6317a3-752c-4921-9e48-94b715a769e7 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:34.925477 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cd6317a3-752c-4921-9e48-94b715a769e7 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:34.927511 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cd6317a3-752c-4921-9e48-94b715a769e7 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:34.927998 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cd6317a3-752c-4921-9e48-94b715a769e7 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:34.931136 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cd6317a3-752c-4921-9e48-94b715a769e7 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:34.931633 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cd6317a3-752c-4921-9e48-94b715a769e7 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:34.932075 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cd6317a3-752c-4921-9e48-94b715a769e7 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:35.027610 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a9ac29dc-4c69-4e8d-86c0-8ddc69cd4f33 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:35.030466 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a9ac29dc-4c69-4e8d-86c0-8ddc69cd4f33 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:35.055167 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:50:35.061252 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9ac29dc-4c69-4e8d-86c0-8ddc69cd4f33 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:35.062687 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9ac29dc-4c69-4e8d-86c0-8ddc69cd4f33 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:35.063361 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9ac29dc-4c69-4e8d-86c0-8ddc69cd4f33 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:35.064437 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9ac29dc-4c69-4e8d-86c0-8ddc69cd4f33 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:35.065077 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9ac29dc-4c69-4e8d-86c0-8ddc69cd4f33 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:35.065667 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9ac29dc-4c69-4e8d-86c0-8ddc69cd4f33 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:35.175214 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-cd6317a3-752c-4921-9e48-94b715a769e7 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:35.203190 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-cd6317a3-752c-4921-9e48-94b715a769e7 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:35.203190 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-cd6317a3-752c-4921-9e48-94b715a769e7 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:35.221272 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-cd6317a3-752c-4921-9e48-94b715a769e7 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1546 microversion: 2.91 time: 0.315458 Sep 16 12:50:35.222253 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 636/1321] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:50:34 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1546 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:50:35.232388 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4b7abe97-43af-4b5f-97f4-06059a602be5 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f10358de310>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:35.320605 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4b7abe97-43af-4b5f-97f4-06059a602be5 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/5e802ae3-4c4e-4e51-b808-64dd163e6b3c" status: 200 len: 1438 microversion: 2.1 time: 0.096076 Sep 16 12:50:35.321952 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 637/1322] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:50:35 2022] GET /compute/v2.1/images/5e802ae3-4c4e-4e51-b808-64dd163e6b3c => generated 1438 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:35.432674 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a9ac29dc-4c69-4e8d-86c0-8ddc69cd4f33 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:35.444962 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a9ac29dc-4c69-4e8d-86c0-8ddc69cd4f33 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1542 microversion: 2.1 time: 0.423537 Sep 16 12:50:35.446407 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 686/1323] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:35 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1542 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:50:35.758547 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fb9164cc-3815-43f0-b2b1-5a378bb8268c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:35.759810 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fb9164cc-3815-43f0-b2b1-5a378bb8268c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 1bdda11e-3b22-4d78-af62-8cc9a3915a4b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:35.777660 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb9164cc-3815-43f0-b2b1-5a378bb8268c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:35.779834 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb9164cc-3815-43f0-b2b1-5a378bb8268c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:35.780661 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb9164cc-3815-43f0-b2b1-5a378bb8268c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:35.783947 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb9164cc-3815-43f0-b2b1-5a378bb8268c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:35.784897 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb9164cc-3815-43f0-b2b1-5a378bb8268c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:35.785727 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb9164cc-3815-43f0-b2b1-5a378bb8268c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:36.374055 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-099d56ad-5a95-48df-86e7-042e26b2e6b5 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Action: 'create', calling method: .version_select at 0x7f10358cd4c0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-251375913", "policies": ["affinity"]}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:50:36.393393 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fb9164cc-3815-43f0-b2b1-5a378bb8268c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:36.419200 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fb9164cc-3815-43f0-b2b1-5a378bb8268c tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b" status: 200 len: 1474 microversion: 2.1 time: 0.664557 Sep 16 12:50:36.442127 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 687/1324] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:35 2022] GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b => generated 1474 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:36.460772 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7ae27c6f-2d4d-4ae5-9ff7-59e27179e59b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:36.461981 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7ae27c6f-2d4d-4ae5-9ff7-59e27179e59b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:36.478229 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ae27c6f-2d4d-4ae5-9ff7-59e27179e59b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:36.480594 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ae27c6f-2d4d-4ae5-9ff7-59e27179e59b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:36.481406 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ae27c6f-2d4d-4ae5-9ff7-59e27179e59b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:36.482871 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ae27c6f-2d4d-4ae5-9ff7-59e27179e59b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:36.486955 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ae27c6f-2d4d-4ae5-9ff7-59e27179e59b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:36.488256 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ae27c6f-2d4d-4ae5-9ff7-59e27179e59b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:36.510479 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-099d56ad-5a95-48df-86e7-042e26b2e6b5 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Getting quotas for project 665869d344cf42e38020c270515c5abf. Resources: {'server_groups'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:50:36.551532 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-099d56ad-5a95-48df-86e7-042e26b2e6b5 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Getting quotas for user 4242164d723c4db8a31efdda44f5207d and project 665869d344cf42e38020c270515c5abf. Resources: {'server_groups'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:50:36.564977 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:50:36.706026 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-099d56ad-5a95-48df-86e7-042e26b2e6b5 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Getting quotas for project 665869d344cf42e38020c270515c5abf. Resources: {'server_groups'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:50:36.723857 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-099d56ad-5a95-48df-86e7-042e26b2e6b5 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Getting quotas for user 4242164d723c4db8a31efdda44f5207d and project 665869d344cf42e38020c270515c5abf. Resources: {'server_groups'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:50:36.757029 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-099d56ad-5a95-48df-86e7-042e26b2e6b5 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 1.274389 Sep 16 12:50:36.759082 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 638/1325] 10.222.0.67 () {60 vars in 1174 bytes} [Fri Sep 16 12:50:35 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:50:36.774060 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b22e06a7-c670-4802-a422-646540ae50dc tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f103629f280>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:36.902535 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b22e06a7-c670-4802-a422-646540ae50dc tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/5e802ae3-4c4e-4e51-b808-64dd163e6b3c" status: 200 len: 1438 microversion: 2.1 time: 0.140060 Sep 16 12:50:36.914743 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 639/1326] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:50:36 2022] GET /compute/v2.1/images/5e802ae3-4c4e-4e51-b808-64dd163e6b3c => generated 1438 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:36.921558 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6b962739-c035-4a5c-b133-2cef6f179ebe tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:36.923934 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6b962739-c035-4a5c-b133-2cef6f179ebe tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:36.966363 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6b962739-c035-4a5c-b133-2cef6f179ebe tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:36.978703 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7ae27c6f-2d4d-4ae5-9ff7-59e27179e59b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:36.987529 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6b962739-c035-4a5c-b133-2cef6f179ebe tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:36.988550 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6b962739-c035-4a5c-b133-2cef6f179ebe tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:36.995722 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6b962739-c035-4a5c-b133-2cef6f179ebe tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:37.009038 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6b962739-c035-4a5c-b133-2cef6f179ebe tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:37.015103 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6b962739-c035-4a5c-b133-2cef6f179ebe tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:37.054363 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7ae27c6f-2d4d-4ae5-9ff7-59e27179e59b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:37.078023 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7ae27c6f-2d4d-4ae5-9ff7-59e27179e59b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:37.128577 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7ae27c6f-2d4d-4ae5-9ff7-59e27179e59b tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1546 microversion: 2.91 time: 0.678778 Sep 16 12:50:37.134226 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 688/1327] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:50:36 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1546 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:50:37.164004 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6bd52295-93a1-4983-aa72-7bcb5b69087c tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Action: 'create', calling method: .version_select at 0x7f1035b2daf0>, body: {"server_group": {"name": "tempest-server-group-351850338", "policies": ["affinity"]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:50:37.320986 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-6bd52295-93a1-4983-aa72-7bcb5b69087c tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Getting quotas for project 665869d344cf42e38020c270515c5abf. Resources: {'server_groups'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:50:37.405791 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-6bd52295-93a1-4983-aa72-7bcb5b69087c tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Getting quotas for user 4242164d723c4db8a31efdda44f5207d and project 665869d344cf42e38020c270515c5abf. Resources: {'server_groups'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:50:37.635727 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-6bd52295-93a1-4983-aa72-7bcb5b69087c tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Getting quotas for project 665869d344cf42e38020c270515c5abf. Resources: {'server_groups'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:50:37.650069 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-6bd52295-93a1-4983-aa72-7bcb5b69087c tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Getting quotas for user 4242164d723c4db8a31efdda44f5207d and project 665869d344cf42e38020c270515c5abf. Resources: {'server_groups'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:50:37.689122 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6bd52295-93a1-4983-aa72-7bcb5b69087c tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.553423 Sep 16 12:50:37.690155 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 689/1328] 10.222.0.67 () {60 vars in 1173 bytes} [Fri Sep 16 12:50:37 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:50:37.700380 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-be3a2cd9-4751-4103-87f4-e49581e42857 req-d00897e7-ec68-413b-8f66-b7af8b5c4a2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bdda11e-3b22-4d78-af62-8cc9a3915a4b", "name": "network-vif-deleted", "tag": "e3afd82f-9e91-4967-8755-5ee2e7d21714"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:50:37.747398 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-be3a2cd9-4751-4103-87f4-e49581e42857 req-d00897e7-ec68-413b-8f66-b7af8b5c4a2f service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:37.749739 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-be3a2cd9-4751-4103-87f4-e49581e42857 req-d00897e7-ec68-413b-8f66-b7af8b5c4a2f service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:37.753630 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-be3a2cd9-4751-4103-87f4-e49581e42857 req-d00897e7-ec68-413b-8f66-b7af8b5c4a2f service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:37.808955 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-be3a2cd9-4751-4103-87f4-e49581e42857 req-d00897e7-ec68-413b-8f66-b7af8b5c4a2f service nova] Creating event network-vif-deleted:e3afd82f-9e91-4967-8755-5ee2e7d21714 for instance 1bdda11e-3b22-4d78-af62-8cc9a3915a4b on n-h1-858094-4 Sep 16 12:50:37.823458 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-be3a2cd9-4751-4103-87f4-e49581e42857 req-d00897e7-ec68-413b-8f66-b7af8b5c4a2f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129709 Sep 16 12:50:37.824204 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 690/1329] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:50:37.838374 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1822b1f8-0335-4df9-87a1-fbec048bcbd5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:37.840867 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1822b1f8-0335-4df9-87a1-fbec048bcbd5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 1bdda11e-3b22-4d78-af62-8cc9a3915a4b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:37.857513 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1822b1f8-0335-4df9-87a1-fbec048bcbd5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:37.861874 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1822b1f8-0335-4df9-87a1-fbec048bcbd5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:37.862698 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1822b1f8-0335-4df9-87a1-fbec048bcbd5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:37.863858 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1822b1f8-0335-4df9-87a1-fbec048bcbd5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:37.866424 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1822b1f8-0335-4df9-87a1-fbec048bcbd5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:37.867007 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1822b1f8-0335-4df9-87a1-fbec048bcbd5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:37.885826 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6b962739-c035-4a5c-b133-2cef6f179ebe tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:37.924806 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6b962739-c035-4a5c-b133-2cef6f179ebe tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1542 microversion: 2.1 time: 1.017967 Sep 16 12:50:37.928084 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 640/1330] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:36 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1542 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:37.962211 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-891b1a9a-d421-425b-93aa-2361194aeced tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Action: 'create', calling method: .version_select at 0x7f103589af70>, body: {"server_group": {"name": "tempest-server-group-351850338", "policies": ["affinity"]}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:50:37.965782 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1822b1f8-0335-4df9-87a1-fbec048bcbd5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:37.971521 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1822b1f8-0335-4df9-87a1-fbec048bcbd5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:37.974188 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1822b1f8-0335-4df9-87a1-fbec048bcbd5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:37.975100 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-1822b1f8-0335-4df9-87a1-fbec048bcbd5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lazy-loading 'fault' on Instance uuid 1bdda11e-3b22-4d78-af62-8cc9a3915a4b {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:50:38.036005 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-891b1a9a-d421-425b-93aa-2361194aeced tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Getting quotas for project 665869d344cf42e38020c270515c5abf. Resources: {'server_groups'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:50:38.051261 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-891b1a9a-d421-425b-93aa-2361194aeced tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Getting quotas for user 4242164d723c4db8a31efdda44f5207d and project 665869d344cf42e38020c270515c5abf. Resources: {'server_groups'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:50:38.081051 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1822b1f8-0335-4df9-87a1-fbec048bcbd5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:38.094768 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1822b1f8-0335-4df9-87a1-fbec048bcbd5 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b" status: 200 len: 1309 microversion: 2.1 time: 0.269064 Sep 16 12:50:38.099291 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 691/1331] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:37 2022] GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b => generated 1309 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:38.114977 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-91a1a19d-e24b-411a-8f36-048cb9db0940 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f10356c35e0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:38.172660 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-891b1a9a-d421-425b-93aa-2361194aeced tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Getting quotas for project 665869d344cf42e38020c270515c5abf. Resources: {'server_groups'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:50:38.182214 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-891b1a9a-d421-425b-93aa-2361194aeced tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Getting quotas for user 4242164d723c4db8a31efdda44f5207d and project 665869d344cf42e38020c270515c5abf. Resources: {'server_groups'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:50:38.205677 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-891b1a9a-d421-425b-93aa-2361194aeced tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.275955 Sep 16 12:50:38.206823 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 641/1332] 10.222.0.67 () {60 vars in 1173 bytes} [Fri Sep 16 12:50:37 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:50:38.213143 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9f57af28-5185-4261-a8f0-fdbd3c0e0a75 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:38.214339 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9f57af28-5185-4261-a8f0-fdbd3c0e0a75 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:38.222468 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9f57af28-5185-4261-a8f0-fdbd3c0e0a75 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:38.223360 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9f57af28-5185-4261-a8f0-fdbd3c0e0a75 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:38.224036 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9f57af28-5185-4261-a8f0-fdbd3c0e0a75 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:38.225437 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9f57af28-5185-4261-a8f0-fdbd3c0e0a75 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:38.226088 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9f57af28-5185-4261-a8f0-fdbd3c0e0a75 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:38.226688 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9f57af28-5185-4261-a8f0-fdbd3c0e0a75 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:38.439396 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9f57af28-5185-4261-a8f0-fdbd3c0e0a75 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:38.460572 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9f57af28-5185-4261-a8f0-fdbd3c0e0a75 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:38.474672 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9f57af28-5185-4261-a8f0-fdbd3c0e0a75 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:38.489140 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9f57af28-5185-4261-a8f0-fdbd3c0e0a75 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1546 microversion: 2.91 time: 0.280965 Sep 16 12:50:38.503204 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 642/1333] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:50:38 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1546 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:50:38.513679 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-aadf9e2d-ccb6-474f-8ef8-e70602cd2c93 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:38.638791 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-aadf9e2d-ccb6-474f-8ef8-e70602cd2c93 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "DELETE /compute/v2.1/os-server-groups/6dde91d9-5bbb-4881-ae93-6e3f7b281679" status: 204 len: 0 microversion: 2.1 time: 0.132567 Sep 16 12:50:38.639696 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 643/1334] 10.222.0.67 () {58 vars in 1266 bytes} [Fri Sep 16 12:50:38 2022] DELETE /compute/v2.1/os-server-groups/6dde91d9-5bbb-4881-ae93-6e3f7b281679 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:50:38.648686 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-fd0b9916-0fb2-4521-9b67-3536de3fd3f2 req-e8f018df-ec84-46e3-8136-bbacd8b16d7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95448444-b52b-428f-9c7c-8e0e78fc2b22", "name": "network-vif-deleted", "tag": "1c5c05cf-4ab1-4beb-b208-fb0941341532"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:50:38.667153 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-fd0b9916-0fb2-4521-9b67-3536de3fd3f2 req-e8f018df-ec84-46e3-8136-bbacd8b16d7a service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:38.667942 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-fd0b9916-0fb2-4521-9b67-3536de3fd3f2 req-e8f018df-ec84-46e3-8136-bbacd8b16d7a service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:38.668585 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-fd0b9916-0fb2-4521-9b67-3536de3fd3f2 req-e8f018df-ec84-46e3-8136-bbacd8b16d7a service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:38.691799 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-fd0b9916-0fb2-4521-9b67-3536de3fd3f2 req-e8f018df-ec84-46e3-8136-bbacd8b16d7a service nova] Creating event network-vif-deleted:1c5c05cf-4ab1-4beb-b208-fb0941341532 for instance 95448444-b52b-428f-9c7c-8e0e78fc2b22 on n-h2-858094-4 Sep 16 12:50:38.699297 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-fd0b9916-0fb2-4521-9b67-3536de3fd3f2 req-e8f018df-ec84-46e3-8136-bbacd8b16d7a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054693 Sep 16 12:50:38.705282 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 644/1335] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:50:38.712280 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-238ee44d-a4d2-4132-8f0b-b8a80f38ac9e tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:38.751636 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-238ee44d-a4d2-4132-8f0b-b8a80f38ac9e tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.044240 Sep 16 12:50:38.753007 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 645/1336] 10.222.0.67 () {58 vars in 1152 bytes} [Fri Sep 16 12:50:38 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:50:38.775352 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6ed7a3a6-8554-407d-8a62-313dfbc7226d tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:38.934272 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6ed7a3a6-8554-407d-8a62-313dfbc7226d tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "DELETE /compute/v2.1/os-server-groups/fe3108b0-4919-4175-b78c-fb1b12ff013e" status: 204 len: 0 microversion: 2.1 time: 0.162132 Sep 16 12:50:38.935782 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 646/1337] 10.222.0.67 () {58 vars in 1266 bytes} [Fri Sep 16 12:50:38 2022] DELETE /compute/v2.1/os-server-groups/fe3108b0-4919-4175-b78c-fb1b12ff013e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:50:38.960384 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-bb8a6b95-2169-42f2-b000-eca6d749bc61 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:39.013865 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-bb8a6b95-2169-42f2-b000-eca6d749bc61 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.068923 Sep 16 12:50:39.016646 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 647/1338] 10.222.0.67 () {58 vars in 1152 bytes} [Fri Sep 16 12:50:38 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:50:39.058449 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-90144446-ba34-4935-87f7-360d6c9a36ef tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:39.063998 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-90144446-ba34-4935-87f7-360d6c9a36ef tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:39.118863 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-90144446-ba34-4935-87f7-360d6c9a36ef tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:39.121372 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-90144446-ba34-4935-87f7-360d6c9a36ef tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:39.163806 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-90144446-ba34-4935-87f7-360d6c9a36ef tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.043s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:39.168160 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-90144446-ba34-4935-87f7-360d6c9a36ef tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:39.173958 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-90144446-ba34-4935-87f7-360d6c9a36ef tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:39.176031 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-90144446-ba34-4935-87f7-360d6c9a36ef tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:39.817904 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-90144446-ba34-4935-87f7-360d6c9a36ef tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:39.838543 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-90144446-ba34-4935-87f7-360d6c9a36ef tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1542 microversion: 2.1 time: 0.817250 Sep 16 12:50:39.840647 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 648/1339] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:39 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1542 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:39.851739 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-15106e5d-36b8-4af5-9661-baa7c92a2942 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Action: 'create', calling method: .version_select at 0x7f103589aee0>, body: {"server_group": {"name": "tempest-server-group-1357879478", "policies": ["affinity"]}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:50:39.887014 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:50:39.907953 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-15106e5d-36b8-4af5-9661-baa7c92a2942 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Getting quotas for project 665869d344cf42e38020c270515c5abf. Resources: {'server_groups'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:50:39.921647 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-15106e5d-36b8-4af5-9661-baa7c92a2942 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Getting quotas for user 4242164d723c4db8a31efdda44f5207d and project 665869d344cf42e38020c270515c5abf. Resources: {'server_groups'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:50:40.094399 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-15106e5d-36b8-4af5-9661-baa7c92a2942 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Getting quotas for project 665869d344cf42e38020c270515c5abf. Resources: {'server_groups'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:50:40.155389 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-15106e5d-36b8-4af5-9661-baa7c92a2942 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Getting quotas for user 4242164d723c4db8a31efdda44f5207d and project 665869d344cf42e38020c270515c5abf. Resources: {'server_groups'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:50:40.204014 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-15106e5d-36b8-4af5-9661-baa7c92a2942 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.360910 Sep 16 12:50:40.214614 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 649/1340] 10.222.0.67 () {60 vars in 1173 bytes} [Fri Sep 16 12:50:39 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:50:40.237355 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e8b44fa8-db16-4a10-8f43-a40fe5d9beb4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:40.238256 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e8b44fa8-db16-4a10-8f43-a40fe5d9beb4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 1bdda11e-3b22-4d78-af62-8cc9a3915a4b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:40.263578 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e8b44fa8-db16-4a10-8f43-a40fe5d9beb4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:40.264081 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e8b44fa8-db16-4a10-8f43-a40fe5d9beb4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:40.264553 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e8b44fa8-db16-4a10-8f43-a40fe5d9beb4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:40.265300 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e8b44fa8-db16-4a10-8f43-a40fe5d9beb4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:40.265758 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e8b44fa8-db16-4a10-8f43-a40fe5d9beb4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:40.266237 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e8b44fa8-db16-4a10-8f43-a40fe5d9beb4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:40.338725 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-e8b44fa8-db16-4a10-8f43-a40fe5d9beb4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] HTTP exception thrown: Instance 1bdda11e-3b22-4d78-af62-8cc9a3915a4b could not be found. Sep 16 12:50:40.353389 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e8b44fa8-db16-4a10-8f43-a40fe5d9beb4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Request method failure captured: Sep 16 12:50:40.353389 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b HTTP/1.1 Sep 16 12:50:40.353389 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:50:40.353389 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:50:40.353389 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:50:40.353389 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:50:40.353389 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:50:40.353389 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:50:40.353389 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:50:40.353389 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:50:40.353389 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHBjUf33JuiB067clS1pRc16KayMcfeeik_2N8qe1xVSws5r9dYJMo_cNLvp1lekO_QhmumFAa7ZdFpMFE4TUtIimhBv92jzTfY_v-8Zx2FEsNx-tLPQhXJ5HSs2Mpeu7Bs3Mkhe9HBesD1Uxdgz5IaUm8Ssa3r2ZDecZ2Zv1_45ono Sep 16 12:50:40.353389 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:50:40.353389 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:50:40.353389 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:50:40.353389 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:50:40.353389 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:50:40.353389 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:50:40.353389 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 8c037a6456444018a6ef54314419e2f2 Sep 16 12:50:40.353389 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ServersOnMultiNodesTest-1155904382 Sep 16 12:50:40.353389 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:50:40.353389 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:50:40.355188 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c037a6456444018a6ef54314419e2f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8c037a6456444018a6ef54314419e2f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8c037a6456444018a6ef54314419e2f2", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c037a6456444018a6ef54314419e2f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:50:40.355188 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ServersOnMultiNodesTest-1155904382 Sep 16 12:50:40.355188 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 8c037a6456444018a6ef54314419e2f2 Sep 16 12:50:40.355188 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1155904382 Sep 16 12:50:40.355188 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ServersOnMultiNodesTest-1155904382-project Sep 16 12:50:40.355188 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:50:40.355188 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:50:40.355188 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: c1928790cac542ec86add5794851f97a Sep 16 12:50:40.355188 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ServersOnMultiNodesTest-1155904382-project Sep 16 12:50:40.355188 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:50:40.355188 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance 1bdda11e-3b22-4d78-af62-8cc9a3915a4b could not be found. Sep 16 12:50:40.355188 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '1bdda11e-3b22-4d78-af62-8cc9a3915a4b'} Sep 16 12:50:40.356021 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:50:40.356021 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:40.356021 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:50:40.356021 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:50:40.356021 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:50:40.356021 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:50:40.356021 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:50:40.356021 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:50:40.356021 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:50:40.356021 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:50:40.356021 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bdda11e-3b22-4d78-af62-8cc9a3915a4b could not be found. Sep 16 12:50:40.356021 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:40.356021 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:50:40.356021 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:40.356021 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:40.356021 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:50:40.356021 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:50:40.356021 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:50:40.356021 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:50:40.356021 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:50:40.357455 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:50:40.357455 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:50:40.357455 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:50:40.357455 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:50:40.357455 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:50:40.357455 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:50:40.357455 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:50:40.357455 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bdda11e-3b22-4d78-af62-8cc9a3915a4b could not be found. Sep 16 12:50:40.357455 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:40.357455 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:50:40.357455 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:40.357455 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:40.357455 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:50:40.357455 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:50:40.357455 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:50:40.357455 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:50:40.357455 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bdda11e-3b22-4d78-af62-8cc9a3915a4b could not be found. Sep 16 12:50:40.357455 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:40.358641 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e8b44fa8-db16-4a10-8f43-a40fe5d9beb4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Returning 404 to user: Instance 1bdda11e-3b22-4d78-af62-8cc9a3915a4b could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:50:40.358641 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e8b44fa8-db16-4a10-8f43-a40fe5d9beb4 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b" status: 404 len: 111 microversion: 2.1 time: 0.139194 Sep 16 12:50:40.364467 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 650/1341] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:40 2022] GET /compute/v2.1/servers/1bdda11e-3b22-4d78-af62-8cc9a3915a4b => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:50:40.387109 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-592542c8-c521-4a3c-b01b-04320cddc9d3 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:40.387974 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-592542c8-c521-4a3c-b01b-04320cddc9d3 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:40.413920 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-592542c8-c521-4a3c-b01b-04320cddc9d3 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:40.414565 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-592542c8-c521-4a3c-b01b-04320cddc9d3 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:40.418450 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-592542c8-c521-4a3c-b01b-04320cddc9d3 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:40.427624 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-592542c8-c521-4a3c-b01b-04320cddc9d3 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:40.430134 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-592542c8-c521-4a3c-b01b-04320cddc9d3 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:40.431786 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-592542c8-c521-4a3c-b01b-04320cddc9d3 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:40.618266 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-592542c8-c521-4a3c-b01b-04320cddc9d3 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:40.638373 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-592542c8-c521-4a3c-b01b-04320cddc9d3 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:40.640573 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-592542c8-c521-4a3c-b01b-04320cddc9d3 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:40.655631 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-592542c8-c521-4a3c-b01b-04320cddc9d3 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1546 microversion: 2.91 time: 0.289824 Sep 16 12:50:40.656638 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 651/1342] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:50:40 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1546 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:50:40.663738 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0a6da8da-43d6-440b-9440-1ef9ba7ec7a0 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:40.775902 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0a6da8da-43d6-440b-9440-1ef9ba7ec7a0 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "DELETE /compute/v2.1/os-server-groups/80d5e482-0553-4ca2-a536-6db525d413f7" status: 204 len: 0 microversion: 2.1 time: 0.116078 Sep 16 12:50:40.775902 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 652/1343] 10.222.0.67 () {58 vars in 1266 bytes} [Fri Sep 16 12:50:40 2022] DELETE /compute/v2.1/os-server-groups/80d5e482-0553-4ca2-a536-6db525d413f7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:50:40.785453 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6bb002db-09c9-40fd-88b2-12150b70cd4a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:40.785453 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6bb002db-09c9-40fd-88b2-12150b70cd4a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 95448444-b52b-428f-9c7c-8e0e78fc2b22] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:40.822222 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6bb002db-09c9-40fd-88b2-12150b70cd4a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:40.822914 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6bb002db-09c9-40fd-88b2-12150b70cd4a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:40.823524 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6bb002db-09c9-40fd-88b2-12150b70cd4a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:40.832646 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6bb002db-09c9-40fd-88b2-12150b70cd4a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:40.833319 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6bb002db-09c9-40fd-88b2-12150b70cd4a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:40.833742 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6bb002db-09c9-40fd-88b2-12150b70cd4a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:40.876721 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-6bb002db-09c9-40fd-88b2-12150b70cd4a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] HTTP exception thrown: Instance 95448444-b52b-428f-9c7c-8e0e78fc2b22 could not be found. Sep 16 12:50:40.878455 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6bb002db-09c9-40fd-88b2-12150b70cd4a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Request method failure captured: Sep 16 12:50:40.878455 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/95448444-b52b-428f-9c7c-8e0e78fc2b22 HTTP/1.1 Sep 16 12:50:40.878455 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:50:40.878455 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:50:40.878455 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:50:40.878455 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:50:40.878455 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:50:40.878455 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:50:40.878455 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:50:40.878455 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:50:40.878455 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHBjUf33JuiB067clS1pRc16KayMcfeeik_2N8qe1xVSws5r9dYJMo_cNLvp1lekO_QhmumFAa7ZdFpMFE4TUtIimhBv92jzTfY_v-8Zx2FEsNx-tLPQhXJ5HSs2Mpeu7Bs3Mkhe9HBesD1Uxdgz5IaUm8Ssa3r2ZDecZ2Zv1_45ono Sep 16 12:50:40.878455 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:50:40.878455 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:50:40.878455 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:50:40.878455 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:50:40.878455 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:50:40.878455 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:50:40.878455 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 8c037a6456444018a6ef54314419e2f2 Sep 16 12:50:40.878455 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ServersOnMultiNodesTest-1155904382 Sep 16 12:50:40.878455 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:50:40.878455 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:50:40.879865 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c037a6456444018a6ef54314419e2f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8c037a6456444018a6ef54314419e2f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8c037a6456444018a6ef54314419e2f2", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c037a6456444018a6ef54314419e2f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:50:40.879865 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ServersOnMultiNodesTest-1155904382 Sep 16 12:50:40.879865 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 8c037a6456444018a6ef54314419e2f2 Sep 16 12:50:40.879865 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1155904382 Sep 16 12:50:40.879865 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ServersOnMultiNodesTest-1155904382-project Sep 16 12:50:40.879865 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:50:40.879865 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:50:40.879865 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: c1928790cac542ec86add5794851f97a Sep 16 12:50:40.879865 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ServersOnMultiNodesTest-1155904382-project Sep 16 12:50:40.879865 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:50:40.879865 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance 95448444-b52b-428f-9c7c-8e0e78fc2b22 could not be found. Sep 16 12:50:40.879865 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '95448444-b52b-428f-9c7c-8e0e78fc2b22'} Sep 16 12:50:40.880690 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:50:40.880690 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:40.880690 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:50:40.880690 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:50:40.880690 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:50:40.880690 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:50:40.880690 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:50:40.880690 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:50:40.880690 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:50:40.880690 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:50:40.880690 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95448444-b52b-428f-9c7c-8e0e78fc2b22 could not be found. Sep 16 12:50:40.880690 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:40.880690 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:50:40.880690 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:40.880690 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:40.880690 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:50:40.880690 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:50:40.880690 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:50:40.880690 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:50:40.880690 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:50:40.882047 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:50:40.882047 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:50:40.882047 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:50:40.882047 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:50:40.882047 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:50:40.882047 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:50:40.882047 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:50:40.882047 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95448444-b52b-428f-9c7c-8e0e78fc2b22 could not be found. Sep 16 12:50:40.882047 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:40.882047 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:50:40.882047 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:40.882047 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:40.882047 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:50:40.882047 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:50:40.882047 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:50:40.882047 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:50:40.882047 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95448444-b52b-428f-9c7c-8e0e78fc2b22 could not be found. Sep 16 12:50:40.882047 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:50:40.887416 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6bb002db-09c9-40fd-88b2-12150b70cd4a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Returning 404 to user: Instance 95448444-b52b-428f-9c7c-8e0e78fc2b22 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:50:40.887416 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6bb002db-09c9-40fd-88b2-12150b70cd4a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/95448444-b52b-428f-9c7c-8e0e78fc2b22" status: 404 len: 111 microversion: 2.1 time: 0.103740 Sep 16 12:50:40.887416 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 653/1344] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:40 2022] GET /compute/v2.1/servers/95448444-b52b-428f-9c7c-8e0e78fc2b22 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:50:41.194260 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-473f4e06-ccbe-4d89-a891-955bfda51500 tempest-FlavorsV255TestJSON-1922907140 tempest-FlavorsV255TestJSON-1922907140-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-2128711847", "id": 1608096917, "os-flavor-access:is_public": "True"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:50:41.240242 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-473f4e06-ccbe-4d89-a891-955bfda51500 tempest-FlavorsV255TestJSON-1922907140 tempest-FlavorsV255TestJSON-1922907140-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.350082 Sep 16 12:50:41.241144 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 654/1345] 10.222.0.67 () {62 vars in 1188 bytes} [Fri Sep 16 12:50:40 2022] POST /compute/v2.1/flavors => generated 449 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:50:41.258554 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d565ff39-96a0-4fac-9f8b-2220b389ed29 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:41.270309 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d565ff39-96a0-4fac-9f8b-2220b389ed29 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.016219 Sep 16 12:50:41.271208 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 655/1346] 10.222.0.67 () {58 vars in 1152 bytes} [Fri Sep 16 12:50:41 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:50:41.276636 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-64d44f08-05dd-4c66-b49b-c346c2dd1478 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:41.355667 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-64d44f08-05dd-4c66-b49b-c346c2dd1478 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "DELETE /compute/v2.1/os-server-groups/44e9d969-be79-4b9c-97d1-8f3943b1de60" status: 204 len: 0 microversion: 2.1 time: 0.083181 Sep 16 12:50:41.358927 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 656/1347] 10.222.0.67 () {58 vars in 1266 bytes} [Fri Sep 16 12:50:41 2022] DELETE /compute/v2.1/os-server-groups/44e9d969-be79-4b9c-97d1-8f3943b1de60 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:50:41.384196 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8bc62ca6-adf9-4dee-b899-979511bb9cbc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:41.395985 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8bc62ca6-adf9-4dee-b899-979511bb9cbc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:41.405884 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bc62ca6-adf9-4dee-b899-979511bb9cbc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:41.407329 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bc62ca6-adf9-4dee-b899-979511bb9cbc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:41.407949 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bc62ca6-adf9-4dee-b899-979511bb9cbc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:41.408880 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bc62ca6-adf9-4dee-b899-979511bb9cbc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:41.409497 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bc62ca6-adf9-4dee-b899-979511bb9cbc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:41.412941 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bc62ca6-adf9-4dee-b899-979511bb9cbc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:41.888154 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8bc62ca6-adf9-4dee-b899-979511bb9cbc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:41.899819 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8bc62ca6-adf9-4dee-b899-979511bb9cbc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1542 microversion: 2.1 time: 0.539230 Sep 16 12:50:41.900899 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 657/1348] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:41 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1542 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:41.905998 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-69bdef37-8ad5-4a4b-bc27-3d054b2a0471 req-344461d4-5454-4108-975b-42be49e38b2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7725f9a0-ac02-47ad-a67f-a9d42c2a6aac", "name": "network-vif-plugged", "status": "completed", "tag": "e749f518-c322-429e-b87d-fb7a8eccab82"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:50:41.937414 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-69bdef37-8ad5-4a4b-bc27-3d054b2a0471 req-344461d4-5454-4108-975b-42be49e38b2c service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:41.938673 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-69bdef37-8ad5-4a4b-bc27-3d054b2a0471 req-344461d4-5454-4108-975b-42be49e38b2c service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:41.939483 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-69bdef37-8ad5-4a4b-bc27-3d054b2a0471 req-344461d4-5454-4108-975b-42be49e38b2c service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:41.964925 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-69bdef37-8ad5-4a4b-bc27-3d054b2a0471 req-344461d4-5454-4108-975b-42be49e38b2c service nova] Creating event network-vif-plugged:e749f518-c322-429e-b87d-fb7a8eccab82 for instance 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac on n-h2-858094-4 Sep 16 12:50:41.982103 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-69bdef37-8ad5-4a4b-bc27-3d054b2a0471 req-344461d4-5454-4108-975b-42be49e38b2c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079628 Sep 16 12:50:41.982937 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 658/1349] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:50:42.214577 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9e579076-899c-4b1a-bb11-33f0d62380f9 tempest-FlavorsV255TestJSON-1812679680 tempest-FlavorsV255TestJSON-1812679680-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:42.243550 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9e579076-899c-4b1a-bb11-33f0d62380f9 tempest-FlavorsV255TestJSON-1812679680 tempest-FlavorsV255TestJSON-1812679680-project] 10.222.0.67 "GET /compute/v2.1/flavors/1608096917" status: 200 len: 449 microversion: 2.55 time: 0.257284 Sep 16 12:50:42.245892 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 659/1350] 10.222.0.67 () {60 vars in 1199 bytes} [Fri Sep 16 12:50:41 2022] GET /compute/v2.1/flavors/1608096917 => generated 449 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:50:42.270204 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-41fd0eb7-9406-4a15-9f18-ed1ff36d7aa6 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Action: 'create', calling method: .version_select at 0x7f10358cda60>, body: {"server_group": {"name": "tempest-server-group-1895990358", "policies": ["anti-affinity"]}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:50:42.310366 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-41fd0eb7-9406-4a15-9f18-ed1ff36d7aa6 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Getting quotas for project 665869d344cf42e38020c270515c5abf. Resources: {'server_groups'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:50:42.320945 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-41fd0eb7-9406-4a15-9f18-ed1ff36d7aa6 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Getting quotas for user 4242164d723c4db8a31efdda44f5207d and project 665869d344cf42e38020c270515c5abf. Resources: {'server_groups'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:50:42.458636 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-41fd0eb7-9406-4a15-9f18-ed1ff36d7aa6 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Getting quotas for project 665869d344cf42e38020c270515c5abf. Resources: {'server_groups'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:50:42.478788 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-41fd0eb7-9406-4a15-9f18-ed1ff36d7aa6 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Getting quotas for user 4242164d723c4db8a31efdda44f5207d and project 665869d344cf42e38020c270515c5abf. Resources: {'server_groups'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:50:42.520788 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-41fd0eb7-9406-4a15-9f18-ed1ff36d7aa6 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.257346 Sep 16 12:50:42.521686 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 660/1351] 10.222.0.67 () {60 vars in 1173 bytes} [Fri Sep 16 12:50:42 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:50:42.539270 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-29dfbd27-81b5-49e0-9025-f1c1a7fd7db6 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:42.542306 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-29dfbd27-81b5-49e0-9025-f1c1a7fd7db6 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 8d5c44e7-c030-4a42-97fb-e838e1472456] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:42.554152 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-29dfbd27-81b5-49e0-9025-f1c1a7fd7db6 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:42.555237 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-29dfbd27-81b5-49e0-9025-f1c1a7fd7db6 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:42.556064 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-29dfbd27-81b5-49e0-9025-f1c1a7fd7db6 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:42.557318 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-29dfbd27-81b5-49e0-9025-f1c1a7fd7db6 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:42.558091 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-29dfbd27-81b5-49e0-9025-f1c1a7fd7db6 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:42.558795 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-29dfbd27-81b5-49e0-9025-f1c1a7fd7db6 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:42.602244 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-29dfbd27-81b5-49e0-9025-f1c1a7fd7db6 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 8d5c44e7-c030-4a42-97fb-e838e1472456] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:50:42.825066 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-29dfbd27-81b5-49e0-9025-f1c1a7fd7db6 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "DELETE /compute/v2.1/servers/8d5c44e7-c030-4a42-97fb-e838e1472456" status: 204 len: 0 microversion: 2.1 time: 0.301827 Sep 16 12:50:42.825751 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 661/1352] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:50:42 2022] DELETE /compute/v2.1/servers/8d5c44e7-c030-4a42-97fb-e838e1472456 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:50:42.843340 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-84eb5650-a62b-4e85-911c-c8eca25c707f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:42.848592 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-84eb5650-a62b-4e85-911c-c8eca25c707f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:42.861513 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-84eb5650-a62b-4e85-911c-c8eca25c707f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:42.862026 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-84eb5650-a62b-4e85-911c-c8eca25c707f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:42.862465 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-84eb5650-a62b-4e85-911c-c8eca25c707f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:42.863185 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-84eb5650-a62b-4e85-911c-c8eca25c707f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:42.863645 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-84eb5650-a62b-4e85-911c-c8eca25c707f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:42.864180 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-84eb5650-a62b-4e85-911c-c8eca25c707f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:42.973720 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-84eb5650-a62b-4e85-911c-c8eca25c707f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:42.986082 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-84eb5650-a62b-4e85-911c-c8eca25c707f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:42.987632 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-84eb5650-a62b-4e85-911c-c8eca25c707f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:43.008793 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-84eb5650-a62b-4e85-911c-c8eca25c707f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1546 microversion: 2.91 time: 0.174306 Sep 16 12:50:43.009387 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 662/1353] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:50:42 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1546 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:50:43.017634 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ae8efde0-adaa-4f51-ba9d-98c528b76ef4 tempest-FlavorsV255TestJSON-1922907140 tempest-FlavorsV255TestJSON-1922907140-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:50:43.058436 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:50:43.160288 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ae8efde0-adaa-4f51-ba9d-98c528b76ef4 tempest-FlavorsV255TestJSON-1922907140 tempest-FlavorsV255TestJSON-1922907140-project-admin] 10.222.0.67 "PUT /compute/v2.1/flavors/1608096917" status: 200 len: 450 microversion: 2.55 time: 0.149239 Sep 16 12:50:43.160908 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 663/1354] 10.222.0.67 () {62 vars in 1219 bytes} [Fri Sep 16 12:50:43 2022] PUT /compute/v2.1/flavors/1608096917 => generated 450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:50:43.175171 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7c9f23ed-0b13-4de8-a8de-f0dc1305a7ba tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:43.237584 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7c9f23ed-0b13-4de8-a8de-f0dc1305a7ba tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "DELETE /compute/v2.1/os-server-groups/dfed8cce-3e17-4e04-bf34-affb37f00909" status: 204 len: 0 microversion: 2.1 time: 0.075087 Sep 16 12:50:43.241511 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 664/1355] 10.222.0.67 () {58 vars in 1266 bytes} [Fri Sep 16 12:50:43 2022] DELETE /compute/v2.1/os-server-groups/dfed8cce-3e17-4e04-bf34-affb37f00909 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:50:43.252104 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7882d4ca-cddb-4628-8064-18f72c8a0146 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:43.252672 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7882d4ca-cddb-4628-8064-18f72c8a0146 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 21107d05-79f1-476d-b921-9548eff4f2c4] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:43.263785 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7882d4ca-cddb-4628-8064-18f72c8a0146 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:43.264338 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7882d4ca-cddb-4628-8064-18f72c8a0146 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:43.264828 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7882d4ca-cddb-4628-8064-18f72c8a0146 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:43.266310 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7882d4ca-cddb-4628-8064-18f72c8a0146 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:43.267067 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7882d4ca-cddb-4628-8064-18f72c8a0146 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:43.268088 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7882d4ca-cddb-4628-8064-18f72c8a0146 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:43.305395 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7882d4ca-cddb-4628-8064-18f72c8a0146 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 21107d05-79f1-476d-b921-9548eff4f2c4] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:50:43.429827 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7882d4ca-cddb-4628-8064-18f72c8a0146 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "DELETE /compute/v2.1/servers/21107d05-79f1-476d-b921-9548eff4f2c4" status: 204 len: 0 microversion: 2.1 time: 0.188854 Sep 16 12:50:43.435121 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 665/1356] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:50:43 2022] DELETE /compute/v2.1/servers/21107d05-79f1-476d-b921-9548eff4f2c4 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:50:43.445426 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a8a679ed-92ea-4676-b467-a90974655c30 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:43.446341 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a8a679ed-92ea-4676-b467-a90974655c30 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:43.456004 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8a679ed-92ea-4676-b467-a90974655c30 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:43.456554 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8a679ed-92ea-4676-b467-a90974655c30 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:43.456991 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8a679ed-92ea-4676-b467-a90974655c30 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:43.459078 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8a679ed-92ea-4676-b467-a90974655c30 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:43.459597 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8a679ed-92ea-4676-b467-a90974655c30 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:43.461048 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8a679ed-92ea-4676-b467-a90974655c30 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:43.655831 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a8a679ed-92ea-4676-b467-a90974655c30 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:43.670234 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a8a679ed-92ea-4676-b467-a90974655c30 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1542 microversion: 2.1 time: 0.232291 Sep 16 12:50:43.672390 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 666/1357] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:43 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1542 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:43.692187 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-26d287a1-f0d9-4e6b-a7a1-a162bc4f0a61 tempest-FlavorsV255TestJSON-1812679680 tempest-FlavorsV255TestJSON-1812679680-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:43.747944 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-26d287a1-f0d9-4e6b-a7a1-a162bc4f0a61 tempest-FlavorsV255TestJSON-1812679680 tempest-FlavorsV255TestJSON-1812679680-project] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5725 microversion: 2.55 time: 0.073202 Sep 16 12:50:43.749798 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 667/1358] 10.222.0.67 () {60 vars in 1187 bytes} [Fri Sep 16 12:50:43 2022] GET /compute/v2.1/flavors/detail => generated 5725 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:50:43.755777 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-990142fb-68be-41e6-84b5-974596d2c8ea tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:43.769227 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-990142fb-68be-41e6-84b5-974596d2c8ea tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.017550 Sep 16 12:50:43.771200 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 668/1359] 10.222.0.67 () {58 vars in 1152 bytes} [Fri Sep 16 12:50:43 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:50:43.789470 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-830ca39c-1186-4c8f-b0c2-dcc8fd22007a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:43.790217 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-830ca39c-1186-4c8f-b0c2-dcc8fd22007a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 8d5c44e7-c030-4a42-97fb-e838e1472456] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:43.801385 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-830ca39c-1186-4c8f-b0c2-dcc8fd22007a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:43.807576 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-830ca39c-1186-4c8f-b0c2-dcc8fd22007a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:43.809819 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-830ca39c-1186-4c8f-b0c2-dcc8fd22007a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:43.810748 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-830ca39c-1186-4c8f-b0c2-dcc8fd22007a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:43.813178 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-830ca39c-1186-4c8f-b0c2-dcc8fd22007a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:43.813762 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-830ca39c-1186-4c8f-b0c2-dcc8fd22007a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:44.068388 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-830ca39c-1186-4c8f-b0c2-dcc8fd22007a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:44.086032 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-830ca39c-1186-4c8f-b0c2-dcc8fd22007a tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/8d5c44e7-c030-4a42-97fb-e838e1472456" status: 200 len: 1475 microversion: 2.1 time: 0.313548 Sep 16 12:50:44.086649 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 669/1360] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:43 2022] GET /compute/v2.1/servers/8d5c44e7-c030-4a42-97fb-e838e1472456 => generated 1475 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:44.113684 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-15bb163b-308a-41dc-bc34-a7ec50ca7ce2 tempest-FlavorsV255TestJSON-1812679680 tempest-FlavorsV255TestJSON-1812679680-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:44.163474 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-15bb163b-308a-41dc-bc34-a7ec50ca7ce2 tempest-FlavorsV255TestJSON-1812679680 tempest-FlavorsV255TestJSON-1812679680-project] 10.222.0.67 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.55 time: 0.075416 Sep 16 12:50:44.167354 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 670/1361] 10.222.0.67 () {60 vars in 1166 bytes} [Fri Sep 16 12:50:44 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:50:44.181102 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c01bc8d1-1c07-4144-a3d9-18bfb79e8d20 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1260812776", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": [{"uuid": "abbd5857-5e09-4393-907b-66607bc40ec5"}]}, "os:scheduler_hints": {"group": "121fd690-9860-4950-a263-9bc4990668d3"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:50:47.670016 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=8 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:50:47.961168 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:50:48.086442 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=13 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:50:49.427127 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-91a1a19d-e24b-411a-8f36-048cb9db0940 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/5e802ae3-4c4e-4e51-b808-64dd163e6b3c" status: 200 len: 1438 microversion: 2.1 time: 11.316944 Sep 16 12:50:49.436463 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 692/1362] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:50:38 2022] GET /compute/v2.1/images/5e802ae3-4c4e-4e51-b808-64dd163e6b3c => generated 1438 bytes in 11327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:49.436977 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-c01bc8d1-1c07-4144-a3d9-18bfb79e8d20 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] validate_networks() for [('abbd5857-5e09-4393-907b-66607bc40ec5', None, None, None, None, None)] {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:50:49.442855 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-77e69022-bb9e-42b8-8df0-b14f87e31b21 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:49.443710 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-77e69022-bb9e-42b8-8df0-b14f87e31b21 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:49.450681 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77e69022-bb9e-42b8-8df0-b14f87e31b21 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:49.451514 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77e69022-bb9e-42b8-8df0-b14f87e31b21 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:49.451872 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77e69022-bb9e-42b8-8df0-b14f87e31b21 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:49.452631 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77e69022-bb9e-42b8-8df0-b14f87e31b21 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:49.453609 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77e69022-bb9e-42b8-8df0-b14f87e31b21 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:49.454305 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77e69022-bb9e-42b8-8df0-b14f87e31b21 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:49.573494 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-77e69022-bb9e-42b8-8df0-b14f87e31b21 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:49.597594 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-77e69022-bb9e-42b8-8df0-b14f87e31b21 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:49.599336 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-77e69022-bb9e-42b8-8df0-b14f87e31b21 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:49.611187 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-77e69022-bb9e-42b8-8df0-b14f87e31b21 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1546 microversion: 2.91 time: 0.172441 Sep 16 12:50:49.613292 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 693/1363] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:50:49 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1546 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:50:49.619094 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5c0e89c4-7d4c-4e60-b2b3-192eb26f1d98 tempest-FlavorsV255TestJSON-1922907140 tempest-FlavorsV255TestJSON-1922907140-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:49.649348 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5c0e89c4-7d4c-4e60-b2b3-192eb26f1d98 tempest-FlavorsV255TestJSON-1922907140 tempest-FlavorsV255TestJSON-1922907140-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1608096917" status: 202 len: 0 microversion: 2.55 time: 0.034302 Sep 16 12:50:49.654879 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 694/1364] 10.222.0.67 () {60 vars in 1202 bytes} [Fri Sep 16 12:50:49 2022] DELETE /compute/v2.1/flavors/1608096917 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:50:49.661544 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b411365a-3bf5-43b1-a549-29f7f6bfb523 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:49.662445 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b411365a-3bf5-43b1-a549-29f7f6bfb523 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:49.673689 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b411365a-3bf5-43b1-a549-29f7f6bfb523 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:49.674190 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b411365a-3bf5-43b1-a549-29f7f6bfb523 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:49.674778 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b411365a-3bf5-43b1-a549-29f7f6bfb523 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:49.675617 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b411365a-3bf5-43b1-a549-29f7f6bfb523 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:49.676073 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b411365a-3bf5-43b1-a549-29f7f6bfb523 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:49.676552 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b411365a-3bf5-43b1-a549-29f7f6bfb523 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:49.905119 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b411365a-3bf5-43b1-a549-29f7f6bfb523 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:49.925119 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b411365a-3bf5-43b1-a549-29f7f6bfb523 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1542 microversion: 2.1 time: 0.268627 Sep 16 12:50:49.931768 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 695/1365] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:49 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1542 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:49.941279 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cbf9ca9f-a951-4c62-810d-e439184b686b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:49.942280 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cbf9ca9f-a951-4c62-810d-e439184b686b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 8d5c44e7-c030-4a42-97fb-e838e1472456] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:49.971888 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cbf9ca9f-a951-4c62-810d-e439184b686b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:49.974909 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cbf9ca9f-a951-4c62-810d-e439184b686b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:49.975844 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cbf9ca9f-a951-4c62-810d-e439184b686b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:49.977922 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cbf9ca9f-a951-4c62-810d-e439184b686b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:49.979238 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cbf9ca9f-a951-4c62-810d-e439184b686b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:49.981589 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cbf9ca9f-a951-4c62-810d-e439184b686b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:50.081724 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-c01bc8d1-1c07-4144-a3d9-18bfb79e8d20 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:50:50.082285 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-c01bc8d1-1c07-4144-a3d9-18bfb79e8d20 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:50:50.082843 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-c01bc8d1-1c07-4144-a3d9-18bfb79e8d20 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:50:50.083472 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-c01bc8d1-1c07-4144-a3d9-18bfb79e8d20 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:50:50.084073 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-c01bc8d1-1c07-4144-a3d9-18bfb79e8d20 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:50:50.118092 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c01bc8d1-1c07-4144-a3d9-18bfb79e8d20 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:50.118885 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c01bc8d1-1c07-4144-a3d9-18bfb79e8d20 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:50.119519 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c01bc8d1-1c07-4144-a3d9-18bfb79e8d20 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:50.121034 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c01bc8d1-1c07-4144-a3d9-18bfb79e8d20 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:50.132463 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c01bc8d1-1c07-4144-a3d9-18bfb79e8d20 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:50.134112 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c01bc8d1-1c07-4144-a3d9-18bfb79e8d20 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:50.187226 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-c01bc8d1-1c07-4144-a3d9-18bfb79e8d20 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Getting quotas for project 665869d344cf42e38020c270515c5abf. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:50:50.196293 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-c01bc8d1-1c07-4144-a3d9-18bfb79e8d20 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Getting quotas for user 4242164d723c4db8a31efdda44f5207d and project 665869d344cf42e38020c270515c5abf. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:50:50.228863 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c01bc8d1-1c07-4144-a3d9-18bfb79e8d20 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:50:50.231714 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c01bc8d1-1c07-4144-a3d9-18bfb79e8d20 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] [instance: 80dccb7b-ee21-422f-8ec5-f31feeab1f65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:50:50.337413 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-c01bc8d1-1c07-4144-a3d9-18bfb79e8d20 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Getting quotas for project 665869d344cf42e38020c270515c5abf. Resources: {'server_group_members'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:50:50.361470 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-c01bc8d1-1c07-4144-a3d9-18bfb79e8d20 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Getting quotas for user 4242164d723c4db8a31efdda44f5207d and project 665869d344cf42e38020c270515c5abf. Resources: {'server_group_members'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:50:50.432577 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-c01bc8d1-1c07-4144-a3d9-18bfb79e8d20 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Getting quotas for project 665869d344cf42e38020c270515c5abf. Resources: {'server_group_members'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:50:50.441033 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-c01bc8d1-1c07-4144-a3d9-18bfb79e8d20 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Getting quotas for user 4242164d723c4db8a31efdda44f5207d and project 665869d344cf42e38020c270515c5abf. Resources: {'server_group_members'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:50:50.477944 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c01bc8d1-1c07-4144-a3d9-18bfb79e8d20 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.309139 Sep 16 12:50:50.479256 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 671/1366] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:50:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 6311 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:50:50.552477 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cbf9ca9f-a951-4c62-810d-e439184b686b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:50.563881 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cbf9ca9f-a951-4c62-810d-e439184b686b tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/8d5c44e7-c030-4a42-97fb-e838e1472456" status: 200 len: 1475 microversion: 2.1 time: 0.629891 Sep 16 12:50:50.594791 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 696/1367] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:49 2022] GET /compute/v2.1/servers/8d5c44e7-c030-4a42-97fb-e838e1472456 => generated 1475 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:50.605941 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e32ed80a-7007-4e24-9c1d-16a9cf14b659 tempest-FlavorsV255TestJSON-1922907140 tempest-FlavorsV255TestJSON-1922907140-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:50.621317 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-c97ade24-6293-4f82-a6bb-d6fe670c7f68 req-b3fb6910-c5ee-430e-8482-9da5858f7884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d5c44e7-c030-4a42-97fb-e838e1472456", "name": "network-vif-unplugged", "status": "completed", "tag": "5d6e364d-d651-4c3c-b21c-27421ce4597f"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:50:50.637629 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e32ed80a-7007-4e24-9c1d-16a9cf14b659 tempest-FlavorsV255TestJSON-1922907140 tempest-FlavorsV255TestJSON-1922907140-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.040603 Sep 16 12:50:50.648150 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 697/1368] 10.222.0.67 () {60 vars in 1187 bytes} [Fri Sep 16 12:50:50 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:50:50.648392 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-c97ade24-6293-4f82-a6bb-d6fe670c7f68 req-b3fb6910-c5ee-430e-8482-9da5858f7884 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:50.648392 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-c97ade24-6293-4f82-a6bb-d6fe670c7f68 req-b3fb6910-c5ee-430e-8482-9da5858f7884 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:50.648392 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-c97ade24-6293-4f82-a6bb-d6fe670c7f68 req-b3fb6910-c5ee-430e-8482-9da5858f7884 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:50.648643 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8c94d09b-e479-4caa-8107-2887fc1bdcba tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f103564b0d0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:50.660725 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:50:50.676116 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-c97ade24-6293-4f82-a6bb-d6fe670c7f68 req-b3fb6910-c5ee-430e-8482-9da5858f7884 service nova] Creating event network-vif-unplugged:5d6e364d-d651-4c3c-b21c-27421ce4597f for instance 8d5c44e7-c030-4a42-97fb-e838e1472456 on n-h2-858094-4 Sep 16 12:50:50.691352 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-c97ade24-6293-4f82-a6bb-d6fe670c7f68 req-b3fb6910-c5ee-430e-8482-9da5858f7884 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.210296 Sep 16 12:50:50.692272 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 672/1369] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:50:50.698779 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-daf3f53d-4364-457b-acac-d855b7312832 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:50.710920 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-daf3f53d-4364-457b-acac-d855b7312832 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] [instance: 80dccb7b-ee21-422f-8ec5-f31feeab1f65] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:50.724800 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8c94d09b-e479-4caa-8107-2887fc1bdcba tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/5e802ae3-4c4e-4e51-b808-64dd163e6b3c" status: 200 len: 1438 microversion: 2.1 time: 0.085095 Sep 16 12:50:50.725396 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 698/1370] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:50:50 2022] GET /compute/v2.1/images/5e802ae3-4c4e-4e51-b808-64dd163e6b3c => generated 1438 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:50.738526 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0f660ceb-7a46-4acc-99a7-efb5c740a5ee tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:50.741536 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0f660ceb-7a46-4acc-99a7-efb5c740a5ee tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:50.752550 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f660ceb-7a46-4acc-99a7-efb5c740a5ee tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:50.753312 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f660ceb-7a46-4acc-99a7-efb5c740a5ee tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:50.754419 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f660ceb-7a46-4acc-99a7-efb5c740a5ee tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:50.755170 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f660ceb-7a46-4acc-99a7-efb5c740a5ee tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:50.755645 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f660ceb-7a46-4acc-99a7-efb5c740a5ee tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:50.756696 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f660ceb-7a46-4acc-99a7-efb5c740a5ee tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:50.847843 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-daf3f53d-4364-457b-acac-d855b7312832 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4242164d723c4db8a31efdda44f5207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665869d344cf42e38020c270515c5abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:50.864929 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-daf3f53d-4364-457b-acac-d855b7312832 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "GET /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65" status: 200 len: 1213 microversion: 2.1 time: 0.170272 Sep 16 12:50:50.871713 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 673/1371] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:50 2022] GET /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65 => generated 1213 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:50.918095 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0f660ceb-7a46-4acc-99a7-efb5c740a5ee tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:50.934125 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0f660ceb-7a46-4acc-99a7-efb5c740a5ee tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:50.941696 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0f660ceb-7a46-4acc-99a7-efb5c740a5ee tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:50.982704 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7365c31b-2508-4412-a2ff-5d19e5a3db76 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:50.993372 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7365c31b-2508-4412-a2ff-5d19e5a3db76 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:51.005640 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0f660ceb-7a46-4acc-99a7-efb5c740a5ee tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1546 microversion: 2.91 time: 0.271904 Sep 16 12:50:51.010037 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7365c31b-2508-4412-a2ff-5d19e5a3db76 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:51.011019 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7365c31b-2508-4412-a2ff-5d19e5a3db76 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:51.012051 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7365c31b-2508-4412-a2ff-5d19e5a3db76 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:51.013146 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7365c31b-2508-4412-a2ff-5d19e5a3db76 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:51.013994 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7365c31b-2508-4412-a2ff-5d19e5a3db76 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:51.015902 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7365c31b-2508-4412-a2ff-5d19e5a3db76 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:51.031989 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 699/1372] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:50:50 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1546 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:50:51.592773 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ef216612-9842-4403-b115-94c88ae17446 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:51.594146 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ef216612-9842-4403-b115-94c88ae17446 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 8d5c44e7-c030-4a42-97fb-e838e1472456] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:51.620175 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef216612-9842-4403-b115-94c88ae17446 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:51.621684 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef216612-9842-4403-b115-94c88ae17446 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:51.622665 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef216612-9842-4403-b115-94c88ae17446 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:51.626322 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef216612-9842-4403-b115-94c88ae17446 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:51.631767 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef216612-9842-4403-b115-94c88ae17446 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:51.633561 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef216612-9842-4403-b115-94c88ae17446 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:51.699423 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7365c31b-2508-4412-a2ff-5d19e5a3db76 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:51.714756 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7365c31b-2508-4412-a2ff-5d19e5a3db76 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1542 microversion: 2.1 time: 0.761423 Sep 16 12:50:51.717972 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 674/1373] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:50 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1542 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:51.738459 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-bea5c64b-4b5a-4d00-bedc-f5413a3544f7 req-a7a83c42-36ff-45ce-8e12-f309614c5471 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d5c44e7-c030-4a42-97fb-e838e1472456", "name": "network-vif-deleted", "tag": "5d6e364d-d651-4c3c-b21c-27421ce4597f"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:50:51.808484 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-bea5c64b-4b5a-4d00-bedc-f5413a3544f7 req-a7a83c42-36ff-45ce-8e12-f309614c5471 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:51.813924 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-bea5c64b-4b5a-4d00-bedc-f5413a3544f7 req-a7a83c42-36ff-45ce-8e12-f309614c5471 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:51.814440 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-bea5c64b-4b5a-4d00-bedc-f5413a3544f7 req-a7a83c42-36ff-45ce-8e12-f309614c5471 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:51.845046 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-bea5c64b-4b5a-4d00-bedc-f5413a3544f7 req-a7a83c42-36ff-45ce-8e12-f309614c5471 service nova] Creating event network-vif-deleted:5d6e364d-d651-4c3c-b21c-27421ce4597f for instance 8d5c44e7-c030-4a42-97fb-e838e1472456 on n-h2-858094-4 Sep 16 12:50:51.857617 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-bea5c64b-4b5a-4d00-bedc-f5413a3544f7 req-a7a83c42-36ff-45ce-8e12-f309614c5471 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122718 Sep 16 12:50:51.862680 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ef216612-9842-4403-b115-94c88ae17446 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:51.873915 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 675/1374] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:50:51.878601 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ef216612-9842-4403-b115-94c88ae17446 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/8d5c44e7-c030-4a42-97fb-e838e1472456" status: 200 len: 1433 microversion: 2.1 time: 0.285904 Sep 16 12:50:51.893061 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 700/1375] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:51 2022] GET /compute/v2.1/servers/8d5c44e7-c030-4a42-97fb-e838e1472456 => generated 1433 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:50:51.900155 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a989e0cf-5e8a-4e85-b90c-a6149d26467d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f1036018550>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:51.914763 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8cc33277-139f-4e23-a325-edb7ddd1f152 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:51.915396 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8cc33277-139f-4e23-a325-edb7ddd1f152 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] [instance: 80dccb7b-ee21-422f-8ec5-f31feeab1f65] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:51.958123 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cc33277-139f-4e23-a325-edb7ddd1f152 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:51.958633 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cc33277-139f-4e23-a325-edb7ddd1f152 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:51.959083 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cc33277-139f-4e23-a325-edb7ddd1f152 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:51.972305 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cc33277-139f-4e23-a325-edb7ddd1f152 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:51.972889 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cc33277-139f-4e23-a325-edb7ddd1f152 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:51.973831 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cc33277-139f-4e23-a325-edb7ddd1f152 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:52.083540 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a989e0cf-5e8a-4e85-b90c-a6149d26467d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/5e802ae3-4c4e-4e51-b808-64dd163e6b3c" status: 200 len: 1438 microversion: 2.1 time: 0.209055 Sep 16 12:50:52.084178 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 676/1376] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:50:51 2022] GET /compute/v2.1/images/5e802ae3-4c4e-4e51-b808-64dd163e6b3c => generated 1438 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:52.097107 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-10eea346-651d-4c6d-b8e2-30452379612f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:52.111207 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-10eea346-651d-4c6d-b8e2-30452379612f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:52.132723 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-10eea346-651d-4c6d-b8e2-30452379612f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:52.133728 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-10eea346-651d-4c6d-b8e2-30452379612f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:52.134353 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-10eea346-651d-4c6d-b8e2-30452379612f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:52.135546 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-10eea346-651d-4c6d-b8e2-30452379612f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:52.139154 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-10eea346-651d-4c6d-b8e2-30452379612f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:52.139842 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-10eea346-651d-4c6d-b8e2-30452379612f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:52.227714 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8cc33277-139f-4e23-a325-edb7ddd1f152 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4242164d723c4db8a31efdda44f5207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665869d344cf42e38020c270515c5abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:52.242125 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8cc33277-139f-4e23-a325-edb7ddd1f152 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "GET /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65" status: 200 len: 1209 microversion: 2.1 time: 0.344939 Sep 16 12:50:52.245619 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 701/1377] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:51 2022] GET /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65 => generated 1209 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:52.321872 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-10eea346-651d-4c6d-b8e2-30452379612f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:52.374711 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-10eea346-651d-4c6d-b8e2-30452379612f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:52.388214 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-10eea346-651d-4c6d-b8e2-30452379612f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:52.461844 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-10eea346-651d-4c6d-b8e2-30452379612f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1546 microversion: 2.91 time: 0.310349 Sep 16 12:50:52.461844 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 677/1378] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:50:52 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1546 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:50:52.743689 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1f8958c3-13a6-4bad-a39a-a91b8e0d187d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:52.744351 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1f8958c3-13a6-4bad-a39a-a91b8e0d187d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:52.763894 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1f8958c3-13a6-4bad-a39a-a91b8e0d187d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:52.764261 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1f8958c3-13a6-4bad-a39a-a91b8e0d187d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:52.764706 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1f8958c3-13a6-4bad-a39a-a91b8e0d187d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:52.766128 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1f8958c3-13a6-4bad-a39a-a91b8e0d187d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:52.766899 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1f8958c3-13a6-4bad-a39a-a91b8e0d187d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:52.767332 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1f8958c3-13a6-4bad-a39a-a91b8e0d187d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:52.907394 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-830133d6-708d-48d7-aae3-8f766a99a45d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:52.908144 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-830133d6-708d-48d7-aae3-8f766a99a45d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 8d5c44e7-c030-4a42-97fb-e838e1472456] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:52.922821 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-830133d6-708d-48d7-aae3-8f766a99a45d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:52.924207 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-830133d6-708d-48d7-aae3-8f766a99a45d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:52.925752 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-830133d6-708d-48d7-aae3-8f766a99a45d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:52.929200 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-830133d6-708d-48d7-aae3-8f766a99a45d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:52.930748 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-830133d6-708d-48d7-aae3-8f766a99a45d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:52.933859 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-830133d6-708d-48d7-aae3-8f766a99a45d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:53.031519 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-830133d6-708d-48d7-aae3-8f766a99a45d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:53.037754 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-830133d6-708d-48d7-aae3-8f766a99a45d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:53.038558 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-830133d6-708d-48d7-aae3-8f766a99a45d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:53.039224 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-830133d6-708d-48d7-aae3-8f766a99a45d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lazy-loading 'fault' on Instance uuid 8d5c44e7-c030-4a42-97fb-e838e1472456 {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:50:53.122381 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1f8958c3-13a6-4bad-a39a-a91b8e0d187d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:53.138600 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1f8958c3-13a6-4bad-a39a-a91b8e0d187d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1542 microversion: 2.1 time: 0.399801 Sep 16 12:50:53.161373 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 702/1379] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:52 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1542 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:53.192802 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f6d13a3b-65e8-4fff-83ae-68c73b7c7fda tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f1035727d30>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:53.231619 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-830133d6-708d-48d7-aae3-8f766a99a45d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:53.250161 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-830133d6-708d-48d7-aae3-8f766a99a45d tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/8d5c44e7-c030-4a42-97fb-e838e1472456" status: 200 len: 1309 microversion: 2.1 time: 0.347694 Sep 16 12:50:53.251610 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 678/1380] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:52 2022] GET /compute/v2.1/servers/8d5c44e7-c030-4a42-97fb-e838e1472456 => generated 1309 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:53.276321 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-08ae3735-85e4-4d39-bbea-16997d2d47da tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:53.279021 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-08ae3735-85e4-4d39-bbea-16997d2d47da tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] [instance: 80dccb7b-ee21-422f-8ec5-f31feeab1f65] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:53.289044 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-08ae3735-85e4-4d39-bbea-16997d2d47da tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:53.289917 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-08ae3735-85e4-4d39-bbea-16997d2d47da tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:53.290794 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-08ae3735-85e4-4d39-bbea-16997d2d47da tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:53.292201 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-08ae3735-85e4-4d39-bbea-16997d2d47da tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:53.292936 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-08ae3735-85e4-4d39-bbea-16997d2d47da tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:53.293578 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-08ae3735-85e4-4d39-bbea-16997d2d47da tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:53.548702 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-08ae3735-85e4-4d39-bbea-16997d2d47da tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4242164d723c4db8a31efdda44f5207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665869d344cf42e38020c270515c5abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:53.561639 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-08ae3735-85e4-4d39-bbea-16997d2d47da tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "GET /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65" status: 200 len: 1265 microversion: 2.1 time: 0.291644 Sep 16 12:50:53.564270 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 679/1381] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:53 2022] GET /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65 => generated 1265 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:53.579344 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-456ef6ff-016a-46bb-b8bc-56a089934565 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:53.583081 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-456ef6ff-016a-46bb-b8bc-56a089934565 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:53.599589 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-456ef6ff-016a-46bb-b8bc-56a089934565 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:53.600098 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-456ef6ff-016a-46bb-b8bc-56a089934565 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:53.600597 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-456ef6ff-016a-46bb-b8bc-56a089934565 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:53.601329 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-456ef6ff-016a-46bb-b8bc-56a089934565 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:53.602286 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-456ef6ff-016a-46bb-b8bc-56a089934565 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:53.602828 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-456ef6ff-016a-46bb-b8bc-56a089934565 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:53.759711 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-456ef6ff-016a-46bb-b8bc-56a089934565 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:53.771679 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-456ef6ff-016a-46bb-b8bc-56a089934565 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:53.778838 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-456ef6ff-016a-46bb-b8bc-56a089934565 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:53.787105 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-456ef6ff-016a-46bb-b8bc-56a089934565 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1546 microversion: 2.91 time: 0.221099 Sep 16 12:50:53.788110 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 680/1382] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:50:53 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1546 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:50:54.083794 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f6d13a3b-65e8-4fff-83ae-68c73b7c7fda tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/5e802ae3-4c4e-4e51-b808-64dd163e6b3c" status: 200 len: 1447 microversion: 2.1 time: 0.920955 Sep 16 12:50:54.087817 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 703/1383] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:50:53 2022] GET /compute/v2.1/images/5e802ae3-4c4e-4e51-b808-64dd163e6b3c => generated 1447 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:54.110416 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-cfdb64f2-27bb-4be4-b9db-b7bcfe1bf3e8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f10358de160>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:54.175735 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ff5c4794-a684-48ea-88ae-3783a356285b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:54.176984 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ff5c4794-a684-48ea-88ae-3783a356285b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:54.189723 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff5c4794-a684-48ea-88ae-3783a356285b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:54.190344 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff5c4794-a684-48ea-88ae-3783a356285b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:54.190927 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff5c4794-a684-48ea-88ae-3783a356285b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:54.191569 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff5c4794-a684-48ea-88ae-3783a356285b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:54.192079 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff5c4794-a684-48ea-88ae-3783a356285b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:54.192666 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff5c4794-a684-48ea-88ae-3783a356285b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:54.200112 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-cfdb64f2-27bb-4be4-b9db-b7bcfe1bf3e8 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/5e802ae3-4c4e-4e51-b808-64dd163e6b3c" status: 200 len: 1447 microversion: 2.1 time: 0.099877 Sep 16 12:50:54.217870 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 681/1384] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:50:54 2022] GET /compute/v2.1/images/5e802ae3-4c4e-4e51-b808-64dd163e6b3c => generated 1447 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:54.225740 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b853f602-b861-400c-b826-ddc5671e0a9d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f103589a9d0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:54.801097 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ff5c4794-a684-48ea-88ae-3783a356285b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:54.815286 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ff5c4794-a684-48ea-88ae-3783a356285b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1542 microversion: 2.1 time: 0.643567 Sep 16 12:50:54.816912 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 704/1385] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:54 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1542 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:50:54.824644 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c2ed13fb-7114-4803-a7dc-83e180ff7149 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:54.825434 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c2ed13fb-7114-4803-a7dc-83e180ff7149 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 8d5c44e7-c030-4a42-97fb-e838e1472456] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:54.832772 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2ed13fb-7114-4803-a7dc-83e180ff7149 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:54.833692 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2ed13fb-7114-4803-a7dc-83e180ff7149 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:54.834426 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2ed13fb-7114-4803-a7dc-83e180ff7149 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:54.835765 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2ed13fb-7114-4803-a7dc-83e180ff7149 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:54.836473 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2ed13fb-7114-4803-a7dc-83e180ff7149 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:54.837234 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2ed13fb-7114-4803-a7dc-83e180ff7149 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:54.862275 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-c2ed13fb-7114-4803-a7dc-83e180ff7149 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] HTTP exception thrown: Instance 8d5c44e7-c030-4a42-97fb-e838e1472456 could not be found. Sep 16 12:50:54.867118 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c2ed13fb-7114-4803-a7dc-83e180ff7149 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Request method failure captured: Sep 16 12:50:54.867118 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/8d5c44e7-c030-4a42-97fb-e838e1472456 HTTP/1.1 Sep 16 12:50:54.867118 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:50:54.867118 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:50:54.867118 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:50:54.867118 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:50:54.867118 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:50:54.867118 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:50:54.867118 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:50:54.867118 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:50:54.867118 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHBjUf33JuiB067clS1pRc16KayMcfeeik_2N8qe1xVSws5r9dYJMo_cNLvp1lekO_QhmumFAa7ZdFpMFE4TUtIimhBv92jzTfY_v-8Zx2FEsNx-tLPQhXJ5HSs2Mpeu7Bs3Mkhe9HBesD1Uxdgz5IaUm8Ssa3r2ZDecZ2Zv1_45ono Sep 16 12:50:54.867118 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:50:54.867118 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:50:54.867118 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:50:54.867118 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:50:54.867118 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:50:54.867118 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:50:54.867118 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 8c037a6456444018a6ef54314419e2f2 Sep 16 12:50:54.867118 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersOnMultiNodesTest-1155904382 Sep 16 12:50:54.867118 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:50:54.867118 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:50:54.868593 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c037a6456444018a6ef54314419e2f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8c037a6456444018a6ef54314419e2f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8c037a6456444018a6ef54314419e2f2", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c037a6456444018a6ef54314419e2f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:50:54.868593 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ServersOnMultiNodesTest-1155904382 Sep 16 12:50:54.868593 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 8c037a6456444018a6ef54314419e2f2 Sep 16 12:50:54.868593 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1155904382 Sep 16 12:50:54.868593 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ServersOnMultiNodesTest-1155904382-project Sep 16 12:50:54.868593 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:50:54.868593 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:50:54.868593 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: c1928790cac542ec86add5794851f97a Sep 16 12:50:54.868593 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ServersOnMultiNodesTest-1155904382-project Sep 16 12:50:54.868593 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:50:54.868593 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 8d5c44e7-c030-4a42-97fb-e838e1472456 could not be found. Sep 16 12:50:54.868593 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '8d5c44e7-c030-4a42-97fb-e838e1472456'} Sep 16 12:50:54.869596 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:50:54.869596 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:54.869596 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:50:54.869596 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:50:54.869596 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:50:54.869596 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:50:54.869596 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:50:54.869596 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:50:54.869596 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:50:54.869596 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:50:54.869596 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d5c44e7-c030-4a42-97fb-e838e1472456 could not be found. Sep 16 12:50:54.869596 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:50:54.869596 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:50:54.869596 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:50:54.869596 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:54.869596 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:50:54.869596 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:50:54.869596 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:50:54.869596 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:50:54.869596 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:50:54.870891 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:50:54.870891 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:50:54.870891 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:50:54.870891 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:50:54.870891 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:50:54.870891 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:50:54.870891 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:50:54.870891 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d5c44e7-c030-4a42-97fb-e838e1472456 could not be found. Sep 16 12:50:54.870891 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:50:54.870891 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:50:54.870891 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:50:54.870891 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:54.870891 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:50:54.870891 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:50:54.870891 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:50:54.870891 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:50:54.870891 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d5c44e7-c030-4a42-97fb-e838e1472456 could not be found. Sep 16 12:50:54.870891 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:50:54.872033 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c2ed13fb-7114-4803-a7dc-83e180ff7149 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Returning 404 to user: Instance 8d5c44e7-c030-4a42-97fb-e838e1472456 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:50:54.872033 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c2ed13fb-7114-4803-a7dc-83e180ff7149 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/8d5c44e7-c030-4a42-97fb-e838e1472456" status: 404 len: 111 microversion: 2.1 time: 0.047760 Sep 16 12:50:54.873133 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 705/1386] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:54 2022] GET /compute/v2.1/servers/8d5c44e7-c030-4a42-97fb-e838e1472456 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:50:54.880317 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-b8b4ea04-6fba-40ed-9240-b729d453f0c7 req-d68c082b-1adb-40d7-a81f-5f512074b63b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21107d05-79f1-476d-b921-9548eff4f2c4", "name": "network-vif-deleted", "tag": "84d3e3e1-0c23-49c4-af27-80f8acbc75ae"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:50:54.893036 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b8b4ea04-6fba-40ed-9240-b729d453f0c7 req-d68c082b-1adb-40d7-a81f-5f512074b63b service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:54.893777 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b8b4ea04-6fba-40ed-9240-b729d453f0c7 req-d68c082b-1adb-40d7-a81f-5f512074b63b service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:54.894394 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b8b4ea04-6fba-40ed-9240-b729d453f0c7 req-d68c082b-1adb-40d7-a81f-5f512074b63b service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:54.909057 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-b8b4ea04-6fba-40ed-9240-b729d453f0c7 req-d68c082b-1adb-40d7-a81f-5f512074b63b service nova] Creating event network-vif-deleted:84d3e3e1-0c23-49c4-af27-80f8acbc75ae for instance 21107d05-79f1-476d-b921-9548eff4f2c4 on n-h2-858094-4 Sep 16 12:50:54.915457 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-b8b4ea04-6fba-40ed-9240-b729d453f0c7 req-d68c082b-1adb-40d7-a81f-5f512074b63b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040538 Sep 16 12:50:54.922788 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 706/1387] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:50:54.929386 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4111cad2-0a8d-43cb-9af7-a07738de9e0d tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:54.930092 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4111cad2-0a8d-43cb-9af7-a07738de9e0d tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] [instance: 80dccb7b-ee21-422f-8ec5-f31feeab1f65] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:54.938083 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4111cad2-0a8d-43cb-9af7-a07738de9e0d tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:54.938691 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4111cad2-0a8d-43cb-9af7-a07738de9e0d tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:54.939125 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4111cad2-0a8d-43cb-9af7-a07738de9e0d tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:54.939942 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4111cad2-0a8d-43cb-9af7-a07738de9e0d tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:54.940583 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4111cad2-0a8d-43cb-9af7-a07738de9e0d tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:54.941160 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4111cad2-0a8d-43cb-9af7-a07738de9e0d tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:55.113266 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b853f602-b861-400c-b826-ddc5671e0a9d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "DELETE /compute/v2.1/images/5e802ae3-4c4e-4e51-b808-64dd163e6b3c" status: 204 len: 0 microversion: 2.1 time: 0.893282 Sep 16 12:50:55.113981 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 682/1388] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:54 2022] DELETE /compute/v2.1/images/5e802ae3-4c4e-4e51-b808-64dd163e6b3c => generated 0 bytes in 895 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:50:55.120439 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-74a52bb9-c245-4d7f-9280-48f482253087 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:55.121423 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-74a52bb9-c245-4d7f-9280-48f482253087 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:55.148446 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-74a52bb9-c245-4d7f-9280-48f482253087 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:55.149198 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-74a52bb9-c245-4d7f-9280-48f482253087 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:55.149863 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-74a52bb9-c245-4d7f-9280-48f482253087 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:55.152066 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-74a52bb9-c245-4d7f-9280-48f482253087 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:55.152835 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-74a52bb9-c245-4d7f-9280-48f482253087 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:55.154064 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-74a52bb9-c245-4d7f-9280-48f482253087 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:55.195298 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4111cad2-0a8d-43cb-9af7-a07738de9e0d tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4242164d723c4db8a31efdda44f5207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665869d344cf42e38020c270515c5abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:55.204287 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4111cad2-0a8d-43cb-9af7-a07738de9e0d tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "GET /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65" status: 200 len: 1313 microversion: 2.1 time: 0.279261 Sep 16 12:50:55.208277 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 707/1389] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:54 2022] GET /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65 => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:55.213500 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1cc60eaf-c2e2-4816-8115-6efa7b90a518 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:55.214469 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1cc60eaf-c2e2-4816-8115-6efa7b90a518 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 21107d05-79f1-476d-b921-9548eff4f2c4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:55.222018 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cc60eaf-c2e2-4816-8115-6efa7b90a518 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:55.222608 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cc60eaf-c2e2-4816-8115-6efa7b90a518 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:55.223122 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cc60eaf-c2e2-4816-8115-6efa7b90a518 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:55.224326 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cc60eaf-c2e2-4816-8115-6efa7b90a518 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:55.225405 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cc60eaf-c2e2-4816-8115-6efa7b90a518 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:55.225988 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cc60eaf-c2e2-4816-8115-6efa7b90a518 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:55.250021 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-1cc60eaf-c2e2-4816-8115-6efa7b90a518 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] HTTP exception thrown: Instance 21107d05-79f1-476d-b921-9548eff4f2c4 could not be found. Sep 16 12:50:55.255199 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1cc60eaf-c2e2-4816-8115-6efa7b90a518 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Request method failure captured: Sep 16 12:50:55.255199 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/21107d05-79f1-476d-b921-9548eff4f2c4 HTTP/1.1 Sep 16 12:50:55.255199 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:50:55.255199 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:50:55.255199 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:50:55.255199 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:50:55.255199 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:50:55.255199 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:50:55.255199 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:50:55.255199 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:50:55.255199 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHBjUf33JuiB067clS1pRc16KayMcfeeik_2N8qe1xVSws5r9dYJMo_cNLvp1lekO_QhmumFAa7ZdFpMFE4TUtIimhBv92jzTfY_v-8Zx2FEsNx-tLPQhXJ5HSs2Mpeu7Bs3Mkhe9HBesD1Uxdgz5IaUm8Ssa3r2ZDecZ2Zv1_45ono Sep 16 12:50:55.255199 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:50:55.255199 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:50:55.255199 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:50:55.255199 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:50:55.255199 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:50:55.255199 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:50:55.255199 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 8c037a6456444018a6ef54314419e2f2 Sep 16 12:50:55.255199 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersOnMultiNodesTest-1155904382 Sep 16 12:50:55.255199 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:50:55.255199 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:50:55.257078 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c037a6456444018a6ef54314419e2f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8c037a6456444018a6ef54314419e2f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8c037a6456444018a6ef54314419e2f2", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c037a6456444018a6ef54314419e2f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:50:55.257078 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ServersOnMultiNodesTest-1155904382 Sep 16 12:50:55.257078 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 8c037a6456444018a6ef54314419e2f2 Sep 16 12:50:55.257078 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1155904382 Sep 16 12:50:55.257078 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ServersOnMultiNodesTest-1155904382-project Sep 16 12:50:55.257078 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:50:55.257078 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:50:55.257078 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: c1928790cac542ec86add5794851f97a Sep 16 12:50:55.257078 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ServersOnMultiNodesTest-1155904382-project Sep 16 12:50:55.257078 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:50:55.257078 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 21107d05-79f1-476d-b921-9548eff4f2c4 could not be found. Sep 16 12:50:55.257078 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '21107d05-79f1-476d-b921-9548eff4f2c4'} Sep 16 12:50:55.258011 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:50:55.258011 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:55.258011 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:50:55.258011 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:50:55.258011 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:50:55.258011 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:50:55.258011 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:50:55.258011 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:50:55.258011 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:50:55.258011 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:50:55.258011 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21107d05-79f1-476d-b921-9548eff4f2c4 could not be found. Sep 16 12:50:55.258011 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:50:55.258011 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:50:55.258011 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:50:55.258011 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:55.258011 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:50:55.258011 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:50:55.258011 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:50:55.258011 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:50:55.258011 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:50:55.259463 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:50:55.259463 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:50:55.259463 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:50:55.259463 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:50:55.259463 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:50:55.259463 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:50:55.259463 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:50:55.259463 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21107d05-79f1-476d-b921-9548eff4f2c4 could not be found. Sep 16 12:50:55.259463 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:50:55.259463 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:50:55.259463 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:50:55.259463 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:50:55.259463 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:50:55.259463 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:50:55.259463 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:50:55.259463 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:50:55.259463 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21107d05-79f1-476d-b921-9548eff4f2c4 could not be found. Sep 16 12:50:55.259463 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:50:55.260815 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1cc60eaf-c2e2-4816-8115-6efa7b90a518 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Returning 404 to user: Instance 21107d05-79f1-476d-b921-9548eff4f2c4 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:50:55.260815 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1cc60eaf-c2e2-4816-8115-6efa7b90a518 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/21107d05-79f1-476d-b921-9548eff4f2c4" status: 404 len: 111 microversion: 2.1 time: 0.050205 Sep 16 12:50:55.264414 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 708/1390] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:55 2022] GET /compute/v2.1/servers/21107d05-79f1-476d-b921-9548eff4f2c4 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:50:55.269875 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-283e8dbe-24c2-4176-a273-0a291b0188ed tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:55.270525 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-283e8dbe-24c2-4176-a273-0a291b0188ed tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:55.277295 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-283e8dbe-24c2-4176-a273-0a291b0188ed tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:55.277766 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-283e8dbe-24c2-4176-a273-0a291b0188ed tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:55.278195 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-283e8dbe-24c2-4176-a273-0a291b0188ed tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:55.279064 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-283e8dbe-24c2-4176-a273-0a291b0188ed tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:55.279668 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-283e8dbe-24c2-4176-a273-0a291b0188ed tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:55.280100 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-283e8dbe-24c2-4176-a273-0a291b0188ed tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:55.287019 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-74a52bb9-c245-4d7f-9280-48f482253087 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:55.298525 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-74a52bb9-c245-4d7f-9280-48f482253087 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:55.300297 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-74a52bb9-c245-4d7f-9280-48f482253087 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:55.304029 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:50:55.309207 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-74a52bb9-c245-4d7f-9280-48f482253087 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1533 microversion: 2.91 time: 0.192675 Sep 16 12:50:55.311028 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-283e8dbe-24c2-4176-a273-0a291b0188ed tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:50:55.319174 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 683/1391] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:50:55 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1533 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:50:55.324277 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1a75f7fa-efdb-417e-b876-7caa06e2bd5f tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:55.371245 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1a75f7fa-efdb-417e-b876-7caa06e2bd5f tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "DELETE /compute/v2.1/os-server-groups/8f990c0d-f2fd-44c0-ad6d-32dadf5fc37b" status: 204 len: 0 microversion: 2.1 time: 0.050792 Sep 16 12:50:55.371849 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 684/1392] 10.222.0.67 () {58 vars in 1266 bytes} [Fri Sep 16 12:50:55 2022] DELETE /compute/v2.1/os-server-groups/8f990c0d-f2fd-44c0-ad6d-32dadf5fc37b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:50:55.381703 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9e2492fc-41ac-499d-8e7b-844ac5e342ee tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:55.382339 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9e2492fc-41ac-499d-8e7b-844ac5e342ee tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:55.396828 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9e2492fc-41ac-499d-8e7b-844ac5e342ee tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:55.398524 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9e2492fc-41ac-499d-8e7b-844ac5e342ee tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:55.398524 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9e2492fc-41ac-499d-8e7b-844ac5e342ee tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:55.398808 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9e2492fc-41ac-499d-8e7b-844ac5e342ee tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:55.399328 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9e2492fc-41ac-499d-8e7b-844ac5e342ee tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:55.399768 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9e2492fc-41ac-499d-8e7b-844ac5e342ee tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:55.470493 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-283e8dbe-24c2-4176-a273-0a291b0188ed tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac" status: 204 len: 0 microversion: 2.1 time: 0.203864 Sep 16 12:50:55.474428 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 709/1393] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:50:55 2022] DELETE /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:50:55.482575 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7c2aeb44-435c-4ba9-a923-5e8d3cf9b1c0 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:55.483822 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7c2aeb44-435c-4ba9-a923-5e8d3cf9b1c0 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 8c7aea62-7b4d-400d-89fa-5411deefe490] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:55.495832 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c2aeb44-435c-4ba9-a923-5e8d3cf9b1c0 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:55.496526 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c2aeb44-435c-4ba9-a923-5e8d3cf9b1c0 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:55.497212 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c2aeb44-435c-4ba9-a923-5e8d3cf9b1c0 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:55.498206 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c2aeb44-435c-4ba9-a923-5e8d3cf9b1c0 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:55.498785 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c2aeb44-435c-4ba9-a923-5e8d3cf9b1c0 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:55.500766 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c2aeb44-435c-4ba9-a923-5e8d3cf9b1c0 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:55.545049 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-9e2492fc-41ac-499d-8e7b-844ac5e342ee tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Lazy-loading 'services' on Instance uuid e1f493c8-0adf-4575-8fbd-4591f72c5e6d {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:50:55.557392 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7c2aeb44-435c-4ba9-a923-5e8d3cf9b1c0 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 8c7aea62-7b4d-400d-89fa-5411deefe490] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:50:55.574304 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9e2492fc-41ac-499d-8e7b-844ac5e342ee tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1938 microversion: 2.91 time: 0.198587 Sep 16 12:50:55.588678 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 685/1394] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:50:55 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1938 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:50:55.604619 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3ce00081-a668-435d-ac3c-33d2482025f1 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:50:55.605564 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3ce00081-a668-435d-ac3c-33d2482025f1 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:55.613589 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3ce00081-a668-435d-ac3c-33d2482025f1 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:55.614431 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3ce00081-a668-435d-ac3c-33d2482025f1 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:55.615130 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3ce00081-a668-435d-ac3c-33d2482025f1 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:55.616066 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3ce00081-a668-435d-ac3c-33d2482025f1 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:55.616757 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3ce00081-a668-435d-ac3c-33d2482025f1 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:55.617776 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3ce00081-a668-435d-ac3c-33d2482025f1 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:55.652861 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-3ce00081-a668-435d-ac3c-33d2482025f1 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lazy-loading 'flavor' on Instance uuid e1f493c8-0adf-4575-8fbd-4591f72c5e6d {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:50:55.672940 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7c2aeb44-435c-4ba9-a923-5e8d3cf9b1c0 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "DELETE /compute/v2.1/servers/8c7aea62-7b4d-400d-89fa-5411deefe490" status: 204 len: 0 microversion: 2.1 time: 0.199148 Sep 16 12:50:55.674311 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 710/1395] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:50:55 2022] DELETE /compute/v2.1/servers/8c7aea62-7b4d-400d-89fa-5411deefe490 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:50:55.680059 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8c68d5e4-ed9c-47dc-ac12-aeed71ba7b68 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1116619600", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": [{"uuid": "0e610de6-3238-41c3-bd1a-f23917fad801"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:50:55.754963 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-8c68d5e4-ed9c-47dc-ac12-aeed71ba7b68 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] validate_networks() for [('0e610de6-3238-41c3-bd1a-f23917fad801', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:50:55.905120 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3ce00081-a668-435d-ac3c-33d2482025f1 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "POST /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d/action" status: 202 len: 0 microversion: 2.91 time: 0.306527 Sep 16 12:50:55.910111 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 686/1396] 10.222.0.67 () {62 vars in 1319 bytes} [Fri Sep 16 12:50:55 2022] POST /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:50:55.915972 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7708d477-2973-43e6-8eef-f64e286b6ccd tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:55.917190 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7708d477-2973-43e6-8eef-f64e286b6ccd tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 8c7aea62-7b4d-400d-89fa-5411deefe490] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:55.926992 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7708d477-2973-43e6-8eef-f64e286b6ccd tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:55.928035 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7708d477-2973-43e6-8eef-f64e286b6ccd tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:55.928703 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7708d477-2973-43e6-8eef-f64e286b6ccd tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:55.929725 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7708d477-2973-43e6-8eef-f64e286b6ccd tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:55.930384 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7708d477-2973-43e6-8eef-f64e286b6ccd tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:55.931053 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7708d477-2973-43e6-8eef-f64e286b6ccd tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:56.342801 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7708d477-2973-43e6-8eef-f64e286b6ccd tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:56.354360 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7708d477-2973-43e6-8eef-f64e286b6ccd tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/8c7aea62-7b4d-400d-89fa-5411deefe490" status: 200 len: 1471 microversion: 2.1 time: 0.442743 Sep 16 12:50:56.363279 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 687/1397] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:55 2022] GET /compute/v2.1/servers/8c7aea62-7b4d-400d-89fa-5411deefe490 => generated 1471 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:56.370573 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1541daa4-e780-494a-9c46-32e9e739a6cc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:56.371408 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-1541daa4-e780-494a-9c46-32e9e739a6cc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:56.383216 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1541daa4-e780-494a-9c46-32e9e739a6cc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:56.383864 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1541daa4-e780-494a-9c46-32e9e739a6cc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:56.384446 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1541daa4-e780-494a-9c46-32e9e739a6cc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:56.385534 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1541daa4-e780-494a-9c46-32e9e739a6cc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:56.386256 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1541daa4-e780-494a-9c46-32e9e739a6cc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:56.386981 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1541daa4-e780-494a-9c46-32e9e739a6cc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:56.655119 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-8c68d5e4-ed9c-47dc-ac12-aeed71ba7b68 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:50:56.656945 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-8c68d5e4-ed9c-47dc-ac12-aeed71ba7b68 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:50:56.657848 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-8c68d5e4-ed9c-47dc-ac12-aeed71ba7b68 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:50:56.658329 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-8c68d5e4-ed9c-47dc-ac12-aeed71ba7b68 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:50:56.658939 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-8c68d5e4-ed9c-47dc-ac12-aeed71ba7b68 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:50:56.669010 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c68d5e4-ed9c-47dc-ac12-aeed71ba7b68 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:56.670004 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c68d5e4-ed9c-47dc-ac12-aeed71ba7b68 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:56.671264 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c68d5e4-ed9c-47dc-ac12-aeed71ba7b68 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:56.672406 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c68d5e4-ed9c-47dc-ac12-aeed71ba7b68 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:56.673158 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c68d5e4-ed9c-47dc-ac12-aeed71ba7b68 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:56.673808 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c68d5e4-ed9c-47dc-ac12-aeed71ba7b68 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:56.695547 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-8c68d5e4-ed9c-47dc-ac12-aeed71ba7b68 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Getting quotas for project e6fa2067c44b42b5aa940619abd8e538. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:50:56.699370 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1541daa4-e780-494a-9c46-32e9e739a6cc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:56.704617 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-8c68d5e4-ed9c-47dc-ac12-aeed71ba7b68 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Getting quotas for user 0cf11dfc3438406ba2710b06fa0fe8ff and project e6fa2067c44b42b5aa940619abd8e538. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:50:56.716005 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1541daa4-e780-494a-9c46-32e9e739a6cc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1542 microversion: 2.1 time: 0.352311 Sep 16 12:50:56.718130 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 688/1398] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:56 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1542 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:56.726654 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-908c119f-4cc2-4f59-a388-9f3a92e62314 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:56.728997 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-908c119f-4cc2-4f59-a388-9f3a92e62314 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:56.738757 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-908c119f-4cc2-4f59-a388-9f3a92e62314 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:56.739880 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-908c119f-4cc2-4f59-a388-9f3a92e62314 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:56.741334 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-908c119f-4cc2-4f59-a388-9f3a92e62314 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:56.742444 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8c68d5e4-ed9c-47dc-ac12-aeed71ba7b68 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:50:56.743085 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-908c119f-4cc2-4f59-a388-9f3a92e62314 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:56.743555 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-908c119f-4cc2-4f59-a388-9f3a92e62314 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:56.743986 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-908c119f-4cc2-4f59-a388-9f3a92e62314 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:56.746095 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8c68d5e4-ed9c-47dc-ac12-aeed71ba7b68 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: f9070e88-5408-48ab-9f4b-a74368e8f25e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:50:56.800819 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8c68d5e4-ed9c-47dc-ac12-aeed71ba7b68 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.124786 Sep 16 12:50:56.802241 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 711/1399] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:50:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:50:56.807301 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-94933fd6-3bc5-4241-81b8-ffb90011ba5c tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:56.808261 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-94933fd6-3bc5-4241-81b8-ffb90011ba5c tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] [instance: 80dccb7b-ee21-422f-8ec5-f31feeab1f65] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:56.816651 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94933fd6-3bc5-4241-81b8-ffb90011ba5c tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:56.817471 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94933fd6-3bc5-4241-81b8-ffb90011ba5c tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:56.818107 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94933fd6-3bc5-4241-81b8-ffb90011ba5c tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:56.819114 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94933fd6-3bc5-4241-81b8-ffb90011ba5c tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:56.819767 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94933fd6-3bc5-4241-81b8-ffb90011ba5c tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:56.820441 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94933fd6-3bc5-4241-81b8-ffb90011ba5c tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:56.986696 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-908c119f-4cc2-4f59-a388-9f3a92e62314 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:56.996595 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-908c119f-4cc2-4f59-a388-9f3a92e62314 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:57.004474 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-908c119f-4cc2-4f59-a388-9f3a92e62314 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:57.019416 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-908c119f-4cc2-4f59-a388-9f3a92e62314 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.298295 Sep 16 12:50:57.020012 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 689/1400] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:50:56 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:50:57.337736 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-90d01725-a8bd-4457-8283-0c388c6584f1 req-eb89ea06-3692-4d42-9dd7-2fc9505c8f22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80dccb7b-ee21-422f-8ec5-f31feeab1f65", "tag": "b830d871-a472-440e-a2b5-2d8208f11f14"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:50:57.353192 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-94933fd6-3bc5-4241-81b8-ffb90011ba5c tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4242164d723c4db8a31efdda44f5207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665869d344cf42e38020c270515c5abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:57.353839 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-90d01725-a8bd-4457-8283-0c388c6584f1 req-eb89ea06-3692-4d42-9dd7-2fc9505c8f22 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:57.354424 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-90d01725-a8bd-4457-8283-0c388c6584f1 req-eb89ea06-3692-4d42-9dd7-2fc9505c8f22 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:57.354963 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-90d01725-a8bd-4457-8283-0c388c6584f1 req-eb89ea06-3692-4d42-9dd7-2fc9505c8f22 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:57.362834 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:50:57.376042 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-94933fd6-3bc5-4241-81b8-ffb90011ba5c tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "GET /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65" status: 200 len: 1313 microversion: 2.1 time: 0.572287 Sep 16 12:50:57.378049 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 712/1401] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:56 2022] GET /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65 => generated 1313 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:57.388798 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f31bc3d0-e100-4b37-a252-19dc59a466e2 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:57.390274 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f31bc3d0-e100-4b37-a252-19dc59a466e2 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: f9070e88-5408-48ab-9f4b-a74368e8f25e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:57.394092 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-90d01725-a8bd-4457-8283-0c388c6584f1 req-eb89ea06-3692-4d42-9dd7-2fc9505c8f22 service nova] Creating event network-changed:b830d871-a472-440e-a2b5-2d8208f11f14 for instance 80dccb7b-ee21-422f-8ec5-f31feeab1f65 on n-h1-858094-4 Sep 16 12:50:57.407131 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-90d01725-a8bd-4457-8283-0c388c6584f1 req-eb89ea06-3692-4d42-9dd7-2fc9505c8f22 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.382653 Sep 16 12:50:57.410145 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 690/1402] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:50:57.425211 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-887ede38-eab7-465d-981c-e725dc17e668 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:57.426354 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-887ede38-eab7-465d-981c-e725dc17e668 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 8c7aea62-7b4d-400d-89fa-5411deefe490] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:57.443475 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-887ede38-eab7-465d-981c-e725dc17e668 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:57.444046 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-887ede38-eab7-465d-981c-e725dc17e668 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:57.445700 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-887ede38-eab7-465d-981c-e725dc17e668 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:57.447416 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-887ede38-eab7-465d-981c-e725dc17e668 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:57.449798 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-887ede38-eab7-465d-981c-e725dc17e668 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:57.451073 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-887ede38-eab7-465d-981c-e725dc17e668 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:57.564007 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f31bc3d0-e100-4b37-a252-19dc59a466e2 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:57.576944 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f31bc3d0-e100-4b37-a252-19dc59a466e2 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e" status: 200 len: 1208 microversion: 2.1 time: 0.195900 Sep 16 12:50:57.580494 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 713/1403] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:57 2022] GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e => generated 1208 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:57.741694 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-53a5f1b6-0f25-4901-9738-4c983a8011ec tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:57.742977 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-53a5f1b6-0f25-4901-9738-4c983a8011ec tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:57.751502 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53a5f1b6-0f25-4901-9738-4c983a8011ec tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:57.752255 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53a5f1b6-0f25-4901-9738-4c983a8011ec tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:57.752837 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53a5f1b6-0f25-4901-9738-4c983a8011ec tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:57.753821 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53a5f1b6-0f25-4901-9738-4c983a8011ec tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:57.754457 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53a5f1b6-0f25-4901-9738-4c983a8011ec tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:57.755048 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53a5f1b6-0f25-4901-9738-4c983a8011ec tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:58.129885 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-887ede38-eab7-465d-981c-e725dc17e668 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:58.142704 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-887ede38-eab7-465d-981c-e725dc17e668 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/8c7aea62-7b4d-400d-89fa-5411deefe490" status: 200 len: 1471 microversion: 2.1 time: 0.730736 Sep 16 12:50:58.142815 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 691/1404] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:57 2022] GET /compute/v2.1/servers/8c7aea62-7b4d-400d-89fa-5411deefe490 => generated 1471 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:58.161209 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-29054449-e7f1-428d-806b-b57a5221429f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:58.161808 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-29054449-e7f1-428d-806b-b57a5221429f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:58.182848 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-29054449-e7f1-428d-806b-b57a5221429f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:58.185180 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-29054449-e7f1-428d-806b-b57a5221429f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:58.185634 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-29054449-e7f1-428d-806b-b57a5221429f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:58.186431 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-29054449-e7f1-428d-806b-b57a5221429f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:58.186892 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-29054449-e7f1-428d-806b-b57a5221429f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:58.187318 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-29054449-e7f1-428d-806b-b57a5221429f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:58.347240 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-53a5f1b6-0f25-4901-9738-4c983a8011ec tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:58.363299 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-53a5f1b6-0f25-4901-9738-4c983a8011ec tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1542 microversion: 2.1 time: 0.625793 Sep 16 12:50:58.363892 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 714/1405] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:57 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1542 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:58.373590 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-65c7c489-dd13-44fb-9d20-a78900db2b89 req-3bdec3ed-abf4-4790-b0a0-f17b2cdaea13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7725f9a0-ac02-47ad-a67f-a9d42c2a6aac", "name": "network-vif-unplugged", "status": "completed", "tag": "e749f518-c322-429e-b87d-fb7a8eccab82"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:50:58.401251 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-65c7c489-dd13-44fb-9d20-a78900db2b89 req-3bdec3ed-abf4-4790-b0a0-f17b2cdaea13 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:58.401753 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-65c7c489-dd13-44fb-9d20-a78900db2b89 req-3bdec3ed-abf4-4790-b0a0-f17b2cdaea13 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:58.402196 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-65c7c489-dd13-44fb-9d20-a78900db2b89 req-3bdec3ed-abf4-4790-b0a0-f17b2cdaea13 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:58.416746 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-29054449-e7f1-428d-806b-b57a5221429f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:58.425557 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-29054449-e7f1-428d-806b-b57a5221429f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:58.427263 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-29054449-e7f1-428d-806b-b57a5221429f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:58.428177 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-65c7c489-dd13-44fb-9d20-a78900db2b89 req-3bdec3ed-abf4-4790-b0a0-f17b2cdaea13 service nova] Creating event network-vif-unplugged:e749f518-c322-429e-b87d-fb7a8eccab82 for instance 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac on n-h2-858094-4 Sep 16 12:50:58.433542 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-29054449-e7f1-428d-806b-b57a5221429f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.289107 Sep 16 12:50:58.434120 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 692/1406] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:50:58 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:50:58.438257 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-65c7c489-dd13-44fb-9d20-a78900db2b89 req-3bdec3ed-abf4-4790-b0a0-f17b2cdaea13 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071845 Sep 16 12:50:58.439010 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 715/1407] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:50:58.440181 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2dd7f4d6-325c-43db-bcfe-fe0a4e358ba1 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:58.440941 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-2dd7f4d6-325c-43db-bcfe-fe0a4e358ba1 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] [instance: 80dccb7b-ee21-422f-8ec5-f31feeab1f65] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:58.454073 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2dd7f4d6-325c-43db-bcfe-fe0a4e358ba1 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:58.455502 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2dd7f4d6-325c-43db-bcfe-fe0a4e358ba1 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:58.456010 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2dd7f4d6-325c-43db-bcfe-fe0a4e358ba1 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:58.456812 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2dd7f4d6-325c-43db-bcfe-fe0a4e358ba1 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:58.457499 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2dd7f4d6-325c-43db-bcfe-fe0a4e358ba1 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:58.457987 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2dd7f4d6-325c-43db-bcfe-fe0a4e358ba1 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:58.463149 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:50:58.607111 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ba99d926-745f-4a15-a933-112231f07dbf tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:58.607814 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ba99d926-745f-4a15-a933-112231f07dbf tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: f9070e88-5408-48ab-9f4b-a74368e8f25e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:58.618569 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba99d926-745f-4a15-a933-112231f07dbf tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:58.619041 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba99d926-745f-4a15-a933-112231f07dbf tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:58.619488 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba99d926-745f-4a15-a933-112231f07dbf tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:58.625162 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba99d926-745f-4a15-a933-112231f07dbf tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:58.625718 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba99d926-745f-4a15-a933-112231f07dbf tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:58.626418 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba99d926-745f-4a15-a933-112231f07dbf tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:58.826399 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-2dd7f4d6-325c-43db-bcfe-fe0a4e358ba1 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4242164d723c4db8a31efdda44f5207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665869d344cf42e38020c270515c5abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:58.836947 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2dd7f4d6-325c-43db-bcfe-fe0a4e358ba1 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "GET /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65" status: 200 len: 1313 microversion: 2.1 time: 0.401602 Sep 16 12:50:58.844307 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ba99d926-745f-4a15-a933-112231f07dbf tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:58.852923 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ba99d926-745f-4a15-a933-112231f07dbf tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e" status: 200 len: 1260 microversion: 2.1 time: 0.250465 Sep 16 12:50:58.853293 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 693/1408] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:58 2022] GET /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65 => generated 1313 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:58.879361 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 716/1409] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:58 2022] GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e => generated 1260 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:58.881579 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-9e360678-3099-4609-bb81-d5d03aff6ba3 req-afef3b5e-e912-4890-bea0-0cd67dc88297 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7725f9a0-ac02-47ad-a67f-a9d42c2a6aac", "name": "network-vif-deleted", "tag": "e749f518-c322-429e-b87d-fb7a8eccab82"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:50:58.899061 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-9e360678-3099-4609-bb81-d5d03aff6ba3 req-afef3b5e-e912-4890-bea0-0cd67dc88297 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:58.899555 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-9e360678-3099-4609-bb81-d5d03aff6ba3 req-afef3b5e-e912-4890-bea0-0cd67dc88297 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:58.899989 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-9e360678-3099-4609-bb81-d5d03aff6ba3 req-afef3b5e-e912-4890-bea0-0cd67dc88297 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:58.920581 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-9e360678-3099-4609-bb81-d5d03aff6ba3 req-afef3b5e-e912-4890-bea0-0cd67dc88297 service nova] Creating event network-vif-deleted:e749f518-c322-429e-b87d-fb7a8eccab82 for instance 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac on n-h2-858094-4 Sep 16 12:50:58.939784 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-9e360678-3099-4609-bb81-d5d03aff6ba3 req-afef3b5e-e912-4890-bea0-0cd67dc88297 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084977 Sep 16 12:50:58.947475 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 694/1410] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:50:59.169702 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a3d31bf6-8689-4795-834f-b876b4fd4675 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:59.171294 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a3d31bf6-8689-4795-834f-b876b4fd4675 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 8c7aea62-7b4d-400d-89fa-5411deefe490] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:59.184280 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3d31bf6-8689-4795-834f-b876b4fd4675 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:59.185134 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3d31bf6-8689-4795-834f-b876b4fd4675 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:59.186885 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3d31bf6-8689-4795-834f-b876b4fd4675 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:59.188009 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3d31bf6-8689-4795-834f-b876b4fd4675 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:59.189323 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3d31bf6-8689-4795-834f-b876b4fd4675 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:59.190125 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3d31bf6-8689-4795-834f-b876b4fd4675 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:59.256219 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a3d31bf6-8689-4795-834f-b876b4fd4675 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:59.269503 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a3d31bf6-8689-4795-834f-b876b4fd4675 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/8c7aea62-7b4d-400d-89fa-5411deefe490" status: 200 len: 1429 microversion: 2.1 time: 0.104686 Sep 16 12:50:59.282846 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 717/1411] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:59 2022] GET /compute/v2.1/servers/8c7aea62-7b4d-400d-89fa-5411deefe490 => generated 1429 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:59.393157 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-587b3c3b-e82d-487a-9f45-a7b64780f8fb tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:59.394426 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-587b3c3b-e82d-487a-9f45-a7b64780f8fb tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:59.408330 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-587b3c3b-e82d-487a-9f45-a7b64780f8fb tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:59.409368 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-587b3c3b-e82d-487a-9f45-a7b64780f8fb tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:59.410028 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-587b3c3b-e82d-487a-9f45-a7b64780f8fb tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:59.413311 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-587b3c3b-e82d-487a-9f45-a7b64780f8fb tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:59.414979 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-587b3c3b-e82d-487a-9f45-a7b64780f8fb tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:59.415935 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-587b3c3b-e82d-487a-9f45-a7b64780f8fb tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:59.439207 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-65ee114e-be5f-4b57-9c38-fddd7856f968 req-124300a4-648c-4aaf-8bce-c8e98cf0a31d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c7aea62-7b4d-400d-89fa-5411deefe490", "name": "network-vif-deleted", "tag": "27de96a3-bf43-46c1-a8f8-afd304cea206"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:50:59.469929 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-65ee114e-be5f-4b57-9c38-fddd7856f968 req-124300a4-648c-4aaf-8bce-c8e98cf0a31d service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:59.472421 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-65ee114e-be5f-4b57-9c38-fddd7856f968 req-124300a4-648c-4aaf-8bce-c8e98cf0a31d service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:59.473180 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-65ee114e-be5f-4b57-9c38-fddd7856f968 req-124300a4-648c-4aaf-8bce-c8e98cf0a31d service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:59.513298 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-65ee114e-be5f-4b57-9c38-fddd7856f968 req-124300a4-648c-4aaf-8bce-c8e98cf0a31d service nova] Creating event network-vif-deleted:27de96a3-bf43-46c1-a8f8-afd304cea206 for instance 8c7aea62-7b4d-400d-89fa-5411deefe490 on n-h1-858094-4 Sep 16 12:50:59.523249 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-65ee114e-be5f-4b57-9c38-fddd7856f968 req-124300a4-648c-4aaf-8bce-c8e98cf0a31d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088651 Sep 16 12:50:59.541995 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 718/1412] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:50:59.561777 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f0e5a748-6b39-4946-b0cc-19fbc9f00dee tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:59.562937 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f0e5a748-6b39-4946-b0cc-19fbc9f00dee tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:59.574281 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0e5a748-6b39-4946-b0cc-19fbc9f00dee tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:59.575202 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0e5a748-6b39-4946-b0cc-19fbc9f00dee tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:59.578707 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0e5a748-6b39-4946-b0cc-19fbc9f00dee tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:59.580053 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0e5a748-6b39-4946-b0cc-19fbc9f00dee tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:59.581214 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0e5a748-6b39-4946-b0cc-19fbc9f00dee tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:59.582174 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0e5a748-6b39-4946-b0cc-19fbc9f00dee tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:59.735485 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-587b3c3b-e82d-487a-9f45-a7b64780f8fb tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:59.745227 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-587b3c3b-e82d-487a-9f45-a7b64780f8fb tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1542 microversion: 2.1 time: 0.357970 Sep 16 12:50:59.753364 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 695/1413] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:59 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1542 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:50:59.815934 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f0e5a748-6b39-4946-b0cc-19fbc9f00dee tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:59.825508 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f0e5a748-6b39-4946-b0cc-19fbc9f00dee tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:59.827141 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f0e5a748-6b39-4946-b0cc-19fbc9f00dee tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:50:59.833194 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f0e5a748-6b39-4946-b0cc-19fbc9f00dee tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.289204 Sep 16 12:50:59.834185 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 719/1414] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:50:59 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:50:59.873086 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a55c17a7-295a-47ea-9160-87850a009aee tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:59.875390 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a55c17a7-295a-47ea-9160-87850a009aee tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] [instance: 80dccb7b-ee21-422f-8ec5-f31feeab1f65] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:59.883442 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a55c17a7-295a-47ea-9160-87850a009aee tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:59.884320 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a55c17a7-295a-47ea-9160-87850a009aee tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:59.884959 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a55c17a7-295a-47ea-9160-87850a009aee tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:59.885910 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a55c17a7-295a-47ea-9160-87850a009aee tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:59.886583 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a55c17a7-295a-47ea-9160-87850a009aee tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:59.887206 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a55c17a7-295a-47ea-9160-87850a009aee tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:59.888458 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-41323823-e639-483e-933c-dd60f4a5a862 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:50:59.889145 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-41323823-e639-483e-933c-dd60f4a5a862 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: f9070e88-5408-48ab-9f4b-a74368e8f25e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:50:59.897470 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41323823-e639-483e-933c-dd60f4a5a862 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:59.897963 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41323823-e639-483e-933c-dd60f4a5a862 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:59.907377 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41323823-e639-483e-933c-dd60f4a5a862 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:50:59.908576 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41323823-e639-483e-933c-dd60f4a5a862 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:50:59.909218 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41323823-e639-483e-933c-dd60f4a5a862 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:50:59.909814 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41323823-e639-483e-933c-dd60f4a5a862 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:00.041828 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-41323823-e639-483e-933c-dd60f4a5a862 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:00.054687 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-41323823-e639-483e-933c-dd60f4a5a862 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e" status: 200 len: 1260 microversion: 2.1 time: 0.169282 Sep 16 12:51:00.057520 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 720/1415] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:59 2022] GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:51:00.101174 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a55c17a7-295a-47ea-9160-87850a009aee tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4242164d723c4db8a31efdda44f5207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665869d344cf42e38020c270515c5abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:00.112105 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a55c17a7-295a-47ea-9160-87850a009aee tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "GET /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65" status: 200 len: 1313 microversion: 2.1 time: 0.242936 Sep 16 12:51:00.128972 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 696/1416] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:50:59 2022] GET /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65 => generated 1313 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:00.309790 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-56be0060-82f2-4fe4-bd43-f58aab13ef37 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:00.310659 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-56be0060-82f2-4fe4-bd43-f58aab13ef37 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 8c7aea62-7b4d-400d-89fa-5411deefe490] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:00.321755 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56be0060-82f2-4fe4-bd43-f58aab13ef37 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:00.322286 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56be0060-82f2-4fe4-bd43-f58aab13ef37 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:00.322730 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56be0060-82f2-4fe4-bd43-f58aab13ef37 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:00.323519 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56be0060-82f2-4fe4-bd43-f58aab13ef37 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:00.324208 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56be0060-82f2-4fe4-bd43-f58aab13ef37 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:00.324851 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56be0060-82f2-4fe4-bd43-f58aab13ef37 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:00.399557 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-56be0060-82f2-4fe4-bd43-f58aab13ef37 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:00.407848 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-56be0060-82f2-4fe4-bd43-f58aab13ef37 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/8c7aea62-7b4d-400d-89fa-5411deefe490" status: 200 len: 1429 microversion: 2.1 time: 0.116765 Sep 16 12:51:00.408939 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 721/1417] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:00 2022] GET /compute/v2.1/servers/8c7aea62-7b4d-400d-89fa-5411deefe490 => generated 1429 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:00.767982 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:51:00.777566 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e7d08767-be85-4a58-be5b-6a54b453ef70 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:00.778419 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e7d08767-be85-4a58-be5b-6a54b453ef70 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:00.807984 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e7d08767-be85-4a58-be5b-6a54b453ef70 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:00.808527 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e7d08767-be85-4a58-be5b-6a54b453ef70 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:00.808969 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e7d08767-be85-4a58-be5b-6a54b453ef70 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:00.809807 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e7d08767-be85-4a58-be5b-6a54b453ef70 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:00.810143 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e7d08767-be85-4a58-be5b-6a54b453ef70 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:00.810578 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e7d08767-be85-4a58-be5b-6a54b453ef70 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:00.866888 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-62810059-798c-4c0e-a539-6d85bd0031b9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:00.867506 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-62810059-798c-4c0e-a539-6d85bd0031b9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:00.878499 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=48 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:51:00.888412 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62810059-798c-4c0e-a539-6d85bd0031b9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:00.888915 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62810059-798c-4c0e-a539-6d85bd0031b9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:00.889588 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62810059-798c-4c0e-a539-6d85bd0031b9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:00.890171 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62810059-798c-4c0e-a539-6d85bd0031b9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:00.890630 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62810059-798c-4c0e-a539-6d85bd0031b9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:00.891061 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62810059-798c-4c0e-a539-6d85bd0031b9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:01.113974 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-62810059-798c-4c0e-a539-6d85bd0031b9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:01.127473 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-62810059-798c-4c0e-a539-6d85bd0031b9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:01.129330 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-62810059-798c-4c0e-a539-6d85bd0031b9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:01.152425 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-62810059-798c-4c0e-a539-6d85bd0031b9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.289274 Sep 16 12:51:01.173482 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 722/1418] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:00 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:01.188963 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-91fc861a-9d4d-487e-88d9-2c94909cf99d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:01.189829 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-91fc861a-9d4d-487e-88d9-2c94909cf99d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: f9070e88-5408-48ab-9f4b-a74368e8f25e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:01.196553 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-91fc861a-9d4d-487e-88d9-2c94909cf99d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:01.197425 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-91fc861a-9d4d-487e-88d9-2c94909cf99d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:01.198023 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-91fc861a-9d4d-487e-88d9-2c94909cf99d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:01.199095 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-91fc861a-9d4d-487e-88d9-2c94909cf99d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:01.199703 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-91fc861a-9d4d-487e-88d9-2c94909cf99d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:01.200397 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-91fc861a-9d4d-487e-88d9-2c94909cf99d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:01.234466 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e7d08767-be85-4a58-be5b-6a54b453ef70 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:01.243159 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e7d08767-be85-4a58-be5b-6a54b453ef70 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1542 microversion: 2.1 time: 0.475977 Sep 16 12:51:01.248913 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 697/1419] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:00 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1542 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:01.268913 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8844ac86-c328-4551-bfc2-249b4c330884 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:01.269809 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8844ac86-c328-4551-bfc2-249b4c330884 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] [instance: 80dccb7b-ee21-422f-8ec5-f31feeab1f65] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:01.276054 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8844ac86-c328-4551-bfc2-249b4c330884 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:01.277017 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8844ac86-c328-4551-bfc2-249b4c330884 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:01.277645 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8844ac86-c328-4551-bfc2-249b4c330884 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:01.278713 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8844ac86-c328-4551-bfc2-249b4c330884 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:01.279329 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8844ac86-c328-4551-bfc2-249b4c330884 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:01.280495 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8844ac86-c328-4551-bfc2-249b4c330884 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:01.331626 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-91fc861a-9d4d-487e-88d9-2c94909cf99d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:01.347162 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-91fc861a-9d4d-487e-88d9-2c94909cf99d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e" status: 200 len: 1260 microversion: 2.1 time: 0.172336 Sep 16 12:51:01.367241 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 723/1420] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:01 2022] GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e => generated 1260 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:01.435899 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2b9e0481-3b12-4070-b261-f1aa6e109333 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:01.438417 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2b9e0481-3b12-4070-b261-f1aa6e109333 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 8c7aea62-7b4d-400d-89fa-5411deefe490] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:01.441755 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=3,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:51:01.457939 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b9e0481-3b12-4070-b261-f1aa6e109333 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:01.458447 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b9e0481-3b12-4070-b261-f1aa6e109333 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:01.458903 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b9e0481-3b12-4070-b261-f1aa6e109333 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:01.459817 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b9e0481-3b12-4070-b261-f1aa6e109333 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:01.460469 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b9e0481-3b12-4070-b261-f1aa6e109333 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:01.461030 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b9e0481-3b12-4070-b261-f1aa6e109333 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:01.523136 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b9e0481-3b12-4070-b261-f1aa6e109333 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:01.523627 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b9e0481-3b12-4070-b261-f1aa6e109333 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:01.524085 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b9e0481-3b12-4070-b261-f1aa6e109333 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:01.527952 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-2b9e0481-3b12-4070-b261-f1aa6e109333 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lazy-loading 'fault' on Instance uuid 8c7aea62-7b4d-400d-89fa-5411deefe490 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:51:01.762658 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2b9e0481-3b12-4070-b261-f1aa6e109333 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1928790cac542ec86add5794851f97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c037a6456444018a6ef54314419e2f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:01.775210 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2b9e0481-3b12-4070-b261-f1aa6e109333 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/8c7aea62-7b4d-400d-89fa-5411deefe490" status: 200 len: 1306 microversion: 2.1 time: 0.345947 Sep 16 12:51:01.779432 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 724/1421] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:01 2022] GET /compute/v2.1/servers/8c7aea62-7b4d-400d-89fa-5411deefe490 => generated 1306 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:51:02.204603 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a7047666-1d3f-4354-a918-c41a07e064b0 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:02.206091 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a7047666-1d3f-4354-a918-c41a07e064b0 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:02.223360 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7047666-1d3f-4354-a918-c41a07e064b0 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:02.224972 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7047666-1d3f-4354-a918-c41a07e064b0 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:02.225608 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7047666-1d3f-4354-a918-c41a07e064b0 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:02.226531 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7047666-1d3f-4354-a918-c41a07e064b0 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:02.227167 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7047666-1d3f-4354-a918-c41a07e064b0 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:02.227807 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7047666-1d3f-4354-a918-c41a07e064b0 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:02.490247 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8844ac86-c328-4551-bfc2-249b4c330884 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4242164d723c4db8a31efdda44f5207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665869d344cf42e38020c270515c5abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:02.492237 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a7047666-1d3f-4354-a918-c41a07e064b0 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:02.507227 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a7047666-1d3f-4354-a918-c41a07e064b0 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:02.509169 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a7047666-1d3f-4354-a918-c41a07e064b0 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:02.509629 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8844ac86-c328-4551-bfc2-249b4c330884 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "GET /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65" status: 200 len: 1313 microversion: 2.1 time: 1.243265 Sep 16 12:51:02.510371 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 698/1422] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:01 2022] GET /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65 => generated 1313 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:02.523074 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5d710618-06f2-41d2-ae0c-cdf8b343c906 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:02.523833 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5d710618-06f2-41d2-ae0c-cdf8b343c906 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:02.540260 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a7047666-1d3f-4354-a918-c41a07e064b0 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.340944 Sep 16 12:51:02.541349 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 725/1423] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:02 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:51:02.550284 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-343fca44-86ac-4570-8630-3c0c459d9fdb tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:02.551185 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-343fca44-86ac-4570-8630-3c0c459d9fdb tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: f9070e88-5408-48ab-9f4b-a74368e8f25e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:02.558161 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5d710618-06f2-41d2-ae0c-cdf8b343c906 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:02.559394 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5d710618-06f2-41d2-ae0c-cdf8b343c906 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:02.560215 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5d710618-06f2-41d2-ae0c-cdf8b343c906 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:02.561717 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5d710618-06f2-41d2-ae0c-cdf8b343c906 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:02.562397 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5d710618-06f2-41d2-ae0c-cdf8b343c906 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:02.563229 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5d710618-06f2-41d2-ae0c-cdf8b343c906 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:02.568694 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-343fca44-86ac-4570-8630-3c0c459d9fdb tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:02.569619 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-343fca44-86ac-4570-8630-3c0c459d9fdb tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:02.571487 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-343fca44-86ac-4570-8630-3c0c459d9fdb tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:02.572613 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-343fca44-86ac-4570-8630-3c0c459d9fdb tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:02.573225 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-343fca44-86ac-4570-8630-3c0c459d9fdb tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:02.573970 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-343fca44-86ac-4570-8630-3c0c459d9fdb tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:02.851555 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-343fca44-86ac-4570-8630-3c0c459d9fdb tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:02.871540 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-343fca44-86ac-4570-8630-3c0c459d9fdb tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e" status: 200 len: 1266 microversion: 2.1 time: 0.328865 Sep 16 12:51:02.872879 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 726/1424] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:02 2022] GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e => generated 1266 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:02.879037 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1d416012-58eb-43e4-b86a-d7ab610ccb7d tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b86207a8-8431-4f52-b974-002c93dc6c21"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:51:02.881601 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1d416012-58eb-43e4-b86a-d7ab610ccb7d tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:02.896774 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d416012-58eb-43e4-b86a-d7ab610ccb7d tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:02.898495 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d416012-58eb-43e4-b86a-d7ab610ccb7d tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:02.899205 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d416012-58eb-43e4-b86a-d7ab610ccb7d tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:02.905657 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d416012-58eb-43e4-b86a-d7ab610ccb7d tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:02.906803 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d416012-58eb-43e4-b86a-d7ab610ccb7d tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:02.907716 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d416012-58eb-43e4-b86a-d7ab610ccb7d tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:03.183311 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5d710618-06f2-41d2-ae0c-cdf8b343c906 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:03.201101 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5d710618-06f2-41d2-ae0c-cdf8b343c906 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1541 microversion: 2.1 time: 0.688596 Sep 16 12:51:03.203966 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 699/1425] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:02 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1541 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:03.215383 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4dc8d58e-0fb3-41df-9e2d-bbe550630a12 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:03.216009 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-4dc8d58e-0fb3-41df-9e2d-bbe550630a12 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] [instance: 8c7aea62-7b4d-400d-89fa-5411deefe490] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:03.225605 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4dc8d58e-0fb3-41df-9e2d-bbe550630a12 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:03.226103 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4dc8d58e-0fb3-41df-9e2d-bbe550630a12 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:03.226689 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4dc8d58e-0fb3-41df-9e2d-bbe550630a12 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:03.227778 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4dc8d58e-0fb3-41df-9e2d-bbe550630a12 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:03.228276 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4dc8d58e-0fb3-41df-9e2d-bbe550630a12 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:03.228704 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4dc8d58e-0fb3-41df-9e2d-bbe550630a12 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:03.262771 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-4dc8d58e-0fb3-41df-9e2d-bbe550630a12 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] HTTP exception thrown: Instance 8c7aea62-7b4d-400d-89fa-5411deefe490 could not be found. Sep 16 12:51:03.265458 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4dc8d58e-0fb3-41df-9e2d-bbe550630a12 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Request method failure captured: Sep 16 12:51:03.265458 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/8c7aea62-7b4d-400d-89fa-5411deefe490 HTTP/1.1 Sep 16 12:51:03.265458 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:51:03.265458 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:51:03.265458 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:51:03.265458 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:51:03.265458 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:51:03.265458 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:51:03.265458 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:51:03.265458 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:51:03.265458 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHBjUf33JuiB067clS1pRc16KayMcfeeik_2N8qe1xVSws5r9dYJMo_cNLvp1lekO_QhmumFAa7ZdFpMFE4TUtIimhBv92jzTfY_v-8Zx2FEsNx-tLPQhXJ5HSs2Mpeu7Bs3Mkhe9HBesD1Uxdgz5IaUm8Ssa3r2ZDecZ2Zv1_45ono Sep 16 12:51:03.265458 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:51:03.265458 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:51:03.265458 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:51:03.265458 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:51:03.265458 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:51:03.265458 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:51:03.265458 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 8c037a6456444018a6ef54314419e2f2 Sep 16 12:51:03.265458 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ServersOnMultiNodesTest-1155904382 Sep 16 12:51:03.265458 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:51:03.265458 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:51:03.267125 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c037a6456444018a6ef54314419e2f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8c037a6456444018a6ef54314419e2f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8c037a6456444018a6ef54314419e2f2", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c037a6456444018a6ef54314419e2f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:51:03.267125 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ServersOnMultiNodesTest-1155904382 Sep 16 12:51:03.267125 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 8c037a6456444018a6ef54314419e2f2 Sep 16 12:51:03.267125 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1155904382 Sep 16 12:51:03.267125 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ServersOnMultiNodesTest-1155904382-project Sep 16 12:51:03.267125 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:51:03.267125 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:51:03.267125 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: c1928790cac542ec86add5794851f97a Sep 16 12:51:03.267125 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ServersOnMultiNodesTest-1155904382-project Sep 16 12:51:03.267125 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:51:03.267125 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance 8c7aea62-7b4d-400d-89fa-5411deefe490 could not be found. Sep 16 12:51:03.267125 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '8c7aea62-7b4d-400d-89fa-5411deefe490'} Sep 16 12:51:03.268055 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:51:03.268055 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:03.268055 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:51:03.268055 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:51:03.268055 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:51:03.268055 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:51:03.268055 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:51:03.268055 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:51:03.268055 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:51:03.268055 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:51:03.268055 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c7aea62-7b4d-400d-89fa-5411deefe490 could not be found. Sep 16 12:51:03.268055 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:03.268055 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:03.268055 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:03.268055 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:03.268055 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:51:03.268055 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:51:03.268055 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:51:03.268055 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:51:03.268055 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:51:03.269383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:51:03.269383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:51:03.269383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:51:03.269383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:51:03.269383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:51:03.269383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:51:03.269383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:51:03.269383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c7aea62-7b4d-400d-89fa-5411deefe490 could not be found. Sep 16 12:51:03.269383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:03.269383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:03.269383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:03.269383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:03.269383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:51:03.269383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:51:03.269383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:51:03.269383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:51:03.269383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c7aea62-7b4d-400d-89fa-5411deefe490 could not be found. Sep 16 12:51:03.269383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:03.277050 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4dc8d58e-0fb3-41df-9e2d-bbe550630a12 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] Returning 404 to user: Instance 8c7aea62-7b4d-400d-89fa-5411deefe490 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:51:03.278222 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4dc8d58e-0fb3-41df-9e2d-bbe550630a12 tempest-ServersOnMultiNodesTest-1155904382 tempest-ServersOnMultiNodesTest-1155904382-project] 10.222.0.67 "GET /compute/v2.1/servers/8c7aea62-7b4d-400d-89fa-5411deefe490" status: 404 len: 111 microversion: 2.1 time: 0.072908 Sep 16 12:51:03.278974 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 700/1426] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:03 2022] GET /compute/v2.1/servers/8c7aea62-7b4d-400d-89fa-5411deefe490 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:51:03.460013 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1d416012-58eb-43e4-b86a-d7ab610ccb7d tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "POST /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.581103 Sep 16 12:51:03.469794 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 727/1427] 10.222.0.67 () {60 vars in 1323 bytes} [Fri Sep 16 12:51:02 2022] POST /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0/os-volume_attachments => generated 194 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:51:03.535260 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-42fe06e7-b516-4b47-86d2-9b4c2a8c0d82 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:03.535874 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-42fe06e7-b516-4b47-86d2-9b4c2a8c0d82 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] [instance: 80dccb7b-ee21-422f-8ec5-f31feeab1f65] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:03.550459 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-42fe06e7-b516-4b47-86d2-9b4c2a8c0d82 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:03.550965 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-42fe06e7-b516-4b47-86d2-9b4c2a8c0d82 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:03.554233 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-42fe06e7-b516-4b47-86d2-9b4c2a8c0d82 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:03.555067 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-42fe06e7-b516-4b47-86d2-9b4c2a8c0d82 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:03.557784 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-42fe06e7-b516-4b47-86d2-9b4c2a8c0d82 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:03.558289 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-42fe06e7-b516-4b47-86d2-9b4c2a8c0d82 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:03.584271 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2f0188f3-13a0-45fe-9c0a-38a059940896 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:03.585046 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2f0188f3-13a0-45fe-9c0a-38a059940896 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:03.618513 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f0188f3-13a0-45fe-9c0a-38a059940896 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:03.619034 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f0188f3-13a0-45fe-9c0a-38a059940896 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:03.626103 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f0188f3-13a0-45fe-9c0a-38a059940896 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:03.626942 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f0188f3-13a0-45fe-9c0a-38a059940896 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:03.628521 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f0188f3-13a0-45fe-9c0a-38a059940896 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:03.628979 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f0188f3-13a0-45fe-9c0a-38a059940896 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:04.059858 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2f0188f3-13a0-45fe-9c0a-38a059940896 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:04.072938 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2f0188f3-13a0-45fe-9c0a-38a059940896 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:04.075861 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2f0188f3-13a0-45fe-9c0a-38a059940896 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:04.084302 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2f0188f3-13a0-45fe-9c0a-38a059940896 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.511382 Sep 16 12:51:04.085920 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 728/1428] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:03 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:04.124587 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-34dd2f94-0ffb-4d7c-a1cd-12c25adc32c1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:04.126457 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-34dd2f94-0ffb-4d7c-a1cd-12c25adc32c1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: f9070e88-5408-48ab-9f4b-a74368e8f25e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:04.162910 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34dd2f94-0ffb-4d7c-a1cd-12c25adc32c1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:04.164554 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34dd2f94-0ffb-4d7c-a1cd-12c25adc32c1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:04.166535 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34dd2f94-0ffb-4d7c-a1cd-12c25adc32c1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:04.168649 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34dd2f94-0ffb-4d7c-a1cd-12c25adc32c1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:04.169335 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34dd2f94-0ffb-4d7c-a1cd-12c25adc32c1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:04.171547 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34dd2f94-0ffb-4d7c-a1cd-12c25adc32c1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:04.391309 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-34dd2f94-0ffb-4d7c-a1cd-12c25adc32c1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:04.408437 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-34dd2f94-0ffb-4d7c-a1cd-12c25adc32c1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e" status: 200 len: 1266 microversion: 2.1 time: 0.321083 Sep 16 12:51:04.409301 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 729/1429] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:04 2022] GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e => generated 1266 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:04.415785 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-7dd037a4-8bc0-4891-a141-0487dc05798c req-0f5baf89-ad38-4545-ba08-0ddd0a09fe42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a439c4ea-46f5-4571-9d87-96a91a6359f7", "name": "network-vif-unplugged", "status": "completed", "tag": "76e2deeb-80ac-4c0d-98b8-96091a5ab0d2"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:51:04.438238 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7dd037a4-8bc0-4891-a141-0487dc05798c req-0f5baf89-ad38-4545-ba08-0ddd0a09fe42 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:04.438924 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7dd037a4-8bc0-4891-a141-0487dc05798c req-0f5baf89-ad38-4545-ba08-0ddd0a09fe42 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:04.439367 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7dd037a4-8bc0-4891-a141-0487dc05798c req-0f5baf89-ad38-4545-ba08-0ddd0a09fe42 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:04.447015 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:51:04.469887 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-7dd037a4-8bc0-4891-a141-0487dc05798c req-0f5baf89-ad38-4545-ba08-0ddd0a09fe42 service nova] Creating event network-vif-unplugged:76e2deeb-80ac-4c0d-98b8-96091a5ab0d2 for instance a439c4ea-46f5-4571-9d87-96a91a6359f7 on n-h1-858094-4 Sep 16 12:51:04.474620 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-42fe06e7-b516-4b47-86d2-9b4c2a8c0d82 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4242164d723c4db8a31efdda44f5207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665869d344cf42e38020c270515c5abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:04.487871 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-42fe06e7-b516-4b47-86d2-9b4c2a8c0d82 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "GET /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65" status: 200 len: 1313 microversion: 2.1 time: 0.956524 Sep 16 12:51:04.491840 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 701/1430] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:03 2022] GET /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65 => generated 1313 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:04.498244 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c3091b18-7c51-45fc-9e05-36e8241f23a1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:04.499140 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c3091b18-7c51-45fc-9e05-36e8241f23a1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:04.507392 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [req-7dd037a4-8bc0-4891-a141-0487dc05798c req-0f5baf89-ad38-4545-ba08-0ddd0a09fe42 service nova] Instance a439c4ea-46f5-4571-9d87-96a91a6359f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858094-4', 'n-h2-858094-4'} {{(pid=128779) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 12:51:04.527974 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c3091b18-7c51-45fc-9e05-36e8241f23a1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:04.532899 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c3091b18-7c51-45fc-9e05-36e8241f23a1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:04.533625 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c3091b18-7c51-45fc-9e05-36e8241f23a1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:04.534849 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c3091b18-7c51-45fc-9e05-36e8241f23a1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:04.538055 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c3091b18-7c51-45fc-9e05-36e8241f23a1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:04.540526 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-7dd037a4-8bc0-4891-a141-0487dc05798c req-0f5baf89-ad38-4545-ba08-0ddd0a09fe42 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128876 Sep 16 12:51:04.547220 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c3091b18-7c51-45fc-9e05-36e8241f23a1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:04.555681 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 730/1431] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:51:04.588335 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f5a316c5-1eec-400b-920c-9650f1f1459f tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:04.589568 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f5a316c5-1eec-400b-920c-9650f1f1459f tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:04.603153 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5a316c5-1eec-400b-920c-9650f1f1459f tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:04.603667 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5a316c5-1eec-400b-920c-9650f1f1459f tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:04.604136 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5a316c5-1eec-400b-920c-9650f1f1459f tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:04.606576 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5a316c5-1eec-400b-920c-9650f1f1459f tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:04.609534 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5a316c5-1eec-400b-920c-9650f1f1459f tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:04.612015 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5a316c5-1eec-400b-920c-9650f1f1459f tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:05.154413 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f5a316c5-1eec-400b-920c-9650f1f1459f tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1811 microversion: 2.1 time: 0.588366 Sep 16 12:51:05.155826 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 731/1432] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:04 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1811 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:05.167939 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-38acbdea-c841-4eb8-9045-df39f30fff33 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:05.168909 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-38acbdea-c841-4eb8-9045-df39f30fff33 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:05.183002 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38acbdea-c841-4eb8-9045-df39f30fff33 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:05.188286 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38acbdea-c841-4eb8-9045-df39f30fff33 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:05.189229 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38acbdea-c841-4eb8-9045-df39f30fff33 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:05.190625 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38acbdea-c841-4eb8-9045-df39f30fff33 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:05.191341 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38acbdea-c841-4eb8-9045-df39f30fff33 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:05.191993 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38acbdea-c841-4eb8-9045-df39f30fff33 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:05.240431 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c3091b18-7c51-45fc-9e05-36e8241f23a1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:05.257908 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c3091b18-7c51-45fc-9e05-36e8241f23a1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1541 microversion: 2.1 time: 0.760309 Sep 16 12:51:05.260450 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 702/1433] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:04 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1541 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:05.273232 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-402e13c9-fac8-4148-828a-317ebcd38361 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:05.295350 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-402e13c9-fac8-4148-828a-317ebcd38361 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:05.296295 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-402e13c9-fac8-4148-828a-317ebcd38361 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:05.296754 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-402e13c9-fac8-4148-828a-317ebcd38361 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:05.297566 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-402e13c9-fac8-4148-828a-317ebcd38361 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:05.304818 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-402e13c9-fac8-4148-828a-317ebcd38361 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:05.305684 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-402e13c9-fac8-4148-828a-317ebcd38361 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:05.375736 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-38acbdea-c841-4eb8-9045-df39f30fff33 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:05.379993 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-402e13c9-fac8-4148-828a-317ebcd38361 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.117541 Sep 16 12:51:05.382674 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 703/1434] 10.222.0.67 () {58 vars in 1176 bytes} [Fri Sep 16 12:51:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:51:05.388270 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-defbc028-a406-49f4-b03a-e6f99f51d53d req-8e556f90-c672-4ccd-9417-d3cdb4271438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80dccb7b-ee21-422f-8ec5-f31feeab1f65", "name": "network-vif-plugged", "status": "completed", "tag": "b830d871-a472-440e-a2b5-2d8208f11f14"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:51:05.400421 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-38acbdea-c841-4eb8-9045-df39f30fff33 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:05.402831 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-38acbdea-c841-4eb8-9045-df39f30fff33 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:05.414191 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-38acbdea-c841-4eb8-9045-df39f30fff33 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.257056 Sep 16 12:51:05.419074 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 732/1435] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:05 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:05.426412 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-defbc028-a406-49f4-b03a-e6f99f51d53d req-8e556f90-c672-4ccd-9417-d3cdb4271438 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:05.427510 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-defbc028-a406-49f4-b03a-e6f99f51d53d req-8e556f90-c672-4ccd-9417-d3cdb4271438 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:05.430584 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-defbc028-a406-49f4-b03a-e6f99f51d53d req-8e556f90-c672-4ccd-9417-d3cdb4271438 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:05.435986 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d85a49c3-f57a-4632-8320-502281e0c4cd tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:05.436961 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d85a49c3-f57a-4632-8320-502281e0c4cd tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: f9070e88-5408-48ab-9f4b-a74368e8f25e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:05.464280 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d85a49c3-f57a-4632-8320-502281e0c4cd tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:05.466760 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d85a49c3-f57a-4632-8320-502281e0c4cd tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:05.467432 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-defbc028-a406-49f4-b03a-e6f99f51d53d req-8e556f90-c672-4ccd-9417-d3cdb4271438 service nova] Creating event network-vif-plugged:b830d871-a472-440e-a2b5-2d8208f11f14 for instance 80dccb7b-ee21-422f-8ec5-f31feeab1f65 on n-h1-858094-4 Sep 16 12:51:05.469272 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d85a49c3-f57a-4632-8320-502281e0c4cd tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:05.471200 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d85a49c3-f57a-4632-8320-502281e0c4cd tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:05.474657 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d85a49c3-f57a-4632-8320-502281e0c4cd tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:05.475402 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d85a49c3-f57a-4632-8320-502281e0c4cd tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:05.490810 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-defbc028-a406-49f4-b03a-e6f99f51d53d req-8e556f90-c672-4ccd-9417-d3cdb4271438 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103786 Sep 16 12:51:05.492645 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 704/1436] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:51:05.519539 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-38f3914a-3798-443c-ae93-6396a093296a tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:05.520637 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-38f3914a-3798-443c-ae93-6396a093296a tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] [instance: 80dccb7b-ee21-422f-8ec5-f31feeab1f65] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:05.549484 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-38f3914a-3798-443c-ae93-6396a093296a tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:05.550151 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-38f3914a-3798-443c-ae93-6396a093296a tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:05.550475 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-38f3914a-3798-443c-ae93-6396a093296a tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:05.551180 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-38f3914a-3798-443c-ae93-6396a093296a tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:05.551600 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-38f3914a-3798-443c-ae93-6396a093296a tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:05.551995 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-38f3914a-3798-443c-ae93-6396a093296a tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:06.684257 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:51:06.812288 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d85a49c3-f57a-4632-8320-502281e0c4cd tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:06.841810 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d85a49c3-f57a-4632-8320-502281e0c4cd tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e" status: 200 len: 1308 microversion: 2.1 time: 1.410440 Sep 16 12:51:06.843091 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 733/1437] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:05 2022] GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e => generated 1308 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:06.868839 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6dd2b90c-96b2-4722-8b63-c6884c4287a1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:06.869461 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6dd2b90c-96b2-4722-8b63-c6884c4287a1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:06.913335 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6dd2b90c-96b2-4722-8b63-c6884c4287a1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:06.915328 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6dd2b90c-96b2-4722-8b63-c6884c4287a1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:06.925160 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6dd2b90c-96b2-4722-8b63-c6884c4287a1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:06.926696 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6dd2b90c-96b2-4722-8b63-c6884c4287a1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:06.927417 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6dd2b90c-96b2-4722-8b63-c6884c4287a1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:06.928102 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6dd2b90c-96b2-4722-8b63-c6884c4287a1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:07.569824 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=8 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:51:07.631490 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-38f3914a-3798-443c-ae93-6396a093296a tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4242164d723c4db8a31efdda44f5207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665869d344cf42e38020c270515c5abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:07.644481 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-38f3914a-3798-443c-ae93-6396a093296a tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "GET /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65" status: 200 len: 1313 microversion: 2.1 time: 2.133214 Sep 16 12:51:07.646327 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 705/1438] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:05 2022] GET /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65 => generated 1313 bytes in 2136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:07.653108 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-041935aa-4273-4107-9268-616a5aecd157 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:07.654064 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-041935aa-4273-4107-9268-616a5aecd157 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:07.702984 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-041935aa-4273-4107-9268-616a5aecd157 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:07.704052 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-041935aa-4273-4107-9268-616a5aecd157 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:07.704790 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-041935aa-4273-4107-9268-616a5aecd157 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:07.706629 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-041935aa-4273-4107-9268-616a5aecd157 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:07.709246 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-041935aa-4273-4107-9268-616a5aecd157 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:07.709986 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-041935aa-4273-4107-9268-616a5aecd157 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:08.415226 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-041935aa-4273-4107-9268-616a5aecd157 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:08.431196 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-041935aa-4273-4107-9268-616a5aecd157 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:08.433803 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-041935aa-4273-4107-9268-616a5aecd157 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:08.452233 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-041935aa-4273-4107-9268-616a5aecd157 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.800381 Sep 16 12:51:08.453655 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 706/1439] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:07 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:08.472403 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-18e39e16-f52e-4279-ac3f-fc4370ee2606 req-023ffc1d-9288-41ae-b2e7-a74743dac95e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a439c4ea-46f5-4571-9d87-96a91a6359f7", "tag": "76e2deeb-80ac-4c0d-98b8-96091a5ab0d2"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:51:08.492781 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-18e39e16-f52e-4279-ac3f-fc4370ee2606 req-023ffc1d-9288-41ae-b2e7-a74743dac95e service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:08.494697 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-18e39e16-f52e-4279-ac3f-fc4370ee2606 req-023ffc1d-9288-41ae-b2e7-a74743dac95e service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:08.498152 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-18e39e16-f52e-4279-ac3f-fc4370ee2606 req-023ffc1d-9288-41ae-b2e7-a74743dac95e service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:08.541005 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-18e39e16-f52e-4279-ac3f-fc4370ee2606 req-023ffc1d-9288-41ae-b2e7-a74743dac95e service nova] Creating event network-changed:76e2deeb-80ac-4c0d-98b8-96091a5ab0d2 for instance a439c4ea-46f5-4571-9d87-96a91a6359f7 on n-h1-858094-4 Sep 16 12:51:08.550190 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [req-18e39e16-f52e-4279-ac3f-fc4370ee2606 req-023ffc1d-9288-41ae-b2e7-a74743dac95e service nova] Instance a439c4ea-46f5-4571-9d87-96a91a6359f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858094-4', 'n-h2-858094-4'} {{(pid=128780) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 12:51:08.568220 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-18e39e16-f52e-4279-ac3f-fc4370ee2606 req-023ffc1d-9288-41ae-b2e7-a74743dac95e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109651 Sep 16 12:51:08.569800 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 707/1440] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:51:08.580264 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f9732a43-0dc6-439b-8898-46d977e22c13 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:08.581445 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f9732a43-0dc6-439b-8898-46d977e22c13 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: f9070e88-5408-48ab-9f4b-a74368e8f25e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:08.588730 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f9732a43-0dc6-439b-8898-46d977e22c13 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:08.590138 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f9732a43-0dc6-439b-8898-46d977e22c13 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:08.590821 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f9732a43-0dc6-439b-8898-46d977e22c13 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:08.592768 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f9732a43-0dc6-439b-8898-46d977e22c13 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:08.594471 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f9732a43-0dc6-439b-8898-46d977e22c13 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:08.595186 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f9732a43-0dc6-439b-8898-46d977e22c13 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:08.775344 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6dd2b90c-96b2-4722-8b63-c6884c4287a1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:08.790438 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6dd2b90c-96b2-4722-8b63-c6884c4287a1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1541 microversion: 2.1 time: 1.925354 Sep 16 12:51:08.796513 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 734/1441] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:06 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1541 bytes in 1953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:08.814289 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-31ded35e-e8f3-4f5e-a339-99e08b43d239 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:08.815216 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-31ded35e-e8f3-4f5e-a339-99e08b43d239 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] [instance: 80dccb7b-ee21-422f-8ec5-f31feeab1f65] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:08.829116 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31ded35e-e8f3-4f5e-a339-99e08b43d239 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:08.829616 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31ded35e-e8f3-4f5e-a339-99e08b43d239 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:08.831140 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31ded35e-e8f3-4f5e-a339-99e08b43d239 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:08.831890 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31ded35e-e8f3-4f5e-a339-99e08b43d239 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:08.834096 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31ded35e-e8f3-4f5e-a339-99e08b43d239 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:08.835872 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31ded35e-e8f3-4f5e-a339-99e08b43d239 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:09.403431 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f9732a43-0dc6-439b-8898-46d977e22c13 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:09.416499 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f9732a43-0dc6-439b-8898-46d977e22c13 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e" status: 200 len: 1308 microversion: 2.1 time: 0.844559 Sep 16 12:51:09.428408 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 708/1442] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:08 2022] GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e => generated 1308 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:09.444520 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6fe09694-8b86-4569-9900-66277fde6d5e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52e50fb6-96e5-47fd-b75b-4cea644cfa75", "device": "/dev/xvdb"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:51:09.455461 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6fe09694-8b86-4569-9900-66277fde6d5e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:09.476372 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6fe09694-8b86-4569-9900-66277fde6d5e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:09.476871 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6fe09694-8b86-4569-9900-66277fde6d5e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:09.477307 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6fe09694-8b86-4569-9900-66277fde6d5e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:09.482677 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6fe09694-8b86-4569-9900-66277fde6d5e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:09.483916 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6fe09694-8b86-4569-9900-66277fde6d5e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:09.487052 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6fe09694-8b86-4569-9900-66277fde6d5e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:09.868049 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-31ded35e-e8f3-4f5e-a339-99e08b43d239 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4242164d723c4db8a31efdda44f5207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665869d344cf42e38020c270515c5abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:09.879385 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-31ded35e-e8f3-4f5e-a339-99e08b43d239 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "GET /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65" status: 200 len: 1498 microversion: 2.1 time: 1.081263 Sep 16 12:51:09.897376 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 735/1443] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:08 2022] GET /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65 => generated 1498 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:09.912712 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-998c153f-dcb5-4cb8-8403-171f7217beae tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:09.916606 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-998c153f-dcb5-4cb8-8403-171f7217beae tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:09.953997 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-998c153f-dcb5-4cb8-8403-171f7217beae tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:09.959374 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-998c153f-dcb5-4cb8-8403-171f7217beae tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:09.960443 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-998c153f-dcb5-4cb8-8403-171f7217beae tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:09.961597 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-998c153f-dcb5-4cb8-8403-171f7217beae tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:09.962128 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-998c153f-dcb5-4cb8-8403-171f7217beae tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:09.965415 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-998c153f-dcb5-4cb8-8403-171f7217beae tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:10.148967 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6fe09694-8b86-4569-9900-66277fde6d5e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "POST /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.715997 Sep 16 12:51:10.157748 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 709/1444] 10.222.0.67 () {60 vars in 1323 bytes} [Fri Sep 16 12:51:09 2022] POST /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16/os-volume_attachments => generated 194 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:51:10.182515 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-743c95ac-3dce-4d6e-b029-93fe95ba864f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:10.183366 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-743c95ac-3dce-4d6e-b029-93fe95ba864f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:10.216248 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-743c95ac-3dce-4d6e-b029-93fe95ba864f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:10.217308 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-743c95ac-3dce-4d6e-b029-93fe95ba864f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:10.217755 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-743c95ac-3dce-4d6e-b029-93fe95ba864f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:10.218471 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-743c95ac-3dce-4d6e-b029-93fe95ba864f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:10.224426 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-743c95ac-3dce-4d6e-b029-93fe95ba864f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:10.225016 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-743c95ac-3dce-4d6e-b029-93fe95ba864f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:10.878812 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-998c153f-dcb5-4cb8-8403-171f7217beae tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:10.889304 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-998c153f-dcb5-4cb8-8403-171f7217beae tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:10.894885 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-998c153f-dcb5-4cb8-8403-171f7217beae tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:10.906013 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-998c153f-dcb5-4cb8-8403-171f7217beae tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 1.016969 Sep 16 12:51:10.906608 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 736/1445] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:09 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:10.926685 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a562fc83-1aed-47c0-97e8-2d3b65eb646b tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:10.956616 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.compute.server_groups [None req-a562fc83-1aed-47c0-97e8-2d3b65eb646b tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Querying cell 19bb4c25-c68f-412b-8c46-4f5dc22c63ee(cell1) for 1 instances {{(pid=128779) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 16 12:51:10.958302 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a562fc83-1aed-47c0-97e8-2d3b65eb646b tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:10.962827 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a562fc83-1aed-47c0-97e8-2d3b65eb646b tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:10.963549 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a562fc83-1aed-47c0-97e8-2d3b65eb646b tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:11.005219 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a562fc83-1aed-47c0-97e8-2d3b65eb646b tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "GET /compute/v2.1/os-server-groups/121fd690-9860-4950-a263-9bc4990668d3" status: 200 len: 221 microversion: 2.1 time: 0.092937 Sep 16 12:51:11.007238 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 737/1446] 10.222.0.67 () {58 vars in 1263 bytes} [Fri Sep 16 12:51:10 2022] GET /compute/v2.1/os-server-groups/121fd690-9860-4950-a263-9bc4990668d3 => generated 221 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:51:11.022090 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fdb8d9e8-d828-407d-8201-b560537c3908 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:11.024698 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fdb8d9e8-d828-407d-8201-b560537c3908 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: f9070e88-5408-48ab-9f4b-a74368e8f25e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:11.043617 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fdb8d9e8-d828-407d-8201-b560537c3908 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:11.044880 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fdb8d9e8-d828-407d-8201-b560537c3908 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:11.046084 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fdb8d9e8-d828-407d-8201-b560537c3908 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:11.047618 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fdb8d9e8-d828-407d-8201-b560537c3908 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:11.050836 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fdb8d9e8-d828-407d-8201-b560537c3908 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:11.051524 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fdb8d9e8-d828-407d-8201-b560537c3908 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:11.340022 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-743c95ac-3dce-4d6e-b029-93fe95ba864f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:11.356525 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-743c95ac-3dce-4d6e-b029-93fe95ba864f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1541 microversion: 2.1 time: 1.196008 Sep 16 12:51:11.360558 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 710/1447] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:10 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1541 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:11.697810 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-51486853-7c21-498a-9f5f-e79c6c7e06f8 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Action: 'update', calling method: .version_select at 0x7f1039b46790>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:51:11.702209 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-51486853-7c21-498a-9f5f-e79c6c7e06f8 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:11.702722 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-51486853-7c21-498a-9f5f-e79c6c7e06f8 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:11.703155 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-51486853-7c21-498a-9f5f-e79c6c7e06f8 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:11.750463 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-51486853-7c21-498a-9f5f-e79c6c7e06f8 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:11.751252 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-51486853-7c21-498a-9f5f-e79c6c7e06f8 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:11.751869 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-51486853-7c21-498a-9f5f-e79c6c7e06f8 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:11.771889 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-51486853-7c21-498a-9f5f-e79c6c7e06f8 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] HTTP exception thrown: Service 42945f9c-3325-4395-b59f-c5f8a5d43017 could not be found. Sep 16 12:51:11.780937 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-51486853-7c21-498a-9f5f-e79c6c7e06f8 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Request method failure captured: Sep 16 12:51:11.780937 n-d-858094-4 devstack@n-api.service[128780]: request: PUT /compute/v2.1/os-services/42945f9c-3325-4395-b59f-c5f8a5d43017 HTTP/1.1 Sep 16 12:51:11.780937 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:51:11.780937 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:51:11.780937 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:51:11.780937 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 56 Sep 16 12:51:11.780937 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:51:11.780937 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:51:11.780937 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:51:11.780937 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:51:11.780937 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHE-her_M-sTNQPIFNuEcebPyr3cvskOLdqhhU5vwwwp3XVveXOl8TnYVy4XPeQHHusFBCXNn_R_7zLL5u8lZ0o-T58Tr-4P6ExK6YKxC6C8uMgK-Hw_jvpg278Fr1vT719sK7hLaCIY4zkIf8H0EhnR0lgGjDjRRHT9EpukP_Yh_ZE Sep 16 12:51:11.780937 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:51:11.780937 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:51:11.780937 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:51:11.780937 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:51:11.780937 n-d-858094-4 devstack@n-api.service[128780]: X-Openstack-Nova-Api-Version: 2.53 Sep 16 12:51:11.780937 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:51:11.780937 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:51:11.780937 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 4d5eea2a259d481ba2f33be421dd4820 Sep 16 12:51:11.780937 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-169684356 Sep 16 12:51:11.780937 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,admin,reader Sep 16 12:51:11.780937 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,admin,reader Sep 16 12:51:11.782656 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4d5eea2a259d481ba2f33be421dd4820"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4d5eea2a259d481ba2f33be421dd4820"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4d5eea2a259d481ba2f33be421dd4820", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4d5eea2a259d481ba2f33be421dd4820"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:51:11.782656 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-169684356 Sep 16 12:51:11.782656 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 4d5eea2a259d481ba2f33be421dd4820 Sep 16 12:51:11.782656 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-169684356 Sep 16 12:51:11.782656 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin Sep 16 12:51:11.782656 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:51:11.782656 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:51:11.782656 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 2f04ceaf311546738ed55635a216197a Sep 16 12:51:11.782656 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin Sep 16 12:51:11.782656 n-d-858094-4 devstack@n-api.service[128780]: Sep 16 12:51:11.782656 n-d-858094-4 devstack@n-api.service[128780]: {"status": "disabled", "disabled_reason": "maintenance"} Sep 16 12:51:11.782656 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 12:51:11.782656 n-d-858094-4 devstack@n-api.service[128780]: exception: Service 42945f9c-3325-4395-b59f-c5f8a5d43017 could not be found. Sep 16 12:51:11.783522 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '42945f9c-3325-4395-b59f-c5f8a5d43017', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Sep 16 12:51:11.783522 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:51:11.783522 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:11.783522 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 16 12:51:11.783522 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 16 12:51:11.783522 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 16 12:51:11.783522 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 16 12:51:11.783522 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 16 12:51:11.783522 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:11.783522 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:11.783522 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:11.783522 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:11.783522 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 16 12:51:11.783522 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 16 12:51:11.783522 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 16 12:51:11.783522 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 16 12:51:11.783522 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 42945f9c-3325-4395-b59f-c5f8a5d43017 could not be found. Sep 16 12:51:11.783522 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:11.783522 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:11.783522 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:11.783522 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:11.784965 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:51:11.784965 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:51:11.784965 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:51:11.784965 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:51:11.784965 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:51:11.784965 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:51:11.784965 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:51:11.784965 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:51:11.784965 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:51:11.784965 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:51:11.784965 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 16 12:51:11.784965 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:51:11.784965 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 42945f9c-3325-4395-b59f-c5f8a5d43017 could not be found. Sep 16 12:51:11.784965 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:11.784965 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:11.784965 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:11.784965 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:11.784965 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:51:11.784965 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:51:11.784965 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:51:11.786450 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:51:11.786450 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 42945f9c-3325-4395-b59f-c5f8a5d43017 could not be found. Sep 16 12:51:11.786450 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:11.787572 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-51486853-7c21-498a-9f5f-e79c6c7e06f8 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Returning 404 to user: Service 42945f9c-3325-4395-b59f-c5f8a5d43017 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:51:11.788665 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-51486853-7c21-498a-9f5f-e79c6c7e06f8 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-services/42945f9c-3325-4395-b59f-c5f8a5d43017" status: 404 len: 110 microversion: 2.53 time: 0.423564 Sep 16 12:51:11.789425 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 711/1448] 10.222.0.67 () {62 vars in 1309 bytes} [Fri Sep 16 12:51:11 2022] PUT /compute/v2.1/os-services/42945f9c-3325-4395-b59f-c5f8a5d43017 => generated 110 bytes in 428 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 12:51:11.796848 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e4b2ead6-0d3f-4565-8275-69eec1f5982f tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:11.797547 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e4b2ead6-0d3f-4565-8275-69eec1f5982f tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] [instance: 80dccb7b-ee21-422f-8ec5-f31feeab1f65] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:11.817076 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fdb8d9e8-d828-407d-8201-b560537c3908 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:11.818381 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e4b2ead6-0d3f-4565-8275-69eec1f5982f tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:11.818932 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e4b2ead6-0d3f-4565-8275-69eec1f5982f tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:11.826832 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e4b2ead6-0d3f-4565-8275-69eec1f5982f tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:11.827471 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e4b2ead6-0d3f-4565-8275-69eec1f5982f tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:11.827639 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fdb8d9e8-d828-407d-8201-b560537c3908 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e" status: 200 len: 1308 microversion: 2.1 time: 0.817209 Sep 16 12:51:11.827957 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e4b2ead6-0d3f-4565-8275-69eec1f5982f tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:11.828421 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e4b2ead6-0d3f-4565-8275-69eec1f5982f tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:11.831169 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 738/1449] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:11 2022] GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e => generated 1308 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:11.838603 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-faac610f-9680-44ea-bcf1-5296b1b80bc8 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Action: 'update', calling method: .version_select at 0x7f10356cdaf0>, body: {"status": "disabled"} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:51:11.843557 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-faac610f-9680-44ea-bcf1-5296b1b80bc8 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:11.844400 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-faac610f-9680-44ea-bcf1-5296b1b80bc8 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:11.849175 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-faac610f-9680-44ea-bcf1-5296b1b80bc8 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:11.867673 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-faac610f-9680-44ea-bcf1-5296b1b80bc8 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:11.868371 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-faac610f-9680-44ea-bcf1-5296b1b80bc8 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:11.868706 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:51:11.869253 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-faac610f-9680-44ea-bcf1-5296b1b80bc8 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:11.890086 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-faac610f-9680-44ea-bcf1-5296b1b80bc8 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] HTTP exception thrown: Service 42945f9c-3325-4395-b59f-c5f8a5d43017 could not be found. Sep 16 12:51:11.890756 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e4b2ead6-0d3f-4565-8275-69eec1f5982f tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] [instance: 80dccb7b-ee21-422f-8ec5-f31feeab1f65] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:51:11.892449 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-faac610f-9680-44ea-bcf1-5296b1b80bc8 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Request method failure captured: Sep 16 12:51:11.892449 n-d-858094-4 devstack@n-api.service[128779]: request: PUT /compute/v2.1/os-services/42945f9c-3325-4395-b59f-c5f8a5d43017 HTTP/1.1 Sep 16 12:51:11.892449 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:51:11.892449 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:51:11.892449 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:51:11.892449 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 22 Sep 16 12:51:11.892449 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:51:11.892449 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:51:11.892449 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:51:11.892449 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:51:11.892449 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHE-her_M-sTNQPIFNuEcebPyr3cvskOLdqhhU5vwwwp3XVveXOl8TnYVy4XPeQHHusFBCXNn_R_7zLL5u8lZ0o-T58Tr-4P6ExK6YKxC6C8uMgK-Hw_jvpg278Fr1vT719sK7hLaCIY4zkIf8H0EhnR0lgGjDjRRHT9EpukP_Yh_ZE Sep 16 12:51:11.892449 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:51:11.892449 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:51:11.892449 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:51:11.892449 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:51:11.892449 n-d-858094-4 devstack@n-api.service[128779]: X-Openstack-Nova-Api-Version: 2.53 Sep 16 12:51:11.892449 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:51:11.892449 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:51:11.892449 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 4d5eea2a259d481ba2f33be421dd4820 Sep 16 12:51:11.892449 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-169684356 Sep 16 12:51:11.892449 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,admin,reader Sep 16 12:51:11.892449 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,admin,reader Sep 16 12:51:11.894286 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4d5eea2a259d481ba2f33be421dd4820"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4d5eea2a259d481ba2f33be421dd4820"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4d5eea2a259d481ba2f33be421dd4820", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4d5eea2a259d481ba2f33be421dd4820"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:51:11.894286 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-169684356 Sep 16 12:51:11.894286 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 4d5eea2a259d481ba2f33be421dd4820 Sep 16 12:51:11.894286 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-169684356 Sep 16 12:51:11.894286 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin Sep 16 12:51:11.894286 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:51:11.894286 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:51:11.894286 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 2f04ceaf311546738ed55635a216197a Sep 16 12:51:11.894286 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin Sep 16 12:51:11.894286 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 12:51:11.894286 n-d-858094-4 devstack@n-api.service[128779]: {"status": "disabled"} Sep 16 12:51:11.894286 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 12:51:11.894286 n-d-858094-4 devstack@n-api.service[128779]: exception: Service 42945f9c-3325-4395-b59f-c5f8a5d43017 could not be found. Sep 16 12:51:11.894286 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '42945f9c-3325-4395-b59f-c5f8a5d43017', 'body': {'status': 'disabled'}} Sep 16 12:51:11.895304 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:51:11.895304 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:11.895304 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 16 12:51:11.895304 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 16 12:51:11.895304 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 16 12:51:11.895304 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 16 12:51:11.895304 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 16 12:51:11.895304 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:11.895304 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:11.895304 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:11.895304 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:11.895304 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 16 12:51:11.895304 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 16 12:51:11.895304 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 16 12:51:11.895304 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 16 12:51:11.895304 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 42945f9c-3325-4395-b59f-c5f8a5d43017 could not be found. Sep 16 12:51:11.895304 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:11.895304 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:11.895304 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:11.895304 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:11.895304 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:51:11.897117 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:51:11.897117 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:51:11.897117 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:51:11.897117 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:51:11.897117 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:51:11.897117 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:51:11.897117 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:51:11.897117 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:51:11.897117 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:51:11.897117 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 16 12:51:11.897117 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:51:11.897117 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 42945f9c-3325-4395-b59f-c5f8a5d43017 could not be found. Sep 16 12:51:11.897117 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:11.897117 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:11.897117 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:11.897117 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:11.897117 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:51:11.897117 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:51:11.897117 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:51:11.897117 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:51:11.898559 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 42945f9c-3325-4395-b59f-c5f8a5d43017 could not be found. Sep 16 12:51:11.898559 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:11.899382 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-faac610f-9680-44ea-bcf1-5296b1b80bc8 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Returning 404 to user: Service 42945f9c-3325-4395-b59f-c5f8a5d43017 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:51:11.902431 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-faac610f-9680-44ea-bcf1-5296b1b80bc8 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-services/42945f9c-3325-4395-b59f-c5f8a5d43017" status: 404 len: 110 microversion: 2.53 time: 0.069639 Sep 16 12:51:11.906101 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 739/1450] 10.222.0.67 () {62 vars in 1309 bytes} [Fri Sep 16 12:51:11 2022] PUT /compute/v2.1/os-services/42945f9c-3325-4395-b59f-c5f8a5d43017 => generated 110 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 12:51:11.915564 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-de154bab-00af-4b0c-9e3b-93a9dbaa0cd3 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Action: 'update', calling method: .version_select at 0x7f103571eca0>, body: {"status": "enabled"} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:51:11.931223 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de154bab-00af-4b0c-9e3b-93a9dbaa0cd3 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:11.932160 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de154bab-00af-4b0c-9e3b-93a9dbaa0cd3 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:11.935637 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de154bab-00af-4b0c-9e3b-93a9dbaa0cd3 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:11.949491 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de154bab-00af-4b0c-9e3b-93a9dbaa0cd3 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:11.952163 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de154bab-00af-4b0c-9e3b-93a9dbaa0cd3 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:11.956941 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de154bab-00af-4b0c-9e3b-93a9dbaa0cd3 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:11.970569 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-de154bab-00af-4b0c-9e3b-93a9dbaa0cd3 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] HTTP exception thrown: Service 42945f9c-3325-4395-b59f-c5f8a5d43017 could not be found. Sep 16 12:51:11.972542 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-de154bab-00af-4b0c-9e3b-93a9dbaa0cd3 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Request method failure captured: Sep 16 12:51:11.972542 n-d-858094-4 devstack@n-api.service[128779]: request: PUT /compute/v2.1/os-services/42945f9c-3325-4395-b59f-c5f8a5d43017 HTTP/1.1 Sep 16 12:51:11.972542 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:51:11.972542 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:51:11.972542 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:51:11.972542 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 21 Sep 16 12:51:11.972542 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:51:11.972542 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:51:11.972542 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:51:11.972542 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:51:11.972542 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHE-her_M-sTNQPIFNuEcebPyr3cvskOLdqhhU5vwwwp3XVveXOl8TnYVy4XPeQHHusFBCXNn_R_7zLL5u8lZ0o-T58Tr-4P6ExK6YKxC6C8uMgK-Hw_jvpg278Fr1vT719sK7hLaCIY4zkIf8H0EhnR0lgGjDjRRHT9EpukP_Yh_ZE Sep 16 12:51:11.972542 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:51:11.972542 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:51:11.972542 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:51:11.972542 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:51:11.972542 n-d-858094-4 devstack@n-api.service[128779]: X-Openstack-Nova-Api-Version: 2.53 Sep 16 12:51:11.972542 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:51:11.972542 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:51:11.972542 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 4d5eea2a259d481ba2f33be421dd4820 Sep 16 12:51:11.972542 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-169684356 Sep 16 12:51:11.972542 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,admin,reader Sep 16 12:51:11.972542 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,admin,reader Sep 16 12:51:11.974310 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4d5eea2a259d481ba2f33be421dd4820"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4d5eea2a259d481ba2f33be421dd4820"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4d5eea2a259d481ba2f33be421dd4820", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4d5eea2a259d481ba2f33be421dd4820"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:51:11.974310 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-169684356 Sep 16 12:51:11.974310 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 4d5eea2a259d481ba2f33be421dd4820 Sep 16 12:51:11.974310 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-169684356 Sep 16 12:51:11.974310 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin Sep 16 12:51:11.974310 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:51:11.974310 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:51:11.974310 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 2f04ceaf311546738ed55635a216197a Sep 16 12:51:11.974310 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin Sep 16 12:51:11.974310 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 12:51:11.974310 n-d-858094-4 devstack@n-api.service[128779]: {"status": "enabled"} Sep 16 12:51:11.974310 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 12:51:11.974310 n-d-858094-4 devstack@n-api.service[128779]: exception: Service 42945f9c-3325-4395-b59f-c5f8a5d43017 could not be found. Sep 16 12:51:11.974310 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '42945f9c-3325-4395-b59f-c5f8a5d43017', 'body': {'status': 'enabled'}} Sep 16 12:51:11.975309 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:51:11.975309 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:11.975309 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 16 12:51:11.975309 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 16 12:51:11.975309 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 16 12:51:11.975309 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 16 12:51:11.975309 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 16 12:51:11.975309 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:11.975309 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:11.975309 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:11.975309 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:11.975309 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 16 12:51:11.975309 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 16 12:51:11.975309 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 16 12:51:11.975309 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 16 12:51:11.975309 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 42945f9c-3325-4395-b59f-c5f8a5d43017 could not be found. Sep 16 12:51:11.975309 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:11.975309 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:11.975309 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:11.975309 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:11.975309 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:51:11.976828 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:51:11.976828 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:51:11.976828 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:51:11.976828 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:51:11.976828 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:51:11.976828 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:51:11.976828 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:51:11.976828 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:51:11.976828 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:51:11.976828 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 16 12:51:11.976828 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:51:11.976828 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 42945f9c-3325-4395-b59f-c5f8a5d43017 could not be found. Sep 16 12:51:11.976828 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:11.976828 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:11.976828 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:11.976828 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:11.976828 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:51:11.976828 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:51:11.976828 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:51:11.976828 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:51:11.978250 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 42945f9c-3325-4395-b59f-c5f8a5d43017 could not be found. Sep 16 12:51:11.978250 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:11.978911 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-de154bab-00af-4b0c-9e3b-93a9dbaa0cd3 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Returning 404 to user: Service 42945f9c-3325-4395-b59f-c5f8a5d43017 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:51:11.985539 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-de154bab-00af-4b0c-9e3b-93a9dbaa0cd3 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-services/42945f9c-3325-4395-b59f-c5f8a5d43017" status: 404 len: 110 microversion: 2.53 time: 0.069638 Sep 16 12:51:11.986597 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 740/1451] 10.222.0.67 () {62 vars in 1309 bytes} [Fri Sep 16 12:51:11 2022] PUT /compute/v2.1/os-services/42945f9c-3325-4395-b59f-c5f8a5d43017 => generated 110 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 12:51:11.994593 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e4b2ead6-0d3f-4565-8275-69eec1f5982f tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "DELETE /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65" status: 204 len: 0 microversion: 2.1 time: 0.203729 Sep 16 12:51:11.995447 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 712/1452] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:51:11 2022] DELETE /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:51:12.002755 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6aaad2fa-aac5-4af6-a5cd-5d345864b03c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:12.004367 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6aaad2fa-aac5-4af6-a5cd-5d345864b03c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:12.011443 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c595c9d4-cffd-4839-8a40-cb2eed1fa3b4 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:12.027755 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c595c9d4-cffd-4839-8a40-cb2eed1fa3b4 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:12.028496 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c595c9d4-cffd-4839-8a40-cb2eed1fa3b4 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:12.028946 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c595c9d4-cffd-4839-8a40-cb2eed1fa3b4 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:12.030200 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c595c9d4-cffd-4839-8a40-cb2eed1fa3b4 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:12.030658 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c595c9d4-cffd-4839-8a40-cb2eed1fa3b4 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:12.031248 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c595c9d4-cffd-4839-8a40-cb2eed1fa3b4 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:12.039552 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6aaad2fa-aac5-4af6-a5cd-5d345864b03c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:12.040693 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6aaad2fa-aac5-4af6-a5cd-5d345864b03c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:12.041646 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6aaad2fa-aac5-4af6-a5cd-5d345864b03c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:12.043525 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6aaad2fa-aac5-4af6-a5cd-5d345864b03c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:12.046179 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6aaad2fa-aac5-4af6-a5cd-5d345864b03c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:12.048537 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6aaad2fa-aac5-4af6-a5cd-5d345864b03c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:12.094520 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c595c9d4-cffd-4839-8a40-cb2eed1fa3b4 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.095576 Sep 16 12:51:12.097686 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 713/1453] 10.222.0.67 () {60 vars in 1178 bytes} [Fri Sep 16 12:51:11 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:12.103053 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fd75a53a-7acc-4dd6-95d0-460fdb055e1a tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:12.103803 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-fd75a53a-7acc-4dd6-95d0-460fdb055e1a tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] [instance: 80dccb7b-ee21-422f-8ec5-f31feeab1f65] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:12.113551 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fd75a53a-7acc-4dd6-95d0-460fdb055e1a tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:12.114054 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fd75a53a-7acc-4dd6-95d0-460fdb055e1a tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:12.114493 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fd75a53a-7acc-4dd6-95d0-460fdb055e1a tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:12.115211 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fd75a53a-7acc-4dd6-95d0-460fdb055e1a tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:12.115665 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fd75a53a-7acc-4dd6-95d0-460fdb055e1a tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:12.116086 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fd75a53a-7acc-4dd6-95d0-460fdb055e1a tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:12.145907 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6aaad2fa-aac5-4af6-a5cd-5d345864b03c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:12.157795 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6aaad2fa-aac5-4af6-a5cd-5d345864b03c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:12.160487 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6aaad2fa-aac5-4af6-a5cd-5d345864b03c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:12.167538 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6aaad2fa-aac5-4af6-a5cd-5d345864b03c tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.179638 Sep 16 12:51:12.203437 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 741/1454] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:11 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:12.214840 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-ff8bf3d4-7b1b-46c6-a877-a3772cce7163 req-1d71d7b8-b304-4125-829b-e6915f28af5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9070e88-5408-48ab-9f4b-a74368e8f25e", "tag": "093f17ab-8dc0-46d4-846c-da7b4807bf31"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:51:12.238661 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ff8bf3d4-7b1b-46c6-a877-a3772cce7163 req-1d71d7b8-b304-4125-829b-e6915f28af5f service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:12.239146 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ff8bf3d4-7b1b-46c6-a877-a3772cce7163 req-1d71d7b8-b304-4125-829b-e6915f28af5f service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:12.240735 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ff8bf3d4-7b1b-46c6-a877-a3772cce7163 req-1d71d7b8-b304-4125-829b-e6915f28af5f service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:12.255851 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-ff8bf3d4-7b1b-46c6-a877-a3772cce7163 req-1d71d7b8-b304-4125-829b-e6915f28af5f service nova] Creating event network-changed:093f17ab-8dc0-46d4-846c-da7b4807bf31 for instance f9070e88-5408-48ab-9f4b-a74368e8f25e on n-h1-858094-4 Sep 16 12:51:12.271956 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-ff8bf3d4-7b1b-46c6-a877-a3772cce7163 req-1d71d7b8-b304-4125-829b-e6915f28af5f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066755 Sep 16 12:51:12.277302 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 742/1455] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:51:12.288217 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dfdc2922-9e5c-4f90-aa80-a4582290fa1c tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:12.296707 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfdc2922-9e5c-4f90-aa80-a4582290fa1c tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:12.302969 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfdc2922-9e5c-4f90-aa80-a4582290fa1c tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:12.307993 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfdc2922-9e5c-4f90-aa80-a4582290fa1c tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:12.309697 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfdc2922-9e5c-4f90-aa80-a4582290fa1c tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:12.311501 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfdc2922-9e5c-4f90-aa80-a4582290fa1c tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:12.315464 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfdc2922-9e5c-4f90-aa80-a4582290fa1c tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:12.369088 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dfdc2922-9e5c-4f90-aa80-a4582290fa1c tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.088596 Sep 16 12:51:12.370826 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 743/1456] 10.222.0.67 () {60 vars in 1211 bytes} [Fri Sep 16 12:51:12 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:12.389549 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-fd75a53a-7acc-4dd6-95d0-460fdb055e1a tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4242164d723c4db8a31efdda44f5207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665869d344cf42e38020c270515c5abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:12.390923 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1dab5a61-b3b7-4005-9add-46fd4de4e422 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:12.391752 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1dab5a61-b3b7-4005-9add-46fd4de4e422 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:12.398807 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dab5a61-b3b7-4005-9add-46fd4de4e422 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:12.399339 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dab5a61-b3b7-4005-9add-46fd4de4e422 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:12.399909 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dab5a61-b3b7-4005-9add-46fd4de4e422 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:12.400903 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dab5a61-b3b7-4005-9add-46fd4de4e422 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:12.401453 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dab5a61-b3b7-4005-9add-46fd4de4e422 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:12.401954 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dab5a61-b3b7-4005-9add-46fd4de4e422 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:12.402813 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-fd75a53a-7acc-4dd6-95d0-460fdb055e1a tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "GET /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65" status: 200 len: 1504 microversion: 2.1 time: 0.301553 Sep 16 12:51:12.403676 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 714/1457] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:12 2022] GET /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65 => generated 1504 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:12.410136 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b1afa64f-e492-4abf-b446-133a8b2ecf88 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:12.413768 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b1afa64f-e492-4abf-b446-133a8b2ecf88 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:12.414464 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b1afa64f-e492-4abf-b446-133a8b2ecf88 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:12.415059 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b1afa64f-e492-4abf-b446-133a8b2ecf88 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:12.415960 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b1afa64f-e492-4abf-b446-133a8b2ecf88 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:12.416645 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b1afa64f-e492-4abf-b446-133a8b2ecf88 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:12.417334 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b1afa64f-e492-4abf-b446-133a8b2ecf88 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:12.478834 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b1afa64f-e492-4abf-b446-133a8b2ecf88 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.065516 Sep 16 12:51:12.479944 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 715/1458] 10.222.0.67 () {60 vars in 1178 bytes} [Fri Sep 16 12:51:12 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:12.492668 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-243af3e5-a9cc-4f95-a1a3-03f11a281f0a tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:12.496576 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-243af3e5-a9cc-4f95-a1a3-03f11a281f0a tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:12.497063 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-243af3e5-a9cc-4f95-a1a3-03f11a281f0a tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:12.497498 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-243af3e5-a9cc-4f95-a1a3-03f11a281f0a tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:12.498790 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-243af3e5-a9cc-4f95-a1a3-03f11a281f0a tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:12.499420 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-243af3e5-a9cc-4f95-a1a3-03f11a281f0a tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:12.505847 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-243af3e5-a9cc-4f95-a1a3-03f11a281f0a tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:12.538763 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-243af3e5-a9cc-4f95-a1a3-03f11a281f0a tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?host=n-d-858094-4&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.049655 Sep 16 12:51:12.539908 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 716/1459] 10.222.0.67 () {60 vars in 1235 bytes} [Fri Sep 16 12:51:12 2022] GET /compute/v2.1/os-services?host=n-d-858094-4&binary=xxx => generated 16 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:51:12.555625 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-20d30512-65f5-47c2-b26e-e5194f0f0d2f tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:12.565394 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-20d30512-65f5-47c2-b26e-e5194f0f0d2f tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:12.566414 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-20d30512-65f5-47c2-b26e-e5194f0f0d2f tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:12.567059 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-20d30512-65f5-47c2-b26e-e5194f0f0d2f tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:12.568015 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-20d30512-65f5-47c2-b26e-e5194f0f0d2f tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:12.568900 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-20d30512-65f5-47c2-b26e-e5194f0f0d2f tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:12.569547 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-20d30512-65f5-47c2-b26e-e5194f0f0d2f tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:12.601911 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-20d30512-65f5-47c2-b26e-e5194f0f0d2f tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.052144 Sep 16 12:51:12.603054 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 717/1460] 10.222.0.67 () {60 vars in 1178 bytes} [Fri Sep 16 12:51:12 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:51:12.616195 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-dacb46af-a208-4000-a2d1-50e02111ec82 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:12.621162 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dacb46af-a208-4000-a2d1-50e02111ec82 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:12.621889 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dacb46af-a208-4000-a2d1-50e02111ec82 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:12.622503 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dacb46af-a208-4000-a2d1-50e02111ec82 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:12.624282 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dacb46af-a208-4000-a2d1-50e02111ec82 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:12.625019 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dacb46af-a208-4000-a2d1-50e02111ec82 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:12.625596 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dacb46af-a208-4000-a2d1-50e02111ec82 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:12.652160 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:51:12.660972 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-dacb46af-a208-4000-a2d1-50e02111ec82 tempest-ServicesAdminNegativeV253TestJSON-169684356 tempest-ServicesAdminNegativeV253TestJSON-169684356-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.049278 Sep 16 12:51:12.662269 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 718/1461] 10.222.0.67 () {60 vars in 1239 bytes} [Fri Sep 16 12:51:12 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:51:12.667637 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1dab5a61-b3b7-4005-9add-46fd4de4e422 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:12.677466 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1dab5a61-b3b7-4005-9add-46fd4de4e422 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1473 microversion: 2.1 time: 0.291406 Sep 16 12:51:12.680426 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 744/1462] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:12 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1473 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:51:12.860472 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-11ae4322-c7e8-4594-9828-ad089cbc5f7f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:12.861458 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-11ae4322-c7e8-4594-9828-ad089cbc5f7f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: f9070e88-5408-48ab-9f4b-a74368e8f25e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:12.878227 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11ae4322-c7e8-4594-9828-ad089cbc5f7f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:12.880583 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11ae4322-c7e8-4594-9828-ad089cbc5f7f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:12.884959 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11ae4322-c7e8-4594-9828-ad089cbc5f7f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:12.885727 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11ae4322-c7e8-4594-9828-ad089cbc5f7f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:12.886364 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11ae4322-c7e8-4594-9828-ad089cbc5f7f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:12.886808 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11ae4322-c7e8-4594-9828-ad089cbc5f7f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:12.905819 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6eb983a5-e433-47c2-b72d-36e04bac35f1 tempest-ServicesAdminNegativeV253TestJSON-1742212632 tempest-ServicesAdminNegativeV253TestJSON-1742212632-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:12.909742 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6eb983a5-e433-47c2-b72d-36e04bac35f1 tempest-ServicesAdminNegativeV253TestJSON-1742212632 tempest-ServicesAdminNegativeV253TestJSON-1742212632-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '44092b443a6842a2bcf1ed7c835e46e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16aa651baf50419b9b96f3f8a5691e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:12.911747 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6eb983a5-e433-47c2-b72d-36e04bac35f1 tempest-ServicesAdminNegativeV253TestJSON-1742212632 tempest-ServicesAdminNegativeV253TestJSON-1742212632-project] Request method failure captured: Sep 16 12:51:12.911747 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 16 12:51:12.911747 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:51:12.911747 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:51:12.911747 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:51:12.911747 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:51:12.911747 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:51:12.911747 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:51:12.911747 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:51:12.911747 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:51:12.911747 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHE8Ahlk3Fqj20Bbnj6h3laOXtRr1U4XYpLL8f-P6cNtEPetUCUvGZjGowZqS_rKlizEMpYz73rWn-zhYq-xj2Y9XNlnCiqlsbqRFhzLgnxqj8M198_aB6Q-K5nb2_cXzYftekB2A4RvWle4aetODMqG8XaSJc4jmJnZ65mnM8TugcI Sep 16 12:51:12.911747 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:51:12.911747 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:51:12.911747 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:51:12.911747 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:51:12.911747 n-d-858094-4 devstack@n-api.service[128780]: X-Openstack-Nova-Api-Version: 2.53 Sep 16 12:51:12.911747 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:51:12.911747 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:51:12.911747 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 16aa651baf50419b9b96f3f8a5691e5e Sep 16 12:51:12.911747 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1742212632 Sep 16 12:51:12.911747 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:51:12.911747 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:51:12.913288 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/16aa651baf50419b9b96f3f8a5691e5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/16aa651baf50419b9b96f3f8a5691e5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_16aa651baf50419b9b96f3f8a5691e5e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/16aa651baf50419b9b96f3f8a5691e5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:51:12.913288 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1742212632 Sep 16 12:51:12.913288 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 16aa651baf50419b9b96f3f8a5691e5e Sep 16 12:51:12.913288 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1742212632 Sep 16 12:51:12.913288 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1742212632-project Sep 16 12:51:12.913288 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:51:12.913288 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:51:12.913288 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 44092b443a6842a2bcf1ed7c835e46e3 Sep 16 12:51:12.913288 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1742212632-project Sep 16 12:51:12.913288 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:51:12.913288 n-d-858094-4 devstack@n-api.service[128780]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 16 12:51:12.913288 n-d-858094-4 devstack@n-api.service[128780]: action_args: {} Sep 16 12:51:12.914041 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:51:12.914041 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:12.914041 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:51:12.914041 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:51:12.914041 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:51:12.914041 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:51:12.914041 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 12:51:12.914041 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:51:12.914041 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 12:51:12.914041 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:51:12.914041 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:51:12.914041 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:51:12.914041 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 16 12:51:12.914041 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 16 12:51:12.914041 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 12:51:12.914041 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 12:51:12.914041 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 12:51:12.914041 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 12:51:12.914041 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:51:12.915326 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:51:12.915326 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:51:12.915326 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:51:12.915326 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 12:51:12.915326 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 12:51:12.915326 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 12:51:12.915326 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 12:51:12.915326 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 12:51:12.915326 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 12:51:12.915326 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 16 12:51:12.915326 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:12.915326 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:12.915326 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:12.915326 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:12.915326 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:51:12.915326 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:51:12.915326 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 12:51:12.915326 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 12:51:12.915326 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 16 12:51:12.915326 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:12.918816 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6eb983a5-e433-47c2-b72d-36e04bac35f1 tempest-ServicesAdminNegativeV253TestJSON-1742212632 tempest-ServicesAdminNegativeV253TestJSON-1742212632-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:51:12.920542 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6eb983a5-e433-47c2-b72d-36e04bac35f1 tempest-ServicesAdminNegativeV253TestJSON-1742212632 tempest-ServicesAdminNegativeV253TestJSON-1742212632-project] 10.222.0.67 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.248368 Sep 16 12:51:12.921402 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 719/1463] 10.222.0.67 () {60 vars in 1178 bytes} [Fri Sep 16 12:51:12 2022] GET /compute/v2.1/os-services => generated 112 bytes in 251 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Sep 16 12:51:13.193169 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-11ae4322-c7e8-4594-9828-ad089cbc5f7f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:13.205188 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-26598b18-0c62-4faa-b09c-3a46b5898309 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:13.206096 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-26598b18-0c62-4faa-b09c-3a46b5898309 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:13.207940 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-11ae4322-c7e8-4594-9828-ad089cbc5f7f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e" status: 200 len: 1308 microversion: 2.1 time: 0.353366 Sep 16 12:51:13.219036 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-26598b18-0c62-4faa-b09c-3a46b5898309 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:13.219511 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 745/1464] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:12 2022] GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e => generated 1308 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:13.220091 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-26598b18-0c62-4faa-b09c-3a46b5898309 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:13.220724 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-26598b18-0c62-4faa-b09c-3a46b5898309 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:13.222654 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-26598b18-0c62-4faa-b09c-3a46b5898309 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:13.224016 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-26598b18-0c62-4faa-b09c-3a46b5898309 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:13.224708 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-26598b18-0c62-4faa-b09c-3a46b5898309 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:13.368955 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-26598b18-0c62-4faa-b09c-3a46b5898309 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:13.382074 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-26598b18-0c62-4faa-b09c-3a46b5898309 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:13.393478 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-26598b18-0c62-4faa-b09c-3a46b5898309 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:13.403270 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-26598b18-0c62-4faa-b09c-3a46b5898309 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.202960 Sep 16 12:51:13.405515 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 720/1465] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:13 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:51:13.432794 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fbd97aaa-6f65-4e19-97be-2ae1f5d13b7f tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:13.433100 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fbd97aaa-6f65-4e19-97be-2ae1f5d13b7f tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] [instance: 80dccb7b-ee21-422f-8ec5-f31feeab1f65] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:13.443125 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fbd97aaa-6f65-4e19-97be-2ae1f5d13b7f tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:13.443920 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fbd97aaa-6f65-4e19-97be-2ae1f5d13b7f tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:13.444581 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fbd97aaa-6f65-4e19-97be-2ae1f5d13b7f tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:13.445456 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fbd97aaa-6f65-4e19-97be-2ae1f5d13b7f tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:13.446072 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fbd97aaa-6f65-4e19-97be-2ae1f5d13b7f tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:13.446671 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fbd97aaa-6f65-4e19-97be-2ae1f5d13b7f tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:13.652085 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fbd97aaa-6f65-4e19-97be-2ae1f5d13b7f tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4242164d723c4db8a31efdda44f5207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665869d344cf42e38020c270515c5abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:13.660771 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fbd97aaa-6f65-4e19-97be-2ae1f5d13b7f tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "GET /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65" status: 200 len: 1504 microversion: 2.1 time: 0.232198 Sep 16 12:51:13.676867 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 746/1466] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:13 2022] GET /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65 => generated 1504 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:13.707436 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ecfa0a7e-74d4-4cde-aa3a-fb135d482325 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:13.708492 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ecfa0a7e-74d4-4cde-aa3a-fb135d482325 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:13.715960 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecfa0a7e-74d4-4cde-aa3a-fb135d482325 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:13.717232 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecfa0a7e-74d4-4cde-aa3a-fb135d482325 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:13.718043 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecfa0a7e-74d4-4cde-aa3a-fb135d482325 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:13.718927 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecfa0a7e-74d4-4cde-aa3a-fb135d482325 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:13.719548 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecfa0a7e-74d4-4cde-aa3a-fb135d482325 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:13.719899 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5bb9c51f-37ae-4c57-8b57-00d1511c2d96 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-231855225", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": [{"uuid": "1e927054-126f-4e94-8719-fa14f3244a7f"}]}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:51:13.720360 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecfa0a7e-74d4-4cde-aa3a-fb135d482325 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:13.833454 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-5bb9c51f-37ae-4c57-8b57-00d1511c2d96 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] validate_networks() for [('1e927054-126f-4e94-8719-fa14f3244a7f', None, None, None, None, None)] {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:51:13.991788 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ecfa0a7e-74d4-4cde-aa3a-fb135d482325 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:14.006664 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ecfa0a7e-74d4-4cde-aa3a-fb135d482325 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1473 microversion: 2.1 time: 0.307279 Sep 16 12:51:14.007450 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 747/1467] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:13 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1473 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:14.243116 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c9596362-b597-4433-86ed-2181c01eae56 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:14.244442 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c9596362-b597-4433-86ed-2181c01eae56 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: f9070e88-5408-48ab-9f4b-a74368e8f25e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:14.251701 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9596362-b597-4433-86ed-2181c01eae56 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:14.252522 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9596362-b597-4433-86ed-2181c01eae56 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:14.253177 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9596362-b597-4433-86ed-2181c01eae56 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:14.254039 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9596362-b597-4433-86ed-2181c01eae56 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:14.254651 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9596362-b597-4433-86ed-2181c01eae56 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:14.255500 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9596362-b597-4433-86ed-2181c01eae56 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:14.593066 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c9596362-b597-4433-86ed-2181c01eae56 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:14.604818 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c9596362-b597-4433-86ed-2181c01eae56 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e" status: 200 len: 1308 microversion: 2.1 time: 0.374873 Sep 16 12:51:14.616626 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 748/1468] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:14 2022] GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e => generated 1308 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:51:14.629387 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-40290561-b960-498d-95a4-78dee5a1b9cf tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:14.631392 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-40290561-b960-498d-95a4-78dee5a1b9cf tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:14.641956 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40290561-b960-498d-95a4-78dee5a1b9cf tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:14.642570 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40290561-b960-498d-95a4-78dee5a1b9cf tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:14.645025 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40290561-b960-498d-95a4-78dee5a1b9cf tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:14.645834 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40290561-b960-498d-95a4-78dee5a1b9cf tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:14.646319 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40290561-b960-498d-95a4-78dee5a1b9cf tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:14.647932 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40290561-b960-498d-95a4-78dee5a1b9cf tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:14.775072 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-5bb9c51f-37ae-4c57-8b57-00d1511c2d96 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:51:14.775588 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-5bb9c51f-37ae-4c57-8b57-00d1511c2d96 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:51:14.775952 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-5bb9c51f-37ae-4c57-8b57-00d1511c2d96 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:51:14.776412 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-5bb9c51f-37ae-4c57-8b57-00d1511c2d96 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:51:14.776822 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-5bb9c51f-37ae-4c57-8b57-00d1511c2d96 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:51:14.801426 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5bb9c51f-37ae-4c57-8b57-00d1511c2d96 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:14.801915 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5bb9c51f-37ae-4c57-8b57-00d1511c2d96 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:14.802349 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5bb9c51f-37ae-4c57-8b57-00d1511c2d96 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:14.803084 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5bb9c51f-37ae-4c57-8b57-00d1511c2d96 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:14.806706 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-40290561-b960-498d-95a4-78dee5a1b9cf tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:14.808105 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5bb9c51f-37ae-4c57-8b57-00d1511c2d96 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:14.808589 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5bb9c51f-37ae-4c57-8b57-00d1511c2d96 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:14.820956 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-40290561-b960-498d-95a4-78dee5a1b9cf tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:14.822479 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-40290561-b960-498d-95a4-78dee5a1b9cf tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:14.829044 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-40290561-b960-498d-95a4-78dee5a1b9cf tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.210756 Sep 16 12:51:14.829888 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 749/1469] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:14 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:14.834687 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-df451882-ba3a-4b5e-a06f-9ffcc335382b tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:14.835310 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-df451882-ba3a-4b5e-a06f-9ffcc335382b tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] [instance: 80dccb7b-ee21-422f-8ec5-f31feeab1f65] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:14.841755 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df451882-ba3a-4b5e-a06f-9ffcc335382b tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:14.842656 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df451882-ba3a-4b5e-a06f-9ffcc335382b tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:14.843256 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df451882-ba3a-4b5e-a06f-9ffcc335382b tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:14.844306 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df451882-ba3a-4b5e-a06f-9ffcc335382b tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:14.845015 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df451882-ba3a-4b5e-a06f-9ffcc335382b tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:14.845628 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df451882-ba3a-4b5e-a06f-9ffcc335382b tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:14.854585 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:51:14.869066 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-5bb9c51f-37ae-4c57-8b57-00d1511c2d96 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Getting quotas for project da915844493a4928ac8830897afa126f. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:51:14.881714 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-5bb9c51f-37ae-4c57-8b57-00d1511c2d96 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Getting quotas for user ab6ca4cf98e14358bf8e0f625812fbb9 and project da915844493a4928ac8830897afa126f. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:51:14.903331 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5bb9c51f-37ae-4c57-8b57-00d1511c2d96 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:51:14.906749 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5bb9c51f-37ae-4c57-8b57-00d1511c2d96 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 041df092-33d4-4b71-84d8-7cd479d32b4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:51:14.969686 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5bb9c51f-37ae-4c57-8b57-00d1511c2d96 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.480596 Sep 16 12:51:14.971188 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 721/1470] 10.222.0.67 () {62 vars in 1188 bytes} [Fri Sep 16 12:51:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1483 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 16 12:51:14.985693 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a8dbf9cc-4a0b-4bba-a4d6-10d0ec0bd33d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:14.987089 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a8dbf9cc-4a0b-4bba-a4d6-10d0ec0bd33d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 041df092-33d4-4b71-84d8-7cd479d32b4f] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:15.050780 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-df451882-ba3a-4b5e-a06f-9ffcc335382b tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4242164d723c4db8a31efdda44f5207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665869d344cf42e38020c270515c5abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:15.063937 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-df451882-ba3a-4b5e-a06f-9ffcc335382b tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "GET /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65" status: 200 len: 1504 microversion: 2.1 time: 0.230673 Sep 16 12:51:15.066168 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 750/1471] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:14 2022] GET /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65 => generated 1504 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:15.080156 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4e023879-1694-4044-82b1-b97b74d48940 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:15.081162 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4e023879-1694-4044-82b1-b97b74d48940 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:15.095650 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e023879-1694-4044-82b1-b97b74d48940 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:15.096461 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e023879-1694-4044-82b1-b97b74d48940 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:15.097058 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e023879-1694-4044-82b1-b97b74d48940 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:15.097184 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a8dbf9cc-4a0b-4bba-a4d6-10d0ec0bd33d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:15.098054 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e023879-1694-4044-82b1-b97b74d48940 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:15.098669 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e023879-1694-4044-82b1-b97b74d48940 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:15.099394 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e023879-1694-4044-82b1-b97b74d48940 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:15.108180 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a8dbf9cc-4a0b-4bba-a4d6-10d0ec0bd33d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:15.110679 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a8dbf9cc-4a0b-4bba-a4d6-10d0ec0bd33d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:15.112160 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a8dbf9cc-4a0b-4bba-a4d6-10d0ec0bd33d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f" status: 200 len: 1261 microversion: 2.25 time: 0.133818 Sep 16 12:51:15.112831 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 722/1472] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:14 2022] GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f => generated 1261 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:15.409565 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4e023879-1694-4044-82b1-b97b74d48940 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:15.421348 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4e023879-1694-4044-82b1-b97b74d48940 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1473 microversion: 2.1 time: 0.353927 Sep 16 12:51:15.426113 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 751/1473] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:15 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1473 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:15.635076 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b6fa952e-0c87-4e89-9d0a-654ddc47bada tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:15.636317 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b6fa952e-0c87-4e89-9d0a-654ddc47bada tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: f9070e88-5408-48ab-9f4b-a74368e8f25e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:15.648099 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b6fa952e-0c87-4e89-9d0a-654ddc47bada tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:15.651221 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b6fa952e-0c87-4e89-9d0a-654ddc47bada tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:15.653178 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b6fa952e-0c87-4e89-9d0a-654ddc47bada tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:15.656217 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b6fa952e-0c87-4e89-9d0a-654ddc47bada tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:15.658387 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b6fa952e-0c87-4e89-9d0a-654ddc47bada tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:15.659715 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b6fa952e-0c87-4e89-9d0a-654ddc47bada tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:15.859767 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c203783c-d8bb-4336-b985-1c033dd63408 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:15.861071 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c203783c-d8bb-4336-b985-1c033dd63408 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:15.884700 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c203783c-d8bb-4336-b985-1c033dd63408 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:15.885331 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c203783c-d8bb-4336-b985-1c033dd63408 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:15.886251 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c203783c-d8bb-4336-b985-1c033dd63408 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:15.893541 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c203783c-d8bb-4336-b985-1c033dd63408 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:15.895586 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c203783c-d8bb-4336-b985-1c033dd63408 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:15.901673 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c203783c-d8bb-4336-b985-1c033dd63408 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:16.166698 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c203783c-d8bb-4336-b985-1c033dd63408 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:16.184345 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c203783c-d8bb-4336-b985-1c033dd63408 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:16.193495 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c203783c-d8bb-4336-b985-1c033dd63408 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:16.211184 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c203783c-d8bb-4336-b985-1c033dd63408 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.355990 Sep 16 12:51:16.215247 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 752/1474] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:15 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:51:16.231431 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2b6a098c-df05-4a32-8bb0-e156836d982c tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:16.235454 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2b6a098c-df05-4a32-8bb0-e156836d982c tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] [instance: 80dccb7b-ee21-422f-8ec5-f31feeab1f65] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:16.253332 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b6a098c-df05-4a32-8bb0-e156836d982c tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:16.254644 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b6a098c-df05-4a32-8bb0-e156836d982c tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:16.255813 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b6a098c-df05-4a32-8bb0-e156836d982c tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:16.257182 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b6a098c-df05-4a32-8bb0-e156836d982c tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:16.258957 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b6a098c-df05-4a32-8bb0-e156836d982c tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:16.259720 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b6a098c-df05-4a32-8bb0-e156836d982c tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:16.288624 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-b6fa952e-0c87-4e89-9d0a-654ddc47bada tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:16.318996 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b6fa952e-0c87-4e89-9d0a-654ddc47bada tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e" status: 200 len: 1308 microversion: 2.1 time: 0.685528 Sep 16 12:51:16.324545 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 723/1475] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:15 2022] GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e => generated 1308 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:16.329875 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e44577fc-1e29-4d1f-9efd-9ef845e29a12 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:16.340962 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e44577fc-1e29-4d1f-9efd-9ef845e29a12 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 041df092-33d4-4b71-84d8-7cd479d32b4f] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:16.361066 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e44577fc-1e29-4d1f-9efd-9ef845e29a12 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:16.361741 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e44577fc-1e29-4d1f-9efd-9ef845e29a12 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:16.362238 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e44577fc-1e29-4d1f-9efd-9ef845e29a12 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:16.362969 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e44577fc-1e29-4d1f-9efd-9ef845e29a12 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:16.363425 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e44577fc-1e29-4d1f-9efd-9ef845e29a12 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:16.363860 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e44577fc-1e29-4d1f-9efd-9ef845e29a12 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:16.662831 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2b6a098c-df05-4a32-8bb0-e156836d982c tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4242164d723c4db8a31efdda44f5207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665869d344cf42e38020c270515c5abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:16.672884 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2b6a098c-df05-4a32-8bb0-e156836d982c tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "GET /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65" status: 200 len: 1504 microversion: 2.1 time: 0.456481 Sep 16 12:51:16.692174 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 753/1476] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:16 2022] GET /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65 => generated 1504 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:16.692174 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-18af204b-6d3d-4b7d-905f-13c25b7733a9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:16.692174 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-18af204b-6d3d-4b7d-905f-13c25b7733a9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:16.703766 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18af204b-6d3d-4b7d-905f-13c25b7733a9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:16.706319 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18af204b-6d3d-4b7d-905f-13c25b7733a9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:16.706989 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18af204b-6d3d-4b7d-905f-13c25b7733a9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:16.708101 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18af204b-6d3d-4b7d-905f-13c25b7733a9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:16.720900 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18af204b-6d3d-4b7d-905f-13c25b7733a9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:16.721914 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18af204b-6d3d-4b7d-905f-13c25b7733a9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:16.748938 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e44577fc-1e29-4d1f-9efd-9ef845e29a12 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:16.766072 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e44577fc-1e29-4d1f-9efd-9ef845e29a12 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:16.769002 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e44577fc-1e29-4d1f-9efd-9ef845e29a12 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:16.773328 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e44577fc-1e29-4d1f-9efd-9ef845e29a12 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f" status: 200 len: 1257 microversion: 2.25 time: 0.447438 Sep 16 12:51:16.775106 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 724/1477] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:16 2022] GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f => generated 1257 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:17.249077 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-963039fb-83c5-49fa-82e5-d96086b3cd17 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:17.249687 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-963039fb-83c5-49fa-82e5-d96086b3cd17 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:17.265024 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-963039fb-83c5-49fa-82e5-d96086b3cd17 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:17.265828 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-963039fb-83c5-49fa-82e5-d96086b3cd17 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:17.266428 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-963039fb-83c5-49fa-82e5-d96086b3cd17 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:17.267299 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-963039fb-83c5-49fa-82e5-d96086b3cd17 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:17.267901 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-963039fb-83c5-49fa-82e5-d96086b3cd17 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:17.268554 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-963039fb-83c5-49fa-82e5-d96086b3cd17 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:17.589815 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-18af204b-6d3d-4b7d-905f-13c25b7733a9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:17.598968 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-18af204b-6d3d-4b7d-905f-13c25b7733a9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1470 microversion: 2.1 time: 0.915344 Sep 16 12:51:17.606033 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 754/1478] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:16 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1470 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:17.616715 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-47764fc8-2512-4d1d-9f53-b937a4c66988 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:17.617547 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-47764fc8-2512-4d1d-9f53-b937a4c66988 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: f9070e88-5408-48ab-9f4b-a74368e8f25e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:17.636155 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47764fc8-2512-4d1d-9f53-b937a4c66988 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:17.647010 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47764fc8-2512-4d1d-9f53-b937a4c66988 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:17.653454 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47764fc8-2512-4d1d-9f53-b937a4c66988 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:17.654313 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47764fc8-2512-4d1d-9f53-b937a4c66988 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:17.654915 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47764fc8-2512-4d1d-9f53-b937a4c66988 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:17.656153 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47764fc8-2512-4d1d-9f53-b937a4c66988 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:17.785703 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-963039fb-83c5-49fa-82e5-d96086b3cd17 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:17.802154 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-963039fb-83c5-49fa-82e5-d96086b3cd17 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:17.809077 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-963039fb-83c5-49fa-82e5-d96086b3cd17 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:17.824068 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-963039fb-83c5-49fa-82e5-d96086b3cd17 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.577747 Sep 16 12:51:17.826151 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 725/1479] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:17 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:17.845072 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-85fd388e-e264-4a4f-8983-4ccb1b20c0e3 req-b004e6cc-ded3-4856-b4bd-114482a62347 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a439c4ea-46f5-4571-9d87-96a91a6359f7", "name": "network-vif-plugged", "status": "completed", "tag": "76e2deeb-80ac-4c0d-98b8-96091a5ab0d2"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:51:17.866362 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-85fd388e-e264-4a4f-8983-4ccb1b20c0e3 req-b004e6cc-ded3-4856-b4bd-114482a62347 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:17.866803 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-85fd388e-e264-4a4f-8983-4ccb1b20c0e3 req-b004e6cc-ded3-4856-b4bd-114482a62347 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:17.872232 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-85fd388e-e264-4a4f-8983-4ccb1b20c0e3 req-b004e6cc-ded3-4856-b4bd-114482a62347 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:17.903286 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-85fd388e-e264-4a4f-8983-4ccb1b20c0e3 req-b004e6cc-ded3-4856-b4bd-114482a62347 service nova] Creating event network-vif-plugged:76e2deeb-80ac-4c0d-98b8-96091a5ab0d2 for instance a439c4ea-46f5-4571-9d87-96a91a6359f7 on n-h1-858094-4 Sep 16 12:51:17.912394 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [req-85fd388e-e264-4a4f-8983-4ccb1b20c0e3 req-b004e6cc-ded3-4856-b4bd-114482a62347 service nova] Instance a439c4ea-46f5-4571-9d87-96a91a6359f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858094-4', 'n-h2-858094-4'} {{(pid=128780) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 12:51:17.945427 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-85fd388e-e264-4a4f-8983-4ccb1b20c0e3 req-b004e6cc-ded3-4856-b4bd-114482a62347 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111391 Sep 16 12:51:17.954012 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 726/1480] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:51:17.968367 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fe26a72a-5628-491a-9a4a-f8e6cb90d7a6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:51:17.969405 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-fe26a72a-5628-491a-9a4a-f8e6cb90d7a6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:17.992571 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe26a72a-5628-491a-9a4a-f8e6cb90d7a6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:17.996586 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe26a72a-5628-491a-9a4a-f8e6cb90d7a6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:18.000973 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe26a72a-5628-491a-9a4a-f8e6cb90d7a6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:18.002003 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe26a72a-5628-491a-9a4a-f8e6cb90d7a6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:18.002927 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe26a72a-5628-491a-9a4a-f8e6cb90d7a6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:18.003545 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe26a72a-5628-491a-9a4a-f8e6cb90d7a6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:18.096889 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe26a72a-5628-491a-9a4a-f8e6cb90d7a6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:18.097372 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe26a72a-5628-491a-9a4a-f8e6cb90d7a6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:18.100276 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe26a72a-5628-491a-9a4a-f8e6cb90d7a6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:18.104669 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe26a72a-5628-491a-9a4a-f8e6cb90d7a6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:18.106197 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe26a72a-5628-491a-9a4a-f8e6cb90d7a6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:18.106684 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe26a72a-5628-491a-9a4a-f8e6cb90d7a6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:18.157719 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-fe26a72a-5628-491a-9a4a-f8e6cb90d7a6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Getting quotas for project 0b18ec5302634d2a95e51547e0019d40. Resources: {'cores', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:51:18.167125 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-fe26a72a-5628-491a-9a4a-f8e6cb90d7a6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Getting quotas for user f3e2827a76d14e4a88c4562f1c0351ac and project 0b18ec5302634d2a95e51547e0019d40. Resources: {'cores', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:51:18.368579 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-fe26a72a-5628-491a-9a4a-f8e6cb90d7a6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "POST /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7/action" status: 202 len: 0 microversion: 2.1 time: 0.412757 Sep 16 12:51:18.375108 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 727/1481] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:51:17 2022] POST /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7/action => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:51:18.381240 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-355127b2-f2d0-4a2c-aaea-5d4a97869c3b tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:18.381763 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-355127b2-f2d0-4a2c-aaea-5d4a97869c3b tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] [instance: 80dccb7b-ee21-422f-8ec5-f31feeab1f65] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:18.392574 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-355127b2-f2d0-4a2c-aaea-5d4a97869c3b tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:18.393297 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-355127b2-f2d0-4a2c-aaea-5d4a97869c3b tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:18.393792 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-355127b2-f2d0-4a2c-aaea-5d4a97869c3b tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:18.395169 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-355127b2-f2d0-4a2c-aaea-5d4a97869c3b tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:18.395869 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-355127b2-f2d0-4a2c-aaea-5d4a97869c3b tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:18.396645 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-355127b2-f2d0-4a2c-aaea-5d4a97869c3b tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:18.418021 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-47764fc8-2512-4d1d-9f53-b937a4c66988 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:18.429618 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-47764fc8-2512-4d1d-9f53-b937a4c66988 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e" status: 200 len: 1308 microversion: 2.1 time: 0.822069 Sep 16 12:51:18.435551 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 755/1482] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:17 2022] GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e => generated 1308 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:18.454426 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c9a2272f-154c-425e-9306-9a83f72fc1ec tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:18.455402 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c9a2272f-154c-425e-9306-9a83f72fc1ec tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 041df092-33d4-4b71-84d8-7cd479d32b4f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:18.466650 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9a2272f-154c-425e-9306-9a83f72fc1ec tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:18.467705 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9a2272f-154c-425e-9306-9a83f72fc1ec tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:18.468416 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9a2272f-154c-425e-9306-9a83f72fc1ec tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:18.469995 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9a2272f-154c-425e-9306-9a83f72fc1ec tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:18.484930 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9a2272f-154c-425e-9306-9a83f72fc1ec tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:18.487042 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9a2272f-154c-425e-9306-9a83f72fc1ec tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:18.771307 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-355127b2-f2d0-4a2c-aaea-5d4a97869c3b tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4242164d723c4db8a31efdda44f5207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665869d344cf42e38020c270515c5abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:18.800770 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-355127b2-f2d0-4a2c-aaea-5d4a97869c3b tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "GET /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65" status: 200 len: 1462 microversion: 2.1 time: 0.423788 Sep 16 12:51:18.801443 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 728/1483] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:18 2022] GET /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65 => generated 1462 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:18.845676 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a80b00be-e1be-4932-881d-bcd7b7d18052 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:18.846304 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a80b00be-e1be-4932-881d-bcd7b7d18052 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:18.885147 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a80b00be-e1be-4932-881d-bcd7b7d18052 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:18.888544 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a80b00be-e1be-4932-881d-bcd7b7d18052 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:18.889442 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a80b00be-e1be-4932-881d-bcd7b7d18052 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:18.892556 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a80b00be-e1be-4932-881d-bcd7b7d18052 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:18.893414 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a80b00be-e1be-4932-881d-bcd7b7d18052 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:18.894023 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a80b00be-e1be-4932-881d-bcd7b7d18052 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:19.190040 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c9a2272f-154c-425e-9306-9a83f72fc1ec tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:19.206110 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c9a2272f-154c-425e-9306-9a83f72fc1ec tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:19.207636 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c9a2272f-154c-425e-9306-9a83f72fc1ec tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:19.208871 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c9a2272f-154c-425e-9306-9a83f72fc1ec tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f" status: 200 len: 1361 microversion: 2.25 time: 0.771347 Sep 16 12:51:19.209453 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 756/1484] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:18 2022] GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f => generated 1361 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:19.224495 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-bc513fad-7566-45d2-88cc-ad29dfbff8bf req-9635c1b7-a90c-40f7-b1c3-05a07d4d5666 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80dccb7b-ee21-422f-8ec5-f31feeab1f65", "name": "network-vif-deleted", "tag": "b830d871-a472-440e-a2b5-2d8208f11f14"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:51:19.239211 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bc513fad-7566-45d2-88cc-ad29dfbff8bf req-9635c1b7-a90c-40f7-b1c3-05a07d4d5666 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:19.244972 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bc513fad-7566-45d2-88cc-ad29dfbff8bf req-9635c1b7-a90c-40f7-b1c3-05a07d4d5666 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:19.245674 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bc513fad-7566-45d2-88cc-ad29dfbff8bf req-9635c1b7-a90c-40f7-b1c3-05a07d4d5666 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:19.277028 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-bc513fad-7566-45d2-88cc-ad29dfbff8bf req-9635c1b7-a90c-40f7-b1c3-05a07d4d5666 service nova] Creating event network-vif-deleted:b830d871-a472-440e-a2b5-2d8208f11f14 for instance 80dccb7b-ee21-422f-8ec5-f31feeab1f65 on n-h1-858094-4 Sep 16 12:51:19.285719 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-bc513fad-7566-45d2-88cc-ad29dfbff8bf req-9635c1b7-a90c-40f7-b1c3-05a07d4d5666 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074754 Sep 16 12:51:19.286637 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 757/1485] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:51:19.291979 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-00754c3a-d434-4558-88bc-5652c1e33711 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:19.292722 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-00754c3a-d434-4558-88bc-5652c1e33711 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:19.310529 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-00754c3a-d434-4558-88bc-5652c1e33711 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:19.311061 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-00754c3a-d434-4558-88bc-5652c1e33711 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:19.311507 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-00754c3a-d434-4558-88bc-5652c1e33711 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:19.312269 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-00754c3a-d434-4558-88bc-5652c1e33711 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:19.312731 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-00754c3a-d434-4558-88bc-5652c1e33711 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:19.313158 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-00754c3a-d434-4558-88bc-5652c1e33711 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:19.534041 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-00754c3a-d434-4558-88bc-5652c1e33711 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:19.547698 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-00754c3a-d434-4558-88bc-5652c1e33711 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:19.554852 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-00754c3a-d434-4558-88bc-5652c1e33711 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:19.570264 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-00754c3a-d434-4558-88bc-5652c1e33711 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.278989 Sep 16 12:51:19.572916 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 758/1486] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:19 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:19.588387 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-89044d58-54cb-4dc8-97c5-aa1420e7d6a0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:19.589404 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-89044d58-54cb-4dc8-97c5-aa1420e7d6a0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: f9070e88-5408-48ab-9f4b-a74368e8f25e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:19.604455 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-89044d58-54cb-4dc8-97c5-aa1420e7d6a0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:19.605404 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-89044d58-54cb-4dc8-97c5-aa1420e7d6a0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:19.608268 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-89044d58-54cb-4dc8-97c5-aa1420e7d6a0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:19.613216 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-89044d58-54cb-4dc8-97c5-aa1420e7d6a0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:19.613949 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-89044d58-54cb-4dc8-97c5-aa1420e7d6a0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:19.614388 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-89044d58-54cb-4dc8-97c5-aa1420e7d6a0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:20.209569 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a80b00be-e1be-4932-881d-bcd7b7d18052 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:20.220657 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a80b00be-e1be-4932-881d-bcd7b7d18052 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1469 microversion: 2.1 time: 1.383610 Sep 16 12:51:20.221517 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 729/1487] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:18 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1469 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:20.228697 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-39e0f71f-1464-4d62-abb5-620f99380cab tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:20.229546 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-39e0f71f-1464-4d62-abb5-620f99380cab tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] [instance: 80dccb7b-ee21-422f-8ec5-f31feeab1f65] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:20.242373 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-39e0f71f-1464-4d62-abb5-620f99380cab tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:20.243219 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-39e0f71f-1464-4d62-abb5-620f99380cab tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:20.245089 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-39e0f71f-1464-4d62-abb5-620f99380cab tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:20.246055 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-39e0f71f-1464-4d62-abb5-620f99380cab tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:20.247942 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-39e0f71f-1464-4d62-abb5-620f99380cab tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:20.248653 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-39e0f71f-1464-4d62-abb5-620f99380cab tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:20.265780 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-39e0f71f-1464-4d62-abb5-620f99380cab tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] HTTP exception thrown: Instance 80dccb7b-ee21-422f-8ec5-f31feeab1f65 could not be found. Sep 16 12:51:20.267866 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-39e0f71f-1464-4d62-abb5-620f99380cab tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Request method failure captured: Sep 16 12:51:20.267866 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65 HTTP/1.1 Sep 16 12:51:20.267866 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:51:20.267866 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:51:20.267866 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:51:20.267866 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:51:20.267866 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:51:20.267866 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:51:20.267866 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:51:20.267866 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:51:20.267866 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHEbxwQCNstQVwT5JRPgTR7vepujuzEgyIUUfgwUnoZeKREOJNI9yG24I_qOa1nGV5xMXwy21Ktxp_Kc26VCsxC_HUF1Ibu3w0sqBdruN-Gbnjwss3YNFfFCSMwEmEBluumXwBa2yLywDO3rRjJjSYbY4KdflRmVRT3Cwr5CY8CjKF8 Sep 16 12:51:20.267866 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:51:20.267866 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:51:20.267866 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:51:20.267866 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:51:20.267866 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:51:20.267866 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:51:20.267866 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 665869d344cf42e38020c270515c5abf Sep 16 12:51:20.267866 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ServerGroupTestJSON-1786596517 Sep 16 12:51:20.267866 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:51:20.267866 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:51:20.269264 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/665869d344cf42e38020c270515c5abf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/665869d344cf42e38020c270515c5abf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_665869d344cf42e38020c270515c5abf", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/665869d344cf42e38020c270515c5abf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:51:20.269264 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ServerGroupTestJSON-1786596517 Sep 16 12:51:20.269264 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 665869d344cf42e38020c270515c5abf Sep 16 12:51:20.269264 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ServerGroupTestJSON-1786596517 Sep 16 12:51:20.269264 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ServerGroupTestJSON-1786596517-project Sep 16 12:51:20.269264 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:51:20.269264 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:51:20.269264 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 4242164d723c4db8a31efdda44f5207d Sep 16 12:51:20.269264 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ServerGroupTestJSON-1786596517-project Sep 16 12:51:20.269264 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:51:20.269264 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance 80dccb7b-ee21-422f-8ec5-f31feeab1f65 could not be found. Sep 16 12:51:20.269264 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '80dccb7b-ee21-422f-8ec5-f31feeab1f65'} Sep 16 12:51:20.270089 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:51:20.270089 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:20.270089 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:51:20.270089 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:51:20.270089 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:51:20.270089 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:51:20.270089 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:51:20.270089 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:51:20.270089 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:51:20.270089 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:51:20.270089 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80dccb7b-ee21-422f-8ec5-f31feeab1f65 could not be found. Sep 16 12:51:20.270089 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:20.270089 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:20.270089 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:20.270089 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:20.270089 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:51:20.270089 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:51:20.270089 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:51:20.270089 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:51:20.270089 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:51:20.271327 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:51:20.271327 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:51:20.271327 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:51:20.271327 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:51:20.271327 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:51:20.271327 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:51:20.271327 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:51:20.271327 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80dccb7b-ee21-422f-8ec5-f31feeab1f65 could not be found. Sep 16 12:51:20.271327 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:20.271327 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:20.271327 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:20.271327 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:20.271327 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:51:20.271327 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:51:20.271327 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:51:20.271327 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:51:20.271327 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80dccb7b-ee21-422f-8ec5-f31feeab1f65 could not be found. Sep 16 12:51:20.271327 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:20.273850 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-39e0f71f-1464-4d62-abb5-620f99380cab tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Returning 404 to user: Instance 80dccb7b-ee21-422f-8ec5-f31feeab1f65 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:51:20.275035 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-39e0f71f-1464-4d62-abb5-620f99380cab tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "GET /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65" status: 404 len: 111 microversion: 2.1 time: 0.052200 Sep 16 12:51:20.276418 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 730/1488] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:20 2022] GET /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:51:20.281369 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-89481753-e41e-4b4b-82db-388a585e5242 req-625a244a-6a04-4e44-a15f-26dfd78a403b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "041df092-33d4-4b71-84d8-7cd479d32b4f", "tag": "756cd197-6a93-4b4a-b498-7ebcbb3246c2"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:51:20.294992 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-89481753-e41e-4b4b-82db-388a585e5242 req-625a244a-6a04-4e44-a15f-26dfd78a403b service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:20.296102 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-89481753-e41e-4b4b-82db-388a585e5242 req-625a244a-6a04-4e44-a15f-26dfd78a403b service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:20.296788 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-89481753-e41e-4b4b-82db-388a585e5242 req-625a244a-6a04-4e44-a15f-26dfd78a403b service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:20.301488 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:51:20.310033 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-89481753-e41e-4b4b-82db-388a585e5242 req-625a244a-6a04-4e44-a15f-26dfd78a403b service nova] Creating event network-changed:756cd197-6a93-4b4a-b498-7ebcbb3246c2 for instance 041df092-33d4-4b71-84d8-7cd479d32b4f on n-h2-858094-4 Sep 16 12:51:20.316426 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-89481753-e41e-4b4b-82db-388a585e5242 req-625a244a-6a04-4e44-a15f-26dfd78a403b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038462 Sep 16 12:51:20.317670 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 731/1489] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:51:20.326194 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-725195e9-9788-4926-ad29-fff256cd1949 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:20.327167 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-725195e9-9788-4926-ad29-fff256cd1949 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 041df092-33d4-4b71-84d8-7cd479d32b4f] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:20.335567 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-725195e9-9788-4926-ad29-fff256cd1949 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:20.336384 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-725195e9-9788-4926-ad29-fff256cd1949 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:20.338171 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-725195e9-9788-4926-ad29-fff256cd1949 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:20.341610 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-725195e9-9788-4926-ad29-fff256cd1949 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:20.342912 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-725195e9-9788-4926-ad29-fff256cd1949 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:20.343551 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-725195e9-9788-4926-ad29-fff256cd1949 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:20.556821 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-89044d58-54cb-4dc8-97c5-aa1420e7d6a0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:20.567447 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-89044d58-54cb-4dc8-97c5-aa1420e7d6a0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e" status: 200 len: 1308 microversion: 2.1 time: 0.992736 Sep 16 12:51:20.585190 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 759/1490] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:19 2022] GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e => generated 1308 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:20.590777 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-184f4ff0-8c76-484d-a1bf-f09bd8ded2b0 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:20.614921 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.compute.server_groups [None req-184f4ff0-8c76-484d-a1bf-f09bd8ded2b0 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Querying cell 19bb4c25-c68f-412b-8c46-4f5dc22c63ee(cell1) for 1 instances {{(pid=128779) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 16 12:51:20.616190 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-184f4ff0-8c76-484d-a1bf-f09bd8ded2b0 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:20.616906 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-184f4ff0-8c76-484d-a1bf-f09bd8ded2b0 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:20.617838 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-184f4ff0-8c76-484d-a1bf-f09bd8ded2b0 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:20.629826 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-184f4ff0-8c76-484d-a1bf-f09bd8ded2b0 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.043165 Sep 16 12:51:20.631176 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 760/1491] 10.222.0.67 () {58 vars in 1152 bytes} [Fri Sep 16 12:51:20 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:51:20.644209 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b66c80e1-870f-4ecc-b0c2-b1cf12fdffe0 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:20.644861 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b66c80e1-870f-4ecc-b0c2-b1cf12fdffe0 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:20.653774 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b66c80e1-870f-4ecc-b0c2-b1cf12fdffe0 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:20.655098 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b66c80e1-870f-4ecc-b0c2-b1cf12fdffe0 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:20.655712 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b66c80e1-870f-4ecc-b0c2-b1cf12fdffe0 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:20.656657 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b66c80e1-870f-4ecc-b0c2-b1cf12fdffe0 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:20.657642 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b66c80e1-870f-4ecc-b0c2-b1cf12fdffe0 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:20.658348 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b66c80e1-870f-4ecc-b0c2-b1cf12fdffe0 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:20.826880 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b66c80e1-870f-4ecc-b0c2-b1cf12fdffe0 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:20.836781 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b66c80e1-870f-4ecc-b0c2-b1cf12fdffe0 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:20.838545 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b66c80e1-870f-4ecc-b0c2-b1cf12fdffe0 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:20.846017 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b66c80e1-870f-4ecc-b0c2-b1cf12fdffe0 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.213506 Sep 16 12:51:20.846776 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 761/1492] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:20 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:20.864102 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-af92266e-b426-4263-a5f3-2cbd25ccc1fe tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:20.887429 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:51:20.889810 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.compute.server_groups [None req-af92266e-b426-4263-a5f3-2cbd25ccc1fe tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Querying cell 19bb4c25-c68f-412b-8c46-4f5dc22c63ee(cell1) for 1 instances {{(pid=128779) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 16 12:51:20.892052 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af92266e-b426-4263-a5f3-2cbd25ccc1fe tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:20.893132 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af92266e-b426-4263-a5f3-2cbd25ccc1fe tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:20.893872 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af92266e-b426-4263-a5f3-2cbd25ccc1fe tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:20.912070 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-af92266e-b426-4263-a5f3-2cbd25ccc1fe tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "GET /compute/v2.1/os-server-groups/121fd690-9860-4950-a263-9bc4990668d3" status: 200 len: 183 microversion: 2.1 time: 0.063994 Sep 16 12:51:20.912688 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 762/1493] 10.222.0.67 () {58 vars in 1263 bytes} [Fri Sep 16 12:51:20 2022] GET /compute/v2.1/os-server-groups/121fd690-9860-4950-a263-9bc4990668d3 => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:51:20.927396 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-317e648e-a6d5-490a-96c2-bb369599c73b tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:20.927915 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-317e648e-a6d5-490a-96c2-bb369599c73b tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] [instance: 80dccb7b-ee21-422f-8ec5-f31feeab1f65] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:20.932225 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-725195e9-9788-4926-ad29-fff256cd1949 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:20.947371 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-317e648e-a6d5-490a-96c2-bb369599c73b tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:20.948078 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-317e648e-a6d5-490a-96c2-bb369599c73b tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:20.948514 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-725195e9-9788-4926-ad29-fff256cd1949 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:20.949113 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-317e648e-a6d5-490a-96c2-bb369599c73b tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:20.949829 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-317e648e-a6d5-490a-96c2-bb369599c73b tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:20.949956 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-725195e9-9788-4926-ad29-fff256cd1949 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:20.950386 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-317e648e-a6d5-490a-96c2-bb369599c73b tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:20.951188 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-317e648e-a6d5-490a-96c2-bb369599c73b tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:20.951361 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-725195e9-9788-4926-ad29-fff256cd1949 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f" status: 200 len: 1361 microversion: 2.25 time: 0.632158 Sep 16 12:51:20.952212 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 732/1494] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:20 2022] GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f => generated 1361 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:20.982623 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-317e648e-a6d5-490a-96c2-bb369599c73b tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] HTTP exception thrown: Instance 80dccb7b-ee21-422f-8ec5-f31feeab1f65 could not be found. Sep 16 12:51:20.984308 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-317e648e-a6d5-490a-96c2-bb369599c73b tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Request method failure captured: Sep 16 12:51:20.984308 n-d-858094-4 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65 HTTP/1.1 Sep 16 12:51:20.984308 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:51:20.984308 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:51:20.984308 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:51:20.984308 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:51:20.984308 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:51:20.984308 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:51:20.984308 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:51:20.984308 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:51:20.984308 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHEbxwQCNstQVwT5JRPgTR7vepujuzEgyIUUfgwUnoZeKREOJNI9yG24I_qOa1nGV5xMXwy21Ktxp_Kc26VCsxC_HUF1Ibu3w0sqBdruN-Gbnjwss3YNFfFCSMwEmEBluumXwBa2yLywDO3rRjJjSYbY4KdflRmVRT3Cwr5CY8CjKF8 Sep 16 12:51:20.984308 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:51:20.984308 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:51:20.984308 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:51:20.984308 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:51:20.984308 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:51:20.984308 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:51:20.984308 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 665869d344cf42e38020c270515c5abf Sep 16 12:51:20.984308 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerGroupTestJSON-1786596517 Sep 16 12:51:20.984308 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:51:20.984308 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:51:20.986028 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/665869d344cf42e38020c270515c5abf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/665869d344cf42e38020c270515c5abf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_665869d344cf42e38020c270515c5abf", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/665869d344cf42e38020c270515c5abf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:51:20.986028 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ServerGroupTestJSON-1786596517 Sep 16 12:51:20.986028 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 665869d344cf42e38020c270515c5abf Sep 16 12:51:20.986028 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerGroupTestJSON-1786596517 Sep 16 12:51:20.986028 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ServerGroupTestJSON-1786596517-project Sep 16 12:51:20.986028 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:51:20.986028 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:51:20.986028 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 4242164d723c4db8a31efdda44f5207d Sep 16 12:51:20.986028 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ServerGroupTestJSON-1786596517-project Sep 16 12:51:20.986028 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:51:20.986028 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 80dccb7b-ee21-422f-8ec5-f31feeab1f65 could not be found. Sep 16 12:51:20.986028 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '80dccb7b-ee21-422f-8ec5-f31feeab1f65'} Sep 16 12:51:20.986990 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:51:20.986990 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:20.986990 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:51:20.986990 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:51:20.986990 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:51:20.986990 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:51:20.986990 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:51:20.986990 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:51:20.986990 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:51:20.986990 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:51:20.986990 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80dccb7b-ee21-422f-8ec5-f31feeab1f65 could not be found. Sep 16 12:51:20.986990 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:20.986990 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:20.986990 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:20.986990 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:20.986990 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:51:20.986990 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:51:20.986990 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:51:20.986990 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:51:20.986990 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:51:20.989344 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:51:20.989344 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 12:51:20.989344 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 12:51:20.989344 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 12:51:20.989344 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 12:51:20.989344 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:51:20.989344 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:51:20.989344 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:51:20.989344 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:51:20.989344 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80dccb7b-ee21-422f-8ec5-f31feeab1f65 could not be found. Sep 16 12:51:20.989344 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:20.989344 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:20.989344 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:20.989344 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:20.989344 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:51:20.989344 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:51:20.989344 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:51:20.989344 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:51:20.989344 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80dccb7b-ee21-422f-8ec5-f31feeab1f65 could not be found. Sep 16 12:51:20.989344 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:20.990892 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-317e648e-a6d5-490a-96c2-bb369599c73b tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Returning 404 to user: Instance 80dccb7b-ee21-422f-8ec5-f31feeab1f65 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:51:20.990892 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-317e648e-a6d5-490a-96c2-bb369599c73b tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "DELETE /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65" status: 404 len: 111 microversion: 2.1 time: 0.063346 Sep 16 12:51:20.990892 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 763/1495] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:51:20 2022] DELETE /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 12:51:20.997870 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7d31c4c9-2842-4229-a8e7-fb098bc16a88 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:20.998625 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7d31c4c9-2842-4229-a8e7-fb098bc16a88 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] [instance: 80dccb7b-ee21-422f-8ec5-f31feeab1f65] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:21.008771 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7d31c4c9-2842-4229-a8e7-fb098bc16a88 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:21.011650 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7d31c4c9-2842-4229-a8e7-fb098bc16a88 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:21.012309 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7d31c4c9-2842-4229-a8e7-fb098bc16a88 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:21.013257 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7d31c4c9-2842-4229-a8e7-fb098bc16a88 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:21.013728 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7d31c4c9-2842-4229-a8e7-fb098bc16a88 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:21.014244 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7d31c4c9-2842-4229-a8e7-fb098bc16a88 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:21.032474 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-7d31c4c9-2842-4229-a8e7-fb098bc16a88 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] HTTP exception thrown: Instance 80dccb7b-ee21-422f-8ec5-f31feeab1f65 could not be found. Sep 16 12:51:21.034374 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7d31c4c9-2842-4229-a8e7-fb098bc16a88 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Request method failure captured: Sep 16 12:51:21.034374 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65 HTTP/1.1 Sep 16 12:51:21.034374 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:51:21.034374 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:51:21.034374 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:51:21.034374 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:51:21.034374 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:51:21.034374 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:51:21.034374 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:51:21.034374 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:51:21.034374 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHEbxwQCNstQVwT5JRPgTR7vepujuzEgyIUUfgwUnoZeKREOJNI9yG24I_qOa1nGV5xMXwy21Ktxp_Kc26VCsxC_HUF1Ibu3w0sqBdruN-Gbnjwss3YNFfFCSMwEmEBluumXwBa2yLywDO3rRjJjSYbY4KdflRmVRT3Cwr5CY8CjKF8 Sep 16 12:51:21.034374 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:51:21.034374 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:51:21.034374 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:51:21.034374 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:51:21.034374 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:51:21.034374 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:51:21.034374 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 665869d344cf42e38020c270515c5abf Sep 16 12:51:21.034374 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ServerGroupTestJSON-1786596517 Sep 16 12:51:21.034374 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:51:21.034374 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:51:21.037423 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/665869d344cf42e38020c270515c5abf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/665869d344cf42e38020c270515c5abf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_665869d344cf42e38020c270515c5abf", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/665869d344cf42e38020c270515c5abf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:51:21.037423 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ServerGroupTestJSON-1786596517 Sep 16 12:51:21.037423 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 665869d344cf42e38020c270515c5abf Sep 16 12:51:21.037423 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ServerGroupTestJSON-1786596517 Sep 16 12:51:21.037423 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ServerGroupTestJSON-1786596517-project Sep 16 12:51:21.037423 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:51:21.037423 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:51:21.037423 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 4242164d723c4db8a31efdda44f5207d Sep 16 12:51:21.037423 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ServerGroupTestJSON-1786596517-project Sep 16 12:51:21.037423 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:51:21.037423 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance 80dccb7b-ee21-422f-8ec5-f31feeab1f65 could not be found. Sep 16 12:51:21.037423 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '80dccb7b-ee21-422f-8ec5-f31feeab1f65'} Sep 16 12:51:21.038337 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:51:21.038337 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:21.038337 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:51:21.038337 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:51:21.038337 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:51:21.038337 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:51:21.038337 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:51:21.038337 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:51:21.038337 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:51:21.038337 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:51:21.038337 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80dccb7b-ee21-422f-8ec5-f31feeab1f65 could not be found. Sep 16 12:51:21.038337 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:21.038337 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:21.038337 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:21.038337 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:21.038337 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:51:21.038337 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:51:21.038337 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:51:21.038337 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:51:21.038337 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:51:21.039737 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:51:21.039737 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:51:21.039737 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:51:21.039737 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:51:21.039737 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:51:21.039737 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:51:21.039737 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:51:21.039737 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80dccb7b-ee21-422f-8ec5-f31feeab1f65 could not be found. Sep 16 12:51:21.039737 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:21.039737 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:21.039737 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:21.039737 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:21.039737 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:51:21.039737 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:51:21.039737 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:51:21.039737 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:51:21.039737 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80dccb7b-ee21-422f-8ec5-f31feeab1f65 could not be found. Sep 16 12:51:21.039737 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:21.041169 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7d31c4c9-2842-4229-a8e7-fb098bc16a88 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Returning 404 to user: Instance 80dccb7b-ee21-422f-8ec5-f31feeab1f65 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:51:21.041169 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7d31c4c9-2842-4229-a8e7-fb098bc16a88 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "GET /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65" status: 404 len: 111 microversion: 2.1 time: 0.042109 Sep 16 12:51:21.041169 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 733/1496] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:20 2022] GET /compute/v2.1/servers/80dccb7b-ee21-422f-8ec5-f31feeab1f65 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:51:21.045560 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-eecaeed3-bef2-4e67-a4dd-293ef1b952ae tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:21.055136 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-eecaeed3-bef2-4e67-a4dd-293ef1b952ae tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] HTTP exception thrown: Instance group dfed8cce-3e17-4e04-bf34-affb37f00909 could not be found. Sep 16 12:51:21.071274 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-eecaeed3-bef2-4e67-a4dd-293ef1b952ae tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Request method failure captured: Sep 16 12:51:21.071274 n-d-858094-4 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/os-server-groups/dfed8cce-3e17-4e04-bf34-affb37f00909 HTTP/1.1 Sep 16 12:51:21.071274 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:51:21.071274 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:51:21.071274 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:51:21.071274 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:51:21.071274 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:51:21.071274 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:51:21.071274 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:51:21.071274 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:51:21.071274 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHEbxwQCNstQVwT5JRPgTR7vepujuzEgyIUUfgwUnoZeKREOJNI9yG24I_qOa1nGV5xMXwy21Ktxp_Kc26VCsxC_HUF1Ibu3w0sqBdruN-Gbnjwss3YNFfFCSMwEmEBluumXwBa2yLywDO3rRjJjSYbY4KdflRmVRT3Cwr5CY8CjKF8 Sep 16 12:51:21.071274 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:51:21.071274 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:51:21.071274 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:51:21.071274 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:51:21.071274 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:51:21.071274 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:51:21.071274 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 665869d344cf42e38020c270515c5abf Sep 16 12:51:21.071274 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerGroupTestJSON-1786596517 Sep 16 12:51:21.071274 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:51:21.071274 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:51:21.072961 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/665869d344cf42e38020c270515c5abf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/665869d344cf42e38020c270515c5abf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_665869d344cf42e38020c270515c5abf", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/665869d344cf42e38020c270515c5abf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:51:21.072961 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ServerGroupTestJSON-1786596517 Sep 16 12:51:21.072961 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 665869d344cf42e38020c270515c5abf Sep 16 12:51:21.072961 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerGroupTestJSON-1786596517 Sep 16 12:51:21.072961 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ServerGroupTestJSON-1786596517-project Sep 16 12:51:21.072961 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:51:21.072961 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:51:21.072961 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 4242164d723c4db8a31efdda44f5207d Sep 16 12:51:21.072961 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ServerGroupTestJSON-1786596517-project Sep 16 12:51:21.072961 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:51:21.072961 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance group dfed8cce-3e17-4e04-bf34-affb37f00909 could not be found. Sep 16 12:51:21.072961 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': 'dfed8cce-3e17-4e04-bf34-affb37f00909'} Sep 16 12:51:21.074322 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:51:21.074322 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:21.074322 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 16 12:51:21.074322 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 16 12:51:21.074322 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 12:51:21.074322 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 12:51:21.074322 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 16 12:51:21.074322 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 16 12:51:21.074322 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 12:51:21.074322 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 12:51:21.074322 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 16 12:51:21.074322 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 16 12:51:21.074322 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group dfed8cce-3e17-4e04-bf34-affb37f00909 could not be found. Sep 16 12:51:21.074322 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:21.074322 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:21.074322 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:21.074322 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:21.074322 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:51:21.074322 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:51:21.076189 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:51:21.076189 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:51:21.076189 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:51:21.076189 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:51:21.076189 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 16 12:51:21.076189 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:51:21.076189 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group dfed8cce-3e17-4e04-bf34-affb37f00909 could not be found. Sep 16 12:51:21.076189 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:21.076189 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:21.076189 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:21.076189 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:21.076189 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:51:21.076189 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:51:21.076189 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:51:21.076189 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:51:21.076189 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group dfed8cce-3e17-4e04-bf34-affb37f00909 could not be found. Sep 16 12:51:21.076189 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:21.079204 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-eecaeed3-bef2-4e67-a4dd-293ef1b952ae tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Returning 404 to user: Instance group dfed8cce-3e17-4e04-bf34-affb37f00909 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:51:21.080381 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-eecaeed3-bef2-4e67-a4dd-293ef1b952ae tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "DELETE /compute/v2.1/os-server-groups/dfed8cce-3e17-4e04-bf34-affb37f00909" status: 404 len: 117 microversion: 2.1 time: 0.039495 Sep 16 12:51:21.081480 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 764/1497] 10.222.0.67 () {58 vars in 1266 bytes} [Fri Sep 16 12:51:21 2022] DELETE /compute/v2.1/os-server-groups/dfed8cce-3e17-4e04-bf34-affb37f00909 => generated 117 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:51:21.089761 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3fec9954-afc7-4aaf-b269-4368bc8d07c6 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:21.100669 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-3fec9954-afc7-4aaf-b269-4368bc8d07c6 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] HTTP exception thrown: Instance group 80d5e482-0553-4ca2-a536-6db525d413f7 could not be found. Sep 16 12:51:21.107195 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3fec9954-afc7-4aaf-b269-4368bc8d07c6 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Request method failure captured: Sep 16 12:51:21.107195 n-d-858094-4 devstack@n-api.service[128780]: request: DELETE /compute/v2.1/os-server-groups/80d5e482-0553-4ca2-a536-6db525d413f7 HTTP/1.1 Sep 16 12:51:21.107195 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:51:21.107195 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:51:21.107195 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:51:21.107195 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:51:21.107195 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:51:21.107195 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:51:21.107195 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:51:21.107195 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:51:21.107195 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHEbxwQCNstQVwT5JRPgTR7vepujuzEgyIUUfgwUnoZeKREOJNI9yG24I_qOa1nGV5xMXwy21Ktxp_Kc26VCsxC_HUF1Ibu3w0sqBdruN-Gbnjwss3YNFfFCSMwEmEBluumXwBa2yLywDO3rRjJjSYbY4KdflRmVRT3Cwr5CY8CjKF8 Sep 16 12:51:21.107195 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:51:21.107195 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:51:21.107195 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:51:21.107195 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:51:21.107195 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:51:21.107195 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:51:21.107195 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 665869d344cf42e38020c270515c5abf Sep 16 12:51:21.107195 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ServerGroupTestJSON-1786596517 Sep 16 12:51:21.107195 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:51:21.107195 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:51:21.109074 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/665869d344cf42e38020c270515c5abf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/665869d344cf42e38020c270515c5abf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_665869d344cf42e38020c270515c5abf", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/665869d344cf42e38020c270515c5abf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:51:21.109074 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ServerGroupTestJSON-1786596517 Sep 16 12:51:21.109074 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 665869d344cf42e38020c270515c5abf Sep 16 12:51:21.109074 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ServerGroupTestJSON-1786596517 Sep 16 12:51:21.109074 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ServerGroupTestJSON-1786596517-project Sep 16 12:51:21.109074 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:51:21.109074 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:51:21.109074 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 4242164d723c4db8a31efdda44f5207d Sep 16 12:51:21.109074 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ServerGroupTestJSON-1786596517-project Sep 16 12:51:21.109074 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:51:21.109074 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance group 80d5e482-0553-4ca2-a536-6db525d413f7 could not be found. Sep 16 12:51:21.109074 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '80d5e482-0553-4ca2-a536-6db525d413f7'} Sep 16 12:51:21.110029 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:51:21.110029 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:21.110029 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 16 12:51:21.110029 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 16 12:51:21.110029 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 12:51:21.110029 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 12:51:21.110029 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 16 12:51:21.110029 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 16 12:51:21.110029 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 12:51:21.110029 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 12:51:21.110029 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 16 12:51:21.110029 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 16 12:51:21.110029 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 80d5e482-0553-4ca2-a536-6db525d413f7 could not be found. Sep 16 12:51:21.110029 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:21.110029 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:21.110029 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:21.110029 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:21.110029 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:51:21.110029 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:51:21.112709 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:51:21.112709 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:51:21.112709 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:51:21.112709 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:51:21.112709 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 16 12:51:21.112709 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:51:21.112709 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 80d5e482-0553-4ca2-a536-6db525d413f7 could not be found. Sep 16 12:51:21.112709 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:21.112709 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:21.112709 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:21.112709 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:21.112709 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:51:21.112709 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:51:21.112709 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:51:21.112709 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:51:21.112709 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 80d5e482-0553-4ca2-a536-6db525d413f7 could not be found. Sep 16 12:51:21.112709 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:21.114444 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3fec9954-afc7-4aaf-b269-4368bc8d07c6 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Returning 404 to user: Instance group 80d5e482-0553-4ca2-a536-6db525d413f7 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:51:21.114444 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3fec9954-afc7-4aaf-b269-4368bc8d07c6 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "DELETE /compute/v2.1/os-server-groups/80d5e482-0553-4ca2-a536-6db525d413f7" status: 404 len: 117 microversion: 2.1 time: 0.023211 Sep 16 12:51:21.114444 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 734/1498] 10.222.0.67 () {58 vars in 1266 bytes} [Fri Sep 16 12:51:21 2022] DELETE /compute/v2.1/os-server-groups/80d5e482-0553-4ca2-a536-6db525d413f7 => generated 117 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:51:21.121963 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9853cc01-4eb4-45e0-8667-d7284eef5795 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:21.132628 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-9853cc01-4eb4-45e0-8667-d7284eef5795 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] HTTP exception thrown: Instance group fe3108b0-4919-4175-b78c-fb1b12ff013e could not be found. Sep 16 12:51:21.135082 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9853cc01-4eb4-45e0-8667-d7284eef5795 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Request method failure captured: Sep 16 12:51:21.135082 n-d-858094-4 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/os-server-groups/fe3108b0-4919-4175-b78c-fb1b12ff013e HTTP/1.1 Sep 16 12:51:21.135082 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:51:21.135082 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:51:21.135082 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:51:21.135082 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:51:21.135082 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:51:21.135082 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:51:21.135082 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:51:21.135082 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:51:21.135082 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHEbxwQCNstQVwT5JRPgTR7vepujuzEgyIUUfgwUnoZeKREOJNI9yG24I_qOa1nGV5xMXwy21Ktxp_Kc26VCsxC_HUF1Ibu3w0sqBdruN-Gbnjwss3YNFfFCSMwEmEBluumXwBa2yLywDO3rRjJjSYbY4KdflRmVRT3Cwr5CY8CjKF8 Sep 16 12:51:21.135082 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:51:21.135082 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:51:21.135082 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:51:21.135082 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:51:21.135082 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:51:21.135082 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:51:21.135082 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 665869d344cf42e38020c270515c5abf Sep 16 12:51:21.135082 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerGroupTestJSON-1786596517 Sep 16 12:51:21.135082 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:51:21.135082 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:51:21.136829 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/665869d344cf42e38020c270515c5abf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/665869d344cf42e38020c270515c5abf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_665869d344cf42e38020c270515c5abf", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/665869d344cf42e38020c270515c5abf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:51:21.136829 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ServerGroupTestJSON-1786596517 Sep 16 12:51:21.136829 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 665869d344cf42e38020c270515c5abf Sep 16 12:51:21.136829 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerGroupTestJSON-1786596517 Sep 16 12:51:21.136829 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ServerGroupTestJSON-1786596517-project Sep 16 12:51:21.136829 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:51:21.136829 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:51:21.136829 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 4242164d723c4db8a31efdda44f5207d Sep 16 12:51:21.136829 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ServerGroupTestJSON-1786596517-project Sep 16 12:51:21.136829 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:51:21.136829 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance group fe3108b0-4919-4175-b78c-fb1b12ff013e could not be found. Sep 16 12:51:21.136829 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': 'fe3108b0-4919-4175-b78c-fb1b12ff013e'} Sep 16 12:51:21.138872 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:51:21.138872 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:21.138872 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 16 12:51:21.138872 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 16 12:51:21.138872 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 12:51:21.138872 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 12:51:21.138872 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 16 12:51:21.138872 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 16 12:51:21.138872 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 12:51:21.138872 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 12:51:21.138872 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 16 12:51:21.138872 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 16 12:51:21.138872 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group fe3108b0-4919-4175-b78c-fb1b12ff013e could not be found. Sep 16 12:51:21.138872 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:21.138872 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:21.138872 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:21.138872 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:21.138872 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:51:21.138872 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:51:21.140138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:51:21.140138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:51:21.140138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:51:21.140138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:51:21.140138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 16 12:51:21.140138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:51:21.140138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group fe3108b0-4919-4175-b78c-fb1b12ff013e could not be found. Sep 16 12:51:21.140138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:21.140138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:21.140138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:21.140138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:21.140138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:51:21.140138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:51:21.140138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:51:21.140138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:51:21.140138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group fe3108b0-4919-4175-b78c-fb1b12ff013e could not be found. Sep 16 12:51:21.140138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:21.142589 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9853cc01-4eb4-45e0-8667-d7284eef5795 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Returning 404 to user: Instance group fe3108b0-4919-4175-b78c-fb1b12ff013e could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:51:21.143722 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9853cc01-4eb4-45e0-8667-d7284eef5795 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "DELETE /compute/v2.1/os-server-groups/fe3108b0-4919-4175-b78c-fb1b12ff013e" status: 404 len: 117 microversion: 2.1 time: 0.026574 Sep 16 12:51:21.146270 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 765/1499] 10.222.0.67 () {58 vars in 1266 bytes} [Fri Sep 16 12:51:21 2022] DELETE /compute/v2.1/os-server-groups/fe3108b0-4919-4175-b78c-fb1b12ff013e => generated 117 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:51:21.161359 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-bc04911b-182e-4af5-8fd9-693cee3c9833 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:21.172890 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-bc04911b-182e-4af5-8fd9-693cee3c9833 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] HTTP exception thrown: Instance group 6dde91d9-5bbb-4881-ae93-6e3f7b281679 could not be found. Sep 16 12:51:21.175251 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-bc04911b-182e-4af5-8fd9-693cee3c9833 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Request method failure captured: Sep 16 12:51:21.175251 n-d-858094-4 devstack@n-api.service[128780]: request: DELETE /compute/v2.1/os-server-groups/6dde91d9-5bbb-4881-ae93-6e3f7b281679 HTTP/1.1 Sep 16 12:51:21.175251 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:51:21.175251 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:51:21.175251 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:51:21.175251 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:51:21.175251 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:51:21.175251 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:51:21.175251 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:51:21.175251 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:51:21.175251 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHEbxwQCNstQVwT5JRPgTR7vepujuzEgyIUUfgwUnoZeKREOJNI9yG24I_qOa1nGV5xMXwy21Ktxp_Kc26VCsxC_HUF1Ibu3w0sqBdruN-Gbnjwss3YNFfFCSMwEmEBluumXwBa2yLywDO3rRjJjSYbY4KdflRmVRT3Cwr5CY8CjKF8 Sep 16 12:51:21.175251 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:51:21.175251 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:51:21.175251 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:51:21.175251 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:51:21.175251 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:51:21.175251 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:51:21.175251 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 665869d344cf42e38020c270515c5abf Sep 16 12:51:21.175251 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ServerGroupTestJSON-1786596517 Sep 16 12:51:21.175251 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:51:21.175251 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:51:21.177012 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/665869d344cf42e38020c270515c5abf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/665869d344cf42e38020c270515c5abf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_665869d344cf42e38020c270515c5abf", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/665869d344cf42e38020c270515c5abf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:51:21.177012 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ServerGroupTestJSON-1786596517 Sep 16 12:51:21.177012 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 665869d344cf42e38020c270515c5abf Sep 16 12:51:21.177012 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ServerGroupTestJSON-1786596517 Sep 16 12:51:21.177012 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ServerGroupTestJSON-1786596517-project Sep 16 12:51:21.177012 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:51:21.177012 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:51:21.177012 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 4242164d723c4db8a31efdda44f5207d Sep 16 12:51:21.177012 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ServerGroupTestJSON-1786596517-project Sep 16 12:51:21.177012 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:51:21.177012 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance group 6dde91d9-5bbb-4881-ae93-6e3f7b281679 could not be found. Sep 16 12:51:21.177012 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '6dde91d9-5bbb-4881-ae93-6e3f7b281679'} Sep 16 12:51:21.177936 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:51:21.177936 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:21.177936 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 16 12:51:21.177936 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 16 12:51:21.177936 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 12:51:21.177936 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 12:51:21.177936 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 16 12:51:21.177936 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 16 12:51:21.177936 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 12:51:21.177936 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 12:51:21.177936 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 16 12:51:21.177936 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 16 12:51:21.177936 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 6dde91d9-5bbb-4881-ae93-6e3f7b281679 could not be found. Sep 16 12:51:21.177936 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:21.177936 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:21.177936 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:21.177936 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:21.177936 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:51:21.177936 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:51:21.179315 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:51:21.179315 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:51:21.179315 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:51:21.179315 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:51:21.179315 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 16 12:51:21.179315 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:51:21.179315 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 6dde91d9-5bbb-4881-ae93-6e3f7b281679 could not be found. Sep 16 12:51:21.179315 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:21.179315 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:21.179315 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:21.179315 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:21.179315 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:51:21.179315 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:51:21.179315 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:51:21.179315 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:51:21.179315 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 6dde91d9-5bbb-4881-ae93-6e3f7b281679 could not be found. Sep 16 12:51:21.179315 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:21.184675 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-bc04911b-182e-4af5-8fd9-693cee3c9833 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Returning 404 to user: Instance group 6dde91d9-5bbb-4881-ae93-6e3f7b281679 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:51:21.186078 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-bc04911b-182e-4af5-8fd9-693cee3c9833 tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "DELETE /compute/v2.1/os-server-groups/6dde91d9-5bbb-4881-ae93-6e3f7b281679" status: 404 len: 117 microversion: 2.1 time: 0.035022 Sep 16 12:51:21.187252 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 735/1500] 10.222.0.67 () {58 vars in 1266 bytes} [Fri Sep 16 12:51:21 2022] DELETE /compute/v2.1/os-server-groups/6dde91d9-5bbb-4881-ae93-6e3f7b281679 => generated 117 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 12:51:21.199205 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f5480623-21a2-4a54-8910-6d1266f380ee tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:21.248401 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6e9678bf-a24c-4fa2-b096-44f32887c9ca tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:21.249735 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6e9678bf-a24c-4fa2-b096-44f32887c9ca tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:21.255426 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f5480623-21a2-4a54-8910-6d1266f380ee tempest-ServerGroupTestJSON-1786596517 tempest-ServerGroupTestJSON-1786596517-project] 10.222.0.67 "DELETE /compute/v2.1/os-server-groups/121fd690-9860-4950-a263-9bc4990668d3" status: 204 len: 0 microversion: 2.1 time: 0.063040 Sep 16 12:51:21.259605 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6e9678bf-a24c-4fa2-b096-44f32887c9ca tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:21.260841 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 766/1501] 10.222.0.67 () {58 vars in 1266 bytes} [Fri Sep 16 12:51:21 2022] DELETE /compute/v2.1/os-server-groups/121fd690-9860-4950-a263-9bc4990668d3 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:51:21.261637 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6e9678bf-a24c-4fa2-b096-44f32887c9ca tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:21.262246 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6e9678bf-a24c-4fa2-b096-44f32887c9ca tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:21.263867 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6e9678bf-a24c-4fa2-b096-44f32887c9ca tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:21.264728 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6e9678bf-a24c-4fa2-b096-44f32887c9ca tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:21.265325 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6e9678bf-a24c-4fa2-b096-44f32887c9ca tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:21.595242 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6e9678bf-a24c-4fa2-b096-44f32887c9ca tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:21.600515 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-32988154-f3a0-48f3-8e71-988af7733d2d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:21.601885 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-32988154-f3a0-48f3-8e71-988af7733d2d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: f9070e88-5408-48ab-9f4b-a74368e8f25e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:21.617349 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32988154-f3a0-48f3-8e71-988af7733d2d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:21.631951 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32988154-f3a0-48f3-8e71-988af7733d2d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:21.634662 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6e9678bf-a24c-4fa2-b096-44f32887c9ca tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1469 microversion: 2.1 time: 0.374416 Sep 16 12:51:21.637067 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32988154-f3a0-48f3-8e71-988af7733d2d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:21.640594 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 736/1502] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:21 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1469 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:51:21.643802 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32988154-f3a0-48f3-8e71-988af7733d2d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:21.645468 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32988154-f3a0-48f3-8e71-988af7733d2d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:21.647430 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32988154-f3a0-48f3-8e71-988af7733d2d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:21.881490 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-05f4fefe-6cfc-44f0-ab73-6ca4b1b9d121 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:21.882239 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-05f4fefe-6cfc-44f0-ab73-6ca4b1b9d121 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:21.899412 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-05f4fefe-6cfc-44f0-ab73-6ca4b1b9d121 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:21.901085 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-05f4fefe-6cfc-44f0-ab73-6ca4b1b9d121 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:21.903853 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-05f4fefe-6cfc-44f0-ab73-6ca4b1b9d121 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:21.906797 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-05f4fefe-6cfc-44f0-ab73-6ca4b1b9d121 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:21.907429 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-05f4fefe-6cfc-44f0-ab73-6ca4b1b9d121 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:21.909440 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-05f4fefe-6cfc-44f0-ab73-6ca4b1b9d121 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:21.981885 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-32988154-f3a0-48f3-8e71-988af7733d2d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:21.992055 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-32988154-f3a0-48f3-8e71-988af7733d2d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e" status: 200 len: 1308 microversion: 2.1 time: 0.404660 Sep 16 12:51:21.996830 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 767/1503] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:21 2022] GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e => generated 1308 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:22.008542 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-33a324af-1d6d-4bad-aea9-dff8528c00c9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:22.017919 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-33a324af-1d6d-4bad-aea9-dff8528c00c9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 041df092-33d4-4b71-84d8-7cd479d32b4f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:22.024678 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33a324af-1d6d-4bad-aea9-dff8528c00c9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:22.025411 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33a324af-1d6d-4bad-aea9-dff8528c00c9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:22.026045 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33a324af-1d6d-4bad-aea9-dff8528c00c9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:22.026766 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33a324af-1d6d-4bad-aea9-dff8528c00c9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:22.027250 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33a324af-1d6d-4bad-aea9-dff8528c00c9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:22.027674 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33a324af-1d6d-4bad-aea9-dff8528c00c9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:22.158045 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-05f4fefe-6cfc-44f0-ab73-6ca4b1b9d121 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:22.171739 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-05f4fefe-6cfc-44f0-ab73-6ca4b1b9d121 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:22.177440 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-05f4fefe-6cfc-44f0-ab73-6ca4b1b9d121 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:22.203049 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-05f4fefe-6cfc-44f0-ab73-6ca4b1b9d121 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1539 microversion: 2.91 time: 0.326820 Sep 16 12:51:22.203800 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 737/1504] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:21 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1539 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:22.269165 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-33a324af-1d6d-4bad-aea9-dff8528c00c9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:22.280046 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-33a324af-1d6d-4bad-aea9-dff8528c00c9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:22.281871 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-33a324af-1d6d-4bad-aea9-dff8528c00c9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:22.283231 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-33a324af-1d6d-4bad-aea9-dff8528c00c9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f" status: 200 len: 1361 microversion: 2.25 time: 0.284144 Sep 16 12:51:22.296897 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 768/1505] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:21 2022] GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f => generated 1361 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:22.667532 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-03c0baf0-d18d-46b5-8b60-bbfe3959255e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:22.668719 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-03c0baf0-d18d-46b5-8b60-bbfe3959255e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:22.686786 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-03c0baf0-d18d-46b5-8b60-bbfe3959255e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:22.688732 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-03c0baf0-d18d-46b5-8b60-bbfe3959255e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:22.689358 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-03c0baf0-d18d-46b5-8b60-bbfe3959255e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:22.690365 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-03c0baf0-d18d-46b5-8b60-bbfe3959255e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:22.691803 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-03c0baf0-d18d-46b5-8b60-bbfe3959255e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:22.692431 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-03c0baf0-d18d-46b5-8b60-bbfe3959255e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:22.969812 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-03c0baf0-d18d-46b5-8b60-bbfe3959255e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:22.982786 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-03c0baf0-d18d-46b5-8b60-bbfe3959255e tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1469 microversion: 2.1 time: 0.318866 Sep 16 12:51:22.983704 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 738/1506] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:22 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1469 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:23.024718 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a2bcfe5a-7eda-4f2e-9f8a-26e54ce56664 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:23.025514 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a2bcfe5a-7eda-4f2e-9f8a-26e54ce56664 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: f9070e88-5408-48ab-9f4b-a74368e8f25e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:23.027501 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:51:23.040233 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2bcfe5a-7eda-4f2e-9f8a-26e54ce56664 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:23.041015 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2bcfe5a-7eda-4f2e-9f8a-26e54ce56664 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:23.041642 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2bcfe5a-7eda-4f2e-9f8a-26e54ce56664 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:23.042594 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2bcfe5a-7eda-4f2e-9f8a-26e54ce56664 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:23.043050 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2bcfe5a-7eda-4f2e-9f8a-26e54ce56664 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:23.043478 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2bcfe5a-7eda-4f2e-9f8a-26e54ce56664 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:23.233757 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-21c95bc7-5af3-4276-a528-eed93eb724d9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:23.234461 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-21c95bc7-5af3-4276-a528-eed93eb724d9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:23.244764 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-21c95bc7-5af3-4276-a528-eed93eb724d9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:23.245195 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-21c95bc7-5af3-4276-a528-eed93eb724d9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:23.249385 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-21c95bc7-5af3-4276-a528-eed93eb724d9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:23.250279 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-21c95bc7-5af3-4276-a528-eed93eb724d9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:23.250773 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-21c95bc7-5af3-4276-a528-eed93eb724d9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:23.251212 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-21c95bc7-5af3-4276-a528-eed93eb724d9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:23.314822 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a2bcfe5a-7eda-4f2e-9f8a-26e54ce56664 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:23.324651 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a2bcfe5a-7eda-4f2e-9f8a-26e54ce56664 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e" status: 200 len: 1308 microversion: 2.1 time: 0.303949 Sep 16 12:51:23.325618 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 769/1507] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:23 2022] GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e => generated 1308 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:23.334163 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2021e791-7ea9-4c2a-b885-ac31003360d6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:23.335026 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2021e791-7ea9-4c2a-b885-ac31003360d6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 041df092-33d4-4b71-84d8-7cd479d32b4f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:23.348236 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2021e791-7ea9-4c2a-b885-ac31003360d6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:23.349016 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2021e791-7ea9-4c2a-b885-ac31003360d6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:23.349673 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2021e791-7ea9-4c2a-b885-ac31003360d6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:23.350560 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2021e791-7ea9-4c2a-b885-ac31003360d6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:23.351199 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2021e791-7ea9-4c2a-b885-ac31003360d6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:23.351786 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2021e791-7ea9-4c2a-b885-ac31003360d6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:23.422940 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-21c95bc7-5af3-4276-a528-eed93eb724d9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:23.432328 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-21c95bc7-5af3-4276-a528-eed93eb724d9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:23.435238 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-21c95bc7-5af3-4276-a528-eed93eb724d9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:23.443454 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-21c95bc7-5af3-4276-a528-eed93eb724d9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1560 microversion: 2.91 time: 0.215154 Sep 16 12:51:23.444857 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 739/1508] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:23 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:51:23.683932 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2021e791-7ea9-4c2a-b885-ac31003360d6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:23.704334 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2021e791-7ea9-4c2a-b885-ac31003360d6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:23.706179 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2021e791-7ea9-4c2a-b885-ac31003360d6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:23.723537 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2021e791-7ea9-4c2a-b885-ac31003360d6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f" status: 200 len: 1361 microversion: 2.25 time: 0.396761 Sep 16 12:51:23.729401 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 770/1509] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:23 2022] GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f => generated 1361 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:24.007262 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b85aa567-7ec8-4d00-b118-fa4da40f412d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:24.008746 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b85aa567-7ec8-4d00-b118-fa4da40f412d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:24.025115 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b85aa567-7ec8-4d00-b118-fa4da40f412d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:24.025624 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b85aa567-7ec8-4d00-b118-fa4da40f412d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:24.026067 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b85aa567-7ec8-4d00-b118-fa4da40f412d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:24.026793 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b85aa567-7ec8-4d00-b118-fa4da40f412d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:24.034177 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b85aa567-7ec8-4d00-b118-fa4da40f412d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:24.034932 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b85aa567-7ec8-4d00-b118-fa4da40f412d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:24.347919 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b3413c5a-70d7-4e7c-9017-975f69aecda1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:24.348713 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b3413c5a-70d7-4e7c-9017-975f69aecda1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: f9070e88-5408-48ab-9f4b-a74368e8f25e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:24.360786 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3413c5a-70d7-4e7c-9017-975f69aecda1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:24.361451 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3413c5a-70d7-4e7c-9017-975f69aecda1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:24.361897 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3413c5a-70d7-4e7c-9017-975f69aecda1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:24.362663 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3413c5a-70d7-4e7c-9017-975f69aecda1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:24.363073 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3413c5a-70d7-4e7c-9017-975f69aecda1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:24.363499 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3413c5a-70d7-4e7c-9017-975f69aecda1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:24.446937 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-b85aa567-7ec8-4d00-b118-fa4da40f412d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:24.460759 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b85aa567-7ec8-4d00-b118-fa4da40f412d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1469 microversion: 2.1 time: 0.453033 Sep 16 12:51:24.473762 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 740/1510] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:24 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1469 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:24.473762 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7aac3aca-a826-4420-a248-b11bf001083d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:24.473762 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7aac3aca-a826-4420-a248-b11bf001083d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:24.496521 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7aac3aca-a826-4420-a248-b11bf001083d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:24.498222 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7aac3aca-a826-4420-a248-b11bf001083d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:24.499204 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7aac3aca-a826-4420-a248-b11bf001083d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:24.513332 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7aac3aca-a826-4420-a248-b11bf001083d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:24.514093 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7aac3aca-a826-4420-a248-b11bf001083d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:24.514544 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7aac3aca-a826-4420-a248-b11bf001083d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:24.671998 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7aac3aca-a826-4420-a248-b11bf001083d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:24.677278 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b3413c5a-70d7-4e7c-9017-975f69aecda1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:24.686087 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7aac3aca-a826-4420-a248-b11bf001083d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:24.687548 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b3413c5a-70d7-4e7c-9017-975f69aecda1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e" status: 200 len: 1308 microversion: 2.1 time: 0.343440 Sep 16 12:51:24.689731 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7aac3aca-a826-4420-a248-b11bf001083d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:24.691369 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 771/1511] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:24 2022] GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e => generated 1308 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:51:24.711692 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7aac3aca-a826-4420-a248-b11bf001083d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1555 microversion: 2.91 time: 0.243252 Sep 16 12:51:24.734095 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 741/1512] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:24 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1555 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:51:24.757957 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a71d2305-cc8e-4d13-b53d-1d4bc96bd1c3 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:24.758586 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a71d2305-cc8e-4d13-b53d-1d4bc96bd1c3 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 041df092-33d4-4b71-84d8-7cd479d32b4f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:24.772845 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a71d2305-cc8e-4d13-b53d-1d4bc96bd1c3 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:24.773434 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a71d2305-cc8e-4d13-b53d-1d4bc96bd1c3 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:24.777653 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a71d2305-cc8e-4d13-b53d-1d4bc96bd1c3 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:24.778568 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a71d2305-cc8e-4d13-b53d-1d4bc96bd1c3 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:24.779067 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a71d2305-cc8e-4d13-b53d-1d4bc96bd1c3 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:24.788424 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a71d2305-cc8e-4d13-b53d-1d4bc96bd1c3 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:24.839984 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:51:25.109144 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a71d2305-cc8e-4d13-b53d-1d4bc96bd1c3 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:25.118212 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a71d2305-cc8e-4d13-b53d-1d4bc96bd1c3 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:25.119663 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a71d2305-cc8e-4d13-b53d-1d4bc96bd1c3 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:25.124057 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a71d2305-cc8e-4d13-b53d-1d4bc96bd1c3 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f" status: 200 len: 1361 microversion: 2.25 time: 0.370802 Sep 16 12:51:25.136180 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 772/1513] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:24 2022] GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f => generated 1361 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:25.490153 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-bfc0c621-edef-41c5-8939-1222508927aa tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:25.490778 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-bfc0c621-edef-41c5-8939-1222508927aa tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:25.498117 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=8 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:51:25.517543 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bfc0c621-edef-41c5-8939-1222508927aa tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:25.519590 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bfc0c621-edef-41c5-8939-1222508927aa tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:25.521071 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bfc0c621-edef-41c5-8939-1222508927aa tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:25.523219 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bfc0c621-edef-41c5-8939-1222508927aa tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:25.524589 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bfc0c621-edef-41c5-8939-1222508927aa tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:25.525767 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bfc0c621-edef-41c5-8939-1222508927aa tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:25.720531 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d5cf25b3-70e1-462c-8840-7329229bdb66 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:25.721857 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d5cf25b3-70e1-462c-8840-7329229bdb66 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: f9070e88-5408-48ab-9f4b-a74368e8f25e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:25.731377 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5cf25b3-70e1-462c-8840-7329229bdb66 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:25.738078 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5cf25b3-70e1-462c-8840-7329229bdb66 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:25.739017 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5cf25b3-70e1-462c-8840-7329229bdb66 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:25.740593 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5cf25b3-70e1-462c-8840-7329229bdb66 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:25.742574 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5cf25b3-70e1-462c-8840-7329229bdb66 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:25.745577 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5cf25b3-70e1-462c-8840-7329229bdb66 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:26.219507 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d5cf25b3-70e1-462c-8840-7329229bdb66 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:26.237297 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d5cf25b3-70e1-462c-8840-7329229bdb66 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e" status: 200 len: 1308 microversion: 2.1 time: 0.523064 Sep 16 12:51:26.260822 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 773/1514] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:25 2022] GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e => generated 1308 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:26.274736 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d210c4eb-b121-4cf5-9b6a-ba833e106dc2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:26.276664 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d210c4eb-b121-4cf5-9b6a-ba833e106dc2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:26.295586 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d210c4eb-b121-4cf5-9b6a-ba833e106dc2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:26.296585 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d210c4eb-b121-4cf5-9b6a-ba833e106dc2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:26.298438 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d210c4eb-b121-4cf5-9b6a-ba833e106dc2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:26.305992 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d210c4eb-b121-4cf5-9b6a-ba833e106dc2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:26.309172 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d210c4eb-b121-4cf5-9b6a-ba833e106dc2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:26.310393 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d210c4eb-b121-4cf5-9b6a-ba833e106dc2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:26.316519 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-bfc0c621-edef-41c5-8939-1222508927aa tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:26.325419 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-bfc0c621-edef-41c5-8939-1222508927aa tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1469 microversion: 2.1 time: 0.841501 Sep 16 12:51:26.328965 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 742/1515] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:25 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1469 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:51:26.355192 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a6a59a8a-4071-4dd2-9b8b-ac63d95816fc tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:26.356816 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a6a59a8a-4071-4dd2-9b8b-ac63d95816fc tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 041df092-33d4-4b71-84d8-7cd479d32b4f] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:26.380449 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a6a59a8a-4071-4dd2-9b8b-ac63d95816fc tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:26.381320 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a6a59a8a-4071-4dd2-9b8b-ac63d95816fc tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:26.389695 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a6a59a8a-4071-4dd2-9b8b-ac63d95816fc tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:26.390822 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a6a59a8a-4071-4dd2-9b8b-ac63d95816fc tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:26.391515 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a6a59a8a-4071-4dd2-9b8b-ac63d95816fc tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:26.392564 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a6a59a8a-4071-4dd2-9b8b-ac63d95816fc tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:26.828980 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d210c4eb-b121-4cf5-9b6a-ba833e106dc2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:26.838274 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d210c4eb-b121-4cf5-9b6a-ba833e106dc2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:26.839761 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d210c4eb-b121-4cf5-9b6a-ba833e106dc2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:26.856606 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d210c4eb-b121-4cf5-9b6a-ba833e106dc2 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1555 microversion: 2.91 time: 0.589901 Sep 16 12:51:26.857534 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 774/1516] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:26 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1555 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:27.007932 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a6a59a8a-4071-4dd2-9b8b-ac63d95816fc tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:27.086816 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a6a59a8a-4071-4dd2-9b8b-ac63d95816fc tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:27.094653 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a6a59a8a-4071-4dd2-9b8b-ac63d95816fc tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:27.110155 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a6a59a8a-4071-4dd2-9b8b-ac63d95816fc tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f" status: 200 len: 1361 microversion: 2.25 time: 0.774162 Sep 16 12:51:27.147587 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 743/1517] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:26 2022] GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f => generated 1361 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:27.266723 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2a04edae-fc67-4064-bf80-cc116b11675b tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:27.267330 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2a04edae-fc67-4064-bf80-cc116b11675b tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: f9070e88-5408-48ab-9f4b-a74368e8f25e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:27.280657 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a04edae-fc67-4064-bf80-cc116b11675b tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:27.282288 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a04edae-fc67-4064-bf80-cc116b11675b tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:27.282853 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a04edae-fc67-4064-bf80-cc116b11675b tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:27.284007 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a04edae-fc67-4064-bf80-cc116b11675b tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:27.284815 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a04edae-fc67-4064-bf80-cc116b11675b tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:27.285752 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a04edae-fc67-4064-bf80-cc116b11675b tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:27.361551 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2c74d264-0877-45b1-bd4f-a337addb85ca tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:27.369861 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-2c74d264-0877-45b1-bd4f-a337addb85ca tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:27.382894 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c74d264-0877-45b1-bd4f-a337addb85ca tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:27.383946 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c74d264-0877-45b1-bd4f-a337addb85ca tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:27.384679 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c74d264-0877-45b1-bd4f-a337addb85ca tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:27.385921 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c74d264-0877-45b1-bd4f-a337addb85ca tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:27.396807 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c74d264-0877-45b1-bd4f-a337addb85ca tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:27.397817 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c74d264-0877-45b1-bd4f-a337addb85ca tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:27.709542 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2a04edae-fc67-4064-bf80-cc116b11675b tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:27.733606 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2a04edae-fc67-4064-bf80-cc116b11675b tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e" status: 200 len: 1308 microversion: 2.1 time: 0.472604 Sep 16 12:51:27.737330 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 775/1518] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:27 2022] GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e => generated 1308 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:27.898097 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3104df75-4773-4786-8ac2-65d7340c0a15 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:27.903783 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3104df75-4773-4786-8ac2-65d7340c0a15 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:27.917722 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3104df75-4773-4786-8ac2-65d7340c0a15 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:27.924880 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3104df75-4773-4786-8ac2-65d7340c0a15 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:27.926813 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3104df75-4773-4786-8ac2-65d7340c0a15 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:27.927959 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3104df75-4773-4786-8ac2-65d7340c0a15 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:27.929024 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3104df75-4773-4786-8ac2-65d7340c0a15 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:27.931701 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3104df75-4773-4786-8ac2-65d7340c0a15 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:28.048576 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-2c74d264-0877-45b1-bd4f-a337addb85ca tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:28.062314 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2c74d264-0877-45b1-bd4f-a337addb85ca tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1469 microversion: 2.1 time: 0.709465 Sep 16 12:51:28.064055 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 744/1519] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:27 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1469 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:51:28.079806 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e7c4a2bf-3aa6-454e-8e6c-f35fa90e4ae9 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:28.086427 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e7c4a2bf-3aa6-454e-8e6c-f35fa90e4ae9 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:28.123895 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e7c4a2bf-3aa6-454e-8e6c-f35fa90e4ae9 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:28.125983 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e7c4a2bf-3aa6-454e-8e6c-f35fa90e4ae9 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:28.127822 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e7c4a2bf-3aa6-454e-8e6c-f35fa90e4ae9 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:28.128873 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e7c4a2bf-3aa6-454e-8e6c-f35fa90e4ae9 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:28.132510 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e7c4a2bf-3aa6-454e-8e6c-f35fa90e4ae9 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:28.133305 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e7c4a2bf-3aa6-454e-8e6c-f35fa90e4ae9 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:28.138294 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=19 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:51:28.243303 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e7c4a2bf-3aa6-454e-8e6c-f35fa90e4ae9 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.177811 Sep 16 12:51:28.247374 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 745/1520] 10.222.0.67 () {58 vars in 1302 bytes} [Fri Sep 16 12:51:28 2022] GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:51:28.258999 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-07fb6dec-f31d-40ac-8f21-5d71843fdc63 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:28.267935 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-07fb6dec-f31d-40ac-8f21-5d71843fdc63 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 041df092-33d4-4b71-84d8-7cd479d32b4f] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:28.291769 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-07fb6dec-f31d-40ac-8f21-5d71843fdc63 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:28.292909 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-07fb6dec-f31d-40ac-8f21-5d71843fdc63 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:28.293698 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-07fb6dec-f31d-40ac-8f21-5d71843fdc63 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:28.294813 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3104df75-4773-4786-8ac2-65d7340c0a15 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:28.301385 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-07fb6dec-f31d-40ac-8f21-5d71843fdc63 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:28.302302 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-07fb6dec-f31d-40ac-8f21-5d71843fdc63 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:28.303310 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-07fb6dec-f31d-40ac-8f21-5d71843fdc63 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:28.318604 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3104df75-4773-4786-8ac2-65d7340c0a15 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:28.327692 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3104df75-4773-4786-8ac2-65d7340c0a15 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:28.343689 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3104df75-4773-4786-8ac2-65d7340c0a15 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1555 microversion: 2.91 time: 0.453511 Sep 16 12:51:28.346133 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 776/1521] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:27 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1555 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:28.361492 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-19de9698-9982-445d-ab63-d02afe7aae63 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:28.369234 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-19de9698-9982-445d-ab63-d02afe7aae63 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:28.394169 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19de9698-9982-445d-ab63-d02afe7aae63 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:28.394927 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19de9698-9982-445d-ab63-d02afe7aae63 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:28.397396 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19de9698-9982-445d-ab63-d02afe7aae63 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:28.400073 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19de9698-9982-445d-ab63-d02afe7aae63 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:28.400580 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19de9698-9982-445d-ab63-d02afe7aae63 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:28.401013 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19de9698-9982-445d-ab63-d02afe7aae63 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:28.765894 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-19de9698-9982-445d-ab63-d02afe7aae63 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lazy-loading 'services' on Instance uuid d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:51:29.008946 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-19de9698-9982-445d-ab63-d02afe7aae63 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0/os-volume_attachments/b86207a8-8431-4f52-b974-002c93dc6c21" status: 202 len: 0 microversion: 2.1 time: 0.659964 Sep 16 12:51:29.010643 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 777/1522] 10.222.0.67 () {58 vars in 1416 bytes} [Fri Sep 16 12:51:28 2022] DELETE /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0/os-volume_attachments/b86207a8-8431-4f52-b974-002c93dc6c21 => generated 0 bytes in 662 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:51:29.038181 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-af31395c-8a70-47df-b6f5-290e37f53cbc tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:29.049038 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-af31395c-8a70-47df-b6f5-290e37f53cbc tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: f9070e88-5408-48ab-9f4b-a74368e8f25e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:29.069404 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af31395c-8a70-47df-b6f5-290e37f53cbc tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:29.074127 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af31395c-8a70-47df-b6f5-290e37f53cbc tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:29.077036 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af31395c-8a70-47df-b6f5-290e37f53cbc tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:29.081075 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af31395c-8a70-47df-b6f5-290e37f53cbc tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:29.082439 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af31395c-8a70-47df-b6f5-290e37f53cbc tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:29.083108 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af31395c-8a70-47df-b6f5-290e37f53cbc tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:29.520925 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-07fb6dec-f31d-40ac-8f21-5d71843fdc63 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:29.536644 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-07fb6dec-f31d-40ac-8f21-5d71843fdc63 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:29.538025 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-07fb6dec-f31d-40ac-8f21-5d71843fdc63 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:29.539189 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-07fb6dec-f31d-40ac-8f21-5d71843fdc63 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f" status: 200 len: 1361 microversion: 2.25 time: 1.290718 Sep 16 12:51:29.564873 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 746/1523] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:28 2022] GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f => generated 1361 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:29.576213 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-060549a8-5e78-45e4-b27a-0d91d063c3ac tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:29.576852 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-060549a8-5e78-45e4-b27a-0d91d063c3ac tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:29.596793 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-060549a8-5e78-45e4-b27a-0d91d063c3ac tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:29.597296 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-060549a8-5e78-45e4-b27a-0d91d063c3ac tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:29.597733 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-060549a8-5e78-45e4-b27a-0d91d063c3ac tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:29.600034 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-060549a8-5e78-45e4-b27a-0d91d063c3ac tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:29.600483 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-060549a8-5e78-45e4-b27a-0d91d063c3ac tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:29.600914 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-060549a8-5e78-45e4-b27a-0d91d063c3ac tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:29.646217 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-af31395c-8a70-47df-b6f5-290e37f53cbc tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:29.661020 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-af31395c-8a70-47df-b6f5-290e37f53cbc tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e" status: 200 len: 1308 microversion: 2.1 time: 0.648815 Sep 16 12:51:29.666920 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 778/1524] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:29 2022] GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e => generated 1308 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:29.689409 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3d315ec0-12e5-4cfb-ba63-2b8470289135 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:29.690236 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3d315ec0-12e5-4cfb-ba63-2b8470289135 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:29.715964 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d315ec0-12e5-4cfb-ba63-2b8470289135 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:29.716695 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d315ec0-12e5-4cfb-ba63-2b8470289135 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:29.717303 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d315ec0-12e5-4cfb-ba63-2b8470289135 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:29.718205 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d315ec0-12e5-4cfb-ba63-2b8470289135 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:29.718815 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d315ec0-12e5-4cfb-ba63-2b8470289135 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:29.719521 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d315ec0-12e5-4cfb-ba63-2b8470289135 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:29.949343 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3d315ec0-12e5-4cfb-ba63-2b8470289135 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:29.964676 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3d315ec0-12e5-4cfb-ba63-2b8470289135 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:29.967219 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3d315ec0-12e5-4cfb-ba63-2b8470289135 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:29.981852 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3d315ec0-12e5-4cfb-ba63-2b8470289135 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1555 microversion: 2.91 time: 0.312310 Sep 16 12:51:29.997857 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 779/1525] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:29 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1555 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:30.015417 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-2f931f19-49d8-4d63-b510-c4e43ee53d39 req-8a7df0c3-5404-4183-bf1c-9f63d336e54a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a439c4ea-46f5-4571-9d87-96a91a6359f7", "name": "network-vif-unplugged", "status": "completed", "tag": "76e2deeb-80ac-4c0d-98b8-96091a5ab0d2"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:51:30.039638 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2f931f19-49d8-4d63-b510-c4e43ee53d39 req-8a7df0c3-5404-4183-bf1c-9f63d336e54a service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:30.042597 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2f931f19-49d8-4d63-b510-c4e43ee53d39 req-8a7df0c3-5404-4183-bf1c-9f63d336e54a service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:30.045199 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2f931f19-49d8-4d63-b510-c4e43ee53d39 req-8a7df0c3-5404-4183-bf1c-9f63d336e54a service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:30.076341 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-2f931f19-49d8-4d63-b510-c4e43ee53d39 req-8a7df0c3-5404-4183-bf1c-9f63d336e54a service nova] Creating event network-vif-unplugged:76e2deeb-80ac-4c0d-98b8-96091a5ab0d2 for instance a439c4ea-46f5-4571-9d87-96a91a6359f7 on n-h2-858094-4 Sep 16 12:51:30.089989 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [req-2f931f19-49d8-4d63-b510-c4e43ee53d39 req-8a7df0c3-5404-4183-bf1c-9f63d336e54a service nova] Instance a439c4ea-46f5-4571-9d87-96a91a6359f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858094-4', 'n-h2-858094-4'} {{(pid=128779) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 12:51:30.121019 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-2f931f19-49d8-4d63-b510-c4e43ee53d39 req-8a7df0c3-5404-4183-bf1c-9f63d336e54a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112650 Sep 16 12:51:30.125747 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 780/1526] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:51:30.247049 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-1e99b575-0019-4ce8-bba1-e46538e916e7 req-3c785d26-e769-44da-b536-bde79a718dbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "041df092-33d4-4b71-84d8-7cd479d32b4f", "name": "network-vif-plugged", "status": "completed", "tag": "756cd197-6a93-4b4a-b498-7ebcbb3246c2"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:51:30.281388 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1e99b575-0019-4ce8-bba1-e46538e916e7 req-3c785d26-e769-44da-b536-bde79a718dbb service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:30.283973 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1e99b575-0019-4ce8-bba1-e46538e916e7 req-3c785d26-e769-44da-b536-bde79a718dbb service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:30.284605 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1e99b575-0019-4ce8-bba1-e46538e916e7 req-3c785d26-e769-44da-b536-bde79a718dbb service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:30.313361 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-1e99b575-0019-4ce8-bba1-e46538e916e7 req-3c785d26-e769-44da-b536-bde79a718dbb service nova] Creating event network-vif-plugged:756cd197-6a93-4b4a-b498-7ebcbb3246c2 for instance 041df092-33d4-4b71-84d8-7cd479d32b4f on n-h2-858094-4 Sep 16 12:51:30.325469 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-1e99b575-0019-4ce8-bba1-e46538e916e7 req-3c785d26-e769-44da-b536-bde79a718dbb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085493 Sep 16 12:51:30.332363 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 781/1527] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:51:30.421199 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-060549a8-5e78-45e4-b27a-0d91d063c3ac tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:30.438973 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-060549a8-5e78-45e4-b27a-0d91d063c3ac tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1535 microversion: 2.1 time: 0.872772 Sep 16 12:51:30.447580 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 747/1528] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:29 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1535 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:30.571953 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4ada15a9-df2d-4865-9b0a-1acffc9b10ac tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:30.575408 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4ada15a9-df2d-4865-9b0a-1acffc9b10ac tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 041df092-33d4-4b71-84d8-7cd479d32b4f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:30.589431 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ada15a9-df2d-4865-9b0a-1acffc9b10ac tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:30.591454 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ada15a9-df2d-4865-9b0a-1acffc9b10ac tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:30.592530 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ada15a9-df2d-4865-9b0a-1acffc9b10ac tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:30.596923 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ada15a9-df2d-4865-9b0a-1acffc9b10ac tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:30.610514 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ada15a9-df2d-4865-9b0a-1acffc9b10ac tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:30.611259 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ada15a9-df2d-4865-9b0a-1acffc9b10ac tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:30.694997 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-646e8ba5-c622-4c24-8b0c-c3b87191f231 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:30.696037 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-646e8ba5-c622-4c24-8b0c-c3b87191f231 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: f9070e88-5408-48ab-9f4b-a74368e8f25e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:30.714862 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-646e8ba5-c622-4c24-8b0c-c3b87191f231 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:30.715626 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-646e8ba5-c622-4c24-8b0c-c3b87191f231 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:30.716358 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-646e8ba5-c622-4c24-8b0c-c3b87191f231 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:30.717196 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-646e8ba5-c622-4c24-8b0c-c3b87191f231 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:30.720171 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-646e8ba5-c622-4c24-8b0c-c3b87191f231 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:30.721405 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-646e8ba5-c622-4c24-8b0c-c3b87191f231 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:31.499390 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4ada15a9-df2d-4865-9b0a-1acffc9b10ac tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:31.511065 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4ada15a9-df2d-4865-9b0a-1acffc9b10ac tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:31.519330 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-646e8ba5-c622-4c24-8b0c-c3b87191f231 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:31.524943 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4ada15a9-df2d-4865-9b0a-1acffc9b10ac tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:31.531532 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-646e8ba5-c622-4c24-8b0c-c3b87191f231 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e" status: 200 len: 1308 microversion: 2.1 time: 0.840315 Sep 16 12:51:31.535179 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4ada15a9-df2d-4865-9b0a-1acffc9b10ac tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f" status: 200 len: 1361 microversion: 2.25 time: 0.967599 Sep 16 12:51:31.552251 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 748/1529] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:30 2022] GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e => generated 1308 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:31.554798 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 782/1530] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:30 2022] GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f => generated 1361 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:31.557778 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-84b204a7-2022-49a7-8379-5d0adb0ea479 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:31.558517 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-84b204a7-2022-49a7-8379-5d0adb0ea479 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:31.597900 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:51:31.603115 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-84b204a7-2022-49a7-8379-5d0adb0ea479 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:31.612681 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-84b204a7-2022-49a7-8379-5d0adb0ea479 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:31.615497 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-84b204a7-2022-49a7-8379-5d0adb0ea479 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:31.616345 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-84b204a7-2022-49a7-8379-5d0adb0ea479 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:31.616826 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-84b204a7-2022-49a7-8379-5d0adb0ea479 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:31.617272 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-84b204a7-2022-49a7-8379-5d0adb0ea479 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:32.160295 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-84b204a7-2022-49a7-8379-5d0adb0ea479 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1857 microversion: 2.1 time: 0.617629 Sep 16 12:51:32.167200 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 749/1531] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:31 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1857 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:32.178920 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8c9e8195-dff3-4a7b-8a1d-382a8cf09ec4 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:32.191343 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8c9e8195-dff3-4a7b-8a1d-382a8cf09ec4 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:32.213439 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8c9e8195-dff3-4a7b-8a1d-382a8cf09ec4 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:32.224107 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8c9e8195-dff3-4a7b-8a1d-382a8cf09ec4 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:32.224838 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8c9e8195-dff3-4a7b-8a1d-382a8cf09ec4 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:32.225792 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8c9e8195-dff3-4a7b-8a1d-382a8cf09ec4 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:32.226448 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8c9e8195-dff3-4a7b-8a1d-382a8cf09ec4 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:32.227277 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8c9e8195-dff3-4a7b-8a1d-382a8cf09ec4 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:32.440252 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8c9e8195-dff3-4a7b-8a1d-382a8cf09ec4 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:32.456525 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8c9e8195-dff3-4a7b-8a1d-382a8cf09ec4 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:32.458608 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8c9e8195-dff3-4a7b-8a1d-382a8cf09ec4 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:32.466476 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8c9e8195-dff3-4a7b-8a1d-382a8cf09ec4 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1555 microversion: 2.91 time: 0.296512 Sep 16 12:51:32.475112 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3dee76df-e3fe-434a-b8d7-a858246197ed tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-600865556", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": [{"uuid": "efc98046-384c-40f8-9e52-6d3af932ac27"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:51:32.492819 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 750/1532] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:32 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1555 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:32.517633 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-536fc4e9-cfdf-451d-9757-26ec6b4d9e17 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:32.523019 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-536fc4e9-cfdf-451d-9757-26ec6b4d9e17 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:32.544507 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-536fc4e9-cfdf-451d-9757-26ec6b4d9e17 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:32.547691 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-536fc4e9-cfdf-451d-9757-26ec6b4d9e17 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:32.549556 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-536fc4e9-cfdf-451d-9757-26ec6b4d9e17 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:32.554229 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-536fc4e9-cfdf-451d-9757-26ec6b4d9e17 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:32.555328 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-536fc4e9-cfdf-451d-9757-26ec6b4d9e17 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:32.557407 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-536fc4e9-cfdf-451d-9757-26ec6b4d9e17 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:32.615573 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=100 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:51:32.671237 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-3dee76df-e3fe-434a-b8d7-a858246197ed tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] validate_networks() for [('efc98046-384c-40f8-9e52-6d3af932ac27', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:51:33.058992 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-536fc4e9-cfdf-451d-9757-26ec6b4d9e17 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:33.070206 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-536fc4e9-cfdf-451d-9757-26ec6b4d9e17 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1535 microversion: 2.1 time: 0.569112 Sep 16 12:51:33.089688 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 751/1533] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:32 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1535 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:33.117067 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c2d716e4-136c-4415-bb48-693dad2d6f80 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858094-4", "block_migration": true, "disk_over_commit": false}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:51:33.133556 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c2d716e4-136c-4415-bb48-693dad2d6f80 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:33.148734 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c2d716e4-136c-4415-bb48-693dad2d6f80 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:33.149431 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c2d716e4-136c-4415-bb48-693dad2d6f80 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:33.150028 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c2d716e4-136c-4415-bb48-693dad2d6f80 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:33.151280 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c2d716e4-136c-4415-bb48-693dad2d6f80 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:33.151999 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c2d716e4-136c-4415-bb48-693dad2d6f80 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:33.153205 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c2d716e4-136c-4415-bb48-693dad2d6f80 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:33.210077 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-c2d716e4-136c-4415-bb48-693dad2d6f80 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lazy-loading 'flavor' on Instance uuid 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:51:33.229497 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c2d716e4-136c-4415-bb48-693dad2d6f80 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Going to try to live migrate instance to n-h2-858094-4 {{(pid=128780) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 16 12:51:33.850883 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-3dee76df-e3fe-434a-b8d7-a858246197ed tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:51:33.852022 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-3dee76df-e3fe-434a-b8d7-a858246197ed tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:51:33.852989 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-3dee76df-e3fe-434a-b8d7-a858246197ed tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:51:33.853627 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-3dee76df-e3fe-434a-b8d7-a858246197ed tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:51:33.854244 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-3dee76df-e3fe-434a-b8d7-a858246197ed tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:51:33.865988 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3dee76df-e3fe-434a-b8d7-a858246197ed tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:33.866834 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3dee76df-e3fe-434a-b8d7-a858246197ed tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:33.867481 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3dee76df-e3fe-434a-b8d7-a858246197ed tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:33.868547 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3dee76df-e3fe-434a-b8d7-a858246197ed tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:33.869330 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3dee76df-e3fe-434a-b8d7-a858246197ed tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:33.869970 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3dee76df-e3fe-434a-b8d7-a858246197ed tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:33.891513 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-3dee76df-e3fe-434a-b8d7-a858246197ed tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Getting quotas for project 034ef732e4504d05a4d5d0eea122165e. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:51:33.898034 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-3dee76df-e3fe-434a-b8d7-a858246197ed tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Getting quotas for user 3ef3656188f245d2a41252cee95b2064 and project 034ef732e4504d05a4d5d0eea122165e. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:51:33.913183 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3dee76df-e3fe-434a-b8d7-a858246197ed tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:51:33.915598 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3dee76df-e3fe-434a-b8d7-a858246197ed tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] [instance: a4906950-755b-4838-b954-fb07189747f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:51:34.069010 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3dee76df-e3fe-434a-b8d7-a858246197ed tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.508225 Sep 16 12:51:34.071255 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 783/1534] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:51:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:51:34.098581 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-070cee93-9efa-44fe-9786-a593e92e125f req-05dafd35-be78-4dc9-b2d2-a2ff3b8deaea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9070e88-5408-48ab-9f4b-a74368e8f25e", "name": "network-vif-plugged", "status": "completed", "tag": "093f17ab-8dc0-46d4-846c-da7b4807bf31"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:51:34.113398 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-070cee93-9efa-44fe-9786-a593e92e125f req-05dafd35-be78-4dc9-b2d2-a2ff3b8deaea service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:34.113949 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-070cee93-9efa-44fe-9786-a593e92e125f req-05dafd35-be78-4dc9-b2d2-a2ff3b8deaea service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:34.114520 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-070cee93-9efa-44fe-9786-a593e92e125f req-05dafd35-be78-4dc9-b2d2-a2ff3b8deaea service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:34.171598 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-070cee93-9efa-44fe-9786-a593e92e125f req-05dafd35-be78-4dc9-b2d2-a2ff3b8deaea service nova] Creating event network-vif-plugged:093f17ab-8dc0-46d4-846c-da7b4807bf31 for instance f9070e88-5408-48ab-9f4b-a74368e8f25e on n-h1-858094-4 Sep 16 12:51:34.191952 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-070cee93-9efa-44fe-9786-a593e92e125f req-05dafd35-be78-4dc9-b2d2-a2ff3b8deaea service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119200 Sep 16 12:51:34.197700 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 784/1535] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:51:34.207823 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-20418f76-4397-4634-8c48-0044dc0bb99e req-dac2d670-7704-4ffb-981b-65423bc777c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a439c4ea-46f5-4571-9d87-96a91a6359f7", "tag": "76e2deeb-80ac-4c0d-98b8-96091a5ab0d2"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:51:34.224239 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-20418f76-4397-4634-8c48-0044dc0bb99e req-dac2d670-7704-4ffb-981b-65423bc777c8 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:34.225087 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-20418f76-4397-4634-8c48-0044dc0bb99e req-dac2d670-7704-4ffb-981b-65423bc777c8 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:34.225738 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-20418f76-4397-4634-8c48-0044dc0bb99e req-dac2d670-7704-4ffb-981b-65423bc777c8 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:34.240861 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-20418f76-4397-4634-8c48-0044dc0bb99e req-dac2d670-7704-4ffb-981b-65423bc777c8 service nova] Creating event network-changed:76e2deeb-80ac-4c0d-98b8-96091a5ab0d2 for instance a439c4ea-46f5-4571-9d87-96a91a6359f7 on n-h2-858094-4 Sep 16 12:51:34.261187 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [req-20418f76-4397-4634-8c48-0044dc0bb99e req-dac2d670-7704-4ffb-981b-65423bc777c8 service nova] Instance a439c4ea-46f5-4571-9d87-96a91a6359f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858094-4', 'n-h2-858094-4'} {{(pid=128779) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 12:51:34.281018 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-20418f76-4397-4634-8c48-0044dc0bb99e req-dac2d670-7704-4ffb-981b-65423bc777c8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081617 Sep 16 12:51:34.282537 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 785/1536] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:51:34.290461 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c76a610c-4b73-49ae-850b-b94cf27470e6 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:34.291499 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c76a610c-4b73-49ae-850b-b94cf27470e6 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: f9070e88-5408-48ab-9f4b-a74368e8f25e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:34.305027 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c76a610c-4b73-49ae-850b-b94cf27470e6 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:34.305847 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c76a610c-4b73-49ae-850b-b94cf27470e6 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:34.306777 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c76a610c-4b73-49ae-850b-b94cf27470e6 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:34.310889 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c76a610c-4b73-49ae-850b-b94cf27470e6 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:34.311630 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c76a610c-4b73-49ae-850b-b94cf27470e6 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:34.312779 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c76a610c-4b73-49ae-850b-b94cf27470e6 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:35.676085 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c76a610c-4b73-49ae-850b-b94cf27470e6 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:35.692789 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c76a610c-4b73-49ae-850b-b94cf27470e6 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e" status: 200 len: 1308 microversion: 2.1 time: 1.408468 Sep 16 12:51:35.693641 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 786/1537] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:34 2022] GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e => generated 1308 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:35.718827 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-206e7bc8-29f4-4e35-8a63-83a419ef22c0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:35.719770 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-206e7bc8-29f4-4e35-8a63-83a419ef22c0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 041df092-33d4-4b71-84d8-7cd479d32b4f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:35.734378 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-206e7bc8-29f4-4e35-8a63-83a419ef22c0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:35.736626 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-206e7bc8-29f4-4e35-8a63-83a419ef22c0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:35.739454 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-206e7bc8-29f4-4e35-8a63-83a419ef22c0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:35.741913 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-206e7bc8-29f4-4e35-8a63-83a419ef22c0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:35.742567 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-206e7bc8-29f4-4e35-8a63-83a419ef22c0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:35.743184 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-206e7bc8-29f4-4e35-8a63-83a419ef22c0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:36.426289 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-206e7bc8-29f4-4e35-8a63-83a419ef22c0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:36.445399 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-206e7bc8-29f4-4e35-8a63-83a419ef22c0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:36.450172 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-206e7bc8-29f4-4e35-8a63-83a419ef22c0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:36.453874 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-206e7bc8-29f4-4e35-8a63-83a419ef22c0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f" status: 200 len: 1557 microversion: 2.25 time: 0.759062 Sep 16 12:51:36.457705 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 787/1538] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:35 2022] GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f => generated 1557 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:36.468100 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b29b893f-ce34-4fe7-ad2f-06970395ae07 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:36.469532 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b29b893f-ce34-4fe7-ad2f-06970395ae07 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:36.481464 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b29b893f-ce34-4fe7-ad2f-06970395ae07 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:36.487159 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b29b893f-ce34-4fe7-ad2f-06970395ae07 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:36.489788 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b29b893f-ce34-4fe7-ad2f-06970395ae07 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:36.490876 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b29b893f-ce34-4fe7-ad2f-06970395ae07 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:36.492752 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b29b893f-ce34-4fe7-ad2f-06970395ae07 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:36.497927 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b29b893f-ce34-4fe7-ad2f-06970395ae07 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:36.838343 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b29b893f-ce34-4fe7-ad2f-06970395ae07 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:36.853579 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b29b893f-ce34-4fe7-ad2f-06970395ae07 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:36.857652 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b29b893f-ce34-4fe7-ad2f-06970395ae07 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:36.891795 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b29b893f-ce34-4fe7-ad2f-06970395ae07 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1555 microversion: 2.91 time: 0.419490 Sep 16 12:51:36.915842 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 788/1539] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:36 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1555 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:37.327508 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-be9687f1-0818-4066-82c9-229237621090 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-57773670", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": "none"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:51:37.443377 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c2d716e4-136c-4415-bb48-693dad2d6f80 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16/action" status: 202 len: 0 microversion: 2.1 time: 4.348961 Sep 16 12:51:37.447061 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 752/1540] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:51:33 2022] POST /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16/action => generated 0 bytes in 4353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:51:37.449475 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-05eb7264-6493-402c-8166-1d092370cb66 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:37.450238 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-05eb7264-6493-402c-8166-1d092370cb66 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] [instance: a4906950-755b-4838-b954-fb07189747f3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:37.478337 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-05eb7264-6493-402c-8166-1d092370cb66 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:37.478835 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-05eb7264-6493-402c-8166-1d092370cb66 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:37.479267 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-05eb7264-6493-402c-8166-1d092370cb66 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:37.498017 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-05eb7264-6493-402c-8166-1d092370cb66 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:37.499203 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-05eb7264-6493-402c-8166-1d092370cb66 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:37.501080 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-be9687f1-0818-4066-82c9-229237621090 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:51:37.501805 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-be9687f1-0818-4066-82c9-229237621090 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:51:37.502527 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-be9687f1-0818-4066-82c9-229237621090 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:51:37.503134 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-be9687f1-0818-4066-82c9-229237621090 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:51:37.503687 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-be9687f1-0818-4066-82c9-229237621090 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:51:37.505466 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-05eb7264-6493-402c-8166-1d092370cb66 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:37.533835 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be9687f1-0818-4066-82c9-229237621090 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:37.536597 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be9687f1-0818-4066-82c9-229237621090 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:37.538724 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be9687f1-0818-4066-82c9-229237621090 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:37.542636 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be9687f1-0818-4066-82c9-229237621090 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:37.543906 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be9687f1-0818-4066-82c9-229237621090 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:37.548374 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be9687f1-0818-4066-82c9-229237621090 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:37.654759 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-be9687f1-0818-4066-82c9-229237621090 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Getting quotas for project 2a7566965e424a09bd5488847d1776bd. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:51:37.679206 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-be9687f1-0818-4066-82c9-229237621090 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Getting quotas for user 43c0495684dc4bdeaacca09eadae3b42 and project 2a7566965e424a09bd5488847d1776bd. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:51:37.749594 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-be9687f1-0818-4066-82c9-229237621090 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:51:37.751985 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-be9687f1-0818-4066-82c9-229237621090 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 5f350206-ba9d-427c-8b60-95c2d2f501ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:51:37.819079 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-05eb7264-6493-402c-8166-1d092370cb66 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef3656188f245d2a41252cee95b2064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034ef732e4504d05a4d5d0eea122165e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:37.830434 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-05eb7264-6493-402c-8166-1d092370cb66 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] 10.222.0.67 "GET /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3" status: 200 len: 1289 microversion: 2.1 time: 0.385012 Sep 16 12:51:37.842301 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 753/1541] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:37 2022] GET /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3 => generated 1289 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:37.866264 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8541f3d7-8128-4e30-a346-dd25d005b3b0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:37.872976 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8541f3d7-8128-4e30-a346-dd25d005b3b0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:37.895467 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8541f3d7-8128-4e30-a346-dd25d005b3b0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:37.897508 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8541f3d7-8128-4e30-a346-dd25d005b3b0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:37.898343 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8541f3d7-8128-4e30-a346-dd25d005b3b0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:37.899806 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8541f3d7-8128-4e30-a346-dd25d005b3b0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:37.901831 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8541f3d7-8128-4e30-a346-dd25d005b3b0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:37.903609 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8541f3d7-8128-4e30-a346-dd25d005b3b0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:37.947304 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-be9687f1-0818-4066-82c9-229237621090 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.029771 Sep 16 12:51:37.951558 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 789/1542] 10.222.0.67 () {62 vars in 1188 bytes} [Fri Sep 16 12:51:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1035 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 16 12:51:38.233494 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1379ce1a-84f0-4688-bfc2-a22c4f147cde tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:38.234353 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1379ce1a-84f0-4688-bfc2-a22c4f147cde tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] [instance: 041df092-33d4-4b71-84d8-7cd479d32b4f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:38.249565 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1379ce1a-84f0-4688-bfc2-a22c4f147cde tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:38.250322 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1379ce1a-84f0-4688-bfc2-a22c4f147cde tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:38.251453 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1379ce1a-84f0-4688-bfc2-a22c4f147cde tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:38.254366 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1379ce1a-84f0-4688-bfc2-a22c4f147cde tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:38.255108 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1379ce1a-84f0-4688-bfc2-a22c4f147cde tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:38.256145 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1379ce1a-84f0-4688-bfc2-a22c4f147cde tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:38.438395 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8541f3d7-8128-4e30-a346-dd25d005b3b0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:38.456394 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8541f3d7-8128-4e30-a346-dd25d005b3b0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1528 microversion: 2.1 time: 0.612639 Sep 16 12:51:38.459132 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 754/1543] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:37 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1528 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:38.474113 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b1566b02-bbed-42ba-bdc0-63096a189faa tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:38.475881 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b1566b02-bbed-42ba-bdc0-63096a189faa tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: f9070e88-5408-48ab-9f4b-a74368e8f25e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:38.488872 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b1566b02-bbed-42ba-bdc0-63096a189faa tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:38.489929 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b1566b02-bbed-42ba-bdc0-63096a189faa tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:38.490837 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b1566b02-bbed-42ba-bdc0-63096a189faa tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:38.491779 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b1566b02-bbed-42ba-bdc0-63096a189faa tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:38.492486 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b1566b02-bbed-42ba-bdc0-63096a189faa tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:38.493147 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b1566b02-bbed-42ba-bdc0-63096a189faa tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:38.786489 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-1379ce1a-84f0-4688-bfc2-a22c4f147cde tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lazy-loading 'services' on Instance uuid 041df092-33d4-4b71-84d8-7cd479d32b4f {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:51:38.860021 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-b1566b02-bbed-42ba-bdc0-63096a189faa tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:38.870008 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b1566b02-bbed-42ba-bdc0-63096a189faa tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e" status: 200 len: 1488 microversion: 2.1 time: 0.408961 Sep 16 12:51:38.874767 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 755/1544] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:38 2022] GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e => generated 1488 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:38.885217 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c643e198-b971-43f8-b285-d904e98776fe tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:38.887332 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c643e198-b971-43f8-b285-d904e98776fe tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:38.907075 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c643e198-b971-43f8-b285-d904e98776fe tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:38.908459 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c643e198-b971-43f8-b285-d904e98776fe tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:38.910047 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c643e198-b971-43f8-b285-d904e98776fe tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:38.911141 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c643e198-b971-43f8-b285-d904e98776fe tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:38.913214 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c643e198-b971-43f8-b285-d904e98776fe tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:38.913665 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c643e198-b971-43f8-b285-d904e98776fe tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:38.947464 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1379ce1a-84f0-4688-bfc2-a22c4f147cde tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f" status: 200 len: 2049 microversion: 2.25 time: 0.994323 Sep 16 12:51:38.949764 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 790/1545] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:37 2022] GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f => generated 2049 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:38.961479 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8de640bd-3276-40c7-93b4-9be2e1ec3e44 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:38.962376 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8de640bd-3276-40c7-93b4-9be2e1ec3e44 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:38.976496 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=3,nova_api:INSERT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:51:38.978564 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8de640bd-3276-40c7-93b4-9be2e1ec3e44 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:38.979350 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8de640bd-3276-40c7-93b4-9be2e1ec3e44 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:38.979963 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8de640bd-3276-40c7-93b4-9be2e1ec3e44 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:38.980965 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8de640bd-3276-40c7-93b4-9be2e1ec3e44 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:38.997595 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8de640bd-3276-40c7-93b4-9be2e1ec3e44 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:38.998048 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8de640bd-3276-40c7-93b4-9be2e1ec3e44 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:39.049913 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:51:39.249749 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8de640bd-3276-40c7-93b4-9be2e1ec3e44 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:39.266813 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8de640bd-3276-40c7-93b4-9be2e1ec3e44 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:39.268296 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8de640bd-3276-40c7-93b4-9be2e1ec3e44 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:39.292017 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8de640bd-3276-40c7-93b4-9be2e1ec3e44 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1555 microversion: 2.91 time: 0.338095 Sep 16 12:51:39.296046 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 791/1546] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:38 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1555 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:39.317969 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4fd8bc1e-9f75-41eb-9958-a2315d0059d8 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:39.320862 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4fd8bc1e-9f75-41eb-9958-a2315d0059d8 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 5f350206-ba9d-427c-8b60-95c2d2f501ae] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:39.347439 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fd8bc1e-9f75-41eb-9958-a2315d0059d8 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:39.348090 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fd8bc1e-9f75-41eb-9958-a2315d0059d8 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:39.355271 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fd8bc1e-9f75-41eb-9958-a2315d0059d8 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:39.367880 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fd8bc1e-9f75-41eb-9958-a2315d0059d8 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:39.370837 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fd8bc1e-9f75-41eb-9958-a2315d0059d8 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:39.371633 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fd8bc1e-9f75-41eb-9958-a2315d0059d8 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:39.375615 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c643e198-b971-43f8-b285-d904e98776fe tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:39.404845 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c643e198-b971-43f8-b285-d904e98776fe tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1716 microversion: 2.1 time: 0.526066 Sep 16 12:51:39.407522 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 756/1547] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:38 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1716 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:39.419726 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0eb7d70a-d179-406b-b9bb-ad5ac31b4c69 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:39.422272 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0eb7d70a-d179-406b-b9bb-ad5ac31b4c69 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:39.443293 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0eb7d70a-d179-406b-b9bb-ad5ac31b4c69 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:39.445246 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0eb7d70a-d179-406b-b9bb-ad5ac31b4c69 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:39.448441 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0eb7d70a-d179-406b-b9bb-ad5ac31b4c69 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:39.450165 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0eb7d70a-d179-406b-b9bb-ad5ac31b4c69 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:39.452520 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0eb7d70a-d179-406b-b9bb-ad5ac31b4c69 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:39.453378 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0eb7d70a-d179-406b-b9bb-ad5ac31b4c69 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:39.708616 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4fd8bc1e-9f75-41eb-9958-a2315d0059d8 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:39.731166 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4fd8bc1e-9f75-41eb-9958-a2315d0059d8 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:39.738135 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4fd8bc1e-9f75-41eb-9958-a2315d0059d8 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:39.739900 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4fd8bc1e-9f75-41eb-9958-a2315d0059d8 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] 10.222.0.67 "GET /compute/v2.1/servers/5f350206-ba9d-427c-8b60-95c2d2f501ae" status: 200 len: 1280 microversion: 2.47 time: 0.440102 Sep 16 12:51:39.751013 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 792/1548] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:39 2022] GET /compute/v2.1/servers/5f350206-ba9d-427c-8b60-95c2d2f501ae => generated 1280 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:39.768154 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4a975dde-e139-473a-9c51-a5884c3d593a tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:39.768154 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4a975dde-e139-473a-9c51-a5884c3d593a tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] [instance: a4906950-755b-4838-b954-fb07189747f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:39.768154 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a975dde-e139-473a-9c51-a5884c3d593a tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:39.768154 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a975dde-e139-473a-9c51-a5884c3d593a tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:39.768745 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a975dde-e139-473a-9c51-a5884c3d593a tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:39.768745 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a975dde-e139-473a-9c51-a5884c3d593a tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:39.769059 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a975dde-e139-473a-9c51-a5884c3d593a tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:39.770031 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a975dde-e139-473a-9c51-a5884c3d593a tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:39.841132 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0eb7d70a-d179-406b-b9bb-ad5ac31b4c69 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:39.861499 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0eb7d70a-d179-406b-b9bb-ad5ac31b4c69 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1528 microversion: 2.1 time: 0.450233 Sep 16 12:51:39.863357 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 757/1549] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:39 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1528 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:39.883051 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ace1a3c8-38b9-4be5-9712-7f7298cc29ce tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1264730607"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:51:39.895609 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ace1a3c8-38b9-4be5-9712-7f7298cc29ce tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: f9070e88-5408-48ab-9f4b-a74368e8f25e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:39.916004 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ace1a3c8-38b9-4be5-9712-7f7298cc29ce tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:39.916718 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ace1a3c8-38b9-4be5-9712-7f7298cc29ce tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:39.927771 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ace1a3c8-38b9-4be5-9712-7f7298cc29ce tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:39.930527 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ace1a3c8-38b9-4be5-9712-7f7298cc29ce tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:39.935304 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ace1a3c8-38b9-4be5-9712-7f7298cc29ce tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:39.944860 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ace1a3c8-38b9-4be5-9712-7f7298cc29ce tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:40.190369 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4a975dde-e139-473a-9c51-a5884c3d593a tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef3656188f245d2a41252cee95b2064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034ef732e4504d05a4d5d0eea122165e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:40.204912 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4a975dde-e139-473a-9c51-a5884c3d593a tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] 10.222.0.67 "GET /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3" status: 200 len: 1331 microversion: 2.1 time: 0.452827 Sep 16 12:51:40.205799 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 793/1550] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:39 2022] GET /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3 => generated 1331 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:40.220097 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1a271e66-22ab-40bc-8701-bc5ce1e5ce2a tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:40.221091 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1a271e66-22ab-40bc-8701-bc5ce1e5ce2a tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] [instance: 041df092-33d4-4b71-84d8-7cd479d32b4f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:40.237452 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a271e66-22ab-40bc-8701-bc5ce1e5ce2a tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:40.241103 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a271e66-22ab-40bc-8701-bc5ce1e5ce2a tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:40.242112 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a271e66-22ab-40bc-8701-bc5ce1e5ce2a tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:40.245042 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a271e66-22ab-40bc-8701-bc5ce1e5ce2a tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:40.248890 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a271e66-22ab-40bc-8701-bc5ce1e5ce2a tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:40.249477 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a271e66-22ab-40bc-8701-bc5ce1e5ce2a tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:40.446855 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ace1a3c8-38b9-4be5-9712-7f7298cc29ce tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "POST /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e/action" status: 202 len: 0 microversion: 2.1 time: 0.581146 Sep 16 12:51:40.448355 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 758/1551] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:51:39 2022] POST /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e/action => generated 0 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 16 12:51:40.462161 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-1a271e66-22ab-40bc-8701-bc5ce1e5ce2a tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lazy-loading 'services' on Instance uuid 041df092-33d4-4b71-84d8-7cd479d32b4f {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:51:40.469142 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-b5ccaed2-a7d6-44cd-b001-2999cac8d2ea req-9ffefb3a-1c26-43b5-b72c-3dc08b471103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a439c4ea-46f5-4571-9d87-96a91a6359f7", "name": "network-vif-plugged", "status": "completed", "tag": "76e2deeb-80ac-4c0d-98b8-96091a5ab0d2"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:51:40.498667 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1a271e66-22ab-40bc-8701-bc5ce1e5ce2a tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f" status: 200 len: 2049 microversion: 2.25 time: 0.290412 Sep 16 12:51:40.500845 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 794/1552] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:40 2022] GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f => generated 2049 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:40.502001 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-b5ccaed2-a7d6-44cd-b001-2999cac8d2ea req-9ffefb3a-1c26-43b5-b72c-3dc08b471103 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:40.503444 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-b5ccaed2-a7d6-44cd-b001-2999cac8d2ea req-9ffefb3a-1c26-43b5-b72c-3dc08b471103 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:40.504015 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-b5ccaed2-a7d6-44cd-b001-2999cac8d2ea req-9ffefb3a-1c26-43b5-b72c-3dc08b471103 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:40.522195 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5205f889-29bd-420c-a61b-5116d5b13927 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1260964280", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": "none"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:51:40.530645 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-b5ccaed2-a7d6-44cd-b001-2999cac8d2ea req-9ffefb3a-1c26-43b5-b72c-3dc08b471103 service nova] Creating event network-vif-plugged:76e2deeb-80ac-4c0d-98b8-96091a5ab0d2 for instance a439c4ea-46f5-4571-9d87-96a91a6359f7 on n-h2-858094-4 Sep 16 12:51:40.548482 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-b5ccaed2-a7d6-44cd-b001-2999cac8d2ea req-9ffefb3a-1c26-43b5-b72c-3dc08b471103 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093565 Sep 16 12:51:40.554307 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 759/1553] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:51:40.560998 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1c2a44ad-c9b8-4766-8665-62d699834433 tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:40.568530 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-1c2a44ad-c9b8-4766-8665-62d699834433 tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] HTTP exception thrown: Flavor 2c986fa9-53ef-4e69-8dea-d107da49319f could not be found. Sep 16 12:51:40.581603 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1c2a44ad-c9b8-4766-8665-62d699834433 tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Request method failure captured: Sep 16 12:51:40.581603 n-d-858094-4 devstack@n-api.service[128780]: request: DELETE /compute/v2.1/flavors/2c986fa9-53ef-4e69-8dea-d107da49319f HTTP/1.1 Sep 16 12:51:40.581603 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:51:40.581603 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:51:40.581603 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:51:40.581603 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:51:40.581603 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:51:40.581603 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:51:40.581603 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:51:40.581603 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:51:40.581603 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHBTgN5drowx3NEEiD0k533qlL4m4KpmgZHhKlol4RzWb_zYFmsE-QpB0YzBts0y6-kE69-x8N9M2qQ-3R3RWr7nBqFkdcMVDaR1v4VosH8YeYUi-kkiMcD1hk_J6y5MJrgIVAkmEVt8uwevrwLM7LvIC0NYZAnnneun6QmX-aijD8Q Sep 16 12:51:40.581603 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:51:40.581603 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:51:40.581603 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:51:40.581603 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:51:40.581603 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:51:40.581603 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:51:40.581603 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: d80d9b2f358446a29f596a7594d182d1 Sep 16 12:51:40.581603 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-MigrationsAdminTest-697105801 Sep 16 12:51:40.581603 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,admin,reader Sep 16 12:51:40.581603 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,admin,reader Sep 16 12:51:40.583447 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d80d9b2f358446a29f596a7594d182d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d80d9b2f358446a29f596a7594d182d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d80d9b2f358446a29f596a7594d182d1", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d80d9b2f358446a29f596a7594d182d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:51:40.583447 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-MigrationsAdminTest-697105801 Sep 16 12:51:40.583447 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: d80d9b2f358446a29f596a7594d182d1 Sep 16 12:51:40.583447 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-MigrationsAdminTest-697105801 Sep 16 12:51:40.583447 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-MigrationsAdminTest-697105801-project-admin Sep 16 12:51:40.583447 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:51:40.583447 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:51:40.583447 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: eb0d7615ec7b41a9837459c5c1fb4f70 Sep 16 12:51:40.583447 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-MigrationsAdminTest-697105801-project-admin Sep 16 12:51:40.583447 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:51:40.583447 n-d-858094-4 devstack@n-api.service[128780]: exception: Flavor 2c986fa9-53ef-4e69-8dea-d107da49319f could not be found. Sep 16 12:51:40.583447 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '2c986fa9-53ef-4e69-8dea-d107da49319f'} Sep 16 12:51:40.584432 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:51:40.584432 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:40.584432 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Sep 16 12:51:40.584432 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi flavor.destroy() Sep 16 12:51:40.584432 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 16 12:51:40.584432 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 16 12:51:40.584432 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Sep 16 12:51:40.584432 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Sep 16 12:51:40.584432 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Sep 16 12:51:40.584432 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Sep 16 12:51:40.584432 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 12:51:40.584432 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 12:51:40.584432 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Sep 16 12:51:40.584432 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Sep 16 12:51:40.584432 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 2c986fa9-53ef-4e69-8dea-d107da49319f could not be found. Sep 16 12:51:40.584432 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:40.584432 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:40.584432 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:40.584432 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:40.584432 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:51:40.586116 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:51:40.586116 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:51:40.586116 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:51:40.586116 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:51:40.586116 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:51:40.586116 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Sep 16 12:51:40.586116 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:51:40.586116 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 2c986fa9-53ef-4e69-8dea-d107da49319f could not be found. Sep 16 12:51:40.586116 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:40.586116 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:40.586116 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:40.586116 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:40.586116 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:51:40.586116 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:51:40.586116 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:51:40.586116 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:51:40.586116 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2c986fa9-53ef-4e69-8dea-d107da49319f could not be found. Sep 16 12:51:40.586116 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:40.590153 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1c2a44ad-c9b8-4766-8665-62d699834433 tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Returning 404 to user: Flavor 2c986fa9-53ef-4e69-8dea-d107da49319f could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:51:40.592373 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1c2a44ad-c9b8-4766-8665-62d699834433 tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/2c986fa9-53ef-4e69-8dea-d107da49319f" status: 404 len: 109 microversion: 2.1 time: 0.035443 Sep 16 12:51:40.596436 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 760/1554] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:51:40 2022] DELETE /compute/v2.1/flavors/2c986fa9-53ef-4e69-8dea-d107da49319f => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:51:40.604270 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9b72fc46-86b1-430b-b0e6-1240c0bf9835 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:40.608694 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9b72fc46-86b1-430b-b0e6-1240c0bf9835 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:40.630523 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9b72fc46-86b1-430b-b0e6-1240c0bf9835 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:40.631206 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9b72fc46-86b1-430b-b0e6-1240c0bf9835 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:40.631753 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9b72fc46-86b1-430b-b0e6-1240c0bf9835 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:40.632611 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9b72fc46-86b1-430b-b0e6-1240c0bf9835 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:40.632933 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-5205f889-29bd-420c-a61b-5116d5b13927 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:51:40.633555 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9b72fc46-86b1-430b-b0e6-1240c0bf9835 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:40.634133 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-5205f889-29bd-420c-a61b-5116d5b13927 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:51:40.634504 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9b72fc46-86b1-430b-b0e6-1240c0bf9835 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:40.635319 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-5205f889-29bd-420c-a61b-5116d5b13927 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:51:40.635501 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-5205f889-29bd-420c-a61b-5116d5b13927 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:51:40.638797 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-5205f889-29bd-420c-a61b-5116d5b13927 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:51:40.662287 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5205f889-29bd-420c-a61b-5116d5b13927 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:40.662769 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5205f889-29bd-420c-a61b-5116d5b13927 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:40.663200 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5205f889-29bd-420c-a61b-5116d5b13927 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:40.669018 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5205f889-29bd-420c-a61b-5116d5b13927 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:40.669594 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5205f889-29bd-420c-a61b-5116d5b13927 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:40.670037 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5205f889-29bd-420c-a61b-5116d5b13927 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:40.695968 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-5205f889-29bd-420c-a61b-5116d5b13927 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Getting quotas for project 2a7566965e424a09bd5488847d1776bd. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:51:40.703187 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-5205f889-29bd-420c-a61b-5116d5b13927 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Getting quotas for user 43c0495684dc4bdeaacca09eadae3b42 and project 2a7566965e424a09bd5488847d1776bd. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:51:40.723597 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5205f889-29bd-420c-a61b-5116d5b13927 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:51:40.726298 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5205f889-29bd-420c-a61b-5116d5b13927 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 4798e026-102b-4ff4-8888-da4bb6b45c08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:51:40.762680 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9b72fc46-86b1-430b-b0e6-1240c0bf9835 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:40.794005 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9b72fc46-86b1-430b-b0e6-1240c0bf9835 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:40.795926 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9b72fc46-86b1-430b-b0e6-1240c0bf9835 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:40.809702 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9b72fc46-86b1-430b-b0e6-1240c0bf9835 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1555 microversion: 2.91 time: 0.211796 Sep 16 12:51:40.820482 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5205f889-29bd-420c-a61b-5116d5b13927 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.310365 Sep 16 12:51:40.820689 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 761/1555] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:40 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1555 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:40.820780 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 795/1556] 10.222.0.67 () {62 vars in 1188 bytes} [Fri Sep 16 12:51:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 319 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 16 12:51:40.830268 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6797215e-83d6-4794-aa1a-75a892e3a58e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:40.830268 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6797215e-83d6-4794-aa1a-75a892e3a58e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:40.838856 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d0ab8504-76d5-493a-9f10-79c33ff1e4b2 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f1035a9a4c0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:40.866472 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6797215e-83d6-4794-aa1a-75a892e3a58e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:40.873289 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6797215e-83d6-4794-aa1a-75a892e3a58e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:40.875867 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6797215e-83d6-4794-aa1a-75a892e3a58e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:40.878497 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6797215e-83d6-4794-aa1a-75a892e3a58e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:40.879909 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6797215e-83d6-4794-aa1a-75a892e3a58e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:40.882004 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6797215e-83d6-4794-aa1a-75a892e3a58e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:40.922335 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d0ab8504-76d5-493a-9f10-79c33ff1e4b2 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/7295f227-b0f5-4cf6-9774-a6670b259cd5" status: 200 len: 1412 microversion: 2.1 time: 0.100302 Sep 16 12:51:40.932555 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 796/1557] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:51:40 2022] GET /compute/v2.1/images/7295f227-b0f5-4cf6-9774-a6670b259cd5 => generated 1412 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:40.939312 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d3bfd7af-355d-42c2-9791-e3c0023ee70f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:40.946226 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3bfd7af-355d-42c2-9791-e3c0023ee70f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:40.946721 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3bfd7af-355d-42c2-9791-e3c0023ee70f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:40.947162 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3bfd7af-355d-42c2-9791-e3c0023ee70f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:40.947896 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3bfd7af-355d-42c2-9791-e3c0023ee70f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:40.950755 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3bfd7af-355d-42c2-9791-e3c0023ee70f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:40.951205 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3bfd7af-355d-42c2-9791-e3c0023ee70f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:41.041078 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d3bfd7af-355d-42c2-9791-e3c0023ee70f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.114465 Sep 16 12:51:41.045310 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 797/1558] 10.222.0.67 () {60 vars in 1217 bytes} [Fri Sep 16 12:51:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:51:41.055279 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b9ba1a09-7377-45ca-ae7d-fe38fd3a079a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1314733712", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:51:41.193223 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-b9ba1a09-7377-45ca-ae7d-fe38fd3a079a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] validate_networks() for None {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:51:41.287790 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6797215e-83d6-4794-aa1a-75a892e3a58e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:41.299962 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6797215e-83d6-4794-aa1a-75a892e3a58e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1716 microversion: 2.1 time: 0.485602 Sep 16 12:51:41.304944 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 762/1559] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:40 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1716 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:41.317121 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e1167c24-241a-4d9d-a8b0-b675525c86d2 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:51:41.325163 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e1167c24-241a-4d9d-a8b0-b675525c86d2 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 4798e026-102b-4ff4-8888-da4bb6b45c08] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:41.437368 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e1167c24-241a-4d9d-a8b0-b675525c86d2 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] 10.222.0.67 "PUT /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08" status: 200 len: 992 microversion: 2.47 time: 0.130047 Sep 16 12:51:41.452840 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 763/1560] 10.222.0.67 () {62 vars in 1297 bytes} [Fri Sep 16 12:51:41 2022] PUT /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08 => generated 992 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:51:41.465999 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fd2a3cd7-507c-4661-a18a-abb7bf82d591 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:41.476199 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-fd2a3cd7-507c-4661-a18a-abb7bf82d591 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:41.517040 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fd2a3cd7-507c-4661-a18a-abb7bf82d591 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:41.518019 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fd2a3cd7-507c-4661-a18a-abb7bf82d591 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:41.521467 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fd2a3cd7-507c-4661-a18a-abb7bf82d591 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:41.526895 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fd2a3cd7-507c-4661-a18a-abb7bf82d591 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:41.527795 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fd2a3cd7-507c-4661-a18a-abb7bf82d591 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:41.530281 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fd2a3cd7-507c-4661-a18a-abb7bf82d591 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:41.615261 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-fd2a3cd7-507c-4661-a18a-abb7bf82d591 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.153048 Sep 16 12:51:41.617159 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 764/1561] 10.222.0.67 () {58 vars in 1302 bytes} [Fri Sep 16 12:51:41 2022] GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0/os-volume_attachments => generated 25 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 12:51:41.641769 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-73f3886c-bc35-4435-9f91-84a11897e15d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f1039b6a4c0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:41.737909 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b9ba1a09-7377-45ca-ae7d-fe38fd3a079a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:51:41.738262 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b9ba1a09-7377-45ca-ae7d-fe38fd3a079a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:51:41.738744 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b9ba1a09-7377-45ca-ae7d-fe38fd3a079a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:51:41.739283 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b9ba1a09-7377-45ca-ae7d-fe38fd3a079a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:51:41.739609 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b9ba1a09-7377-45ca-ae7d-fe38fd3a079a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:51:41.759263 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9ba1a09-7377-45ca-ae7d-fe38fd3a079a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:41.761687 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9ba1a09-7377-45ca-ae7d-fe38fd3a079a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:41.762899 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9ba1a09-7377-45ca-ae7d-fe38fd3a079a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:41.766914 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9ba1a09-7377-45ca-ae7d-fe38fd3a079a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:41.769542 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9ba1a09-7377-45ca-ae7d-fe38fd3a079a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:41.770333 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9ba1a09-7377-45ca-ae7d-fe38fd3a079a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:41.785317 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-73f3886c-bc35-4435-9f91-84a11897e15d tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/7295f227-b0f5-4cf6-9774-a6670b259cd5" status: 200 len: 1412 microversion: 2.1 time: 0.165405 Sep 16 12:51:41.785495 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 765/1562] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:51:41 2022] GET /compute/v2.1/images/7295f227-b0f5-4cf6-9774-a6670b259cd5 => generated 1412 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:41.806464 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4f8c3a6c-c2a1-4941-9a1d-4f3c6ab6773f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858094-4", "block_migration": "auto"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:51:41.807259 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-b9ba1a09-7377-45ca-ae7d-fe38fd3a079a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Getting quotas for project 0b18ec5302634d2a95e51547e0019d40. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:51:41.813517 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-b9ba1a09-7377-45ca-ae7d-fe38fd3a079a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Getting quotas for user f3e2827a76d14e4a88c4562f1c0351ac and project 0b18ec5302634d2a95e51547e0019d40. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:51:41.816921 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-4f8c3a6c-c2a1-4941-9a1d-4f3c6ab6773f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] [instance: 041df092-33d4-4b71-84d8-7cd479d32b4f] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:41.829508 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4f8c3a6c-c2a1-4941-9a1d-4f3c6ab6773f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:41.829992 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4f8c3a6c-c2a1-4941-9a1d-4f3c6ab6773f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:41.830422 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4f8c3a6c-c2a1-4941-9a1d-4f3c6ab6773f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:41.831521 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4f8c3a6c-c2a1-4941-9a1d-4f3c6ab6773f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:41.831641 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b9ba1a09-7377-45ca-ae7d-fe38fd3a079a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:51:41.831969 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4f8c3a6c-c2a1-4941-9a1d-4f3c6ab6773f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:41.832412 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4f8c3a6c-c2a1-4941-9a1d-4f3c6ab6773f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:41.833879 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b9ba1a09-7377-45ca-ae7d-fe38fd3a079a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:51:41.866429 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-4f8c3a6c-c2a1-4941-9a1d-4f3c6ab6773f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lazy-loading 'flavor' on Instance uuid 041df092-33d4-4b71-84d8-7cd479d32b4f {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:51:41.891678 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-4f8c3a6c-c2a1-4941-9a1d-4f3c6ab6773f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] [instance: 041df092-33d4-4b71-84d8-7cd479d32b4f] Going to try to live migrate instance to n-h1-858094-4 {{(pid=128780) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 16 12:51:41.900107 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b9ba1a09-7377-45ca-ae7d-fe38fd3a079a tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.853698 Sep 16 12:51:41.901574 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 798/1563] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:51:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:51:41.907155 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7f055199-6b69-4456-b65e-0a1a933fc3f9 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:41.908938 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7f055199-6b69-4456-b65e-0a1a933fc3f9 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] [instance: a4906950-755b-4838-b954-fb07189747f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:41.916483 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f055199-6b69-4456-b65e-0a1a933fc3f9 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:41.917969 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f055199-6b69-4456-b65e-0a1a933fc3f9 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:41.919369 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f055199-6b69-4456-b65e-0a1a933fc3f9 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:41.921501 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f055199-6b69-4456-b65e-0a1a933fc3f9 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:41.922920 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f055199-6b69-4456-b65e-0a1a933fc3f9 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:41.923738 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f055199-6b69-4456-b65e-0a1a933fc3f9 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:42.002741 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:51:42.232707 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7f055199-6b69-4456-b65e-0a1a933fc3f9 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef3656188f245d2a41252cee95b2064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034ef732e4504d05a4d5d0eea122165e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:42.270519 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7f055199-6b69-4456-b65e-0a1a933fc3f9 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] 10.222.0.67 "GET /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3" status: 200 len: 1331 microversion: 2.1 time: 0.359377 Sep 16 12:51:42.273940 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 799/1564] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:41 2022] GET /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3 => generated 1331 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:42.309490 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-68c3a375-e5e7-4b97-b1f0-4509c53f94aa tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:42.313207 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-68c3a375-e5e7-4b97-b1f0-4509c53f94aa tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 4798e026-102b-4ff4-8888-da4bb6b45c08] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:42.360599 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68c3a375-e5e7-4b97-b1f0-4509c53f94aa tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:42.361146 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68c3a375-e5e7-4b97-b1f0-4509c53f94aa tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:42.361590 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68c3a375-e5e7-4b97-b1f0-4509c53f94aa tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:42.371440 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68c3a375-e5e7-4b97-b1f0-4509c53f94aa tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:42.371926 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68c3a375-e5e7-4b97-b1f0-4509c53f94aa tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:42.379016 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68c3a375-e5e7-4b97-b1f0-4509c53f94aa tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:42.634411 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-68c3a375-e5e7-4b97-b1f0-4509c53f94aa tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:42.653883 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-68c3a375-e5e7-4b97-b1f0-4509c53f94aa tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:42.660179 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-68c3a375-e5e7-4b97-b1f0-4509c53f94aa tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:42.666547 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-68c3a375-e5e7-4b97-b1f0-4509c53f94aa tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] 10.222.0.67 "GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08" status: 200 len: 1274 microversion: 2.47 time: 0.390023 Sep 16 12:51:42.687170 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 800/1565] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:42 2022] GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08 => generated 1274 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:42.703142 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9bf01e7a-9101-42c7-8615-d9792e1a7208 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:42.710374 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9bf01e7a-9101-42c7-8615-d9792e1a7208 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:42.726422 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9bf01e7a-9101-42c7-8615-d9792e1a7208 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:42.726926 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9bf01e7a-9101-42c7-8615-d9792e1a7208 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:42.727368 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9bf01e7a-9101-42c7-8615-d9792e1a7208 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:42.732715 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9bf01e7a-9101-42c7-8615-d9792e1a7208 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:42.733213 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9bf01e7a-9101-42c7-8615-d9792e1a7208 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:42.733659 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9bf01e7a-9101-42c7-8615-d9792e1a7208 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:42.822311 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9bf01e7a-9101-42c7-8615-d9792e1a7208 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.133923 Sep 16 12:51:42.823229 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 801/1566] 10.222.0.67 () {58 vars in 1302 bytes} [Fri Sep 16 12:51:42 2022] GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0/os-volume_attachments => generated 25 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 12:51:42.840448 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f92b2e9b-82bf-4491-b7b9-e0143a8720ba tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f10355b6160>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:43.191669 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f92b2e9b-82bf-4491-b7b9-e0143a8720ba tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "DELETE /compute/v2.1/images/7295f227-b0f5-4cf6-9774-a6670b259cd5" status: 204 len: 0 microversion: 2.1 time: 0.366501 Sep 16 12:51:43.196634 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 802/1567] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:42 2022] DELETE /compute/v2.1/images/7295f227-b0f5-4cf6-9774-a6670b259cd5 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:51:43.203183 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-953aff98-f7cf-4206-baf3-13f407542d1e tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:43.209115 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-953aff98-f7cf-4206-baf3-13f407542d1e tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:43.225434 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-953aff98-f7cf-4206-baf3-13f407542d1e tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:43.226198 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-953aff98-f7cf-4206-baf3-13f407542d1e tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:43.228529 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-953aff98-f7cf-4206-baf3-13f407542d1e tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:43.230487 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-953aff98-f7cf-4206-baf3-13f407542d1e tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:43.231478 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-953aff98-f7cf-4206-baf3-13f407542d1e tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:43.233689 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-953aff98-f7cf-4206-baf3-13f407542d1e tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:43.345092 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-953aff98-f7cf-4206-baf3-13f407542d1e tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:43.357805 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-953aff98-f7cf-4206-baf3-13f407542d1e tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:43.359850 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-953aff98-f7cf-4206-baf3-13f407542d1e tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:43.368258 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-953aff98-f7cf-4206-baf3-13f407542d1e tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1555 microversion: 2.91 time: 0.170260 Sep 16 12:51:43.369156 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 803/1568] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:43 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1555 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:43.375523 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-76d20c71-f050-4906-a37c-a09daf432d6b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:43.376715 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-76d20c71-f050-4906-a37c-a09daf432d6b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:43.398256 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76d20c71-f050-4906-a37c-a09daf432d6b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:43.399083 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76d20c71-f050-4906-a37c-a09daf432d6b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:43.402203 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76d20c71-f050-4906-a37c-a09daf432d6b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:43.404590 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76d20c71-f050-4906-a37c-a09daf432d6b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:43.405545 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76d20c71-f050-4906-a37c-a09daf432d6b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:43.406180 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76d20c71-f050-4906-a37c-a09daf432d6b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:43.500021 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-76d20c71-f050-4906-a37c-a09daf432d6b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:43.510393 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-76d20c71-f050-4906-a37c-a09daf432d6b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1217 microversion: 2.1 time: 0.139472 Sep 16 12:51:43.521371 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 804/1569] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:43 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1217 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:43.535262 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-7de1d9dc-64f1-4791-bf62-d4fae2115eac req-c9a91fff-dc5d-4d20-ada0-7923d3fa1a1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4906950-755b-4838-b954-fb07189747f3", "tag": "92b5ca07-8b77-48e8-915c-8ee94ddb3bb2"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:51:43.548329 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7de1d9dc-64f1-4791-bf62-d4fae2115eac req-c9a91fff-dc5d-4d20-ada0-7923d3fa1a1c service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:43.549125 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7de1d9dc-64f1-4791-bf62-d4fae2115eac req-c9a91fff-dc5d-4d20-ada0-7923d3fa1a1c service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:43.549765 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7de1d9dc-64f1-4791-bf62-d4fae2115eac req-c9a91fff-dc5d-4d20-ada0-7923d3fa1a1c service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:43.566419 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-7de1d9dc-64f1-4791-bf62-d4fae2115eac req-c9a91fff-dc5d-4d20-ada0-7923d3fa1a1c service nova] Creating event network-changed:92b5ca07-8b77-48e8-915c-8ee94ddb3bb2 for instance a4906950-755b-4838-b954-fb07189747f3 on n-h2-858094-4 Sep 16 12:51:43.572581 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-7de1d9dc-64f1-4791-bf62-d4fae2115eac req-c9a91fff-dc5d-4d20-ada0-7923d3fa1a1c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049557 Sep 16 12:51:43.577528 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 805/1570] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:51:43.584343 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7beceb15-b5e6-4623-8248-fed84b6219c5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:43.585050 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7beceb15-b5e6-4623-8248-fed84b6219c5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:43.598927 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7beceb15-b5e6-4623-8248-fed84b6219c5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:43.601164 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7beceb15-b5e6-4623-8248-fed84b6219c5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:43.602303 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7beceb15-b5e6-4623-8248-fed84b6219c5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:43.603047 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7beceb15-b5e6-4623-8248-fed84b6219c5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:43.603859 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7beceb15-b5e6-4623-8248-fed84b6219c5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:43.604328 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7beceb15-b5e6-4623-8248-fed84b6219c5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:43.867211 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7beceb15-b5e6-4623-8248-fed84b6219c5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:43.882874 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7beceb15-b5e6-4623-8248-fed84b6219c5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1716 microversion: 2.1 time: 0.303822 Sep 16 12:51:43.905644 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 806/1571] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:43 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1716 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:43.914167 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cb6e6aee-6871-4159-9547-636438f107f2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:43.914965 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cb6e6aee-6871-4159-9547-636438f107f2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:43.927112 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb6e6aee-6871-4159-9547-636438f107f2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:43.927895 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb6e6aee-6871-4159-9547-636438f107f2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:43.928532 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb6e6aee-6871-4159-9547-636438f107f2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:43.929460 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb6e6aee-6871-4159-9547-636438f107f2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:43.930119 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb6e6aee-6871-4159-9547-636438f107f2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:43.930745 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb6e6aee-6871-4159-9547-636438f107f2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:43.967181 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cb6e6aee-6871-4159-9547-636438f107f2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:51:44.159247 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cb6e6aee-6871-4159-9547-636438f107f2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0" status: 204 len: 0 microversion: 2.1 time: 0.251475 Sep 16 12:51:44.159404 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 807/1572] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:51:43 2022] DELETE /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:51:44.191907 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5e6834ac-35f1-46de-bc71-e336670a6ad2 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f1035a08c10>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:44.246069 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-5e6834ac-35f1-46de-bc71-e336670a6ad2 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] HTTP exception thrown: Image not found. Sep 16 12:51:44.297828 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5e6834ac-35f1-46de-bc71-e336670a6ad2 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Request method failure captured: Sep 16 12:51:44.297828 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/images/7295f227-b0f5-4cf6-9774-a6670b259cd5 HTTP/1.1 Sep 16 12:51:44.297828 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:51:44.297828 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:51:44.297828 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:51:44.297828 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:51:44.297828 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:51:44.297828 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:51:44.297828 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:51:44.297828 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:51:44.297828 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHBls5iww8LeNdGfN3Bt6xT3u64vTQpoFqqS_yYvzsbwThKqraYEgvm-TdmuqPPz7mGkP9XHyURnG4NYJ545iZv6yPCgHdajJlEkh27p7U2bf14vD5cf-sXeqVlOowoXVEnizOzsThYBaLh4g8eNB_RsSBiHvaFUpYtbB3XbCuVO8vc Sep 16 12:51:44.297828 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:51:44.297828 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:51:44.297828 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:51:44.297828 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:51:44.297828 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:51:44.297828 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:51:44.297828 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: e6fa2067c44b42b5aa940619abd8e538 Sep 16 12:51:44.297828 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesTestJSON-969058415 Sep 16 12:51:44.297828 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:51:44.297828 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:51:44.299396 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e6fa2067c44b42b5aa940619abd8e538"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e6fa2067c44b42b5aa940619abd8e538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e6fa2067c44b42b5aa940619abd8e538", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e6fa2067c44b42b5aa940619abd8e538"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:51:44.299396 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesTestJSON-969058415 Sep 16 12:51:44.299396 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: e6fa2067c44b42b5aa940619abd8e538 Sep 16 12:51:44.299396 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesTestJSON-969058415 Sep 16 12:51:44.299396 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ImagesTestJSON-969058415-project Sep 16 12:51:44.299396 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:51:44.299396 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:51:44.299396 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 0cf11dfc3438406ba2710b06fa0fe8ff Sep 16 12:51:44.299396 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesTestJSON-969058415-project Sep 16 12:51:44.299396 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 12:51:44.299396 n-d-858094-4 devstack@n-api.service[128779]: exception: Image not found. Sep 16 12:51:44.299396 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '7295f227-b0f5-4cf6-9774-a6670b259cd5'} Sep 16 12:51:44.299396 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:51:44.299396 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:44.300492 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 16 12:51:44.300492 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 16 12:51:44.300492 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 12:51:44.300492 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 12:51:44.300492 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 16 12:51:44.300492 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 16 12:51:44.300492 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 12:51:44.300492 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 12:51:44.300492 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 16 12:51:44.300492 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 16 12:51:44.300492 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 16 12:51:44.300492 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 16 12:51:44.300492 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 12:51:44.300492 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 12:51:44.300492 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 12:51:44.300492 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 12:51:44.300492 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7295f227-b0f5-4cf6-9774-a6670b259cd5 Sep 16 12:51:44.300492 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:44.301668 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:44.301668 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:44.301668 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:44.301668 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 16 12:51:44.301668 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 16 12:51:44.301668 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 16 12:51:44.301668 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 16 12:51:44.301668 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 16 12:51:44.301668 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 16 12:51:44.301668 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 16 12:51:44.301668 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 16 12:51:44.301668 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 16 12:51:44.301668 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 16 12:51:44.301668 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 12:51:44.301668 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 12:51:44.301668 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 16 12:51:44.301668 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 16 12:51:44.301668 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 12:51:44.301668 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 12:51:44.302851 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 16 12:51:44.302851 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 16 12:51:44.302851 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 16 12:51:44.302851 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 16 12:51:44.302851 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 12:51:44.302851 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 12:51:44.302851 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 12:51:44.302851 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 12:51:44.302851 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7295f227-b0f5-4cf6-9774-a6670b259cd5 could not be found. Sep 16 12:51:44.302851 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:44.302851 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:44.302851 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:44.302851 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:44.302851 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:51:44.302851 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:51:44.302851 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:51:44.302851 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:51:44.302851 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:51:44.302851 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:51:44.304070 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:51:44.304070 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:51:44.304070 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 16 12:51:44.304070 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 16 12:51:44.304070 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 12:51:44.304070 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:44.304070 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:44.304070 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:44.304070 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:44.304070 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:51:44.304070 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:51:44.304070 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:51:44.304070 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:51:44.304070 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 12:51:44.304070 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:44.304070 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5e6834ac-35f1-46de-bc71-e336670a6ad2 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Returning 404 to user: Image not found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:51:44.304070 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5e6834ac-35f1-46de-bc71-e336670a6ad2 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/images/7295f227-b0f5-4cf6-9774-a6670b259cd5" status: 404 len: 62 microversion: 2.1 time: 0.129073 Sep 16 12:51:44.305173 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 808/1573] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:51:44 2022] GET /compute/v2.1/images/7295f227-b0f5-4cf6-9774-a6670b259cd5 => generated 62 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 12:51:44.309749 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-129bea7e-39f8-4fff-b7c8-fc612fec9fc6 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:44.313172 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-129bea7e-39f8-4fff-b7c8-fc612fec9fc6 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] [instance: a4906950-755b-4838-b954-fb07189747f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:44.320172 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-129bea7e-39f8-4fff-b7c8-fc612fec9fc6 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:44.320690 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-129bea7e-39f8-4fff-b7c8-fc612fec9fc6 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:44.321116 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-129bea7e-39f8-4fff-b7c8-fc612fec9fc6 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:44.321998 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-129bea7e-39f8-4fff-b7c8-fc612fec9fc6 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:44.322498 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-129bea7e-39f8-4fff-b7c8-fc612fec9fc6 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:44.323011 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-129bea7e-39f8-4fff-b7c8-fc612fec9fc6 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:44.539781 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-129bea7e-39f8-4fff-b7c8-fc612fec9fc6 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef3656188f245d2a41252cee95b2064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034ef732e4504d05a4d5d0eea122165e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:44.553344 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-129bea7e-39f8-4fff-b7c8-fc612fec9fc6 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] 10.222.0.67 "GET /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3" status: 200 len: 1331 microversion: 2.1 time: 0.251398 Sep 16 12:51:44.554482 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 809/1574] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:44 2022] GET /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3 => generated 1331 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:44.560181 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5962c16f-827e-4a0f-b150-9541a8d4c906 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:44.561222 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5962c16f-827e-4a0f-b150-9541a8d4c906 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 4798e026-102b-4ff4-8888-da4bb6b45c08] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:44.568685 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5962c16f-827e-4a0f-b150-9541a8d4c906 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:44.569475 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5962c16f-827e-4a0f-b150-9541a8d4c906 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:44.570241 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5962c16f-827e-4a0f-b150-9541a8d4c906 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:44.571279 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5962c16f-827e-4a0f-b150-9541a8d4c906 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:44.571950 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5962c16f-827e-4a0f-b150-9541a8d4c906 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:44.572603 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5962c16f-827e-4a0f-b150-9541a8d4c906 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:44.660069 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5962c16f-827e-4a0f-b150-9541a8d4c906 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:44.675483 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5962c16f-827e-4a0f-b150-9541a8d4c906 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:44.678208 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5962c16f-827e-4a0f-b150-9541a8d4c906 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:44.679763 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5962c16f-827e-4a0f-b150-9541a8d4c906 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] 10.222.0.67 "GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08" status: 200 len: 1338 microversion: 2.47 time: 0.123999 Sep 16 12:51:44.680945 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 810/1575] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:44 2022] GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08 => generated 1338 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:44.695323 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dce63a8c-2b1e-4562-86f6-3ea4851dff19 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:44.699242 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dce63a8c-2b1e-4562-86f6-3ea4851dff19 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:44.706914 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dce63a8c-2b1e-4562-86f6-3ea4851dff19 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:44.707737 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dce63a8c-2b1e-4562-86f6-3ea4851dff19 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:44.708429 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dce63a8c-2b1e-4562-86f6-3ea4851dff19 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:44.710074 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dce63a8c-2b1e-4562-86f6-3ea4851dff19 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:44.710753 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dce63a8c-2b1e-4562-86f6-3ea4851dff19 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:44.711422 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dce63a8c-2b1e-4562-86f6-3ea4851dff19 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:44.992087 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dce63a8c-2b1e-4562-86f6-3ea4851dff19 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fd28118c342529cda410e9587dfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a3e6c179c6495281c2816a1e18aa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:44.997049 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:51:45.015371 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dce63a8c-2b1e-4562-86f6-3ea4851dff19 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0" status: 200 len: 1681 microversion: 2.1 time: 0.333096 Sep 16 12:51:45.028535 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 811/1576] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:44 2022] GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 => generated 1681 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:45.028535 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5bfe0dc8-ba26-4993-b732-3b9274646a47 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:45.028535 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5bfe0dc8-ba26-4993-b732-3b9274646a47 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: f9070e88-5408-48ab-9f4b-a74368e8f25e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:45.040666 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bfe0dc8-ba26-4993-b732-3b9274646a47 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:45.041141 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bfe0dc8-ba26-4993-b732-3b9274646a47 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:45.041590 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bfe0dc8-ba26-4993-b732-3b9274646a47 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:45.042858 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bfe0dc8-ba26-4993-b732-3b9274646a47 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:45.043642 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bfe0dc8-ba26-4993-b732-3b9274646a47 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:45.043999 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bfe0dc8-ba26-4993-b732-3b9274646a47 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:45.231735 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5bfe0dc8-ba26-4993-b732-3b9274646a47 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:45.239903 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5bfe0dc8-ba26-4993-b732-3b9274646a47 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e" status: 200 len: 1506 microversion: 2.1 time: 0.222896 Sep 16 12:51:45.243504 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 812/1577] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:45 2022] GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e => generated 1506 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:45.250035 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3ad7ddd4-cbc9-48be-bdb5-f9ff9aef74b7 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:45.250683 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3ad7ddd4-cbc9-48be-bdb5-f9ff9aef74b7 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:45.265175 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ad7ddd4-cbc9-48be-bdb5-f9ff9aef74b7 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:45.265670 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ad7ddd4-cbc9-48be-bdb5-f9ff9aef74b7 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:45.266114 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ad7ddd4-cbc9-48be-bdb5-f9ff9aef74b7 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:45.266819 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ad7ddd4-cbc9-48be-bdb5-f9ff9aef74b7 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:45.267269 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ad7ddd4-cbc9-48be-bdb5-f9ff9aef74b7 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:45.267686 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ad7ddd4-cbc9-48be-bdb5-f9ff9aef74b7 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:45.342029 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3ad7ddd4-cbc9-48be-bdb5-f9ff9aef74b7 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:45.353535 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3ad7ddd4-cbc9-48be-bdb5-f9ff9aef74b7 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:45.355111 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3ad7ddd4-cbc9-48be-bdb5-f9ff9aef74b7 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:45.361607 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3ad7ddd4-cbc9-48be-bdb5-f9ff9aef74b7 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1555 microversion: 2.91 time: 0.116977 Sep 16 12:51:45.372209 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 813/1578] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:45 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1555 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:45.372209 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-053aba90-6a9d-4615-9770-257394206ecc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:45.372209 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-053aba90-6a9d-4615-9770-257394206ecc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:45.375416 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-053aba90-6a9d-4615-9770-257394206ecc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:45.375903 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-053aba90-6a9d-4615-9770-257394206ecc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:45.376375 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-053aba90-6a9d-4615-9770-257394206ecc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:45.377309 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-053aba90-6a9d-4615-9770-257394206ecc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:45.377629 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-053aba90-6a9d-4615-9770-257394206ecc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:45.378051 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-053aba90-6a9d-4615-9770-257394206ecc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:45.466972 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-053aba90-6a9d-4615-9770-257394206ecc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:45.476449 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-053aba90-6a9d-4615-9770-257394206ecc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1265 microversion: 2.1 time: 0.112728 Sep 16 12:51:45.478808 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 814/1579] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:45 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1265 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:45.487645 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d92cc3c9-3db5-4ac7-adf7-5534b7aeff28 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:45.488450 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d92cc3c9-3db5-4ac7-adf7-5534b7aeff28 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:45.494760 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d92cc3c9-3db5-4ac7-adf7-5534b7aeff28 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:45.496028 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d92cc3c9-3db5-4ac7-adf7-5534b7aeff28 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:45.496499 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d92cc3c9-3db5-4ac7-adf7-5534b7aeff28 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:45.497537 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d92cc3c9-3db5-4ac7-adf7-5534b7aeff28 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:45.498008 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d92cc3c9-3db5-4ac7-adf7-5534b7aeff28 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:45.498441 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d92cc3c9-3db5-4ac7-adf7-5534b7aeff28 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:45.670058 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d92cc3c9-3db5-4ac7-adf7-5534b7aeff28 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:45.680648 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d92cc3c9-3db5-4ac7-adf7-5534b7aeff28 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1716 microversion: 2.1 time: 0.199502 Sep 16 12:51:45.692246 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 815/1580] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:45 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1716 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:45.692246 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-52216047-5457-4194-b055-bbdcf4c9e9a4 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:45.692246 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-52216047-5457-4194-b055-bbdcf4c9e9a4 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] [instance: a4906950-755b-4838-b954-fb07189747f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:45.701187 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52216047-5457-4194-b055-bbdcf4c9e9a4 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:45.701187 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52216047-5457-4194-b055-bbdcf4c9e9a4 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:45.701187 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52216047-5457-4194-b055-bbdcf4c9e9a4 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:45.701593 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52216047-5457-4194-b055-bbdcf4c9e9a4 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:45.701593 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52216047-5457-4194-b055-bbdcf4c9e9a4 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:45.701593 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52216047-5457-4194-b055-bbdcf4c9e9a4 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:45.922727 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-52216047-5457-4194-b055-bbdcf4c9e9a4 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef3656188f245d2a41252cee95b2064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034ef732e4504d05a4d5d0eea122165e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:45.935140 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-52216047-5457-4194-b055-bbdcf4c9e9a4 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] 10.222.0.67 "GET /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3" status: 200 len: 1331 microversion: 2.1 time: 0.252393 Sep 16 12:51:45.949375 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 816/1581] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:45 2022] GET /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3 => generated 1331 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:45.960685 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2789a258-296d-4e01-931b-11b35a363bea tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:45.961400 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2789a258-296d-4e01-931b-11b35a363bea tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 4798e026-102b-4ff4-8888-da4bb6b45c08] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:45.969890 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2789a258-296d-4e01-931b-11b35a363bea tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:45.970372 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2789a258-296d-4e01-931b-11b35a363bea tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:45.970802 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2789a258-296d-4e01-931b-11b35a363bea tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:45.971573 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2789a258-296d-4e01-931b-11b35a363bea tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:45.972024 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2789a258-296d-4e01-931b-11b35a363bea tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:45.973178 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2789a258-296d-4e01-931b-11b35a363bea tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:46.076927 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2789a258-296d-4e01-931b-11b35a363bea tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:46.093256 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2789a258-296d-4e01-931b-11b35a363bea tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:46.100177 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2789a258-296d-4e01-931b-11b35a363bea tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:46.102254 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2789a258-296d-4e01-931b-11b35a363bea tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] 10.222.0.67 "GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08" status: 200 len: 1336 microversion: 2.47 time: 0.145905 Sep 16 12:51:46.105200 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 817/1582] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:45 2022] GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08 => generated 1336 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:46.128337 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b3ea091f-1352-4bc2-8be7-9231993d9722 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:46.154753 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b3ea091f-1352-4bc2-8be7-9231993d9722 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:46.185326 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3ea091f-1352-4bc2-8be7-9231993d9722 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:46.186731 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3ea091f-1352-4bc2-8be7-9231993d9722 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:46.187286 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3ea091f-1352-4bc2-8be7-9231993d9722 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:46.188113 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3ea091f-1352-4bc2-8be7-9231993d9722 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:46.188836 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3ea091f-1352-4bc2-8be7-9231993d9722 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:46.200566 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3ea091f-1352-4bc2-8be7-9231993d9722 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:46.417707 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b3ea091f-1352-4bc2-8be7-9231993d9722 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fd28118c342529cda410e9587dfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a3e6c179c6495281c2816a1e18aa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:46.428656 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b3ea091f-1352-4bc2-8be7-9231993d9722 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0" status: 200 len: 1681 microversion: 2.1 time: 0.319226 Sep 16 12:51:46.445881 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 818/1583] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:46 2022] GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 => generated 1681 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:46.445881 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1fa96eab-ec9c-4239-abd8-4a2f3d41abf4 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:46.445881 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1fa96eab-ec9c-4239-abd8-4a2f3d41abf4 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: f9070e88-5408-48ab-9f4b-a74368e8f25e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:46.455698 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1fa96eab-ec9c-4239-abd8-4a2f3d41abf4 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:46.456820 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1fa96eab-ec9c-4239-abd8-4a2f3d41abf4 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:46.460987 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1fa96eab-ec9c-4239-abd8-4a2f3d41abf4 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:46.462080 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1fa96eab-ec9c-4239-abd8-4a2f3d41abf4 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:46.462659 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1fa96eab-ec9c-4239-abd8-4a2f3d41abf4 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:46.463197 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1fa96eab-ec9c-4239-abd8-4a2f3d41abf4 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:46.694749 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1fa96eab-ec9c-4239-abd8-4a2f3d41abf4 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:46.711939 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1fa96eab-ec9c-4239-abd8-4a2f3d41abf4 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e" status: 200 len: 1506 microversion: 2.1 time: 0.270836 Sep 16 12:51:46.712623 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 819/1584] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:46 2022] GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e => generated 1506 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:46.717903 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-28b447be-d971-4909-aade-642aedc6f006 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:46.718517 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-28b447be-d971-4909-aade-642aedc6f006 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:46.725175 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28b447be-d971-4909-aade-642aedc6f006 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:46.725680 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28b447be-d971-4909-aade-642aedc6f006 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:46.726168 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28b447be-d971-4909-aade-642aedc6f006 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:46.726850 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28b447be-d971-4909-aade-642aedc6f006 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:46.727311 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28b447be-d971-4909-aade-642aedc6f006 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:46.727806 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28b447be-d971-4909-aade-642aedc6f006 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:46.821977 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-28b447be-d971-4909-aade-642aedc6f006 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:46.831678 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-28b447be-d971-4909-aade-642aedc6f006 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:46.833525 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-28b447be-d971-4909-aade-642aedc6f006 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:46.848316 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-28b447be-d971-4909-aade-642aedc6f006 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1555 microversion: 2.91 time: 0.134252 Sep 16 12:51:46.848983 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 820/1585] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:46 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1555 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:46.854069 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6d69da89-4d9e-4403-a5e4-dceeb9d266a5 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:46.855153 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6d69da89-4d9e-4403-a5e4-dceeb9d266a5 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:46.861514 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d69da89-4d9e-4403-a5e4-dceeb9d266a5 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:46.862011 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d69da89-4d9e-4403-a5e4-dceeb9d266a5 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:46.862452 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d69da89-4d9e-4403-a5e4-dceeb9d266a5 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:46.863464 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d69da89-4d9e-4403-a5e4-dceeb9d266a5 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:46.863932 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d69da89-4d9e-4403-a5e4-dceeb9d266a5 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:46.864407 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d69da89-4d9e-4403-a5e4-dceeb9d266a5 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:46.969243 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6d69da89-4d9e-4403-a5e4-dceeb9d266a5 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:46.982580 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6d69da89-4d9e-4403-a5e4-dceeb9d266a5 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1265 microversion: 2.1 time: 0.131243 Sep 16 12:51:47.004525 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 821/1586] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:46 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:47.013784 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-708a23bc-679b-4f9d-82b3-6ffcce47f218 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:47.014413 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-708a23bc-679b-4f9d-82b3-6ffcce47f218 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:47.017284 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:51:47.024584 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-708a23bc-679b-4f9d-82b3-6ffcce47f218 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:47.025085 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-708a23bc-679b-4f9d-82b3-6ffcce47f218 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:47.025531 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-708a23bc-679b-4f9d-82b3-6ffcce47f218 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:47.027083 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-708a23bc-679b-4f9d-82b3-6ffcce47f218 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:47.027366 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-708a23bc-679b-4f9d-82b3-6ffcce47f218 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:47.027808 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-708a23bc-679b-4f9d-82b3-6ffcce47f218 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:47.437142 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-708a23bc-679b-4f9d-82b3-6ffcce47f218 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:47.459849 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-708a23bc-679b-4f9d-82b3-6ffcce47f218 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1716 microversion: 2.1 time: 0.453827 Sep 16 12:51:47.460792 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 822/1587] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:47 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1716 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:47.468328 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-63558852-cd50-4910-aa9b-46b719f1244a tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:47.475981 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-63558852-cd50-4910-aa9b-46b719f1244a tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] [instance: a4906950-755b-4838-b954-fb07189747f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:47.498367 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63558852-cd50-4910-aa9b-46b719f1244a tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:47.503658 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63558852-cd50-4910-aa9b-46b719f1244a tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:47.504499 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63558852-cd50-4910-aa9b-46b719f1244a tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:47.505468 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63558852-cd50-4910-aa9b-46b719f1244a tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:47.508582 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63558852-cd50-4910-aa9b-46b719f1244a tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:47.513415 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63558852-cd50-4910-aa9b-46b719f1244a tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:48.014355 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-63558852-cd50-4910-aa9b-46b719f1244a tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef3656188f245d2a41252cee95b2064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034ef732e4504d05a4d5d0eea122165e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:48.030783 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-63558852-cd50-4910-aa9b-46b719f1244a tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] 10.222.0.67 "GET /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3" status: 200 len: 1331 microversion: 2.1 time: 0.567692 Sep 16 12:51:48.049428 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 823/1588] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:47 2022] GET /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3 => generated 1331 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:48.056826 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3f79b260-aea4-4985-b93e-7d02a93ffb2e tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:48.058514 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3f79b260-aea4-4985-b93e-7d02a93ffb2e tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 4798e026-102b-4ff4-8888-da4bb6b45c08] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:48.065821 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3f79b260-aea4-4985-b93e-7d02a93ffb2e tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:48.066617 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3f79b260-aea4-4985-b93e-7d02a93ffb2e tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:48.067202 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3f79b260-aea4-4985-b93e-7d02a93ffb2e tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:48.068079 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3f79b260-aea4-4985-b93e-7d02a93ffb2e tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:48.068817 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3f79b260-aea4-4985-b93e-7d02a93ffb2e tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:48.069944 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3f79b260-aea4-4985-b93e-7d02a93ffb2e tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:48.255726 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3f79b260-aea4-4985-b93e-7d02a93ffb2e tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:48.265332 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3f79b260-aea4-4985-b93e-7d02a93ffb2e tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:48.266794 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3f79b260-aea4-4985-b93e-7d02a93ffb2e tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:48.267998 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3f79b260-aea4-4985-b93e-7d02a93ffb2e tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] 10.222.0.67 "GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08" status: 200 len: 1357 microversion: 2.47 time: 0.217171 Sep 16 12:51:48.292200 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 824/1589] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:48 2022] GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08 => generated 1357 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:48.303208 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d665b5c2-7258-4a0c-8acf-27ffb88b2830 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:48.303837 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d665b5c2-7258-4a0c-8acf-27ffb88b2830 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:48.325900 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d665b5c2-7258-4a0c-8acf-27ffb88b2830 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:48.326662 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d665b5c2-7258-4a0c-8acf-27ffb88b2830 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:48.327347 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d665b5c2-7258-4a0c-8acf-27ffb88b2830 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:48.328276 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d665b5c2-7258-4a0c-8acf-27ffb88b2830 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:48.328895 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d665b5c2-7258-4a0c-8acf-27ffb88b2830 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:48.329484 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d665b5c2-7258-4a0c-8acf-27ffb88b2830 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:48.756973 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d665b5c2-7258-4a0c-8acf-27ffb88b2830 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fd28118c342529cda410e9587dfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a3e6c179c6495281c2816a1e18aa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:48.776775 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d665b5c2-7258-4a0c-8acf-27ffb88b2830 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0" status: 200 len: 1681 microversion: 2.1 time: 0.475299 Sep 16 12:51:48.778240 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 825/1590] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:48 2022] GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 => generated 1681 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:48.789992 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-99adeef0-930d-4cef-8b96-1ff3b899e44f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:48.790783 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-99adeef0-930d-4cef-8b96-1ff3b899e44f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: f9070e88-5408-48ab-9f4b-a74368e8f25e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:48.830102 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99adeef0-930d-4cef-8b96-1ff3b899e44f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:48.831348 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99adeef0-930d-4cef-8b96-1ff3b899e44f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:48.834491 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99adeef0-930d-4cef-8b96-1ff3b899e44f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:48.836142 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99adeef0-930d-4cef-8b96-1ff3b899e44f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:48.847531 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99adeef0-930d-4cef-8b96-1ff3b899e44f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:48.849060 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99adeef0-930d-4cef-8b96-1ff3b899e44f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:48.909386 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4f8c3a6c-c2a1-4941-9a1d-4f3c6ab6773f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f/action" status: 202 len: 0 microversion: 2.25 time: 7.122164 Sep 16 12:51:48.910645 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 766/1591] 10.222.0.67 () {62 vars in 1319 bytes} [Fri Sep 16 12:51:41 2022] POST /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f/action => generated 0 bytes in 7124 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:51:48.916211 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-64299894-db63-4d4c-9ad7-93ba6e359b51 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:48.917051 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-64299894-db63-4d4c-9ad7-93ba6e359b51 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:48.944043 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-64299894-db63-4d4c-9ad7-93ba6e359b51 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:48.946955 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-64299894-db63-4d4c-9ad7-93ba6e359b51 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:48.949129 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-64299894-db63-4d4c-9ad7-93ba6e359b51 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:48.953065 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-64299894-db63-4d4c-9ad7-93ba6e359b51 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:48.956816 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-64299894-db63-4d4c-9ad7-93ba6e359b51 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:48.957635 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-64299894-db63-4d4c-9ad7-93ba6e359b51 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:49.252441 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-64299894-db63-4d4c-9ad7-93ba6e359b51 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:49.272167 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-64299894-db63-4d4c-9ad7-93ba6e359b51 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:49.277786 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-64299894-db63-4d4c-9ad7-93ba6e359b51 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:49.291105 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-64299894-db63-4d4c-9ad7-93ba6e359b51 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1555 microversion: 2.91 time: 0.378488 Sep 16 12:51:49.304151 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 767/1592] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:48 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1555 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:49.304151 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-5b45105b-336a-46e5-b3d6-e89d75116d56 req-1f278205-465f-4612-bb67-0315b8871774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9070e88-5408-48ab-9f4b-a74368e8f25e", "name": "network-vif-plugged", "status": "completed", "tag": "093f17ab-8dc0-46d4-846c-da7b4807bf31"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:51:49.317118 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-5b45105b-336a-46e5-b3d6-e89d75116d56 req-1f278205-465f-4612-bb67-0315b8871774 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:49.317845 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-5b45105b-336a-46e5-b3d6-e89d75116d56 req-1f278205-465f-4612-bb67-0315b8871774 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:49.318412 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-5b45105b-336a-46e5-b3d6-e89d75116d56 req-1f278205-465f-4612-bb67-0315b8871774 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:49.332979 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-5b45105b-336a-46e5-b3d6-e89d75116d56 req-1f278205-465f-4612-bb67-0315b8871774 service nova] Creating event network-vif-plugged:093f17ab-8dc0-46d4-846c-da7b4807bf31 for instance f9070e88-5408-48ab-9f4b-a74368e8f25e on n-h1-858094-4 Sep 16 12:51:49.340026 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-5b45105b-336a-46e5-b3d6-e89d75116d56 req-1f278205-465f-4612-bb67-0315b8871774 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043977 Sep 16 12:51:49.347577 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 768/1593] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:51:49.356216 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0e809a4d-027d-44a0-b52f-a1d40242a7cd tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:49.356924 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0e809a4d-027d-44a0-b52f-a1d40242a7cd tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:49.363636 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0e809a4d-027d-44a0-b52f-a1d40242a7cd tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:49.364392 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0e809a4d-027d-44a0-b52f-a1d40242a7cd tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:49.365027 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0e809a4d-027d-44a0-b52f-a1d40242a7cd tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:49.366020 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0e809a4d-027d-44a0-b52f-a1d40242a7cd tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:49.366754 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0e809a4d-027d-44a0-b52f-a1d40242a7cd tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:49.367349 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0e809a4d-027d-44a0-b52f-a1d40242a7cd tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:49.673656 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-99adeef0-930d-4cef-8b96-1ff3b899e44f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:49.688312 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-99adeef0-930d-4cef-8b96-1ff3b899e44f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e" status: 200 len: 1506 microversion: 2.1 time: 0.905231 Sep 16 12:51:49.711404 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 826/1594] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:48 2022] GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e => generated 1506 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:49.725388 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6a181372-9d2e-41b1-bbc1-24d7a4e34dfb tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:51:49.731669 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6a181372-9d2e-41b1-bbc1-24d7a4e34dfb tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 4798e026-102b-4ff4-8888-da4bb6b45c08] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:49.771728 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a181372-9d2e-41b1-bbc1-24d7a4e34dfb tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:49.826755 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a181372-9d2e-41b1-bbc1-24d7a4e34dfb tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:49.857693 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a181372-9d2e-41b1-bbc1-24d7a4e34dfb tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.066s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:49.859169 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a181372-9d2e-41b1-bbc1-24d7a4e34dfb tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:49.867757 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a181372-9d2e-41b1-bbc1-24d7a4e34dfb tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:49.868742 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a181372-9d2e-41b1-bbc1-24d7a4e34dfb tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:50.008259 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-6a181372-9d2e-41b1-bbc1-24d7a4e34dfb tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:51:50.012314 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-6a181372-9d2e-41b1-bbc1-24d7a4e34dfb tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:51:50.012944 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-6a181372-9d2e-41b1-bbc1-24d7a4e34dfb tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:51:50.013577 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-6a181372-9d2e-41b1-bbc1-24d7a4e34dfb tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:51:50.022507 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-6a181372-9d2e-41b1-bbc1-24d7a4e34dfb tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:51:50.085736 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:51:50.130499 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6a181372-9d2e-41b1-bbc1-24d7a4e34dfb tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 4798e026-102b-4ff4-8888-da4bb6b45c08] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:50.144148 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a181372-9d2e-41b1-bbc1-24d7a4e34dfb tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:50.148052 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a181372-9d2e-41b1-bbc1-24d7a4e34dfb tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:50.148732 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a181372-9d2e-41b1-bbc1-24d7a4e34dfb tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:50.152688 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a181372-9d2e-41b1-bbc1-24d7a4e34dfb tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:50.153274 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a181372-9d2e-41b1-bbc1-24d7a4e34dfb tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:50.153727 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a181372-9d2e-41b1-bbc1-24d7a4e34dfb tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:50.227465 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6a181372-9d2e-41b1-bbc1-24d7a4e34dfb tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] 10.222.0.67 "POST /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08/action" status: 202 len: 1079 microversion: 2.47 time: 0.508078 Sep 16 12:51:50.230566 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 827/1595] 10.222.0.67 () {62 vars in 1319 bytes} [Fri Sep 16 12:51:49 2022] POST /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08/action => generated 1079 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 16 12:51:50.239390 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8c3b8dbd-d869-4536-8603-ce7e4a7439f3 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:50.240907 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8c3b8dbd-d869-4536-8603-ce7e4a7439f3 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:50.259114 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c3b8dbd-d869-4536-8603-ce7e4a7439f3 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:50.259997 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c3b8dbd-d869-4536-8603-ce7e4a7439f3 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:50.260856 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c3b8dbd-d869-4536-8603-ce7e4a7439f3 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:50.261685 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c3b8dbd-d869-4536-8603-ce7e4a7439f3 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:50.264195 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c3b8dbd-d869-4536-8603-ce7e4a7439f3 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:50.264700 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c3b8dbd-d869-4536-8603-ce7e4a7439f3 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:50.998589 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0e809a4d-027d-44a0-b52f-a1d40242a7cd tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:51.009217 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0e809a4d-027d-44a0-b52f-a1d40242a7cd tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1313 microversion: 2.1 time: 1.660324 Sep 16 12:51:51.012876 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 769/1596] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:49 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1313 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:51.033672 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fda4455a-44a6-4b70-87f6-f55c137c3e27 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:51.049088 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-fda4455a-44a6-4b70-87f6-f55c137c3e27 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 041df092-33d4-4b71-84d8-7cd479d32b4f] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:51.055584 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fda4455a-44a6-4b70-87f6-f55c137c3e27 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:51.056357 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fda4455a-44a6-4b70-87f6-f55c137c3e27 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:51.057003 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fda4455a-44a6-4b70-87f6-f55c137c3e27 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:51.057921 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fda4455a-44a6-4b70-87f6-f55c137c3e27 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:51.058757 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fda4455a-44a6-4b70-87f6-f55c137c3e27 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:51.059358 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fda4455a-44a6-4b70-87f6-f55c137c3e27 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:51.238693 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8c3b8dbd-d869-4536-8603-ce7e4a7439f3 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:51.253993 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8c3b8dbd-d869-4536-8603-ce7e4a7439f3 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1716 microversion: 2.1 time: 1.021430 Sep 16 12:51:51.256787 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 828/1597] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:50 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1716 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:51.265788 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-50cb633f-b8ef-4c59-ba78-1ede7168f67d tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:51.266405 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-50cb633f-b8ef-4c59-ba78-1ede7168f67d tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] [instance: a4906950-755b-4838-b954-fb07189747f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:51.309300 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50cb633f-b8ef-4c59-ba78-1ede7168f67d tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:51.309805 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50cb633f-b8ef-4c59-ba78-1ede7168f67d tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:51.316801 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50cb633f-b8ef-4c59-ba78-1ede7168f67d tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:51.318223 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50cb633f-b8ef-4c59-ba78-1ede7168f67d tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:51.318715 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50cb633f-b8ef-4c59-ba78-1ede7168f67d tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:51.319171 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50cb633f-b8ef-4c59-ba78-1ede7168f67d tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:51.595784 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-fda4455a-44a6-4b70-87f6-f55c137c3e27 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:51.610666 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-fda4455a-44a6-4b70-87f6-f55c137c3e27 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:51.613356 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-fda4455a-44a6-4b70-87f6-f55c137c3e27 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:51.618920 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-fda4455a-44a6-4b70-87f6-f55c137c3e27 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f" status: 200 len: 1567 microversion: 2.25 time: 0.587120 Sep 16 12:51:51.620542 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 770/1598] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:51 2022] GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f => generated 1567 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:51.636107 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-404fe8ee-b100-4eca-b65b-c837582e73be tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:51.637001 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-404fe8ee-b100-4eca-b65b-c837582e73be tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:51.646253 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-50cb633f-b8ef-4c59-ba78-1ede7168f67d tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef3656188f245d2a41252cee95b2064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034ef732e4504d05a4d5d0eea122165e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:51.658194 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-404fe8ee-b100-4eca-b65b-c837582e73be tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:51.658884 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-404fe8ee-b100-4eca-b65b-c837582e73be tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:51.660535 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-50cb633f-b8ef-4c59-ba78-1ede7168f67d tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] 10.222.0.67 "GET /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3" status: 200 len: 1331 microversion: 2.1 time: 0.400546 Sep 16 12:51:51.660811 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-404fe8ee-b100-4eca-b65b-c837582e73be tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:51.661156 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 829/1599] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:51 2022] GET /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3 => generated 1331 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:51.674706 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-404fe8ee-b100-4eca-b65b-c837582e73be tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:51.679773 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-404fe8ee-b100-4eca-b65b-c837582e73be tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:51.679945 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-60edb715-8c06-4dc0-ae24-33198ce1b535 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:51.679945 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-60edb715-8c06-4dc0-ae24-33198ce1b535 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 4798e026-102b-4ff4-8888-da4bb6b45c08] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:51.680807 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-404fe8ee-b100-4eca-b65b-c837582e73be tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:51.687715 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60edb715-8c06-4dc0-ae24-33198ce1b535 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:51.688891 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60edb715-8c06-4dc0-ae24-33198ce1b535 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:51.691895 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60edb715-8c06-4dc0-ae24-33198ce1b535 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:51.692929 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60edb715-8c06-4dc0-ae24-33198ce1b535 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:51.696872 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60edb715-8c06-4dc0-ae24-33198ce1b535 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:51.697511 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60edb715-8c06-4dc0-ae24-33198ce1b535 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:51.719022 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-404fe8ee-b100-4eca-b65b-c837582e73be tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:51.719777 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-404fe8ee-b100-4eca-b65b-c837582e73be tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:51.720402 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-404fe8ee-b100-4eca-b65b-c837582e73be tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:51.721019 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-404fe8ee-b100-4eca-b65b-c837582e73be tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lazy-loading 'fault' on Instance uuid d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:51:51.786048 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=10 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:51:51.826096 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=24 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:51:51.826450 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-404fe8ee-b100-4eca-b65b-c837582e73be tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fd28118c342529cda410e9587dfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a3e6c179c6495281c2816a1e18aa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:51.835251 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-404fe8ee-b100-4eca-b65b-c837582e73be tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0" status: 200 len: 1331 microversion: 2.1 time: 0.210798 Sep 16 12:51:51.848148 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 771/1600] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:51 2022] GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 => generated 1331 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:51.853050 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8bc33ec4-cf0e-411a-b2fb-a08bbaac6a75 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:51.853872 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8bc33ec4-cf0e-411a-b2fb-a08bbaac6a75 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:51.862522 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bc33ec4-cf0e-411a-b2fb-a08bbaac6a75 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:51.863018 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bc33ec4-cf0e-411a-b2fb-a08bbaac6a75 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:51.863457 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bc33ec4-cf0e-411a-b2fb-a08bbaac6a75 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:51.864217 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bc33ec4-cf0e-411a-b2fb-a08bbaac6a75 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:51.864678 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bc33ec4-cf0e-411a-b2fb-a08bbaac6a75 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:51.865098 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bc33ec4-cf0e-411a-b2fb-a08bbaac6a75 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:51.883088 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-60edb715-8c06-4dc0-ae24-33198ce1b535 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:51.904361 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-60edb715-8c06-4dc0-ae24-33198ce1b535 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:51.906552 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-60edb715-8c06-4dc0-ae24-33198ce1b535 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:51.907959 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-60edb715-8c06-4dc0-ae24-33198ce1b535 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] 10.222.0.67 "GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08" status: 200 len: 1366 microversion: 2.47 time: 0.245255 Sep 16 12:51:51.920177 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 830/1601] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:51 2022] GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:51.920177 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-47028779-86e2-449e-a00e-8a64f766c1ed tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:51.920177 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-47028779-86e2-449e-a00e-8a64f766c1ed tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: f9070e88-5408-48ab-9f4b-a74368e8f25e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:51.921174 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47028779-86e2-449e-a00e-8a64f766c1ed tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:51.921998 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47028779-86e2-449e-a00e-8a64f766c1ed tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:51.922619 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47028779-86e2-449e-a00e-8a64f766c1ed tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:51.923802 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47028779-86e2-449e-a00e-8a64f766c1ed tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:51.924765 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47028779-86e2-449e-a00e-8a64f766c1ed tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:51.925516 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47028779-86e2-449e-a00e-8a64f766c1ed tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:51.963525 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8bc33ec4-cf0e-411a-b2fb-a08bbaac6a75 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:51.971969 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8bc33ec4-cf0e-411a-b2fb-a08bbaac6a75 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:51.973537 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8bc33ec4-cf0e-411a-b2fb-a08bbaac6a75 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:51.979561 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8bc33ec4-cf0e-411a-b2fb-a08bbaac6a75 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1555 microversion: 2.91 time: 0.137985 Sep 16 12:51:51.980647 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 772/1602] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:51 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1555 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:51.985523 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-7902b8f5-9d7d-4676-aa29-85a49e5d97da req-debee995-1a00-4f72-b9fe-3c929a01fd85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d16466e6-cdcd-43d7-bc01-bdf3249fdcf0", "name": "network-vif-deleted", "tag": "9fe525ed-e767-4d78-8eff-93ca2a0eb98f"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:51:51.995690 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-7902b8f5-9d7d-4676-aa29-85a49e5d97da req-debee995-1a00-4f72-b9fe-3c929a01fd85 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:51.996246 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-7902b8f5-9d7d-4676-aa29-85a49e5d97da req-debee995-1a00-4f72-b9fe-3c929a01fd85 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:51.996654 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-7902b8f5-9d7d-4676-aa29-85a49e5d97da req-debee995-1a00-4f72-b9fe-3c929a01fd85 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:52.009328 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-7902b8f5-9d7d-4676-aa29-85a49e5d97da req-debee995-1a00-4f72-b9fe-3c929a01fd85 service nova] Creating event network-vif-deleted:9fe525ed-e767-4d78-8eff-93ca2a0eb98f for instance d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 on n-h1-858094-4 Sep 16 12:51:52.015545 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-7902b8f5-9d7d-4676-aa29-85a49e5d97da req-debee995-1a00-4f72-b9fe-3c929a01fd85 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033581 Sep 16 12:51:52.016561 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 773/1603] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:51:52.023003 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-8ab17e18-b054-4cfc-8b4e-56a348e46615 req-af5aa440-5ee8-4907-b72e-c22574b9b261 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d16466e6-cdcd-43d7-bc01-bdf3249fdcf0", "name": "network-vif-unplugged", "status": "completed", "tag": "9fe525ed-e767-4d78-8eff-93ca2a0eb98f"}, {"server_uuid": "a4906950-755b-4838-b954-fb07189747f3", "name": "network-vif-plugged", "status": "completed", "tag": "92b5ca07-8b77-48e8-915c-8ee94ddb3bb2"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:51:52.034364 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-8ab17e18-b054-4cfc-8b4e-56a348e46615 req-af5aa440-5ee8-4907-b72e-c22574b9b261 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:52.034840 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-8ab17e18-b054-4cfc-8b4e-56a348e46615 req-af5aa440-5ee8-4907-b72e-c22574b9b261 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:52.035529 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-8ab17e18-b054-4cfc-8b4e-56a348e46615 req-af5aa440-5ee8-4907-b72e-c22574b9b261 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:52.049523 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-8ab17e18-b054-4cfc-8b4e-56a348e46615 req-af5aa440-5ee8-4907-b72e-c22574b9b261 service nova] Creating event network-vif-unplugged:9fe525ed-e767-4d78-8eff-93ca2a0eb98f for instance d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 on n-h1-858094-4 Sep 16 12:51:52.050037 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-8ab17e18-b054-4cfc-8b4e-56a348e46615 req-af5aa440-5ee8-4907-b72e-c22574b9b261 service nova] Creating event network-vif-plugged:92b5ca07-8b77-48e8-915c-8ee94ddb3bb2 for instance a4906950-755b-4838-b954-fb07189747f3 on n-h2-858094-4 Sep 16 12:51:52.059314 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-8ab17e18-b054-4cfc-8b4e-56a348e46615 req-af5aa440-5ee8-4907-b72e-c22574b9b261 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.041209 Sep 16 12:51:52.060258 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 774/1604] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:51:52.065207 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-f968d1dc-b593-4fe5-861d-8790d24aa715 req-b530b656-ed5a-4311-9b69-1ee51f4f0f41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1afdaec3-fdf0-4eac-a324-c0f8eaa6797b", "tag": "bf12465f-8132-474a-94b1-e3b53f03df41"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:51:52.075130 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-47028779-86e2-449e-a00e-8a64f766c1ed tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:52.075440 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-f968d1dc-b593-4fe5-861d-8790d24aa715 req-b530b656-ed5a-4311-9b69-1ee51f4f0f41 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:52.075923 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-f968d1dc-b593-4fe5-861d-8790d24aa715 req-b530b656-ed5a-4311-9b69-1ee51f4f0f41 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:52.076469 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-f968d1dc-b593-4fe5-861d-8790d24aa715 req-b530b656-ed5a-4311-9b69-1ee51f4f0f41 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:52.083251 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-47028779-86e2-449e-a00e-8a64f766c1ed tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e" status: 200 len: 1488 microversion: 2.1 time: 0.173296 Sep 16 12:51:52.083840 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 831/1605] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:51 2022] GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e => generated 1488 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:52.087226 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-f968d1dc-b593-4fe5-861d-8790d24aa715 req-b530b656-ed5a-4311-9b69-1ee51f4f0f41 service nova] Creating event network-changed:bf12465f-8132-474a-94b1-e3b53f03df41 for instance 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b on n-h2-858094-4 Sep 16 12:51:52.088460 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fca96e42-021b-4843-9237-5b095f1fff69 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:52.089320 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fca96e42-021b-4843-9237-5b095f1fff69 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:52.092340 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-f968d1dc-b593-4fe5-861d-8790d24aa715 req-b530b656-ed5a-4311-9b69-1ee51f4f0f41 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030769 Sep 16 12:51:52.093126 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 775/1606] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:51:52.095672 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fca96e42-021b-4843-9237-5b095f1fff69 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:52.096378 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fca96e42-021b-4843-9237-5b095f1fff69 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:52.096741 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fca96e42-021b-4843-9237-5b095f1fff69 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:52.097357 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fca96e42-021b-4843-9237-5b095f1fff69 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:52.098023 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fca96e42-021b-4843-9237-5b095f1fff69 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:52.098671 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fca96e42-021b-4843-9237-5b095f1fff69 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:52.109120 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0b637846-cb88-4607-bf7b-578a1cdcf7e1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:52.109705 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0b637846-cb88-4607-bf7b-578a1cdcf7e1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: f9070e88-5408-48ab-9f4b-a74368e8f25e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:52.117286 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0b637846-cb88-4607-bf7b-578a1cdcf7e1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:52.117859 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0b637846-cb88-4607-bf7b-578a1cdcf7e1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:52.118421 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0b637846-cb88-4607-bf7b-578a1cdcf7e1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:52.119214 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0b637846-cb88-4607-bf7b-578a1cdcf7e1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:52.120199 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0b637846-cb88-4607-bf7b-578a1cdcf7e1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:52.120718 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0b637846-cb88-4607-bf7b-578a1cdcf7e1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:52.149451 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0b637846-cb88-4607-bf7b-578a1cdcf7e1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: f9070e88-5408-48ab-9f4b-a74368e8f25e] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:51:52.236986 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0b637846-cb88-4607-bf7b-578a1cdcf7e1 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e" status: 204 len: 0 microversion: 2.1 time: 0.132366 Sep 16 12:51:52.242770 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 776/1607] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:51:52 2022] DELETE /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:51:52.251727 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4c1018cb-303c-41d6-8e49-83fe1087f307 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f1039a93ee0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:52.266150 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fca96e42-021b-4843-9237-5b095f1fff69 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:52.273983 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fca96e42-021b-4843-9237-5b095f1fff69 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1313 microversion: 2.1 time: 0.189076 Sep 16 12:51:52.274862 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 832/1608] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:52 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:52.281562 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8ffd18b2-a315-4431-bc07-915910b9a255 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:52.282282 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8ffd18b2-a315-4431-bc07-915910b9a255 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:52.288881 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ffd18b2-a315-4431-bc07-915910b9a255 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:52.289673 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ffd18b2-a315-4431-bc07-915910b9a255 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:52.290786 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ffd18b2-a315-4431-bc07-915910b9a255 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:52.290915 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ffd18b2-a315-4431-bc07-915910b9a255 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:52.291953 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ffd18b2-a315-4431-bc07-915910b9a255 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:52.292477 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ffd18b2-a315-4431-bc07-915910b9a255 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:52.321832 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-4c1018cb-303c-41d6-8e49-83fe1087f307 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] HTTP exception thrown: Image not found. Sep 16 12:51:52.325805 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4c1018cb-303c-41d6-8e49-83fe1087f307 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Request method failure captured: Sep 16 12:51:52.325805 n-d-858094-4 devstack@n-api.service[128780]: request: DELETE /compute/v2.1/images/7295f227-b0f5-4cf6-9774-a6670b259cd5 HTTP/1.1 Sep 16 12:51:52.325805 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:51:52.325805 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:51:52.325805 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:51:52.325805 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:51:52.325805 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:51:52.325805 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:51:52.325805 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:51:52.325805 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:51:52.325805 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHBls5iww8LeNdGfN3Bt6xT3u64vTQpoFqqS_yYvzsbwThKqraYEgvm-TdmuqPPz7mGkP9XHyURnG4NYJ545iZv6yPCgHdajJlEkh27p7U2bf14vD5cf-sXeqVlOowoXVEnizOzsThYBaLh4g8eNB_RsSBiHvaFUpYtbB3XbCuVO8vc Sep 16 12:51:52.325805 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:51:52.325805 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:51:52.325805 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:51:52.325805 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:51:52.325805 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:51:52.325805 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:51:52.325805 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: e6fa2067c44b42b5aa940619abd8e538 Sep 16 12:51:52.325805 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ImagesTestJSON-969058415 Sep 16 12:51:52.325805 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:51:52.325805 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:51:52.327481 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e6fa2067c44b42b5aa940619abd8e538"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e6fa2067c44b42b5aa940619abd8e538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e6fa2067c44b42b5aa940619abd8e538", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e6fa2067c44b42b5aa940619abd8e538"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:51:52.327481 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ImagesTestJSON-969058415 Sep 16 12:51:52.327481 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: e6fa2067c44b42b5aa940619abd8e538 Sep 16 12:51:52.327481 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ImagesTestJSON-969058415 Sep 16 12:51:52.327481 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ImagesTestJSON-969058415-project Sep 16 12:51:52.327481 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:51:52.327481 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:51:52.327481 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 0cf11dfc3438406ba2710b06fa0fe8ff Sep 16 12:51:52.327481 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ImagesTestJSON-969058415-project Sep 16 12:51:52.327481 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 12:51:52.327481 n-d-858094-4 devstack@n-api.service[128780]: exception: Image not found. Sep 16 12:51:52.327481 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '7295f227-b0f5-4cf6-9774-a6670b259cd5'} Sep 16 12:51:52.327481 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:51:52.327481 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:52.328409 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 16 12:51:52.328409 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 16 12:51:52.328409 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 12:51:52.328409 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 12:51:52.328409 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 12:51:52.328409 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 12:51:52.328409 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 16 12:51:52.328409 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 16 12:51:52.328409 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 16 12:51:52.328409 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 16 12:51:52.328409 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 12:51:52.328409 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 12:51:52.328409 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 12:51:52.328409 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 12:51:52.328409 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7295f227-b0f5-4cf6-9774-a6670b259cd5 to delete Sep 16 12:51:52.328409 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:52.328409 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:52.328409 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:52.328409 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:52.329667 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 16 12:51:52.329667 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 16 12:51:52.329667 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 16 12:51:52.329667 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 16 12:51:52.329667 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 16 12:51:52.329667 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 16 12:51:52.329667 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7295f227-b0f5-4cf6-9774-a6670b259cd5 could not be found. Sep 16 12:51:52.329667 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:52.329667 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:52.329667 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:52.329667 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:52.329667 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:51:52.329667 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:51:52.329667 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:51:52.329667 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:51:52.329667 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:51:52.329667 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:51:52.329667 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:51:52.329667 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:51:52.329667 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 16 12:51:52.330921 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 16 12:51:52.330921 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 12:51:52.330921 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:52.330921 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:52.330921 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:52.330921 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:52.330921 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:51:52.330921 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:51:52.330921 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:51:52.330921 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:51:52.330921 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 12:51:52.330921 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:52.330921 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4c1018cb-303c-41d6-8e49-83fe1087f307 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Returning 404 to user: Image not found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:51:52.330921 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4c1018cb-303c-41d6-8e49-83fe1087f307 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "DELETE /compute/v2.1/images/7295f227-b0f5-4cf6-9774-a6670b259cd5" status: 404 len: 62 microversion: 2.1 time: 0.080179 Sep 16 12:51:52.330921 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 777/1609] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:52 2022] DELETE /compute/v2.1/images/7295f227-b0f5-4cf6-9774-a6670b259cd5 => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 12:51:52.335976 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1f41c41e-258b-4ddd-8175-df12e61911ea tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:52.336619 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-1f41c41e-258b-4ddd-8175-df12e61911ea tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: f9070e88-5408-48ab-9f4b-a74368e8f25e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:52.344777 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1f41c41e-258b-4ddd-8175-df12e61911ea tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:52.345278 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1f41c41e-258b-4ddd-8175-df12e61911ea tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:52.346864 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1f41c41e-258b-4ddd-8175-df12e61911ea tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:52.347592 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1f41c41e-258b-4ddd-8175-df12e61911ea tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:52.348055 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1f41c41e-258b-4ddd-8175-df12e61911ea tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:52.348541 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1f41c41e-258b-4ddd-8175-df12e61911ea tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:52.384484 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-1f41c41e-258b-4ddd-8175-df12e61911ea tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: f9070e88-5408-48ab-9f4b-a74368e8f25e] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:51:52.459391 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.compute.api [None req-1f41c41e-258b-4ddd-8175-df12e61911ea tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: f9070e88-5408-48ab-9f4b-a74368e8f25e] Instance is already in deleting state, ignoring this request Sep 16 12:51:52.460140 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1f41c41e-258b-4ddd-8175-df12e61911ea tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e" status: 204 len: 0 microversion: 2.1 time: 0.127944 Sep 16 12:51:52.460722 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 778/1610] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:51:52 2022] DELETE /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:51:52.468837 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4750c901-8008-425a-a4e4-1c04030bad5f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:52.469447 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-4750c901-8008-425a-a4e4-1c04030bad5f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: f9070e88-5408-48ab-9f4b-a74368e8f25e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:52.470974 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8ffd18b2-a315-4431-bc07-915910b9a255 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:52.476368 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4750c901-8008-425a-a4e4-1c04030bad5f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:52.476859 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4750c901-8008-425a-a4e4-1c04030bad5f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:52.477288 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4750c901-8008-425a-a4e4-1c04030bad5f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:52.477983 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4750c901-8008-425a-a4e4-1c04030bad5f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:52.478704 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4750c901-8008-425a-a4e4-1c04030bad5f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:52.479753 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4750c901-8008-425a-a4e4-1c04030bad5f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:52.481407 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8ffd18b2-a315-4431-bc07-915910b9a255 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1716 microversion: 2.1 time: 0.203546 Sep 16 12:51:52.482557 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 833/1611] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:52 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1716 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:51:52.626786 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4750c901-8008-425a-a4e4-1c04030bad5f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:52.634928 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4750c901-8008-425a-a4e4-1c04030bad5f tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e" status: 200 len: 1494 microversion: 2.1 time: 0.169894 Sep 16 12:51:52.635528 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 779/1612] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:52 2022] GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e => generated 1494 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:51:52.646883 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c6fa82d9-3ff5-47d4-a00b-8e3597ba291a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:52.647495 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c6fa82d9-3ff5-47d4-a00b-8e3597ba291a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 041df092-33d4-4b71-84d8-7cd479d32b4f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:52.654891 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6fa82d9-3ff5-47d4-a00b-8e3597ba291a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:52.655471 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6fa82d9-3ff5-47d4-a00b-8e3597ba291a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:52.655913 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6fa82d9-3ff5-47d4-a00b-8e3597ba291a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:52.656738 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6fa82d9-3ff5-47d4-a00b-8e3597ba291a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:52.657188 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6fa82d9-3ff5-47d4-a00b-8e3597ba291a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:52.657609 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6fa82d9-3ff5-47d4-a00b-8e3597ba291a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:52.686847 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c43c1a46-dbec-4abd-9cef-c7a87d972e12 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:52.687492 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c43c1a46-dbec-4abd-9cef-c7a87d972e12 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] [instance: a4906950-755b-4838-b954-fb07189747f3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:52.693514 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c43c1a46-dbec-4abd-9cef-c7a87d972e12 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:52.693995 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c43c1a46-dbec-4abd-9cef-c7a87d972e12 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:52.694429 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c43c1a46-dbec-4abd-9cef-c7a87d972e12 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:52.695117 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c43c1a46-dbec-4abd-9cef-c7a87d972e12 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:52.695564 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c43c1a46-dbec-4abd-9cef-c7a87d972e12 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:52.695992 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c43c1a46-dbec-4abd-9cef-c7a87d972e12 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:52.850164 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c6fa82d9-3ff5-47d4-a00b-8e3597ba291a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:52.859617 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c6fa82d9-3ff5-47d4-a00b-8e3597ba291a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:52.861105 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c6fa82d9-3ff5-47d4-a00b-8e3597ba291a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:52.862291 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c6fa82d9-3ff5-47d4-a00b-8e3597ba291a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f" status: 200 len: 1567 microversion: 2.25 time: 0.219456 Sep 16 12:51:52.862855 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 834/1613] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:52 2022] GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f => generated 1567 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:52.867564 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-99e1b6c7-23c5-46e8-913b-735c653e6255 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:52.868192 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-99e1b6c7-23c5-46e8-913b-735c653e6255 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:52.875613 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99e1b6c7-23c5-46e8-913b-735c653e6255 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:52.876201 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99e1b6c7-23c5-46e8-913b-735c653e6255 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:52.876559 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99e1b6c7-23c5-46e8-913b-735c653e6255 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:52.877269 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99e1b6c7-23c5-46e8-913b-735c653e6255 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:52.877722 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99e1b6c7-23c5-46e8-913b-735c653e6255 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:52.878144 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99e1b6c7-23c5-46e8-913b-735c653e6255 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:52.879602 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c43c1a46-dbec-4abd-9cef-c7a87d972e12 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef3656188f245d2a41252cee95b2064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034ef732e4504d05a4d5d0eea122165e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:52.888394 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c43c1a46-dbec-4abd-9cef-c7a87d972e12 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] 10.222.0.67 "GET /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3" status: 200 len: 1331 microversion: 2.1 time: 0.205344 Sep 16 12:51:52.889060 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 780/1614] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:52 2022] GET /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3 => generated 1331 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:51:52.910883 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99e1b6c7-23c5-46e8-913b-735c653e6255 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:52.911361 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99e1b6c7-23c5-46e8-913b-735c653e6255 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:52.911789 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99e1b6c7-23c5-46e8-913b-735c653e6255 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:52.912268 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-99e1b6c7-23c5-46e8-913b-735c653e6255 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lazy-loading 'fault' on Instance uuid d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:51:52.935509 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4e4b9a12-008e-4199-9201-d76ad3c5e2be tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:52.936139 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-4e4b9a12-008e-4199-9201-d76ad3c5e2be tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 4798e026-102b-4ff4-8888-da4bb6b45c08] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:52.942202 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4e4b9a12-008e-4199-9201-d76ad3c5e2be tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:52.942697 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4e4b9a12-008e-4199-9201-d76ad3c5e2be tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:52.943114 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4e4b9a12-008e-4199-9201-d76ad3c5e2be tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:52.943816 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4e4b9a12-008e-4199-9201-d76ad3c5e2be tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:52.944295 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4e4b9a12-008e-4199-9201-d76ad3c5e2be tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:52.944723 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4e4b9a12-008e-4199-9201-d76ad3c5e2be tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:52.954662 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-99e1b6c7-23c5-46e8-913b-735c653e6255 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fd28118c342529cda410e9587dfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a3e6c179c6495281c2816a1e18aa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:52.962918 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-99e1b6c7-23c5-46e8-913b-735c653e6255 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0" status: 200 len: 1331 microversion: 2.1 time: 0.099090 Sep 16 12:51:52.963663 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 835/1615] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:52 2022] GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:53.011249 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0a393aa3-f853-479b-bdec-715113486b6d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:53.011749 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0a393aa3-f853-479b-bdec-715113486b6d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:53.017965 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a393aa3-f853-479b-bdec-715113486b6d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:53.018477 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a393aa3-f853-479b-bdec-715113486b6d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:53.018912 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a393aa3-f853-479b-bdec-715113486b6d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:53.019604 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a393aa3-f853-479b-bdec-715113486b6d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:53.020056 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a393aa3-f853-479b-bdec-715113486b6d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:53.020515 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a393aa3-f853-479b-bdec-715113486b6d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:53.053555 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4e4b9a12-008e-4199-9201-d76ad3c5e2be tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:53.063136 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4e4b9a12-008e-4199-9201-d76ad3c5e2be tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:53.064609 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4e4b9a12-008e-4199-9201-d76ad3c5e2be tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:53.065785 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4e4b9a12-008e-4199-9201-d76ad3c5e2be tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] 10.222.0.67 "GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08" status: 200 len: 1366 microversion: 2.47 time: 0.135579 Sep 16 12:51:53.066357 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 781/1616] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:52 2022] GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08 => generated 1366 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:51:53.089966 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0a393aa3-f853-479b-bdec-715113486b6d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:53.098576 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0a393aa3-f853-479b-bdec-715113486b6d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:53.100002 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0a393aa3-f853-479b-bdec-715113486b6d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:53.105420 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0a393aa3-f853-479b-bdec-715113486b6d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1537 microversion: 2.91 time: 0.098500 Sep 16 12:51:53.105988 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 836/1617] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:53 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1537 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:51:53.298173 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-532d9a27-4fac-4f00-9d7c-f6e39b996bc1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:53.298686 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-532d9a27-4fac-4f00-9d7c-f6e39b996bc1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:53.305274 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-532d9a27-4fac-4f00-9d7c-f6e39b996bc1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:53.305754 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-532d9a27-4fac-4f00-9d7c-f6e39b996bc1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:53.306212 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-532d9a27-4fac-4f00-9d7c-f6e39b996bc1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:53.306896 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-532d9a27-4fac-4f00-9d7c-f6e39b996bc1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:53.307953 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-532d9a27-4fac-4f00-9d7c-f6e39b996bc1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:53.308586 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-532d9a27-4fac-4f00-9d7c-f6e39b996bc1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:53.439547 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-532d9a27-4fac-4f00-9d7c-f6e39b996bc1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:53.447225 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-532d9a27-4fac-4f00-9d7c-f6e39b996bc1 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1313 microversion: 2.1 time: 0.153035 Sep 16 12:51:53.447805 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 782/1618] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:53 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:53.506894 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-41d8fbff-6ce0-4a2d-b3a5-7fa55f7c2435 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:53.507674 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-41d8fbff-6ce0-4a2d-b3a5-7fa55f7c2435 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:53.514398 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41d8fbff-6ce0-4a2d-b3a5-7fa55f7c2435 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:53.514886 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41d8fbff-6ce0-4a2d-b3a5-7fa55f7c2435 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:53.515328 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41d8fbff-6ce0-4a2d-b3a5-7fa55f7c2435 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:53.516034 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41d8fbff-6ce0-4a2d-b3a5-7fa55f7c2435 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:53.516525 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41d8fbff-6ce0-4a2d-b3a5-7fa55f7c2435 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:53.516949 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41d8fbff-6ce0-4a2d-b3a5-7fa55f7c2435 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:53.650209 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-41d8fbff-6ce0-4a2d-b3a5-7fa55f7c2435 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:53.658728 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d69c3630-3b65-403b-b662-d77275cdbb4a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:53.659447 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d69c3630-3b65-403b-b662-d77275cdbb4a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: f9070e88-5408-48ab-9f4b-a74368e8f25e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:53.660810 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-41d8fbff-6ce0-4a2d-b3a5-7fa55f7c2435 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1716 microversion: 2.1 time: 0.157818 Sep 16 12:51:53.661658 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 837/1619] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:53 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1716 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:53.666225 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d69c3630-3b65-403b-b662-d77275cdbb4a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:53.667501 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d69c3630-3b65-403b-b662-d77275cdbb4a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:53.668345 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d69c3630-3b65-403b-b662-d77275cdbb4a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:53.669323 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d69c3630-3b65-403b-b662-d77275cdbb4a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:53.669914 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d69c3630-3b65-403b-b662-d77275cdbb4a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:53.670455 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d69c3630-3b65-403b-b662-d77275cdbb4a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:53.675979 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:51:53.813051 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d69c3630-3b65-403b-b662-d77275cdbb4a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:53.820640 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d69c3630-3b65-403b-b662-d77275cdbb4a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e" status: 200 len: 1494 microversion: 2.1 time: 0.165907 Sep 16 12:51:53.821218 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 783/1620] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:53 2022] GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e => generated 1494 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:53.888223 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d44c406d-c04e-4347-b2cb-7272eb4134e5 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:53.888745 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d44c406d-c04e-4347-b2cb-7272eb4134e5 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 041df092-33d4-4b71-84d8-7cd479d32b4f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:53.895360 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d44c406d-c04e-4347-b2cb-7272eb4134e5 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:53.895853 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d44c406d-c04e-4347-b2cb-7272eb4134e5 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:53.896341 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d44c406d-c04e-4347-b2cb-7272eb4134e5 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:53.897043 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d44c406d-c04e-4347-b2cb-7272eb4134e5 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:53.897500 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d44c406d-c04e-4347-b2cb-7272eb4134e5 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:53.897925 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d44c406d-c04e-4347-b2cb-7272eb4134e5 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:53.910747 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-03b574b2-5e67-4a8d-b71c-e60253784d35 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:53.911351 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-03b574b2-5e67-4a8d-b71c-e60253784d35 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] [instance: a4906950-755b-4838-b954-fb07189747f3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:53.918378 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-03b574b2-5e67-4a8d-b71c-e60253784d35 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:53.918856 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-03b574b2-5e67-4a8d-b71c-e60253784d35 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:53.919291 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-03b574b2-5e67-4a8d-b71c-e60253784d35 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:53.919978 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-03b574b2-5e67-4a8d-b71c-e60253784d35 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:53.920461 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-03b574b2-5e67-4a8d-b71c-e60253784d35 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:53.920879 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-03b574b2-5e67-4a8d-b71c-e60253784d35 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:54.145930 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d44c406d-c04e-4347-b2cb-7272eb4134e5 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:54.155518 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d44c406d-c04e-4347-b2cb-7272eb4134e5 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:54.157335 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d44c406d-c04e-4347-b2cb-7272eb4134e5 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:54.158630 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d44c406d-c04e-4347-b2cb-7272eb4134e5 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f" status: 200 len: 1567 microversion: 2.25 time: 0.274846 Sep 16 12:51:54.159203 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 838/1621] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:53 2022] GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f => generated 1567 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:54.164096 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-09955255-8353-401d-b566-57fbf7eab1d2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:54.164733 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-09955255-8353-401d-b566-57fbf7eab1d2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:54.171538 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09955255-8353-401d-b566-57fbf7eab1d2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:54.172034 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09955255-8353-401d-b566-57fbf7eab1d2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:54.172502 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09955255-8353-401d-b566-57fbf7eab1d2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:54.173200 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09955255-8353-401d-b566-57fbf7eab1d2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:54.173708 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09955255-8353-401d-b566-57fbf7eab1d2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:54.174074 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09955255-8353-401d-b566-57fbf7eab1d2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:54.185069 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-03b574b2-5e67-4a8d-b71c-e60253784d35 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef3656188f245d2a41252cee95b2064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034ef732e4504d05a4d5d0eea122165e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:54.190593 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-09955255-8353-401d-b566-57fbf7eab1d2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] HTTP exception thrown: Instance d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 could not be found. Sep 16 12:51:54.192185 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-09955255-8353-401d-b566-57fbf7eab1d2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Request method failure captured: Sep 16 12:51:54.192185 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 HTTP/1.1 Sep 16 12:51:54.192185 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:51:54.192185 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:51:54.192185 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:51:54.192185 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:51:54.192185 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:51:54.192185 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:51:54.192185 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:51:54.192185 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:51:54.192185 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHB33MmKtVepdP3tP-i3P2SYaWbhlmKsFGTwHUG3fpikpDGiY3FVLPEKhzq6YTFGogWZz2ERsnmdLmeZ8PTDNrC0RU9ltWZS1YHL53QNaW1-H2U8tdY_9eYKhQhHhiqOgrONMcJzCOlckV15AdG8cHfAAnPMY0sWQ9KMvLr4xkNqUtk Sep 16 12:51:54.192185 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:51:54.192185 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:51:54.192185 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:51:54.192185 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:51:54.192185 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:51:54.192185 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:51:54.192185 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 97a3e6c179c6495281c2816a1e18aa7e Sep 16 12:51:54.192185 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2026917510 Sep 16 12:51:54.192185 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:51:54.192185 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:51:54.193955 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/97a3e6c179c6495281c2816a1e18aa7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/97a3e6c179c6495281c2816a1e18aa7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_97a3e6c179c6495281c2816a1e18aa7e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/97a3e6c179c6495281c2816a1e18aa7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:51:54.193955 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2026917510 Sep 16 12:51:54.193955 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 97a3e6c179c6495281c2816a1e18aa7e Sep 16 12:51:54.193955 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2026917510 Sep 16 12:51:54.193955 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-AttachSCSIVolumeTestJSON-2026917510-project Sep 16 12:51:54.193955 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:51:54.193955 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:51:54.193955 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 687fd28118c342529cda410e9587dfd0 Sep 16 12:51:54.193955 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2026917510-project Sep 16 12:51:54.193955 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:51:54.193955 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 could not be found. Sep 16 12:51:54.193955 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': 'd16466e6-cdcd-43d7-bc01-bdf3249fdcf0'} Sep 16 12:51:54.194825 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:51:54.194825 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:54.194825 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:51:54.194825 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:51:54.194825 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:51:54.194825 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:51:54.194825 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:51:54.194825 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:51:54.194825 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:51:54.194825 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:51:54.194825 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 could not be found. Sep 16 12:51:54.194825 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:54.194825 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:54.194825 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:54.194825 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:54.194825 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:51:54.194825 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:51:54.194825 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:51:54.194825 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:51:54.194825 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:51:54.197055 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:51:54.197055 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:51:54.197055 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:51:54.197055 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:51:54.197055 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:51:54.197055 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:51:54.197055 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:51:54.197055 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 could not be found. Sep 16 12:51:54.197055 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:54.197055 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:54.197055 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:54.197055 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:54.197055 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:51:54.197055 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:51:54.197055 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:51:54.197055 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:51:54.197055 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 could not be found. Sep 16 12:51:54.197055 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:54.202131 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-09955255-8353-401d-b566-57fbf7eab1d2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Returning 404 to user: Instance d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:51:54.202131 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-09955255-8353-401d-b566-57fbf7eab1d2 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0" status: 404 len: 111 microversion: 2.1 time: 0.033457 Sep 16 12:51:54.202451 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-03b574b2-5e67-4a8d-b71c-e60253784d35 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] 10.222.0.67 "GET /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3" status: 200 len: 1331 microversion: 2.1 time: 0.286941 Sep 16 12:51:54.202625 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 839/1622] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:54 2022] GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:51:54.202625 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-860caef9-0c48-4a8a-b769-2272c0e00eba tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:54.202625 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-860caef9-0c48-4a8a-b769-2272c0e00eba tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 4798e026-102b-4ff4-8888-da4bb6b45c08] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:54.206779 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-860caef9-0c48-4a8a-b769-2272c0e00eba tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:54.207266 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-860caef9-0c48-4a8a-b769-2272c0e00eba tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:54.207700 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-860caef9-0c48-4a8a-b769-2272c0e00eba tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:54.208426 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-860caef9-0c48-4a8a-b769-2272c0e00eba tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:54.208745 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 784/1623] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:53 2022] GET /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3 => generated 1331 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:51:54.208915 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-860caef9-0c48-4a8a-b769-2272c0e00eba tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:54.209456 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-860caef9-0c48-4a8a-b769-2272c0e00eba tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:54.213743 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9bc8a7be-db19-41f3-be63-63ed77cb8391 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:54.215620 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9bc8a7be-db19-41f3-be63-63ed77cb8391 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:54.222282 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9bc8a7be-db19-41f3-be63-63ed77cb8391 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:54.222826 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9bc8a7be-db19-41f3-be63-63ed77cb8391 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:54.223264 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9bc8a7be-db19-41f3-be63-63ed77cb8391 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:54.223964 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9bc8a7be-db19-41f3-be63-63ed77cb8391 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:54.224643 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9bc8a7be-db19-41f3-be63-63ed77cb8391 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:54.225064 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9bc8a7be-db19-41f3-be63-63ed77cb8391 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:54.324721 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-860caef9-0c48-4a8a-b769-2272c0e00eba tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:54.328131 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9bc8a7be-db19-41f3-be63-63ed77cb8391 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:54.340713 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9bc8a7be-db19-41f3-be63-63ed77cb8391 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:54.341191 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-860caef9-0c48-4a8a-b769-2272c0e00eba tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:54.342638 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-860caef9-0c48-4a8a-b769-2272c0e00eba tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:54.343819 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-860caef9-0c48-4a8a-b769-2272c0e00eba tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] 10.222.0.67 "GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08" status: 200 len: 1366 microversion: 2.47 time: 0.148793 Sep 16 12:51:54.344604 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 840/1624] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:54 2022] GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:54.346315 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9bc8a7be-db19-41f3-be63-63ed77cb8391 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:54.353541 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9bc8a7be-db19-41f3-be63-63ed77cb8391 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1537 microversion: 2.91 time: 0.143676 Sep 16 12:51:54.356213 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 785/1625] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:54 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1537 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:54.368453 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-db8229f7-1cbc-4928-83d6-28fbda8ac8ab tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '.version_select at 0x7f103546c310>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:54.389646 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-db8229f7-1cbc-4928-83d6-28fbda8ac8ab tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-323052697" status: 202 len: 0 microversion: 2.1 time: 0.033885 Sep 16 12:51:54.390356 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 841/1626] 10.222.0.67 () {58 vars in 1218 bytes} [Fri Sep 16 12:51:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-323052697 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:51:54.470159 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fe3a002b-8252-4c13-a021-6518dde80cc3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:54.471085 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-fe3a002b-8252-4c13-a021-6518dde80cc3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:54.477170 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe3a002b-8252-4c13-a021-6518dde80cc3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:54.477792 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe3a002b-8252-4c13-a021-6518dde80cc3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:54.478091 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe3a002b-8252-4c13-a021-6518dde80cc3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:54.479328 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe3a002b-8252-4c13-a021-6518dde80cc3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:54.480024 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe3a002b-8252-4c13-a021-6518dde80cc3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:54.480638 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe3a002b-8252-4c13-a021-6518dde80cc3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:54.580339 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-88559497-9679-4bcf-8067-2d0b0db93e1c req-429fc30c-2d79-422e-87ee-ead9c866ab5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "041df092-33d4-4b71-84d8-7cd479d32b4f", "name": "network-vif-unplugged", "status": "completed", "tag": "756cd197-6a93-4b4a-b498-7ebcbb3246c2"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:51:54.596847 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-88559497-9679-4bcf-8067-2d0b0db93e1c req-429fc30c-2d79-422e-87ee-ead9c866ab5f service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:54.597545 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-88559497-9679-4bcf-8067-2d0b0db93e1c req-429fc30c-2d79-422e-87ee-ead9c866ab5f service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:54.598163 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-88559497-9679-4bcf-8067-2d0b0db93e1c req-429fc30c-2d79-422e-87ee-ead9c866ab5f service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:54.615600 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-88559497-9679-4bcf-8067-2d0b0db93e1c req-429fc30c-2d79-422e-87ee-ead9c866ab5f service nova] Creating event network-vif-unplugged:756cd197-6a93-4b4a-b498-7ebcbb3246c2 for instance 041df092-33d4-4b71-84d8-7cd479d32b4f on n-h2-858094-4 Sep 16 12:51:54.622911 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-88559497-9679-4bcf-8067-2d0b0db93e1c req-429fc30c-2d79-422e-87ee-ead9c866ab5f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051794 Sep 16 12:51:54.624352 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 842/1627] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:51:54.691891 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-675873c7-4c2d-4998-afc7-65944650e496 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:54.692646 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-675873c7-4c2d-4998-afc7-65944650e496 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:54.699425 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-675873c7-4c2d-4998-afc7-65944650e496 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:54.699917 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-675873c7-4c2d-4998-afc7-65944650e496 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:54.700382 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-675873c7-4c2d-4998-afc7-65944650e496 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:54.701250 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-675873c7-4c2d-4998-afc7-65944650e496 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:54.702790 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-675873c7-4c2d-4998-afc7-65944650e496 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:54.703221 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-675873c7-4c2d-4998-afc7-65944650e496 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:54.852145 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-fe3a002b-8252-4c13-a021-6518dde80cc3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:54.862518 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-fe3a002b-8252-4c13-a021-6518dde80cc3 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1313 microversion: 2.1 time: 0.396155 Sep 16 12:51:54.877931 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 786/1628] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:54 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1313 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:54.890307 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6a6c76ca-8802-49ad-bf87-0912710222c6 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:54.891176 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6a6c76ca-8802-49ad-bf87-0912710222c6 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: f9070e88-5408-48ab-9f4b-a74368e8f25e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:54.898475 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:51:54.900598 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6a6c76ca-8802-49ad-bf87-0912710222c6 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:54.902347 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6a6c76ca-8802-49ad-bf87-0912710222c6 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:54.903228 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6a6c76ca-8802-49ad-bf87-0912710222c6 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:54.904223 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6a6c76ca-8802-49ad-bf87-0912710222c6 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:54.904888 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6a6c76ca-8802-49ad-bf87-0912710222c6 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:54.905545 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6a6c76ca-8802-49ad-bf87-0912710222c6 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:55.140274 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-675873c7-4c2d-4998-afc7-65944650e496 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:55.149561 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-675873c7-4c2d-4998-afc7-65944650e496 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1716 microversion: 2.1 time: 0.463704 Sep 16 12:51:55.150283 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 843/1629] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:54 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1716 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:51:55.185201 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ab78d2e5-c59a-46b0-884e-f389ade6e321 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:55.185736 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ab78d2e5-c59a-46b0-884e-f389ade6e321 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 041df092-33d4-4b71-84d8-7cd479d32b4f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:55.191649 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab78d2e5-c59a-46b0-884e-f389ade6e321 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:55.192163 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab78d2e5-c59a-46b0-884e-f389ade6e321 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:55.192598 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab78d2e5-c59a-46b0-884e-f389ade6e321 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:55.193496 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab78d2e5-c59a-46b0-884e-f389ade6e321 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:55.193947 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab78d2e5-c59a-46b0-884e-f389ade6e321 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:55.194369 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab78d2e5-c59a-46b0-884e-f389ade6e321 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:55.272986 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6a6c76ca-8802-49ad-bf87-0912710222c6 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:55.282859 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6a6c76ca-8802-49ad-bf87-0912710222c6 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e" status: 200 len: 1494 microversion: 2.1 time: 0.403573 Sep 16 12:51:55.283625 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 787/1630] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:54 2022] GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e => generated 1494 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:55.288524 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8abcd6d4-d9b9-4e6a-a89f-7ae80fc119df tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:55.289477 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8abcd6d4-d9b9-4e6a-a89f-7ae80fc119df tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] [instance: a4906950-755b-4838-b954-fb07189747f3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:55.297638 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8abcd6d4-d9b9-4e6a-a89f-7ae80fc119df tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:55.298520 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8abcd6d4-d9b9-4e6a-a89f-7ae80fc119df tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:55.299108 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8abcd6d4-d9b9-4e6a-a89f-7ae80fc119df tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:55.300234 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8abcd6d4-d9b9-4e6a-a89f-7ae80fc119df tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:55.300924 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8abcd6d4-d9b9-4e6a-a89f-7ae80fc119df tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:55.301579 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8abcd6d4-d9b9-4e6a-a89f-7ae80fc119df tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:55.554790 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ab78d2e5-c59a-46b0-884e-f389ade6e321 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:55.566392 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ab78d2e5-c59a-46b0-884e-f389ade6e321 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:55.567969 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ab78d2e5-c59a-46b0-884e-f389ade6e321 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:55.569265 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ab78d2e5-c59a-46b0-884e-f389ade6e321 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f" status: 200 len: 1567 microversion: 2.25 time: 0.388953 Sep 16 12:51:55.570056 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 844/1631] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:55 2022] GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f => generated 1567 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:51:55.575276 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-95a2e29d-025f-4c3f-a4df-45daa74be4e6 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:55.576173 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-95a2e29d-025f-4c3f-a4df-45daa74be4e6 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 4798e026-102b-4ff4-8888-da4bb6b45c08] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:55.583323 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-95a2e29d-025f-4c3f-a4df-45daa74be4e6 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:55.584569 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-95a2e29d-025f-4c3f-a4df-45daa74be4e6 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:55.585217 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-95a2e29d-025f-4c3f-a4df-45daa74be4e6 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:55.586123 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-95a2e29d-025f-4c3f-a4df-45daa74be4e6 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:55.586784 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-95a2e29d-025f-4c3f-a4df-45daa74be4e6 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:55.587393 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-95a2e29d-025f-4c3f-a4df-45daa74be4e6 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:55.593611 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:51:55.698859 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-95a2e29d-025f-4c3f-a4df-45daa74be4e6 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:55.709768 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-95a2e29d-025f-4c3f-a4df-45daa74be4e6 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:55.709918 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8abcd6d4-d9b9-4e6a-a89f-7ae80fc119df tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef3656188f245d2a41252cee95b2064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034ef732e4504d05a4d5d0eea122165e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:55.711502 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-95a2e29d-025f-4c3f-a4df-45daa74be4e6 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:55.714966 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-95a2e29d-025f-4c3f-a4df-45daa74be4e6 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] 10.222.0.67 "GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08" status: 200 len: 1366 microversion: 2.47 time: 0.143088 Sep 16 12:51:55.727454 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 845/1632] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:55 2022] GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:55.730890 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8abcd6d4-d9b9-4e6a-a89f-7ae80fc119df tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] 10.222.0.67 "GET /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3" status: 200 len: 1331 microversion: 2.1 time: 0.441917 Sep 16 12:51:55.745442 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c5a3612c-98ee-4c62-bbbf-a9c71affda79 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:55.755707 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c5a3612c-98ee-4c62-bbbf-a9c71affda79 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:55.755707 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5a3612c-98ee-4c62-bbbf-a9c71affda79 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:55.756086 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5a3612c-98ee-4c62-bbbf-a9c71affda79 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:55.756572 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5a3612c-98ee-4c62-bbbf-a9c71affda79 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:55.757287 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5a3612c-98ee-4c62-bbbf-a9c71affda79 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:55.757743 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5a3612c-98ee-4c62-bbbf-a9c71affda79 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:55.758171 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5a3612c-98ee-4c62-bbbf-a9c71affda79 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:55.768649 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 788/1633] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:55 2022] GET /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3 => generated 1331 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:55.885034 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c5a3612c-98ee-4c62-bbbf-a9c71affda79 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:55.894935 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-52b3b4ad-58b3-468b-abc0-158f62b24cef tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:55.895546 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-52b3b4ad-58b3-468b-abc0-158f62b24cef tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:55.903037 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c5a3612c-98ee-4c62-bbbf-a9c71affda79 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:55.904940 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-52b3b4ad-58b3-468b-abc0-158f62b24cef tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:55.905304 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c5a3612c-98ee-4c62-bbbf-a9c71affda79 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:55.905520 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-52b3b4ad-58b3-468b-abc0-158f62b24cef tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:55.905923 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-52b3b4ad-58b3-468b-abc0-158f62b24cef tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:55.906679 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-52b3b4ad-58b3-468b-abc0-158f62b24cef tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:55.907201 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-52b3b4ad-58b3-468b-abc0-158f62b24cef tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:55.907646 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-52b3b4ad-58b3-468b-abc0-158f62b24cef tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:55.918973 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c5a3612c-98ee-4c62-bbbf-a9c71affda79 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1537 microversion: 2.91 time: 0.190102 Sep 16 12:51:55.926125 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 846/1634] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:55 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1537 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:56.101972 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-52b3b4ad-58b3-468b-abc0-158f62b24cef tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:56.112668 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-52b3b4ad-58b3-468b-abc0-158f62b24cef tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1313 microversion: 2.1 time: 0.221288 Sep 16 12:51:56.113526 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 789/1635] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:55 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:51:56.174511 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6e93f766-5b8a-4d08-a0d1-888585b17a12 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:56.175423 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6e93f766-5b8a-4d08-a0d1-888585b17a12 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:56.182836 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e93f766-5b8a-4d08-a0d1-888585b17a12 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:56.183325 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e93f766-5b8a-4d08-a0d1-888585b17a12 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:56.183761 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e93f766-5b8a-4d08-a0d1-888585b17a12 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:56.184707 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e93f766-5b8a-4d08-a0d1-888585b17a12 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:56.185458 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e93f766-5b8a-4d08-a0d1-888585b17a12 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:56.185895 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e93f766-5b8a-4d08-a0d1-888585b17a12 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:56.310552 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3cd03b96-c035-41e0-b25e-f4f1a9409431 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:56.311171 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3cd03b96-c035-41e0-b25e-f4f1a9409431 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: f9070e88-5408-48ab-9f4b-a74368e8f25e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:56.317432 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3cd03b96-c035-41e0-b25e-f4f1a9409431 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:56.318165 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3cd03b96-c035-41e0-b25e-f4f1a9409431 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:56.318804 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3cd03b96-c035-41e0-b25e-f4f1a9409431 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:56.319713 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3cd03b96-c035-41e0-b25e-f4f1a9409431 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:56.320178 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3cd03b96-c035-41e0-b25e-f4f1a9409431 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:56.320771 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3cd03b96-c035-41e0-b25e-f4f1a9409431 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:56.364433 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6e93f766-5b8a-4d08-a0d1-888585b17a12 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:56.365385 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3cd03b96-c035-41e0-b25e-f4f1a9409431 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:56.366049 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3cd03b96-c035-41e0-b25e-f4f1a9409431 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:56.366637 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3cd03b96-c035-41e0-b25e-f4f1a9409431 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:56.367239 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-3cd03b96-c035-41e0-b25e-f4f1a9409431 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lazy-loading 'fault' on Instance uuid f9070e88-5408-48ab-9f4b-a74368e8f25e {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:51:56.375424 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6e93f766-5b8a-4d08-a0d1-888585b17a12 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1716 microversion: 2.1 time: 0.204665 Sep 16 12:51:56.389087 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 847/1636] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:56 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1716 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:51:56.429620 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3cd03b96-c035-41e0-b25e-f4f1a9409431 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf11dfc3438406ba2710b06fa0fe8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fa2067c44b42b5aa940619abd8e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:56.451196 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3cd03b96-c035-41e0-b25e-f4f1a9409431 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e" status: 200 len: 1298 microversion: 2.1 time: 0.145588 Sep 16 12:51:56.463519 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 790/1637] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:56 2022] GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e => generated 1298 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:56.576090 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-9316507e-ccb0-4f2b-88d6-d6a545804c1e req-eaf8179a-ff03-481a-8dfb-0423e0eff354 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1afdaec3-fdf0-4eac-a324-c0f8eaa6797b", "name": "network-vif-plugged", "status": "completed", "tag": "bf12465f-8132-474a-94b1-e3b53f03df41"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:51:56.586909 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9316507e-ccb0-4f2b-88d6-d6a545804c1e req-eaf8179a-ff03-481a-8dfb-0423e0eff354 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:56.588674 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9316507e-ccb0-4f2b-88d6-d6a545804c1e req-eaf8179a-ff03-481a-8dfb-0423e0eff354 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:56.589336 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9316507e-ccb0-4f2b-88d6-d6a545804c1e req-eaf8179a-ff03-481a-8dfb-0423e0eff354 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:56.598673 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0931d500-9f03-4ac9-9c83-b887d5bc8687 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:56.599533 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0931d500-9f03-4ac9-9c83-b887d5bc8687 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 041df092-33d4-4b71-84d8-7cd479d32b4f] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:56.605728 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-9316507e-ccb0-4f2b-88d6-d6a545804c1e req-eaf8179a-ff03-481a-8dfb-0423e0eff354 service nova] Creating event network-vif-plugged:bf12465f-8132-474a-94b1-e3b53f03df41 for instance 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b on n-h2-858094-4 Sep 16 12:51:56.611689 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-9316507e-ccb0-4f2b-88d6-d6a545804c1e req-eaf8179a-ff03-481a-8dfb-0423e0eff354 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040431 Sep 16 12:51:56.613130 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0931d500-9f03-4ac9-9c83-b887d5bc8687 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:56.615696 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0931d500-9f03-4ac9-9c83-b887d5bc8687 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:56.616248 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0931d500-9f03-4ac9-9c83-b887d5bc8687 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:56.622403 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0931d500-9f03-4ac9-9c83-b887d5bc8687 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:56.622998 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0931d500-9f03-4ac9-9c83-b887d5bc8687 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:56.623512 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0931d500-9f03-4ac9-9c83-b887d5bc8687 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:56.637475 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 848/1638] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:51:56.653642 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-4f42edc6-12fb-4df9-9db8-b5b4970226fa req-b977da99-1089-4ea9-a216-82d95aeec855 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "041df092-33d4-4b71-84d8-7cd479d32b4f", "tag": "756cd197-6a93-4b4a-b498-7ebcbb3246c2"}, {"server_uuid": "f9070e88-5408-48ab-9f4b-a74368e8f25e", "name": "network-vif-deleted", "tag": "093f17ab-8dc0-46d4-846c-da7b4807bf31"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:51:56.679025 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4f42edc6-12fb-4df9-9db8-b5b4970226fa req-b977da99-1089-4ea9-a216-82d95aeec855 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:56.679525 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4f42edc6-12fb-4df9-9db8-b5b4970226fa req-b977da99-1089-4ea9-a216-82d95aeec855 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:56.679948 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4f42edc6-12fb-4df9-9db8-b5b4970226fa req-b977da99-1089-4ea9-a216-82d95aeec855 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:56.695603 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-4f42edc6-12fb-4df9-9db8-b5b4970226fa req-b977da99-1089-4ea9-a216-82d95aeec855 service nova] Creating event network-changed:756cd197-6a93-4b4a-b498-7ebcbb3246c2 for instance 041df092-33d4-4b71-84d8-7cd479d32b4f on n-h2-858094-4 Sep 16 12:51:56.696584 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-4f42edc6-12fb-4df9-9db8-b5b4970226fa req-b977da99-1089-4ea9-a216-82d95aeec855 service nova] Creating event network-vif-deleted:093f17ab-8dc0-46d4-846c-da7b4807bf31 for instance f9070e88-5408-48ab-9f4b-a74368e8f25e on n-h1-858094-4 Sep 16 12:51:56.711845 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-4f42edc6-12fb-4df9-9db8-b5b4970226fa req-b977da99-1089-4ea9-a216-82d95aeec855 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.069258 Sep 16 12:51:56.713067 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 849/1639] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:51:56.751033 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-335205c5-4d4f-468c-9f22-9e9184fa1c79 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:56.752533 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-335205c5-4d4f-468c-9f22-9e9184fa1c79 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 4798e026-102b-4ff4-8888-da4bb6b45c08] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:56.762818 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-335205c5-4d4f-468c-9f22-9e9184fa1c79 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:56.763420 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-335205c5-4d4f-468c-9f22-9e9184fa1c79 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:56.764133 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-335205c5-4d4f-468c-9f22-9e9184fa1c79 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:56.765097 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-335205c5-4d4f-468c-9f22-9e9184fa1c79 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:56.765705 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-335205c5-4d4f-468c-9f22-9e9184fa1c79 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:56.766225 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-335205c5-4d4f-468c-9f22-9e9184fa1c79 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:56.861059 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-335205c5-4d4f-468c-9f22-9e9184fa1c79 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:56.874236 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-335205c5-4d4f-468c-9f22-9e9184fa1c79 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:56.876744 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-335205c5-4d4f-468c-9f22-9e9184fa1c79 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:56.878521 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-335205c5-4d4f-468c-9f22-9e9184fa1c79 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] 10.222.0.67 "GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08" status: 200 len: 1366 microversion: 2.47 time: 0.131731 Sep 16 12:51:56.892733 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 850/1640] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:56 2022] GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08 => generated 1366 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:56.902210 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bb948b82-2c4c-4294-b27b-5e36fba9bcb1 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:56.906208 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bb948b82-2c4c-4294-b27b-5e36fba9bcb1 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] [instance: a4906950-755b-4838-b954-fb07189747f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:56.921772 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb948b82-2c4c-4294-b27b-5e36fba9bcb1 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:56.922262 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb948b82-2c4c-4294-b27b-5e36fba9bcb1 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:56.922856 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb948b82-2c4c-4294-b27b-5e36fba9bcb1 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:56.923615 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb948b82-2c4c-4294-b27b-5e36fba9bcb1 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:56.924297 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb948b82-2c4c-4294-b27b-5e36fba9bcb1 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:56.924916 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb948b82-2c4c-4294-b27b-5e36fba9bcb1 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:56.926085 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0931d500-9f03-4ac9-9c83-b887d5bc8687 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:56.937234 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0931d500-9f03-4ac9-9c83-b887d5bc8687 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:56.939150 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0931d500-9f03-4ac9-9c83-b887d5bc8687 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:56.940792 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0931d500-9f03-4ac9-9c83-b887d5bc8687 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f" status: 200 len: 1567 microversion: 2.25 time: 0.347049 Sep 16 12:51:56.960769 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 791/1641] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:56 2022] GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f => generated 1567 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:56.966580 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-df193d19-a7c8-4621-98e8-7705fce2ffcd tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:56.972933 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-df193d19-a7c8-4621-98e8-7705fce2ffcd tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:56.980478 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-df193d19-a7c8-4621-98e8-7705fce2ffcd tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:56.981233 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-df193d19-a7c8-4621-98e8-7705fce2ffcd tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:56.982492 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-df193d19-a7c8-4621-98e8-7705fce2ffcd tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:56.983227 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-df193d19-a7c8-4621-98e8-7705fce2ffcd tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:56.983688 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-df193d19-a7c8-4621-98e8-7705fce2ffcd tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:56.984114 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-df193d19-a7c8-4621-98e8-7705fce2ffcd tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:57.066502 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-df193d19-a7c8-4621-98e8-7705fce2ffcd tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:57.076635 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-df193d19-a7c8-4621-98e8-7705fce2ffcd tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:57.078172 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-df193d19-a7c8-4621-98e8-7705fce2ffcd tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:57.083405 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-df193d19-a7c8-4621-98e8-7705fce2ffcd tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1540 microversion: 2.91 time: 0.121390 Sep 16 12:51:57.083977 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 792/1642] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:56 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1540 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:57.101107 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bb948b82-2c4c-4294-b27b-5e36fba9bcb1 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef3656188f245d2a41252cee95b2064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034ef732e4504d05a4d5d0eea122165e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:57.110622 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bb948b82-2c4c-4294-b27b-5e36fba9bcb1 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] 10.222.0.67 "GET /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3" status: 200 len: 1536 microversion: 2.1 time: 0.223902 Sep 16 12:51:57.111368 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 851/1643] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:56 2022] GET /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3 => generated 1536 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:57.111971 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-93eadcd8-7f5e-4cba-a1eb-8a62782dd326 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-858094-4"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:51:57.114764 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-93eadcd8-7f5e-4cba-a1eb-8a62782dd326 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:57.121392 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-93eadcd8-7f5e-4cba-a1eb-8a62782dd326 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:57.121873 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-93eadcd8-7f5e-4cba-a1eb-8a62782dd326 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:57.122301 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-93eadcd8-7f5e-4cba-a1eb-8a62782dd326 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:57.122987 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-93eadcd8-7f5e-4cba-a1eb-8a62782dd326 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:57.123598 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-93eadcd8-7f5e-4cba-a1eb-8a62782dd326 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:57.124192 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-93eadcd8-7f5e-4cba-a1eb-8a62782dd326 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:57.136292 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8e696bc5-2c42-440e-900a-4948c9548be4 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Action: 'create', calling method: .version_select at 0x7f10354d11f0>, body: {"pool": "42d33e50-b5e8-4084-82dc-226debf86786"} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:51:57.166595 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-93eadcd8-7f5e-4cba-a1eb-8a62782dd326 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-858094-4". {{(pid=128780) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 16 12:51:57.231374 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-93eadcd8-7f5e-4cba-a1eb-8a62782dd326 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d/action" status: 202 len: 0 microversion: 2.91 time: 0.123196 Sep 16 12:51:57.232416 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 793/1644] 10.222.0.67 () {62 vars in 1319 bytes} [Fri Sep 16 12:51:57 2022] POST /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 16 12:51:57.237377 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-cd31e4aa-a848-4d12-9fed-003139587c5d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:57.237993 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-cd31e4aa-a848-4d12-9fed-003139587c5d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:57.245181 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cd31e4aa-a848-4d12-9fed-003139587c5d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:57.245662 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cd31e4aa-a848-4d12-9fed-003139587c5d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:57.246156 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cd31e4aa-a848-4d12-9fed-003139587c5d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:57.246887 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cd31e4aa-a848-4d12-9fed-003139587c5d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:57.247339 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cd31e4aa-a848-4d12-9fed-003139587c5d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:57.247757 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cd31e4aa-a848-4d12-9fed-003139587c5d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:57.497628 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-cd31e4aa-a848-4d12-9fed-003139587c5d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:57.508914 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-cd31e4aa-a848-4d12-9fed-003139587c5d tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1313 microversion: 2.1 time: 0.274141 Sep 16 12:51:57.527359 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 794/1645] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:57 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1313 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:57.533218 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c33e3b2f-c80b-46c2-81f2-7523a4897daf tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:57.533992 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c33e3b2f-c80b-46c2-81f2-7523a4897daf tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:57.553484 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c33e3b2f-c80b-46c2-81f2-7523a4897daf tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:57.553983 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c33e3b2f-c80b-46c2-81f2-7523a4897daf tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:57.554430 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c33e3b2f-c80b-46c2-81f2-7523a4897daf tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:57.560503 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c33e3b2f-c80b-46c2-81f2-7523a4897daf tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:57.560896 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c33e3b2f-c80b-46c2-81f2-7523a4897daf tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:57.561339 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c33e3b2f-c80b-46c2-81f2-7523a4897daf tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:57.670906 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c33e3b2f-c80b-46c2-81f2-7523a4897daf tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:57.681394 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c33e3b2f-c80b-46c2-81f2-7523a4897daf tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:57.683617 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c33e3b2f-c80b-46c2-81f2-7523a4897daf tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:57.690869 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c33e3b2f-c80b-46c2-81f2-7523a4897daf tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1548 microversion: 2.91 time: 0.161696 Sep 16 12:51:57.691689 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 795/1646] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:57 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1548 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:57.698195 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8d9feb92-6a0a-400a-b5d9-6c03049c5114 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:57.699005 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8d9feb92-6a0a-400a-b5d9-6c03049c5114 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:57.706193 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8d9feb92-6a0a-400a-b5d9-6c03049c5114 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:57.706997 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8d9feb92-6a0a-400a-b5d9-6c03049c5114 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:57.707435 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8d9feb92-6a0a-400a-b5d9-6c03049c5114 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:57.708227 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8d9feb92-6a0a-400a-b5d9-6c03049c5114 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:57.708840 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8d9feb92-6a0a-400a-b5d9-6c03049c5114 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:57.709429 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8d9feb92-6a0a-400a-b5d9-6c03049c5114 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:58.252084 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8d9feb92-6a0a-400a-b5d9-6c03049c5114 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:58.267255 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8d9feb92-6a0a-400a-b5d9-6c03049c5114 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1716 microversion: 2.1 time: 0.570605 Sep 16 12:51:58.273282 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 796/1647] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:57 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1716 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:58.281566 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d8a18687-7f14-48c0-8954-735f2473c75a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:58.282415 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d8a18687-7f14-48c0-8954-735f2473c75a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: f9070e88-5408-48ab-9f4b-a74368e8f25e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:58.290564 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d8a18687-7f14-48c0-8954-735f2473c75a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:58.292216 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d8a18687-7f14-48c0-8954-735f2473c75a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:58.293399 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d8a18687-7f14-48c0-8954-735f2473c75a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:58.294304 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d8a18687-7f14-48c0-8954-735f2473c75a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:58.294929 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d8a18687-7f14-48c0-8954-735f2473c75a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:58.296368 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d8a18687-7f14-48c0-8954-735f2473c75a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:58.346465 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-d8a18687-7f14-48c0-8954-735f2473c75a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] HTTP exception thrown: Instance f9070e88-5408-48ab-9f4b-a74368e8f25e could not be found. Sep 16 12:51:58.348158 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d8a18687-7f14-48c0-8954-735f2473c75a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Request method failure captured: Sep 16 12:51:58.348158 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e HTTP/1.1 Sep 16 12:51:58.348158 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:51:58.348158 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:51:58.348158 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:51:58.348158 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:51:58.348158 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:51:58.348158 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:51:58.348158 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:51:58.348158 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:51:58.348158 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHBls5iww8LeNdGfN3Bt6xT3u64vTQpoFqqS_yYvzsbwThKqraYEgvm-TdmuqPPz7mGkP9XHyURnG4NYJ545iZv6yPCgHdajJlEkh27p7U2bf14vD5cf-sXeqVlOowoXVEnizOzsThYBaLh4g8eNB_RsSBiHvaFUpYtbB3XbCuVO8vc Sep 16 12:51:58.348158 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:51:58.348158 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:51:58.348158 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:51:58.348158 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:51:58.348158 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:51:58.348158 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:51:58.348158 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: e6fa2067c44b42b5aa940619abd8e538 Sep 16 12:51:58.348158 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ImagesTestJSON-969058415 Sep 16 12:51:58.348158 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:51:58.348158 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:51:58.349641 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e6fa2067c44b42b5aa940619abd8e538"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e6fa2067c44b42b5aa940619abd8e538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e6fa2067c44b42b5aa940619abd8e538", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e6fa2067c44b42b5aa940619abd8e538"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:51:58.349641 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ImagesTestJSON-969058415 Sep 16 12:51:58.349641 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: e6fa2067c44b42b5aa940619abd8e538 Sep 16 12:51:58.349641 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ImagesTestJSON-969058415 Sep 16 12:51:58.349641 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ImagesTestJSON-969058415-project Sep 16 12:51:58.349641 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:51:58.349641 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:51:58.349641 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 0cf11dfc3438406ba2710b06fa0fe8ff Sep 16 12:51:58.349641 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ImagesTestJSON-969058415-project Sep 16 12:51:58.349641 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:51:58.349641 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance f9070e88-5408-48ab-9f4b-a74368e8f25e could not be found. Sep 16 12:51:58.349641 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'f9070e88-5408-48ab-9f4b-a74368e8f25e'} Sep 16 12:51:58.350570 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:51:58.350570 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:58.350570 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:51:58.350570 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:51:58.350570 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:51:58.350570 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:51:58.350570 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:51:58.350570 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:51:58.350570 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:51:58.350570 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:51:58.350570 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9070e88-5408-48ab-9f4b-a74368e8f25e could not be found. Sep 16 12:51:58.350570 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:58.350570 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:58.350570 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:58.350570 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:58.350570 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:51:58.350570 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:51:58.350570 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:51:58.350570 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:51:58.350570 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:51:58.352315 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:51:58.352315 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:51:58.352315 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:51:58.352315 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:51:58.352315 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:51:58.352315 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:51:58.352315 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:51:58.352315 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9070e88-5408-48ab-9f4b-a74368e8f25e could not be found. Sep 16 12:51:58.352315 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:58.352315 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:58.352315 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:58.352315 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:58.352315 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:51:58.352315 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:51:58.352315 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:51:58.352315 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:51:58.352315 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9070e88-5408-48ab-9f4b-a74368e8f25e could not be found. Sep 16 12:51:58.352315 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:58.354510 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d8a18687-7f14-48c0-8954-735f2473c75a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Returning 404 to user: Instance f9070e88-5408-48ab-9f4b-a74368e8f25e could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:51:58.354510 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d8a18687-7f14-48c0-8954-735f2473c75a tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e" status: 404 len: 111 microversion: 2.1 time: 0.075490 Sep 16 12:51:58.357798 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 797/1648] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:58 2022] GET /compute/v2.1/servers/f9070e88-5408-48ab-9f4b-a74368e8f25e => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:51:58.364774 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a41e8dfb-b7c7-4ec5-83e3-c1c13c890454 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:58.370236 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a41e8dfb-b7c7-4ec5-83e3-c1c13c890454 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 4798e026-102b-4ff4-8888-da4bb6b45c08] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:58.389263 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a41e8dfb-b7c7-4ec5-83e3-c1c13c890454 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:58.390022 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a41e8dfb-b7c7-4ec5-83e3-c1c13c890454 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:58.392090 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a41e8dfb-b7c7-4ec5-83e3-c1c13c890454 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:58.393026 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a41e8dfb-b7c7-4ec5-83e3-c1c13c890454 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:58.393847 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a41e8dfb-b7c7-4ec5-83e3-c1c13c890454 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:58.397870 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a41e8dfb-b7c7-4ec5-83e3-c1c13c890454 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:58.518404 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a41e8dfb-b7c7-4ec5-83e3-c1c13c890454 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:58.522151 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:51:58.529374 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a41e8dfb-b7c7-4ec5-83e3-c1c13c890454 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:58.530995 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a41e8dfb-b7c7-4ec5-83e3-c1c13c890454 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:58.532197 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a41e8dfb-b7c7-4ec5-83e3-c1c13c890454 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] 10.222.0.67 "GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08" status: 200 len: 1366 microversion: 2.47 time: 0.171774 Sep 16 12:51:58.532954 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 798/1649] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:58 2022] GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:58.538613 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d3495a88-6dc1-44aa-b2c4-aff969459ae4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:58.539227 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d3495a88-6dc1-44aa-b2c4-aff969459ae4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 041df092-33d4-4b71-84d8-7cd479d32b4f] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:58.553253 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d3495a88-6dc1-44aa-b2c4-aff969459ae4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:58.553944 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d3495a88-6dc1-44aa-b2c4-aff969459ae4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:58.554486 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d3495a88-6dc1-44aa-b2c4-aff969459ae4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:58.555654 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d3495a88-6dc1-44aa-b2c4-aff969459ae4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:58.556202 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d3495a88-6dc1-44aa-b2c4-aff969459ae4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:58.556756 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d3495a88-6dc1-44aa-b2c4-aff969459ae4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:58.832938 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d3495a88-6dc1-44aa-b2c4-aff969459ae4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:58.844684 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d3495a88-6dc1-44aa-b2c4-aff969459ae4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:58.846676 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d3495a88-6dc1-44aa-b2c4-aff969459ae4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:58.847979 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d3495a88-6dc1-44aa-b2c4-aff969459ae4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f" status: 200 len: 1567 microversion: 2.25 time: 0.313927 Sep 16 12:51:58.848821 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 799/1650] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:58 2022] GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f => generated 1567 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:58.854791 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-90a1a0b9-2056-4294-8228-b88e064dc298 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f1039b6c670>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:58.882055 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-90a1a0b9-2056-4294-8228-b88e064dc298 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] HTTP exception thrown: Image not found. Sep 16 12:51:58.883883 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-90a1a0b9-2056-4294-8228-b88e064dc298 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Request method failure captured: Sep 16 12:51:58.883883 n-d-858094-4 devstack@n-api.service[128780]: request: DELETE /compute/v2.1/images/5e802ae3-4c4e-4e51-b808-64dd163e6b3c HTTP/1.1 Sep 16 12:51:58.883883 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:51:58.883883 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:51:58.883883 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:51:58.883883 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:51:58.883883 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:51:58.883883 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:51:58.883883 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:51:58.883883 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:51:58.883883 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHBls5iww8LeNdGfN3Bt6xT3u64vTQpoFqqS_yYvzsbwThKqraYEgvm-TdmuqPPz7mGkP9XHyURnG4NYJ545iZv6yPCgHdajJlEkh27p7U2bf14vD5cf-sXeqVlOowoXVEnizOzsThYBaLh4g8eNB_RsSBiHvaFUpYtbB3XbCuVO8vc Sep 16 12:51:58.883883 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:51:58.883883 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:51:58.883883 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:51:58.883883 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:51:58.883883 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:51:58.883883 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:51:58.883883 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: e6fa2067c44b42b5aa940619abd8e538 Sep 16 12:51:58.883883 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ImagesTestJSON-969058415 Sep 16 12:51:58.883883 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:51:58.883883 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:51:58.885475 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e6fa2067c44b42b5aa940619abd8e538"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e6fa2067c44b42b5aa940619abd8e538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e6fa2067c44b42b5aa940619abd8e538", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e6fa2067c44b42b5aa940619abd8e538"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:51:58.885475 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ImagesTestJSON-969058415 Sep 16 12:51:58.885475 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: e6fa2067c44b42b5aa940619abd8e538 Sep 16 12:51:58.885475 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ImagesTestJSON-969058415 Sep 16 12:51:58.885475 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ImagesTestJSON-969058415-project Sep 16 12:51:58.885475 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:51:58.885475 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:51:58.885475 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 0cf11dfc3438406ba2710b06fa0fe8ff Sep 16 12:51:58.885475 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ImagesTestJSON-969058415-project Sep 16 12:51:58.885475 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 12:51:58.885475 n-d-858094-4 devstack@n-api.service[128780]: exception: Image not found. Sep 16 12:51:58.885475 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '5e802ae3-4c4e-4e51-b808-64dd163e6b3c'} Sep 16 12:51:58.885475 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:51:58.885475 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:58.886759 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 16 12:51:58.886759 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 16 12:51:58.886759 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 12:51:58.886759 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 12:51:58.886759 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 12:51:58.886759 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 12:51:58.886759 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 16 12:51:58.886759 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 16 12:51:58.886759 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 16 12:51:58.886759 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 16 12:51:58.886759 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 12:51:58.886759 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 12:51:58.886759 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 12:51:58.886759 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 12:51:58.886759 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5e802ae3-4c4e-4e51-b808-64dd163e6b3c to delete Sep 16 12:51:58.886759 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:58.886759 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:58.886759 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:58.886759 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:58.888234 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 16 12:51:58.888234 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 16 12:51:58.888234 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 16 12:51:58.888234 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 16 12:51:58.888234 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 16 12:51:58.888234 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 16 12:51:58.888234 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5e802ae3-4c4e-4e51-b808-64dd163e6b3c could not be found. Sep 16 12:51:58.888234 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:58.888234 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:58.888234 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:58.888234 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:58.888234 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:51:58.888234 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:51:58.888234 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:51:58.888234 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:51:58.888234 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:51:58.888234 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:51:58.888234 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:51:58.888234 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:51:58.888234 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 16 12:51:58.889692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 16 12:51:58.889692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 12:51:58.889692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:58.889692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:58.889692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:58.889692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:58.889692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:51:58.889692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:51:58.889692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:51:58.889692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:51:58.889692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 12:51:58.889692 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:58.891255 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-90a1a0b9-2056-4294-8228-b88e064dc298 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Returning 404 to user: Image not found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:51:58.892345 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-90a1a0b9-2056-4294-8228-b88e064dc298 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "DELETE /compute/v2.1/images/5e802ae3-4c4e-4e51-b808-64dd163e6b3c" status: 404 len: 62 microversion: 2.1 time: 0.042309 Sep 16 12:51:58.893265 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 800/1651] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:58 2022] DELETE /compute/v2.1/images/5e802ae3-4c4e-4e51-b808-64dd163e6b3c => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 12:51:58.898752 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a0766143-e324-4236-ade4-6e4786cdb69b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:58.899474 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a0766143-e324-4236-ade4-6e4786cdb69b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:58.907806 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a0766143-e324-4236-ade4-6e4786cdb69b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:58.909755 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a0766143-e324-4236-ade4-6e4786cdb69b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:58.910379 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a0766143-e324-4236-ade4-6e4786cdb69b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:58.911214 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a0766143-e324-4236-ade4-6e4786cdb69b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:58.912422 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a0766143-e324-4236-ade4-6e4786cdb69b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:58.912935 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a0766143-e324-4236-ade4-6e4786cdb69b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:59.261540 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a0766143-e324-4236-ade4-6e4786cdb69b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:59.270232 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a0766143-e324-4236-ade4-6e4786cdb69b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1313 microversion: 2.1 time: 0.375599 Sep 16 12:51:59.270806 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 801/1652] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:58 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1313 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:59.277005 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-095c2bab-bd07-4020-9ed0-8721f190935d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:59.277814 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-095c2bab-bd07-4020-9ed0-8721f190935d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:59.284451 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-095c2bab-bd07-4020-9ed0-8721f190935d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:59.284932 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-095c2bab-bd07-4020-9ed0-8721f190935d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:59.285360 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-095c2bab-bd07-4020-9ed0-8721f190935d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:59.286184 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-095c2bab-bd07-4020-9ed0-8721f190935d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:59.286512 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-095c2bab-bd07-4020-9ed0-8721f190935d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:59.286907 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-095c2bab-bd07-4020-9ed0-8721f190935d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:59.434526 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-095c2bab-bd07-4020-9ed0-8721f190935d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:59.448212 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-095c2bab-bd07-4020-9ed0-8721f190935d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:59.450443 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-095c2bab-bd07-4020-9ed0-8721f190935d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:59.456747 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-095c2bab-bd07-4020-9ed0-8721f190935d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1546 microversion: 2.91 time: 0.184382 Sep 16 12:51:59.457619 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 802/1653] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:59 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1546 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:51:59.464821 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-168f67b4-8f07-4466-bf5c-5be1a3d6206b tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:59.465606 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-168f67b4-8f07-4466-bf5c-5be1a3d6206b tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:59.473264 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-168f67b4-8f07-4466-bf5c-5be1a3d6206b tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:59.474030 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-168f67b4-8f07-4466-bf5c-5be1a3d6206b tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:59.475846 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-168f67b4-8f07-4466-bf5c-5be1a3d6206b tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:59.476846 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-168f67b4-8f07-4466-bf5c-5be1a3d6206b tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:59.477488 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-168f67b4-8f07-4466-bf5c-5be1a3d6206b tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:59.478108 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-168f67b4-8f07-4466-bf5c-5be1a3d6206b tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:59.521828 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8e696bc5-2c42-440e-900a-4948c9548be4 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] 10.222.0.67 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.390391 Sep 16 12:51:59.522319 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-168f67b4-8f07-4466-bf5c-5be1a3d6206b tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] HTTP exception thrown: Instance 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac could not be found. Sep 16 12:51:59.523598 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-168f67b4-8f07-4466-bf5c-5be1a3d6206b tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Request method failure captured: Sep 16 12:51:59.523598 n-d-858094-4 devstack@n-api.service[128780]: request: DELETE /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac HTTP/1.1 Sep 16 12:51:59.523598 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:51:59.523598 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:51:59.523598 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:51:59.523598 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:51:59.523598 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:51:59.523598 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:51:59.523598 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:51:59.523598 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:51:59.523598 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHBls5iww8LeNdGfN3Bt6xT3u64vTQpoFqqS_yYvzsbwThKqraYEgvm-TdmuqPPz7mGkP9XHyURnG4NYJ545iZv6yPCgHdajJlEkh27p7U2bf14vD5cf-sXeqVlOowoXVEnizOzsThYBaLh4g8eNB_RsSBiHvaFUpYtbB3XbCuVO8vc Sep 16 12:51:59.523598 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:51:59.523598 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:51:59.523598 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:51:59.523598 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:51:59.523598 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:51:59.523598 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:51:59.523598 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: e6fa2067c44b42b5aa940619abd8e538 Sep 16 12:51:59.523598 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ImagesTestJSON-969058415 Sep 16 12:51:59.523598 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:51:59.523598 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:51:59.525521 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e6fa2067c44b42b5aa940619abd8e538"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e6fa2067c44b42b5aa940619abd8e538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e6fa2067c44b42b5aa940619abd8e538", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e6fa2067c44b42b5aa940619abd8e538"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:51:59.525521 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ImagesTestJSON-969058415 Sep 16 12:51:59.525521 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: e6fa2067c44b42b5aa940619abd8e538 Sep 16 12:51:59.525521 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ImagesTestJSON-969058415 Sep 16 12:51:59.525521 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ImagesTestJSON-969058415-project Sep 16 12:51:59.525521 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:51:59.525521 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:51:59.525521 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 0cf11dfc3438406ba2710b06fa0fe8ff Sep 16 12:51:59.525521 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ImagesTestJSON-969058415-project Sep 16 12:51:59.525521 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:51:59.525521 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac could not be found. Sep 16 12:51:59.525521 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '7725f9a0-ac02-47ad-a67f-a9d42c2a6aac'} Sep 16 12:51:59.526527 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:51:59.526527 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:59.526527 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:51:59.526527 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:51:59.526527 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:51:59.526527 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:51:59.526527 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:51:59.526527 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:51:59.526527 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:51:59.526527 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:51:59.526527 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac could not be found. Sep 16 12:51:59.526527 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:59.526527 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:59.526527 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:59.526527 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:59.526527 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:51:59.526527 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:51:59.526527 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:51:59.526527 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:51:59.526527 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:51:59.528043 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:51:59.528043 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 12:51:59.528043 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 12:51:59.528043 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 12:51:59.528043 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 12:51:59.528043 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:51:59.528043 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:51:59.528043 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:51:59.528043 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:51:59.528043 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac could not be found. Sep 16 12:51:59.528043 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:59.528043 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:59.528043 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:59.528043 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:59.528043 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:51:59.528043 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:51:59.528043 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:51:59.528043 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:51:59.528043 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac could not be found. Sep 16 12:51:59.528043 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:51:59.530129 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-168f67b4-8f07-4466-bf5c-5be1a3d6206b tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Returning 404 to user: Instance 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:51:59.530129 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-168f67b4-8f07-4466-bf5c-5be1a3d6206b tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac" status: 404 len: 111 microversion: 2.1 time: 0.065336 Sep 16 12:51:59.530129 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 803/1654] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:51:59 2022] DELETE /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:51:59.532883 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 852/1655] 10.222.0.67 () {60 vars in 1170 bytes} [Fri Sep 16 12:51:57 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:51:59.538545 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3f7cc38c-577d-481a-baa1-d5bdd3691d43 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:59.541894 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3f7cc38c-577d-481a-baa1-d5bdd3691d43 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:59.543796 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a06f86ee-2235-4381-966e-b8c27db21d16 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:59.544532 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a06f86ee-2235-4381-966e-b8c27db21d16 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:59.560381 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3f7cc38c-577d-481a-baa1-d5bdd3691d43 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:59.561149 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3f7cc38c-577d-481a-baa1-d5bdd3691d43 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:59.561667 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3f7cc38c-577d-481a-baa1-d5bdd3691d43 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:59.562584 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a06f86ee-2235-4381-966e-b8c27db21d16 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:59.562713 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3f7cc38c-577d-481a-baa1-d5bdd3691d43 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:59.563158 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3f7cc38c-577d-481a-baa1-d5bdd3691d43 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:59.563516 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a06f86ee-2235-4381-966e-b8c27db21d16 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:59.563644 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3f7cc38c-577d-481a-baa1-d5bdd3691d43 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:59.564134 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a06f86ee-2235-4381-966e-b8c27db21d16 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:59.564881 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a06f86ee-2235-4381-966e-b8c27db21d16 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:59.565831 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a06f86ee-2235-4381-966e-b8c27db21d16 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:59.566305 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a06f86ee-2235-4381-966e-b8c27db21d16 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:59.588656 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-a06f86ee-2235-4381-966e-b8c27db21d16 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] HTTP exception thrown: Instance 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac could not be found. Sep 16 12:51:59.590432 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a06f86ee-2235-4381-966e-b8c27db21d16 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Request method failure captured: Sep 16 12:51:59.590432 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac HTTP/1.1 Sep 16 12:51:59.590432 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:51:59.590432 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:51:59.590432 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:51:59.590432 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:51:59.590432 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:51:59.590432 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:51:59.590432 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:51:59.590432 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:51:59.590432 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHBls5iww8LeNdGfN3Bt6xT3u64vTQpoFqqS_yYvzsbwThKqraYEgvm-TdmuqPPz7mGkP9XHyURnG4NYJ545iZv6yPCgHdajJlEkh27p7U2bf14vD5cf-sXeqVlOowoXVEnizOzsThYBaLh4g8eNB_RsSBiHvaFUpYtbB3XbCuVO8vc Sep 16 12:51:59.590432 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:51:59.590432 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:51:59.590432 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:51:59.590432 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:51:59.590432 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:51:59.590432 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:51:59.590432 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: e6fa2067c44b42b5aa940619abd8e538 Sep 16 12:51:59.590432 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesTestJSON-969058415 Sep 16 12:51:59.590432 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:51:59.590432 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:51:59.592030 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e6fa2067c44b42b5aa940619abd8e538"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e6fa2067c44b42b5aa940619abd8e538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e6fa2067c44b42b5aa940619abd8e538", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e6fa2067c44b42b5aa940619abd8e538"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:51:59.592030 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesTestJSON-969058415 Sep 16 12:51:59.592030 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: e6fa2067c44b42b5aa940619abd8e538 Sep 16 12:51:59.592030 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesTestJSON-969058415 Sep 16 12:51:59.592030 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ImagesTestJSON-969058415-project Sep 16 12:51:59.592030 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:51:59.592030 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:51:59.592030 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 0cf11dfc3438406ba2710b06fa0fe8ff Sep 16 12:51:59.592030 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesTestJSON-969058415-project Sep 16 12:51:59.592030 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:51:59.592030 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac could not be found. Sep 16 12:51:59.592030 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '7725f9a0-ac02-47ad-a67f-a9d42c2a6aac'} Sep 16 12:51:59.592978 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:51:59.592978 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:59.592978 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:51:59.592978 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:51:59.592978 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:51:59.592978 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:51:59.592978 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:51:59.592978 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:51:59.592978 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:51:59.592978 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:51:59.592978 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac could not be found. Sep 16 12:51:59.592978 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:59.592978 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:59.592978 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:59.592978 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:59.592978 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:51:59.592978 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:51:59.592978 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:51:59.592978 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:51:59.592978 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:51:59.594499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:51:59.594499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:51:59.594499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:51:59.594499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:51:59.594499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:51:59.594499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:51:59.594499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:51:59.594499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac could not be found. Sep 16 12:51:59.594499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:59.594499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:51:59.594499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:59.594499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:51:59.594499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:51:59.594499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:51:59.594499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:51:59.594499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:51:59.594499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac could not be found. Sep 16 12:51:59.594499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:51:59.595843 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a06f86ee-2235-4381-966e-b8c27db21d16 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Returning 404 to user: Instance 7725f9a0-ac02-47ad-a67f-a9d42c2a6aac could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:51:59.595843 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a06f86ee-2235-4381-966e-b8c27db21d16 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac" status: 404 len: 111 microversion: 2.1 time: 0.058054 Sep 16 12:51:59.597276 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 853/1656] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:59 2022] GET /compute/v2.1/servers/7725f9a0-ac02-47ad-a67f-a9d42c2a6aac => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:51:59.602981 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-72da60fc-0463-444b-8951-01c8aa122448 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Action: 'action', calling method: .version_select at 0x7f1037ead9d0>, body: {"addFloatingIp": {"address": "172.25.2.129"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:51:59.606288 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-72da60fc-0463-444b-8951-01c8aa122448 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] [instance: a4906950-755b-4838-b954-fb07189747f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:59.616588 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72da60fc-0463-444b-8951-01c8aa122448 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:59.617211 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72da60fc-0463-444b-8951-01c8aa122448 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:59.617787 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72da60fc-0463-444b-8951-01c8aa122448 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:59.618627 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72da60fc-0463-444b-8951-01c8aa122448 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:59.619704 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72da60fc-0463-444b-8951-01c8aa122448 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:59.620376 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72da60fc-0463-444b-8951-01c8aa122448 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:59.702265 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72da60fc-0463-444b-8951-01c8aa122448 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "refresh_cache-a4906950-755b-4838-b954-fb07189747f3" {{(pid=128779) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 16 12:51:59.704745 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72da60fc-0463-444b-8951-01c8aa122448 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquired lock "refresh_cache-a4906950-755b-4838-b954-fb07189747f3" {{(pid=128779) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 16 12:51:59.922089 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3f7cc38c-577d-481a-baa1-d5bdd3691d43 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:51:59.943437 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3f7cc38c-577d-481a-baa1-d5bdd3691d43 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1716 microversion: 2.1 time: 0.412754 Sep 16 12:51:59.944055 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 804/1657] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:51:59 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1716 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:51:59.951506 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6ec2a35a-0046-4d5f-9fd2-c9ec74805d01 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:51:59.952163 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6ec2a35a-0046-4d5f-9fd2-c9ec74805d01 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 4798e026-102b-4ff4-8888-da4bb6b45c08] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:51:59.967903 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6ec2a35a-0046-4d5f-9fd2-c9ec74805d01 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:59.968421 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6ec2a35a-0046-4d5f-9fd2-c9ec74805d01 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:59.968857 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6ec2a35a-0046-4d5f-9fd2-c9ec74805d01 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:51:59.969561 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6ec2a35a-0046-4d5f-9fd2-c9ec74805d01 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:51:59.970001 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6ec2a35a-0046-4d5f-9fd2-c9ec74805d01 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:51:59.970419 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6ec2a35a-0046-4d5f-9fd2-c9ec74805d01 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:00.165412 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6ec2a35a-0046-4d5f-9fd2-c9ec74805d01 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:00.181166 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6ec2a35a-0046-4d5f-9fd2-c9ec74805d01 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:00.185810 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6ec2a35a-0046-4d5f-9fd2-c9ec74805d01 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:00.187133 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6ec2a35a-0046-4d5f-9fd2-c9ec74805d01 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] 10.222.0.67 "GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08" status: 200 len: 1366 microversion: 2.47 time: 0.239821 Sep 16 12:52:00.191152 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 805/1658] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:51:59 2022] GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:00.208901 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a1fae7fc-274c-4291-9b7d-9dc483531231 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f1039aee1f0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:00.255813 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-a1fae7fc-274c-4291-9b7d-9dc483531231 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] HTTP exception thrown: Image not found. Sep 16 12:52:00.257948 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a1fae7fc-274c-4291-9b7d-9dc483531231 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Request method failure captured: Sep 16 12:52:00.257948 n-d-858094-4 devstack@n-api.service[128780]: request: DELETE /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4 HTTP/1.1 Sep 16 12:52:00.257948 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:52:00.257948 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:52:00.257948 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:52:00.257948 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:52:00.257948 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:52:00.257948 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:52:00.257948 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:52:00.257948 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:52:00.257948 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHBls5iww8LeNdGfN3Bt6xT3u64vTQpoFqqS_yYvzsbwThKqraYEgvm-TdmuqPPz7mGkP9XHyURnG4NYJ545iZv6yPCgHdajJlEkh27p7U2bf14vD5cf-sXeqVlOowoXVEnizOzsThYBaLh4g8eNB_RsSBiHvaFUpYtbB3XbCuVO8vc Sep 16 12:52:00.257948 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:52:00.257948 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:52:00.257948 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:52:00.257948 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:52:00.257948 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:52:00.257948 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:52:00.257948 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: e6fa2067c44b42b5aa940619abd8e538 Sep 16 12:52:00.257948 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ImagesTestJSON-969058415 Sep 16 12:52:00.257948 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:52:00.257948 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:52:00.259845 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e6fa2067c44b42b5aa940619abd8e538"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e6fa2067c44b42b5aa940619abd8e538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e6fa2067c44b42b5aa940619abd8e538", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e6fa2067c44b42b5aa940619abd8e538"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:52:00.259845 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ImagesTestJSON-969058415 Sep 16 12:52:00.259845 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: e6fa2067c44b42b5aa940619abd8e538 Sep 16 12:52:00.259845 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ImagesTestJSON-969058415 Sep 16 12:52:00.259845 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ImagesTestJSON-969058415-project Sep 16 12:52:00.259845 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:52:00.259845 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:52:00.259845 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 0cf11dfc3438406ba2710b06fa0fe8ff Sep 16 12:52:00.259845 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ImagesTestJSON-969058415-project Sep 16 12:52:00.259845 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 12:52:00.259845 n-d-858094-4 devstack@n-api.service[128780]: exception: Image not found. Sep 16 12:52:00.259845 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '85ab24ea-6f14-482e-9d6b-82245e46b4e4'} Sep 16 12:52:00.259845 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:52:00.259845 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:00.260880 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 16 12:52:00.260880 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 16 12:52:00.260880 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 12:52:00.260880 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 12:52:00.260880 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 12:52:00.260880 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 12:52:00.260880 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 16 12:52:00.260880 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 16 12:52:00.260880 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 16 12:52:00.260880 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 16 12:52:00.260880 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 12:52:00.260880 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 12:52:00.260880 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 12:52:00.260880 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 12:52:00.260880 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 85ab24ea-6f14-482e-9d6b-82245e46b4e4 to delete Sep 16 12:52:00.260880 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:00.260880 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:00.260880 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:00.260880 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:00.262098 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 16 12:52:00.262098 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 16 12:52:00.262098 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 16 12:52:00.262098 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 16 12:52:00.262098 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 16 12:52:00.262098 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 16 12:52:00.262098 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 85ab24ea-6f14-482e-9d6b-82245e46b4e4 could not be found. Sep 16 12:52:00.262098 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:00.262098 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:00.262098 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:00.262098 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:00.262098 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:00.262098 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:00.262098 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:52:00.262098 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:52:00.262098 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:52:00.262098 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:52:00.262098 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:52:00.262098 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:52:00.262098 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 16 12:52:00.263416 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 16 12:52:00.263416 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 12:52:00.263416 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:00.263416 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:00.263416 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:00.263416 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:00.263416 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:00.263416 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:00.263416 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:52:00.263416 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:52:00.263416 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 12:52:00.263416 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:00.263416 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a1fae7fc-274c-4291-9b7d-9dc483531231 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Returning 404 to user: Image not found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:52:00.263416 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a1fae7fc-274c-4291-9b7d-9dc483531231 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "DELETE /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4" status: 404 len: 62 microversion: 2.1 time: 0.066568 Sep 16 12:52:00.263416 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 806/1659] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:00 2022] DELETE /compute/v2.1/images/85ab24ea-6f14-482e-9d6b-82245e46b4e4 => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 12:52:00.266624 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d9296f9f-9fc0-4442-96ad-52fa2b69cf21 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:00.267092 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d9296f9f-9fc0-4442-96ad-52fa2b69cf21 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:00.274493 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d9296f9f-9fc0-4442-96ad-52fa2b69cf21 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:00.280603 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d9296f9f-9fc0-4442-96ad-52fa2b69cf21 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:00.281366 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d9296f9f-9fc0-4442-96ad-52fa2b69cf21 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:00.282323 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d9296f9f-9fc0-4442-96ad-52fa2b69cf21 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:00.283564 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d9296f9f-9fc0-4442-96ad-52fa2b69cf21 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:00.284674 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d9296f9f-9fc0-4442-96ad-52fa2b69cf21 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:00.309115 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-d9296f9f-9fc0-4442-96ad-52fa2b69cf21 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] HTTP exception thrown: Instance d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 could not be found. Sep 16 12:52:00.313887 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d9296f9f-9fc0-4442-96ad-52fa2b69cf21 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Request method failure captured: Sep 16 12:52:00.313887 n-d-858094-4 devstack@n-api.service[128780]: request: DELETE /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 HTTP/1.1 Sep 16 12:52:00.313887 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:52:00.313887 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:52:00.313887 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:52:00.313887 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:52:00.313887 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:52:00.313887 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:52:00.313887 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:52:00.313887 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:52:00.313887 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHB33MmKtVepdP3tP-i3P2SYaWbhlmKsFGTwHUG3fpikpDGiY3FVLPEKhzq6YTFGogWZz2ERsnmdLmeZ8PTDNrC0RU9ltWZS1YHL53QNaW1-H2U8tdY_9eYKhQhHhiqOgrONMcJzCOlckV15AdG8cHfAAnPMY0sWQ9KMvLr4xkNqUtk Sep 16 12:52:00.313887 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:52:00.313887 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:52:00.313887 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:52:00.313887 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:52:00.313887 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:52:00.313887 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:52:00.313887 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 97a3e6c179c6495281c2816a1e18aa7e Sep 16 12:52:00.313887 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2026917510 Sep 16 12:52:00.313887 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:52:00.313887 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:52:00.319142 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/97a3e6c179c6495281c2816a1e18aa7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/97a3e6c179c6495281c2816a1e18aa7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_97a3e6c179c6495281c2816a1e18aa7e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/97a3e6c179c6495281c2816a1e18aa7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:52:00.319142 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2026917510 Sep 16 12:52:00.319142 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 97a3e6c179c6495281c2816a1e18aa7e Sep 16 12:52:00.319142 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2026917510 Sep 16 12:52:00.319142 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-AttachSCSIVolumeTestJSON-2026917510-project Sep 16 12:52:00.319142 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:52:00.319142 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:52:00.319142 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 687fd28118c342529cda410e9587dfd0 Sep 16 12:52:00.319142 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2026917510-project Sep 16 12:52:00.319142 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:52:00.319142 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 could not be found. Sep 16 12:52:00.319142 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'd16466e6-cdcd-43d7-bc01-bdf3249fdcf0'} Sep 16 12:52:00.320412 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:52:00.320412 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:00.320412 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:52:00.320412 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:52:00.320412 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:52:00.320412 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:52:00.320412 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:52:00.320412 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:52:00.320412 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:52:00.320412 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:52:00.320412 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 could not be found. Sep 16 12:52:00.320412 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:00.320412 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:00.320412 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:00.320412 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:00.320412 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:00.320412 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:00.320412 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:52:00.320412 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:52:00.320412 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:52:00.322844 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:52:00.322844 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 12:52:00.322844 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 12:52:00.322844 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 12:52:00.322844 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 12:52:00.322844 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:52:00.322844 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:52:00.322844 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:52:00.322844 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:52:00.322844 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 could not be found. Sep 16 12:52:00.322844 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:00.322844 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:00.322844 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:00.322844 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:00.322844 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:00.322844 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:00.322844 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:52:00.322844 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:52:00.322844 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 could not be found. Sep 16 12:52:00.322844 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:00.324707 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d9296f9f-9fc0-4442-96ad-52fa2b69cf21 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Returning 404 to user: Instance d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:52:00.324707 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d9296f9f-9fc0-4442-96ad-52fa2b69cf21 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0" status: 404 len: 111 microversion: 2.1 time: 0.054069 Sep 16 12:52:00.324707 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 807/1660] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:52:00 2022] DELETE /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:52:00.332151 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5b0c8c27-1e43-48da-b5fd-05ee7e28f169 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:00.333434 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5b0c8c27-1e43-48da-b5fd-05ee7e28f169 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 041df092-33d4-4b71-84d8-7cd479d32b4f] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:00.343231 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5b0c8c27-1e43-48da-b5fd-05ee7e28f169 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:00.344349 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5b0c8c27-1e43-48da-b5fd-05ee7e28f169 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:00.346146 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5b0c8c27-1e43-48da-b5fd-05ee7e28f169 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:00.347031 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5b0c8c27-1e43-48da-b5fd-05ee7e28f169 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:00.353112 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5b0c8c27-1e43-48da-b5fd-05ee7e28f169 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:00.354442 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5b0c8c27-1e43-48da-b5fd-05ee7e28f169 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:00.867349 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5b0c8c27-1e43-48da-b5fd-05ee7e28f169 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:00.880691 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5b0c8c27-1e43-48da-b5fd-05ee7e28f169 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:00.885455 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5b0c8c27-1e43-48da-b5fd-05ee7e28f169 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:00.888989 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5b0c8c27-1e43-48da-b5fd-05ee7e28f169 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f" status: 200 len: 1567 microversion: 2.25 time: 0.570580 Sep 16 12:52:00.891141 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 808/1661] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:00 2022] GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f => generated 1567 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:00.904457 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b839bbe5-ce04-4fe1-8b77-958971c78ebe tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:00.907375 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b839bbe5-ce04-4fe1-8b77-958971c78ebe tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:00.937695 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b839bbe5-ce04-4fe1-8b77-958971c78ebe tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:00.938471 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b839bbe5-ce04-4fe1-8b77-958971c78ebe tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:00.939064 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b839bbe5-ce04-4fe1-8b77-958971c78ebe tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:00.939955 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b839bbe5-ce04-4fe1-8b77-958971c78ebe tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:00.940419 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b839bbe5-ce04-4fe1-8b77-958971c78ebe tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:00.941027 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b839bbe5-ce04-4fe1-8b77-958971c78ebe tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:00.967024 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-b839bbe5-ce04-4fe1-8b77-958971c78ebe tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] HTTP exception thrown: Instance dacfa868-1c8b-4918-8797-f31caee29361 could not be found. Sep 16 12:52:00.968996 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b839bbe5-ce04-4fe1-8b77-958971c78ebe tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Request method failure captured: Sep 16 12:52:00.968996 n-d-858094-4 devstack@n-api.service[128780]: request: DELETE /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 HTTP/1.1 Sep 16 12:52:00.968996 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:52:00.968996 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:52:00.968996 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:52:00.968996 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:52:00.968996 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:52:00.968996 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:52:00.968996 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:52:00.968996 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:52:00.968996 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHBls5iww8LeNdGfN3Bt6xT3u64vTQpoFqqS_yYvzsbwThKqraYEgvm-TdmuqPPz7mGkP9XHyURnG4NYJ545iZv6yPCgHdajJlEkh27p7U2bf14vD5cf-sXeqVlOowoXVEnizOzsThYBaLh4g8eNB_RsSBiHvaFUpYtbB3XbCuVO8vc Sep 16 12:52:00.968996 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:52:00.968996 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:52:00.968996 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:52:00.968996 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:52:00.968996 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:52:00.968996 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:52:00.968996 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: e6fa2067c44b42b5aa940619abd8e538 Sep 16 12:52:00.968996 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ImagesTestJSON-969058415 Sep 16 12:52:00.968996 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:52:00.968996 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:52:00.970691 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e6fa2067c44b42b5aa940619abd8e538"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e6fa2067c44b42b5aa940619abd8e538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e6fa2067c44b42b5aa940619abd8e538", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e6fa2067c44b42b5aa940619abd8e538"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:52:00.970691 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ImagesTestJSON-969058415 Sep 16 12:52:00.970691 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: e6fa2067c44b42b5aa940619abd8e538 Sep 16 12:52:00.970691 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ImagesTestJSON-969058415 Sep 16 12:52:00.970691 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ImagesTestJSON-969058415-project Sep 16 12:52:00.970691 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:52:00.970691 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:52:00.970691 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 0cf11dfc3438406ba2710b06fa0fe8ff Sep 16 12:52:00.970691 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ImagesTestJSON-969058415-project Sep 16 12:52:00.970691 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:52:00.970691 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance dacfa868-1c8b-4918-8797-f31caee29361 could not be found. Sep 16 12:52:00.970691 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'dacfa868-1c8b-4918-8797-f31caee29361'} Sep 16 12:52:00.971634 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:52:00.971634 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:00.971634 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:52:00.971634 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:52:00.971634 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:52:00.971634 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:52:00.971634 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:52:00.971634 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:52:00.971634 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:52:00.971634 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:52:00.971634 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dacfa868-1c8b-4918-8797-f31caee29361 could not be found. Sep 16 12:52:00.971634 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:00.971634 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:00.971634 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:00.971634 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:00.971634 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:00.971634 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:00.971634 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:52:00.971634 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:52:00.971634 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:52:00.973170 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:52:00.973170 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 12:52:00.973170 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 12:52:00.973170 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 12:52:00.973170 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 12:52:00.973170 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:52:00.973170 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:52:00.973170 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:52:00.973170 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:52:00.973170 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dacfa868-1c8b-4918-8797-f31caee29361 could not be found. Sep 16 12:52:00.973170 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:00.973170 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:00.973170 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:00.973170 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:00.973170 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:00.973170 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:00.973170 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:52:00.973170 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:52:00.973170 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dacfa868-1c8b-4918-8797-f31caee29361 could not be found. Sep 16 12:52:00.973170 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:00.976917 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b839bbe5-ce04-4fe1-8b77-958971c78ebe tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Returning 404 to user: Instance dacfa868-1c8b-4918-8797-f31caee29361 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:52:00.981141 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b839bbe5-ce04-4fe1-8b77-958971c78ebe tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "DELETE /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 404 len: 111 microversion: 2.1 time: 0.088853 Sep 16 12:52:00.982210 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 809/1662] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:52:00 2022] DELETE /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:52:00.992945 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f9116cfb-38aa-4c4f-a14e-a97a95431928 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:00.993850 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f9116cfb-38aa-4c4f-a14e-a97a95431928 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:01.007727 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f9116cfb-38aa-4c4f-a14e-a97a95431928 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:01.015407 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f9116cfb-38aa-4c4f-a14e-a97a95431928 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:01.016516 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f9116cfb-38aa-4c4f-a14e-a97a95431928 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:01.017521 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f9116cfb-38aa-4c4f-a14e-a97a95431928 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:01.018151 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f9116cfb-38aa-4c4f-a14e-a97a95431928 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:01.018773 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f9116cfb-38aa-4c4f-a14e-a97a95431928 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:01.830873 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f9116cfb-38aa-4c4f-a14e-a97a95431928 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:01.846096 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f9116cfb-38aa-4c4f-a14e-a97a95431928 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1313 microversion: 2.1 time: 0.859671 Sep 16 12:52:01.863986 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 810/1663] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:00 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1313 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:01.877231 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d5a3c3be-3809-4a9a-8b2f-fd2701238623 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:01.882951 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d5a3c3be-3809-4a9a-8b2f-fd2701238623 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] [instance: d16466e6-cdcd-43d7-bc01-bdf3249fdcf0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:01.906278 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d5a3c3be-3809-4a9a-8b2f-fd2701238623 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:01.911311 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d5a3c3be-3809-4a9a-8b2f-fd2701238623 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:01.918987 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d5a3c3be-3809-4a9a-8b2f-fd2701238623 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:01.921844 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d5a3c3be-3809-4a9a-8b2f-fd2701238623 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:01.922379 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d5a3c3be-3809-4a9a-8b2f-fd2701238623 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:01.925102 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d5a3c3be-3809-4a9a-8b2f-fd2701238623 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:01.950829 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-d5a3c3be-3809-4a9a-8b2f-fd2701238623 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] HTTP exception thrown: Instance d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 could not be found. Sep 16 12:52:01.955395 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d5a3c3be-3809-4a9a-8b2f-fd2701238623 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Request method failure captured: Sep 16 12:52:01.955395 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 HTTP/1.1 Sep 16 12:52:01.955395 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:52:01.955395 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:52:01.955395 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:52:01.955395 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:52:01.955395 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:52:01.955395 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:52:01.955395 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:52:01.955395 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:52:01.955395 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHB33MmKtVepdP3tP-i3P2SYaWbhlmKsFGTwHUG3fpikpDGiY3FVLPEKhzq6YTFGogWZz2ERsnmdLmeZ8PTDNrC0RU9ltWZS1YHL53QNaW1-H2U8tdY_9eYKhQhHhiqOgrONMcJzCOlckV15AdG8cHfAAnPMY0sWQ9KMvLr4xkNqUtk Sep 16 12:52:01.955395 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:52:01.955395 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:52:01.955395 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:52:01.955395 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:52:01.955395 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:52:01.955395 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:52:01.955395 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 97a3e6c179c6495281c2816a1e18aa7e Sep 16 12:52:01.955395 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2026917510 Sep 16 12:52:01.955395 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:52:01.955395 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:52:01.957243 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/97a3e6c179c6495281c2816a1e18aa7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/97a3e6c179c6495281c2816a1e18aa7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_97a3e6c179c6495281c2816a1e18aa7e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/97a3e6c179c6495281c2816a1e18aa7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:52:01.957243 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2026917510 Sep 16 12:52:01.957243 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 97a3e6c179c6495281c2816a1e18aa7e Sep 16 12:52:01.957243 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2026917510 Sep 16 12:52:01.957243 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-AttachSCSIVolumeTestJSON-2026917510-project Sep 16 12:52:01.957243 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:52:01.957243 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:52:01.957243 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 687fd28118c342529cda410e9587dfd0 Sep 16 12:52:01.957243 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2026917510-project Sep 16 12:52:01.957243 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:52:01.957243 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 could not be found. Sep 16 12:52:01.957243 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'd16466e6-cdcd-43d7-bc01-bdf3249fdcf0'} Sep 16 12:52:01.958201 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:52:01.958201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:01.958201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:52:01.958201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:52:01.958201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:52:01.958201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:52:01.958201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:52:01.958201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:52:01.958201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:52:01.958201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:52:01.958201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 could not be found. Sep 16 12:52:01.958201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:01.958201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:01.958201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:01.958201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:01.958201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:01.958201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:01.958201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:52:01.958201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:52:01.958201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:52:01.959768 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:52:01.959768 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:52:01.959768 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:52:01.959768 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:52:01.959768 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:52:01.959768 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:52:01.959768 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:52:01.959768 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 could not be found. Sep 16 12:52:01.959768 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:01.959768 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:01.959768 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:01.959768 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:01.959768 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:01.959768 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:01.959768 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:52:01.959768 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:52:01.959768 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 could not be found. Sep 16 12:52:01.959768 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:01.962212 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d5a3c3be-3809-4a9a-8b2f-fd2701238623 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] Returning 404 to user: Instance d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:52:01.964029 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d5a3c3be-3809-4a9a-8b2f-fd2701238623 tempest-AttachSCSIVolumeTestJSON-2026917510 tempest-AttachSCSIVolumeTestJSON-2026917510-project] 10.222.0.67 "GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0" status: 404 len: 111 microversion: 2.1 time: 0.098730 Sep 16 12:52:01.965224 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 811/1664] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:01 2022] GET /compute/v2.1/servers/d16466e6-cdcd-43d7-bc01-bdf3249fdcf0 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:52:01.970491 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-687e22dd-60a1-4efb-892f-58490af8af71 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:01.971661 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-687e22dd-60a1-4efb-892f-58490af8af71 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:01.983162 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-687e22dd-60a1-4efb-892f-58490af8af71 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:01.983976 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-687e22dd-60a1-4efb-892f-58490af8af71 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:01.984719 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-687e22dd-60a1-4efb-892f-58490af8af71 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:01.985622 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-687e22dd-60a1-4efb-892f-58490af8af71 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:01.986252 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-687e22dd-60a1-4efb-892f-58490af8af71 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:01.986907 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-687e22dd-60a1-4efb-892f-58490af8af71 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:02.136936 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-687e22dd-60a1-4efb-892f-58490af8af71 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:02.151641 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-687e22dd-60a1-4efb-892f-58490af8af71 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:02.153941 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-687e22dd-60a1-4efb-892f-58490af8af71 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:02.160224 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-687e22dd-60a1-4efb-892f-58490af8af71 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1486 microversion: 2.91 time: 0.193556 Sep 16 12:52:02.161644 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 812/1665] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:01 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1486 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:02.169804 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-63192986-95fe-4e02-8d45-6103f84fbbe7 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:02.170868 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-63192986-95fe-4e02-8d45-6103f84fbbe7 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:02.178501 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-63192986-95fe-4e02-8d45-6103f84fbbe7 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:02.179566 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-63192986-95fe-4e02-8d45-6103f84fbbe7 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:02.180284 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-63192986-95fe-4e02-8d45-6103f84fbbe7 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:02.181216 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-63192986-95fe-4e02-8d45-6103f84fbbe7 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:02.182518 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-63192986-95fe-4e02-8d45-6103f84fbbe7 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:02.183362 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-63192986-95fe-4e02-8d45-6103f84fbbe7 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:02.911198 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-63192986-95fe-4e02-8d45-6103f84fbbe7 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:02.925381 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-63192986-95fe-4e02-8d45-6103f84fbbe7 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1716 microversion: 2.1 time: 0.762359 Sep 16 12:52:02.926601 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 813/1666] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:02 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1716 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:02.936502 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3f4369f1-778e-49e3-ba30-22686e881918 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:02.941236 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3f4369f1-778e-49e3-ba30-22686e881918 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: dacfa868-1c8b-4918-8797-f31caee29361] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:02.952282 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3f4369f1-778e-49e3-ba30-22686e881918 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:02.952764 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3f4369f1-778e-49e3-ba30-22686e881918 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:02.953213 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3f4369f1-778e-49e3-ba30-22686e881918 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:02.953930 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3f4369f1-778e-49e3-ba30-22686e881918 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:02.965202 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3f4369f1-778e-49e3-ba30-22686e881918 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:02.966063 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3f4369f1-778e-49e3-ba30-22686e881918 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:02.985992 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-3f4369f1-778e-49e3-ba30-22686e881918 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] HTTP exception thrown: Instance dacfa868-1c8b-4918-8797-f31caee29361 could not be found. Sep 16 12:52:02.987158 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-72da60fc-0463-444b-8951-01c8aa122448 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] [instance: a4906950-755b-4838-b954-fb07189747f3] Building network info cache for instance {{(pid=128779) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 16 12:52:02.988475 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3f4369f1-778e-49e3-ba30-22686e881918 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Request method failure captured: Sep 16 12:52:02.988475 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 HTTP/1.1 Sep 16 12:52:02.988475 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:52:02.988475 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:52:02.988475 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:52:02.988475 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:52:02.988475 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:52:02.988475 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:52:02.988475 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:52:02.988475 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:52:02.988475 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHBls5iww8LeNdGfN3Bt6xT3u64vTQpoFqqS_yYvzsbwThKqraYEgvm-TdmuqPPz7mGkP9XHyURnG4NYJ545iZv6yPCgHdajJlEkh27p7U2bf14vD5cf-sXeqVlOowoXVEnizOzsThYBaLh4g8eNB_RsSBiHvaFUpYtbB3XbCuVO8vc Sep 16 12:52:02.988475 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:52:02.988475 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:52:02.988475 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:52:02.988475 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:52:02.988475 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:52:02.988475 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:52:02.988475 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: e6fa2067c44b42b5aa940619abd8e538 Sep 16 12:52:02.988475 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ImagesTestJSON-969058415 Sep 16 12:52:02.988475 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:52:02.988475 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:52:02.989928 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e6fa2067c44b42b5aa940619abd8e538"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e6fa2067c44b42b5aa940619abd8e538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e6fa2067c44b42b5aa940619abd8e538", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e6fa2067c44b42b5aa940619abd8e538"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:52:02.989928 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ImagesTestJSON-969058415 Sep 16 12:52:02.989928 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: e6fa2067c44b42b5aa940619abd8e538 Sep 16 12:52:02.989928 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ImagesTestJSON-969058415 Sep 16 12:52:02.989928 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ImagesTestJSON-969058415-project Sep 16 12:52:02.989928 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:52:02.989928 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:52:02.989928 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 0cf11dfc3438406ba2710b06fa0fe8ff Sep 16 12:52:02.989928 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ImagesTestJSON-969058415-project Sep 16 12:52:02.989928 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:52:02.989928 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance dacfa868-1c8b-4918-8797-f31caee29361 could not be found. Sep 16 12:52:02.989928 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'dacfa868-1c8b-4918-8797-f31caee29361'} Sep 16 12:52:02.990830 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:52:02.990830 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:02.990830 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:52:02.990830 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:52:02.990830 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:52:02.990830 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:52:02.990830 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:52:02.990830 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:52:02.990830 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:52:02.990830 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:52:02.990830 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dacfa868-1c8b-4918-8797-f31caee29361 could not be found. Sep 16 12:52:02.990830 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:02.990830 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:02.990830 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:02.990830 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:02.990830 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:02.990830 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:02.990830 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:52:02.990830 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:52:02.990830 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:52:02.992205 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:52:02.992205 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:52:02.992205 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:52:02.992205 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:52:02.992205 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:52:02.992205 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:52:02.992205 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:52:02.992205 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dacfa868-1c8b-4918-8797-f31caee29361 could not be found. Sep 16 12:52:02.992205 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:02.992205 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:02.992205 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:02.992205 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:02.992205 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:02.992205 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:02.992205 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:52:02.992205 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:52:02.992205 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dacfa868-1c8b-4918-8797-f31caee29361 could not be found. Sep 16 12:52:02.992205 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:02.995643 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3f4369f1-778e-49e3-ba30-22686e881918 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Returning 404 to user: Instance dacfa868-1c8b-4918-8797-f31caee29361 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:52:02.996799 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3f4369f1-778e-49e3-ba30-22686e881918 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361" status: 404 len: 111 microversion: 2.1 time: 0.069000 Sep 16 12:52:03.000752 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 814/1667] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:02 2022] GET /compute/v2.1/servers/dacfa868-1c8b-4918-8797-f31caee29361 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:52:03.008972 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-289bd122-f97d-44f9-8bad-fde9c28e84d1 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:03.010668 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-289bd122-f97d-44f9-8bad-fde9c28e84d1 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 4798e026-102b-4ff4-8888-da4bb6b45c08] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:03.017238 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-289bd122-f97d-44f9-8bad-fde9c28e84d1 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:03.018053 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-289bd122-f97d-44f9-8bad-fde9c28e84d1 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:03.018715 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-289bd122-f97d-44f9-8bad-fde9c28e84d1 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:03.019656 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-289bd122-f97d-44f9-8bad-fde9c28e84d1 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:03.020359 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-289bd122-f97d-44f9-8bad-fde9c28e84d1 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:03.020993 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-289bd122-f97d-44f9-8bad-fde9c28e84d1 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:03.173151 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-289bd122-f97d-44f9-8bad-fde9c28e84d1 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:03.183041 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-289bd122-f97d-44f9-8bad-fde9c28e84d1 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:03.195984 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-289bd122-f97d-44f9-8bad-fde9c28e84d1 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:03.197704 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-289bd122-f97d-44f9-8bad-fde9c28e84d1 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] 10.222.0.67 "GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08" status: 200 len: 1366 microversion: 2.47 time: 0.195186 Sep 16 12:52:03.197955 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 815/1668] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:03 2022] GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:03.210267 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-d819b9a2-81da-4b51-b6df-a4a30c3448bb req-1ef708d1-36e7-4025-9751-59b9aac97989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3085e02c-a09e-4bc5-a8c4-87ab1cedfc16", "name": "network-vif-unplugged", "status": "completed", "tag": "065308fc-710e-4f14-b3d0-e976788d4def"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:52:03.257195 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-d819b9a2-81da-4b51-b6df-a4a30c3448bb req-1ef708d1-36e7-4025-9751-59b9aac97989 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:03.257779 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-d819b9a2-81da-4b51-b6df-a4a30c3448bb req-1ef708d1-36e7-4025-9751-59b9aac97989 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:03.258389 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-d819b9a2-81da-4b51-b6df-a4a30c3448bb req-1ef708d1-36e7-4025-9751-59b9aac97989 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:03.273955 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-d819b9a2-81da-4b51-b6df-a4a30c3448bb req-1ef708d1-36e7-4025-9751-59b9aac97989 service nova] Creating event network-vif-unplugged:065308fc-710e-4f14-b3d0-e976788d4def for instance 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 on n-h1-858094-4 Sep 16 12:52:03.303725 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-d819b9a2-81da-4b51-b6df-a4a30c3448bb req-1ef708d1-36e7-4025-9751-59b9aac97989 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100987 Sep 16 12:52:03.305051 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 816/1669] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:52:03.312783 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8aba3f2a-465f-4d6c-bdb0-dbb6aa4b6474 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:03.313869 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8aba3f2a-465f-4d6c-bdb0-dbb6aa4b6474 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 041df092-33d4-4b71-84d8-7cd479d32b4f] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:03.325975 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8aba3f2a-465f-4d6c-bdb0-dbb6aa4b6474 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:03.326737 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8aba3f2a-465f-4d6c-bdb0-dbb6aa4b6474 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:03.328500 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8aba3f2a-465f-4d6c-bdb0-dbb6aa4b6474 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:03.329428 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8aba3f2a-465f-4d6c-bdb0-dbb6aa4b6474 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:03.330054 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8aba3f2a-465f-4d6c-bdb0-dbb6aa4b6474 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:03.330641 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8aba3f2a-465f-4d6c-bdb0-dbb6aa4b6474 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:03.691705 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8aba3f2a-465f-4d6c-bdb0-dbb6aa4b6474 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:03.702859 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8aba3f2a-465f-4d6c-bdb0-dbb6aa4b6474 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:03.704349 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8aba3f2a-465f-4d6c-bdb0-dbb6aa4b6474 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:03.705978 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8aba3f2a-465f-4d6c-bdb0-dbb6aa4b6474 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f" status: 200 len: 1567 microversion: 2.25 time: 0.399420 Sep 16 12:52:03.718323 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 817/1670] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:03 2022] GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f => generated 1567 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:03.718323 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2c8bcacc-f6fd-4d1b-b6b5-3bb7ef1c8d9b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:03.718323 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-2c8bcacc-f6fd-4d1b-b6b5-3bb7ef1c8d9b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:03.724208 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c8bcacc-f6fd-4d1b-b6b5-3bb7ef1c8d9b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:03.724208 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c8bcacc-f6fd-4d1b-b6b5-3bb7ef1c8d9b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:03.724208 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c8bcacc-f6fd-4d1b-b6b5-3bb7ef1c8d9b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:03.724208 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c8bcacc-f6fd-4d1b-b6b5-3bb7ef1c8d9b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:03.724882 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c8bcacc-f6fd-4d1b-b6b5-3bb7ef1c8d9b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:03.724882 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c8bcacc-f6fd-4d1b-b6b5-3bb7ef1c8d9b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:04.118066 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-2c8bcacc-f6fd-4d1b-b6b5-3bb7ef1c8d9b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:04.131122 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2c8bcacc-f6fd-4d1b-b6b5-3bb7ef1c8d9b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1463 microversion: 2.1 time: 0.423068 Sep 16 12:52:04.148252 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 818/1671] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:03 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1463 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:04.165241 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-d9f9850d-b394-4ca4-8eb9-fd9c3723ab22 req-edc2f0d9-02a9-40e1-bc0d-f12368edcbcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4906950-755b-4838-b954-fb07189747f3", "tag": "92b5ca07-8b77-48e8-915c-8ee94ddb3bb2"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:52:04.188257 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-d9f9850d-b394-4ca4-8eb9-fd9c3723ab22 req-edc2f0d9-02a9-40e1-bc0d-f12368edcbcd service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:04.188954 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-d9f9850d-b394-4ca4-8eb9-fd9c3723ab22 req-edc2f0d9-02a9-40e1-bc0d-f12368edcbcd service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:04.189168 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-d9f9850d-b394-4ca4-8eb9-fd9c3723ab22 req-edc2f0d9-02a9-40e1-bc0d-f12368edcbcd service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:04.219788 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-d9f9850d-b394-4ca4-8eb9-fd9c3723ab22 req-edc2f0d9-02a9-40e1-bc0d-f12368edcbcd service nova] Creating event network-changed:92b5ca07-8b77-48e8-915c-8ee94ddb3bb2 for instance a4906950-755b-4838-b954-fb07189747f3 on n-h2-858094-4 Sep 16 12:52:04.225222 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-d9f9850d-b394-4ca4-8eb9-fd9c3723ab22 req-edc2f0d9-02a9-40e1-bc0d-f12368edcbcd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075217 Sep 16 12:52:04.226473 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 819/1672] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:52:04.233639 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a117f119-d73e-4277-9b5f-b26d4c04063b tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '.version_select at 0x7f10399b8940>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:04.296587 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-a117f119-d73e-4277-9b5f-b26d4c04063b tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] HTTP exception thrown: Image not found. Sep 16 12:52:04.298355 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a117f119-d73e-4277-9b5f-b26d4c04063b tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Request method failure captured: Sep 16 12:52:04.298355 n-d-858094-4 devstack@n-api.service[128780]: request: DELETE /compute/v2.1/images/b7be3aa9-bb67-45cb-9262-02de0dc4a4b0 HTTP/1.1 Sep 16 12:52:04.298355 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:52:04.298355 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:52:04.298355 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:52:04.298355 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:52:04.298355 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:52:04.298355 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:52:04.298355 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:52:04.298355 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:52:04.298355 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHBls5iww8LeNdGfN3Bt6xT3u64vTQpoFqqS_yYvzsbwThKqraYEgvm-TdmuqPPz7mGkP9XHyURnG4NYJ545iZv6yPCgHdajJlEkh27p7U2bf14vD5cf-sXeqVlOowoXVEnizOzsThYBaLh4g8eNB_RsSBiHvaFUpYtbB3XbCuVO8vc Sep 16 12:52:04.298355 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:52:04.298355 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:52:04.298355 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:52:04.298355 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:52:04.298355 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:52:04.298355 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:52:04.298355 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: e6fa2067c44b42b5aa940619abd8e538 Sep 16 12:52:04.298355 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ImagesTestJSON-969058415 Sep 16 12:52:04.298355 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:52:04.298355 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:52:04.300328 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e6fa2067c44b42b5aa940619abd8e538"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e6fa2067c44b42b5aa940619abd8e538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e6fa2067c44b42b5aa940619abd8e538", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e6fa2067c44b42b5aa940619abd8e538"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:52:04.300328 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ImagesTestJSON-969058415 Sep 16 12:52:04.300328 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: e6fa2067c44b42b5aa940619abd8e538 Sep 16 12:52:04.300328 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ImagesTestJSON-969058415 Sep 16 12:52:04.300328 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ImagesTestJSON-969058415-project Sep 16 12:52:04.300328 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:52:04.300328 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:52:04.300328 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 0cf11dfc3438406ba2710b06fa0fe8ff Sep 16 12:52:04.300328 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ImagesTestJSON-969058415-project Sep 16 12:52:04.300328 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 12:52:04.300328 n-d-858094-4 devstack@n-api.service[128780]: exception: Image not found. Sep 16 12:52:04.300328 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'b7be3aa9-bb67-45cb-9262-02de0dc4a4b0'} Sep 16 12:52:04.300328 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:52:04.300328 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:04.306376 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 16 12:52:04.306376 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 16 12:52:04.306376 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 12:52:04.306376 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 12:52:04.306376 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 12:52:04.306376 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 12:52:04.306376 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 16 12:52:04.306376 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 16 12:52:04.306376 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 16 12:52:04.306376 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 16 12:52:04.306376 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 12:52:04.306376 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 12:52:04.306376 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 12:52:04.306376 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 12:52:04.306376 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b7be3aa9-bb67-45cb-9262-02de0dc4a4b0 to delete Sep 16 12:52:04.306376 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:04.306376 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:04.306376 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:04.306376 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:04.307913 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 16 12:52:04.307913 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 16 12:52:04.307913 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 16 12:52:04.307913 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 16 12:52:04.307913 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 16 12:52:04.307913 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 16 12:52:04.307913 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b7be3aa9-bb67-45cb-9262-02de0dc4a4b0 could not be found. Sep 16 12:52:04.307913 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:04.307913 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:04.307913 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:04.307913 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:04.307913 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:04.307913 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:04.307913 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:52:04.307913 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:52:04.307913 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:52:04.307913 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:52:04.307913 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:52:04.307913 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:52:04.307913 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 16 12:52:04.311203 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 16 12:52:04.311203 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 12:52:04.311203 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:04.311203 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:04.311203 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:04.311203 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:04.311203 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:04.311203 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:04.311203 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:52:04.311203 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:52:04.311203 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 12:52:04.311203 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:04.311203 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a117f119-d73e-4277-9b5f-b26d4c04063b tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Returning 404 to user: Image not found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:52:04.311203 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a117f119-d73e-4277-9b5f-b26d4c04063b tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "DELETE /compute/v2.1/images/b7be3aa9-bb67-45cb-9262-02de0dc4a4b0" status: 404 len: 62 microversion: 2.1 time: 0.072095 Sep 16 12:52:04.311203 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 820/1673] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:04 2022] DELETE /compute/v2.1/images/b7be3aa9-bb67-45cb-9262-02de0dc4a4b0 => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 12:52:04.317592 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ad71b18e-1900-4132-a023-b0b722f44983 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:04.317592 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ad71b18e-1900-4132-a023-b0b722f44983 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:04.338542 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ad71b18e-1900-4132-a023-b0b722f44983 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:04.338542 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ad71b18e-1900-4132-a023-b0b722f44983 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:04.339371 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ad71b18e-1900-4132-a023-b0b722f44983 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:04.339734 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ad71b18e-1900-4132-a023-b0b722f44983 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:04.340228 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ad71b18e-1900-4132-a023-b0b722f44983 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:04.340658 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ad71b18e-1900-4132-a023-b0b722f44983 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:04.505224 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ad71b18e-1900-4132-a023-b0b722f44983 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:04.527124 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ad71b18e-1900-4132-a023-b0b722f44983 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:04.533349 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ad71b18e-1900-4132-a023-b0b722f44983 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:04.550668 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ad71b18e-1900-4132-a023-b0b722f44983 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1486 microversion: 2.91 time: 0.248502 Sep 16 12:52:04.564151 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 821/1674] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:04 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1486 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:04.564151 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-249c98e0-9203-4798-9a4c-5d1ca39bee6e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:04.564151 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-249c98e0-9203-4798-9a4c-5d1ca39bee6e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:04.565526 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-249c98e0-9203-4798-9a4c-5d1ca39bee6e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:04.566180 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-249c98e0-9203-4798-9a4c-5d1ca39bee6e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:04.567033 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-249c98e0-9203-4798-9a4c-5d1ca39bee6e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:04.567889 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-249c98e0-9203-4798-9a4c-5d1ca39bee6e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:04.568542 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-249c98e0-9203-4798-9a4c-5d1ca39bee6e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:04.569122 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-249c98e0-9203-4798-9a4c-5d1ca39bee6e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:04.842454 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-72da60fc-0463-444b-8951-01c8aa122448 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] [instance: a4906950-755b-4838-b954-fb07189747f3] Updating instance_info_cache with network_info: [{"id": "92b5ca07-8b77-48e8-915c-8ee94ddb3bb2", "address": "fa:16:3e:bd:45:e0", "network": {"id": "efc98046-384c-40f8-9e52-6d3af932ac27", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1220383004-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "034ef732e4504d05a4d5d0eea122165e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap92b5ca07-8b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128779) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 16 12:52:04.875260 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72da60fc-0463-444b-8951-01c8aa122448 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Releasing lock "refresh_cache-a4906950-755b-4838-b954-fb07189747f3" {{(pid=128779) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 16 12:52:04.876776 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-72da60fc-0463-444b-8951-01c8aa122448 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] 10.222.0.67 "POST /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3/action" status: 202 len: 0 microversion: 2.1 time: 5.278246 Sep 16 12:52:04.881049 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 854/1675] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:51:59 2022] POST /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3/action => generated 0 bytes in 5283 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 16 12:52:04.887273 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-58407e39-e6f5-4136-85a9-876b251db734 tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:04.888224 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-58407e39-e6f5-4136-85a9-876b251db734 tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:04.907764 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-249c98e0-9203-4798-9a4c-5d1ca39bee6e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:04.909454 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58407e39-e6f5-4136-85a9-876b251db734 tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:04.910266 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58407e39-e6f5-4136-85a9-876b251db734 tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:04.913919 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58407e39-e6f5-4136-85a9-876b251db734 tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:04.914933 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58407e39-e6f5-4136-85a9-876b251db734 tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:04.919227 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58407e39-e6f5-4136-85a9-876b251db734 tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:04.920101 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58407e39-e6f5-4136-85a9-876b251db734 tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:04.928374 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-249c98e0-9203-4798-9a4c-5d1ca39bee6e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1716 microversion: 2.1 time: 0.375343 Sep 16 12:52:04.945015 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 822/1676] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:04 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1716 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:04.951823 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-33bf8134-4cdb-4cf7-b159-1f3821e53d0b tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:04.952529 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-33bf8134-4cdb-4cf7-b159-1f3821e53d0b tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 4798e026-102b-4ff4-8888-da4bb6b45c08] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:04.966078 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-33bf8134-4cdb-4cf7-b159-1f3821e53d0b tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:04.980386 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-33bf8134-4cdb-4cf7-b159-1f3821e53d0b tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:04.980997 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-33bf8134-4cdb-4cf7-b159-1f3821e53d0b tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:04.981971 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-33bf8134-4cdb-4cf7-b159-1f3821e53d0b tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:04.982607 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-33bf8134-4cdb-4cf7-b159-1f3821e53d0b tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:04.983198 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-33bf8134-4cdb-4cf7-b159-1f3821e53d0b tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:05.013698 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=100 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:52:05.163027 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-33bf8134-4cdb-4cf7-b159-1f3821e53d0b tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:05.178660 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-33bf8134-4cdb-4cf7-b159-1f3821e53d0b tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:05.180440 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-33bf8134-4cdb-4cf7-b159-1f3821e53d0b tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:05.182536 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-33bf8134-4cdb-4cf7-b159-1f3821e53d0b tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] 10.222.0.67 "GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08" status: 200 len: 1366 microversion: 2.47 time: 0.236084 Sep 16 12:52:05.183777 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 823/1677] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:04 2022] GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:05.189097 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2592e1ac-ecdb-4656-a39f-5c8906c84837 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:05.189813 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-2592e1ac-ecdb-4656-a39f-5c8906c84837 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: c077c0ae-56e2-42f7-a0e7-32e6597062c5] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:05.197444 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2592e1ac-ecdb-4656-a39f-5c8906c84837 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:05.198340 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2592e1ac-ecdb-4656-a39f-5c8906c84837 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:05.199033 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2592e1ac-ecdb-4656-a39f-5c8906c84837 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:05.199934 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2592e1ac-ecdb-4656-a39f-5c8906c84837 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:05.200576 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2592e1ac-ecdb-4656-a39f-5c8906c84837 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:05.201165 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2592e1ac-ecdb-4656-a39f-5c8906c84837 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:05.237004 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-2592e1ac-ecdb-4656-a39f-5c8906c84837 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] HTTP exception thrown: Instance c077c0ae-56e2-42f7-a0e7-32e6597062c5 could not be found. Sep 16 12:52:05.239110 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2592e1ac-ecdb-4656-a39f-5c8906c84837 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Request method failure captured: Sep 16 12:52:05.239110 n-d-858094-4 devstack@n-api.service[128780]: request: DELETE /compute/v2.1/servers/c077c0ae-56e2-42f7-a0e7-32e6597062c5 HTTP/1.1 Sep 16 12:52:05.239110 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:52:05.239110 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:52:05.239110 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:52:05.239110 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:52:05.239110 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:52:05.239110 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:52:05.239110 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:52:05.239110 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:52:05.239110 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHBls5iww8LeNdGfN3Bt6xT3u64vTQpoFqqS_yYvzsbwThKqraYEgvm-TdmuqPPz7mGkP9XHyURnG4NYJ545iZv6yPCgHdajJlEkh27p7U2bf14vD5cf-sXeqVlOowoXVEnizOzsThYBaLh4g8eNB_RsSBiHvaFUpYtbB3XbCuVO8vc Sep 16 12:52:05.239110 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:52:05.239110 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:52:05.239110 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:52:05.239110 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:52:05.239110 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:52:05.239110 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:52:05.239110 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: e6fa2067c44b42b5aa940619abd8e538 Sep 16 12:52:05.239110 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ImagesTestJSON-969058415 Sep 16 12:52:05.239110 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:52:05.239110 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:52:05.240873 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e6fa2067c44b42b5aa940619abd8e538"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e6fa2067c44b42b5aa940619abd8e538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e6fa2067c44b42b5aa940619abd8e538", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e6fa2067c44b42b5aa940619abd8e538"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:52:05.240873 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ImagesTestJSON-969058415 Sep 16 12:52:05.240873 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: e6fa2067c44b42b5aa940619abd8e538 Sep 16 12:52:05.240873 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ImagesTestJSON-969058415 Sep 16 12:52:05.240873 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ImagesTestJSON-969058415-project Sep 16 12:52:05.240873 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:52:05.240873 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:52:05.240873 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 0cf11dfc3438406ba2710b06fa0fe8ff Sep 16 12:52:05.240873 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ImagesTestJSON-969058415-project Sep 16 12:52:05.240873 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:52:05.240873 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance c077c0ae-56e2-42f7-a0e7-32e6597062c5 could not be found. Sep 16 12:52:05.240873 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'c077c0ae-56e2-42f7-a0e7-32e6597062c5'} Sep 16 12:52:05.241837 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:52:05.241837 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:05.241837 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:52:05.241837 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:52:05.241837 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:52:05.241837 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:52:05.241837 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:52:05.241837 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:52:05.241837 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:52:05.241837 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:52:05.241837 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c077c0ae-56e2-42f7-a0e7-32e6597062c5 could not be found. Sep 16 12:52:05.241837 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:05.241837 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:05.241837 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:05.241837 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:05.241837 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:05.241837 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:05.241837 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:52:05.241837 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:52:05.241837 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:52:05.243524 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:52:05.243524 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 12:52:05.243524 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 12:52:05.243524 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 12:52:05.243524 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 12:52:05.243524 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:52:05.243524 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:52:05.243524 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:52:05.243524 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:52:05.243524 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c077c0ae-56e2-42f7-a0e7-32e6597062c5 could not be found. Sep 16 12:52:05.243524 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:05.243524 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:05.243524 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:05.243524 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:05.243524 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:05.243524 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:05.243524 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:52:05.243524 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:52:05.243524 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c077c0ae-56e2-42f7-a0e7-32e6597062c5 could not be found. Sep 16 12:52:05.243524 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:05.246834 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2592e1ac-ecdb-4656-a39f-5c8906c84837 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Returning 404 to user: Instance c077c0ae-56e2-42f7-a0e7-32e6597062c5 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:52:05.248293 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2592e1ac-ecdb-4656-a39f-5c8906c84837 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c077c0ae-56e2-42f7-a0e7-32e6597062c5" status: 404 len: 111 microversion: 2.1 time: 0.062961 Sep 16 12:52:05.249046 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 824/1678] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:52:05 2022] DELETE /compute/v2.1/servers/c077c0ae-56e2-42f7-a0e7-32e6597062c5 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:52:05.253668 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-153e12ba-b8c3-45ea-8a56-0945700a91e1 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:05.254285 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-153e12ba-b8c3-45ea-8a56-0945700a91e1 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 041df092-33d4-4b71-84d8-7cd479d32b4f] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:05.267740 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-153e12ba-b8c3-45ea-8a56-0945700a91e1 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:05.268213 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-153e12ba-b8c3-45ea-8a56-0945700a91e1 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:05.268619 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-153e12ba-b8c3-45ea-8a56-0945700a91e1 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:05.269343 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-153e12ba-b8c3-45ea-8a56-0945700a91e1 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:05.272420 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-153e12ba-b8c3-45ea-8a56-0945700a91e1 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:05.272420 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-153e12ba-b8c3-45ea-8a56-0945700a91e1 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:05.323723 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-58407e39-e6f5-4136-85a9-876b251db734 tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1614 microversion: 2.1 time: 0.441203 Sep 16 12:52:05.334775 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 855/1679] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:04 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1614 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:05.348740 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-db99c03a-2f22-411b-a580-dcf8798eb885 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Action: 'create', calling method: .version_select at 0x7f103542fd30>, body: {"pool": "42d33e50-b5e8-4084-82dc-226debf86786"} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:52:05.680338 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-153e12ba-b8c3-45ea-8a56-0945700a91e1 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:05.695563 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-153e12ba-b8c3-45ea-8a56-0945700a91e1 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:05.697157 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-153e12ba-b8c3-45ea-8a56-0945700a91e1 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:05.699060 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-153e12ba-b8c3-45ea-8a56-0945700a91e1 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f" status: 200 len: 1567 microversion: 2.25 time: 0.448979 Sep 16 12:52:05.710141 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 825/1680] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:05 2022] GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f => generated 1567 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:05.714354 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-81a115c6-8ad6-4c51-9ab6-c029073e62a0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:05.715231 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-81a115c6-8ad6-4c51-9ab6-c029073e62a0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] [instance: c077c0ae-56e2-42f7-a0e7-32e6597062c5] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:05.721706 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-81a115c6-8ad6-4c51-9ab6-c029073e62a0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:05.722423 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-81a115c6-8ad6-4c51-9ab6-c029073e62a0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:05.723207 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-81a115c6-8ad6-4c51-9ab6-c029073e62a0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:05.724432 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-81a115c6-8ad6-4c51-9ab6-c029073e62a0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:05.724896 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-81a115c6-8ad6-4c51-9ab6-c029073e62a0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:05.725323 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-81a115c6-8ad6-4c51-9ab6-c029073e62a0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:05.741512 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-81a115c6-8ad6-4c51-9ab6-c029073e62a0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] HTTP exception thrown: Instance c077c0ae-56e2-42f7-a0e7-32e6597062c5 could not be found. Sep 16 12:52:05.743830 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-81a115c6-8ad6-4c51-9ab6-c029073e62a0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Request method failure captured: Sep 16 12:52:05.743830 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/c077c0ae-56e2-42f7-a0e7-32e6597062c5 HTTP/1.1 Sep 16 12:52:05.743830 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:52:05.743830 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:52:05.743830 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:52:05.743830 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:52:05.743830 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:52:05.743830 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:52:05.743830 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:52:05.743830 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:52:05.743830 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHBls5iww8LeNdGfN3Bt6xT3u64vTQpoFqqS_yYvzsbwThKqraYEgvm-TdmuqPPz7mGkP9XHyURnG4NYJ545iZv6yPCgHdajJlEkh27p7U2bf14vD5cf-sXeqVlOowoXVEnizOzsThYBaLh4g8eNB_RsSBiHvaFUpYtbB3XbCuVO8vc Sep 16 12:52:05.743830 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:52:05.743830 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:52:05.743830 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:52:05.743830 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:52:05.743830 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:52:05.743830 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:52:05.743830 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: e6fa2067c44b42b5aa940619abd8e538 Sep 16 12:52:05.743830 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ImagesTestJSON-969058415 Sep 16 12:52:05.743830 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:52:05.743830 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:52:05.745607 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e6fa2067c44b42b5aa940619abd8e538"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e6fa2067c44b42b5aa940619abd8e538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e6fa2067c44b42b5aa940619abd8e538", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e6fa2067c44b42b5aa940619abd8e538"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:52:05.745607 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ImagesTestJSON-969058415 Sep 16 12:52:05.745607 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: e6fa2067c44b42b5aa940619abd8e538 Sep 16 12:52:05.745607 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ImagesTestJSON-969058415 Sep 16 12:52:05.745607 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ImagesTestJSON-969058415-project Sep 16 12:52:05.745607 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:52:05.745607 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:52:05.745607 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 0cf11dfc3438406ba2710b06fa0fe8ff Sep 16 12:52:05.745607 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ImagesTestJSON-969058415-project Sep 16 12:52:05.745607 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:52:05.745607 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance c077c0ae-56e2-42f7-a0e7-32e6597062c5 could not be found. Sep 16 12:52:05.745607 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'c077c0ae-56e2-42f7-a0e7-32e6597062c5'} Sep 16 12:52:05.746556 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:52:05.746556 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:05.746556 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:52:05.746556 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:52:05.746556 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:52:05.746556 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:52:05.746556 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:52:05.746556 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:52:05.746556 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:52:05.746556 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:52:05.746556 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c077c0ae-56e2-42f7-a0e7-32e6597062c5 could not be found. Sep 16 12:52:05.746556 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:05.746556 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:05.746556 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:05.746556 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:05.746556 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:05.746556 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:05.746556 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:52:05.746556 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:52:05.746556 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:52:05.747949 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:52:05.747949 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:52:05.747949 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:52:05.747949 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:52:05.747949 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:52:05.747949 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:52:05.747949 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:52:05.747949 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c077c0ae-56e2-42f7-a0e7-32e6597062c5 could not be found. Sep 16 12:52:05.747949 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:05.747949 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:05.747949 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:05.747949 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:05.747949 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:05.747949 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:05.747949 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:52:05.747949 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:52:05.747949 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c077c0ae-56e2-42f7-a0e7-32e6597062c5 could not be found. Sep 16 12:52:05.747949 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:05.750294 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-81a115c6-8ad6-4c51-9ab6-c029073e62a0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] Returning 404 to user: Instance c077c0ae-56e2-42f7-a0e7-32e6597062c5 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:52:05.751511 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-81a115c6-8ad6-4c51-9ab6-c029073e62a0 tempest-ImagesTestJSON-969058415 tempest-ImagesTestJSON-969058415-project] 10.222.0.67 "GET /compute/v2.1/servers/c077c0ae-56e2-42f7-a0e7-32e6597062c5" status: 404 len: 111 microversion: 2.1 time: 0.042282 Sep 16 12:52:05.752381 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 826/1681] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:05 2022] GET /compute/v2.1/servers/c077c0ae-56e2-42f7-a0e7-32e6597062c5 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:52:05.757506 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-c0e7334e-c9be-4824-baca-388d6e85b6d4 req-5bf005ed-0164-4b2d-8695-6a744e015930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3085e02c-a09e-4bc5-a8c4-87ab1cedfc16", "tag": "065308fc-710e-4f14-b3d0-e976788d4def"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:52:05.770206 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-c0e7334e-c9be-4824-baca-388d6e85b6d4 req-5bf005ed-0164-4b2d-8695-6a744e015930 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:05.770957 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-c0e7334e-c9be-4824-baca-388d6e85b6d4 req-5bf005ed-0164-4b2d-8695-6a744e015930 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:05.771568 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-c0e7334e-c9be-4824-baca-388d6e85b6d4 req-5bf005ed-0164-4b2d-8695-6a744e015930 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:05.794235 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-c0e7334e-c9be-4824-baca-388d6e85b6d4 req-5bf005ed-0164-4b2d-8695-6a744e015930 service nova] Creating event network-changed:065308fc-710e-4f14-b3d0-e976788d4def for instance 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 on n-h1-858094-4 Sep 16 12:52:05.803158 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-c0e7334e-c9be-4824-baca-388d6e85b6d4 req-5bf005ed-0164-4b2d-8695-6a744e015930 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049269 Sep 16 12:52:05.807918 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 827/1682] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:52:05.816239 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d6bb41b3-7f53-4720-aae8-1e131091f94f tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:52:05.817113 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d6bb41b3-7f53-4720-aae8-1e131091f94f tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:05.838365 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d6bb41b3-7f53-4720-aae8-1e131091f94f tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:05.838858 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d6bb41b3-7f53-4720-aae8-1e131091f94f tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:05.839292 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d6bb41b3-7f53-4720-aae8-1e131091f94f tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:05.839998 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d6bb41b3-7f53-4720-aae8-1e131091f94f tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:05.850832 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d6bb41b3-7f53-4720-aae8-1e131091f94f tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:05.851704 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d6bb41b3-7f53-4720-aae8-1e131091f94f tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:05.896727 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d6bb41b3-7f53-4720-aae8-1e131091f94f tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'eb0d7615ec7b41a9837459c5c1fb4f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80d9b2f358446a29f596a7594d182d1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:05.897498 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d6bb41b3-7f53-4720-aae8-1e131091f94f tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] flavor_id is None. Assuming migration. {{(pid=128780) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 16 12:52:05.897902 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d6bb41b3-7f53-4720-aae8-1e131091f94f tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128780) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 16 12:52:06.268899 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d6bb41b3-7f53-4720-aae8-1e131091f94f tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b/action" status: 202 len: 0 microversion: 2.1 time: 0.459246 Sep 16 12:52:06.272658 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 828/1683] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:52:05 2022] POST /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b/action => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:52:06.278522 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7934b07c-7a3b-4420-acb7-29c761bb3284 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:06.279135 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7934b07c-7a3b-4420-acb7-29c761bb3284 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:06.286017 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7934b07c-7a3b-4420-acb7-29c761bb3284 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:06.286576 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7934b07c-7a3b-4420-acb7-29c761bb3284 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:06.287104 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7934b07c-7a3b-4420-acb7-29c761bb3284 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:06.288135 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7934b07c-7a3b-4420-acb7-29c761bb3284 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:06.288388 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7934b07c-7a3b-4420-acb7-29c761bb3284 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:06.288717 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7934b07c-7a3b-4420-acb7-29c761bb3284 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:06.533277 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7934b07c-7a3b-4420-acb7-29c761bb3284 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:06.547176 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7934b07c-7a3b-4420-acb7-29c761bb3284 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:06.550584 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7934b07c-7a3b-4420-acb7-29c761bb3284 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:06.566487 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7934b07c-7a3b-4420-acb7-29c761bb3284 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1486 microversion: 2.91 time: 0.290203 Sep 16 12:52:06.567544 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 829/1684] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:06 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1486 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:06.782532 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ee158c47-b319-45f2-8ad2-6e8f37861fd5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:06.783552 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ee158c47-b319-45f2-8ad2-6e8f37861fd5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:06.786151 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=100 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:52:06.804419 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ee158c47-b319-45f2-8ad2-6e8f37861fd5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:06.807015 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ee158c47-b319-45f2-8ad2-6e8f37861fd5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:06.807521 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ee158c47-b319-45f2-8ad2-6e8f37861fd5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:06.810695 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ee158c47-b319-45f2-8ad2-6e8f37861fd5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:06.811224 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ee158c47-b319-45f2-8ad2-6e8f37861fd5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:06.811677 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ee158c47-b319-45f2-8ad2-6e8f37861fd5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:07.872077 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ee158c47-b319-45f2-8ad2-6e8f37861fd5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:07.888864 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ee158c47-b319-45f2-8ad2-6e8f37861fd5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1716 microversion: 2.1 time: 1.315969 Sep 16 12:52:07.891102 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 830/1685] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:06 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1716 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:07.914288 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-dfe83719-34e1-413c-8be3-f2d9c1c63b11 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:07.916780 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-dfe83719-34e1-413c-8be3-f2d9c1c63b11 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 4798e026-102b-4ff4-8888-da4bb6b45c08] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:07.928019 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dfe83719-34e1-413c-8be3-f2d9c1c63b11 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:07.928933 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dfe83719-34e1-413c-8be3-f2d9c1c63b11 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:07.930105 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dfe83719-34e1-413c-8be3-f2d9c1c63b11 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:07.931822 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dfe83719-34e1-413c-8be3-f2d9c1c63b11 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:07.932573 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dfe83719-34e1-413c-8be3-f2d9c1c63b11 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:07.933197 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dfe83719-34e1-413c-8be3-f2d9c1c63b11 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:08.111663 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-dfe83719-34e1-413c-8be3-f2d9c1c63b11 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:08.135441 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-dfe83719-34e1-413c-8be3-f2d9c1c63b11 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:08.137483 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-dfe83719-34e1-413c-8be3-f2d9c1c63b11 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:08.138978 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-dfe83719-34e1-413c-8be3-f2d9c1c63b11 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] 10.222.0.67 "GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08" status: 200 len: 1366 microversion: 2.47 time: 0.232226 Sep 16 12:52:08.156890 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 831/1686] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:07 2022] GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08 => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:08.170597 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-683610cb-7e11-4249-b8fb-4bc22239b82c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:08.172007 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-683610cb-7e11-4249-b8fb-4bc22239b82c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:08.181808 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-683610cb-7e11-4249-b8fb-4bc22239b82c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:08.182511 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-683610cb-7e11-4249-b8fb-4bc22239b82c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:08.183118 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-683610cb-7e11-4249-b8fb-4bc22239b82c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:08.184152 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-683610cb-7e11-4249-b8fb-4bc22239b82c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:08.189149 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-683610cb-7e11-4249-b8fb-4bc22239b82c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:08.190141 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-683610cb-7e11-4249-b8fb-4bc22239b82c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:08.503214 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-683610cb-7e11-4249-b8fb-4bc22239b82c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:08.514317 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-683610cb-7e11-4249-b8fb-4bc22239b82c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1472 microversion: 2.1 time: 0.355798 Sep 16 12:52:08.515227 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 832/1687] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:08 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1472 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:08.521285 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-998b9b8c-1899-4dab-95a7-0feac67daffd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:08.522126 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-998b9b8c-1899-4dab-95a7-0feac67daffd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 041df092-33d4-4b71-84d8-7cd479d32b4f] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:08.534235 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-998b9b8c-1899-4dab-95a7-0feac67daffd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:08.534665 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-998b9b8c-1899-4dab-95a7-0feac67daffd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:08.535748 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-998b9b8c-1899-4dab-95a7-0feac67daffd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:08.536105 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-998b9b8c-1899-4dab-95a7-0feac67daffd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:08.536757 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-998b9b8c-1899-4dab-95a7-0feac67daffd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:08.539341 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-998b9b8c-1899-4dab-95a7-0feac67daffd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:08.897062 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-998b9b8c-1899-4dab-95a7-0feac67daffd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:08.910877 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-998b9b8c-1899-4dab-95a7-0feac67daffd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:08.916892 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-998b9b8c-1899-4dab-95a7-0feac67daffd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:08.918670 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-998b9b8c-1899-4dab-95a7-0feac67daffd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f" status: 200 len: 1567 microversion: 2.25 time: 0.402374 Sep 16 12:52:08.921971 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 833/1688] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:08 2022] GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f => generated 1567 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:08.947678 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5b0dfb0a-bde8-466d-a0a5-f84c4324435e tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:08.949048 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5b0dfb0a-bde8-466d-a0a5-f84c4324435e tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:08.959601 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5b0dfb0a-bde8-466d-a0a5-f84c4324435e tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:08.960533 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5b0dfb0a-bde8-466d-a0a5-f84c4324435e tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:08.961479 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5b0dfb0a-bde8-466d-a0a5-f84c4324435e tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:08.962498 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5b0dfb0a-bde8-466d-a0a5-f84c4324435e tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:08.963186 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5b0dfb0a-bde8-466d-a0a5-f84c4324435e tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:08.963839 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5b0dfb0a-bde8-466d-a0a5-f84c4324435e tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:09.121403 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5b0dfb0a-bde8-466d-a0a5-f84c4324435e tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:09.148661 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5b0dfb0a-bde8-466d-a0a5-f84c4324435e tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:09.154546 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5b0dfb0a-bde8-466d-a0a5-f84c4324435e tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:09.167042 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5b0dfb0a-bde8-466d-a0a5-f84c4324435e tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1486 microversion: 2.91 time: 0.243457 Sep 16 12:52:09.176435 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 834/1689] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:08 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1486 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:09.192467 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-259f29ce-f7e8-4e72-a957-9bbdb5e31c53 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:09.193443 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-259f29ce-f7e8-4e72-a957-9bbdb5e31c53 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:09.205302 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-259f29ce-f7e8-4e72-a957-9bbdb5e31c53 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:09.206216 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-259f29ce-f7e8-4e72-a957-9bbdb5e31c53 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:09.206906 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-259f29ce-f7e8-4e72-a957-9bbdb5e31c53 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:09.210784 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-259f29ce-f7e8-4e72-a957-9bbdb5e31c53 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:09.211806 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-259f29ce-f7e8-4e72-a957-9bbdb5e31c53 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:09.212804 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-259f29ce-f7e8-4e72-a957-9bbdb5e31c53 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:10.096251 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-259f29ce-f7e8-4e72-a957-9bbdb5e31c53 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:10.107108 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-259f29ce-f7e8-4e72-a957-9bbdb5e31c53 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1716 microversion: 2.1 time: 0.925853 Sep 16 12:52:10.116937 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 835/1690] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:09 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1716 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:10.128357 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e0b73afc-4ddb-49f3-9483-403ea09cb687 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:10.130628 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e0b73afc-4ddb-49f3-9483-403ea09cb687 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 4798e026-102b-4ff4-8888-da4bb6b45c08] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:10.155850 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e0b73afc-4ddb-49f3-9483-403ea09cb687 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:10.160598 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e0b73afc-4ddb-49f3-9483-403ea09cb687 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:10.161037 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e0b73afc-4ddb-49f3-9483-403ea09cb687 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:10.161785 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e0b73afc-4ddb-49f3-9483-403ea09cb687 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:10.162271 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e0b73afc-4ddb-49f3-9483-403ea09cb687 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:10.162679 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e0b73afc-4ddb-49f3-9483-403ea09cb687 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:10.318795 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e0b73afc-4ddb-49f3-9483-403ea09cb687 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:10.327948 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e0b73afc-4ddb-49f3-9483-403ea09cb687 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:10.344821 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e0b73afc-4ddb-49f3-9483-403ea09cb687 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:10.346094 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e0b73afc-4ddb-49f3-9483-403ea09cb687 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] 10.222.0.67 "GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08" status: 200 len: 1366 microversion: 2.47 time: 0.226121 Sep 16 12:52:10.346679 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 836/1691] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:10 2022] GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:10.359824 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-449005db-f225-452e-be92-5922c8ff3cd2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:10.363696 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-449005db-f225-452e-be92-5922c8ff3cd2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:10.377206 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-449005db-f225-452e-be92-5922c8ff3cd2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:10.378183 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-449005db-f225-452e-be92-5922c8ff3cd2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:10.378847 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-449005db-f225-452e-be92-5922c8ff3cd2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:10.379873 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-449005db-f225-452e-be92-5922c8ff3cd2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:10.380523 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-449005db-f225-452e-be92-5922c8ff3cd2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:10.381304 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-449005db-f225-452e-be92-5922c8ff3cd2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:10.840249 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-db99c03a-2f22-411b-a580-dcf8798eb885 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] 10.222.0.67 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.504017 Sep 16 12:52:10.841926 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 856/1692] 10.222.0.67 () {60 vars in 1170 bytes} [Fri Sep 16 12:52:05 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:52:10.854535 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-001c9715-5601-4ae2-a78b-b2aaaf1fbb59 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:10.855533 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-001c9715-5601-4ae2-a78b-b2aaaf1fbb59 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 041df092-33d4-4b71-84d8-7cd479d32b4f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:10.862152 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-001c9715-5601-4ae2-a78b-b2aaaf1fbb59 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:10.862645 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-001c9715-5601-4ae2-a78b-b2aaaf1fbb59 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:10.863083 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-001c9715-5601-4ae2-a78b-b2aaaf1fbb59 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:10.863989 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-001c9715-5601-4ae2-a78b-b2aaaf1fbb59 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:10.864482 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-001c9715-5601-4ae2-a78b-b2aaaf1fbb59 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:10.864907 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-001c9715-5601-4ae2-a78b-b2aaaf1fbb59 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:11.002141 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-449005db-f225-452e-be92-5922c8ff3cd2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:11.011458 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-449005db-f225-452e-be92-5922c8ff3cd2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1472 microversion: 2.1 time: 0.663409 Sep 16 12:52:11.018179 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 837/1693] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:10 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1472 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:11.024697 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1d827048-9344-4a33-bcbf-0be3eb4dfa7d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:11.025714 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-1d827048-9344-4a33-bcbf-0be3eb4dfa7d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:11.031812 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1d827048-9344-4a33-bcbf-0be3eb4dfa7d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:11.032323 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1d827048-9344-4a33-bcbf-0be3eb4dfa7d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:11.032974 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1d827048-9344-4a33-bcbf-0be3eb4dfa7d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:11.033890 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1d827048-9344-4a33-bcbf-0be3eb4dfa7d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:11.034536 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1d827048-9344-4a33-bcbf-0be3eb4dfa7d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:11.035414 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1d827048-9344-4a33-bcbf-0be3eb4dfa7d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:11.134338 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1d827048-9344-4a33-bcbf-0be3eb4dfa7d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:11.148791 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1d827048-9344-4a33-bcbf-0be3eb4dfa7d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:11.150639 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1d827048-9344-4a33-bcbf-0be3eb4dfa7d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:11.157284 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1d827048-9344-4a33-bcbf-0be3eb4dfa7d tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1486 microversion: 2.91 time: 0.137916 Sep 16 12:52:11.158203 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 838/1694] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:11 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1486 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:11.164469 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0a420087-6323-49d3-8a5f-dcc1066ed2a6 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Action: 'action', calling method: .version_select at 0x7f103751a790>, body: {"addFloatingIp": {"address": "172.25.2.242"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:52:11.167463 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0a420087-6323-49d3-8a5f-dcc1066ed2a6 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] [instance: a4906950-755b-4838-b954-fb07189747f3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:11.167668 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-001c9715-5601-4ae2-a78b-b2aaaf1fbb59 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:11.175235 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0a420087-6323-49d3-8a5f-dcc1066ed2a6 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:11.182373 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-001c9715-5601-4ae2-a78b-b2aaaf1fbb59 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:11.182682 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0a420087-6323-49d3-8a5f-dcc1066ed2a6 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:11.183383 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0a420087-6323-49d3-8a5f-dcc1066ed2a6 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:11.184494 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0a420087-6323-49d3-8a5f-dcc1066ed2a6 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:11.184840 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-001c9715-5601-4ae2-a78b-b2aaaf1fbb59 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:11.186373 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0a420087-6323-49d3-8a5f-dcc1066ed2a6 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:11.186846 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-001c9715-5601-4ae2-a78b-b2aaaf1fbb59 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f" status: 200 len: 1567 microversion: 2.25 time: 0.342430 Sep 16 12:52:11.186980 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0a420087-6323-49d3-8a5f-dcc1066ed2a6 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:11.197325 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 857/1695] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:10 2022] GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f => generated 1567 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:11.220867 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2eecf917-2321-4c6f-a123-43afb135fd11 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:11.222583 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2eecf917-2321-4c6f-a123-43afb135fd11 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:11.236954 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2eecf917-2321-4c6f-a123-43afb135fd11 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:11.237882 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2eecf917-2321-4c6f-a123-43afb135fd11 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:11.238569 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2eecf917-2321-4c6f-a123-43afb135fd11 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:11.239535 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2eecf917-2321-4c6f-a123-43afb135fd11 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:11.240269 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2eecf917-2321-4c6f-a123-43afb135fd11 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:11.240922 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2eecf917-2321-4c6f-a123-43afb135fd11 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:11.276367 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0a420087-6323-49d3-8a5f-dcc1066ed2a6 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "refresh_cache-a4906950-755b-4838-b954-fb07189747f3" {{(pid=128780) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 16 12:52:11.277128 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0a420087-6323-49d3-8a5f-dcc1066ed2a6 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquired lock "refresh_cache-a4906950-755b-4838-b954-fb07189747f3" {{(pid=128780) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 16 12:52:11.489942 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2eecf917-2321-4c6f-a123-43afb135fd11 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:11.501251 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2eecf917-2321-4c6f-a123-43afb135fd11 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1716 microversion: 2.1 time: 0.301579 Sep 16 12:52:11.502571 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 858/1696] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:11 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1716 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:11.508331 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f787fd98-0e4f-4897-a1fc-fa0fefb4c27d tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:11.510209 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f787fd98-0e4f-4897-a1fc-fa0fefb4c27d tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 4798e026-102b-4ff4-8888-da4bb6b45c08] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:11.517744 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f787fd98-0e4f-4897-a1fc-fa0fefb4c27d tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:11.518629 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f787fd98-0e4f-4897-a1fc-fa0fefb4c27d tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:11.519292 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f787fd98-0e4f-4897-a1fc-fa0fefb4c27d tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:11.520429 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f787fd98-0e4f-4897-a1fc-fa0fefb4c27d tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:11.520892 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f787fd98-0e4f-4897-a1fc-fa0fefb4c27d tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:11.521392 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f787fd98-0e4f-4897-a1fc-fa0fefb4c27d tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:11.658936 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f787fd98-0e4f-4897-a1fc-fa0fefb4c27d tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:11.673239 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f787fd98-0e4f-4897-a1fc-fa0fefb4c27d tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:11.676152 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f787fd98-0e4f-4897-a1fc-fa0fefb4c27d tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:11.678006 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f787fd98-0e4f-4897-a1fc-fa0fefb4c27d tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] 10.222.0.67 "GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08" status: 200 len: 1366 microversion: 2.47 time: 0.174046 Sep 16 12:52:11.680011 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 859/1697] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:11 2022] GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:11.872444 n-d-858094-4 devstack@n-api.service[128780]: DEBUG neutronclient.v2_0.client [None req-0a420087-6323-49d3-8a5f-dcc1066ed2a6 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.2.242 (2dafe94e-b194-46b7-8c62-7ed274063b42) with port 92b5ca07-8b77-48e8-915c-8ee94ddb3bb2 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 42d33e50-b5e8-4084-82dc-226debf86786.", "detail": ""}} {{(pid=128780) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 12:52:11.873111 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0a420087-6323-49d3-8a5f-dcc1066ed2a6 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Releasing lock "refresh_cache-a4906950-755b-4838-b954-fb07189747f3" {{(pid=128780) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 16 12:52:11.873798 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-0a420087-6323-49d3-8a5f-dcc1066ed2a6 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] HTTP exception thrown: Cannot associate floating IP 172.25.2.242 (2dafe94e-b194-46b7-8c62-7ed274063b42) with port 92b5ca07-8b77-48e8-915c-8ee94ddb3bb2 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 42d33e50-b5e8-4084-82dc-226debf86786. Sep 16 12:52:11.873798 n-d-858094-4 devstack@n-api.service[128780]: Neutron server returns request_ids: ['req-4e564cdf-dc12-41b1-aafb-67dfe86758af'] Sep 16 12:52:11.879145 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0a420087-6323-49d3-8a5f-dcc1066ed2a6 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Request method failure captured: Sep 16 12:52:11.879145 n-d-858094-4 devstack@n-api.service[128780]: request: POST /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3/action HTTP/1.1 Sep 16 12:52:11.879145 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:52:11.879145 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:52:11.879145 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:52:11.879145 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 46 Sep 16 12:52:11.879145 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:52:11.879145 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:52:11.879145 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:52:11.879145 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:52:11.879145 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHFS8EFvZXNl5S_uda6P-WB34IvsPBJqqwg7-VPrX1aGa8hdMCAAnVJnTeCsbPrqw9dWO6B53YREFTTWZiCJ8BUYBeldDgVVcDdq5yVPDc7DnZSNXJjewGwPXJiMjM_LBftyQzKFAE_KVo7jzyUExj-lyKkXCjdKuYx44pYTKoClJOw Sep 16 12:52:11.879145 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:52:11.879145 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:52:11.879145 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:52:11.879145 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:52:11.879145 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:52:11.879145 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:52:11.879145 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 034ef732e4504d05a4d5d0eea122165e Sep 16 12:52:11.879145 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-28705252 Sep 16 12:52:11.879145 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:52:11.879145 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:52:11.880915 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/034ef732e4504d05a4d5d0eea122165e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/034ef732e4504d05a4d5d0eea122165e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_034ef732e4504d05a4d5d0eea122165e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/034ef732e4504d05a4d5d0eea122165e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:52:11.880915 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-28705252 Sep 16 12:52:11.880915 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 034ef732e4504d05a4d5d0eea122165e Sep 16 12:52:11.880915 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-28705252 Sep 16 12:52:11.880915 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project Sep 16 12:52:11.880915 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:52:11.880915 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:52:11.880915 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 3ef3656188f245d2a41252cee95b2064 Sep 16 12:52:11.880915 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project Sep 16 12:52:11.880915 n-d-858094-4 devstack@n-api.service[128780]: Sep 16 12:52:11.880915 n-d-858094-4 devstack@n-api.service[128780]: {"addFloatingIp": {"address": "172.25.2.242"}} Sep 16 12:52:11.880915 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 12:52:11.882059 n-d-858094-4 devstack@n-api.service[128780]: exception: Cannot associate floating IP 172.25.2.242 (2dafe94e-b194-46b7-8c62-7ed274063b42) with port 92b5ca07-8b77-48e8-915c-8ee94ddb3bb2 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 42d33e50-b5e8-4084-82dc-226debf86786. Sep 16 12:52:11.882059 n-d-858094-4 devstack@n-api.service[128780]: Neutron server returns request_ids: ['req-4e564cdf-dc12-41b1-aafb-67dfe86758af'] Sep 16 12:52:11.882059 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'a4906950-755b-4838-b954-fb07189747f3', 'body': {'addFloatingIp': {'address': '172.25.2.242'}}} Sep 16 12:52:11.882059 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:52:11.882059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:11.882059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Sep 16 12:52:11.882059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Sep 16 12:52:11.882059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:52:11.882059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:52:11.882059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Sep 16 12:52:11.882059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Sep 16 12:52:11.882059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:52:11.882059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:52:11.882059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Sep 16 12:52:11.882059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Sep 16 12:52:11.882059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:52:11.882059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:52:11.887498 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Sep 16 12:52:11.887498 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Sep 16 12:52:11.887498 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:52:11.887498 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:52:11.887498 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 12:52:11.887498 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 12:52:11.887498 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:52:11.887498 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:52:11.887498 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 12:52:11.887498 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 12:52:11.887498 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:52:11.887498 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:52:11.887498 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 12:52:11.887498 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 12:52:11.887498 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 12:52:11.887498 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 12:52:11.888986 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.2.242 (2dafe94e-b194-46b7-8c62-7ed274063b42) with port 92b5ca07-8b77-48e8-915c-8ee94ddb3bb2 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 42d33e50-b5e8-4084-82dc-226debf86786. Sep 16 12:52:11.888986 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4e564cdf-dc12-41b1-aafb-67dfe86758af'] Sep 16 12:52:11.888986 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:11.888986 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:11.888986 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:11.888986 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:11.888986 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 16 12:52:11.888986 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 16 12:52:11.888986 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 16 12:52:11.888986 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 16 12:52:11.888986 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Sep 16 12:52:11.888986 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Sep 16 12:52:11.888986 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.2.242 (2dafe94e-b194-46b7-8c62-7ed274063b42) with port 92b5ca07-8b77-48e8-915c-8ee94ddb3bb2 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 42d33e50-b5e8-4084-82dc-226debf86786. Sep 16 12:52:11.888986 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4e564cdf-dc12-41b1-aafb-67dfe86758af'] Sep 16 12:52:11.888986 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:11.888986 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:11.890379 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:11.890379 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:11.890379 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:11.890379 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:11.890379 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:52:11.890379 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:52:11.890379 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:52:11.890379 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:52:11.890379 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:52:11.890379 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:52:11.890379 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:52:11.890379 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:52:11.890379 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Sep 16 12:52:11.890379 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Sep 16 12:52:11.890379 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.2.242 (2dafe94e-b194-46b7-8c62-7ed274063b42) with port 92b5ca07-8b77-48e8-915c-8ee94ddb3bb2 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 42d33e50-b5e8-4084-82dc-226debf86786. Sep 16 12:52:11.890379 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4e564cdf-dc12-41b1-aafb-67dfe86758af'] Sep 16 12:52:11.890379 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:11.890379 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:11.891850 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:11.891850 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:11.891850 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:11.891850 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:11.891850 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:52:11.891850 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:52:11.891850 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.2.242 (2dafe94e-b194-46b7-8c62-7ed274063b42) with port 92b5ca07-8b77-48e8-915c-8ee94ddb3bb2 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 42d33e50-b5e8-4084-82dc-226debf86786. Sep 16 12:52:11.891850 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4e564cdf-dc12-41b1-aafb-67dfe86758af'] Sep 16 12:52:11.891850 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:11.891850 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0a420087-6323-49d3-8a5f-dcc1066ed2a6 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Returning 400 to user: Cannot associate floating IP 172.25.2.242 (2dafe94e-b194-46b7-8c62-7ed274063b42) with port 92b5ca07-8b77-48e8-915c-8ee94ddb3bb2 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 42d33e50-b5e8-4084-82dc-226debf86786. Sep 16 12:52:11.891850 n-d-858094-4 devstack@n-api.service[128780]: Neutron server returns request_ids: ['req-4e564cdf-dc12-41b1-aafb-67dfe86758af'] {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:52:11.894536 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0a420087-6323-49d3-8a5f-dcc1066ed2a6 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] 10.222.0.67 "POST /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3/action" status: 400 len: 382 microversion: 2.1 time: 0.721268 Sep 16 12:52:11.894536 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 839/1698] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:52:11 2022] POST /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3/action => generated 382 bytes in 724 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 12:52:11.894839 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-73a985d4-8255-49d6-b2b7-629e3e9b0527 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Calling method '.version_select at 0x7f103542fe50>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:12.037912 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-aa6c70ca-3ad0-4632-8289-bf177fce92bc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:12.039307 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-aa6c70ca-3ad0-4632-8289-bf177fce92bc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:12.054143 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aa6c70ca-3ad0-4632-8289-bf177fce92bc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:12.055002 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aa6c70ca-3ad0-4632-8289-bf177fce92bc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:12.055757 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aa6c70ca-3ad0-4632-8289-bf177fce92bc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:12.057087 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aa6c70ca-3ad0-4632-8289-bf177fce92bc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:12.057790 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aa6c70ca-3ad0-4632-8289-bf177fce92bc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:12.058445 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aa6c70ca-3ad0-4632-8289-bf177fce92bc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:12.108240 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:52:12.441990 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-aa6c70ca-3ad0-4632-8289-bf177fce92bc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:12.451439 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-aa6c70ca-3ad0-4632-8289-bf177fce92bc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1472 microversion: 2.1 time: 0.419855 Sep 16 12:52:12.465565 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 840/1699] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:12 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1472 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:12.465565 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5c3ba700-e2fe-4f6b-beca-74f57aeb3fb3 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:12.465565 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5c3ba700-e2fe-4f6b-beca-74f57aeb3fb3 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:12.465565 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5c3ba700-e2fe-4f6b-beca-74f57aeb3fb3 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:12.466031 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5c3ba700-e2fe-4f6b-beca-74f57aeb3fb3 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:12.466031 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5c3ba700-e2fe-4f6b-beca-74f57aeb3fb3 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:12.466031 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5c3ba700-e2fe-4f6b-beca-74f57aeb3fb3 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:12.466278 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5c3ba700-e2fe-4f6b-beca-74f57aeb3fb3 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:12.466658 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5c3ba700-e2fe-4f6b-beca-74f57aeb3fb3 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:12.567322 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5c3ba700-e2fe-4f6b-beca-74f57aeb3fb3 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:12.577981 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5c3ba700-e2fe-4f6b-beca-74f57aeb3fb3 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:12.579766 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5c3ba700-e2fe-4f6b-beca-74f57aeb3fb3 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:12.585781 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5c3ba700-e2fe-4f6b-beca-74f57aeb3fb3 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1486 microversion: 2.91 time: 0.132757 Sep 16 12:52:12.600852 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 841/1700] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:12 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1486 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:12.621271 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-cb1314e3-5eb4-4286-8ce7-7113283f9a2a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:12.622288 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-cb1314e3-5eb4-4286-8ce7-7113283f9a2a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 041df092-33d4-4b71-84d8-7cd479d32b4f] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:12.629272 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cb1314e3-5eb4-4286-8ce7-7113283f9a2a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:12.629917 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cb1314e3-5eb4-4286-8ce7-7113283f9a2a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:12.630635 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cb1314e3-5eb4-4286-8ce7-7113283f9a2a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:12.631884 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cb1314e3-5eb4-4286-8ce7-7113283f9a2a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:12.632501 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cb1314e3-5eb4-4286-8ce7-7113283f9a2a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:12.633339 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cb1314e3-5eb4-4286-8ce7-7113283f9a2a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:12.870154 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-cb1314e3-5eb4-4286-8ce7-7113283f9a2a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:12.880269 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-cb1314e3-5eb4-4286-8ce7-7113283f9a2a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:12.881729 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-cb1314e3-5eb4-4286-8ce7-7113283f9a2a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:12.882960 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-cb1314e3-5eb4-4286-8ce7-7113283f9a2a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f" status: 200 len: 1567 microversion: 2.25 time: 0.270906 Sep 16 12:52:12.884209 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 842/1701] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:12 2022] GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f => generated 1567 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:12.889650 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3a167703-15a7-463a-9cf2-95a86b32c2a9 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:12.890572 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3a167703-15a7-463a-9cf2-95a86b32c2a9 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:12.897508 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3a167703-15a7-463a-9cf2-95a86b32c2a9 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:12.897992 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3a167703-15a7-463a-9cf2-95a86b32c2a9 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:12.898421 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3a167703-15a7-463a-9cf2-95a86b32c2a9 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:12.899138 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3a167703-15a7-463a-9cf2-95a86b32c2a9 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:12.899567 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3a167703-15a7-463a-9cf2-95a86b32c2a9 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:12.900361 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3a167703-15a7-463a-9cf2-95a86b32c2a9 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:13.060261 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-73a985d4-8255-49d6-b2b7-629e3e9b0527 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] 10.222.0.67 "DELETE /compute/v2.1/os-floating-ips/2dafe94e-b194-46b7-8c62-7ed274063b42" status: 202 len: 0 microversion: 2.1 time: 1.172607 Sep 16 12:52:13.065126 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 860/1702] 10.222.0.67 () {58 vars in 1263 bytes} [Fri Sep 16 12:52:11 2022] DELETE /compute/v2.1/os-floating-ips/2dafe94e-b194-46b7-8c62-7ed274063b42 => generated 0 bytes in 1178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:52:13.070777 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6dd87c57-8b4b-48fe-a734-37081b37df41 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:13.071796 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6dd87c57-8b4b-48fe-a734-37081b37df41 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 4798e026-102b-4ff4-8888-da4bb6b45c08] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:13.082290 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6dd87c57-8b4b-48fe-a734-37081b37df41 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:13.083104 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6dd87c57-8b4b-48fe-a734-37081b37df41 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:13.083643 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6dd87c57-8b4b-48fe-a734-37081b37df41 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:13.084701 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6dd87c57-8b4b-48fe-a734-37081b37df41 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:13.085159 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6dd87c57-8b4b-48fe-a734-37081b37df41 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:13.086466 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6dd87c57-8b4b-48fe-a734-37081b37df41 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:13.107830 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3a167703-15a7-463a-9cf2-95a86b32c2a9 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:13.116539 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3a167703-15a7-463a-9cf2-95a86b32c2a9 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1716 microversion: 2.1 time: 0.230880 Sep 16 12:52:13.117127 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 843/1703] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:12 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1716 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:13.122692 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-26321f0a-420a-44bf-bd0f-2bf168b03dab tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Action: 'action', calling method: .version_select at 0x7f103751ab80>, body: {"removeFloatingIp": {"address": "172.25.2.129"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:52:13.239471 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6dd87c57-8b4b-48fe-a734-37081b37df41 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:13.257634 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6dd87c57-8b4b-48fe-a734-37081b37df41 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:13.259553 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6dd87c57-8b4b-48fe-a734-37081b37df41 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:13.262861 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6dd87c57-8b4b-48fe-a734-37081b37df41 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] 10.222.0.67 "GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08" status: 200 len: 1366 microversion: 2.47 time: 0.196448 Sep 16 12:52:13.264589 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 861/1704] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:13 2022] GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:13.323692 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-26321f0a-420a-44bf-bd0f-2bf168b03dab tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] [instance: a4906950-755b-4838-b954-fb07189747f3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:13.342291 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-26321f0a-420a-44bf-bd0f-2bf168b03dab tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:13.343000 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-26321f0a-420a-44bf-bd0f-2bf168b03dab tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:13.343788 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-26321f0a-420a-44bf-bd0f-2bf168b03dab tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:13.345125 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-26321f0a-420a-44bf-bd0f-2bf168b03dab tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:13.345775 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-26321f0a-420a-44bf-bd0f-2bf168b03dab tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:13.346379 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-26321f0a-420a-44bf-bd0f-2bf168b03dab tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:13.477190 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2fb86366-b31e-491d-b011-bf0ee3363d88 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:13.477779 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2fb86366-b31e-491d-b011-bf0ee3363d88 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:13.484418 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2fb86366-b31e-491d-b011-bf0ee3363d88 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:13.485731 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2fb86366-b31e-491d-b011-bf0ee3363d88 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:13.486248 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2fb86366-b31e-491d-b011-bf0ee3363d88 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:13.486973 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2fb86366-b31e-491d-b011-bf0ee3363d88 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:13.487431 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2fb86366-b31e-491d-b011-bf0ee3363d88 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:13.488801 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2fb86366-b31e-491d-b011-bf0ee3363d88 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:13.658003 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-26321f0a-420a-44bf-bd0f-2bf168b03dab tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "refresh_cache-a4906950-755b-4838-b954-fb07189747f3" {{(pid=128780) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 16 12:52:13.660483 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-26321f0a-420a-44bf-bd0f-2bf168b03dab tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquired lock "refresh_cache-a4906950-755b-4838-b954-fb07189747f3" {{(pid=128780) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 16 12:52:13.859126 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2fb86366-b31e-491d-b011-bf0ee3363d88 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:13.880554 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2fb86366-b31e-491d-b011-bf0ee3363d88 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1472 microversion: 2.1 time: 0.397722 Sep 16 12:52:13.903366 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 862/1705] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:13 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1472 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:13.913448 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3ecab8b4-511f-454b-bdb5-2e09b3767e2f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:13.917392 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3ecab8b4-511f-454b-bdb5-2e09b3767e2f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:13.929608 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ecab8b4-511f-454b-bdb5-2e09b3767e2f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:13.930496 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ecab8b4-511f-454b-bdb5-2e09b3767e2f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:13.932579 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ecab8b4-511f-454b-bdb5-2e09b3767e2f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:13.933521 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ecab8b4-511f-454b-bdb5-2e09b3767e2f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:13.934193 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ecab8b4-511f-454b-bdb5-2e09b3767e2f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:13.934817 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ecab8b4-511f-454b-bdb5-2e09b3767e2f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:14.161689 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3ecab8b4-511f-454b-bdb5-2e09b3767e2f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:14.174239 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3ecab8b4-511f-454b-bdb5-2e09b3767e2f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:14.176026 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3ecab8b4-511f-454b-bdb5-2e09b3767e2f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:14.182895 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3ecab8b4-511f-454b-bdb5-2e09b3767e2f tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1486 microversion: 2.91 time: 0.276469 Sep 16 12:52:14.184243 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 863/1706] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:13 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1486 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:14.189626 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5790de49-a9e9-4802-a687-1f325ea4a5bf tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:14.190522 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5790de49-a9e9-4802-a687-1f325ea4a5bf tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 041df092-33d4-4b71-84d8-7cd479d32b4f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:14.201784 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5790de49-a9e9-4802-a687-1f325ea4a5bf tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:14.202665 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5790de49-a9e9-4802-a687-1f325ea4a5bf tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:14.203359 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5790de49-a9e9-4802-a687-1f325ea4a5bf tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:14.204395 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5790de49-a9e9-4802-a687-1f325ea4a5bf tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:14.205088 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5790de49-a9e9-4802-a687-1f325ea4a5bf tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:14.206417 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5790de49-a9e9-4802-a687-1f325ea4a5bf tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:14.653457 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5790de49-a9e9-4802-a687-1f325ea4a5bf tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:14.673834 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5790de49-a9e9-4802-a687-1f325ea4a5bf tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:14.675963 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5790de49-a9e9-4802-a687-1f325ea4a5bf tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:14.677445 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5790de49-a9e9-4802-a687-1f325ea4a5bf tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f" status: 200 len: 1567 microversion: 2.25 time: 0.491997 Sep 16 12:52:14.683219 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 864/1707] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:14 2022] GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f => generated 1567 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:14.692462 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dc0ef85a-2e3c-4b51-a5fe-cd24fe005a6f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:14.694404 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dc0ef85a-2e3c-4b51-a5fe-cd24fe005a6f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:14.715252 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc0ef85a-2e3c-4b51-a5fe-cd24fe005a6f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:14.719381 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc0ef85a-2e3c-4b51-a5fe-cd24fe005a6f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:14.720146 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc0ef85a-2e3c-4b51-a5fe-cd24fe005a6f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:14.721680 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc0ef85a-2e3c-4b51-a5fe-cd24fe005a6f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:14.722379 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc0ef85a-2e3c-4b51-a5fe-cd24fe005a6f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:14.723045 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc0ef85a-2e3c-4b51-a5fe-cd24fe005a6f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:15.257156 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dc0ef85a-2e3c-4b51-a5fe-cd24fe005a6f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:15.268094 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dc0ef85a-2e3c-4b51-a5fe-cd24fe005a6f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1716 microversion: 2.1 time: 0.583240 Sep 16 12:52:15.276664 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 865/1708] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:14 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1716 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:15.281553 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b4fba7d0-bc5d-42f6-b075-3883db3693cf tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:15.290762 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b4fba7d0-bc5d-42f6-b075-3883db3693cf tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 4798e026-102b-4ff4-8888-da4bb6b45c08] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:15.303144 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4fba7d0-bc5d-42f6-b075-3883db3693cf tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:15.303592 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4fba7d0-bc5d-42f6-b075-3883db3693cf tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:15.304098 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4fba7d0-bc5d-42f6-b075-3883db3693cf tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:15.304905 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4fba7d0-bc5d-42f6-b075-3883db3693cf tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:15.305753 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4fba7d0-bc5d-42f6-b075-3883db3693cf tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:15.306498 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4fba7d0-bc5d-42f6-b075-3883db3693cf tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:15.315615 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:52:15.874497 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b4fba7d0-bc5d-42f6-b075-3883db3693cf tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:15.883630 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b4fba7d0-bc5d-42f6-b075-3883db3693cf tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:15.887367 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b4fba7d0-bc5d-42f6-b075-3883db3693cf tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:15.888970 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b4fba7d0-bc5d-42f6-b075-3883db3693cf tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] 10.222.0.67 "GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08" status: 200 len: 1366 microversion: 2.47 time: 0.611169 Sep 16 12:52:15.890131 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 866/1709] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:15 2022] GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08 => generated 1366 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:15.895917 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-38e7ce0c-4b78-45df-bcc7-ab3c313d9d0f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:15.896849 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-38e7ce0c-4b78-45df-bcc7-ab3c313d9d0f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:15.905369 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38e7ce0c-4b78-45df-bcc7-ab3c313d9d0f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:15.906249 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38e7ce0c-4b78-45df-bcc7-ab3c313d9d0f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:15.906915 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38e7ce0c-4b78-45df-bcc7-ab3c313d9d0f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:15.907871 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38e7ce0c-4b78-45df-bcc7-ab3c313d9d0f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:15.908587 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38e7ce0c-4b78-45df-bcc7-ab3c313d9d0f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:15.909256 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38e7ce0c-4b78-45df-bcc7-ab3c313d9d0f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:16.298687 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-26321f0a-420a-44bf-bd0f-2bf168b03dab tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] [instance: a4906950-755b-4838-b954-fb07189747f3] Building network info cache for instance {{(pid=128780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 16 12:52:16.861340 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-38e7ce0c-4b78-45df-bcc7-ab3c313d9d0f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:16.870357 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-38e7ce0c-4b78-45df-bcc7-ab3c313d9d0f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1472 microversion: 2.1 time: 0.978924 Sep 16 12:52:16.876466 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 867/1710] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:15 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1472 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:16.883659 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a1c8b7d1-265e-4dd8-9ef4-ffa22e5975f8 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:16.890844 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a1c8b7d1-265e-4dd8-9ef4-ffa22e5975f8 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:16.915748 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:52:16.917937 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a1c8b7d1-265e-4dd8-9ef4-ffa22e5975f8 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:16.918647 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a1c8b7d1-265e-4dd8-9ef4-ffa22e5975f8 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:16.919462 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a1c8b7d1-265e-4dd8-9ef4-ffa22e5975f8 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:16.920398 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a1c8b7d1-265e-4dd8-9ef4-ffa22e5975f8 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:16.921016 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a1c8b7d1-265e-4dd8-9ef4-ffa22e5975f8 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:16.921606 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a1c8b7d1-265e-4dd8-9ef4-ffa22e5975f8 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:17.085362 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a1c8b7d1-265e-4dd8-9ef4-ffa22e5975f8 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:17.103220 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a1c8b7d1-265e-4dd8-9ef4-ffa22e5975f8 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:17.104954 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a1c8b7d1-265e-4dd8-9ef4-ffa22e5975f8 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:17.131410 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a1c8b7d1-265e-4dd8-9ef4-ffa22e5975f8 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1486 microversion: 2.91 time: 0.241626 Sep 16 12:52:17.144147 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 868/1711] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:16 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1486 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:17.146120 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-59fd222f-20ec-4b79-b72b-ba3fa7510813 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:17.156746 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-59fd222f-20ec-4b79-b72b-ba3fa7510813 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 041df092-33d4-4b71-84d8-7cd479d32b4f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:17.163227 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59fd222f-20ec-4b79-b72b-ba3fa7510813 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:17.166260 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59fd222f-20ec-4b79-b72b-ba3fa7510813 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:17.166817 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59fd222f-20ec-4b79-b72b-ba3fa7510813 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:17.168045 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59fd222f-20ec-4b79-b72b-ba3fa7510813 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:17.168538 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59fd222f-20ec-4b79-b72b-ba3fa7510813 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:17.169108 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59fd222f-20ec-4b79-b72b-ba3fa7510813 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:17.900667 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-59fd222f-20ec-4b79-b72b-ba3fa7510813 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:17.909653 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-59fd222f-20ec-4b79-b72b-ba3fa7510813 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:17.920539 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-59fd222f-20ec-4b79-b72b-ba3fa7510813 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:17.922046 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-59fd222f-20ec-4b79-b72b-ba3fa7510813 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f" status: 200 len: 1567 microversion: 2.25 time: 0.786391 Sep 16 12:52:17.923152 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 869/1712] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:17 2022] GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f => generated 1567 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:17.932710 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0aba3142-af86-4984-af99-d4d10908db8d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:17.933345 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0aba3142-af86-4984-af99-d4d10908db8d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:17.956321 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0aba3142-af86-4984-af99-d4d10908db8d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:17.957324 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0aba3142-af86-4984-af99-d4d10908db8d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:17.957680 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0aba3142-af86-4984-af99-d4d10908db8d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:17.959846 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0aba3142-af86-4984-af99-d4d10908db8d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:17.960342 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0aba3142-af86-4984-af99-d4d10908db8d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:17.960763 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0aba3142-af86-4984-af99-d4d10908db8d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:18.088753 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-26321f0a-420a-44bf-bd0f-2bf168b03dab tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] [instance: a4906950-755b-4838-b954-fb07189747f3] Updating instance_info_cache with network_info: [{"id": "92b5ca07-8b77-48e8-915c-8ee94ddb3bb2", "address": "fa:16:3e:bd:45:e0", "network": {"id": "efc98046-384c-40f8-9e52-6d3af932ac27", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1220383004-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "034ef732e4504d05a4d5d0eea122165e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap92b5ca07-8b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 16 12:52:18.129567 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-26321f0a-420a-44bf-bd0f-2bf168b03dab tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Releasing lock "refresh_cache-a4906950-755b-4838-b954-fb07189747f3" {{(pid=128780) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 16 12:52:18.130491 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-26321f0a-420a-44bf-bd0f-2bf168b03dab tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] 10.222.0.67 "POST /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3/action" status: 202 len: 0 microversion: 2.1 time: 5.012091 Sep 16 12:52:18.144686 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 844/1713] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:52:13 2022] POST /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3/action => generated 0 bytes in 5027 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 16 12:52:18.157472 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-e8adf1ab-f9ac-4799-b3ec-09b8ff8a73ea req-a904ecee-16b8-4ade-938c-542c464420ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4906950-755b-4838-b954-fb07189747f3", "tag": "92b5ca07-8b77-48e8-915c-8ee94ddb3bb2"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:52:18.186125 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-e8adf1ab-f9ac-4799-b3ec-09b8ff8a73ea req-a904ecee-16b8-4ade-938c-542c464420ae service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:18.186616 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-e8adf1ab-f9ac-4799-b3ec-09b8ff8a73ea req-a904ecee-16b8-4ade-938c-542c464420ae service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:18.187121 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-e8adf1ab-f9ac-4799-b3ec-09b8ff8a73ea req-a904ecee-16b8-4ade-938c-542c464420ae service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:18.205377 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-e8adf1ab-f9ac-4799-b3ec-09b8ff8a73ea req-a904ecee-16b8-4ade-938c-542c464420ae service nova] Creating event network-changed:92b5ca07-8b77-48e8-915c-8ee94ddb3bb2 for instance a4906950-755b-4838-b954-fb07189747f3 on n-h2-858094-4 Sep 16 12:52:18.211359 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-e8adf1ab-f9ac-4799-b3ec-09b8ff8a73ea req-a904ecee-16b8-4ade-938c-542c464420ae service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064165 Sep 16 12:52:18.213154 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 845/1714] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:52:18.221299 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c341f980-5fb6-4752-8ed8-9245228e2891 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:18.222114 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c341f980-5fb6-4752-8ed8-9245228e2891 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 4798e026-102b-4ff4-8888-da4bb6b45c08] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:18.230488 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c341f980-5fb6-4752-8ed8-9245228e2891 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:18.231319 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c341f980-5fb6-4752-8ed8-9245228e2891 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:18.231875 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c341f980-5fb6-4752-8ed8-9245228e2891 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:18.232923 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c341f980-5fb6-4752-8ed8-9245228e2891 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:18.233619 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c341f980-5fb6-4752-8ed8-9245228e2891 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:18.234326 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c341f980-5fb6-4752-8ed8-9245228e2891 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:18.383885 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0aba3142-af86-4984-af99-d4d10908db8d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:18.399369 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0aba3142-af86-4984-af99-d4d10908db8d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1716 microversion: 2.1 time: 0.473610 Sep 16 12:52:18.412985 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 870/1715] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:17 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1716 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:18.426489 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d5e302ea-0047-4a7f-9ba7-9756d263bedf tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:18.427253 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d5e302ea-0047-4a7f-9ba7-9756d263bedf tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:18.434298 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5e302ea-0047-4a7f-9ba7-9756d263bedf tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:18.435108 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5e302ea-0047-4a7f-9ba7-9756d263bedf tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:18.435758 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5e302ea-0047-4a7f-9ba7-9756d263bedf tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:18.436616 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5e302ea-0047-4a7f-9ba7-9756d263bedf tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:18.437178 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5e302ea-0047-4a7f-9ba7-9756d263bedf tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:18.437704 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5e302ea-0047-4a7f-9ba7-9756d263bedf tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:18.482242 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c341f980-5fb6-4752-8ed8-9245228e2891 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:18.493722 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c341f980-5fb6-4752-8ed8-9245228e2891 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:18.498424 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c341f980-5fb6-4752-8ed8-9245228e2891 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:18.503880 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c341f980-5fb6-4752-8ed8-9245228e2891 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] 10.222.0.67 "GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08" status: 200 len: 1366 microversion: 2.47 time: 0.284952 Sep 16 12:52:18.505240 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 846/1716] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:18 2022] GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08 => generated 1366 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:18.515840 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c3962269-6674-439c-a7e3-22daed5fde06 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Calling method '.version_select at 0x7f1034e0cca0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:19.085161 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d5e302ea-0047-4a7f-9ba7-9756d263bedf tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:19.095910 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d5e302ea-0047-4a7f-9ba7-9756d263bedf tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1472 microversion: 2.1 time: 0.681526 Sep 16 12:52:19.112349 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 871/1717] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:18 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1472 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:19.117893 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1fce8a98-f568-4474-af01-27f2a97638b8 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:19.118767 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1fce8a98-f568-4474-af01-27f2a97638b8 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:19.127082 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1fce8a98-f568-4474-af01-27f2a97638b8 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:19.127993 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1fce8a98-f568-4474-af01-27f2a97638b8 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:19.128523 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1fce8a98-f568-4474-af01-27f2a97638b8 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:19.129459 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1fce8a98-f568-4474-af01-27f2a97638b8 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:19.130111 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1fce8a98-f568-4474-af01-27f2a97638b8 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:19.130534 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1fce8a98-f568-4474-af01-27f2a97638b8 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:19.272790 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1fce8a98-f568-4474-af01-27f2a97638b8 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:19.288423 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1fce8a98-f568-4474-af01-27f2a97638b8 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:19.291198 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1fce8a98-f568-4474-af01-27f2a97638b8 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:19.299848 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1fce8a98-f568-4474-af01-27f2a97638b8 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1486 microversion: 2.91 time: 0.185461 Sep 16 12:52:19.302241 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 872/1718] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:19 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1486 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:19.511607 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-449523af-e6a6-4bdc-92d6-9f424d7ef1f0 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1414777333", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:52:19.582822 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-449523af-e6a6-4bdc-92d6-9f424d7ef1f0 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] validate_networks() for None {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:52:20.793819 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-449523af-e6a6-4bdc-92d6-9f424d7ef1f0 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:52:20.794486 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-449523af-e6a6-4bdc-92d6-9f424d7ef1f0 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:52:20.794733 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-449523af-e6a6-4bdc-92d6-9f424d7ef1f0 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:52:20.795131 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-449523af-e6a6-4bdc-92d6-9f424d7ef1f0 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:52:20.796476 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-449523af-e6a6-4bdc-92d6-9f424d7ef1f0 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:52:20.806480 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-449523af-e6a6-4bdc-92d6-9f424d7ef1f0 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:20.806981 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-449523af-e6a6-4bdc-92d6-9f424d7ef1f0 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:20.807405 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-449523af-e6a6-4bdc-92d6-9f424d7ef1f0 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:20.808150 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-449523af-e6a6-4bdc-92d6-9f424d7ef1f0 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:20.808612 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-449523af-e6a6-4bdc-92d6-9f424d7ef1f0 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:20.809668 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-449523af-e6a6-4bdc-92d6-9f424d7ef1f0 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:20.827550 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-449523af-e6a6-4bdc-92d6-9f424d7ef1f0 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Getting quotas for project 69b7d059fb70415fb5dc20e3a921d189. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:52:20.832838 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-449523af-e6a6-4bdc-92d6-9f424d7ef1f0 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Getting quotas for user 45d4c5f7ddf5432ba8b4eac2cb6a9860 and project 69b7d059fb70415fb5dc20e3a921d189. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:52:20.850123 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-449523af-e6a6-4bdc-92d6-9f424d7ef1f0 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:52:20.853371 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-449523af-e6a6-4bdc-92d6-9f424d7ef1f0 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] [instance: 345ee81d-c503-421c-90ea-218ac1c98600] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:52:20.902212 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-449523af-e6a6-4bdc-92d6-9f424d7ef1f0 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.598415 Sep 16 12:52:20.908950 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 873/1719] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:52:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:52:20.908950 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-67fe38fa-cda8-446f-9f8d-f63c796d6454 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:20.908950 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-67fe38fa-cda8-446f-9f8d-f63c796d6454 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 041df092-33d4-4b71-84d8-7cd479d32b4f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:20.915654 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67fe38fa-cda8-446f-9f8d-f63c796d6454 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:20.916409 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67fe38fa-cda8-446f-9f8d-f63c796d6454 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:20.916662 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67fe38fa-cda8-446f-9f8d-f63c796d6454 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:20.917543 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67fe38fa-cda8-446f-9f8d-f63c796d6454 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:20.919086 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67fe38fa-cda8-446f-9f8d-f63c796d6454 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:20.920264 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67fe38fa-cda8-446f-9f8d-f63c796d6454 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:21.318699 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-67fe38fa-cda8-446f-9f8d-f63c796d6454 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:21.338555 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-67fe38fa-cda8-446f-9f8d-f63c796d6454 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:21.340872 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-67fe38fa-cda8-446f-9f8d-f63c796d6454 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:21.345662 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-67fe38fa-cda8-446f-9f8d-f63c796d6454 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f" status: 200 len: 1557 microversion: 2.25 time: 0.438642 Sep 16 12:52:21.346362 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 874/1720] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:20 2022] GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f => generated 1557 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:21.351758 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4fe65221-1c44-4503-8517-130345511cd2 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:21.353067 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4fe65221-1c44-4503-8517-130345511cd2 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:21.372681 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fe65221-1c44-4503-8517-130345511cd2 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:21.373572 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fe65221-1c44-4503-8517-130345511cd2 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:21.375199 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fe65221-1c44-4503-8517-130345511cd2 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:21.376185 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fe65221-1c44-4503-8517-130345511cd2 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:21.377697 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fe65221-1c44-4503-8517-130345511cd2 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:21.378214 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fe65221-1c44-4503-8517-130345511cd2 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:21.423366 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c3962269-6674-439c-a7e3-22daed5fde06 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] 10.222.0.67 "DELETE /compute/v2.1/os-floating-ips/d65fc9a9-0c1c-4b66-a26e-64a3a116e738" status: 202 len: 0 microversion: 2.1 time: 2.916488 Sep 16 12:52:21.425338 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 847/1721] 10.222.0.67 () {58 vars in 1263 bytes} [Fri Sep 16 12:52:18 2022] DELETE /compute/v2.1/os-floating-ips/d65fc9a9-0c1c-4b66-a26e-64a3a116e738 => generated 0 bytes in 2919 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:52:21.435922 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-99f18a26-5cf9-4fa9-97a7-ccb67e56316a tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:21.436839 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-99f18a26-5cf9-4fa9-97a7-ccb67e56316a tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 4798e026-102b-4ff4-8888-da4bb6b45c08] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:21.452220 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-99f18a26-5cf9-4fa9-97a7-ccb67e56316a tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:21.453478 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-99f18a26-5cf9-4fa9-97a7-ccb67e56316a tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:21.454025 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-99f18a26-5cf9-4fa9-97a7-ccb67e56316a tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:21.454999 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-99f18a26-5cf9-4fa9-97a7-ccb67e56316a tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:21.455624 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-99f18a26-5cf9-4fa9-97a7-ccb67e56316a tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:21.456226 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-99f18a26-5cf9-4fa9-97a7-ccb67e56316a tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:21.554529 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-99f18a26-5cf9-4fa9-97a7-ccb67e56316a tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:21.565531 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-99f18a26-5cf9-4fa9-97a7-ccb67e56316a tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:21.568784 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-99f18a26-5cf9-4fa9-97a7-ccb67e56316a tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:21.569989 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-99f18a26-5cf9-4fa9-97a7-ccb67e56316a tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] 10.222.0.67 "GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08" status: 200 len: 1366 microversion: 2.47 time: 0.143493 Sep 16 12:52:21.570567 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 848/1722] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:21 2022] GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08 => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:21.584450 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-65e551e8-3a71-402a-897c-7cfd411815c6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:21.585075 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-65e551e8-3a71-402a-897c-7cfd411815c6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:21.615702 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-65e551e8-3a71-402a-897c-7cfd411815c6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:21.619358 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-65e551e8-3a71-402a-897c-7cfd411815c6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:21.620459 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-65e551e8-3a71-402a-897c-7cfd411815c6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:21.621462 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-65e551e8-3a71-402a-897c-7cfd411815c6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:21.627030 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-65e551e8-3a71-402a-897c-7cfd411815c6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:21.630178 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-65e551e8-3a71-402a-897c-7cfd411815c6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:21.633952 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4fe65221-1c44-4503-8517-130345511cd2 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:21.644554 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4fe65221-1c44-4503-8517-130345511cd2 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1716 microversion: 2.1 time: 0.296112 Sep 16 12:52:21.645129 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 875/1723] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:21 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1716 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:21.650447 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-64e85e3f-d309-474e-89b9-ee1c3f7afa46 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:21.651405 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-64e85e3f-d309-474e-89b9-ee1c3f7afa46 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:21.658580 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64e85e3f-d309-474e-89b9-ee1c3f7afa46 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:21.659397 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64e85e3f-d309-474e-89b9-ee1c3f7afa46 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:21.660048 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64e85e3f-d309-474e-89b9-ee1c3f7afa46 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:21.661024 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64e85e3f-d309-474e-89b9-ee1c3f7afa46 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:21.661704 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64e85e3f-d309-474e-89b9-ee1c3f7afa46 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:21.662341 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64e85e3f-d309-474e-89b9-ee1c3f7afa46 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:21.738207 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-64e85e3f-d309-474e-89b9-ee1c3f7afa46 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:21.755529 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-64e85e3f-d309-474e-89b9-ee1c3f7afa46 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:21.766874 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-64e85e3f-d309-474e-89b9-ee1c3f7afa46 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '691336b67d6040f3aefad86397238f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4fa02f470647fea7d4732332e71a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:21.773482 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-64e85e3f-d309-474e-89b9-ee1c3f7afa46 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1473 microversion: 2.91 time: 0.127056 Sep 16 12:52:21.774665 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 876/1724] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:21 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1473 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:21.781006 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a2377944-3811-4328-8a03-05f001f36439 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:21.781620 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a2377944-3811-4328-8a03-05f001f36439 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] [instance: 345ee81d-c503-421c-90ea-218ac1c98600] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:21.787778 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2377944-3811-4328-8a03-05f001f36439 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:21.788496 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2377944-3811-4328-8a03-05f001f36439 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:21.788959 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2377944-3811-4328-8a03-05f001f36439 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:21.790196 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2377944-3811-4328-8a03-05f001f36439 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:21.791303 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2377944-3811-4328-8a03-05f001f36439 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:21.791740 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2377944-3811-4328-8a03-05f001f36439 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:21.911952 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-65e551e8-3a71-402a-897c-7cfd411815c6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:21.923725 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-65e551e8-3a71-402a-897c-7cfd411815c6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1477 microversion: 2.1 time: 0.351977 Sep 16 12:52:21.932364 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a2377944-3811-4328-8a03-05f001f36439 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d4c5f7ddf5432ba8b4eac2cb6a9860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b7d059fb70415fb5dc20e3a921d189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:21.936368 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 849/1725] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:21 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1477 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:21.941343 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a2377944-3811-4328-8a03-05f001f36439 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600" status: 200 len: 1269 microversion: 2.1 time: 0.165494 Sep 16 12:52:21.944596 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-902f4b7f-1953-476e-8493-069a21fb2316 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Calling method '.version_select at 0x7f1034dd21f0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:21.947231 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 877/1726] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:21 2022] GET /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600 => generated 1269 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:21.956041 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b9d64355-5e59-4c14-b967-dcf443342c65 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:52:21.965737 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b9d64355-5e59-4c14-b967-dcf443342c65 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Request method failure captured: Sep 16 12:52:21.965737 n-d-858094-4 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3/action HTTP/1.1 Sep 16 12:52:21.965737 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:52:21.965737 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:52:21.965737 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:52:21.965737 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 34 Sep 16 12:52:21.965737 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:52:21.965737 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:52:21.965737 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:52:21.965737 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:52:21.965737 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHFS8EFvZXNl5S_uda6P-WB34IvsPBJqqwg7-VPrX1aGa8hdMCAAnVJnTeCsbPrqw9dWO6B53YREFTTWZiCJ8BUYBeldDgVVcDdq5yVPDc7DnZSNXJjewGwPXJiMjM_LBftyQzKFAE_KVo7jzyUExj-lyKkXCjdKuYx44pYTKoClJOw Sep 16 12:52:21.965737 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:52:21.965737 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:52:21.965737 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:52:21.965737 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:52:21.965737 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:52:21.965737 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:52:21.965737 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 034ef732e4504d05a4d5d0eea122165e Sep 16 12:52:21.965737 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-28705252 Sep 16 12:52:21.965737 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:52:21.965737 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:52:21.967371 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/034ef732e4504d05a4d5d0eea122165e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/034ef732e4504d05a4d5d0eea122165e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_034ef732e4504d05a4d5d0eea122165e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/034ef732e4504d05a4d5d0eea122165e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:52:21.967371 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-28705252 Sep 16 12:52:21.967371 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 034ef732e4504d05a4d5d0eea122165e Sep 16 12:52:21.967371 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-28705252 Sep 16 12:52:21.967371 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project Sep 16 12:52:21.967371 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:52:21.967371 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:52:21.967371 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 3ef3656188f245d2a41252cee95b2064 Sep 16 12:52:21.967371 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project Sep 16 12:52:21.967371 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 12:52:21.967371 n-d-858094-4 devstack@n-api.service[128779]: {"addFloatingIp": {"address": ""}} Sep 16 12:52:21.967371 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 12:52:21.967371 n-d-858094-4 devstack@n-api.service[128779]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 16 12:52:21.968506 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': 'a4906950-755b-4838-b954-fb07189747f3', 'body': {'addFloatingIp': {'address': ''}}} Sep 16 12:52:21.968506 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:52:21.968506 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:21.968506 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 12:52:21.968506 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 12:52:21.968506 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 12:52:21.968506 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise error Sep 16 12:52:21.968506 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Sep 16 12:52:21.968506 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:52:21.968506 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Sep 16 12:52:21.968506 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Sep 16 12:52:21.968506 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:52:21.968506 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Sep 16 12:52:21.968506 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi '' Sep 16 12:52:21.968506 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:52:21.968506 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:21.968506 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:52:21.968506 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:21.968506 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:21.968506 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:21.968506 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:52:21.968506 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:52:21.970031 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:52:21.970031 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:52:21.970031 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:52:21.970031 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:52:21.970031 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 12:52:21.970031 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 12:52:21.970031 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 12:52:21.970031 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 12:52:21.970031 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 12:52:21.970031 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 12:52:21.970031 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 16 12:52:21.970031 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:52:21.970031 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:21.970031 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:52:21.970031 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:21.970031 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:21.970031 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:21.970031 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 12:52:21.970031 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 12:52:21.971322 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 16 12:52:21.971322 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:52:21.971322 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b9d64355-5e59-4c14-b967-dcf443342c65 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:52:21.971556 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b9d64355-5e59-4c14-b967-dcf443342c65 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] 10.222.0.67 "POST /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3/action" status: 400 len: 142 microversion: 2.1 time: 0.018349 Sep 16 12:52:21.975684 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-902f4b7f-1953-476e-8493-069a21fb2316 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:21.975684 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-902f4b7f-1953-476e-8493-069a21fb2316 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:21.975684 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-902f4b7f-1953-476e-8493-069a21fb2316 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:21.976108 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 878/1727] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:52:21 2022] POST /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3/action => generated 142 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 12:52:21.983024 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bd9312fd-2d04-47af-96d2-bc6a01273030 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:21.983807 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bd9312fd-2d04-47af-96d2-bc6a01273030 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:21.991605 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd9312fd-2d04-47af-96d2-bc6a01273030 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:21.992094 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd9312fd-2d04-47af-96d2-bc6a01273030 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:21.992550 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd9312fd-2d04-47af-96d2-bc6a01273030 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:21.993300 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd9312fd-2d04-47af-96d2-bc6a01273030 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:21.993751 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd9312fd-2d04-47af-96d2-bc6a01273030 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:21.994176 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd9312fd-2d04-47af-96d2-bc6a01273030 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:21.998560 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-902f4b7f-1953-476e-8493-069a21fb2316 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] 10.222.0.67 "GET /compute/v2.1/os-migrations" status: 200 len: 3873 microversion: 2.25 time: 0.058991 Sep 16 12:52:22.007543 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 850/1728] 10.222.0.67 () {60 vars in 1184 bytes} [Fri Sep 16 12:52:21 2022] GET /compute/v2.1/os-migrations => generated 3873 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:22.015789 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-eaff5d6e-4ea0-4ae1-b4a6-dbb9b7383787 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:52:22.024762 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-eaff5d6e-4ea0-4ae1-b4a6-dbb9b7383787 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] [instance: a4906950-755b-4838-b954-fb07189747f3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:22.032206 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eaff5d6e-4ea0-4ae1-b4a6-dbb9b7383787 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:22.032855 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eaff5d6e-4ea0-4ae1-b4a6-dbb9b7383787 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:22.033509 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eaff5d6e-4ea0-4ae1-b4a6-dbb9b7383787 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:22.034322 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eaff5d6e-4ea0-4ae1-b4a6-dbb9b7383787 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:22.035034 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eaff5d6e-4ea0-4ae1-b4a6-dbb9b7383787 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:22.035564 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eaff5d6e-4ea0-4ae1-b4a6-dbb9b7383787 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:22.065160 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eaff5d6e-4ea0-4ae1-b4a6-dbb9b7383787 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "refresh_cache-a4906950-755b-4838-b954-fb07189747f3" {{(pid=128780) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 16 12:52:22.065664 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eaff5d6e-4ea0-4ae1-b4a6-dbb9b7383787 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquired lock "refresh_cache-a4906950-755b-4838-b954-fb07189747f3" {{(pid=128780) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 16 12:52:22.217661 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bd9312fd-2d04-47af-96d2-bc6a01273030 tempest-UnshelveToHostMultiNodesTest-1253340493 tempest-UnshelveToHostMultiNodesTest-1253340493-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 200 len: 1854 microversion: 2.91 time: 0.242591 Sep 16 12:52:22.226393 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 879/1729] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:21 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 1854 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:22.242112 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eaff5d6e-4ea0-4ae1-b4a6-dbb9b7383787 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Releasing lock "refresh_cache-a4906950-755b-4838-b954-fb07189747f3" {{(pid=128780) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 16 12:52:22.242712 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-eaff5d6e-4ea0-4ae1-b4a6-dbb9b7383787 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] HTTP exception thrown: floating IP not found Sep 16 12:52:22.244620 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-916073ae-f85c-4e1b-8e0d-53d2e03d8e5f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:22.244826 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-eaff5d6e-4ea0-4ae1-b4a6-dbb9b7383787 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Request method failure captured: Sep 16 12:52:22.244826 n-d-858094-4 devstack@n-api.service[128780]: request: POST /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3/action HTTP/1.1 Sep 16 12:52:22.244826 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:52:22.244826 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:52:22.244826 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:52:22.244826 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 41 Sep 16 12:52:22.244826 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:52:22.244826 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:52:22.244826 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:52:22.244826 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:52:22.244826 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHFS8EFvZXNl5S_uda6P-WB34IvsPBJqqwg7-VPrX1aGa8hdMCAAnVJnTeCsbPrqw9dWO6B53YREFTTWZiCJ8BUYBeldDgVVcDdq5yVPDc7DnZSNXJjewGwPXJiMjM_LBftyQzKFAE_KVo7jzyUExj-lyKkXCjdKuYx44pYTKoClJOw Sep 16 12:52:22.244826 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:52:22.244826 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:52:22.244826 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:52:22.244826 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:52:22.244826 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:52:22.244826 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:52:22.244826 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 034ef732e4504d05a4d5d0eea122165e Sep 16 12:52:22.244826 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-28705252 Sep 16 12:52:22.244826 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:52:22.244826 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:52:22.246574 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/034ef732e4504d05a4d5d0eea122165e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/034ef732e4504d05a4d5d0eea122165e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_034ef732e4504d05a4d5d0eea122165e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/034ef732e4504d05a4d5d0eea122165e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:52:22.246574 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-28705252 Sep 16 12:52:22.246574 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 034ef732e4504d05a4d5d0eea122165e Sep 16 12:52:22.246574 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-28705252 Sep 16 12:52:22.246574 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project Sep 16 12:52:22.246574 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:52:22.246574 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:52:22.246574 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 3ef3656188f245d2a41252cee95b2064 Sep 16 12:52:22.246574 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project Sep 16 12:52:22.246574 n-d-858094-4 devstack@n-api.service[128780]: Sep 16 12:52:22.246574 n-d-858094-4 devstack@n-api.service[128780]: {"addFloatingIp": {"address": "0.0.0.0"}} Sep 16 12:52:22.246574 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 12:52:22.246574 n-d-858094-4 devstack@n-api.service[128780]: exception: floating IP not found Sep 16 12:52:22.247516 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'a4906950-755b-4838-b954-fb07189747f3', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Sep 16 12:52:22.247516 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:52:22.247516 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:22.247516 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 16 12:52:22.247516 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 16 12:52:22.247516 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 16 12:52:22.247516 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 16 12:52:22.247516 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Sep 16 12:52:22.247516 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Sep 16 12:52:22.247516 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 16 12:52:22.247516 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 16 12:52:22.247516 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 16 12:52:22.247516 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:22.247516 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:22.247516 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:22.247516 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:22.247516 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:22.247516 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:22.247516 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:52:22.248859 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:52:22.248859 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:52:22.248859 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:52:22.248859 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:52:22.248859 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:52:22.248859 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:52:22.248859 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:52:22.248859 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Sep 16 12:52:22.248859 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 16 12:52:22.248859 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Sep 16 12:52:22.248859 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:22.248859 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:22.248859 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:22.248859 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:22.248859 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:22.248859 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:22.248859 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:52:22.248859 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:52:22.248859 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Sep 16 12:52:22.248859 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:22.250218 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-916073ae-f85c-4e1b-8e0d-53d2e03d8e5f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] [instance: 041df092-33d4-4b71-84d8-7cd479d32b4f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:22.251708 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-eaff5d6e-4ea0-4ae1-b4a6-dbb9b7383787 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Returning 404 to user: floating IP not found {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:52:22.252836 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-eaff5d6e-4ea0-4ae1-b4a6-dbb9b7383787 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] 10.222.0.67 "POST /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3/action" status: 404 len: 67 microversion: 2.1 time: 0.243369 Sep 16 12:52:22.255480 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 851/1730] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:52:22 2022] POST /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3/action => generated 67 bytes in 247 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 12:52:22.267003 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-916073ae-f85c-4e1b-8e0d-53d2e03d8e5f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:22.267711 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-916073ae-f85c-4e1b-8e0d-53d2e03d8e5f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:22.268150 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-916073ae-f85c-4e1b-8e0d-53d2e03d8e5f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:22.269404 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-916073ae-f85c-4e1b-8e0d-53d2e03d8e5f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:22.269404 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-916073ae-f85c-4e1b-8e0d-53d2e03d8e5f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:22.270362 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-916073ae-f85c-4e1b-8e0d-53d2e03d8e5f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:22.280763 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-908a1257-8019-4c36-97e5-f09fc279a24f tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:52:22.337296 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-908a1257-8019-4c36-97e5-f09fc279a24f tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Sep 16 12:52:22.338907 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-908a1257-8019-4c36-97e5-f09fc279a24f tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Request method failure captured: Sep 16 12:52:22.338907 n-d-858094-4 devstack@n-api.service[128780]: request: POST /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3/action HTTP/1.1 Sep 16 12:52:22.338907 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:52:22.338907 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:52:22.338907 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:52:22.338907 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 44 Sep 16 12:52:22.338907 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:52:22.338907 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:52:22.338907 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:52:22.338907 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:52:22.338907 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHFS8EFvZXNl5S_uda6P-WB34IvsPBJqqwg7-VPrX1aGa8hdMCAAnVJnTeCsbPrqw9dWO6B53YREFTTWZiCJ8BUYBeldDgVVcDdq5yVPDc7DnZSNXJjewGwPXJiMjM_LBftyQzKFAE_KVo7jzyUExj-lyKkXCjdKuYx44pYTKoClJOw Sep 16 12:52:22.338907 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:52:22.338907 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:52:22.338907 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:52:22.338907 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:52:22.338907 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:52:22.338907 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:52:22.338907 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 034ef732e4504d05a4d5d0eea122165e Sep 16 12:52:22.338907 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-28705252 Sep 16 12:52:22.338907 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:52:22.338907 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:52:22.340430 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/034ef732e4504d05a4d5d0eea122165e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/034ef732e4504d05a4d5d0eea122165e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_034ef732e4504d05a4d5d0eea122165e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/034ef732e4504d05a4d5d0eea122165e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:52:22.340430 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-28705252 Sep 16 12:52:22.340430 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 034ef732e4504d05a4d5d0eea122165e Sep 16 12:52:22.340430 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-28705252 Sep 16 12:52:22.340430 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project Sep 16 12:52:22.340430 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:52:22.340430 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:52:22.340430 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 3ef3656188f245d2a41252cee95b2064 Sep 16 12:52:22.340430 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project Sep 16 12:52:22.340430 n-d-858094-4 devstack@n-api.service[128780]: Sep 16 12:52:22.340430 n-d-858094-4 devstack@n-api.service[128780]: {"removeFloatingIp": {"address": "0.0.0.0"}} Sep 16 12:52:22.340430 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 12:52:22.340430 n-d-858094-4 devstack@n-api.service[128780]: exception: Floating IP not found for address 0.0.0.0. Sep 16 12:52:22.341298 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'a4906950-755b-4838-b954-fb07189747f3', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Sep 16 12:52:22.341298 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:52:22.341298 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:22.341298 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Sep 16 12:52:22.341298 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Sep 16 12:52:22.341298 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Sep 16 12:52:22.341298 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Sep 16 12:52:22.341298 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 16 12:52:22.341298 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 16 12:52:22.341298 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 16 12:52:22.341298 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:22.341298 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:22.341298 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:22.341298 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:22.341298 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:22.341298 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:22.341298 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:52:22.341298 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:52:22.341298 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:52:22.342670 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:52:22.342670 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:52:22.342670 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:52:22.342670 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:52:22.342670 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:52:22.342670 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Sep 16 12:52:22.342670 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Sep 16 12:52:22.342670 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Sep 16 12:52:22.342670 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Sep 16 12:52:22.342670 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Sep 16 12:52:22.342670 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:22.342670 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:22.342670 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:22.342670 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:22.342670 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:22.342670 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:22.342670 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:52:22.342670 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:52:22.342670 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Sep 16 12:52:22.342670 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:22.345776 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-908a1257-8019-4c36-97e5-f09fc279a24f tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:52:22.345776 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-908a1257-8019-4c36-97e5-f09fc279a24f tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] 10.222.0.67 "POST /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3/action" status: 404 len: 88 microversion: 2.1 time: 0.077950 Sep 16 12:52:22.345776 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 852/1731] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:52:22 2022] POST /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3/action => generated 88 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 12:52:22.347538 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-66325db3-1e56-4c46-9db9-82bab44aabf9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:22.347898 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-66325db3-1e56-4c46-9db9-82bab44aabf9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:22.372740 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-66325db3-1e56-4c46-9db9-82bab44aabf9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:22.373222 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-66325db3-1e56-4c46-9db9-82bab44aabf9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:22.374029 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-66325db3-1e56-4c46-9db9-82bab44aabf9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:22.376964 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-66325db3-1e56-4c46-9db9-82bab44aabf9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:22.377626 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-66325db3-1e56-4c46-9db9-82bab44aabf9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:22.378071 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-66325db3-1e56-4c46-9db9-82bab44aabf9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:22.415694 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-66325db3-1e56-4c46-9db9-82bab44aabf9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:52:22.427402 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-66325db3-1e56-4c46-9db9-82bab44aabf9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:22.428664 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-66325db3-1e56-4c46-9db9-82bab44aabf9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:22.429308 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-66325db3-1e56-4c46-9db9-82bab44aabf9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:22.493947 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-66325db3-1e56-4c46-9db9-82bab44aabf9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lazy-loading 'flavor' on Instance uuid e1f493c8-0adf-4575-8fbd-4591f72c5e6d {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:52:22.506997 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-916073ae-f85c-4e1b-8e0d-53d2e03d8e5f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lazy-loading 'services' on Instance uuid 041df092-33d4-4b71-84d8-7cd479d32b4f {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:52:22.513005 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-66325db3-1e56-4c46-9db9-82bab44aabf9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lazy-loading 'system_metadata' on Instance uuid e1f493c8-0adf-4575-8fbd-4591f72c5e6d {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:52:22.544087 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-916073ae-f85c-4e1b-8e0d-53d2e03d8e5f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f" status: 200 len: 2049 microversion: 2.25 time: 0.315596 Sep 16 12:52:22.545066 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 880/1732] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:22 2022] GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f => generated 2049 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:22.550578 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-59769079-7a30-4f37-9d32-05890a122fff tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:22.551327 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-59769079-7a30-4f37-9d32-05890a122fff tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] [instance: a4906950-755b-4838-b954-fb07189747f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:22.558165 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59769079-7a30-4f37-9d32-05890a122fff tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:22.558997 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59769079-7a30-4f37-9d32-05890a122fff tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:22.559623 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59769079-7a30-4f37-9d32-05890a122fff tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:22.560885 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59769079-7a30-4f37-9d32-05890a122fff tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:22.561512 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59769079-7a30-4f37-9d32-05890a122fff tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:22.562218 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59769079-7a30-4f37-9d32-05890a122fff tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:22.592527 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-66325db3-1e56-4c46-9db9-82bab44aabf9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lazy-loading 'metadata' on Instance uuid e1f493c8-0adf-4575-8fbd-4591f72c5e6d {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:52:22.615502 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-59769079-7a30-4f37-9d32-05890a122fff tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] [instance: a4906950-755b-4838-b954-fb07189747f3] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:52:22.730622 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-59769079-7a30-4f37-9d32-05890a122fff tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3" status: 204 len: 0 microversion: 2.1 time: 0.183623 Sep 16 12:52:22.732371 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 881/1733] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:52:22 2022] DELETE /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:52:22.740277 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d89729c2-0856-460a-a5da-381adc4dace3 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:22.741295 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d89729c2-0856-460a-a5da-381adc4dace3 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 4798e026-102b-4ff4-8888-da4bb6b45c08] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:22.751891 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d89729c2-0856-460a-a5da-381adc4dace3 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:22.753127 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d89729c2-0856-460a-a5da-381adc4dace3 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:22.753821 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d89729c2-0856-460a-a5da-381adc4dace3 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:22.754715 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d89729c2-0856-460a-a5da-381adc4dace3 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:22.755326 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d89729c2-0856-460a-a5da-381adc4dace3 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:22.756070 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d89729c2-0856-460a-a5da-381adc4dace3 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:22.816864 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:52:22.948370 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d89729c2-0856-460a-a5da-381adc4dace3 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:22.963969 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d89729c2-0856-460a-a5da-381adc4dace3 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:22.971364 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d89729c2-0856-460a-a5da-381adc4dace3 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:22.973686 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d89729c2-0856-460a-a5da-381adc4dace3 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] 10.222.0.67 "GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08" status: 200 len: 1366 microversion: 2.47 time: 0.239799 Sep 16 12:52:22.976350 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 882/1734] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:22 2022] GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08 => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:22.985752 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5b212f3f-a459-42e2-ba54-bcb293d065dc tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:22.989125 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5b212f3f-a459-42e2-ba54-bcb293d065dc tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:23.007650 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b212f3f-a459-42e2-ba54-bcb293d065dc tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:23.008172 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b212f3f-a459-42e2-ba54-bcb293d065dc tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:23.009140 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b212f3f-a459-42e2-ba54-bcb293d065dc tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:23.011593 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b212f3f-a459-42e2-ba54-bcb293d065dc tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:23.012113 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b212f3f-a459-42e2-ba54-bcb293d065dc tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:23.013870 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b212f3f-a459-42e2-ba54-bcb293d065dc tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:23.298247 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.scheduler.client.report [None req-66325db3-1e56-4c46-9db9-82bab44aabf9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Deleted allocations for instance e1f493c8-0adf-4575-8fbd-4591f72c5e6d Sep 16 12:52:23.321670 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-66325db3-1e56-4c46-9db9-82bab44aabf9 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 204 len: 0 microversion: 2.91 time: 0.979164 Sep 16 12:52:23.322653 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 853/1735] 10.222.0.67 () {60 vars in 1280 bytes} [Fri Sep 16 12:52:22 2022] DELETE /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 0 bytes in 981 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 12:52:23.327522 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-209c4419-8942-43c8-aacf-268b8f99e900 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:23.328256 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-209c4419-8942-43c8-aacf-268b8f99e900 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] [instance: a4906950-755b-4838-b954-fb07189747f3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:23.334644 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-209c4419-8942-43c8-aacf-268b8f99e900 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:23.335221 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-209c4419-8942-43c8-aacf-268b8f99e900 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:23.335730 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-209c4419-8942-43c8-aacf-268b8f99e900 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:23.336522 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-209c4419-8942-43c8-aacf-268b8f99e900 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:23.337946 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-209c4419-8942-43c8-aacf-268b8f99e900 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:23.338447 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-209c4419-8942-43c8-aacf-268b8f99e900 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:23.371687 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5b212f3f-a459-42e2-ba54-bcb293d065dc tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:23.380803 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5b212f3f-a459-42e2-ba54-bcb293d065dc tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1716 microversion: 2.1 time: 0.403057 Sep 16 12:52:23.392250 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 883/1736] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:22 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1716 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:23.400234 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9b84bfb7-fcad-4a1b-81eb-f5d2f1f6ea68 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1448419209", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": [{"uuid": "1e927054-126f-4e94-8719-fa14f3244a7f"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:52:23.482606 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-9b84bfb7-fcad-4a1b-81eb-f5d2f1f6ea68 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] validate_networks() for [('1e927054-126f-4e94-8719-fa14f3244a7f', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:52:23.586204 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-209c4419-8942-43c8-aacf-268b8f99e900 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef3656188f245d2a41252cee95b2064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034ef732e4504d05a4d5d0eea122165e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:23.594932 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-209c4419-8942-43c8-aacf-268b8f99e900 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] 10.222.0.67 "GET /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3" status: 200 len: 1542 microversion: 2.1 time: 0.270976 Sep 16 12:52:23.596037 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 854/1737] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:23 2022] GET /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3 => generated 1542 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:23.603080 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ce1a97bd-c65f-4c35-ba8b-e51ea0a41d04 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:23.603935 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ce1a97bd-c65f-4c35-ba8b-e51ea0a41d04 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:23.610630 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce1a97bd-c65f-4c35-ba8b-e51ea0a41d04 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:23.611513 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce1a97bd-c65f-4c35-ba8b-e51ea0a41d04 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:23.612248 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce1a97bd-c65f-4c35-ba8b-e51ea0a41d04 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:23.618576 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce1a97bd-c65f-4c35-ba8b-e51ea0a41d04 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:23.619676 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce1a97bd-c65f-4c35-ba8b-e51ea0a41d04 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:23.621284 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce1a97bd-c65f-4c35-ba8b-e51ea0a41d04 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:24.092839 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ce1a97bd-c65f-4c35-ba8b-e51ea0a41d04 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:24.097547 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=84,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=12,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:52:24.104756 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ce1a97bd-c65f-4c35-ba8b-e51ea0a41d04 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1477 microversion: 2.1 time: 0.507239 Sep 16 12:52:24.105424 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 855/1738] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:23 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1477 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:24.112317 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-32153cba-706e-4bdf-b11c-b94d99ec69e7 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:24.113103 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-32153cba-706e-4bdf-b11c-b94d99ec69e7 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] [instance: 345ee81d-c503-421c-90ea-218ac1c98600] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:24.143877 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-32153cba-706e-4bdf-b11c-b94d99ec69e7 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:24.144403 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-32153cba-706e-4bdf-b11c-b94d99ec69e7 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:24.144847 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-32153cba-706e-4bdf-b11c-b94d99ec69e7 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:24.145563 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-32153cba-706e-4bdf-b11c-b94d99ec69e7 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:24.146014 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-32153cba-706e-4bdf-b11c-b94d99ec69e7 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:24.146437 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-32153cba-706e-4bdf-b11c-b94d99ec69e7 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:24.332681 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-32153cba-706e-4bdf-b11c-b94d99ec69e7 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d4c5f7ddf5432ba8b4eac2cb6a9860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b7d059fb70415fb5dc20e3a921d189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:24.342251 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-32153cba-706e-4bdf-b11c-b94d99ec69e7 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600" status: 200 len: 1275 microversion: 2.1 time: 0.235350 Sep 16 12:52:24.345453 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 856/1739] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:24 2022] GET /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600 => generated 1275 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:24.351407 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3f016ef4-09d2-4d54-9080-db174411e6b1 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:24.352369 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3f016ef4-09d2-4d54-9080-db174411e6b1 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] [instance: e1f493c8-0adf-4575-8fbd-4591f72c5e6d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:24.362122 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3f016ef4-09d2-4d54-9080-db174411e6b1 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:24.362682 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3f016ef4-09d2-4d54-9080-db174411e6b1 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:24.363115 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3f016ef4-09d2-4d54-9080-db174411e6b1 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:24.363811 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3f016ef4-09d2-4d54-9080-db174411e6b1 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:24.364468 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3f016ef4-09d2-4d54-9080-db174411e6b1 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:24.365051 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3f016ef4-09d2-4d54-9080-db174411e6b1 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:24.383777 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-3f016ef4-09d2-4d54-9080-db174411e6b1 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] HTTP exception thrown: Instance e1f493c8-0adf-4575-8fbd-4591f72c5e6d could not be found. Sep 16 12:52:24.385930 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3f016ef4-09d2-4d54-9080-db174411e6b1 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Request method failure captured: Sep 16 12:52:24.385930 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d HTTP/1.1 Sep 16 12:52:24.385930 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:52:24.385930 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:52:24.385930 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:52:24.385930 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:52:24.385930 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:52:24.385930 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:52:24.385930 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:52:24.385930 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:52:24.385930 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHDOWMpxwcpKf1pX9vk9KhFdQHd7S9VdtctHCG2ApbasTIvY7YKQ_My26BWE1ZJdOxIzeb2jBp9Jgx_AmJtzSevonhI--J-1vP3YVlzch6rIddT3JQ4M9p2I-M0QiDLzZFkoOAcBABJ-r2uEosTHgnrSmwbuCGJmNXU_tbqewc9b-DE Sep 16 12:52:24.385930 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:52:24.385930 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:52:24.385930 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:52:24.385930 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:52:24.385930 n-d-858094-4 devstack@n-api.service[128780]: X-Openstack-Nova-Api-Version: 2.91 Sep 16 12:52:24.385930 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:52:24.385930 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:52:24.385930 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 2f4fa02f470647fea7d4732332e71a2d Sep 16 12:52:24.385930 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-214912117 Sep 16 12:52:24.385930 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:52:24.385930 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:52:24.387724 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2f4fa02f470647fea7d4732332e71a2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2f4fa02f470647fea7d4732332e71a2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2f4fa02f470647fea7d4732332e71a2d", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2f4fa02f470647fea7d4732332e71a2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:52:24.387724 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-214912117 Sep 16 12:52:24.387724 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 2f4fa02f470647fea7d4732332e71a2d Sep 16 12:52:24.387724 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-214912117 Sep 16 12:52:24.387724 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-UnshelveToHostMultiNodesTest-214912117-project Sep 16 12:52:24.387724 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:52:24.387724 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:52:24.387724 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 691336b67d6040f3aefad86397238f8c Sep 16 12:52:24.387724 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-214912117-project Sep 16 12:52:24.387724 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:52:24.387724 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance e1f493c8-0adf-4575-8fbd-4591f72c5e6d could not be found. Sep 16 12:52:24.387724 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'e1f493c8-0adf-4575-8fbd-4591f72c5e6d'} Sep 16 12:52:24.388707 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:52:24.388707 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:24.388707 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:52:24.388707 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:52:24.388707 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:52:24.388707 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:52:24.388707 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:52:24.388707 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:52:24.388707 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:52:24.388707 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:52:24.388707 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1f493c8-0adf-4575-8fbd-4591f72c5e6d could not be found. Sep 16 12:52:24.388707 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:24.388707 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:24.388707 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:24.388707 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:24.388707 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:24.388707 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:24.388707 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:52:24.388707 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:52:24.388707 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:52:24.390183 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:52:24.390183 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:52:24.390183 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:52:24.390183 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:52:24.390183 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:52:24.390183 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:52:24.390183 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:52:24.390183 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1f493c8-0adf-4575-8fbd-4591f72c5e6d could not be found. Sep 16 12:52:24.390183 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:24.390183 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:24.390183 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:24.390183 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:24.390183 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:24.390183 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:24.390183 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:52:24.390183 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:52:24.390183 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1f493c8-0adf-4575-8fbd-4591f72c5e6d could not be found. Sep 16 12:52:24.390183 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:24.397526 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3f016ef4-09d2-4d54-9080-db174411e6b1 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] Returning 404 to user: Instance e1f493c8-0adf-4575-8fbd-4591f72c5e6d could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:52:24.398621 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3f016ef4-09d2-4d54-9080-db174411e6b1 tempest-UnshelveToHostMultiNodesTest-214912117 tempest-UnshelveToHostMultiNodesTest-214912117-project] 10.222.0.67 "GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d" status: 404 len: 111 microversion: 2.91 time: 0.051709 Sep 16 12:52:24.399487 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 857/1740] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:24 2022] GET /compute/v2.1/servers/e1f493c8-0adf-4575-8fbd-4591f72c5e6d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 12:52:24.407561 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5b6dc28b-7444-4eac-9057-a8c1acf1267b tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:24.408435 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5b6dc28b-7444-4eac-9057-a8c1acf1267b tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 4798e026-102b-4ff4-8888-da4bb6b45c08] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:24.416601 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5b6dc28b-7444-4eac-9057-a8c1acf1267b tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:24.417361 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5b6dc28b-7444-4eac-9057-a8c1acf1267b tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:24.418330 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5b6dc28b-7444-4eac-9057-a8c1acf1267b tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:24.419661 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5b6dc28b-7444-4eac-9057-a8c1acf1267b tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:24.420432 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5b6dc28b-7444-4eac-9057-a8c1acf1267b tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:24.421016 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5b6dc28b-7444-4eac-9057-a8c1acf1267b tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:24.538030 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5b6dc28b-7444-4eac-9057-a8c1acf1267b tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:24.549742 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5b6dc28b-7444-4eac-9057-a8c1acf1267b tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:24.554514 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5b6dc28b-7444-4eac-9057-a8c1acf1267b tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:24.555759 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5b6dc28b-7444-4eac-9057-a8c1acf1267b tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] 10.222.0.67 "GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08" status: 200 len: 1372 microversion: 2.47 time: 0.154105 Sep 16 12:52:24.560406 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 858/1741] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:24 2022] GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:24.565498 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d8397f92-bc9e-4b32-a4d9-be8486a03a2d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:24.565897 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d8397f92-bc9e-4b32-a4d9-be8486a03a2d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:24.586129 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d8397f92-bc9e-4b32-a4d9-be8486a03a2d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:24.586767 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d8397f92-bc9e-4b32-a4d9-be8486a03a2d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:24.588028 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d8397f92-bc9e-4b32-a4d9-be8486a03a2d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:24.588555 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d8397f92-bc9e-4b32-a4d9-be8486a03a2d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:24.589008 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d8397f92-bc9e-4b32-a4d9-be8486a03a2d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:24.589550 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d8397f92-bc9e-4b32-a4d9-be8486a03a2d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:25.017474 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-9b84bfb7-fcad-4a1b-81eb-f5d2f1f6ea68 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:52:25.018654 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-9b84bfb7-fcad-4a1b-81eb-f5d2f1f6ea68 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:52:25.019763 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-9b84bfb7-fcad-4a1b-81eb-f5d2f1f6ea68 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:52:25.021728 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-9b84bfb7-fcad-4a1b-81eb-f5d2f1f6ea68 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:52:25.027666 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-9b84bfb7-fcad-4a1b-81eb-f5d2f1f6ea68 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:52:25.044596 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b84bfb7-fcad-4a1b-81eb-f5d2f1f6ea68 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:25.045406 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b84bfb7-fcad-4a1b-81eb-f5d2f1f6ea68 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:25.046121 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b84bfb7-fcad-4a1b-81eb-f5d2f1f6ea68 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:25.047144 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b84bfb7-fcad-4a1b-81eb-f5d2f1f6ea68 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:25.048303 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b84bfb7-fcad-4a1b-81eb-f5d2f1f6ea68 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:25.049108 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b84bfb7-fcad-4a1b-81eb-f5d2f1f6ea68 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:25.084791 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-9b84bfb7-fcad-4a1b-81eb-f5d2f1f6ea68 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Getting quotas for project da915844493a4928ac8830897afa126f. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:52:25.092229 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-9b84bfb7-fcad-4a1b-81eb-f5d2f1f6ea68 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Getting quotas for user ab6ca4cf98e14358bf8e0f625812fbb9 and project da915844493a4928ac8830897afa126f. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:52:25.116670 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9b84bfb7-fcad-4a1b-81eb-f5d2f1f6ea68 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:52:25.119873 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9b84bfb7-fcad-4a1b-81eb-f5d2f1f6ea68 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 4fbd6b22-2181-4786-9116-a8c8eafb9933] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:52:25.193424 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9b84bfb7-fcad-4a1b-81eb-f5d2f1f6ea68 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.810099 Sep 16 12:52:25.194508 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 884/1742] 10.222.0.67 () {62 vars in 1188 bytes} [Fri Sep 16 12:52:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1812 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 16 12:52:25.202658 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9749f2ae-abd9-4595-8c1c-df5c431296b8 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:25.204684 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9749f2ae-abd9-4595-8c1c-df5c431296b8 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] [instance: a4906950-755b-4838-b954-fb07189747f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:25.218850 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9749f2ae-abd9-4595-8c1c-df5c431296b8 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:25.219712 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9749f2ae-abd9-4595-8c1c-df5c431296b8 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:25.221747 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9749f2ae-abd9-4595-8c1c-df5c431296b8 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:25.222914 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9749f2ae-abd9-4595-8c1c-df5c431296b8 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:25.223839 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9749f2ae-abd9-4595-8c1c-df5c431296b8 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:25.224498 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9749f2ae-abd9-4595-8c1c-df5c431296b8 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:25.476500 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d8397f92-bc9e-4b32-a4d9-be8486a03a2d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:25.485179 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d8397f92-bc9e-4b32-a4d9-be8486a03a2d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1716 microversion: 2.1 time: 0.923643 Sep 16 12:52:25.491740 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 859/1743] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:24 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1716 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:25.497480 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5eef9c5a-484f-449f-b71f-ba0f53496f32 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:25.501949 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5eef9c5a-484f-449f-b71f-ba0f53496f32 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:25.517846 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5eef9c5a-484f-449f-b71f-ba0f53496f32 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:25.518583 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5eef9c5a-484f-449f-b71f-ba0f53496f32 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:25.519228 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5eef9c5a-484f-449f-b71f-ba0f53496f32 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:25.520239 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5eef9c5a-484f-449f-b71f-ba0f53496f32 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:25.520756 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5eef9c5a-484f-449f-b71f-ba0f53496f32 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:25.523288 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5eef9c5a-484f-449f-b71f-ba0f53496f32 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:26.015818 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9749f2ae-abd9-4595-8c1c-df5c431296b8 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef3656188f245d2a41252cee95b2064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034ef732e4504d05a4d5d0eea122165e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:26.029128 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9749f2ae-abd9-4595-8c1c-df5c431296b8 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] 10.222.0.67 "GET /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3" status: 200 len: 1542 microversion: 2.1 time: 0.833189 Sep 16 12:52:26.044263 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 885/1744] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:25 2022] GET /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3 => generated 1542 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:26.044263 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3a17314a-621b-456f-bb66-cbf4dd424dd8 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:26.044263 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3a17314a-621b-456f-bb66-cbf4dd424dd8 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 4fbd6b22-2181-4786-9116-a8c8eafb9933] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:26.213931 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5eef9c5a-484f-449f-b71f-ba0f53496f32 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:26.242659 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5eef9c5a-484f-449f-b71f-ba0f53496f32 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1477 microversion: 2.1 time: 0.744274 Sep 16 12:52:26.256646 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 860/1745] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:25 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1477 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:26.256646 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-994b170e-6f07-48eb-a634-487a39d98db2 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:26.256646 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-994b170e-6f07-48eb-a634-487a39d98db2 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] [instance: 345ee81d-c503-421c-90ea-218ac1c98600] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:26.264364 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-994b170e-6f07-48eb-a634-487a39d98db2 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:26.264861 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-994b170e-6f07-48eb-a634-487a39d98db2 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:26.265298 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-994b170e-6f07-48eb-a634-487a39d98db2 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:26.270320 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-994b170e-6f07-48eb-a634-487a39d98db2 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:26.271020 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-994b170e-6f07-48eb-a634-487a39d98db2 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:26.274867 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-994b170e-6f07-48eb-a634-487a39d98db2 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:26.317660 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3a17314a-621b-456f-bb66-cbf4dd424dd8 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:26.332723 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3a17314a-621b-456f-bb66-cbf4dd424dd8 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:26.343940 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3a17314a-621b-456f-bb66-cbf4dd424dd8 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:26.350408 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3a17314a-621b-456f-bb66-cbf4dd424dd8 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933" status: 200 len: 1262 microversion: 2.25 time: 0.316761 Sep 16 12:52:26.354990 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 886/1746] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:26 2022] GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933 => generated 1262 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:26.377120 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-475a9544-be2a-474b-ae36-aade53d9b964 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:26.389414 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-475a9544-be2a-474b-ae36-aade53d9b964 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 4798e026-102b-4ff4-8888-da4bb6b45c08] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:26.415156 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-475a9544-be2a-474b-ae36-aade53d9b964 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:26.435882 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-475a9544-be2a-474b-ae36-aade53d9b964 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:26.436485 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-475a9544-be2a-474b-ae36-aade53d9b964 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:26.437339 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-475a9544-be2a-474b-ae36-aade53d9b964 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:26.438046 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-475a9544-be2a-474b-ae36-aade53d9b964 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:26.438698 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-475a9544-be2a-474b-ae36-aade53d9b964 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:26.771266 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-475a9544-be2a-474b-ae36-aade53d9b964 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:26.788549 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-475a9544-be2a-474b-ae36-aade53d9b964 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:26.788549 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-475a9544-be2a-474b-ae36-aade53d9b964 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:26.789180 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-475a9544-be2a-474b-ae36-aade53d9b964 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] 10.222.0.67 "GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08" status: 200 len: 1372 microversion: 2.47 time: 0.432905 Sep 16 12:52:26.791933 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 887/1747] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:26 2022] GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08 => generated 1372 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:26.803330 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-d991e5e7-03d7-442a-b707-b24a94b7ca93 req-f8201814-d5f6-4cd9-884c-0514aaf23023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4906950-755b-4838-b954-fb07189747f3", "name": "network-vif-deleted", "tag": "92b5ca07-8b77-48e8-915c-8ee94ddb3bb2"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:52:26.845818 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-994b170e-6f07-48eb-a634-487a39d98db2 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d4c5f7ddf5432ba8b4eac2cb6a9860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b7d059fb70415fb5dc20e3a921d189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:26.848880 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d991e5e7-03d7-442a-b707-b24a94b7ca93 req-f8201814-d5f6-4cd9-884c-0514aaf23023 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:26.850655 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d991e5e7-03d7-442a-b707-b24a94b7ca93 req-f8201814-d5f6-4cd9-884c-0514aaf23023 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:26.860520 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d991e5e7-03d7-442a-b707-b24a94b7ca93 req-f8201814-d5f6-4cd9-884c-0514aaf23023 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:26.900163 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-994b170e-6f07-48eb-a634-487a39d98db2 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600" status: 200 len: 1317 microversion: 2.1 time: 0.651314 Sep 16 12:52:26.917153 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-d991e5e7-03d7-442a-b707-b24a94b7ca93 req-f8201814-d5f6-4cd9-884c-0514aaf23023 service nova] Creating event network-vif-deleted:92b5ca07-8b77-48e8-915c-8ee94ddb3bb2 for instance a4906950-755b-4838-b954-fb07189747f3 on n-h2-858094-4 Sep 16 12:52:26.920690 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 861/1748] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:26 2022] GET /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600 => generated 1317 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:26.929361 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-d991e5e7-03d7-442a-b707-b24a94b7ca93 req-f8201814-d5f6-4cd9-884c-0514aaf23023 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133714 Sep 16 12:52:26.935607 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 888/1749] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:52:26.938100 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-aca08225-3973-4693-8463-b2abfac4931b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:26.941103 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-aca08225-3973-4693-8463-b2abfac4931b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:26.958611 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aca08225-3973-4693-8463-b2abfac4931b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:26.959108 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aca08225-3973-4693-8463-b2abfac4931b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:26.959543 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aca08225-3973-4693-8463-b2abfac4931b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:26.960338 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aca08225-3973-4693-8463-b2abfac4931b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:26.960963 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aca08225-3973-4693-8463-b2abfac4931b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:26.961568 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aca08225-3973-4693-8463-b2abfac4931b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:27.057335 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e3005b31-9f48-4c79-82e8-87031d76258e tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:27.060518 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e3005b31-9f48-4c79-82e8-87031d76258e tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] [instance: a4906950-755b-4838-b954-fb07189747f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:27.074344 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3005b31-9f48-4c79-82e8-87031d76258e tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:27.075439 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3005b31-9f48-4c79-82e8-87031d76258e tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:27.076412 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3005b31-9f48-4c79-82e8-87031d76258e tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:27.077144 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3005b31-9f48-4c79-82e8-87031d76258e tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:27.077758 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3005b31-9f48-4c79-82e8-87031d76258e tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:27.080977 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3005b31-9f48-4c79-82e8-87031d76258e tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:27.146433 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3005b31-9f48-4c79-82e8-87031d76258e tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:27.147068 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3005b31-9f48-4c79-82e8-87031d76258e tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:27.147506 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3005b31-9f48-4c79-82e8-87031d76258e tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:27.148110 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-e3005b31-9f48-4c79-82e8-87031d76258e tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lazy-loading 'fault' on Instance uuid a4906950-755b-4838-b954-fb07189747f3 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:52:27.221596 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e3005b31-9f48-4c79-82e8-87031d76258e tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef3656188f245d2a41252cee95b2064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034ef732e4504d05a4d5d0eea122165e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:27.241372 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e3005b31-9f48-4c79-82e8-87031d76258e tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] 10.222.0.67 "GET /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3" status: 200 len: 1321 microversion: 2.1 time: 0.189526 Sep 16 12:52:27.242263 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 889/1750] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:27 2022] GET /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3 => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:27.275105 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0f50e15b-8a88-4921-b790-6916f33d7128 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:27.277032 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0f50e15b-8a88-4921-b790-6916f33d7128 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:27.284217 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f50e15b-8a88-4921-b790-6916f33d7128 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:27.284784 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f50e15b-8a88-4921-b790-6916f33d7128 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:27.285444 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f50e15b-8a88-4921-b790-6916f33d7128 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:27.286324 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f50e15b-8a88-4921-b790-6916f33d7128 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:27.286836 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f50e15b-8a88-4921-b790-6916f33d7128 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:27.287329 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f50e15b-8a88-4921-b790-6916f33d7128 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:27.552228 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-aca08225-3973-4693-8463-b2abfac4931b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:27.589003 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-aca08225-3973-4693-8463-b2abfac4931b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1716 microversion: 2.1 time: 0.661103 Sep 16 12:52:27.607507 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 862/1751] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:26 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1716 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:27.634612 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-815b255e-d0b7-4361-9faf-fe69db2387a8 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:27.636875 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-815b255e-d0b7-4361-9faf-fe69db2387a8 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 4fbd6b22-2181-4786-9116-a8c8eafb9933] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:27.653630 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-815b255e-d0b7-4361-9faf-fe69db2387a8 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:27.655094 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-815b255e-d0b7-4361-9faf-fe69db2387a8 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:27.655832 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-815b255e-d0b7-4361-9faf-fe69db2387a8 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:27.670567 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-815b255e-d0b7-4361-9faf-fe69db2387a8 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:27.671705 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-815b255e-d0b7-4361-9faf-fe69db2387a8 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:27.672614 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-815b255e-d0b7-4361-9faf-fe69db2387a8 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:27.693653 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0f50e15b-8a88-4921-b790-6916f33d7128 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:27.704609 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0f50e15b-8a88-4921-b790-6916f33d7128 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1477 microversion: 2.1 time: 0.437025 Sep 16 12:52:27.709703 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 890/1752] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:27 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1477 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:27.824739 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-815b255e-d0b7-4361-9faf-fe69db2387a8 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:27.826335 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-99dffd31-f6c4-493e-bade-636721c72c36 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:27.827430 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-99dffd31-f6c4-493e-bade-636721c72c36 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 4798e026-102b-4ff4-8888-da4bb6b45c08] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:27.834248 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99dffd31-f6c4-493e-bade-636721c72c36 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:27.834742 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99dffd31-f6c4-493e-bade-636721c72c36 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:27.835267 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99dffd31-f6c4-493e-bade-636721c72c36 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:27.835859 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99dffd31-f6c4-493e-bade-636721c72c36 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:27.836337 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99dffd31-f6c4-493e-bade-636721c72c36 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:27.836762 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99dffd31-f6c4-493e-bade-636721c72c36 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:27.855940 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-815b255e-d0b7-4361-9faf-fe69db2387a8 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:27.862833 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-815b255e-d0b7-4361-9faf-fe69db2387a8 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:27.863936 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-815b255e-d0b7-4361-9faf-fe69db2387a8 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933" status: 200 len: 1314 microversion: 2.25 time: 0.246866 Sep 16 12:52:27.892690 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 863/1753] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:27 2022] GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:27.925923 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ad468a6f-6c8a-4c1e-91ca-818400c009c1 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:27.926597 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ad468a6f-6c8a-4c1e-91ca-818400c009c1 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] [instance: 345ee81d-c503-421c-90ea-218ac1c98600] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:27.942140 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ad468a6f-6c8a-4c1e-91ca-818400c009c1 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:27.944257 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ad468a6f-6c8a-4c1e-91ca-818400c009c1 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:27.945188 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ad468a6f-6c8a-4c1e-91ca-818400c009c1 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:27.949598 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ad468a6f-6c8a-4c1e-91ca-818400c009c1 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:27.951197 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ad468a6f-6c8a-4c1e-91ca-818400c009c1 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:27.952686 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ad468a6f-6c8a-4c1e-91ca-818400c009c1 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:28.035835 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-99dffd31-f6c4-493e-bade-636721c72c36 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:28.053021 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-99dffd31-f6c4-493e-bade-636721c72c36 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:28.054800 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-99dffd31-f6c4-493e-bade-636721c72c36 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:28.056238 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-99dffd31-f6c4-493e-bade-636721c72c36 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] 10.222.0.67 "GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08" status: 200 len: 1357 microversion: 2.47 time: 0.240479 Sep 16 12:52:28.057653 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 891/1754] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:27 2022] GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08 => generated 1357 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:28.084707 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-74aa357c-0e27-4991-9b50-26b8b5d53595 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:28.092556 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-74aa357c-0e27-4991-9b50-26b8b5d53595 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:28.093765 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-74aa357c-0e27-4991-9b50-26b8b5d53595 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Searching by: {'deleted': False, 'project_id': '2a7566965e424a09bd5488847d1776bd'} {{(pid=128779) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 12:52:28.149878 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74aa357c-0e27-4991-9b50-26b8b5d53595 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:28.151332 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74aa357c-0e27-4991-9b50-26b8b5d53595 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:28.151797 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74aa357c-0e27-4991-9b50-26b8b5d53595 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:28.152579 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74aa357c-0e27-4991-9b50-26b8b5d53595 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:28.153152 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74aa357c-0e27-4991-9b50-26b8b5d53595 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:28.153581 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74aa357c-0e27-4991-9b50-26b8b5d53595 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:28.360759 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.multi_cell_list [None req-74aa357c-0e27-4991-9b50-26b8b5d53595 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128779) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 12:52:28.590112 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-74aa357c-0e27-4991-9b50-26b8b5d53595 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:28.609016 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74aa357c-0e27-4991-9b50-26b8b5d53595 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:28.609769 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74aa357c-0e27-4991-9b50-26b8b5d53595 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:28.610503 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74aa357c-0e27-4991-9b50-26b8b5d53595 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:28.631875 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ad468a6f-6c8a-4c1e-91ca-818400c009c1 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d4c5f7ddf5432ba8b4eac2cb6a9860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b7d059fb70415fb5dc20e3a921d189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:28.641006 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-74aa357c-0e27-4991-9b50-26b8b5d53595 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:28.646351 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-74aa357c-0e27-4991-9b50-26b8b5d53595 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:28.658999 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ad468a6f-6c8a-4c1e-91ca-818400c009c1 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600" status: 200 len: 1317 microversion: 2.1 time: 0.737683 Sep 16 12:52:28.659977 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 864/1755] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:27 2022] GET /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600 => generated 1317 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:52:28.883550 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-74aa357c-0e27-4991-9b50-26b8b5d53595 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] 10.222.0.67 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 0.802668 Sep 16 12:52:28.884592 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 892/1756] 10.222.0.67 () {60 vars in 1187 bytes} [Fri Sep 16 12:52:28 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:28.901679 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ad42191c-d9c2-4a9a-82d1-dc954a459196 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:28.902404 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ad42191c-d9c2-4a9a-82d1-dc954a459196 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] [instance: a4906950-755b-4838-b954-fb07189747f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:28.917345 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad42191c-d9c2-4a9a-82d1-dc954a459196 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:28.917777 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e42400ea-87ba-44db-87a3-3efec2484317 tempest-FlavorsV2TestJSON-1904868552 tempest-FlavorsV2TestJSON-1904868552-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:28.918538 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad42191c-d9c2-4a9a-82d1-dc954a459196 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:28.919472 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad42191c-d9c2-4a9a-82d1-dc954a459196 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:28.921294 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad42191c-d9c2-4a9a-82d1-dc954a459196 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:28.922609 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad42191c-d9c2-4a9a-82d1-dc954a459196 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:28.927888 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e42400ea-87ba-44db-87a3-3efec2484317 tempest-FlavorsV2TestJSON-1904868552 tempest-FlavorsV2TestJSON-1904868552-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.266672 Sep 16 12:52:28.936615 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad42191c-d9c2-4a9a-82d1-dc954a459196 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:28.939509 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 865/1757] 10.222.0.67 () {58 vars in 1137 bytes} [Fri Sep 16 12:52:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:52:28.952363 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6ecbb387-e577-4bf7-b9d5-64c2cdb65ea4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:28.953036 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6ecbb387-e577-4bf7-b9d5-64c2cdb65ea4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:28.961610 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6ecbb387-e577-4bf7-b9d5-64c2cdb65ea4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:28.962185 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6ecbb387-e577-4bf7-b9d5-64c2cdb65ea4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:28.962849 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6ecbb387-e577-4bf7-b9d5-64c2cdb65ea4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:28.963798 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-ad42191c-d9c2-4a9a-82d1-dc954a459196 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] HTTP exception thrown: Instance a4906950-755b-4838-b954-fb07189747f3 could not be found. Sep 16 12:52:28.964583 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6ecbb387-e577-4bf7-b9d5-64c2cdb65ea4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:28.965217 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6ecbb387-e577-4bf7-b9d5-64c2cdb65ea4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:28.965812 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6ecbb387-e577-4bf7-b9d5-64c2cdb65ea4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:28.968348 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ad42191c-d9c2-4a9a-82d1-dc954a459196 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Request method failure captured: Sep 16 12:52:28.968348 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3 HTTP/1.1 Sep 16 12:52:28.968348 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:52:28.968348 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:52:28.968348 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:52:28.968348 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:52:28.968348 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:52:28.968348 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:52:28.968348 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:52:28.968348 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:52:28.968348 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHFS8EFvZXNl5S_uda6P-WB34IvsPBJqqwg7-VPrX1aGa8hdMCAAnVJnTeCsbPrqw9dWO6B53YREFTTWZiCJ8BUYBeldDgVVcDdq5yVPDc7DnZSNXJjewGwPXJiMjM_LBftyQzKFAE_KVo7jzyUExj-lyKkXCjdKuYx44pYTKoClJOw Sep 16 12:52:28.968348 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:52:28.968348 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:52:28.968348 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:52:28.968348 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:52:28.968348 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:52:28.968348 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:52:28.968348 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 034ef732e4504d05a4d5d0eea122165e Sep 16 12:52:28.968348 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-28705252 Sep 16 12:52:28.968348 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:52:28.968348 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:52:28.969854 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/034ef732e4504d05a4d5d0eea122165e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/034ef732e4504d05a4d5d0eea122165e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_034ef732e4504d05a4d5d0eea122165e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/034ef732e4504d05a4d5d0eea122165e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:52:28.969854 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-28705252 Sep 16 12:52:28.969854 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 034ef732e4504d05a4d5d0eea122165e Sep 16 12:52:28.969854 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-28705252 Sep 16 12:52:28.969854 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project Sep 16 12:52:28.969854 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:52:28.969854 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:52:28.969854 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 3ef3656188f245d2a41252cee95b2064 Sep 16 12:52:28.969854 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project Sep 16 12:52:28.969854 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:52:28.969854 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance a4906950-755b-4838-b954-fb07189747f3 could not be found. Sep 16 12:52:28.969854 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': 'a4906950-755b-4838-b954-fb07189747f3'} Sep 16 12:52:28.970677 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:52:28.970677 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:28.970677 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:52:28.970677 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:52:28.970677 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:52:28.970677 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:52:28.970677 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:52:28.970677 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:52:28.970677 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:52:28.970677 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:52:28.970677 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4906950-755b-4838-b954-fb07189747f3 could not be found. Sep 16 12:52:28.970677 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:52:28.970677 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:28.970677 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:52:28.970677 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:28.970677 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:28.970677 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:28.970677 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:52:28.970677 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:52:28.970677 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:52:28.972402 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:52:28.972402 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:52:28.972402 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:52:28.972402 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:52:28.972402 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:52:28.972402 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:52:28.972402 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:52:28.972402 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4906950-755b-4838-b954-fb07189747f3 could not be found. Sep 16 12:52:28.972402 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:52:28.972402 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:28.972402 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:52:28.972402 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:28.972402 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:28.972402 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:28.972402 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:52:28.972402 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:52:28.972402 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4906950-755b-4838-b954-fb07189747f3 could not be found. Sep 16 12:52:28.972402 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:52:28.973608 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ad42191c-d9c2-4a9a-82d1-dc954a459196 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] Returning 404 to user: Instance a4906950-755b-4838-b954-fb07189747f3 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:52:28.973608 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ad42191c-d9c2-4a9a-82d1-dc954a459196 tempest-FloatingIPsAssociationNegativeTestJSON-28705252 tempest-FloatingIPsAssociationNegativeTestJSON-28705252-project] 10.222.0.67 "GET /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3" status: 404 len: 111 microversion: 2.1 time: 0.086901 Sep 16 12:52:28.982409 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 893/1758] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:28 2022] GET /compute/v2.1/servers/a4906950-755b-4838-b954-fb07189747f3 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:52:28.992650 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-222e39af-7a71-48dc-ba61-3a52c5b6dc5f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:28.993397 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-222e39af-7a71-48dc-ba61-3a52c5b6dc5f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:29.015602 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-222e39af-7a71-48dc-ba61-3a52c5b6dc5f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:29.016083 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-222e39af-7a71-48dc-ba61-3a52c5b6dc5f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:29.016616 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-222e39af-7a71-48dc-ba61-3a52c5b6dc5f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:29.017355 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-222e39af-7a71-48dc-ba61-3a52c5b6dc5f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:29.017816 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-222e39af-7a71-48dc-ba61-3a52c5b6dc5f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:29.018230 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-222e39af-7a71-48dc-ba61-3a52c5b6dc5f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:29.519737 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6ecbb387-e577-4bf7-b9d5-64c2cdb65ea4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:29.535028 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6ecbb387-e577-4bf7-b9d5-64c2cdb65ea4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1706 microversion: 2.1 time: 0.590044 Sep 16 12:52:29.536239 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 866/1759] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:28 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1706 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:29.550768 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-222e39af-7a71-48dc-ba61-3a52c5b6dc5f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:29.560634 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-74db2bf3-d113-4202-96ba-2801ed7b2e5e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:29.562388 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-222e39af-7a71-48dc-ba61-3a52c5b6dc5f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1477 microversion: 2.1 time: 0.578762 Sep 16 12:52:29.564076 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-74db2bf3-d113-4202-96ba-2801ed7b2e5e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 4fbd6b22-2181-4786-9116-a8c8eafb9933] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:29.570737 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 894/1760] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:28 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1477 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:29.586622 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-74db2bf3-d113-4202-96ba-2801ed7b2e5e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:29.589255 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6cc6e513-9021-47d4-bfb3-f91485e406fb tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:29.594289 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-74db2bf3-d113-4202-96ba-2801ed7b2e5e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:29.595184 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6cc6e513-9021-47d4-bfb3-f91485e406fb tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 4798e026-102b-4ff4-8888-da4bb6b45c08] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:29.595887 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-74db2bf3-d113-4202-96ba-2801ed7b2e5e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:29.596598 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-74db2bf3-d113-4202-96ba-2801ed7b2e5e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:29.597071 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-74db2bf3-d113-4202-96ba-2801ed7b2e5e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:29.597494 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-74db2bf3-d113-4202-96ba-2801ed7b2e5e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:29.608615 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:52:29.622645 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cc6e513-9021-47d4-bfb3-f91485e406fb tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:29.632248 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cc6e513-9021-47d4-bfb3-f91485e406fb tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:29.635209 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cc6e513-9021-47d4-bfb3-f91485e406fb tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:29.637580 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cc6e513-9021-47d4-bfb3-f91485e406fb tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:29.640707 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cc6e513-9021-47d4-bfb3-f91485e406fb tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:29.641471 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cc6e513-9021-47d4-bfb3-f91485e406fb tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:29.713020 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6cc6e513-9021-47d4-bfb3-f91485e406fb tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 4798e026-102b-4ff4-8888-da4bb6b45c08] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:52:29.846350 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-74db2bf3-d113-4202-96ba-2801ed7b2e5e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:29.859473 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6cc6e513-9021-47d4-bfb3-f91485e406fb tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08" status: 204 len: 0 microversion: 2.47 time: 0.287044 Sep 16 12:52:29.860428 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 895/1761] 10.222.0.67 () {60 vars in 1280 bytes} [Fri Sep 16 12:52:29 2022] DELETE /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 12:52:29.873788 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-74db2bf3-d113-4202-96ba-2801ed7b2e5e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:29.880903 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9d5f873b-2bdf-4599-9d5e-b333733eea1b tempest-FlavorsV2TestJSON-1904868552 tempest-FlavorsV2TestJSON-1904868552-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:29.895777 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-74db2bf3-d113-4202-96ba-2801ed7b2e5e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:29.900395 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-74db2bf3-d113-4202-96ba-2801ed7b2e5e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933" status: 200 len: 1320 microversion: 2.25 time: 0.360798 Sep 16 12:52:29.913798 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9d5f873b-2bdf-4599-9d5e-b333733eea1b tempest-FlavorsV2TestJSON-1904868552 tempest-FlavorsV2TestJSON-1904868552-project] 10.222.0.67 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.046828 Sep 16 12:52:29.914282 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 867/1762] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:29 2022] GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933 => generated 1320 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:29.915755 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 896/1763] 10.222.0.67 () {58 vars in 1125 bytes} [Fri Sep 16 12:52:29 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:29.925724 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-eba54fa9-5c4c-4b0a-afbc-4fa40de4c04f tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Calling method '.version_select at 0x7f103549ce50>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:29.931832 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eba54fa9-5c4c-4b0a-afbc-4fa40de4c04f tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:29.935794 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eba54fa9-5c4c-4b0a-afbc-4fa40de4c04f tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:29.937578 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eba54fa9-5c4c-4b0a-afbc-4fa40de4c04f tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:29.956480 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-444c650c-e8ee-440c-ad96-e0601b805567 req-eeafd22a-b7c6-4f2a-8396-ca05e726ed8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "345ee81d-c503-421c-90ea-218ac1c98600", "tag": "56c49806-0b21-4f4b-9b96-195fc33fcba5"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:52:29.969831 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-444c650c-e8ee-440c-ad96-e0601b805567 req-eeafd22a-b7c6-4f2a-8396-ca05e726ed8a service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:29.970704 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-444c650c-e8ee-440c-ad96-e0601b805567 req-eeafd22a-b7c6-4f2a-8396-ca05e726ed8a service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:29.971510 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-444c650c-e8ee-440c-ad96-e0601b805567 req-eeafd22a-b7c6-4f2a-8396-ca05e726ed8a service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:29.980794 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-eba54fa9-5c4c-4b0a-afbc-4fa40de4c04f tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] 10.222.0.67 "GET /compute/v2.1/os-migrations" status: 200 len: 3121 microversion: 2.1 time: 0.063668 Sep 16 12:52:29.988873 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-444c650c-e8ee-440c-ad96-e0601b805567 req-eeafd22a-b7c6-4f2a-8396-ca05e726ed8a service nova] Creating event network-changed:56c49806-0b21-4f4b-9b96-195fc33fcba5 for instance 345ee81d-c503-421c-90ea-218ac1c98600 on n-h1-858094-4 Sep 16 12:52:30.003583 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 897/1764] 10.222.0.67 () {58 vars in 1143 bytes} [Fri Sep 16 12:52:29 2022] GET /compute/v2.1/os-migrations => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:30.004575 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-444c650c-e8ee-440c-ad96-e0601b805567 req-eeafd22a-b7c6-4f2a-8396-ca05e726ed8a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082205 Sep 16 12:52:30.006050 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 868/1765] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:52:30.010182 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a21c4a05-2af9-499b-adb3-67ef4d12c7f6 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:30.014850 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-eecd1a2e-51c3-4a34-bfb0-87da951984f0 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:30.016402 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-eecd1a2e-51c3-4a34-bfb0-87da951984f0 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 4798e026-102b-4ff4-8888-da4bb6b45c08] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:30.020183 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a21c4a05-2af9-499b-adb3-67ef4d12c7f6 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] [instance: 345ee81d-c503-421c-90ea-218ac1c98600] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:30.031803 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eecd1a2e-51c3-4a34-bfb0-87da951984f0 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:30.032025 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a21c4a05-2af9-499b-adb3-67ef4d12c7f6 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:30.032472 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a21c4a05-2af9-499b-adb3-67ef4d12c7f6 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:30.033948 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eecd1a2e-51c3-4a34-bfb0-87da951984f0 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:30.034496 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eecd1a2e-51c3-4a34-bfb0-87da951984f0 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:30.035675 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eecd1a2e-51c3-4a34-bfb0-87da951984f0 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:30.036268 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eecd1a2e-51c3-4a34-bfb0-87da951984f0 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:30.036840 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a21c4a05-2af9-499b-adb3-67ef4d12c7f6 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:30.037213 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a21c4a05-2af9-499b-adb3-67ef4d12c7f6 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:30.037687 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a21c4a05-2af9-499b-adb3-67ef4d12c7f6 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:30.038124 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a21c4a05-2af9-499b-adb3-67ef4d12c7f6 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:30.038376 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eecd1a2e-51c3-4a34-bfb0-87da951984f0 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:30.240697 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-eecd1a2e-51c3-4a34-bfb0-87da951984f0 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:30.285084 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-eecd1a2e-51c3-4a34-bfb0-87da951984f0 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:30.286680 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-eecd1a2e-51c3-4a34-bfb0-87da951984f0 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:30.287914 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-eecd1a2e-51c3-4a34-bfb0-87da951984f0 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] 10.222.0.67 "GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08" status: 200 len: 1363 microversion: 2.47 time: 0.280536 Sep 16 12:52:30.288878 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 869/1766] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:30 2022] GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08 => generated 1363 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:30.293642 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b6fb2b9d-597e-40ba-8e89-e904f461a65e tempest-FlavorsV2TestJSON-1904868552 tempest-FlavorsV2TestJSON-1904868552-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:30.306103 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b6fb2b9d-597e-40ba-8e89-e904f461a65e tempest-FlavorsV2TestJSON-1904868552 tempest-FlavorsV2TestJSON-1904868552-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016132 Sep 16 12:52:30.306693 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 870/1767] 10.222.0.67 () {58 vars in 1137 bytes} [Fri Sep 16 12:52:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:52:30.316518 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-11e7f69c-be9b-4ca5-a8f4-549603348af3 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:30.316518 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-11e7f69c-be9b-4ca5-a8f4-549603348af3 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:30.324625 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-11e7f69c-be9b-4ca5-a8f4-549603348af3 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:30.325124 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-11e7f69c-be9b-4ca5-a8f4-549603348af3 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:30.325561 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-11e7f69c-be9b-4ca5-a8f4-549603348af3 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:30.326277 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-11e7f69c-be9b-4ca5-a8f4-549603348af3 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:30.326731 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-11e7f69c-be9b-4ca5-a8f4-549603348af3 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:30.327797 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-11e7f69c-be9b-4ca5-a8f4-549603348af3 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:30.630715 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a21c4a05-2af9-499b-adb3-67ef4d12c7f6 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d4c5f7ddf5432ba8b4eac2cb6a9860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b7d059fb70415fb5dc20e3a921d189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:30.640463 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a21c4a05-2af9-499b-adb3-67ef4d12c7f6 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600" status: 200 len: 1317 microversion: 2.1 time: 0.635481 Sep 16 12:52:30.643170 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 898/1768] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:30 2022] GET /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600 => generated 1317 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:30.663200 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5a316d43-9b8f-4189-8cba-e72d55adfde4 tempest-FlavorsV2TestJSON-1904868552 tempest-FlavorsV2TestJSON-1904868552-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:30.676103 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5a316d43-9b8f-4189-8cba-e72d55adfde4 tempest-FlavorsV2TestJSON-1904868552 tempest-FlavorsV2TestJSON-1904868552-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018661 Sep 16 12:52:30.687333 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 899/1769] 10.222.0.67 () {58 vars in 1137 bytes} [Fri Sep 16 12:52:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:52:30.692625 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-527119e1-fad1-4920-8b81-679d07d79845 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:30.693885 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-527119e1-fad1-4920-8b81-679d07d79845 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:30.702866 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-527119e1-fad1-4920-8b81-679d07d79845 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:30.704001 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-527119e1-fad1-4920-8b81-679d07d79845 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:30.704711 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-527119e1-fad1-4920-8b81-679d07d79845 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:30.707537 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-527119e1-fad1-4920-8b81-679d07d79845 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:30.708396 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-527119e1-fad1-4920-8b81-679d07d79845 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:30.709062 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-527119e1-fad1-4920-8b81-679d07d79845 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:30.733270 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-11e7f69c-be9b-4ca5-a8f4-549603348af3 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1857 microversion: 2.1 time: 0.425402 Sep 16 12:52:30.733796 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 871/1770] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:30 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1857 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:30.755788 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0427aaeb-0ca3-4991-93fa-f848bc6f3513 tempest-FlavorsV2TestJSON-1904868552 tempest-FlavorsV2TestJSON-1904868552-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:30.785899 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0427aaeb-0ca3-4991-93fa-f848bc6f3513 tempest-FlavorsV2TestJSON-1904868552 tempest-FlavorsV2TestJSON-1904868552-project] 10.222.0.67 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.036546 Sep 16 12:52:30.787105 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 872/1771] 10.222.0.67 () {58 vars in 1165 bytes} [Fri Sep 16 12:52:30 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:30.792482 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e6178918-e61e-466f-ac30-e612ea2388f7 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:30.800899 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e6178918-e61e-466f-ac30-e612ea2388f7 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:30.807986 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e6178918-e61e-466f-ac30-e612ea2388f7 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:30.809295 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e6178918-e61e-466f-ac30-e612ea2388f7 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:30.809936 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e6178918-e61e-466f-ac30-e612ea2388f7 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:30.811014 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e6178918-e61e-466f-ac30-e612ea2388f7 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:30.811637 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e6178918-e61e-466f-ac30-e612ea2388f7 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:30.812433 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e6178918-e61e-466f-ac30-e612ea2388f7 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:31.054794 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-527119e1-fad1-4920-8b81-679d07d79845 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:31.063927 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-527119e1-fad1-4920-8b81-679d07d79845 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1477 microversion: 2.1 time: 0.375357 Sep 16 12:52:31.068220 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 900/1772] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:30 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1477 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:31.073876 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1f932d32-fda1-4c72-b13f-604a2c923940 tempest-FlavorsV2TestJSON-1904868552 tempest-FlavorsV2TestJSON-1904868552-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:31.097711 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1f932d32-fda1-4c72-b13f-604a2c923940 tempest-FlavorsV2TestJSON-1904868552 tempest-FlavorsV2TestJSON-1904868552-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028005 Sep 16 12:52:31.098424 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 901/1773] 10.222.0.67 () {58 vars in 1137 bytes} [Fri Sep 16 12:52:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:52:31.109929 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4398d06c-e5d3-4ea0-b3e6-6876de8663fe tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:31.110542 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4398d06c-e5d3-4ea0-b3e6-6876de8663fe tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 4fbd6b22-2181-4786-9116-a8c8eafb9933] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:31.118665 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4398d06c-e5d3-4ea0-b3e6-6876de8663fe tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:31.119150 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4398d06c-e5d3-4ea0-b3e6-6876de8663fe tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:31.119583 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4398d06c-e5d3-4ea0-b3e6-6876de8663fe tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:31.120885 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4398d06c-e5d3-4ea0-b3e6-6876de8663fe tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:31.121345 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4398d06c-e5d3-4ea0-b3e6-6876de8663fe tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:31.121757 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4398d06c-e5d3-4ea0-b3e6-6876de8663fe tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:31.723636 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e6178918-e61e-466f-ac30-e612ea2388f7 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1857 microversion: 2.1 time: 0.935240 Sep 16 12:52:31.725962 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 873/1774] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:30 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1857 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:31.744877 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-aaeeb7eb-3f28-48b8-909e-b7ad43957072 tempest-FlavorsV2TestJSON-1904868552 tempest-FlavorsV2TestJSON-1904868552-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:31.796524 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-aaeeb7eb-3f28-48b8-909e-b7ad43957072 tempest-FlavorsV2TestJSON-1904868552 tempest-FlavorsV2TestJSON-1904868552-project] 10.222.0.67 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.064804 Sep 16 12:52:31.809778 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 874/1775] 10.222.0.67 () {58 vars in 1169 bytes} [Fri Sep 16 12:52:31 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:31.816719 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4d693cb5-4d85-4c2a-94e2-647087fb0201 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:31.817457 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-4d693cb5-4d85-4c2a-94e2-647087fb0201 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 4798e026-102b-4ff4-8888-da4bb6b45c08] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:31.823323 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:52:31.826156 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4d693cb5-4d85-4c2a-94e2-647087fb0201 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:31.826795 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4d693cb5-4d85-4c2a-94e2-647087fb0201 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:31.827302 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4d693cb5-4d85-4c2a-94e2-647087fb0201 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:31.828190 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4d693cb5-4d85-4c2a-94e2-647087fb0201 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:31.828735 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4d693cb5-4d85-4c2a-94e2-647087fb0201 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:31.829237 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4d693cb5-4d85-4c2a-94e2-647087fb0201 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:31.849972 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4398d06c-e5d3-4ea0-b3e6-6876de8663fe tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:31.865257 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4398d06c-e5d3-4ea0-b3e6-6876de8663fe tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:31.867357 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4398d06c-e5d3-4ea0-b3e6-6876de8663fe tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:31.868774 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4398d06c-e5d3-4ea0-b3e6-6876de8663fe tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933" status: 200 len: 1362 microversion: 2.25 time: 0.769091 Sep 16 12:52:31.869924 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 902/1776] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:31 2022] GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933 => generated 1362 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:31.875095 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ba2483d3-b7bc-46de-8910-c6a8ee29c692 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:31.875999 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ba2483d3-b7bc-46de-8910-c6a8ee29c692 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] [instance: 345ee81d-c503-421c-90ea-218ac1c98600] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:31.894951 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba2483d3-b7bc-46de-8910-c6a8ee29c692 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:31.896301 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba2483d3-b7bc-46de-8910-c6a8ee29c692 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:31.897012 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba2483d3-b7bc-46de-8910-c6a8ee29c692 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:31.898396 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba2483d3-b7bc-46de-8910-c6a8ee29c692 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:31.899034 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba2483d3-b7bc-46de-8910-c6a8ee29c692 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:31.899658 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba2483d3-b7bc-46de-8910-c6a8ee29c692 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:31.909437 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:52:31.964637 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4d693cb5-4d85-4c2a-94e2-647087fb0201 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:31.983371 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4d693cb5-4d85-4c2a-94e2-647087fb0201 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:31.984941 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4d693cb5-4d85-4c2a-94e2-647087fb0201 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:31.987498 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4d693cb5-4d85-4c2a-94e2-647087fb0201 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] 10.222.0.67 "GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08" status: 200 len: 1363 microversion: 2.47 time: 0.176433 Sep 16 12:52:31.988825 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 875/1777] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:31 2022] GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:31.997113 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f761d45a-1796-448e-9b26-3d1c21333416 tempest-FlavorsV2TestJSON-1904868552 tempest-FlavorsV2TestJSON-1904868552-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:32.014409 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f761d45a-1796-448e-9b26-3d1c21333416 tempest-FlavorsV2TestJSON-1904868552 tempest-FlavorsV2TestJSON-1904868552-project] 10.222.0.67 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.024284 Sep 16 12:52:32.016361 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 876/1778] 10.222.0.67 () {58 vars in 1161 bytes} [Fri Sep 16 12:52:31 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:52:32.025258 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a449acb3-4ee3-4de8-b87d-d78b46b4fb46 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:32.026861 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a449acb3-4ee3-4de8-b87d-d78b46b4fb46 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:32.044757 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a449acb3-4ee3-4de8-b87d-d78b46b4fb46 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:32.045769 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a449acb3-4ee3-4de8-b87d-d78b46b4fb46 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:32.046324 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a449acb3-4ee3-4de8-b87d-d78b46b4fb46 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:32.052576 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a449acb3-4ee3-4de8-b87d-d78b46b4fb46 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:32.069032 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a449acb3-4ee3-4de8-b87d-d78b46b4fb46 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:32.070931 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a449acb3-4ee3-4de8-b87d-d78b46b4fb46 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:32.111642 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ba2483d3-b7bc-46de-8910-c6a8ee29c692 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d4c5f7ddf5432ba8b4eac2cb6a9860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b7d059fb70415fb5dc20e3a921d189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:32.123150 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ba2483d3-b7bc-46de-8910-c6a8ee29c692 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600" status: 200 len: 1317 microversion: 2.1 time: 0.251683 Sep 16 12:52:32.142366 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 903/1779] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:31 2022] GET /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600 => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:32.148600 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-75b29912-729a-46e6-bd7e-eb4069f176e8 tempest-FlavorsV2TestJSON-1904868552 tempest-FlavorsV2TestJSON-1904868552-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:32.157469 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-75b29912-729a-46e6-bd7e-eb4069f176e8 tempest-FlavorsV2TestJSON-1904868552 tempest-FlavorsV2TestJSON-1904868552-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013229 Sep 16 12:52:32.158296 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 904/1780] 10.222.0.67 () {58 vars in 1137 bytes} [Fri Sep 16 12:52:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:52:32.175059 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a42d7425-ab5c-4fb5-952c-ca1cd202a5df tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:32.175903 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a42d7425-ab5c-4fb5-952c-ca1cd202a5df tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:32.200448 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a42d7425-ab5c-4fb5-952c-ca1cd202a5df tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:32.201018 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a42d7425-ab5c-4fb5-952c-ca1cd202a5df tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:32.201664 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a42d7425-ab5c-4fb5-952c-ca1cd202a5df tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:32.202556 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a42d7425-ab5c-4fb5-952c-ca1cd202a5df tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:32.203456 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a42d7425-ab5c-4fb5-952c-ca1cd202a5df tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:32.203957 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a42d7425-ab5c-4fb5-952c-ca1cd202a5df tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:32.306513 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-a449acb3-4ee3-4de8-b87d-d78b46b4fb46 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lazy-loading 'services' on Instance uuid 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:52:32.467404 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a42d7425-ab5c-4fb5-952c-ca1cd202a5df tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:32.478638 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a42d7425-ab5c-4fb5-952c-ca1cd202a5df tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1477 microversion: 2.1 time: 0.315333 Sep 16 12:52:32.492412 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 905/1781] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:32 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1477 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:32.492412 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-882a14c7-ff3e-4b33-90a3-b43ab039b0c3 tempest-FlavorsV2TestJSON-1904868552 tempest-FlavorsV2TestJSON-1904868552-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:32.492726 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a449acb3-4ee3-4de8-b87d-d78b46b4fb46 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16/os-volume_attachments/52e50fb6-96e5-47fd-b75b-4cea644cfa75" status: 202 len: 0 microversion: 2.1 time: 0.469146 Sep 16 12:52:32.493700 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 877/1782] 10.222.0.67 () {58 vars in 1416 bytes} [Fri Sep 16 12:52:32 2022] DELETE /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16/os-volume_attachments/52e50fb6-96e5-47fd-b75b-4cea644cfa75 => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:52:32.528536 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-882a14c7-ff3e-4b33-90a3-b43ab039b0c3 tempest-FlavorsV2TestJSON-1904868552 tempest-FlavorsV2TestJSON-1904868552-project] 10.222.0.67 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.046870 Sep 16 12:52:32.529521 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 906/1783] 10.222.0.67 () {58 vars in 1167 bytes} [Fri Sep 16 12:52:32 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:32.535640 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c2e1d521-a96a-41e9-9eb4-73ae7e5d2635 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:32.538580 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c2e1d521-a96a-41e9-9eb4-73ae7e5d2635 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:32.546831 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2e1d521-a96a-41e9-9eb4-73ae7e5d2635 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:32.547566 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2e1d521-a96a-41e9-9eb4-73ae7e5d2635 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:32.548231 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2e1d521-a96a-41e9-9eb4-73ae7e5d2635 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:32.549116 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2e1d521-a96a-41e9-9eb4-73ae7e5d2635 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:32.549737 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2e1d521-a96a-41e9-9eb4-73ae7e5d2635 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:32.550818 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2e1d521-a96a-41e9-9eb4-73ae7e5d2635 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:32.578702 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a6b3c723-2976-4bce-9d1a-07d82b506a06 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-613523996", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": [{"uuid": "2a6f5c27-4e22-4940-b2ce-5570b20e4dba"}]}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:52:32.617075 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c2e1d521-a96a-41e9-9eb4-73ae7e5d2635 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086083 Sep 16 12:52:32.618318 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 907/1784] 10.222.0.67 () {58 vars in 1302 bytes} [Fri Sep 16 12:52:32 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:52:32.627943 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-421b5399-c24f-4846-93ae-7735e80bf85f tempest-FlavorsV2TestJSON-1904868552 tempest-FlavorsV2TestJSON-1904868552-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:32.643728 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-421b5399-c24f-4846-93ae-7735e80bf85f tempest-FlavorsV2TestJSON-1904868552 tempest-FlavorsV2TestJSON-1904868552-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023999 Sep 16 12:52:32.649177 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 908/1785] 10.222.0.67 () {58 vars in 1137 bytes} [Fri Sep 16 12:52:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:52:32.662404 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-01dbeb48-00d1-47a9-926d-085969ec0ed7 tempest-FlavorsV2TestJSON-1904868552 tempest-FlavorsV2TestJSON-1904868552-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:32.734004 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-a6b3c723-2976-4bce-9d1a-07d82b506a06 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] validate_networks() for [('2a6f5c27-4e22-4940-b2ce-5570b20e4dba', None, None, None, None, None)] {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:52:32.751983 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-01dbeb48-00d1-47a9-926d-085969ec0ed7 tempest-FlavorsV2TestJSON-1904868552 tempest-FlavorsV2TestJSON-1904868552-project] 10.222.0.67 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.093759 Sep 16 12:52:32.763107 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 909/1786] 10.222.0.67 () {58 vars in 1144 bytes} [Fri Sep 16 12:52:32 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:32.777883 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2c36c7e7-c0e5-4f5c-95f1-2f029e710a5d tempest-FlavorsV2TestJSON-1904868552 tempest-FlavorsV2TestJSON-1904868552-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:32.792175 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2c36c7e7-c0e5-4f5c-95f1-2f029e710a5d tempest-FlavorsV2TestJSON-1904868552 tempest-FlavorsV2TestJSON-1904868552-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018737 Sep 16 12:52:32.793470 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 910/1787] 10.222.0.67 () {58 vars in 1137 bytes} [Fri Sep 16 12:52:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:52:32.805503 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cb70d4a9-68b0-4ff0-aabd-b8a19596183d tempest-FlavorsV2TestJSON-1904868552 tempest-FlavorsV2TestJSON-1904868552-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:32.867492 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cb70d4a9-68b0-4ff0-aabd-b8a19596183d tempest-FlavorsV2TestJSON-1904868552 tempest-FlavorsV2TestJSON-1904868552-project] 10.222.0.67 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.048412 Sep 16 12:52:32.869646 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 911/1788] 10.222.0.67 () {58 vars in 1148 bytes} [Fri Sep 16 12:52:32 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:32.884003 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9457ec1c-eba6-472f-a960-2c09e1a69fc1 tempest-FlavorsV2TestJSON-1904868552 tempest-FlavorsV2TestJSON-1904868552-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:32.907410 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9457ec1c-eba6-472f-a960-2c09e1a69fc1 tempest-FlavorsV2TestJSON-1904868552 tempest-FlavorsV2TestJSON-1904868552-project] 10.222.0.67 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.027272 Sep 16 12:52:32.913062 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 912/1789] 10.222.0.67 () {58 vars in 1140 bytes} [Fri Sep 16 12:52:32 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:52:32.919327 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9cc2e355-3328-4d9d-8d48-b16fdfb9a8b4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:32.919966 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9cc2e355-3328-4d9d-8d48-b16fdfb9a8b4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 4fbd6b22-2181-4786-9116-a8c8eafb9933] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:32.929116 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9cc2e355-3328-4d9d-8d48-b16fdfb9a8b4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:32.929895 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9cc2e355-3328-4d9d-8d48-b16fdfb9a8b4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:32.930569 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9cc2e355-3328-4d9d-8d48-b16fdfb9a8b4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:32.931488 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9cc2e355-3328-4d9d-8d48-b16fdfb9a8b4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:32.932182 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9cc2e355-3328-4d9d-8d48-b16fdfb9a8b4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:32.933071 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9cc2e355-3328-4d9d-8d48-b16fdfb9a8b4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:33.425788 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9cc2e355-3328-4d9d-8d48-b16fdfb9a8b4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:33.443036 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9cc2e355-3328-4d9d-8d48-b16fdfb9a8b4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:33.454155 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9cc2e355-3328-4d9d-8d48-b16fdfb9a8b4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:33.455397 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9cc2e355-3328-4d9d-8d48-b16fdfb9a8b4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933" status: 200 len: 1362 microversion: 2.25 time: 0.540998 Sep 16 12:52:33.456511 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 913/1790] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:32 2022] GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933 => generated 1362 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:33.465551 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8ed9624f-9223-4320-aed9-b4a6363454b3 tempest-FlavorsV2TestJSON-1904868552 tempest-FlavorsV2TestJSON-1904868552-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:33.491769 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8ed9624f-9223-4320-aed9-b4a6363454b3 tempest-FlavorsV2TestJSON-1904868552 tempest-FlavorsV2TestJSON-1904868552-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.034010 Sep 16 12:52:33.492644 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 914/1791] 10.222.0.67 () {58 vars in 1137 bytes} [Fri Sep 16 12:52:33 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:52:33.505594 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-383835eb-2662-4d72-a4ce-97f947ce5a64 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:33.507070 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-383835eb-2662-4d72-a4ce-97f947ce5a64 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 4798e026-102b-4ff4-8888-da4bb6b45c08] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:33.517185 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-383835eb-2662-4d72-a4ce-97f947ce5a64 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:33.527260 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-383835eb-2662-4d72-a4ce-97f947ce5a64 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:33.528371 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-383835eb-2662-4d72-a4ce-97f947ce5a64 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:33.529353 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-383835eb-2662-4d72-a4ce-97f947ce5a64 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:33.530033 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-383835eb-2662-4d72-a4ce-97f947ce5a64 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:33.530700 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-383835eb-2662-4d72-a4ce-97f947ce5a64 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:33.561915 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-383835eb-2662-4d72-a4ce-97f947ce5a64 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] HTTP exception thrown: Instance 4798e026-102b-4ff4-8888-da4bb6b45c08 could not be found. Sep 16 12:52:33.569965 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-383835eb-2662-4d72-a4ce-97f947ce5a64 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Request method failure captured: Sep 16 12:52:33.569965 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08 HTTP/1.1 Sep 16 12:52:33.569965 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:52:33.569965 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:52:33.569965 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:52:33.569965 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:52:33.569965 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:52:33.569965 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:52:33.569965 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:52:33.569965 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:52:33.569965 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHFV9VsqJxF4eqvlqXS_BElNyZ-0OU72dnnqNeHWzK1Gfz0SREGF4FOamoPY4boC8PNaptXG0gq4uEUsc8TVGPockjGWZ_40xRABNQT82B1_jhHEpdS8cFhahC8WyhTyPsMVzEHTzVd-x9ir6f1PpUP1SaZ2-nY6PGWV2xjWz9xY2Ro Sep 16 12:52:33.569965 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:52:33.569965 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:52:33.569965 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:52:33.569965 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:52:33.569965 n-d-858094-4 devstack@n-api.service[128779]: X-Openstack-Nova-Api-Version: 2.47 Sep 16 12:52:33.569965 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:52:33.569965 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:52:33.569965 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 2a7566965e424a09bd5488847d1776bd Sep 16 12:52:33.569965 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerShowV247Test-1271383446 Sep 16 12:52:33.569965 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:52:33.569965 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:52:33.571524 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2a7566965e424a09bd5488847d1776bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2a7566965e424a09bd5488847d1776bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2a7566965e424a09bd5488847d1776bd", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2a7566965e424a09bd5488847d1776bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:52:33.571524 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ServerShowV247Test-1271383446 Sep 16 12:52:33.571524 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 2a7566965e424a09bd5488847d1776bd Sep 16 12:52:33.571524 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerShowV247Test-1271383446 Sep 16 12:52:33.571524 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ServerShowV247Test-1271383446-project Sep 16 12:52:33.571524 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:52:33.571524 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:52:33.571524 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 43c0495684dc4bdeaacca09eadae3b42 Sep 16 12:52:33.571524 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ServerShowV247Test-1271383446-project Sep 16 12:52:33.571524 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:52:33.571524 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 4798e026-102b-4ff4-8888-da4bb6b45c08 could not be found. Sep 16 12:52:33.571524 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '4798e026-102b-4ff4-8888-da4bb6b45c08'} Sep 16 12:52:33.572404 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:52:33.572404 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:33.572404 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:52:33.572404 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:52:33.572404 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:52:33.572404 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:52:33.572404 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:52:33.572404 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:52:33.572404 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:52:33.572404 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:52:33.572404 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4798e026-102b-4ff4-8888-da4bb6b45c08 could not be found. Sep 16 12:52:33.572404 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:52:33.572404 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:33.572404 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:52:33.572404 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:33.572404 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:33.572404 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:33.572404 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:52:33.572404 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:52:33.572404 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:52:33.573690 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:52:33.573690 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:52:33.573690 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:52:33.573690 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:52:33.573690 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:52:33.573690 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:52:33.573690 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:52:33.573690 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4798e026-102b-4ff4-8888-da4bb6b45c08 could not be found. Sep 16 12:52:33.573690 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:52:33.573690 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:33.573690 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:52:33.573690 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:33.573690 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:33.573690 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:33.573690 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:52:33.573690 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:52:33.573690 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4798e026-102b-4ff4-8888-da4bb6b45c08 could not be found. Sep 16 12:52:33.573690 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:52:33.578703 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-383835eb-2662-4d72-a4ce-97f947ce5a64 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Returning 404 to user: Instance 4798e026-102b-4ff4-8888-da4bb6b45c08 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:52:33.579912 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-383835eb-2662-4d72-a4ce-97f947ce5a64 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] 10.222.0.67 "GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08" status: 404 len: 111 microversion: 2.47 time: 0.086190 Sep 16 12:52:33.580785 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 915/1792] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:33 2022] GET /compute/v2.1/servers/4798e026-102b-4ff4-8888-da4bb6b45c08 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 12:52:33.591078 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-61e266b2-d511-4b84-8334-ff5ea375d55c tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:33.596406 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-61e266b2-d511-4b84-8334-ff5ea375d55c tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] [instance: 345ee81d-c503-421c-90ea-218ac1c98600] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:33.608642 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61e266b2-d511-4b84-8334-ff5ea375d55c tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:33.610418 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61e266b2-d511-4b84-8334-ff5ea375d55c tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:33.621495 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61e266b2-d511-4b84-8334-ff5ea375d55c tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:33.623018 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61e266b2-d511-4b84-8334-ff5ea375d55c tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:33.623740 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61e266b2-d511-4b84-8334-ff5ea375d55c tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:33.624418 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61e266b2-d511-4b84-8334-ff5ea375d55c tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:33.652448 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-a6b3c723-2976-4bce-9d1a-07d82b506a06 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:52:33.653412 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-a6b3c723-2976-4bce-9d1a-07d82b506a06 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:52:33.654104 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-a6b3c723-2976-4bce-9d1a-07d82b506a06 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:52:33.654748 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-a6b3c723-2976-4bce-9d1a-07d82b506a06 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:52:33.655401 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-a6b3c723-2976-4bce-9d1a-07d82b506a06 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:52:33.678936 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a6b3c723-2976-4bce-9d1a-07d82b506a06 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:33.679872 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a6b3c723-2976-4bce-9d1a-07d82b506a06 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:33.680589 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a6b3c723-2976-4bce-9d1a-07d82b506a06 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:33.681711 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a6b3c723-2976-4bce-9d1a-07d82b506a06 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:33.687325 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a6b3c723-2976-4bce-9d1a-07d82b506a06 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:33.687888 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a6b3c723-2976-4bce-9d1a-07d82b506a06 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:33.716396 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:52:33.753889 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-a6b3c723-2976-4bce-9d1a-07d82b506a06 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Getting quotas for project 1e41136645964ea98a675833bd73299f. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:52:33.774006 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-a6b3c723-2976-4bce-9d1a-07d82b506a06 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Getting quotas for user b9101f5af9e34d21bb8e872d337d3545 and project 1e41136645964ea98a675833bd73299f. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:52:33.813234 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a6b3c723-2976-4bce-9d1a-07d82b506a06 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:52:33.815661 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a6b3c723-2976-4bce-9d1a-07d82b506a06 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 5c161179-0b93-4676-86f7-2f507a3ebeb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:52:33.869362 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a6b3c723-2976-4bce-9d1a-07d82b506a06 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.373930 Sep 16 12:52:33.876604 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 878/1793] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:52:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1382 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:52:33.882612 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-b59e3e9f-f594-4adc-a746-516e77bfd96a req-2fbbf311-2dba-4de8-9921-499a9515c615 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fbd6b22-2181-4786-9116-a8c8eafb9933", "tag": "c56b7ce5-25b3-4ac0-bcbf-28e9db2c0185"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:52:33.894639 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-b59e3e9f-f594-4adc-a746-516e77bfd96a req-2fbbf311-2dba-4de8-9921-499a9515c615 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:33.895406 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-b59e3e9f-f594-4adc-a746-516e77bfd96a req-2fbbf311-2dba-4de8-9921-499a9515c615 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:33.896002 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-b59e3e9f-f594-4adc-a746-516e77bfd96a req-2fbbf311-2dba-4de8-9921-499a9515c615 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:33.909351 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-b59e3e9f-f594-4adc-a746-516e77bfd96a req-2fbbf311-2dba-4de8-9921-499a9515c615 service nova] Creating event network-changed:c56b7ce5-25b3-4ac0-bcbf-28e9db2c0185 for instance 4fbd6b22-2181-4786-9116-a8c8eafb9933 on n-h2-858094-4 Sep 16 12:52:33.915364 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-b59e3e9f-f594-4adc-a746-516e77bfd96a req-2fbbf311-2dba-4de8-9921-499a9515c615 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036934 Sep 16 12:52:33.916754 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 879/1794] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:52:33.925243 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f4700075-012a-4d39-bcb1-843c982ab16c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:33.926356 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f4700075-012a-4d39-bcb1-843c982ab16c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:33.935124 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f4700075-012a-4d39-bcb1-843c982ab16c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:33.935753 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f4700075-012a-4d39-bcb1-843c982ab16c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:33.936277 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f4700075-012a-4d39-bcb1-843c982ab16c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:33.937465 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f4700075-012a-4d39-bcb1-843c982ab16c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:33.937603 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f4700075-012a-4d39-bcb1-843c982ab16c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:33.938051 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f4700075-012a-4d39-bcb1-843c982ab16c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:33.967345 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-61e266b2-d511-4b84-8334-ff5ea375d55c tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d4c5f7ddf5432ba8b4eac2cb6a9860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b7d059fb70415fb5dc20e3a921d189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:33.987195 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-61e266b2-d511-4b84-8334-ff5ea375d55c tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600" status: 200 len: 1317 microversion: 2.1 time: 0.394066 Sep 16 12:52:33.988385 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 916/1795] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:33 2022] GET /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600 => generated 1317 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:33.993450 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c11526fe-e31c-4eec-b015-bdd226770c15 tempest-FlavorsV2TestJSON-1904868552 tempest-FlavorsV2TestJSON-1904868552-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:34.064430 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c11526fe-e31c-4eec-b015-bdd226770c15 tempest-FlavorsV2TestJSON-1904868552 tempest-FlavorsV2TestJSON-1904868552-project] 10.222.0.67 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.074642 Sep 16 12:52:34.065768 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 917/1796] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:52:33 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:34.080850 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c34f1b97-8e10-41fe-995c-91a8e1f416cc tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:34.081658 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c34f1b97-8e10-41fe-995c-91a8e1f416cc tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 5f350206-ba9d-427c-8b60-95c2d2f501ae] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:34.088100 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c34f1b97-8e10-41fe-995c-91a8e1f416cc tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:34.092743 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c34f1b97-8e10-41fe-995c-91a8e1f416cc tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:34.093286 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c34f1b97-8e10-41fe-995c-91a8e1f416cc tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:34.094281 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c34f1b97-8e10-41fe-995c-91a8e1f416cc tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:34.098693 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c34f1b97-8e10-41fe-995c-91a8e1f416cc tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:34.099319 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c34f1b97-8e10-41fe-995c-91a8e1f416cc tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:34.160346 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c34f1b97-8e10-41fe-995c-91a8e1f416cc tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 5f350206-ba9d-427c-8b60-95c2d2f501ae] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:52:34.342137 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c34f1b97-8e10-41fe-995c-91a8e1f416cc tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] 10.222.0.67 "DELETE /compute/v2.1/servers/5f350206-ba9d-427c-8b60-95c2d2f501ae" status: 204 len: 0 microversion: 2.47 time: 0.269458 Sep 16 12:52:34.347480 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 918/1797] 10.222.0.67 () {60 vars in 1280 bytes} [Fri Sep 16 12:52:34 2022] DELETE /compute/v2.1/servers/5f350206-ba9d-427c-8b60-95c2d2f501ae => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 12:52:34.400890 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ca0c728b-b126-4809-a3e8-128cf1eb0769 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:34.402344 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ca0c728b-b126-4809-a3e8-128cf1eb0769 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:34.429735 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca0c728b-b126-4809-a3e8-128cf1eb0769 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:34.430594 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca0c728b-b126-4809-a3e8-128cf1eb0769 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:34.433794 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca0c728b-b126-4809-a3e8-128cf1eb0769 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:34.435008 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca0c728b-b126-4809-a3e8-128cf1eb0769 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:34.435816 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca0c728b-b126-4809-a3e8-128cf1eb0769 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:34.436639 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca0c728b-b126-4809-a3e8-128cf1eb0769 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:34.453519 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f4700075-012a-4d39-bcb1-843c982ab16c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:34.476406 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f4700075-012a-4d39-bcb1-843c982ab16c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1477 microversion: 2.1 time: 0.557080 Sep 16 12:52:34.494681 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 880/1798] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:33 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1477 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:34.506018 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9f736207-4ec2-4233-8abd-1147639d33bc tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:34.509008 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9f736207-4ec2-4233-8abd-1147639d33bc tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 5c161179-0b93-4676-86f7-2f507a3ebeb3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:34.573086 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ca0c728b-b126-4809-a3e8-128cf1eb0769 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.226822 Sep 16 12:52:34.590915 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 919/1799] 10.222.0.67 () {58 vars in 1302 bytes} [Fri Sep 16 12:52:34 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16/os-volume_attachments => generated 197 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:52:34.605536 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-98283000-8b48-4cf3-852c-e83e723e9d19 tempest-FlavorsV2TestJSON-1904868552 tempest-FlavorsV2TestJSON-1904868552-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:34.678703 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-98283000-8b48-4cf3-852c-e83e723e9d19 tempest-FlavorsV2TestJSON-1904868552 tempest-FlavorsV2TestJSON-1904868552-project] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.071213 Sep 16 12:52:34.681099 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 920/1800] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 12:52:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:34.712091 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8e438fe8-ff8b-42b1-b62d-2b931aa9ab35 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:34.714949 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8e438fe8-ff8b-42b1-b62d-2b931aa9ab35 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 5f350206-ba9d-427c-8b60-95c2d2f501ae] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:34.728369 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8e438fe8-ff8b-42b1-b62d-2b931aa9ab35 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:34.729187 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8e438fe8-ff8b-42b1-b62d-2b931aa9ab35 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:34.729801 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8e438fe8-ff8b-42b1-b62d-2b931aa9ab35 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:34.730833 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8e438fe8-ff8b-42b1-b62d-2b931aa9ab35 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:34.731691 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8e438fe8-ff8b-42b1-b62d-2b931aa9ab35 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:34.732624 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8e438fe8-ff8b-42b1-b62d-2b931aa9ab35 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:34.776177 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9f736207-4ec2-4233-8abd-1147639d33bc tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9101f5af9e34d21bb8e872d337d3545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e41136645964ea98a675833bd73299f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:34.784773 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9f736207-4ec2-4233-8abd-1147639d33bc tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3" status: 200 len: 1223 microversion: 2.1 time: 0.288594 Sep 16 12:52:34.800189 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 881/1801] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:34 2022] GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3 => generated 1223 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:34.804945 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0f0e9e61-dbe2-4c86-8b4d-07e8d7be8403 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:34.816195 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0f0e9e61-dbe2-4c86-8b4d-07e8d7be8403 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 4fbd6b22-2181-4786-9116-a8c8eafb9933] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:34.835851 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0f0e9e61-dbe2-4c86-8b4d-07e8d7be8403 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:34.842472 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0f0e9e61-dbe2-4c86-8b4d-07e8d7be8403 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:34.845958 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0f0e9e61-dbe2-4c86-8b4d-07e8d7be8403 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:34.852366 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0f0e9e61-dbe2-4c86-8b4d-07e8d7be8403 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:34.853109 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0f0e9e61-dbe2-4c86-8b4d-07e8d7be8403 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:34.855186 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0f0e9e61-dbe2-4c86-8b4d-07e8d7be8403 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:35.010321 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8e438fe8-ff8b-42b1-b62d-2b931aa9ab35 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:35.024576 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8e438fe8-ff8b-42b1-b62d-2b931aa9ab35 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:35.036665 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8e438fe8-ff8b-42b1-b62d-2b931aa9ab35 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:35.038057 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8e438fe8-ff8b-42b1-b62d-2b931aa9ab35 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] 10.222.0.67 "GET /compute/v2.1/servers/5f350206-ba9d-427c-8b60-95c2d2f501ae" status: 200 len: 1361 microversion: 2.47 time: 0.350821 Sep 16 12:52:35.048851 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 921/1802] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:34 2022] GET /compute/v2.1/servers/5f350206-ba9d-427c-8b60-95c2d2f501ae => generated 1361 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:35.065526 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d1b9b4eb-bdec-4f88-a8ca-ad8e00aea588 tempest-FlavorsV2TestJSON-1904868552 tempest-FlavorsV2TestJSON-1904868552-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:35.092277 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d1b9b4eb-bdec-4f88-a8ca-ad8e00aea588 tempest-FlavorsV2TestJSON-1904868552 tempest-FlavorsV2TestJSON-1904868552-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.039597 Sep 16 12:52:35.116774 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 922/1803] 10.222.0.67 () {58 vars in 1137 bytes} [Fri Sep 16 12:52:35 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:52:35.134159 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-62afbe7a-e9e7-4d59-9c77-d08c05632e38 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:35.135226 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-62afbe7a-e9e7-4d59-9c77-d08c05632e38 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] [instance: 345ee81d-c503-421c-90ea-218ac1c98600] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:35.147819 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62afbe7a-e9e7-4d59-9c77-d08c05632e38 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:35.148631 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62afbe7a-e9e7-4d59-9c77-d08c05632e38 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:35.150211 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62afbe7a-e9e7-4d59-9c77-d08c05632e38 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:35.152068 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62afbe7a-e9e7-4d59-9c77-d08c05632e38 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:35.153057 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62afbe7a-e9e7-4d59-9c77-d08c05632e38 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:35.153728 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62afbe7a-e9e7-4d59-9c77-d08c05632e38 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:35.645570 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0f0e9e61-dbe2-4c86-8b4d-07e8d7be8403 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:35.657520 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0f0e9e61-dbe2-4c86-8b4d-07e8d7be8403 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:35.663586 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0f0e9e61-dbe2-4c86-8b4d-07e8d7be8403 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:35.664855 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0f0e9e61-dbe2-4c86-8b4d-07e8d7be8403 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933" status: 200 len: 1362 microversion: 2.25 time: 0.872358 Sep 16 12:52:35.665986 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 882/1804] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:34 2022] GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933 => generated 1362 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:35.678667 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f4f4c3aa-16f9-4367-8f72-e4b9bda8ee42 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:35.679703 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f4f4c3aa-16f9-4367-8f72-e4b9bda8ee42 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:35.687489 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f4f4c3aa-16f9-4367-8f72-e4b9bda8ee42 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:35.688268 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f4f4c3aa-16f9-4367-8f72-e4b9bda8ee42 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:35.689005 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f4f4c3aa-16f9-4367-8f72-e4b9bda8ee42 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:35.689924 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f4f4c3aa-16f9-4367-8f72-e4b9bda8ee42 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:35.691069 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f4f4c3aa-16f9-4367-8f72-e4b9bda8ee42 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:35.691689 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f4f4c3aa-16f9-4367-8f72-e4b9bda8ee42 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:36.034537 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-62afbe7a-e9e7-4d59-9c77-d08c05632e38 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d4c5f7ddf5432ba8b4eac2cb6a9860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b7d059fb70415fb5dc20e3a921d189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:36.050608 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-62afbe7a-e9e7-4d59-9c77-d08c05632e38 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600" status: 200 len: 1317 microversion: 2.1 time: 0.926540 Sep 16 12:52:36.052017 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 923/1805] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:35 2022] GET /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600 => generated 1317 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:36.060361 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-de2147d8-2ea3-46d8-be97-c3fb19c96707 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:36.078026 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-de2147d8-2ea3-46d8-be97-c3fb19c96707 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:36.094653 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de2147d8-2ea3-46d8-be97-c3fb19c96707 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:36.095734 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de2147d8-2ea3-46d8-be97-c3fb19c96707 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:36.096443 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de2147d8-2ea3-46d8-be97-c3fb19c96707 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:36.097407 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de2147d8-2ea3-46d8-be97-c3fb19c96707 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:36.098078 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de2147d8-2ea3-46d8-be97-c3fb19c96707 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:36.099399 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de2147d8-2ea3-46d8-be97-c3fb19c96707 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:36.216816 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-de2147d8-2ea3-46d8-be97-c3fb19c96707 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.163114 Sep 16 12:52:36.222276 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 924/1806] 10.222.0.67 () {58 vars in 1302 bytes} [Fri Sep 16 12:52:36 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:52:36.231117 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c4653767-5950-44a8-94b5-993561958219 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:36.236357 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c4653767-5950-44a8-94b5-993561958219 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 5c161179-0b93-4676-86f7-2f507a3ebeb3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:36.243978 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f4f4c3aa-16f9-4367-8f72-e4b9bda8ee42 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:36.247175 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4653767-5950-44a8-94b5-993561958219 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:36.247818 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4653767-5950-44a8-94b5-993561958219 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:36.248468 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4653767-5950-44a8-94b5-993561958219 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:36.258522 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f4f4c3aa-16f9-4367-8f72-e4b9bda8ee42 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1477 microversion: 2.1 time: 0.591163 Sep 16 12:52:36.259135 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 883/1807] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:35 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1477 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:36.262806 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4653767-5950-44a8-94b5-993561958219 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:36.263472 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4653767-5950-44a8-94b5-993561958219 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:36.264269 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4653767-5950-44a8-94b5-993561958219 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:36.282991 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-33c767e8-c8c7-42e7-bdf1-2aa9e2a8b09a tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:36.283626 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-33c767e8-c8c7-42e7-bdf1-2aa9e2a8b09a tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 5f350206-ba9d-427c-8b60-95c2d2f501ae] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:36.313910 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-33c767e8-c8c7-42e7-bdf1-2aa9e2a8b09a tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:36.314492 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-33c767e8-c8c7-42e7-bdf1-2aa9e2a8b09a tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:36.314939 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-33c767e8-c8c7-42e7-bdf1-2aa9e2a8b09a tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:36.315681 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-33c767e8-c8c7-42e7-bdf1-2aa9e2a8b09a tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:36.316131 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-33c767e8-c8c7-42e7-bdf1-2aa9e2a8b09a tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:36.316564 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-33c767e8-c8c7-42e7-bdf1-2aa9e2a8b09a tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:36.473758 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c4653767-5950-44a8-94b5-993561958219 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9101f5af9e34d21bb8e872d337d3545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e41136645964ea98a675833bd73299f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:36.486584 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c4653767-5950-44a8-94b5-993561958219 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3" status: 200 len: 1275 microversion: 2.1 time: 0.262947 Sep 16 12:52:36.487181 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 925/1808] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:36 2022] GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3 => generated 1275 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:36.541355 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-33c767e8-c8c7-42e7-bdf1-2aa9e2a8b09a tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:36.550912 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-33c767e8-c8c7-42e7-bdf1-2aa9e2a8b09a tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:36.558343 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-33c767e8-c8c7-42e7-bdf1-2aa9e2a8b09a tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:36.563618 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-33c767e8-c8c7-42e7-bdf1-2aa9e2a8b09a tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] 10.222.0.67 "GET /compute/v2.1/servers/5f350206-ba9d-427c-8b60-95c2d2f501ae" status: 200 len: 1361 microversion: 2.47 time: 0.303439 Sep 16 12:52:36.564469 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 884/1809] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:36 2022] GET /compute/v2.1/servers/5f350206-ba9d-427c-8b60-95c2d2f501ae => generated 1361 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:36.692068 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-235c0f96-81fa-48a1-89b1-70ff77014ca4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:36.694631 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-235c0f96-81fa-48a1-89b1-70ff77014ca4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 4fbd6b22-2181-4786-9116-a8c8eafb9933] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:36.711727 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-235c0f96-81fa-48a1-89b1-70ff77014ca4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:36.712444 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-235c0f96-81fa-48a1-89b1-70ff77014ca4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:36.712998 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-235c0f96-81fa-48a1-89b1-70ff77014ca4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:36.713992 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-235c0f96-81fa-48a1-89b1-70ff77014ca4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:36.714431 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-235c0f96-81fa-48a1-89b1-70ff77014ca4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:36.714958 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-235c0f96-81fa-48a1-89b1-70ff77014ca4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:37.080530 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-18d980eb-bd6f-4dd2-a843-c8f31078f2da tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:37.081562 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-18d980eb-bd6f-4dd2-a843-c8f31078f2da tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] [instance: 345ee81d-c503-421c-90ea-218ac1c98600] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:37.095987 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-18d980eb-bd6f-4dd2-a843-c8f31078f2da tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:37.097846 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-18d980eb-bd6f-4dd2-a843-c8f31078f2da tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:37.099168 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-18d980eb-bd6f-4dd2-a843-c8f31078f2da tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:37.100409 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-18d980eb-bd6f-4dd2-a843-c8f31078f2da tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:37.102364 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-18d980eb-bd6f-4dd2-a843-c8f31078f2da tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:37.103610 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-18d980eb-bd6f-4dd2-a843-c8f31078f2da tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:37.193769 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-235c0f96-81fa-48a1-89b1-70ff77014ca4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:37.220004 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-235c0f96-81fa-48a1-89b1-70ff77014ca4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:37.224727 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-235c0f96-81fa-48a1-89b1-70ff77014ca4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:37.229687 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-235c0f96-81fa-48a1-89b1-70ff77014ca4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933" status: 200 len: 1362 microversion: 2.25 time: 0.542307 Sep 16 12:52:37.237223 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 926/1810] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:36 2022] GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933 => generated 1362 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:37.242305 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-399a6cc1-49da-4eb5-b8b0-a208dc576bc5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:37.253795 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-399a6cc1-49da-4eb5-b8b0-a208dc576bc5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:37.269560 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-399a6cc1-49da-4eb5-b8b0-a208dc576bc5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:37.270166 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-399a6cc1-49da-4eb5-b8b0-a208dc576bc5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:37.270729 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-399a6cc1-49da-4eb5-b8b0-a208dc576bc5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:37.271462 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-399a6cc1-49da-4eb5-b8b0-a208dc576bc5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:37.271921 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-399a6cc1-49da-4eb5-b8b0-a208dc576bc5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:37.277941 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-399a6cc1-49da-4eb5-b8b0-a208dc576bc5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:37.378548 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-399a6cc1-49da-4eb5-b8b0-a208dc576bc5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139967 Sep 16 12:52:37.398253 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 927/1811] 10.222.0.67 () {58 vars in 1302 bytes} [Fri Sep 16 12:52:37 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:52:37.411040 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f86fdfbc-5fa8-41c7-807a-4b0007db6e74 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:37.411665 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f86fdfbc-5fa8-41c7-807a-4b0007db6e74 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:37.424157 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-18d980eb-bd6f-4dd2-a843-c8f31078f2da tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d4c5f7ddf5432ba8b4eac2cb6a9860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b7d059fb70415fb5dc20e3a921d189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:37.429994 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f86fdfbc-5fa8-41c7-807a-4b0007db6e74 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:37.430669 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f86fdfbc-5fa8-41c7-807a-4b0007db6e74 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:37.431303 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f86fdfbc-5fa8-41c7-807a-4b0007db6e74 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:37.432230 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f86fdfbc-5fa8-41c7-807a-4b0007db6e74 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:37.432848 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f86fdfbc-5fa8-41c7-807a-4b0007db6e74 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:37.433985 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f86fdfbc-5fa8-41c7-807a-4b0007db6e74 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:37.442176 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-18d980eb-bd6f-4dd2-a843-c8f31078f2da tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600" status: 200 len: 1317 microversion: 2.1 time: 0.367643 Sep 16 12:52:37.458344 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 885/1812] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:37 2022] GET /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600 => generated 1317 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:37.514070 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-db7866f5-4776-49e0-a2d5-6ce198eb2967 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:37.514908 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-db7866f5-4776-49e0-a2d5-6ce198eb2967 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 5c161179-0b93-4676-86f7-2f507a3ebeb3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:37.524431 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db7866f5-4776-49e0-a2d5-6ce198eb2967 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:37.528896 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db7866f5-4776-49e0-a2d5-6ce198eb2967 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:37.530970 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db7866f5-4776-49e0-a2d5-6ce198eb2967 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:37.533295 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db7866f5-4776-49e0-a2d5-6ce198eb2967 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:37.534845 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db7866f5-4776-49e0-a2d5-6ce198eb2967 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:37.538508 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db7866f5-4776-49e0-a2d5-6ce198eb2967 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:37.723263 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f86fdfbc-5fa8-41c7-807a-4b0007db6e74 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:37.730978 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f86fdfbc-5fa8-41c7-807a-4b0007db6e74 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1476 microversion: 2.1 time: 0.330038 Sep 16 12:52:37.748715 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 928/1813] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:37 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1476 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:37.759825 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-db7866f5-4776-49e0-a2d5-6ce198eb2967 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9101f5af9e34d21bb8e872d337d3545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e41136645964ea98a675833bd73299f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:37.760186 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-36cc2058-002a-49fc-ab29-9cc922e89805 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:37.760991 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-36cc2058-002a-49fc-ab29-9cc922e89805 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 5f350206-ba9d-427c-8b60-95c2d2f501ae] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:37.768752 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36cc2058-002a-49fc-ab29-9cc922e89805 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:37.769202 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-db7866f5-4776-49e0-a2d5-6ce198eb2967 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3" status: 200 len: 1275 microversion: 2.1 time: 0.258601 Sep 16 12:52:37.769653 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36cc2058-002a-49fc-ab29-9cc922e89805 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:37.770297 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36cc2058-002a-49fc-ab29-9cc922e89805 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:37.771198 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36cc2058-002a-49fc-ab29-9cc922e89805 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:37.771343 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 886/1814] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:37 2022] GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3 => generated 1275 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:52:37.771949 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36cc2058-002a-49fc-ab29-9cc922e89805 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:37.774203 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36cc2058-002a-49fc-ab29-9cc922e89805 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:37.927847 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-36cc2058-002a-49fc-ab29-9cc922e89805 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:37.934477 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:52:37.948652 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-36cc2058-002a-49fc-ab29-9cc922e89805 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:37.951675 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-36cc2058-002a-49fc-ab29-9cc922e89805 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:37.954718 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-36cc2058-002a-49fc-ab29-9cc922e89805 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] 10.222.0.67 "GET /compute/v2.1/servers/5f350206-ba9d-427c-8b60-95c2d2f501ae" status: 200 len: 1361 microversion: 2.47 time: 0.204768 Sep 16 12:52:37.971742 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 929/1815] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:37 2022] GET /compute/v2.1/servers/5f350206-ba9d-427c-8b60-95c2d2f501ae => generated 1361 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:38.266535 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f7f9e351-4d7c-4b07-9b5d-cb60b6f7deeb tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:38.267897 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f7f9e351-4d7c-4b07-9b5d-cb60b6f7deeb tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 4fbd6b22-2181-4786-9116-a8c8eafb9933] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:38.273178 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:52:38.301373 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7f9e351-4d7c-4b07-9b5d-cb60b6f7deeb tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:38.310535 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7f9e351-4d7c-4b07-9b5d-cb60b6f7deeb tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:38.311920 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7f9e351-4d7c-4b07-9b5d-cb60b6f7deeb tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:38.315336 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7f9e351-4d7c-4b07-9b5d-cb60b6f7deeb tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:38.316203 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7f9e351-4d7c-4b07-9b5d-cb60b6f7deeb tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:38.332421 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7f9e351-4d7c-4b07-9b5d-cb60b6f7deeb tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:38.398907 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-400605a2-ecdb-4de9-b752-baed7439c2ba tempest-ImagesDeleteNegativeTestJSON-1003719084 tempest-ImagesDeleteNegativeTestJSON-1003719084-project] 10.222.0.67 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.246071 Sep 16 12:52:38.407753 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 887/1816] 10.222.0.67 () {58 vars in 1128 bytes} [Fri Sep 16 12:52:38 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 16 12:52:38.413663 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-88b4ca1f-aff1-439e-b02c-33ba98abb279 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:38.416712 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-88b4ca1f-aff1-439e-b02c-33ba98abb279 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:38.425024 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-88b4ca1f-aff1-439e-b02c-33ba98abb279 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:38.426261 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-88b4ca1f-aff1-439e-b02c-33ba98abb279 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:38.426904 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-88b4ca1f-aff1-439e-b02c-33ba98abb279 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:38.428297 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-88b4ca1f-aff1-439e-b02c-33ba98abb279 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:38.429618 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-88b4ca1f-aff1-439e-b02c-33ba98abb279 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:38.430753 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-88b4ca1f-aff1-439e-b02c-33ba98abb279 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:38.474391 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-88b4ca1f-aff1-439e-b02c-33ba98abb279 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064313 Sep 16 12:52:38.476004 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 888/1817] 10.222.0.67 () {58 vars in 1302 bytes} [Fri Sep 16 12:52:38 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:52:38.481661 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7b89d679-3f30-4868-9dcf-edf9cca55594 tempest-ImagesDeleteNegativeTestJSON-1003719084 tempest-ImagesDeleteNegativeTestJSON-1003719084-project] Calling method '.version_select at 0x7f1039ac5ca0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:38.513369 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-7b89d679-3f30-4868-9dcf-edf9cca55594 tempest-ImagesDeleteNegativeTestJSON-1003719084 tempest-ImagesDeleteNegativeTestJSON-1003719084-project] HTTP exception thrown: Image not found. Sep 16 12:52:38.515984 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7b89d679-3f30-4868-9dcf-edf9cca55594 tempest-ImagesDeleteNegativeTestJSON-1003719084 tempest-ImagesDeleteNegativeTestJSON-1003719084-project] Request method failure captured: Sep 16 12:52:38.515984 n-d-858094-4 devstack@n-api.service[128780]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Sep 16 12:52:38.515984 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:52:38.515984 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:52:38.515984 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:52:38.515984 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:52:38.515984 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:52:38.515984 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:52:38.515984 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:52:38.515984 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:52:38.515984 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHGWVFlakiY_4jFGileTGqsGQEEjhuof_3SJCdrzU96_6xUF-Ff3MlZGwa1GUiUSTh8jIneAezeClM05FHQiPdy4EJWo-8NozwNOWzngkWI1sML18nOHXinaquuK4wNWXzxCUDTNdoYfrS54pR8Ft2saNzp-xS0Lk81oFAuW37MaZlM Sep 16 12:52:38.515984 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:52:38.515984 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:52:38.515984 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:52:38.515984 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:52:38.515984 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:52:38.515984 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:52:38.515984 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: c752cec157b049348ce93c97d5b0904a Sep 16 12:52:38.515984 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1003719084 Sep 16 12:52:38.515984 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:52:38.515984 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:52:38.517644 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c752cec157b049348ce93c97d5b0904a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c752cec157b049348ce93c97d5b0904a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c752cec157b049348ce93c97d5b0904a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c752cec157b049348ce93c97d5b0904a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:52:38.517644 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1003719084 Sep 16 12:52:38.517644 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: c752cec157b049348ce93c97d5b0904a Sep 16 12:52:38.517644 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1003719084 Sep 16 12:52:38.517644 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ImagesDeleteNegativeTestJSON-1003719084-project Sep 16 12:52:38.517644 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:52:38.517644 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:52:38.517644 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 9c3fde07b9f142c38dac3176af55ab69 Sep 16 12:52:38.517644 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1003719084-project Sep 16 12:52:38.517644 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 12:52:38.517644 n-d-858094-4 devstack@n-api.service[128780]: exception: Image not found. Sep 16 12:52:38.517644 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '-1'} Sep 16 12:52:38.517644 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:52:38.517644 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:38.518617 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 16 12:52:38.518617 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 16 12:52:38.518617 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 12:52:38.518617 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 12:52:38.518617 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 12:52:38.518617 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 12:52:38.518617 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 16 12:52:38.518617 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 16 12:52:38.518617 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 16 12:52:38.518617 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 16 12:52:38.518617 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 12:52:38.518617 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 12:52:38.518617 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 12:52:38.518617 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 12:52:38.518617 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Sep 16 12:52:38.518617 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:38.518617 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:38.518617 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:38.518617 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:38.519912 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 16 12:52:38.519912 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 16 12:52:38.519912 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 16 12:52:38.519912 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 16 12:52:38.519912 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 16 12:52:38.519912 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 16 12:52:38.519912 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Sep 16 12:52:38.519912 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:38.519912 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:38.519912 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:38.519912 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:38.519912 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:38.519912 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:38.519912 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:52:38.519912 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:52:38.519912 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:52:38.519912 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:52:38.519912 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:52:38.519912 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:52:38.519912 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 16 12:52:38.521289 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 16 12:52:38.521289 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 12:52:38.521289 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:38.521289 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:38.521289 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:38.521289 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:38.521289 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:38.521289 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:38.521289 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:52:38.521289 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:52:38.521289 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 12:52:38.521289 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:38.526051 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7b89d679-3f30-4868-9dcf-edf9cca55594 tempest-ImagesDeleteNegativeTestJSON-1003719084 tempest-ImagesDeleteNegativeTestJSON-1003719084-project] Returning 404 to user: Image not found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:52:38.527138 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7b89d679-3f30-4868-9dcf-edf9cca55594 tempest-ImagesDeleteNegativeTestJSON-1003719084 tempest-ImagesDeleteNegativeTestJSON-1003719084-project] 10.222.0.67 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.049628 Sep 16 12:52:38.527985 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 889/1818] 10.222.0.67 () {58 vars in 1134 bytes} [Fri Sep 16 12:52:38 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 12:52:38.541756 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-95f7ecfd-4802-450f-ba67-b287d210f3f1 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:38.542410 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-95f7ecfd-4802-450f-ba67-b287d210f3f1 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] [instance: 345ee81d-c503-421c-90ea-218ac1c98600] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:38.561821 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-95f7ecfd-4802-450f-ba67-b287d210f3f1 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:38.562421 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-95f7ecfd-4802-450f-ba67-b287d210f3f1 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:38.562812 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-95f7ecfd-4802-450f-ba67-b287d210f3f1 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:38.566950 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-95f7ecfd-4802-450f-ba67-b287d210f3f1 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:38.567415 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-95f7ecfd-4802-450f-ba67-b287d210f3f1 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:38.572878 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-95f7ecfd-4802-450f-ba67-b287d210f3f1 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:38.581340 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=16 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:52:38.921649 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f7f9e351-4d7c-4b07-9b5d-cb60b6f7deeb tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:38.956173 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f7f9e351-4d7c-4b07-9b5d-cb60b6f7deeb tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:38.960891 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f7f9e351-4d7c-4b07-9b5d-cb60b6f7deeb tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:38.964018 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f7f9e351-4d7c-4b07-9b5d-cb60b6f7deeb tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933" status: 200 len: 1362 microversion: 2.25 time: 0.702642 Sep 16 12:52:38.964642 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 930/1819] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:38 2022] GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933 => generated 1362 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:38.984828 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-189f840a-19ee-4782-b169-a7d03bacebab tempest-ImagesDeleteNegativeTestJSON-1003719084 tempest-ImagesDeleteNegativeTestJSON-1003719084-project] Calling method '.version_select at 0x7f103521aca0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:39.011725 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-189f840a-19ee-4782-b169-a7d03bacebab tempest-ImagesDeleteNegativeTestJSON-1003719084 tempest-ImagesDeleteNegativeTestJSON-1003719084-project] HTTP exception thrown: Image not found. Sep 16 12:52:39.016114 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-189f840a-19ee-4782-b169-a7d03bacebab tempest-ImagesDeleteNegativeTestJSON-1003719084 tempest-ImagesDeleteNegativeTestJSON-1003719084-project] Request method failure captured: Sep 16 12:52:39.016114 n-d-858094-4 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/images/53df3bbe-879d-4dba-821f-c759326c1e3j HTTP/1.1 Sep 16 12:52:39.016114 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:52:39.016114 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:52:39.016114 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:52:39.016114 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:52:39.016114 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:52:39.016114 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:52:39.016114 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:52:39.016114 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:52:39.016114 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHGWVFlakiY_4jFGileTGqsGQEEjhuof_3SJCdrzU96_6xUF-Ff3MlZGwa1GUiUSTh8jIneAezeClM05FHQiPdy4EJWo-8NozwNOWzngkWI1sML18nOHXinaquuK4wNWXzxCUDTNdoYfrS54pR8Ft2saNzp-xS0Lk81oFAuW37MaZlM Sep 16 12:52:39.016114 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:52:39.016114 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:52:39.016114 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:52:39.016114 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:52:39.016114 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:52:39.016114 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:52:39.016114 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: c752cec157b049348ce93c97d5b0904a Sep 16 12:52:39.016114 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1003719084 Sep 16 12:52:39.016114 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:52:39.016114 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:52:39.017818 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c752cec157b049348ce93c97d5b0904a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c752cec157b049348ce93c97d5b0904a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c752cec157b049348ce93c97d5b0904a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c752cec157b049348ce93c97d5b0904a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:52:39.017818 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1003719084 Sep 16 12:52:39.017818 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: c752cec157b049348ce93c97d5b0904a Sep 16 12:52:39.017818 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1003719084 Sep 16 12:52:39.017818 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ImagesDeleteNegativeTestJSON-1003719084-project Sep 16 12:52:39.017818 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:52:39.017818 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:52:39.017818 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 9c3fde07b9f142c38dac3176af55ab69 Sep 16 12:52:39.017818 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1003719084-project Sep 16 12:52:39.017818 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 12:52:39.017818 n-d-858094-4 devstack@n-api.service[128779]: exception: Image not found. Sep 16 12:52:39.017818 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '53df3bbe-879d-4dba-821f-c759326c1e3j'} Sep 16 12:52:39.017818 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:52:39.018871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:39.018871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 16 12:52:39.018871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 16 12:52:39.018871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 12:52:39.018871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 12:52:39.018871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 12:52:39.018871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 12:52:39.018871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 16 12:52:39.018871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 16 12:52:39.018871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 16 12:52:39.018871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 16 12:52:39.018871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 12:52:39.018871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 12:52:39.018871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 12:52:39.018871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 12:52:39.018871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 53df3bbe-879d-4dba-821f-c759326c1e3j to delete Sep 16 12:52:39.018871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:52:39.018871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:39.018871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:52:39.020754 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:39.020754 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 16 12:52:39.020754 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 16 12:52:39.020754 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 16 12:52:39.020754 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 16 12:52:39.020754 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 16 12:52:39.020754 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 16 12:52:39.020754 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 53df3bbe-879d-4dba-821f-c759326c1e3j could not be found. Sep 16 12:52:39.020754 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:52:39.020754 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:39.020754 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:52:39.020754 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:39.020754 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:39.020754 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:39.020754 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:52:39.020754 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:52:39.020754 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:52:39.020754 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:52:39.020754 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:52:39.020754 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:52:39.024221 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 16 12:52:39.024221 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 16 12:52:39.024221 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 12:52:39.024221 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:52:39.024221 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:39.024221 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:52:39.024221 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:39.024221 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:39.024221 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:39.024221 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:52:39.024221 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:52:39.024221 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 12:52:39.024221 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:52:39.024221 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-189f840a-19ee-4782-b169-a7d03bacebab tempest-ImagesDeleteNegativeTestJSON-1003719084 tempest-ImagesDeleteNegativeTestJSON-1003719084-project] Returning 404 to user: Image not found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:52:39.024221 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-189f840a-19ee-4782-b169-a7d03bacebab tempest-ImagesDeleteNegativeTestJSON-1003719084 tempest-ImagesDeleteNegativeTestJSON-1003719084-project] 10.222.0.67 "DELETE /compute/v2.1/images/53df3bbe-879d-4dba-821f-c759326c1e3j" status: 404 len: 62 microversion: 2.1 time: 0.044759 Sep 16 12:52:39.028534 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 931/1820] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:38 2022] DELETE /compute/v2.1/images/53df3bbe-879d-4dba-821f-c759326c1e3j => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 12:52:39.030895 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-05af2a2b-8818-41f1-b001-30da7106abe7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:39.031915 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-05af2a2b-8818-41f1-b001-30da7106abe7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:39.041084 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05af2a2b-8818-41f1-b001-30da7106abe7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:39.041637 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05af2a2b-8818-41f1-b001-30da7106abe7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:39.042234 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05af2a2b-8818-41f1-b001-30da7106abe7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:39.043425 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05af2a2b-8818-41f1-b001-30da7106abe7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:39.044501 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05af2a2b-8818-41f1-b001-30da7106abe7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:39.045819 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05af2a2b-8818-41f1-b001-30da7106abe7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:39.389217 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-95f7ecfd-4802-450f-ba67-b287d210f3f1 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d4c5f7ddf5432ba8b4eac2cb6a9860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b7d059fb70415fb5dc20e3a921d189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:39.402165 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-95f7ecfd-4802-450f-ba67-b287d210f3f1 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600" status: 200 len: 1317 microversion: 2.1 time: 0.869287 Sep 16 12:52:39.403733 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 890/1821] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:38 2022] GET /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600 => generated 1317 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:39.409569 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-286f292d-20cf-43a4-b581-b1338b2b0b57 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:39.410448 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-286f292d-20cf-43a4-b581-b1338b2b0b57 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 5c161179-0b93-4676-86f7-2f507a3ebeb3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:39.419313 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-286f292d-20cf-43a4-b581-b1338b2b0b57 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:39.420305 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-286f292d-20cf-43a4-b581-b1338b2b0b57 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:39.421215 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-286f292d-20cf-43a4-b581-b1338b2b0b57 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:39.422782 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-286f292d-20cf-43a4-b581-b1338b2b0b57 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:39.445430 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-286f292d-20cf-43a4-b581-b1338b2b0b57 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:39.447276 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-286f292d-20cf-43a4-b581-b1338b2b0b57 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:39.576182 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-05af2a2b-8818-41f1-b001-30da7106abe7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:39.592604 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-05af2a2b-8818-41f1-b001-30da7106abe7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1476 microversion: 2.1 time: 0.567730 Sep 16 12:52:39.605426 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 932/1822] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:39 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1476 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:39.616214 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-aca994d0-dc14-4b07-898f-aa0c7dcc6453 req-ad6fb864-9439-4831-b4ac-92cea89ad695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1afdaec3-fdf0-4eac-a324-c0f8eaa6797b", "name": "network-vif-unplugged", "status": "completed", "tag": "bf12465f-8132-474a-94b1-e3b53f03df41"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:52:39.627618 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-286f292d-20cf-43a4-b581-b1338b2b0b57 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9101f5af9e34d21bb8e872d337d3545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e41136645964ea98a675833bd73299f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:39.637264 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-286f292d-20cf-43a4-b581-b1338b2b0b57 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3" status: 200 len: 1281 microversion: 2.1 time: 0.231794 Sep 16 12:52:39.641011 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 891/1823] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:39 2022] GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3 => generated 1281 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:39.644910 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-aca994d0-dc14-4b07-898f-aa0c7dcc6453 req-ad6fb864-9439-4831-b4ac-92cea89ad695 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:39.646699 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-aca994d0-dc14-4b07-898f-aa0c7dcc6453 req-ad6fb864-9439-4831-b4ac-92cea89ad695 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:39.649125 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-aca994d0-dc14-4b07-898f-aa0c7dcc6453 req-ad6fb864-9439-4831-b4ac-92cea89ad695 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:39.652716 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7a12b9f6-c5f2-4007-aa2b-08993e694ca1 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:39.655596 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7a12b9f6-c5f2-4007-aa2b-08993e694ca1 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 5f350206-ba9d-427c-8b60-95c2d2f501ae] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:39.664548 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7a12b9f6-c5f2-4007-aa2b-08993e694ca1 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:39.665426 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7a12b9f6-c5f2-4007-aa2b-08993e694ca1 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:39.666298 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7a12b9f6-c5f2-4007-aa2b-08993e694ca1 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:39.667193 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7a12b9f6-c5f2-4007-aa2b-08993e694ca1 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:39.668564 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7a12b9f6-c5f2-4007-aa2b-08993e694ca1 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:39.669209 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7a12b9f6-c5f2-4007-aa2b-08993e694ca1 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:39.670772 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-aca994d0-dc14-4b07-898f-aa0c7dcc6453 req-ad6fb864-9439-4831-b4ac-92cea89ad695 service nova] Creating event network-vif-unplugged:bf12465f-8132-474a-94b1-e3b53f03df41 for instance 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b on n-h1-858094-4 Sep 16 12:52:39.678750 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [req-aca994d0-dc14-4b07-898f-aa0c7dcc6453 req-ad6fb864-9439-4831-b4ac-92cea89ad695 service nova] Instance 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858094-4', 'n-h2-858094-4'} {{(pid=128779) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 12:52:39.693348 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-aca994d0-dc14-4b07-898f-aa0c7dcc6453 req-ad6fb864-9439-4831-b4ac-92cea89ad695 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086550 Sep 16 12:52:39.694640 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 933/1824] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:52:39.707635 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-364996b4-5d97-4cad-8ae7-8aa7ede454a3 tempest-ImagesDeleteNegativeTestJSON-1003719084 tempest-ImagesDeleteNegativeTestJSON-1003719084-project] Calling method '.version_select at 0x7f10353a4430>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:39.728156 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-364996b4-5d97-4cad-8ae7-8aa7ede454a3 tempest-ImagesDeleteNegativeTestJSON-1003719084 tempest-ImagesDeleteNegativeTestJSON-1003719084-project] HTTP exception thrown: Image not found. Sep 16 12:52:39.730318 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-364996b4-5d97-4cad-8ae7-8aa7ede454a3 tempest-ImagesDeleteNegativeTestJSON-1003719084 tempest-ImagesDeleteNegativeTestJSON-1003719084-project] Request method failure captured: Sep 16 12:52:39.730318 n-d-858094-4 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/images/60503208-a374-49de-993e-69a4debfac871 HTTP/1.1 Sep 16 12:52:39.730318 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:52:39.730318 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:52:39.730318 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:52:39.730318 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:52:39.730318 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:52:39.730318 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:52:39.730318 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:52:39.730318 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:52:39.730318 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHGWVFlakiY_4jFGileTGqsGQEEjhuof_3SJCdrzU96_6xUF-Ff3MlZGwa1GUiUSTh8jIneAezeClM05FHQiPdy4EJWo-8NozwNOWzngkWI1sML18nOHXinaquuK4wNWXzxCUDTNdoYfrS54pR8Ft2saNzp-xS0Lk81oFAuW37MaZlM Sep 16 12:52:39.730318 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:52:39.730318 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:52:39.730318 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:52:39.730318 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:52:39.730318 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:52:39.730318 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:52:39.730318 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: c752cec157b049348ce93c97d5b0904a Sep 16 12:52:39.730318 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1003719084 Sep 16 12:52:39.730318 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:52:39.730318 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:52:39.732384 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c752cec157b049348ce93c97d5b0904a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c752cec157b049348ce93c97d5b0904a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c752cec157b049348ce93c97d5b0904a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c752cec157b049348ce93c97d5b0904a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:52:39.732384 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1003719084 Sep 16 12:52:39.732384 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: c752cec157b049348ce93c97d5b0904a Sep 16 12:52:39.732384 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1003719084 Sep 16 12:52:39.732384 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ImagesDeleteNegativeTestJSON-1003719084-project Sep 16 12:52:39.732384 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:52:39.732384 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:52:39.732384 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 9c3fde07b9f142c38dac3176af55ab69 Sep 16 12:52:39.732384 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1003719084-project Sep 16 12:52:39.732384 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 12:52:39.732384 n-d-858094-4 devstack@n-api.service[128779]: exception: Image not found. Sep 16 12:52:39.732384 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '60503208-a374-49de-993e-69a4debfac871'} Sep 16 12:52:39.732384 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:52:39.733469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:39.733469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 16 12:52:39.733469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 16 12:52:39.733469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 12:52:39.733469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 12:52:39.733469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 12:52:39.733469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 12:52:39.733469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 16 12:52:39.733469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 16 12:52:39.733469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 16 12:52:39.733469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 16 12:52:39.733469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 12:52:39.733469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 12:52:39.733469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 12:52:39.733469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 12:52:39.733469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 60503208-a374-49de-993e-69a4debfac871 to delete Sep 16 12:52:39.733469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:52:39.733469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:39.733469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:52:39.736104 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:39.736104 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 16 12:52:39.736104 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 16 12:52:39.736104 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 16 12:52:39.736104 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 16 12:52:39.736104 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 16 12:52:39.736104 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 16 12:52:39.736104 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 60503208-a374-49de-993e-69a4debfac871 could not be found. Sep 16 12:52:39.736104 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:52:39.736104 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:39.736104 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:52:39.736104 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:39.736104 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:39.736104 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:39.736104 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:52:39.736104 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:52:39.736104 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:52:39.736104 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:52:39.736104 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:52:39.736104 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:52:39.743345 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 16 12:52:39.743345 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 16 12:52:39.743345 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 12:52:39.743345 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:52:39.743345 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:39.743345 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:52:39.743345 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:39.743345 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:39.743345 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:39.743345 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:52:39.743345 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:52:39.743345 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 12:52:39.743345 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:52:39.743345 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-364996b4-5d97-4cad-8ae7-8aa7ede454a3 tempest-ImagesDeleteNegativeTestJSON-1003719084 tempest-ImagesDeleteNegativeTestJSON-1003719084-project] Returning 404 to user: Image not found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:52:39.743345 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-364996b4-5d97-4cad-8ae7-8aa7ede454a3 tempest-ImagesDeleteNegativeTestJSON-1003719084 tempest-ImagesDeleteNegativeTestJSON-1003719084-project] 10.222.0.67 "DELETE /compute/v2.1/images/60503208-a374-49de-993e-69a4debfac871" status: 404 len: 62 microversion: 2.1 time: 0.031141 Sep 16 12:52:39.746197 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 934/1825] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:52:39 2022] DELETE /compute/v2.1/images/60503208-a374-49de-993e-69a4debfac871 => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 12:52:39.746197 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6c8a4209-c56f-4cd2-8305-a4e2ee29bb50 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:39.754089 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7a12b9f6-c5f2-4007-aa2b-08993e694ca1 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:39.754572 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7a12b9f6-c5f2-4007-aa2b-08993e694ca1 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:39.755447 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6c8a4209-c56f-4cd2-8305-a4e2ee29bb50 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:39.755713 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7a12b9f6-c5f2-4007-aa2b-08993e694ca1 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:39.761750 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-7a12b9f6-c5f2-4007-aa2b-08993e694ca1 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lazy-loading 'fault' on Instance uuid 5f350206-ba9d-427c-8b60-95c2d2f501ae {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:52:39.763908 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c8a4209-c56f-4cd2-8305-a4e2ee29bb50 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:39.764445 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c8a4209-c56f-4cd2-8305-a4e2ee29bb50 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:39.764884 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c8a4209-c56f-4cd2-8305-a4e2ee29bb50 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:39.765865 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c8a4209-c56f-4cd2-8305-a4e2ee29bb50 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:39.766770 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c8a4209-c56f-4cd2-8305-a4e2ee29bb50 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:39.767766 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c8a4209-c56f-4cd2-8305-a4e2ee29bb50 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:39.827719 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6c8a4209-c56f-4cd2-8305-a4e2ee29bb50 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087376 Sep 16 12:52:39.832920 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7a12b9f6-c5f2-4007-aa2b-08993e694ca1 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:39.833606 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 935/1826] 10.222.0.67 () {58 vars in 1302 bytes} [Fri Sep 16 12:52:39 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:52:39.839685 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-94ae912c-cdea-40c8-b39d-9690008adda2 tempest-ImagesDeleteNegativeTestJSON-1003719084 tempest-ImagesDeleteNegativeTestJSON-1003719084-project] Calling method '.version_select at 0x7f1035649670>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:39.847909 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7a12b9f6-c5f2-4007-aa2b-08993e694ca1 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:39.861196 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7a12b9f6-c5f2-4007-aa2b-08993e694ca1 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c0495684dc4bdeaacca09eadae3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7566965e424a09bd5488847d1776bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:39.863800 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7a12b9f6-c5f2-4007-aa2b-08993e694ca1 tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] 10.222.0.67 "GET /compute/v2.1/servers/5f350206-ba9d-427c-8b60-95c2d2f501ae" status: 200 len: 1366 microversion: 2.47 time: 0.220648 Sep 16 12:52:39.867903 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-94ae912c-cdea-40c8-b39d-9690008adda2 tempest-ImagesDeleteNegativeTestJSON-1003719084 tempest-ImagesDeleteNegativeTestJSON-1003719084-project] HTTP exception thrown: Image not found. Sep 16 12:52:39.868542 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 892/1827] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:39 2022] GET /compute/v2.1/servers/5f350206-ba9d-427c-8b60-95c2d2f501ae => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:39.870128 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-94ae912c-cdea-40c8-b39d-9690008adda2 tempest-ImagesDeleteNegativeTestJSON-1003719084 tempest-ImagesDeleteNegativeTestJSON-1003719084-project] Request method failure captured: Sep 16 12:52:39.870128 n-d-858094-4 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/images/tempest-invalid-1741485006 HTTP/1.1 Sep 16 12:52:39.870128 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:52:39.870128 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:52:39.870128 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:52:39.870128 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:52:39.870128 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:52:39.870128 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:52:39.870128 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:52:39.870128 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:52:39.870128 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHGWVFlakiY_4jFGileTGqsGQEEjhuof_3SJCdrzU96_6xUF-Ff3MlZGwa1GUiUSTh8jIneAezeClM05FHQiPdy4EJWo-8NozwNOWzngkWI1sML18nOHXinaquuK4wNWXzxCUDTNdoYfrS54pR8Ft2saNzp-xS0Lk81oFAuW37MaZlM Sep 16 12:52:39.870128 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:52:39.870128 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:52:39.870128 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:52:39.870128 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:52:39.870128 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:52:39.870128 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:52:39.870128 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: c752cec157b049348ce93c97d5b0904a Sep 16 12:52:39.870128 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1003719084 Sep 16 12:52:39.870128 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:52:39.870128 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:52:39.871598 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c752cec157b049348ce93c97d5b0904a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c752cec157b049348ce93c97d5b0904a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c752cec157b049348ce93c97d5b0904a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c752cec157b049348ce93c97d5b0904a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:52:39.871598 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1003719084 Sep 16 12:52:39.871598 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: c752cec157b049348ce93c97d5b0904a Sep 16 12:52:39.871598 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1003719084 Sep 16 12:52:39.871598 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ImagesDeleteNegativeTestJSON-1003719084-project Sep 16 12:52:39.871598 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:52:39.871598 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:52:39.871598 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 9c3fde07b9f142c38dac3176af55ab69 Sep 16 12:52:39.871598 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1003719084-project Sep 16 12:52:39.871598 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 12:52:39.871598 n-d-858094-4 devstack@n-api.service[128779]: exception: Image not found. Sep 16 12:52:39.871598 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': 'tempest-invalid-1741485006'} Sep 16 12:52:39.871598 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:52:39.873310 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:39.873310 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 16 12:52:39.873310 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 16 12:52:39.873310 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 12:52:39.873310 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 12:52:39.873310 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 12:52:39.873310 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 12:52:39.873310 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 16 12:52:39.873310 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 16 12:52:39.873310 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 16 12:52:39.873310 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 16 12:52:39.873310 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 12:52:39.873310 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 12:52:39.873310 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 12:52:39.873310 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 12:52:39.873310 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1741485006 to delete Sep 16 12:52:39.873310 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:52:39.873310 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:39.873310 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:52:39.874734 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:39.874734 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 16 12:52:39.874734 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 16 12:52:39.874734 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 16 12:52:39.874734 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 16 12:52:39.874734 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 16 12:52:39.874734 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 16 12:52:39.874734 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1741485006 could not be found. Sep 16 12:52:39.874734 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:52:39.874734 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:39.874734 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:52:39.874734 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:39.874734 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:39.874734 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:39.874734 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:52:39.874734 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:52:39.874734 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:52:39.874734 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:52:39.874734 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:52:39.874734 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:52:39.876049 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 16 12:52:39.876049 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 16 12:52:39.876049 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 12:52:39.876049 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:52:39.876049 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:39.876049 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:52:39.876049 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:39.876049 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:39.876049 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:39.876049 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:52:39.876049 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:52:39.876049 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 12:52:39.876049 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:52:39.876049 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-94ae912c-cdea-40c8-b39d-9690008adda2 tempest-ImagesDeleteNegativeTestJSON-1003719084 tempest-ImagesDeleteNegativeTestJSON-1003719084-project] Returning 404 to user: Image not found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:52:39.876049 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-94ae912c-cdea-40c8-b39d-9690008adda2 tempest-ImagesDeleteNegativeTestJSON-1003719084 tempest-ImagesDeleteNegativeTestJSON-1003719084-project] 10.222.0.67 "DELETE /compute/v2.1/images/tempest-invalid-1741485006" status: 404 len: 62 microversion: 2.1 time: 0.036701 Sep 16 12:52:39.878796 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 936/1828] 10.222.0.67 () {58 vars in 1206 bytes} [Fri Sep 16 12:52:39 2022] DELETE /compute/v2.1/images/tempest-invalid-1741485006 => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 12:52:39.889939 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f897c52b-0da6-49b5-bf29-c1daaa200e50 tempest-ImagesDeleteNegativeTestJSON-1003719084 tempest-ImagesDeleteNegativeTestJSON-1003719084-project] Calling method '.version_select at 0x7f1039a939d0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:39.925228 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-f897c52b-0da6-49b5-bf29-c1daaa200e50 tempest-ImagesDeleteNegativeTestJSON-1003719084 tempest-ImagesDeleteNegativeTestJSON-1003719084-project] HTTP exception thrown: Image not found. Sep 16 12:52:39.927309 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f897c52b-0da6-49b5-bf29-c1daaa200e50 tempest-ImagesDeleteNegativeTestJSON-1003719084 tempest-ImagesDeleteNegativeTestJSON-1003719084-project] Request method failure captured: Sep 16 12:52:39.927309 n-d-858094-4 devstack@n-api.service[128780]: request: DELETE /compute/v2.1/images/49487f5d-3b5f-4736-a7c7-34e62b29dc82 HTTP/1.1 Sep 16 12:52:39.927309 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:52:39.927309 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:52:39.927309 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:52:39.927309 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:52:39.927309 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:52:39.927309 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:52:39.927309 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:52:39.927309 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:52:39.927309 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHGWVFlakiY_4jFGileTGqsGQEEjhuof_3SJCdrzU96_6xUF-Ff3MlZGwa1GUiUSTh8jIneAezeClM05FHQiPdy4EJWo-8NozwNOWzngkWI1sML18nOHXinaquuK4wNWXzxCUDTNdoYfrS54pR8Ft2saNzp-xS0Lk81oFAuW37MaZlM Sep 16 12:52:39.927309 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:52:39.927309 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:52:39.927309 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:52:39.927309 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:52:39.927309 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:52:39.927309 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:52:39.927309 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: c752cec157b049348ce93c97d5b0904a Sep 16 12:52:39.927309 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1003719084 Sep 16 12:52:39.927309 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:52:39.927309 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:52:39.928944 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c752cec157b049348ce93c97d5b0904a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c752cec157b049348ce93c97d5b0904a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c752cec157b049348ce93c97d5b0904a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c752cec157b049348ce93c97d5b0904a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:52:39.928944 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1003719084 Sep 16 12:52:39.928944 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: c752cec157b049348ce93c97d5b0904a Sep 16 12:52:39.928944 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1003719084 Sep 16 12:52:39.928944 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ImagesDeleteNegativeTestJSON-1003719084-project Sep 16 12:52:39.928944 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:52:39.928944 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:52:39.928944 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 9c3fde07b9f142c38dac3176af55ab69 Sep 16 12:52:39.928944 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1003719084-project Sep 16 12:52:39.928944 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 12:52:39.928944 n-d-858094-4 devstack@n-api.service[128780]: exception: Image not found. Sep 16 12:52:39.928944 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '49487f5d-3b5f-4736-a7c7-34e62b29dc82'} Sep 16 12:52:39.928944 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:52:39.929841 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:39.929841 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 16 12:52:39.929841 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 16 12:52:39.929841 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 12:52:39.929841 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 12:52:39.929841 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 12:52:39.929841 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 12:52:39.929841 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 16 12:52:39.929841 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 16 12:52:39.929841 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 16 12:52:39.929841 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 16 12:52:39.929841 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 12:52:39.929841 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 12:52:39.929841 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 12:52:39.929841 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 12:52:39.929841 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 49487f5d-3b5f-4736-a7c7-34e62b29dc82 to delete Sep 16 12:52:39.929841 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:39.929841 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:39.929841 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:39.931105 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:39.931105 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 16 12:52:39.931105 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 16 12:52:39.931105 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 16 12:52:39.931105 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 16 12:52:39.931105 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 16 12:52:39.931105 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 16 12:52:39.931105 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 49487f5d-3b5f-4736-a7c7-34e62b29dc82 could not be found. Sep 16 12:52:39.931105 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:39.931105 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:39.931105 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:39.931105 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:39.931105 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:39.931105 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:39.931105 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:52:39.931105 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:52:39.931105 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:52:39.931105 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:52:39.931105 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:52:39.931105 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:52:39.932773 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 16 12:52:39.932773 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 16 12:52:39.932773 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 12:52:39.932773 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:39.932773 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:39.932773 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:39.932773 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:39.932773 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:39.932773 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:39.932773 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:52:39.932773 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:52:39.932773 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 12:52:39.932773 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:39.936069 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f897c52b-0da6-49b5-bf29-c1daaa200e50 tempest-ImagesDeleteNegativeTestJSON-1003719084 tempest-ImagesDeleteNegativeTestJSON-1003719084-project] Returning 404 to user: Image not found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:52:39.937583 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f897c52b-0da6-49b5-bf29-c1daaa200e50 tempest-ImagesDeleteNegativeTestJSON-1003719084 tempest-ImagesDeleteNegativeTestJSON-1003719084-project] 10.222.0.67 "DELETE /compute/v2.1/images/49487f5d-3b5f-4736-a7c7-34e62b29dc82" status: 404 len: 62 microversion: 2.1 time: 0.056111 Sep 16 12:52:39.941043 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 893/1829] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:39 2022] DELETE /compute/v2.1/images/49487f5d-3b5f-4736-a7c7-34e62b29dc82 => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 12:52:39.992054 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6c989b56-1d6d-465d-b16d-37c3c6666c43 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:39.992975 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6c989b56-1d6d-465d-b16d-37c3c6666c43 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 4fbd6b22-2181-4786-9116-a8c8eafb9933] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:40.011064 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c989b56-1d6d-465d-b16d-37c3c6666c43 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:40.011575 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c989b56-1d6d-465d-b16d-37c3c6666c43 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:40.012734 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c989b56-1d6d-465d-b16d-37c3c6666c43 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:40.013543 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c989b56-1d6d-465d-b16d-37c3c6666c43 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:40.014081 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c989b56-1d6d-465d-b16d-37c3c6666c43 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:40.014519 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c989b56-1d6d-465d-b16d-37c3c6666c43 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:40.431714 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3007baea-91bc-443b-b44f-c91ee8783126 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:40.433417 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3007baea-91bc-443b-b44f-c91ee8783126 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] [instance: 345ee81d-c503-421c-90ea-218ac1c98600] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:40.447003 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3007baea-91bc-443b-b44f-c91ee8783126 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:40.447745 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3007baea-91bc-443b-b44f-c91ee8783126 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:40.448625 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3007baea-91bc-443b-b44f-c91ee8783126 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:40.449759 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3007baea-91bc-443b-b44f-c91ee8783126 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:40.450486 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3007baea-91bc-443b-b44f-c91ee8783126 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:40.461202 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3007baea-91bc-443b-b44f-c91ee8783126 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:40.875846 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6c989b56-1d6d-465d-b16d-37c3c6666c43 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:40.890527 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6c989b56-1d6d-465d-b16d-37c3c6666c43 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:40.893614 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6c989b56-1d6d-465d-b16d-37c3c6666c43 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:40.895047 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6c989b56-1d6d-465d-b16d-37c3c6666c43 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933" status: 200 len: 1362 microversion: 2.25 time: 0.908121 Sep 16 12:52:40.896603 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 937/1830] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:39 2022] GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933 => generated 1362 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:40.901388 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3007baea-91bc-443b-b44f-c91ee8783126 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d4c5f7ddf5432ba8b4eac2cb6a9860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b7d059fb70415fb5dc20e3a921d189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:40.909370 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3007baea-91bc-443b-b44f-c91ee8783126 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600" status: 200 len: 1317 microversion: 2.1 time: 0.483249 Sep 16 12:52:40.909951 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 894/1831] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:40 2022] GET /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600 => generated 1317 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:40.916694 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1a70514d-7ac5-4d96-ae5c-d9382833c7f7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:40.919831 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1a70514d-7ac5-4d96-ae5c-d9382833c7f7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:40.920373 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6c3419b6-cd7a-499c-bf79-4c34557e06c1 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:40.921226 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6c3419b6-cd7a-499c-bf79-4c34557e06c1 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 5c161179-0b93-4676-86f7-2f507a3ebeb3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:40.937782 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a70514d-7ac5-4d96-ae5c-d9382833c7f7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:40.938669 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a70514d-7ac5-4d96-ae5c-d9382833c7f7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:40.939435 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a70514d-7ac5-4d96-ae5c-d9382833c7f7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:40.939844 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6c3419b6-cd7a-499c-bf79-4c34557e06c1 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:40.940411 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6c3419b6-cd7a-499c-bf79-4c34557e06c1 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:40.940601 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a70514d-7ac5-4d96-ae5c-d9382833c7f7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:40.941186 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6c3419b6-cd7a-499c-bf79-4c34557e06c1 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:40.942088 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6c3419b6-cd7a-499c-bf79-4c34557e06c1 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:40.942940 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6c3419b6-cd7a-499c-bf79-4c34557e06c1 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:40.943735 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6c3419b6-cd7a-499c-bf79-4c34557e06c1 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:40.944651 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a70514d-7ac5-4d96-ae5c-d9382833c7f7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:40.946301 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a70514d-7ac5-4d96-ae5c-d9382833c7f7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:41.111724 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6c3419b6-cd7a-499c-bf79-4c34557e06c1 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9101f5af9e34d21bb8e872d337d3545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e41136645964ea98a675833bd73299f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:41.121721 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6c3419b6-cd7a-499c-bf79-4c34557e06c1 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3" status: 200 len: 1281 microversion: 2.1 time: 0.210656 Sep 16 12:52:41.137225 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 895/1832] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:40 2022] GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3 => generated 1281 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:41.153208 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4d2000b1-017a-4a76-883a-ce5b003e3a3d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:41.157063 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-4d2000b1-017a-4a76-883a-ce5b003e3a3d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:41.164179 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4d2000b1-017a-4a76-883a-ce5b003e3a3d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:41.165018 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4d2000b1-017a-4a76-883a-ce5b003e3a3d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:41.165648 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4d2000b1-017a-4a76-883a-ce5b003e3a3d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:41.166803 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4d2000b1-017a-4a76-883a-ce5b003e3a3d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:41.167961 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4d2000b1-017a-4a76-883a-ce5b003e3a3d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:41.168614 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4d2000b1-017a-4a76-883a-ce5b003e3a3d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:41.222687 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4d2000b1-017a-4a76-883a-ce5b003e3a3d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084020 Sep 16 12:52:41.223446 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 896/1833] 10.222.0.67 () {58 vars in 1302 bytes} [Fri Sep 16 12:52:41 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 12:52:41.228311 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3ffa9291-b847-464b-bb25-90c366926d2c tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:41.229621 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3ffa9291-b847-464b-bb25-90c366926d2c tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] [instance: 5f350206-ba9d-427c-8b60-95c2d2f501ae] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:41.237694 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3ffa9291-b847-464b-bb25-90c366926d2c tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:41.238239 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3ffa9291-b847-464b-bb25-90c366926d2c tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:41.238677 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3ffa9291-b847-464b-bb25-90c366926d2c tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:41.239796 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3ffa9291-b847-464b-bb25-90c366926d2c tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:41.240509 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3ffa9291-b847-464b-bb25-90c366926d2c tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:41.241210 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3ffa9291-b847-464b-bb25-90c366926d2c tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:41.263319 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-3ffa9291-b847-464b-bb25-90c366926d2c tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] HTTP exception thrown: Instance 5f350206-ba9d-427c-8b60-95c2d2f501ae could not be found. Sep 16 12:52:41.265312 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3ffa9291-b847-464b-bb25-90c366926d2c tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Request method failure captured: Sep 16 12:52:41.265312 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/5f350206-ba9d-427c-8b60-95c2d2f501ae HTTP/1.1 Sep 16 12:52:41.265312 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:52:41.265312 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:52:41.265312 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:52:41.265312 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:52:41.265312 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:52:41.265312 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:52:41.265312 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:52:41.265312 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:52:41.265312 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHFV9VsqJxF4eqvlqXS_BElNyZ-0OU72dnnqNeHWzK1Gfz0SREGF4FOamoPY4boC8PNaptXG0gq4uEUsc8TVGPockjGWZ_40xRABNQT82B1_jhHEpdS8cFhahC8WyhTyPsMVzEHTzVd-x9ir6f1PpUP1SaZ2-nY6PGWV2xjWz9xY2Ro Sep 16 12:52:41.265312 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:52:41.265312 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:52:41.265312 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:52:41.265312 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:52:41.265312 n-d-858094-4 devstack@n-api.service[128780]: X-Openstack-Nova-Api-Version: 2.47 Sep 16 12:52:41.265312 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:52:41.265312 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:52:41.265312 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 2a7566965e424a09bd5488847d1776bd Sep 16 12:52:41.265312 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ServerShowV247Test-1271383446 Sep 16 12:52:41.265312 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:52:41.265312 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:52:41.267242 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2a7566965e424a09bd5488847d1776bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2a7566965e424a09bd5488847d1776bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2a7566965e424a09bd5488847d1776bd", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2a7566965e424a09bd5488847d1776bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:52:41.267242 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ServerShowV247Test-1271383446 Sep 16 12:52:41.267242 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 2a7566965e424a09bd5488847d1776bd Sep 16 12:52:41.267242 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ServerShowV247Test-1271383446 Sep 16 12:52:41.267242 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ServerShowV247Test-1271383446-project Sep 16 12:52:41.267242 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:52:41.267242 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:52:41.267242 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 43c0495684dc4bdeaacca09eadae3b42 Sep 16 12:52:41.267242 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ServerShowV247Test-1271383446-project Sep 16 12:52:41.267242 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:52:41.267242 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance 5f350206-ba9d-427c-8b60-95c2d2f501ae could not be found. Sep 16 12:52:41.267242 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '5f350206-ba9d-427c-8b60-95c2d2f501ae'} Sep 16 12:52:41.268409 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:52:41.268409 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:41.268409 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:52:41.268409 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:52:41.268409 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:52:41.268409 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:52:41.268409 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:52:41.268409 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:52:41.268409 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:52:41.268409 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:52:41.268409 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f350206-ba9d-427c-8b60-95c2d2f501ae could not be found. Sep 16 12:52:41.268409 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:41.268409 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:41.268409 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:41.268409 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:41.268409 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:41.268409 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:41.268409 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:52:41.268409 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:52:41.268409 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:52:41.270134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:52:41.270134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:52:41.270134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:52:41.270134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:52:41.270134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:52:41.270134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:52:41.270134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:52:41.270134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f350206-ba9d-427c-8b60-95c2d2f501ae could not be found. Sep 16 12:52:41.270134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:41.270134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:52:41.270134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:41.270134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:52:41.270134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:52:41.270134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:52:41.270134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:52:41.270134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:52:41.270134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f350206-ba9d-427c-8b60-95c2d2f501ae could not be found. Sep 16 12:52:41.270134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:52:41.271580 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3ffa9291-b847-464b-bb25-90c366926d2c tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] Returning 404 to user: Instance 5f350206-ba9d-427c-8b60-95c2d2f501ae could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:52:41.271580 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3ffa9291-b847-464b-bb25-90c366926d2c tempest-ServerShowV247Test-1271383446 tempest-ServerShowV247Test-1271383446-project] 10.222.0.67 "GET /compute/v2.1/servers/5f350206-ba9d-427c-8b60-95c2d2f501ae" status: 404 len: 111 microversion: 2.47 time: 0.045179 Sep 16 12:52:41.275965 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 897/1834] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:41 2022] GET /compute/v2.1/servers/5f350206-ba9d-427c-8b60-95c2d2f501ae => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 12:52:41.579588 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1a70514d-7ac5-4d96-ae5c-d9382833c7f7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:41.590826 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1a70514d-7ac5-4d96-ae5c-d9382833c7f7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1476 microversion: 2.1 time: 0.692654 Sep 16 12:52:41.620828 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 938/1835] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:40 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1476 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:41.689873 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-08843af1-9962-4cd2-bc95-06296b38a276 req-5614f586-cbeb-4dc6-a5b2-3570f0f4f691 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1afdaec3-fdf0-4eac-a324-c0f8eaa6797b", "tag": "bf12465f-8132-474a-94b1-e3b53f03df41"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:52:41.716083 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-d4c41411-d1b9-4d11-bbdc-cb3241ff277f req-dbd6d882-1b18-4df6-8b53-97f80f810480 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "345ee81d-c503-421c-90ea-218ac1c98600", "name": "network-vif-plugged", "status": "completed", "tag": "56c49806-0b21-4f4b-9b96-195fc33fcba5"}, {"server_uuid": "4fbd6b22-2181-4786-9116-a8c8eafb9933", "name": "network-vif-plugged", "status": "completed", "tag": "c56b7ce5-25b3-4ac0-bcbf-28e9db2c0185"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:52:41.735653 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-08843af1-9962-4cd2-bc95-06296b38a276 req-5614f586-cbeb-4dc6-a5b2-3570f0f4f691 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:41.735793 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-08843af1-9962-4cd2-bc95-06296b38a276 req-5614f586-cbeb-4dc6-a5b2-3570f0f4f691 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:41.736254 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-08843af1-9962-4cd2-bc95-06296b38a276 req-5614f586-cbeb-4dc6-a5b2-3570f0f4f691 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:41.740512 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d4c41411-d1b9-4d11-bbdc-cb3241ff277f req-dbd6d882-1b18-4df6-8b53-97f80f810480 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:41.741006 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d4c41411-d1b9-4d11-bbdc-cb3241ff277f req-dbd6d882-1b18-4df6-8b53-97f80f810480 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:41.741433 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d4c41411-d1b9-4d11-bbdc-cb3241ff277f req-dbd6d882-1b18-4df6-8b53-97f80f810480 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:41.774406 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-d4c41411-d1b9-4d11-bbdc-cb3241ff277f req-dbd6d882-1b18-4df6-8b53-97f80f810480 service nova] Creating event network-vif-plugged:56c49806-0b21-4f4b-9b96-195fc33fcba5 for instance 345ee81d-c503-421c-90ea-218ac1c98600 on n-h1-858094-4 Sep 16 12:52:41.775204 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-d4c41411-d1b9-4d11-bbdc-cb3241ff277f req-dbd6d882-1b18-4df6-8b53-97f80f810480 service nova] Creating event network-vif-plugged:c56b7ce5-25b3-4ac0-bcbf-28e9db2c0185 for instance 4fbd6b22-2181-4786-9116-a8c8eafb9933 on n-h2-858094-4 Sep 16 12:52:41.792002 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-08843af1-9962-4cd2-bc95-06296b38a276 req-5614f586-cbeb-4dc6-a5b2-3570f0f4f691 service nova] Creating event network-changed:bf12465f-8132-474a-94b1-e3b53f03df41 for instance 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b on n-h1-858094-4 Sep 16 12:52:41.797634 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-d4c41411-d1b9-4d11-bbdc-cb3241ff277f req-dbd6d882-1b18-4df6-8b53-97f80f810480 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.083265 Sep 16 12:52:41.800166 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 939/1836] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:52:41.823212 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [req-08843af1-9962-4cd2-bc95-06296b38a276 req-5614f586-cbeb-4dc6-a5b2-3570f0f4f691 service nova] Instance 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858094-4', 'n-h2-858094-4'} {{(pid=128780) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 12:52:41.848237 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-08843af1-9962-4cd2-bc95-06296b38a276 req-5614f586-cbeb-4dc6-a5b2-3570f0f4f691 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164758 Sep 16 12:52:41.851263 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 898/1837] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:52:41.950915 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1243037a-2744-4161-b1c0-0ec63c18d153 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:41.951893 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1243037a-2744-4161-b1c0-0ec63c18d153 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] [instance: 345ee81d-c503-421c-90ea-218ac1c98600] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:41.955448 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-dd23b9e8-fdf3-4cee-acd9-4ed01b488130 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:41.956208 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-dd23b9e8-fdf3-4cee-acd9-4ed01b488130 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 4fbd6b22-2181-4786-9116-a8c8eafb9933] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:41.972961 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dd23b9e8-fdf3-4cee-acd9-4ed01b488130 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:41.973899 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1243037a-2744-4161-b1c0-0ec63c18d153 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:41.974401 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1243037a-2744-4161-b1c0-0ec63c18d153 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:41.974825 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1243037a-2744-4161-b1c0-0ec63c18d153 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:41.975529 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1243037a-2744-4161-b1c0-0ec63c18d153 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:41.979943 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dd23b9e8-fdf3-4cee-acd9-4ed01b488130 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:41.980437 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dd23b9e8-fdf3-4cee-acd9-4ed01b488130 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:41.981896 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1243037a-2744-4161-b1c0-0ec63c18d153 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:41.982221 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1243037a-2744-4161-b1c0-0ec63c18d153 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:41.983843 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dd23b9e8-fdf3-4cee-acd9-4ed01b488130 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:41.984642 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dd23b9e8-fdf3-4cee-acd9-4ed01b488130 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:41.985303 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dd23b9e8-fdf3-4cee-acd9-4ed01b488130 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:42.965572 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-dd23b9e8-fdf3-4cee-acd9-4ed01b488130 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:42.971402 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1243037a-2744-4161-b1c0-0ec63c18d153 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d4c5f7ddf5432ba8b4eac2cb6a9860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b7d059fb70415fb5dc20e3a921d189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:43.004582 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-dd23b9e8-fdf3-4cee-acd9-4ed01b488130 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:43.008057 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1243037a-2744-4161-b1c0-0ec63c18d153 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600" status: 200 len: 1317 microversion: 2.1 time: 1.063985 Sep 16 12:52:43.014828 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 940/1838] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:41 2022] GET /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600 => generated 1317 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:43.021459 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-dd23b9e8-fdf3-4cee-acd9-4ed01b488130 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:43.025261 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-50b2c8a2-8e2d-407a-bf30-0298c0186b00 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:43.027276 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-dd23b9e8-fdf3-4cee-acd9-4ed01b488130 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933" status: 200 len: 1362 microversion: 2.25 time: 1.081204 Sep 16 12:52:43.053452 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 899/1839] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:41 2022] GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933 => generated 1362 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:43.059348 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c9cc95c5-5c33-410f-977a-6c803e28e9af tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:43.059928 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c9cc95c5-5c33-410f-977a-6c803e28e9af tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:43.064613 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-50b2c8a2-8e2d-407a-bf30-0298c0186b00 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 5c161179-0b93-4676-86f7-2f507a3ebeb3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:43.084405 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50b2c8a2-8e2d-407a-bf30-0298c0186b00 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:43.084908 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50b2c8a2-8e2d-407a-bf30-0298c0186b00 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:43.085345 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50b2c8a2-8e2d-407a-bf30-0298c0186b00 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:43.086058 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50b2c8a2-8e2d-407a-bf30-0298c0186b00 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:43.086509 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50b2c8a2-8e2d-407a-bf30-0298c0186b00 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:43.086929 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50b2c8a2-8e2d-407a-bf30-0298c0186b00 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:43.100716 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c9cc95c5-5c33-410f-977a-6c803e28e9af tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:43.101192 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c9cc95c5-5c33-410f-977a-6c803e28e9af tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:43.101630 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c9cc95c5-5c33-410f-977a-6c803e28e9af tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:43.102418 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c9cc95c5-5c33-410f-977a-6c803e28e9af tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:43.102876 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c9cc95c5-5c33-410f-977a-6c803e28e9af tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:43.103299 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c9cc95c5-5c33-410f-977a-6c803e28e9af tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:43.715932 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:52:43.734502 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-50b2c8a2-8e2d-407a-bf30-0298c0186b00 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9101f5af9e34d21bb8e872d337d3545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e41136645964ea98a675833bd73299f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:43.746609 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-50b2c8a2-8e2d-407a-bf30-0298c0186b00 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3" status: 200 len: 1323 microversion: 2.1 time: 0.728959 Sep 16 12:52:43.747498 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 941/1840] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:43 2022] GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3 => generated 1323 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:43.824920 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c9cc95c5-5c33-410f-977a-6c803e28e9af tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:43.829554 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=100 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:52:43.837181 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c9cc95c5-5c33-410f-977a-6c803e28e9af tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1476 microversion: 2.1 time: 0.781734 Sep 16 12:52:43.855662 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 900/1841] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:43 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1476 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:44.039340 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-21f82f45-d5e7-42df-a1b9-62d925ac7dfc tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:44.039950 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-21f82f45-d5e7-42df-a1b9-62d925ac7dfc tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] [instance: 345ee81d-c503-421c-90ea-218ac1c98600] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:44.049587 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:52:44.051915 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-21f82f45-d5e7-42df-a1b9-62d925ac7dfc tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:44.059026 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2c4eefe9-18fc-42c6-8b6d-246e0490c34c tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:44.060332 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-2c4eefe9-18fc-42c6-8b6d-246e0490c34c tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 4fbd6b22-2181-4786-9116-a8c8eafb9933] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:44.064479 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-21f82f45-d5e7-42df-a1b9-62d925ac7dfc tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:44.066657 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-21f82f45-d5e7-42df-a1b9-62d925ac7dfc tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:44.070431 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-21f82f45-d5e7-42df-a1b9-62d925ac7dfc tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:44.072192 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-21f82f45-d5e7-42df-a1b9-62d925ac7dfc tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:44.073191 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c4eefe9-18fc-42c6-8b6d-246e0490c34c tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:44.073812 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-21f82f45-d5e7-42df-a1b9-62d925ac7dfc tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:44.081622 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c4eefe9-18fc-42c6-8b6d-246e0490c34c tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:44.083389 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c4eefe9-18fc-42c6-8b6d-246e0490c34c tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:44.084176 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c4eefe9-18fc-42c6-8b6d-246e0490c34c tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:44.084703 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c4eefe9-18fc-42c6-8b6d-246e0490c34c tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:44.085136 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c4eefe9-18fc-42c6-8b6d-246e0490c34c tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:44.781359 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=8 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:52:44.825561 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-21f82f45-d5e7-42df-a1b9-62d925ac7dfc tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d4c5f7ddf5432ba8b4eac2cb6a9860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b7d059fb70415fb5dc20e3a921d189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:44.854283 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-21f82f45-d5e7-42df-a1b9-62d925ac7dfc tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600" status: 200 len: 1317 microversion: 2.1 time: 0.816958 Sep 16 12:52:44.871104 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 942/1842] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:44 2022] GET /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600 => generated 1317 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:44.882131 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-83d03206-19f0-4844-b16d-8d1a50430df3 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:44.888498 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-83d03206-19f0-4844-b16d-8d1a50430df3 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 5c161179-0b93-4676-86f7-2f507a3ebeb3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:44.918389 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83d03206-19f0-4844-b16d-8d1a50430df3 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:44.920531 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83d03206-19f0-4844-b16d-8d1a50430df3 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:44.921645 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83d03206-19f0-4844-b16d-8d1a50430df3 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:44.925613 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83d03206-19f0-4844-b16d-8d1a50430df3 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:44.926996 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-2c4eefe9-18fc-42c6-8b6d-246e0490c34c tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:44.927710 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83d03206-19f0-4844-b16d-8d1a50430df3 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:44.939413 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-2c4eefe9-18fc-42c6-8b6d-246e0490c34c tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:44.941184 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-2c4eefe9-18fc-42c6-8b6d-246e0490c34c tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:44.943782 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83d03206-19f0-4844-b16d-8d1a50430df3 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:44.945380 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2c4eefe9-18fc-42c6-8b6d-246e0490c34c tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933" status: 200 len: 1559 microversion: 2.25 time: 0.890375 Sep 16 12:52:44.949185 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 901/1843] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:44 2022] GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933 => generated 1559 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:52:44.960526 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f089264a-11c4-4936-9b52-e695400e2bc0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:44.961568 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f089264a-11c4-4936-9b52-e695400e2bc0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:44.990216 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f089264a-11c4-4936-9b52-e695400e2bc0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:44.990942 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f089264a-11c4-4936-9b52-e695400e2bc0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:44.991561 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f089264a-11c4-4936-9b52-e695400e2bc0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:44.992803 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f089264a-11c4-4936-9b52-e695400e2bc0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:44.993422 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f089264a-11c4-4936-9b52-e695400e2bc0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:44.994010 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f089264a-11c4-4936-9b52-e695400e2bc0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:45.511612 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-83d03206-19f0-4844-b16d-8d1a50430df3 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9101f5af9e34d21bb8e872d337d3545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e41136645964ea98a675833bd73299f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:45.521174 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-83d03206-19f0-4844-b16d-8d1a50430df3 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3" status: 200 len: 1323 microversion: 2.1 time: 0.644788 Sep 16 12:52:45.541583 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 943/1844] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:44 2022] GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3 => generated 1323 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:45.547470 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-01084386-84dc-4c66-85bd-811b0c2fc5bd tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:45.556754 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-01084386-84dc-4c66-85bd-811b0c2fc5bd tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] [instance: 4fbd6b22-2181-4786-9116-a8c8eafb9933] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:45.569612 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01084386-84dc-4c66-85bd-811b0c2fc5bd tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:45.572756 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01084386-84dc-4c66-85bd-811b0c2fc5bd tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:45.573404 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01084386-84dc-4c66-85bd-811b0c2fc5bd tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:45.574321 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01084386-84dc-4c66-85bd-811b0c2fc5bd tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:45.576497 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01084386-84dc-4c66-85bd-811b0c2fc5bd tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:45.580998 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01084386-84dc-4c66-85bd-811b0c2fc5bd tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:45.636562 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f089264a-11c4-4936-9b52-e695400e2bc0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:45.647725 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f089264a-11c4-4936-9b52-e695400e2bc0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1474 microversion: 2.1 time: 0.696620 Sep 16 12:52:45.664150 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 902/1845] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:44 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1474 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:45.685528 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7488d4eb-46b0-49fe-9d61-7c420f33634f tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f1039b00670>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:45.808367 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7488d4eb-46b0-49fe-9d61-7c420f33634f tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/54daa0c5-9a5f-43d3-ad6f-11b5d75596b1" status: 200 len: 661 microversion: 2.1 time: 0.142001 Sep 16 12:52:45.819942 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 903/1846] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:52:45 2022] GET /compute/v2.1/images/54daa0c5-9a5f-43d3-ad6f-11b5d75596b1 => generated 661 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:52:45.839227 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-80c63955-88b2-4577-b9a5-7b7f5beeec1d tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f1039aee160>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:45.984053 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-80c63955-88b2-4577-b9a5-7b7f5beeec1d tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/54daa0c5-9a5f-43d3-ad6f-11b5d75596b1" status: 200 len: 661 microversion: 2.1 time: 0.152211 Sep 16 12:52:45.989701 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 904/1847] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:52:45 2022] GET /compute/v2.1/images/54daa0c5-9a5f-43d3-ad6f-11b5d75596b1 => generated 661 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:52:46.012765 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-84b6afef-9dae-4c69-9e27-d6f431960016 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:46.016473 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-84b6afef-9dae-4c69-9e27-d6f431960016 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] [instance: 345ee81d-c503-421c-90ea-218ac1c98600] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:46.036978 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-84b6afef-9dae-4c69-9e27-d6f431960016 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:46.037803 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-84b6afef-9dae-4c69-9e27-d6f431960016 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:46.040607 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-84b6afef-9dae-4c69-9e27-d6f431960016 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:46.042686 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-84b6afef-9dae-4c69-9e27-d6f431960016 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:46.053687 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-84b6afef-9dae-4c69-9e27-d6f431960016 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:46.054525 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-84b6afef-9dae-4c69-9e27-d6f431960016 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:46.057651 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-01084386-84dc-4c66-85bd-811b0c2fc5bd tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lazy-loading 'services' on Instance uuid 4fbd6b22-2181-4786-9116-a8c8eafb9933 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:52:46.090023 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-01084386-84dc-4c66-85bd-811b0c2fc5bd tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933" status: 200 len: 2052 microversion: 2.25 time: 0.546820 Sep 16 12:52:46.090632 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 944/1848] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:45 2022] GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933 => generated 2052 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:46.118225 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-25b9dc2b-11fe-49c1-af41-d1e111c06356 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:46.118854 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-25b9dc2b-11fe-49c1-af41-d1e111c06356 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] [instance: 4fbd6b22-2181-4786-9116-a8c8eafb9933] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:46.135153 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25b9dc2b-11fe-49c1-af41-d1e111c06356 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:46.135650 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25b9dc2b-11fe-49c1-af41-d1e111c06356 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:46.136094 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25b9dc2b-11fe-49c1-af41-d1e111c06356 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:46.136845 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25b9dc2b-11fe-49c1-af41-d1e111c06356 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:46.137304 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25b9dc2b-11fe-49c1-af41-d1e111c06356 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:46.144544 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25b9dc2b-11fe-49c1-af41-d1e111c06356 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:46.506209 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-84b6afef-9dae-4c69-9e27-d6f431960016 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d4c5f7ddf5432ba8b4eac2cb6a9860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b7d059fb70415fb5dc20e3a921d189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:46.516174 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-84b6afef-9dae-4c69-9e27-d6f431960016 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600" status: 200 len: 1466 microversion: 2.1 time: 0.523507 Sep 16 12:52:46.531615 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 905/1849] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:45 2022] GET /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600 => generated 1466 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:46.537696 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-84b6afef-9dae-4c69-9e27-d6f431960016 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:46.539278 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-84b6afef-9dae-4c69-9e27-d6f431960016 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute//" status: 200 len: 377 microversion: - time: 0.006231 Sep 16 12:52:46.540108 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 906/1850] 10.222.0.67 () {56 vars in 886 bytes} [Fri Sep 16 12:52:46 2022] GET /compute/ => generated 377 bytes in 8 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 16 12:52:46.545302 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ba11126d-938d-432b-8762-ce862429426b tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1236344103", "metadata": {"image_type": "test"}}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:52:46.548768 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ba11126d-938d-432b-8762-ce862429426b tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] [instance: 345ee81d-c503-421c-90ea-218ac1c98600] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:46.578222 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ba11126d-938d-432b-8762-ce862429426b tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:46.579142 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ba11126d-938d-432b-8762-ce862429426b tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:46.579817 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ba11126d-938d-432b-8762-ce862429426b tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:46.580793 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ba11126d-938d-432b-8762-ce862429426b tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:46.582590 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ba11126d-938d-432b-8762-ce862429426b tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:46.583699 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ba11126d-938d-432b-8762-ce862429426b tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:46.683965 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-ba11126d-938d-432b-8762-ce862429426b tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Getting quotas for project 69b7d059fb70415fb5dc20e3a921d189. Resources: dict_keys(['metadata_items']) {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:52:46.698633 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-ba11126d-938d-432b-8762-ce862429426b tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Getting quotas for user 45d4c5f7ddf5432ba8b4eac2cb6a9860 and project 69b7d059fb70415fb5dc20e3a921d189. Resources: dict_keys(['metadata_items']) {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:52:46.719149 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-25b9dc2b-11fe-49c1-af41-d1e111c06356 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lazy-loading 'services' on Instance uuid 4fbd6b22-2181-4786-9116-a8c8eafb9933 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:52:46.774885 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-25b9dc2b-11fe-49c1-af41-d1e111c06356 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933" status: 200 len: 2052 microversion: 2.25 time: 0.658213 Sep 16 12:52:46.778831 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 945/1851] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:46 2022] GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933 => generated 2052 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:46.788968 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-71291d1d-bd97-41c7-9c17-d04c698c47a8 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:46.793359 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-71291d1d-bd97-41c7-9c17-d04c698c47a8 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 5c161179-0b93-4676-86f7-2f507a3ebeb3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:46.833569 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71291d1d-bd97-41c7-9c17-d04c698c47a8 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:46.835588 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71291d1d-bd97-41c7-9c17-d04c698c47a8 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:46.838402 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71291d1d-bd97-41c7-9c17-d04c698c47a8 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:46.840292 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71291d1d-bd97-41c7-9c17-d04c698c47a8 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:46.845619 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71291d1d-bd97-41c7-9c17-d04c698c47a8 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:46.847619 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71291d1d-bd97-41c7-9c17-d04c698c47a8 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:47.192030 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ba11126d-938d-432b-8762-ce862429426b tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "POST /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600/action" status: 202 len: 0 microversion: 2.1 time: 0.650434 Sep 16 12:52:47.196986 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 907/1852] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:52:46 2022] POST /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600/action => generated 0 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 16 12:52:47.206346 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8a866c33-e518-46df-9988-4197d351ef87 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:47.207162 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8a866c33-e518-46df-9988-4197d351ef87 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:47.214533 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8a866c33-e518-46df-9988-4197d351ef87 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:47.215364 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8a866c33-e518-46df-9988-4197d351ef87 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:47.215999 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8a866c33-e518-46df-9988-4197d351ef87 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:47.216997 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8a866c33-e518-46df-9988-4197d351ef87 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:47.217666 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8a866c33-e518-46df-9988-4197d351ef87 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:47.218325 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8a866c33-e518-46df-9988-4197d351ef87 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:48.221991 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-71291d1d-bd97-41c7-9c17-d04c698c47a8 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9101f5af9e34d21bb8e872d337d3545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e41136645964ea98a675833bd73299f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:48.238479 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-71291d1d-bd97-41c7-9c17-d04c698c47a8 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3" status: 200 len: 1323 microversion: 2.1 time: 1.458129 Sep 16 12:52:48.239081 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 946/1853] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:46 2022] GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3 => generated 1323 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:48.265324 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-cded07dc-4f34-4a59-91a7-583d5c57e021 req-4d4c1296-4a21-4c9f-899e-2d3931297ceb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c161179-0b93-4676-86f7-2f507a3ebeb3", "tag": "d5a5f978-c5f0-4476-91cc-2b79e48ec4a7"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:52:48.267016 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8a866c33-e518-46df-9988-4197d351ef87 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:48.281338 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8a866c33-e518-46df-9988-4197d351ef87 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1474 microversion: 2.1 time: 1.081931 Sep 16 12:52:48.283006 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 908/1854] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:47 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1474 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:48.283585 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-cded07dc-4f34-4a59-91a7-583d5c57e021 req-4d4c1296-4a21-4c9f-899e-2d3931297ceb service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:48.284077 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-cded07dc-4f34-4a59-91a7-583d5c57e021 req-4d4c1296-4a21-4c9f-899e-2d3931297ceb service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:48.284659 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-cded07dc-4f34-4a59-91a7-583d5c57e021 req-4d4c1296-4a21-4c9f-899e-2d3931297ceb service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:48.288929 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a412fc8b-38f2-4b80-b040-4e60de189bba tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:48.301728 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-cded07dc-4f34-4a59-91a7-583d5c57e021 req-4d4c1296-4a21-4c9f-899e-2d3931297ceb service nova] Creating event network-changed:d5a5f978-c5f0-4476-91cc-2b79e48ec4a7 for instance 5c161179-0b93-4676-86f7-2f507a3ebeb3 on n-h1-858094-4 Sep 16 12:52:48.308104 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-cded07dc-4f34-4a59-91a7-583d5c57e021 req-4d4c1296-4a21-4c9f-899e-2d3931297ceb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058595 Sep 16 12:52:48.310277 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a412fc8b-38f2-4b80-b040-4e60de189bba tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:48.311017 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a412fc8b-38f2-4b80-b040-4e60de189bba tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:48.311910 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a412fc8b-38f2-4b80-b040-4e60de189bba tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:48.313634 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a412fc8b-38f2-4b80-b040-4e60de189bba tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:48.314118 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a412fc8b-38f2-4b80-b040-4e60de189bba tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:48.314596 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 947/1855] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:52:48.319089 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a412fc8b-38f2-4b80-b040-4e60de189bba tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:48.323342 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c82381f6-7b38-4a00-9c17-fdb2eade31fc tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '.version_select at 0x7f103520ef70>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:48.390291 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a412fc8b-38f2-4b80-b040-4e60de189bba tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.105333 Sep 16 12:52:48.391342 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 909/1856] 10.222.0.67 () {60 vars in 1217 bytes} [Fri Sep 16 12:52:48 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:52:48.412288 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-dc70e144-2c2e-4578-a17f-9ec440e617e6 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f1039aee790>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:48.529109 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c82381f6-7b38-4a00-9c17-fdb2eade31fc tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/images/a14d99e9-0c3f-4440-a1b8-2513d1ea03c3" status: 200 len: 1424 microversion: 2.1 time: 0.212696 Sep 16 12:52:48.540291 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-dc70e144-2c2e-4578-a17f-9ec440e617e6 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/fd848734-b5d1-45eb-856c-610b57bf8403" status: 200 len: 661 microversion: 2.1 time: 0.139111 Sep 16 12:52:48.541049 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 910/1858] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:52:48 2022] GET /compute/v2.1/images/fd848734-b5d1-45eb-856c-610b57bf8403 => generated 661 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:52:48.541250 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 948/1858] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:52:48 2022] GET /compute/v2.1/images/a14d99e9-0c3f-4440-a1b8-2513d1ea03c3 => generated 1424 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:48.559360 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-83bc71ab-e16c-4e4e-8269-802fce97c0ef tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f10351b8b80>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:48.560423 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-be22720b-324d-4451-bb71-db4da9342be0 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:52:48.566296 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-be22720b-324d-4451-bb71-db4da9342be0 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] [instance: 4fbd6b22-2181-4786-9116-a8c8eafb9933] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:48.579825 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-be22720b-324d-4451-bb71-db4da9342be0 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:48.585789 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-be22720b-324d-4451-bb71-db4da9342be0 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:48.586356 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-be22720b-324d-4451-bb71-db4da9342be0 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:48.587227 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-be22720b-324d-4451-bb71-db4da9342be0 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:48.587794 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-be22720b-324d-4451-bb71-db4da9342be0 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:48.592208 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-be22720b-324d-4451-bb71-db4da9342be0 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:48.648378 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-83bc71ab-e16c-4e4e-8269-802fce97c0ef tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/fd848734-b5d1-45eb-856c-610b57bf8403" status: 200 len: 661 microversion: 2.1 time: 0.096317 Sep 16 12:52:48.649602 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 949/1859] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:52:48 2022] GET /compute/v2.1/images/fd848734-b5d1-45eb-856c-610b57bf8403 => generated 661 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:52:48.811945 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-be22720b-324d-4451-bb71-db4da9342be0 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933/action" status: 202 len: 0 microversion: 2.25 time: 0.268222 Sep 16 12:52:48.814012 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 911/1860] 10.222.0.67 () {62 vars in 1319 bytes} [Fri Sep 16 12:52:48 2022] POST /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:52:48.836662 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5a70892d-161c-496e-8eeb-66b1e5610aa3 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:48.837562 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5a70892d-161c-496e-8eeb-66b1e5610aa3 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] [instance: 4fbd6b22-2181-4786-9116-a8c8eafb9933] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:48.851225 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a70892d-161c-496e-8eeb-66b1e5610aa3 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:48.851801 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a70892d-161c-496e-8eeb-66b1e5610aa3 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:48.852323 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a70892d-161c-496e-8eeb-66b1e5610aa3 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:48.853572 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a70892d-161c-496e-8eeb-66b1e5610aa3 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:48.854381 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a70892d-161c-496e-8eeb-66b1e5610aa3 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:48.867121 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a70892d-161c-496e-8eeb-66b1e5610aa3 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:49.265045 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6a0db1ca-4d20-4072-b12c-b1331c0febc9 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:49.267445 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6a0db1ca-4d20-4072-b12c-b1331c0febc9 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 5c161179-0b93-4676-86f7-2f507a3ebeb3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:49.295733 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6a0db1ca-4d20-4072-b12c-b1331c0febc9 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:49.297610 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6a0db1ca-4d20-4072-b12c-b1331c0febc9 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:49.299482 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6a0db1ca-4d20-4072-b12c-b1331c0febc9 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:49.303680 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6a0db1ca-4d20-4072-b12c-b1331c0febc9 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:49.304522 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6a0db1ca-4d20-4072-b12c-b1331c0febc9 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:49.306037 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6a0db1ca-4d20-4072-b12c-b1331c0febc9 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:49.777313 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-5a70892d-161c-496e-8eeb-66b1e5610aa3 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lazy-loading 'services' on Instance uuid 4fbd6b22-2181-4786-9116-a8c8eafb9933 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:52:49.818894 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5a70892d-161c-496e-8eeb-66b1e5610aa3 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933" status: 200 len: 2057 microversion: 2.25 time: 0.999969 Sep 16 12:52:49.821451 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 950/1861] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:48 2022] GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933 => generated 2057 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:49.833334 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6a0db1ca-4d20-4072-b12c-b1331c0febc9 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9101f5af9e34d21bb8e872d337d3545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e41136645964ea98a675833bd73299f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:49.858368 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-def797fc-457c-4a5c-ba32-f7e081c908db tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:49.858567 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6a0db1ca-4d20-4072-b12c-b1331c0febc9 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3" status: 200 len: 1323 microversion: 2.1 time: 0.599148 Sep 16 12:52:49.859010 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-def797fc-457c-4a5c-ba32-f7e081c908db tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:49.862193 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 912/1862] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:49 2022] GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3 => generated 1323 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:52:49.872652 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3716e125-370c-4445-b73d-5d5af3ac1c41 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '.version_select at 0x7f1039a69280>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:49.900609 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-def797fc-457c-4a5c-ba32-f7e081c908db tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:49.901156 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-def797fc-457c-4a5c-ba32-f7e081c908db tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:49.901614 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-def797fc-457c-4a5c-ba32-f7e081c908db tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:49.902362 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-def797fc-457c-4a5c-ba32-f7e081c908db tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:49.907271 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-def797fc-457c-4a5c-ba32-f7e081c908db tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:49.908462 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-def797fc-457c-4a5c-ba32-f7e081c908db tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:50.242068 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-def797fc-457c-4a5c-ba32-f7e081c908db tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:50.258981 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-def797fc-457c-4a5c-ba32-f7e081c908db tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1471 microversion: 2.1 time: 0.436131 Sep 16 12:52:50.260945 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 951/1863] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:49 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1471 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:50.294205 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9f1ee713-5364-46ff-ac8a-5d4e9262bc4b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:52:50.296209 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9f1ee713-5364-46ff-ac8a-5d4e9262bc4b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:50.321916 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f1ee713-5364-46ff-ac8a-5d4e9262bc4b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:50.322719 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f1ee713-5364-46ff-ac8a-5d4e9262bc4b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:50.323342 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f1ee713-5364-46ff-ac8a-5d4e9262bc4b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:50.325885 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f1ee713-5364-46ff-ac8a-5d4e9262bc4b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:50.332559 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f1ee713-5364-46ff-ac8a-5d4e9262bc4b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:50.333245 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f1ee713-5364-46ff-ac8a-5d4e9262bc4b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:50.385564 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:52:50.640719 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9f1ee713-5364-46ff-ac8a-5d4e9262bc4b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "POST /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b/action" status: 202 len: 0 microversion: 2.1 time: 0.359972 Sep 16 12:52:50.641548 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 952/1864] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:52:50 2022] POST /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:52:50.650323 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4d895e04-23d3-43bc-b407-598aa2817731 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:50.654918 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4d895e04-23d3-43bc-b407-598aa2817731 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:50.666609 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d895e04-23d3-43bc-b407-598aa2817731 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:50.667150 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d895e04-23d3-43bc-b407-598aa2817731 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:50.670032 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d895e04-23d3-43bc-b407-598aa2817731 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:50.671050 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d895e04-23d3-43bc-b407-598aa2817731 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:50.671715 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d895e04-23d3-43bc-b407-598aa2817731 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:50.672266 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d895e04-23d3-43bc-b407-598aa2817731 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:50.778851 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3716e125-370c-4445-b73d-5d5af3ac1c41 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/images/a14d99e9-0c3f-4440-a1b8-2513d1ea03c3" status: 200 len: 1424 microversion: 2.1 time: 0.915324 Sep 16 12:52:50.787205 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 913/1865] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:52:49 2022] GET /compute/v2.1/images/a14d99e9-0c3f-4440-a1b8-2513d1ea03c3 => generated 1424 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:50.792735 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3003fd19-ea93-436c-9b9b-57cc77fb71d9 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f1039abcb80>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:50.867016 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3003fd19-ea93-436c-9b9b-57cc77fb71d9 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/09c17acb-ad38-43c8-9325-ab54e2b69b5c" status: 200 len: 660 microversion: 2.1 time: 0.085795 Sep 16 12:52:50.867537 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 914/1866] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:52:50 2022] GET /compute/v2.1/images/09c17acb-ad38-43c8-9325-ab54e2b69b5c => generated 660 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:52:50.885702 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b38175c4-a060-4572-b420-c73b3a492211 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:50.886849 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b38175c4-a060-4572-b420-c73b3a492211 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] [instance: 4fbd6b22-2181-4786-9116-a8c8eafb9933] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:50.897056 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b38175c4-a060-4572-b420-c73b3a492211 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:50.898316 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b38175c4-a060-4572-b420-c73b3a492211 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:50.898951 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b38175c4-a060-4572-b420-c73b3a492211 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:50.900298 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b38175c4-a060-4572-b420-c73b3a492211 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:50.900923 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b38175c4-a060-4572-b420-c73b3a492211 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:50.901512 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b38175c4-a060-4572-b420-c73b3a492211 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:50.980102 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4d895e04-23d3-43bc-b407-598aa2817731 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:50.995657 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4d895e04-23d3-43bc-b407-598aa2817731 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1470 microversion: 2.1 time: 0.349426 Sep 16 12:52:51.011793 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 953/1867] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:50 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1470 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:51.011793 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2f825f82-b357-4f21-8d1e-6aada4225260 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f103529a790>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:51.110792 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2f825f82-b357-4f21-8d1e-6aada4225260 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/09c17acb-ad38-43c8-9325-ab54e2b69b5c" status: 200 len: 660 microversion: 2.1 time: 0.108601 Sep 16 12:52:51.111604 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 954/1868] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:52:51 2022] GET /compute/v2.1/images/09c17acb-ad38-43c8-9325-ab54e2b69b5c => generated 660 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:52:51.124384 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-b38175c4-a060-4572-b420-c73b3a492211 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lazy-loading 'services' on Instance uuid 4fbd6b22-2181-4786-9116-a8c8eafb9933 {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:52:51.141609 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-221b13cb-c0d4-477e-abc1-8f53a1fee26e tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:51.142129 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b38175c4-a060-4572-b420-c73b3a492211 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933" status: 200 len: 2037 microversion: 2.25 time: 0.270041 Sep 16 12:52:51.142281 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-221b13cb-c0d4-477e-abc1-8f53a1fee26e tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 5c161179-0b93-4676-86f7-2f507a3ebeb3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:51.143425 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 915/1869] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:50 2022] GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933 => generated 2037 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:51.171863 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b8d5c6a8-b08e-47bf-abe6-62069184ed4d tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858094-4", "block_migration": "auto"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:52:51.174696 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b8d5c6a8-b08e-47bf-abe6-62069184ed4d tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] [instance: 4fbd6b22-2181-4786-9116-a8c8eafb9933] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:51.188523 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-221b13cb-c0d4-477e-abc1-8f53a1fee26e tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:51.188715 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b8d5c6a8-b08e-47bf-abe6-62069184ed4d tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:51.189034 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b8d5c6a8-b08e-47bf-abe6-62069184ed4d tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:51.189678 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b8d5c6a8-b08e-47bf-abe6-62069184ed4d tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:51.190390 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b8d5c6a8-b08e-47bf-abe6-62069184ed4d tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:51.190844 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b8d5c6a8-b08e-47bf-abe6-62069184ed4d tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:51.191267 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b8d5c6a8-b08e-47bf-abe6-62069184ed4d tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:51.194281 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-221b13cb-c0d4-477e-abc1-8f53a1fee26e tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:51.200170 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-221b13cb-c0d4-477e-abc1-8f53a1fee26e tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:51.211557 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-221b13cb-c0d4-477e-abc1-8f53a1fee26e tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:51.212253 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-221b13cb-c0d4-477e-abc1-8f53a1fee26e tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:51.212714 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-221b13cb-c0d4-477e-abc1-8f53a1fee26e tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:51.287883 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-b8d5c6a8-b08e-47bf-abe6-62069184ed4d tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lazy-loading 'flavor' on Instance uuid 4fbd6b22-2181-4786-9116-a8c8eafb9933 {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:52:51.305567 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b8d5c6a8-b08e-47bf-abe6-62069184ed4d tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] [instance: 4fbd6b22-2181-4786-9116-a8c8eafb9933] Going to try to live migrate instance to n-h1-858094-4 {{(pid=128780) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 16 12:52:51.561568 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-221b13cb-c0d4-477e-abc1-8f53a1fee26e tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9101f5af9e34d21bb8e872d337d3545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e41136645964ea98a675833bd73299f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:51.591445 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-221b13cb-c0d4-477e-abc1-8f53a1fee26e tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3" status: 200 len: 1323 microversion: 2.1 time: 0.467951 Sep 16 12:52:51.593588 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 955/1870] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:51 2022] GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3 => generated 1323 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:51.607252 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-397659f2-0b2a-4f81-9e71-9524e08c6408 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-945674242", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:52:51.741673 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-397659f2-0b2a-4f81-9e71-9524e08c6408 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] validate_networks() for None {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:52:52.372883 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-397659f2-0b2a-4f81-9e71-9524e08c6408 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:52:52.377209 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-397659f2-0b2a-4f81-9e71-9524e08c6408 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:52:52.381923 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-397659f2-0b2a-4f81-9e71-9524e08c6408 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:52:52.383194 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-397659f2-0b2a-4f81-9e71-9524e08c6408 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:52:52.389926 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-397659f2-0b2a-4f81-9e71-9524e08c6408 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:52:52.442882 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-397659f2-0b2a-4f81-9e71-9524e08c6408 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:52.444490 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-397659f2-0b2a-4f81-9e71-9524e08c6408 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:52.449564 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-397659f2-0b2a-4f81-9e71-9524e08c6408 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:52.452248 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-397659f2-0b2a-4f81-9e71-9524e08c6408 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:52.453160 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-397659f2-0b2a-4f81-9e71-9524e08c6408 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:52.456307 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-397659f2-0b2a-4f81-9e71-9524e08c6408 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:52.537716 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-397659f2-0b2a-4f81-9e71-9524e08c6408 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Getting quotas for project 051e81fca8624d18b9415a46e158d243. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:52:52.560444 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-397659f2-0b2a-4f81-9e71-9524e08c6408 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Getting quotas for user 63998619bf654ebb8d74f91e42c8c780 and project 051e81fca8624d18b9415a46e158d243. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:52:52.593700 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-397659f2-0b2a-4f81-9e71-9524e08c6408 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:52:52.599837 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-397659f2-0b2a-4f81-9e71-9524e08c6408 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] [instance: 5219baf4-bfde-4037-a511-88ff2690ea6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:52:52.742294 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-397659f2-0b2a-4f81-9e71-9524e08c6408 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.147504 Sep 16 12:52:52.742949 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 956/1871] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:52:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:52:52.757534 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-0d37ad0f-d1c1-402d-a186-090b8fc1cce8 req-7b2ce04e-e97c-4f61-9ee7-e82f5970cb0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1afdaec3-fdf0-4eac-a324-c0f8eaa6797b", "name": "network-vif-plugged", "status": "completed", "tag": "bf12465f-8132-474a-94b1-e3b53f03df41"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:52:52.788197 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0d37ad0f-d1c1-402d-a186-090b8fc1cce8 req-7b2ce04e-e97c-4f61-9ee7-e82f5970cb0d service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:52.791556 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0d37ad0f-d1c1-402d-a186-090b8fc1cce8 req-7b2ce04e-e97c-4f61-9ee7-e82f5970cb0d service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:52.792290 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0d37ad0f-d1c1-402d-a186-090b8fc1cce8 req-7b2ce04e-e97c-4f61-9ee7-e82f5970cb0d service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:52.839271 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-0d37ad0f-d1c1-402d-a186-090b8fc1cce8 req-7b2ce04e-e97c-4f61-9ee7-e82f5970cb0d service nova] Creating event network-vif-plugged:bf12465f-8132-474a-94b1-e3b53f03df41 for instance 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b on n-h1-858094-4 Sep 16 12:52:52.855367 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [req-0d37ad0f-d1c1-402d-a186-090b8fc1cce8 req-7b2ce04e-e97c-4f61-9ee7-e82f5970cb0d service nova] Instance 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858094-4', 'n-h2-858094-4'} {{(pid=128779) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 12:52:52.871301 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-0d37ad0f-d1c1-402d-a186-090b8fc1cce8 req-7b2ce04e-e97c-4f61-9ee7-e82f5970cb0d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126670 Sep 16 12:52:52.872757 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 957/1872] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:52:53.183139 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f4d27708-8267-48ec-95ec-add55f2009b2 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1846994030", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": [{"uuid": "6b075bdd-1414-4e77-8147-4734221b7be7"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:52:53.299830 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-f4d27708-8267-48ec-95ec-add55f2009b2 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] validate_networks() for [('6b075bdd-1414-4e77-8147-4734221b7be7', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:52:54.695514 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-f4d27708-8267-48ec-95ec-add55f2009b2 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:52:54.695514 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-f4d27708-8267-48ec-95ec-add55f2009b2 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:52:54.696271 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-f4d27708-8267-48ec-95ec-add55f2009b2 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:52:54.696388 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-f4d27708-8267-48ec-95ec-add55f2009b2 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:52:54.697320 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-f4d27708-8267-48ec-95ec-add55f2009b2 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:52:54.715356 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4d27708-8267-48ec-95ec-add55f2009b2 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:54.715845 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4d27708-8267-48ec-95ec-add55f2009b2 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:54.716310 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4d27708-8267-48ec-95ec-add55f2009b2 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:54.717137 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4d27708-8267-48ec-95ec-add55f2009b2 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:54.717483 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4d27708-8267-48ec-95ec-add55f2009b2 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:54.717905 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4d27708-8267-48ec-95ec-add55f2009b2 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:54.742348 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b8d5c6a8-b08e-47bf-abe6-62069184ed4d tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933/action" status: 202 len: 0 microversion: 2.25 time: 3.574036 Sep 16 12:52:54.743056 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 916/1873] 10.222.0.67 () {62 vars in 1319 bytes} [Fri Sep 16 12:52:51 2022] POST /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933/action => generated 0 bytes in 3576 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 16 12:52:54.749973 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a4a1bc47-6313-412a-be97-d3e91abeb20e tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '.version_select at 0x7f1039abce50>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:54.769029 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-f4d27708-8267-48ec-95ec-add55f2009b2 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Getting quotas for project b10cd073476b420c89d93ce9c5a608c5. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:52:54.783886 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-f4d27708-8267-48ec-95ec-add55f2009b2 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Getting quotas for user 59c5683ddbb047348d4924b7ce957472 and project b10cd073476b420c89d93ce9c5a608c5. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:52:54.813972 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f4d27708-8267-48ec-95ec-add55f2009b2 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:52:54.816636 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f4d27708-8267-48ec-95ec-add55f2009b2 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] [instance: e8c8969d-7c0d-4bfe-bd49-6271193614b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:52:54.891343 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a4a1bc47-6313-412a-be97-d3e91abeb20e tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/images/a14d99e9-0c3f-4440-a1b8-2513d1ea03c3" status: 200 len: 1424 microversion: 2.1 time: 0.142076 Sep 16 12:52:54.898996 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 917/1874] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:52:54 2022] GET /compute/v2.1/images/a14d99e9-0c3f-4440-a1b8-2513d1ea03c3 => generated 1424 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:54.925033 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6516ba54-400f-4fce-86f1-4b306c339d6f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:54.939396 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f4d27708-8267-48ec-95ec-add55f2009b2 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.064313 Sep 16 12:52:54.945267 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 958/1875] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:52:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:52:54.951409 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6516ba54-400f-4fce-86f1-4b306c339d6f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:54.968143 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3e2868d6-251b-4324-a40b-dc98f3e89e94 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:54.969922 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3e2868d6-251b-4324-a40b-dc98f3e89e94 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 5c161179-0b93-4676-86f7-2f507a3ebeb3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:54.998542 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e2868d6-251b-4324-a40b-dc98f3e89e94 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:55.003090 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e2868d6-251b-4324-a40b-dc98f3e89e94 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:55.004472 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e2868d6-251b-4324-a40b-dc98f3e89e94 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:55.007097 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e2868d6-251b-4324-a40b-dc98f3e89e94 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:55.008022 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e2868d6-251b-4324-a40b-dc98f3e89e94 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:55.013882 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e2868d6-251b-4324-a40b-dc98f3e89e94 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:55.021219 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6516ba54-400f-4fce-86f1-4b306c339d6f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:55.022931 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6516ba54-400f-4fce-86f1-4b306c339d6f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:55.023410 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6516ba54-400f-4fce-86f1-4b306c339d6f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:55.027286 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6516ba54-400f-4fce-86f1-4b306c339d6f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:55.027779 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6516ba54-400f-4fce-86f1-4b306c339d6f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:55.028256 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6516ba54-400f-4fce-86f1-4b306c339d6f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:55.366230 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6516ba54-400f-4fce-86f1-4b306c339d6f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:55.387301 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6516ba54-400f-4fce-86f1-4b306c339d6f tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1470 microversion: 2.1 time: 0.480655 Sep 16 12:52:55.392155 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 918/1876] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:54 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1470 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:55.393128 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3e2868d6-251b-4324-a40b-dc98f3e89e94 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9101f5af9e34d21bb8e872d337d3545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e41136645964ea98a675833bd73299f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:55.402012 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3e2868d6-251b-4324-a40b-dc98f3e89e94 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3" status: 200 len: 1323 microversion: 2.1 time: 0.455669 Sep 16 12:52:55.402210 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8006d70a-930e-4f76-bdd9-d1684f7718c4 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-805947393", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:52:55.418441 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 959/1877] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:54 2022] GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3 => generated 1323 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:55.427936 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e75d1286-c7e1-4c8d-b9db-22cf0020fd3e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:55.430534 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e75d1286-c7e1-4c8d-b9db-22cf0020fd3e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 4fbd6b22-2181-4786-9116-a8c8eafb9933] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:55.469418 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e75d1286-c7e1-4c8d-b9db-22cf0020fd3e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:55.472610 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e75d1286-c7e1-4c8d-b9db-22cf0020fd3e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:55.476153 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e75d1286-c7e1-4c8d-b9db-22cf0020fd3e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:55.483758 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e75d1286-c7e1-4c8d-b9db-22cf0020fd3e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:55.488910 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e75d1286-c7e1-4c8d-b9db-22cf0020fd3e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:55.490199 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e75d1286-c7e1-4c8d-b9db-22cf0020fd3e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:55.530155 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-8006d70a-930e-4f76-bdd9-d1684f7718c4 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] validate_networks() for None {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:52:56.055841 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e75d1286-c7e1-4c8d-b9db-22cf0020fd3e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:56.077511 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e75d1286-c7e1-4c8d-b9db-22cf0020fd3e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:56.085909 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e75d1286-c7e1-4c8d-b9db-22cf0020fd3e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:56.112440 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e75d1286-c7e1-4c8d-b9db-22cf0020fd3e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933" status: 200 len: 1569 microversion: 2.25 time: 0.680071 Sep 16 12:52:56.113825 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 960/1878] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:52:55 2022] GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933 => generated 1569 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:52:56.139272 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-775cb8df-7b2e-4e75-bfbe-14283e520286 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:56.144253 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-775cb8df-7b2e-4e75-bfbe-14283e520286 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] [instance: e8c8969d-7c0d-4bfe-bd49-6271193614b9] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:56.167496 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-775cb8df-7b2e-4e75-bfbe-14283e520286 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:56.169690 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-775cb8df-7b2e-4e75-bfbe-14283e520286 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:56.170785 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-775cb8df-7b2e-4e75-bfbe-14283e520286 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:56.173829 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-775cb8df-7b2e-4e75-bfbe-14283e520286 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:56.174745 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-775cb8df-7b2e-4e75-bfbe-14283e520286 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:56.175962 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-775cb8df-7b2e-4e75-bfbe-14283e520286 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:56.502531 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-775cb8df-7b2e-4e75-bfbe-14283e520286 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c5683ddbb047348d4924b7ce957472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10cd073476b420c89d93ce9c5a608c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:56.514992 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-775cb8df-7b2e-4e75-bfbe-14283e520286 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] 10.222.0.67 "GET /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9" status: 200 len: 1220 microversion: 2.1 time: 0.399536 Sep 16 12:52:56.533995 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 961/1879] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:56 2022] GET /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9 => generated 1220 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:56.540025 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-8006d70a-930e-4f76-bdd9-d1684f7718c4 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:52:56.541009 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-8006d70a-930e-4f76-bdd9-d1684f7718c4 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:52:56.541661 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-8006d70a-930e-4f76-bdd9-d1684f7718c4 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:52:56.542074 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-8006d70a-930e-4f76-bdd9-d1684f7718c4 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:52:56.542481 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-8006d70a-930e-4f76-bdd9-d1684f7718c4 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:52:56.544770 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:52:56.554223 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-65a88274-6ab7-43f6-b6c4-5e0c12e68c7e tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '.version_select at 0x7f1035181ca0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:56.568506 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8006d70a-930e-4f76-bdd9-d1684f7718c4 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:56.569878 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8006d70a-930e-4f76-bdd9-d1684f7718c4 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:56.570494 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8006d70a-930e-4f76-bdd9-d1684f7718c4 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:56.571455 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8006d70a-930e-4f76-bdd9-d1684f7718c4 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:56.572412 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8006d70a-930e-4f76-bdd9-d1684f7718c4 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:56.573011 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8006d70a-930e-4f76-bdd9-d1684f7718c4 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:56.619473 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-8006d70a-930e-4f76-bdd9-d1684f7718c4 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Getting quotas for project 051e81fca8624d18b9415a46e158d243. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:52:56.644505 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-8006d70a-930e-4f76-bdd9-d1684f7718c4 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Getting quotas for user 63998619bf654ebb8d74f91e42c8c780 and project 051e81fca8624d18b9415a46e158d243. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:52:56.662505 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-65a88274-6ab7-43f6-b6c4-5e0c12e68c7e tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/images/a14d99e9-0c3f-4440-a1b8-2513d1ea03c3" status: 200 len: 1424 microversion: 2.1 time: 0.127099 Sep 16 12:52:56.665070 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 962/1880] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:52:56 2022] GET /compute/v2.1/images/a14d99e9-0c3f-4440-a1b8-2513d1ea03c3 => generated 1424 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:56.685496 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e9e9fe23-213b-45ba-83c1-deb9c62e6006 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:56.686122 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e9e9fe23-213b-45ba-83c1-deb9c62e6006 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:56.698074 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8006d70a-930e-4f76-bdd9-d1684f7718c4 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:52:56.707760 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9e9fe23-213b-45ba-83c1-deb9c62e6006 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:56.707987 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8006d70a-930e-4f76-bdd9-d1684f7718c4 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] [instance: c97d5f35-6ea1-4ec7-88f5-9da9dbe81182] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:52:56.716636 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9e9fe23-213b-45ba-83c1-deb9c62e6006 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:56.719548 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9e9fe23-213b-45ba-83c1-deb9c62e6006 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:56.720818 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9e9fe23-213b-45ba-83c1-deb9c62e6006 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:56.721897 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9e9fe23-213b-45ba-83c1-deb9c62e6006 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:56.722507 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9e9fe23-213b-45ba-83c1-deb9c62e6006 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:56.832696 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8006d70a-930e-4f76-bdd9-d1684f7718c4 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.436543 Sep 16 12:52:56.833970 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 919/1881] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:52:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:52:56.865452 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f3d8d495-0fc1-4943-a44d-4ca6acc019fd tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:56.873287 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f3d8d495-0fc1-4943-a44d-4ca6acc019fd tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 5c161179-0b93-4676-86f7-2f507a3ebeb3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:56.893914 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f3d8d495-0fc1-4943-a44d-4ca6acc019fd tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:56.898193 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f3d8d495-0fc1-4943-a44d-4ca6acc019fd tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:56.899110 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f3d8d495-0fc1-4943-a44d-4ca6acc019fd tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:56.902535 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f3d8d495-0fc1-4943-a44d-4ca6acc019fd tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:56.905201 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f3d8d495-0fc1-4943-a44d-4ca6acc019fd tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:56.907051 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f3d8d495-0fc1-4943-a44d-4ca6acc019fd tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:56.945944 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:52:59.356426 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e9e9fe23-213b-45ba-83c1-deb9c62e6006 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:52:59.384323 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e9e9fe23-213b-45ba-83c1-deb9c62e6006 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1470 microversion: 2.1 time: 2.717371 Sep 16 12:52:59.385249 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 963/1882] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:56 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1470 bytes in 2719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:52:59.390647 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9bcb9dbf-12cc-4eda-85de-c412c8e7710e tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:52:59.399890 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9bcb9dbf-12cc-4eda-85de-c412c8e7710e tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] [instance: c97d5f35-6ea1-4ec7-88f5-9da9dbe81182] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:52:59.438026 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9bcb9dbf-12cc-4eda-85de-c412c8e7710e tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:59.443798 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9bcb9dbf-12cc-4eda-85de-c412c8e7710e tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:59.444646 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9bcb9dbf-12cc-4eda-85de-c412c8e7710e tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:52:59.445650 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9bcb9dbf-12cc-4eda-85de-c412c8e7710e tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:52:59.454185 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9bcb9dbf-12cc-4eda-85de-c412c8e7710e tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:52:59.455157 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9bcb9dbf-12cc-4eda-85de-c412c8e7710e tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:00.074825 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9bcb9dbf-12cc-4eda-85de-c412c8e7710e tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63998619bf654ebb8d74f91e42c8c780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e81fca8624d18b9415a46e158d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:00.100022 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9bcb9dbf-12cc-4eda-85de-c412c8e7710e tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182" status: 200 len: 1269 microversion: 2.1 time: 0.713247 Sep 16 12:53:00.102452 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 964/1883] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:59 2022] GET /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182 => generated 1269 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:00.123294 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-34e23b7d-8650-4a9f-aa2c-2fe13bb1edf9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:00.130463 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-34e23b7d-8650-4a9f-aa2c-2fe13bb1edf9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 4fbd6b22-2181-4786-9116-a8c8eafb9933] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:00.153346 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34e23b7d-8650-4a9f-aa2c-2fe13bb1edf9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:00.173798 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34e23b7d-8650-4a9f-aa2c-2fe13bb1edf9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:00.176728 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34e23b7d-8650-4a9f-aa2c-2fe13bb1edf9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:00.177797 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34e23b7d-8650-4a9f-aa2c-2fe13bb1edf9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:00.180329 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34e23b7d-8650-4a9f-aa2c-2fe13bb1edf9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:00.182269 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34e23b7d-8650-4a9f-aa2c-2fe13bb1edf9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:00.666702 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f3d8d495-0fc1-4943-a44d-4ca6acc019fd tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9101f5af9e34d21bb8e872d337d3545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e41136645964ea98a675833bd73299f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:00.676703 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f3d8d495-0fc1-4943-a44d-4ca6acc019fd tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3" status: 200 len: 1323 microversion: 2.1 time: 3.839401 Sep 16 12:53:00.697378 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 920/1884] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:52:56 2022] GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3 => generated 1323 bytes in 3861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:00.722676 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1ab61745-b297-4163-a89c-7cf1ece53b50 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:00.723607 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-1ab61745-b297-4163-a89c-7cf1ece53b50 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] [instance: e8c8969d-7c0d-4bfe-bd49-6271193614b9] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:00.744546 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1ab61745-b297-4163-a89c-7cf1ece53b50 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:00.745261 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1ab61745-b297-4163-a89c-7cf1ece53b50 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:00.745931 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1ab61745-b297-4163-a89c-7cf1ece53b50 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:00.746853 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1ab61745-b297-4163-a89c-7cf1ece53b50 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:00.748024 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1ab61745-b297-4163-a89c-7cf1ece53b50 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:00.749858 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1ab61745-b297-4163-a89c-7cf1ece53b50 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:01.045970 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1ab61745-b297-4163-a89c-7cf1ece53b50 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c5683ddbb047348d4924b7ce957472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10cd073476b420c89d93ce9c5a608c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:01.058792 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1ab61745-b297-4163-a89c-7cf1ece53b50 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] 10.222.0.67 "GET /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9" status: 200 len: 1274 microversion: 2.1 time: 0.360205 Sep 16 12:53:01.064227 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 921/1885] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:00 2022] GET /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9 => generated 1274 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:01.095496 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3fa8a1cd-6317-47f1-b1bb-25de198fcfea tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '.version_select at 0x7f1034e66310>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:01.752505 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-34e23b7d-8650-4a9f-aa2c-2fe13bb1edf9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:01.788682 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-34e23b7d-8650-4a9f-aa2c-2fe13bb1edf9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:01.790907 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-34e23b7d-8650-4a9f-aa2c-2fe13bb1edf9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:01.792149 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-34e23b7d-8650-4a9f-aa2c-2fe13bb1edf9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933" status: 200 len: 1569 microversion: 2.25 time: 1.687221 Sep 16 12:53:01.792745 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 965/1886] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:53:00 2022] GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933 => generated 1569 bytes in 1688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:53:01.851558 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9e08c161-85e3-4b79-9ff8-fefa13b013b0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:01.852718 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9e08c161-85e3-4b79-9ff8-fefa13b013b0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:01.882541 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e08c161-85e3-4b79-9ff8-fefa13b013b0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:01.887002 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e08c161-85e3-4b79-9ff8-fefa13b013b0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:01.887785 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e08c161-85e3-4b79-9ff8-fefa13b013b0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:01.888809 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e08c161-85e3-4b79-9ff8-fefa13b013b0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:01.891491 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e08c161-85e3-4b79-9ff8-fefa13b013b0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:01.892213 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e08c161-85e3-4b79-9ff8-fefa13b013b0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:03.349063 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9e08c161-85e3-4b79-9ff8-fefa13b013b0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:03.359646 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9e08c161-85e3-4b79-9ff8-fefa13b013b0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1470 microversion: 2.1 time: 1.528018 Sep 16 12:53:03.360300 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 966/1887] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:01 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1470 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:03.374312 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-1d05c428-3ed1-4875-a66b-651aacdbb670 req-688825c9-13f8-4bd3-9d6e-294121bce285 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1afdaec3-fdf0-4eac-a324-c0f8eaa6797b", "name": "network-vif-unplugged", "status": "completed", "tag": "bf12465f-8132-474a-94b1-e3b53f03df41"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:03.411776 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1d05c428-3ed1-4875-a66b-651aacdbb670 req-688825c9-13f8-4bd3-9d6e-294121bce285 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:03.414173 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1d05c428-3ed1-4875-a66b-651aacdbb670 req-688825c9-13f8-4bd3-9d6e-294121bce285 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:03.419338 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1d05c428-3ed1-4875-a66b-651aacdbb670 req-688825c9-13f8-4bd3-9d6e-294121bce285 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:03.444846 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-1d05c428-3ed1-4875-a66b-651aacdbb670 req-688825c9-13f8-4bd3-9d6e-294121bce285 service nova] Creating event network-vif-unplugged:bf12465f-8132-474a-94b1-e3b53f03df41 for instance 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b on n-h2-858094-4 Sep 16 12:53:03.453130 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [req-1d05c428-3ed1-4875-a66b-651aacdbb670 req-688825c9-13f8-4bd3-9d6e-294121bce285 service nova] Instance 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858094-4', 'n-h2-858094-4'} {{(pid=128779) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 12:53:03.469004 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-1d05c428-3ed1-4875-a66b-651aacdbb670 req-688825c9-13f8-4bd3-9d6e-294121bce285 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107456 Sep 16 12:53:03.470178 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 967/1888] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:53:03.476682 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f9413051-cc38-4231-aee7-634d37621f8b tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:03.477630 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f9413051-cc38-4231-aee7-634d37621f8b tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] [instance: c97d5f35-6ea1-4ec7-88f5-9da9dbe81182] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:03.484848 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9413051-cc38-4231-aee7-634d37621f8b tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:03.485675 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9413051-cc38-4231-aee7-634d37621f8b tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:03.486272 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9413051-cc38-4231-aee7-634d37621f8b tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:03.487139 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9413051-cc38-4231-aee7-634d37621f8b tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:03.488331 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9413051-cc38-4231-aee7-634d37621f8b tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:03.488924 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9413051-cc38-4231-aee7-634d37621f8b tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:03.811377 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f9413051-cc38-4231-aee7-634d37621f8b tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63998619bf654ebb8d74f91e42c8c780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e81fca8624d18b9415a46e158d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:03.821780 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f9413051-cc38-4231-aee7-634d37621f8b tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182" status: 200 len: 1275 microversion: 2.1 time: 0.350005 Sep 16 12:53:03.822384 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 968/1889] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:03 2022] GET /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182 => generated 1275 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:03.850845 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-d08ae712-7064-4146-a11c-60fb3d3bcc32 req-c4aa9d7c-f4e9-42fe-a23e-525aa67b2f98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "345ee81d-c503-421c-90ea-218ac1c98600", "name": "network-vif-plugged", "status": "completed", "tag": "56c49806-0b21-4f4b-9b96-195fc33fcba5"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:03.872996 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d08ae712-7064-4146-a11c-60fb3d3bcc32 req-c4aa9d7c-f4e9-42fe-a23e-525aa67b2f98 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:03.874385 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d08ae712-7064-4146-a11c-60fb3d3bcc32 req-c4aa9d7c-f4e9-42fe-a23e-525aa67b2f98 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:03.875793 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d08ae712-7064-4146-a11c-60fb3d3bcc32 req-c4aa9d7c-f4e9-42fe-a23e-525aa67b2f98 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:03.907882 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-d08ae712-7064-4146-a11c-60fb3d3bcc32 req-c4aa9d7c-f4e9-42fe-a23e-525aa67b2f98 service nova] Creating event network-vif-plugged:56c49806-0b21-4f4b-9b96-195fc33fcba5 for instance 345ee81d-c503-421c-90ea-218ac1c98600 on n-h1-858094-4 Sep 16 12:53:03.918166 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-d08ae712-7064-4146-a11c-60fb3d3bcc32 req-c4aa9d7c-f4e9-42fe-a23e-525aa67b2f98 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071055 Sep 16 12:53:03.919452 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 969/1890] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:53:03.935896 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6c8fc8e8-be27-40dc-8072-a9f34728b9a3 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:03.936679 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6c8fc8e8-be27-40dc-8072-a9f34728b9a3 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 5c161179-0b93-4676-86f7-2f507a3ebeb3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:03.949341 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c8fc8e8-be27-40dc-8072-a9f34728b9a3 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:03.950045 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c8fc8e8-be27-40dc-8072-a9f34728b9a3 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:03.950719 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c8fc8e8-be27-40dc-8072-a9f34728b9a3 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:03.953712 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c8fc8e8-be27-40dc-8072-a9f34728b9a3 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:03.956316 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c8fc8e8-be27-40dc-8072-a9f34728b9a3 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:03.957158 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c8fc8e8-be27-40dc-8072-a9f34728b9a3 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:04.497680 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3fa8a1cd-6317-47f1-b1bb-25de198fcfea tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/images/a14d99e9-0c3f-4440-a1b8-2513d1ea03c3" status: 200 len: 1424 microversion: 2.1 time: 3.426501 Sep 16 12:53:04.499479 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 922/1891] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:53:01 2022] GET /compute/v2.1/images/a14d99e9-0c3f-4440-a1b8-2513d1ea03c3 => generated 1424 bytes in 3434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:04.509784 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6e8dcf54-ad7f-4353-bb4e-675394cc85d0 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:04.514516 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6e8dcf54-ad7f-4353-bb4e-675394cc85d0 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] [instance: e8c8969d-7c0d-4bfe-bd49-6271193614b9] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:04.532503 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6e8dcf54-ad7f-4353-bb4e-675394cc85d0 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:04.533409 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6e8dcf54-ad7f-4353-bb4e-675394cc85d0 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:04.534147 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6e8dcf54-ad7f-4353-bb4e-675394cc85d0 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:04.535672 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6e8dcf54-ad7f-4353-bb4e-675394cc85d0 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:04.536387 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6e8dcf54-ad7f-4353-bb4e-675394cc85d0 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:04.537096 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6e8dcf54-ad7f-4353-bb4e-675394cc85d0 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:04.747137 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:53:04.776241 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6e8dcf54-ad7f-4353-bb4e-675394cc85d0 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c5683ddbb047348d4924b7ce957472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10cd073476b420c89d93ce9c5a608c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:04.790199 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6e8dcf54-ad7f-4353-bb4e-675394cc85d0 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] 10.222.0.67 "GET /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9" status: 200 len: 1274 microversion: 2.1 time: 0.288348 Sep 16 12:53:04.791761 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 923/1892] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:04 2022] GET /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9 => generated 1274 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:04.798448 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=12 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:53:04.801488 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5de98b28-ab0a-4369-869c-9a0f030005dd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:04.803655 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5de98b28-ab0a-4369-869c-9a0f030005dd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 4fbd6b22-2181-4786-9116-a8c8eafb9933] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:04.826203 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5de98b28-ab0a-4369-869c-9a0f030005dd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:04.829759 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5de98b28-ab0a-4369-869c-9a0f030005dd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:04.834320 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5de98b28-ab0a-4369-869c-9a0f030005dd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:04.836251 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5de98b28-ab0a-4369-869c-9a0f030005dd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:04.837108 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5de98b28-ab0a-4369-869c-9a0f030005dd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:04.838919 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5de98b28-ab0a-4369-869c-9a0f030005dd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:05.593022 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6c8fc8e8-be27-40dc-8072-a9f34728b9a3 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9101f5af9e34d21bb8e872d337d3545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e41136645964ea98a675833bd73299f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:05.606815 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6c8fc8e8-be27-40dc-8072-a9f34728b9a3 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3" status: 200 len: 1323 microversion: 2.1 time: 1.677847 Sep 16 12:53:05.608293 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 970/1893] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:03 2022] GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3 => generated 1323 bytes in 1688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:05.617359 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e83068f8-8925-412a-8093-958d1304a535 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:05.621132 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e83068f8-8925-412a-8093-958d1304a535 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:05.634239 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e83068f8-8925-412a-8093-958d1304a535 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:05.636651 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e83068f8-8925-412a-8093-958d1304a535 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:05.637210 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e83068f8-8925-412a-8093-958d1304a535 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:05.638042 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e83068f8-8925-412a-8093-958d1304a535 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:05.645187 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e83068f8-8925-412a-8093-958d1304a535 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:05.645988 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e83068f8-8925-412a-8093-958d1304a535 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:05.694686 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:53:06.158004 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5de98b28-ab0a-4369-869c-9a0f030005dd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:06.176943 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5de98b28-ab0a-4369-869c-9a0f030005dd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:06.178733 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5de98b28-ab0a-4369-869c-9a0f030005dd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:06.180309 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5de98b28-ab0a-4369-869c-9a0f030005dd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933" status: 200 len: 1569 microversion: 2.25 time: 1.386345 Sep 16 12:53:06.193378 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 924/1894] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:53:04 2022] GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933 => generated 1569 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:53:06.205919 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-48172eab-06b2-4ecb-a95b-1fe2c3849c3b tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:06.206556 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-48172eab-06b2-4ecb-a95b-1fe2c3849c3b tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] [instance: c97d5f35-6ea1-4ec7-88f5-9da9dbe81182] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:06.214333 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-48172eab-06b2-4ecb-a95b-1fe2c3849c3b tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:06.215163 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-48172eab-06b2-4ecb-a95b-1fe2c3849c3b tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:06.215791 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-48172eab-06b2-4ecb-a95b-1fe2c3849c3b tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:06.216889 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-48172eab-06b2-4ecb-a95b-1fe2c3849c3b tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:06.217178 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-48172eab-06b2-4ecb-a95b-1fe2c3849c3b tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:06.217597 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-48172eab-06b2-4ecb-a95b-1fe2c3849c3b tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:06.476797 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e83068f8-8925-412a-8093-958d1304a535 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:06.495557 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e83068f8-8925-412a-8093-958d1304a535 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1470 microversion: 2.1 time: 0.881888 Sep 16 12:53:06.496964 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 971/1895] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:05 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1470 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:06.511479 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-987307d0-bc6e-430f-9434-cd8a055fce10 req-cd93cdd2-728a-41e1-8ad3-e863a92c2052 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fbd6b22-2181-4786-9116-a8c8eafb9933", "name": "network-vif-unplugged", "status": "completed", "tag": "c56b7ce5-25b3-4ac0-bcbf-28e9db2c0185"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:06.536290 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-987307d0-bc6e-430f-9434-cd8a055fce10 req-cd93cdd2-728a-41e1-8ad3-e863a92c2052 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:06.537438 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-987307d0-bc6e-430f-9434-cd8a055fce10 req-cd93cdd2-728a-41e1-8ad3-e863a92c2052 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:06.538001 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-987307d0-bc6e-430f-9434-cd8a055fce10 req-cd93cdd2-728a-41e1-8ad3-e863a92c2052 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:06.551989 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-987307d0-bc6e-430f-9434-cd8a055fce10 req-cd93cdd2-728a-41e1-8ad3-e863a92c2052 service nova] Creating event network-vif-unplugged:c56b7ce5-25b3-4ac0-bcbf-28e9db2c0185 for instance 4fbd6b22-2181-4786-9116-a8c8eafb9933 on n-h2-858094-4 Sep 16 12:53:06.558500 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-987307d0-bc6e-430f-9434-cd8a055fce10 req-cd93cdd2-728a-41e1-8ad3-e863a92c2052 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058960 Sep 16 12:53:06.560772 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 972/1896] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:53:06.568619 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-861b4e20-8307-4f9c-8073-cf3a2a8adc09 req-c06720ca-3286-45fc-889a-9326f7f9b3ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5219baf4-bfde-4037-a511-88ff2690ea6a", "tag": "537bc282-546d-4a7e-b32f-2149067cc012"}, {"name": "network-changed", "server_uuid": "1afdaec3-fdf0-4eac-a324-c0f8eaa6797b", "tag": "bf12465f-8132-474a-94b1-e3b53f03df41"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:06.580103 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=4 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:53:06.583019 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-861b4e20-8307-4f9c-8073-cf3a2a8adc09 req-c06720ca-3286-45fc-889a-9326f7f9b3ad service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:06.584157 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-861b4e20-8307-4f9c-8073-cf3a2a8adc09 req-c06720ca-3286-45fc-889a-9326f7f9b3ad service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:06.584868 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-861b4e20-8307-4f9c-8073-cf3a2a8adc09 req-c06720ca-3286-45fc-889a-9326f7f9b3ad service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:06.621424 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-861b4e20-8307-4f9c-8073-cf3a2a8adc09 req-c06720ca-3286-45fc-889a-9326f7f9b3ad service nova] Creating event network-changed:537bc282-546d-4a7e-b32f-2149067cc012 for instance 5219baf4-bfde-4037-a511-88ff2690ea6a on n-h2-858094-4 Sep 16 12:53:06.624734 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-861b4e20-8307-4f9c-8073-cf3a2a8adc09 req-c06720ca-3286-45fc-889a-9326f7f9b3ad service nova] Creating event network-changed:bf12465f-8132-474a-94b1-e3b53f03df41 for instance 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b on n-h2-858094-4 Sep 16 12:53:06.633873 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [req-861b4e20-8307-4f9c-8073-cf3a2a8adc09 req-c06720ca-3286-45fc-889a-9326f7f9b3ad service nova] Instance 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858094-4', 'n-h2-858094-4'} {{(pid=128779) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 12:53:06.649436 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-861b4e20-8307-4f9c-8073-cf3a2a8adc09 req-c06720ca-3286-45fc-889a-9326f7f9b3ad service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.086512 Sep 16 12:53:06.650785 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 973/1897] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:53:06.652954 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=6 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:53:06.658369 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5923cf65-5850-43e4-aab8-2d356d39728b tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '.version_select at 0x7f103529a8b0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:06.746748 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5923cf65-5850-43e4-aab8-2d356d39728b tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/images/a14d99e9-0c3f-4440-a1b8-2513d1ea03c3" status: 200 len: 1424 microversion: 2.1 time: 0.094201 Sep 16 12:53:06.757948 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 974/1898] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:53:06 2022] GET /compute/v2.1/images/a14d99e9-0c3f-4440-a1b8-2513d1ea03c3 => generated 1424 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:06.771968 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ca3bea25-520b-4388-9650-854df379e1c5 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:06.774887 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ca3bea25-520b-4388-9650-854df379e1c5 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] [instance: e8c8969d-7c0d-4bfe-bd49-6271193614b9] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:06.794707 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca3bea25-520b-4388-9650-854df379e1c5 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:06.797525 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca3bea25-520b-4388-9650-854df379e1c5 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:06.798656 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca3bea25-520b-4388-9650-854df379e1c5 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:06.799613 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca3bea25-520b-4388-9650-854df379e1c5 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:06.802686 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca3bea25-520b-4388-9650-854df379e1c5 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:06.803383 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca3bea25-520b-4388-9650-854df379e1c5 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:07.121079 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-48172eab-06b2-4ecb-a95b-1fe2c3849c3b tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63998619bf654ebb8d74f91e42c8c780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e81fca8624d18b9415a46e158d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:07.143669 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-48172eab-06b2-4ecb-a95b-1fe2c3849c3b tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182" status: 200 len: 1317 microversion: 2.1 time: 0.939968 Sep 16 12:53:07.145014 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 925/1899] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:06 2022] GET /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182 => generated 1317 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:07.162679 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-80dc0a20-3891-44d1-8985-5eb0b2a232b8 req-72a32daf-3b28-42a0-9434-cd394564c9e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c161179-0b93-4676-86f7-2f507a3ebeb3", "name": "network-vif-plugged", "status": "completed", "tag": "d5a5f978-c5f0-4476-91cc-2b79e48ec4a7"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:07.204677 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-80dc0a20-3891-44d1-8985-5eb0b2a232b8 req-72a32daf-3b28-42a0-9434-cd394564c9e8 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:07.211286 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-80dc0a20-3891-44d1-8985-5eb0b2a232b8 req-72a32daf-3b28-42a0-9434-cd394564c9e8 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:07.212874 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-80dc0a20-3891-44d1-8985-5eb0b2a232b8 req-72a32daf-3b28-42a0-9434-cd394564c9e8 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:07.267884 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-80dc0a20-3891-44d1-8985-5eb0b2a232b8 req-72a32daf-3b28-42a0-9434-cd394564c9e8 service nova] Creating event network-vif-plugged:d5a5f978-c5f0-4476-91cc-2b79e48ec4a7 for instance 5c161179-0b93-4676-86f7-2f507a3ebeb3 on n-h1-858094-4 Sep 16 12:53:07.277242 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-80dc0a20-3891-44d1-8985-5eb0b2a232b8 req-72a32daf-3b28-42a0-9434-cd394564c9e8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126605 Sep 16 12:53:07.278745 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 926/1900] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:53:07.288974 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-92178a88-e251-4822-b610-ede1a2987b1a tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:07.291060 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-92178a88-e251-4822-b610-ede1a2987b1a tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 5c161179-0b93-4676-86f7-2f507a3ebeb3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:07.304757 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92178a88-e251-4822-b610-ede1a2987b1a tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:07.305907 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92178a88-e251-4822-b610-ede1a2987b1a tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:07.306547 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92178a88-e251-4822-b610-ede1a2987b1a tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:07.308685 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92178a88-e251-4822-b610-ede1a2987b1a tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:07.309353 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92178a88-e251-4822-b610-ede1a2987b1a tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:07.310061 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92178a88-e251-4822-b610-ede1a2987b1a tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:08.312774 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ca3bea25-520b-4388-9650-854df379e1c5 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c5683ddbb047348d4924b7ce957472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10cd073476b420c89d93ce9c5a608c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:08.321829 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ca3bea25-520b-4388-9650-854df379e1c5 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] 10.222.0.67 "GET /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9" status: 200 len: 1316 microversion: 2.1 time: 1.561358 Sep 16 12:53:08.337211 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 975/1901] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:06 2022] GET /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9 => generated 1316 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:08.360523 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-51badb95-5e81-423c-ae3d-42dec3602aec tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:08.361393 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-51badb95-5e81-423c-ae3d-42dec3602aec tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 4fbd6b22-2181-4786-9116-a8c8eafb9933] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:08.372999 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-51badb95-5e81-423c-ae3d-42dec3602aec tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:08.374697 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-51badb95-5e81-423c-ae3d-42dec3602aec tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:08.375328 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-51badb95-5e81-423c-ae3d-42dec3602aec tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:08.376260 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-51badb95-5e81-423c-ae3d-42dec3602aec tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:08.376896 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-51badb95-5e81-423c-ae3d-42dec3602aec tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:08.377490 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-51badb95-5e81-423c-ae3d-42dec3602aec tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:08.446408 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-92178a88-e251-4822-b610-ede1a2987b1a tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9101f5af9e34d21bb8e872d337d3545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e41136645964ea98a675833bd73299f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:08.456376 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-92178a88-e251-4822-b610-ede1a2987b1a tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3" status: 200 len: 1323 microversion: 2.1 time: 1.175933 Sep 16 12:53:08.457602 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 927/1902] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:07 2022] GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3 => generated 1323 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:08.464154 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-12cc0b72-1d22-497a-836c-80ae681c429c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:08.465114 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-12cc0b72-1d22-497a-836c-80ae681c429c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:08.472439 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-12cc0b72-1d22-497a-836c-80ae681c429c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:08.473212 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-12cc0b72-1d22-497a-836c-80ae681c429c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:08.473842 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-12cc0b72-1d22-497a-836c-80ae681c429c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:08.474932 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-12cc0b72-1d22-497a-836c-80ae681c429c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:08.477976 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-12cc0b72-1d22-497a-836c-80ae681c429c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:08.478906 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-12cc0b72-1d22-497a-836c-80ae681c429c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:09.929881 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-12cc0b72-1d22-497a-836c-80ae681c429c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:09.939085 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-12cc0b72-1d22-497a-836c-80ae681c429c tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1463 microversion: 2.1 time: 1.479709 Sep 16 12:53:09.944363 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 928/1903] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:08 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1463 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:09.950179 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-14e5780a-7060-457a-9232-3f8b70d04d30 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '.version_select at 0x7f1035b11af0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:10.023417 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-14e5780a-7060-457a-9232-3f8b70d04d30 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/images/a14d99e9-0c3f-4440-a1b8-2513d1ea03c3" status: 200 len: 1424 microversion: 2.1 time: 0.076921 Sep 16 12:53:10.034100 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 929/1904] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:53:09 2022] GET /compute/v2.1/images/a14d99e9-0c3f-4440-a1b8-2513d1ea03c3 => generated 1424 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:10.034100 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7141bfaa-c488-4f50-810f-3c416d798e89 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:10.034100 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7141bfaa-c488-4f50-810f-3c416d798e89 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] [instance: c97d5f35-6ea1-4ec7-88f5-9da9dbe81182] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:10.038791 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-51badb95-5e81-423c-ae3d-42dec3602aec tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:10.041687 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7141bfaa-c488-4f50-810f-3c416d798e89 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:10.042325 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7141bfaa-c488-4f50-810f-3c416d798e89 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:10.042863 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7141bfaa-c488-4f50-810f-3c416d798e89 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:10.043668 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7141bfaa-c488-4f50-810f-3c416d798e89 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:10.044422 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7141bfaa-c488-4f50-810f-3c416d798e89 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:10.045070 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7141bfaa-c488-4f50-810f-3c416d798e89 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:10.050538 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-51badb95-5e81-423c-ae3d-42dec3602aec tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:10.054200 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-51badb95-5e81-423c-ae3d-42dec3602aec tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:10.055896 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-51badb95-5e81-423c-ae3d-42dec3602aec tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933" status: 200 len: 1569 microversion: 2.25 time: 1.717335 Sep 16 12:53:10.057427 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 976/1905] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:53:08 2022] GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933 => generated 1569 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:53:10.063567 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-95c2b5d8-5feb-4cde-9802-068e295cfc16 req-4f618a47-03c2-41ab-aae1-fe0da726ebf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fbd6b22-2181-4786-9116-a8c8eafb9933", "tag": "c56b7ce5-25b3-4ac0-bcbf-28e9db2c0185"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:10.076940 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-95c2b5d8-5feb-4cde-9802-068e295cfc16 req-4f618a47-03c2-41ab-aae1-fe0da726ebf7 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:10.077813 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-95c2b5d8-5feb-4cde-9802-068e295cfc16 req-4f618a47-03c2-41ab-aae1-fe0da726ebf7 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:10.078621 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-95c2b5d8-5feb-4cde-9802-068e295cfc16 req-4f618a47-03c2-41ab-aae1-fe0da726ebf7 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:10.093397 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-95c2b5d8-5feb-4cde-9802-068e295cfc16 req-4f618a47-03c2-41ab-aae1-fe0da726ebf7 service nova] Creating event network-changed:c56b7ce5-25b3-4ac0-bcbf-28e9db2c0185 for instance 4fbd6b22-2181-4786-9116-a8c8eafb9933 on n-h2-858094-4 Sep 16 12:53:10.100841 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-95c2b5d8-5feb-4cde-9802-068e295cfc16 req-4f618a47-03c2-41ab-aae1-fe0da726ebf7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041898 Sep 16 12:53:10.102177 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 977/1906] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:53:10.108870 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a3ba5de9-49c1-4b9e-89d9-972a3864034c tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:10.109859 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a3ba5de9-49c1-4b9e-89d9-972a3864034c tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] [instance: e8c8969d-7c0d-4bfe-bd49-6271193614b9] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:10.136595 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3ba5de9-49c1-4b9e-89d9-972a3864034c tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:10.137349 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3ba5de9-49c1-4b9e-89d9-972a3864034c tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:10.138106 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3ba5de9-49c1-4b9e-89d9-972a3864034c tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:10.139376 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3ba5de9-49c1-4b9e-89d9-972a3864034c tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:10.142419 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3ba5de9-49c1-4b9e-89d9-972a3864034c tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:10.143066 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3ba5de9-49c1-4b9e-89d9-972a3864034c tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:11.387709 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a3ba5de9-49c1-4b9e-89d9-972a3864034c tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c5683ddbb047348d4924b7ce957472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10cd073476b420c89d93ce9c5a608c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:11.427522 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a3ba5de9-49c1-4b9e-89d9-972a3864034c tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] 10.222.0.67 "GET /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9" status: 200 len: 1316 microversion: 2.1 time: 1.323844 Sep 16 12:53:11.454289 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 978/1907] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:10 2022] GET /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9 => generated 1316 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:11.484660 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-144ea93e-5b90-4b28-821a-58c7cd495a35 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:11.485600 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-144ea93e-5b90-4b28-821a-58c7cd495a35 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 5c161179-0b93-4676-86f7-2f507a3ebeb3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:11.508590 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7141bfaa-c488-4f50-810f-3c416d798e89 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63998619bf654ebb8d74f91e42c8c780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e81fca8624d18b9415a46e158d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:11.519383 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7141bfaa-c488-4f50-810f-3c416d798e89 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182" status: 200 len: 1317 microversion: 2.1 time: 1.493638 Sep 16 12:53:11.523921 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 930/1908] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:10 2022] GET /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182 => generated 1317 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:11.525929 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-144ea93e-5b90-4b28-821a-58c7cd495a35 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:11.526447 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-144ea93e-5b90-4b28-821a-58c7cd495a35 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:11.526901 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-144ea93e-5b90-4b28-821a-58c7cd495a35 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:11.527628 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-144ea93e-5b90-4b28-821a-58c7cd495a35 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:11.528085 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-144ea93e-5b90-4b28-821a-58c7cd495a35 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:11.534811 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-abbe489c-e1a2-4137-9655-f0a99a264f25 req-1f3694c3-762d-4890-af9a-eb79b26109fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1afdaec3-fdf0-4eac-a324-c0f8eaa6797b", "name": "network-vif-plugged", "status": "completed", "tag": "bf12465f-8132-474a-94b1-e3b53f03df41"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:11.535529 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-144ea93e-5b90-4b28-821a-58c7cd495a35 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:11.559542 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-abbe489c-e1a2-4137-9655-f0a99a264f25 req-1f3694c3-762d-4890-af9a-eb79b26109fa service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:11.560041 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-abbe489c-e1a2-4137-9655-f0a99a264f25 req-1f3694c3-762d-4890-af9a-eb79b26109fa service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:11.560515 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-abbe489c-e1a2-4137-9655-f0a99a264f25 req-1f3694c3-762d-4890-af9a-eb79b26109fa service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:11.587746 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-abbe489c-e1a2-4137-9655-f0a99a264f25 req-1f3694c3-762d-4890-af9a-eb79b26109fa service nova] Creating event network-vif-plugged:bf12465f-8132-474a-94b1-e3b53f03df41 for instance 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b on n-h2-858094-4 Sep 16 12:53:11.614153 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-abbe489c-e1a2-4137-9655-f0a99a264f25 req-1f3694c3-762d-4890-af9a-eb79b26109fa service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082289 Sep 16 12:53:11.615272 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 931/1909] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:53:12.012055 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fd38e405-fc3e-4e63-ac5e-558ed4f2c7e7 tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:12.012807 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-fd38e405-fc3e-4e63-ac5e-558ed4f2c7e7 tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:12.026091 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fd38e405-fc3e-4e63-ac5e-558ed4f2c7e7 tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:12.026591 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fd38e405-fc3e-4e63-ac5e-558ed4f2c7e7 tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:12.033755 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fd38e405-fc3e-4e63-ac5e-558ed4f2c7e7 tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:12.038808 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fd38e405-fc3e-4e63-ac5e-558ed4f2c7e7 tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:12.039726 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fd38e405-fc3e-4e63-ac5e-558ed4f2c7e7 tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:12.043069 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fd38e405-fc3e-4e63-ac5e-558ed4f2c7e7 tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:12.467371 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-fd38e405-fc3e-4e63-ac5e-558ed4f2c7e7 tempest-MigrationsAdminTest-697105801 tempest-MigrationsAdminTest-697105801-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1614 microversion: 2.1 time: 0.850566 Sep 16 12:53:12.480629 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 932/1910] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:11 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1614 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:12.509634 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-580db87a-327a-4686-8bf9-a8d35d202189 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '.version_select at 0x7f1035ee3700>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:12.703400 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-580db87a-327a-4686-8bf9-a8d35d202189 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/images/a14d99e9-0c3f-4440-a1b8-2513d1ea03c3" status: 200 len: 1424 microversion: 2.1 time: 0.215901 Sep 16 12:53:12.704981 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 933/1911] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:53:12 2022] GET /compute/v2.1/images/a14d99e9-0c3f-4440-a1b8-2513d1ea03c3 => generated 1424 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:12.710575 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3bb2d4cf-f7ca-4ab6-8137-6dfb1d4f02bd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:12.711537 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3bb2d4cf-f7ca-4ab6-8137-6dfb1d4f02bd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 4fbd6b22-2181-4786-9116-a8c8eafb9933] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:12.724505 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3bb2d4cf-f7ca-4ab6-8137-6dfb1d4f02bd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:12.726181 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3bb2d4cf-f7ca-4ab6-8137-6dfb1d4f02bd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:12.727163 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3bb2d4cf-f7ca-4ab6-8137-6dfb1d4f02bd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:12.729691 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3bb2d4cf-f7ca-4ab6-8137-6dfb1d4f02bd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:12.730851 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3bb2d4cf-f7ca-4ab6-8137-6dfb1d4f02bd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:12.731844 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3bb2d4cf-f7ca-4ab6-8137-6dfb1d4f02bd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:12.786408 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-144ea93e-5b90-4b28-821a-58c7cd495a35 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9101f5af9e34d21bb8e872d337d3545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e41136645964ea98a675833bd73299f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:12.808601 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-144ea93e-5b90-4b28-821a-58c7cd495a35 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3" status: 200 len: 1520 microversion: 2.1 time: 1.352471 Sep 16 12:53:12.814595 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 979/1912] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:11 2022] GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3 => generated 1520 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:13.022558 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a0038227-55e9-4602-b83d-0b70babd594e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Action: 'create', calling method: .version_select at 0x7f103519b940>, body: {"keypair": {"name": "tempest-keypair-1009663872", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIS7YOtsvHjzsK/kb381hmUxhoE+TI7gkkRHbptuksp33I7MPQ8QXvA0azYq2jLAz+UWWHAUl/cGJsiGiVmH8TXe6i2xfyO2LoiDTNhcJ+t7PA+NrVwjzXDv7w/vqYvJtg=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:13.043031 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:53:13.070016 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-a0038227-55e9-4602-b83d-0b70babd594e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Getting quotas for project 7a67136b9d8041fd8e62a81be2d6b48d. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:53:13.088401 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-a0038227-55e9-4602-b83d-0b70babd594e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Getting quotas for user 65566509bf544a398cbb9c29ace613c5 and project 7a67136b9d8041fd8e62a81be2d6b48d. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:53:13.163901 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a0038227-55e9-4602-b83d-0b70babd594e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.347463 Sep 16 12:53:13.170615 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 980/1913] 10.222.0.67 () {60 vars in 1159 bytes} [Fri Sep 16 12:53:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:53:13.170615 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f6d5b23c-b13d-4fd1-b16e-ab95dbdff3ca tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:13.173813 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f6d5b23c-b13d-4fd1-b16e-ab95dbdff3ca tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] [instance: e8c8969d-7c0d-4bfe-bd49-6271193614b9] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:13.179367 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6d5b23c-b13d-4fd1-b16e-ab95dbdff3ca tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:13.179998 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6d5b23c-b13d-4fd1-b16e-ab95dbdff3ca tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:13.180576 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6d5b23c-b13d-4fd1-b16e-ab95dbdff3ca tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:13.181355 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6d5b23c-b13d-4fd1-b16e-ab95dbdff3ca tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:13.182200 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6d5b23c-b13d-4fd1-b16e-ab95dbdff3ca tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:13.182705 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6d5b23c-b13d-4fd1-b16e-ab95dbdff3ca tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:13.489819 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3bb2d4cf-f7ca-4ab6-8137-6dfb1d4f02bd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:13.519003 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3bb2d4cf-f7ca-4ab6-8137-6dfb1d4f02bd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:13.524894 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3bb2d4cf-f7ca-4ab6-8137-6dfb1d4f02bd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:13.529274 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3bb2d4cf-f7ca-4ab6-8137-6dfb1d4f02bd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933" status: 200 len: 1569 microversion: 2.25 time: 0.822903 Sep 16 12:53:13.558441 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 934/1914] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:53:12 2022] GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933 => generated 1569 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:53:13.582309 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-895e89d7-53a6-4736-b144-7257e3e1f51a tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:13.583163 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-895e89d7-53a6-4736-b144-7257e3e1f51a tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] [instance: c97d5f35-6ea1-4ec7-88f5-9da9dbe81182] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:13.614406 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-895e89d7-53a6-4736-b144-7257e3e1f51a tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:13.617326 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-895e89d7-53a6-4736-b144-7257e3e1f51a tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:13.618175 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-895e89d7-53a6-4736-b144-7257e3e1f51a tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:13.619576 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-895e89d7-53a6-4736-b144-7257e3e1f51a tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:13.620371 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-895e89d7-53a6-4736-b144-7257e3e1f51a tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:13.621103 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-895e89d7-53a6-4736-b144-7257e3e1f51a tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:13.715696 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f6d5b23c-b13d-4fd1-b16e-ab95dbdff3ca tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c5683ddbb047348d4924b7ce957472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10cd073476b420c89d93ce9c5a608c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:13.724256 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f6d5b23c-b13d-4fd1-b16e-ab95dbdff3ca tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] 10.222.0.67 "GET /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9" status: 200 len: 1316 microversion: 2.1 time: 0.557845 Sep 16 12:53:13.732272 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 981/1915] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:13 2022] GET /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9 => generated 1316 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:13.745616 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e60dfa26-ca4e-4a74-87e3-55751edcc273 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:13.746429 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e60dfa26-ca4e-4a74-87e3-55751edcc273 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:13.765682 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e60dfa26-ca4e-4a74-87e3-55751edcc273 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:13.766293 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e60dfa26-ca4e-4a74-87e3-55751edcc273 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:13.766941 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e60dfa26-ca4e-4a74-87e3-55751edcc273 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:13.769165 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e60dfa26-ca4e-4a74-87e3-55751edcc273 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:13.774601 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e60dfa26-ca4e-4a74-87e3-55751edcc273 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:13.775467 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e60dfa26-ca4e-4a74-87e3-55751edcc273 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:13.848749 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e60dfa26-ca4e-4a74-87e3-55751edcc273 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:53:14.054957 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-895e89d7-53a6-4736-b144-7257e3e1f51a tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63998619bf654ebb8d74f91e42c8c780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e81fca8624d18b9415a46e158d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:14.069913 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-895e89d7-53a6-4736-b144-7257e3e1f51a tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182" status: 200 len: 1317 microversion: 2.1 time: 0.506885 Sep 16 12:53:14.070520 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 935/1916] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:13 2022] GET /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182 => generated 1317 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:14.080991 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-468fe949-5d5f-4d09-9d73-3295e9175d3c tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Action: 'create', calling method: .version_select at 0x7f1039b00670>, body: {"pool": null} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:14.099538 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e60dfa26-ca4e-4a74-87e3-55751edcc273 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "DELETE /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 204 len: 0 microversion: 2.1 time: 0.364357 Sep 16 12:53:14.102156 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 982/1917] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:53:13 2022] DELETE /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:53:14.130160 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-dfaf4522-acec-4137-b5a7-bc11185d7650 req-7245eb38-8ce2-40b2-bdfc-7ed1d513ddc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c97d5f35-6ea1-4ec7-88f5-9da9dbe81182", "tag": "81054b4c-c45a-4833-ae83-e752ff18ff48"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:14.163287 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dfaf4522-acec-4137-b5a7-bc11185d7650 req-7245eb38-8ce2-40b2-bdfc-7ed1d513ddc8 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:14.163983 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dfaf4522-acec-4137-b5a7-bc11185d7650 req-7245eb38-8ce2-40b2-bdfc-7ed1d513ddc8 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:14.164230 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dfaf4522-acec-4137-b5a7-bc11185d7650 req-7245eb38-8ce2-40b2-bdfc-7ed1d513ddc8 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:14.199639 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-dfaf4522-acec-4137-b5a7-bc11185d7650 req-7245eb38-8ce2-40b2-bdfc-7ed1d513ddc8 service nova] Creating event network-changed:81054b4c-c45a-4833-ae83-e752ff18ff48 for instance c97d5f35-6ea1-4ec7-88f5-9da9dbe81182 on n-h1-858094-4 Sep 16 12:53:14.215389 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-dfaf4522-acec-4137-b5a7-bc11185d7650 req-7245eb38-8ce2-40b2-bdfc-7ed1d513ddc8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111564 Sep 16 12:53:14.216330 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 983/1918] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:53:14.228985 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-f244d214-100e-4461-ac3b-778c2f10ffd3 req-289bac43-b47d-4e30-8627-5ccde3075c86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5219baf4-bfde-4037-a511-88ff2690ea6a", "name": "network-vif-plugged", "status": "completed", "tag": "537bc282-546d-4a7e-b32f-2149067cc012"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:14.253333 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f244d214-100e-4461-ac3b-778c2f10ffd3 req-289bac43-b47d-4e30-8627-5ccde3075c86 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:14.255085 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f244d214-100e-4461-ac3b-778c2f10ffd3 req-289bac43-b47d-4e30-8627-5ccde3075c86 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:14.257654 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f244d214-100e-4461-ac3b-778c2f10ffd3 req-289bac43-b47d-4e30-8627-5ccde3075c86 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:14.285305 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-f244d214-100e-4461-ac3b-778c2f10ffd3 req-289bac43-b47d-4e30-8627-5ccde3075c86 service nova] Creating event network-vif-plugged:537bc282-546d-4a7e-b32f-2149067cc012 for instance 5219baf4-bfde-4037-a511-88ff2690ea6a on n-h2-858094-4 Sep 16 12:53:14.293910 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-f244d214-100e-4461-ac3b-778c2f10ffd3 req-289bac43-b47d-4e30-8627-5ccde3075c86 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076163 Sep 16 12:53:14.296514 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 984/1919] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:53:14.313983 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1c0eec85-650d-45aa-ab5e-2ab5d9a3b33a tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '.version_select at 0x7f103519b670>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:14.392103 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1c0eec85-650d-45aa-ab5e-2ab5d9a3b33a tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/images/a14d99e9-0c3f-4440-a1b8-2513d1ea03c3" status: 200 len: 1424 microversion: 2.1 time: 0.094332 Sep 16 12:53:14.393022 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 985/1920] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:53:14 2022] GET /compute/v2.1/images/a14d99e9-0c3f-4440-a1b8-2513d1ea03c3 => generated 1424 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:14.400979 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-962b6cd3-d7a7-44f2-bd2f-2a2c0e86b0f7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:14.401505 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-962b6cd3-d7a7-44f2-bd2f-2a2c0e86b0f7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:14.423636 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-962b6cd3-d7a7-44f2-bd2f-2a2c0e86b0f7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:14.424812 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-962b6cd3-d7a7-44f2-bd2f-2a2c0e86b0f7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:14.425272 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-962b6cd3-d7a7-44f2-bd2f-2a2c0e86b0f7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:14.426010 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-962b6cd3-d7a7-44f2-bd2f-2a2c0e86b0f7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:14.426469 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-962b6cd3-d7a7-44f2-bd2f-2a2c0e86b0f7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:14.427271 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-962b6cd3-d7a7-44f2-bd2f-2a2c0e86b0f7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:14.994484 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-962b6cd3-d7a7-44f2-bd2f-2a2c0e86b0f7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:15.013109 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-962b6cd3-d7a7-44f2-bd2f-2a2c0e86b0f7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1469 microversion: 2.1 time: 0.619014 Sep 16 12:53:15.013766 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 986/1921] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:14 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1469 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:15.024175 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c0a221c8-0b3f-47da-8a6b-b117ba80ce78 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:15.024924 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c0a221c8-0b3f-47da-8a6b-b117ba80ce78 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 4fbd6b22-2181-4786-9116-a8c8eafb9933] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:15.042554 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0a221c8-0b3f-47da-8a6b-b117ba80ce78 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:15.060040 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0a221c8-0b3f-47da-8a6b-b117ba80ce78 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:15.062446 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0a221c8-0b3f-47da-8a6b-b117ba80ce78 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:15.064407 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0a221c8-0b3f-47da-8a6b-b117ba80ce78 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:15.067413 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0a221c8-0b3f-47da-8a6b-b117ba80ce78 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:15.076695 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0a221c8-0b3f-47da-8a6b-b117ba80ce78 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:15.465588 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c0a221c8-0b3f-47da-8a6b-b117ba80ce78 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:15.480195 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c0a221c8-0b3f-47da-8a6b-b117ba80ce78 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:15.482260 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c0a221c8-0b3f-47da-8a6b-b117ba80ce78 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:15.485576 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c0a221c8-0b3f-47da-8a6b-b117ba80ce78 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933" status: 200 len: 1569 microversion: 2.25 time: 0.470798 Sep 16 12:53:15.488097 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 987/1922] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:53:15 2022] GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933 => generated 1569 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:53:15.495370 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a17b115d-afc9-4109-bfca-b57f62e7bb8d tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:15.499860 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a17b115d-afc9-4109-bfca-b57f62e7bb8d tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] [instance: e8c8969d-7c0d-4bfe-bd49-6271193614b9] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:15.518100 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a17b115d-afc9-4109-bfca-b57f62e7bb8d tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:15.518926 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a17b115d-afc9-4109-bfca-b57f62e7bb8d tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:15.519537 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a17b115d-afc9-4109-bfca-b57f62e7bb8d tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:15.522600 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a17b115d-afc9-4109-bfca-b57f62e7bb8d tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:15.525251 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a17b115d-afc9-4109-bfca-b57f62e7bb8d tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:15.526091 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a17b115d-afc9-4109-bfca-b57f62e7bb8d tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:15.784467 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a17b115d-afc9-4109-bfca-b57f62e7bb8d tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c5683ddbb047348d4924b7ce957472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10cd073476b420c89d93ce9c5a608c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:15.793943 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a17b115d-afc9-4109-bfca-b57f62e7bb8d tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] 10.222.0.67 "GET /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9" status: 200 len: 1316 microversion: 2.1 time: 0.302905 Sep 16 12:53:15.799841 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 988/1923] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:15 2022] GET /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9 => generated 1316 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:15.820613 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b531d081-8197-4d87-9c9b-1a6873481de2 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:15.821696 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b531d081-8197-4d87-9c9b-1a6873481de2 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] [instance: c97d5f35-6ea1-4ec7-88f5-9da9dbe81182] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:15.828711 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b531d081-8197-4d87-9c9b-1a6873481de2 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:15.829751 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b531d081-8197-4d87-9c9b-1a6873481de2 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:15.830496 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b531d081-8197-4d87-9c9b-1a6873481de2 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:15.831723 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b531d081-8197-4d87-9c9b-1a6873481de2 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:15.832453 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b531d081-8197-4d87-9c9b-1a6873481de2 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:15.833243 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b531d081-8197-4d87-9c9b-1a6873481de2 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:16.237461 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b531d081-8197-4d87-9c9b-1a6873481de2 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63998619bf654ebb8d74f91e42c8c780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e81fca8624d18b9415a46e158d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:16.248528 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b531d081-8197-4d87-9c9b-1a6873481de2 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182" status: 200 len: 1317 microversion: 2.1 time: 0.431701 Sep 16 12:53:16.267680 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 989/1924] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:15 2022] GET /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182 => generated 1317 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:16.273424 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-72c77842-3c63-46cf-957a-e80cd7cc0288 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1464455661", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "40f9024a-6954-4a0a-afdb-132e05c6d9d2"}], "block_device_mapping_v2": [{"uuid": "c4ffa176-7334-452f-89c6-ffa2597fc3c8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:16.410104 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-72c77842-3c63-46cf-957a-e80cd7cc0288 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] validate_networks() for [('40f9024a-6954-4a0a-afdb-132e05c6d9d2', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:53:18.955435 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-72c77842-3c63-46cf-957a-e80cd7cc0288 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:53:18.956041 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-72c77842-3c63-46cf-957a-e80cd7cc0288 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:53:18.957442 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-72c77842-3c63-46cf-957a-e80cd7cc0288 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:53:18.957878 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-72c77842-3c63-46cf-957a-e80cd7cc0288 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:53:18.958446 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-72c77842-3c63-46cf-957a-e80cd7cc0288 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:53:18.980910 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72c77842-3c63-46cf-957a-e80cd7cc0288 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:18.981441 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72c77842-3c63-46cf-957a-e80cd7cc0288 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:18.981886 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72c77842-3c63-46cf-957a-e80cd7cc0288 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:18.982633 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72c77842-3c63-46cf-957a-e80cd7cc0288 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:18.983147 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72c77842-3c63-46cf-957a-e80cd7cc0288 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:18.983800 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72c77842-3c63-46cf-957a-e80cd7cc0288 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:19.007415 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-72c77842-3c63-46cf-957a-e80cd7cc0288 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Getting quotas for project dd7ec914bffb4743921e4116b0c399eb. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:53:19.013661 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-72c77842-3c63-46cf-957a-e80cd7cc0288 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Getting quotas for user 745ef253e9844572a0f081955b3e9a90 and project dd7ec914bffb4743921e4116b0c399eb. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:53:19.018767 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-468fe949-5d5f-4d09-9d73-3295e9175d3c tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.945044 Sep 16 12:53:19.019933 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 936/1925] 10.222.0.67 () {60 vars in 1170 bytes} [Fri Sep 16 12:53:14 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4947 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:53:19.025372 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c4809de6-ec0a-4cc7-a66d-9703dfe7c294 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '.version_select at 0x7f1039b5ff70>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:19.130179 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c4809de6-ec0a-4cc7-a66d-9703dfe7c294 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/images/a14d99e9-0c3f-4440-a1b8-2513d1ea03c3" status: 200 len: 1424 microversion: 2.1 time: 0.109035 Sep 16 12:53:19.130779 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 937/1926] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:53:19 2022] GET /compute/v2.1/images/a14d99e9-0c3f-4440-a1b8-2513d1ea03c3 => generated 1424 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:19.145252 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-aca022b5-ec1a-4a93-b376-7482f5e6ab86 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:19.145867 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-aca022b5-ec1a-4a93-b376-7482f5e6ab86 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:19.153226 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-72c77842-3c63-46cf-957a-e80cd7cc0288 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:53:19.155427 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-72c77842-3c63-46cf-957a-e80cd7cc0288 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c4ffa176-7334-452f-89c6-ffa2597fc3c8',volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:53:19.181611 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aca022b5-ec1a-4a93-b376-7482f5e6ab86 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:19.184324 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aca022b5-ec1a-4a93-b376-7482f5e6ab86 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:19.184787 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aca022b5-ec1a-4a93-b376-7482f5e6ab86 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:19.185524 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aca022b5-ec1a-4a93-b376-7482f5e6ab86 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:19.185989 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aca022b5-ec1a-4a93-b376-7482f5e6ab86 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:19.190675 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aca022b5-ec1a-4a93-b376-7482f5e6ab86 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:19.298185 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aca022b5-ec1a-4a93-b376-7482f5e6ab86 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:19.299040 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aca022b5-ec1a-4a93-b376-7482f5e6ab86 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:19.299645 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aca022b5-ec1a-4a93-b376-7482f5e6ab86 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:19.300319 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-aca022b5-ec1a-4a93-b376-7482f5e6ab86 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lazy-loading 'fault' on Instance uuid 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:53:19.368681 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-aca022b5-ec1a-4a93-b376-7482f5e6ab86 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:19.380448 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-aca022b5-ec1a-4a93-b376-7482f5e6ab86 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 200 len: 1303 microversion: 2.1 time: 0.245850 Sep 16 12:53:19.381631 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 938/1927] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:19 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 1303 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:19.388049 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-62e3c604-9490-4495-8c43-aeb8761bdbe1 req-bcd4c754-f496-4fe9-a3e4-013c64acc971 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8c8969d-7c0d-4bfe-bd49-6271193614b9", "tag": "7612ea0a-26f5-4749-ac66-963beed5e38a"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:19.407878 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-62e3c604-9490-4495-8c43-aeb8761bdbe1 req-bcd4c754-f496-4fe9-a3e4-013c64acc971 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:19.408717 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-62e3c604-9490-4495-8c43-aeb8761bdbe1 req-bcd4c754-f496-4fe9-a3e4-013c64acc971 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:19.409363 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-62e3c604-9490-4495-8c43-aeb8761bdbe1 req-bcd4c754-f496-4fe9-a3e4-013c64acc971 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:19.425569 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-72c77842-3c63-46cf-957a-e80cd7cc0288 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.156389 Sep 16 12:53:19.426670 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 990/1928] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:53:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 3158 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:53:19.438008 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d36a6862-bb33-470a-af61-76a62b2950f6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:19.438793 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d36a6862-bb33-470a-af61-76a62b2950f6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 4fbd6b22-2181-4786-9116-a8c8eafb9933] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:19.449320 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d36a6862-bb33-470a-af61-76a62b2950f6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:19.450545 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-62e3c604-9490-4495-8c43-aeb8761bdbe1 req-bcd4c754-f496-4fe9-a3e4-013c64acc971 service nova] Creating event network-changed:7612ea0a-26f5-4749-ac66-963beed5e38a for instance e8c8969d-7c0d-4bfe-bd49-6271193614b9 on n-h1-858094-4 Sep 16 12:53:19.458883 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-62e3c604-9490-4495-8c43-aeb8761bdbe1 req-bcd4c754-f496-4fe9-a3e4-013c64acc971 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075081 Sep 16 12:53:19.459484 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 939/1929] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:53:19.468969 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d36a6862-bb33-470a-af61-76a62b2950f6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:19.473247 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d36a6862-bb33-470a-af61-76a62b2950f6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:19.474205 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d36a6862-bb33-470a-af61-76a62b2950f6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:19.474818 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d36a6862-bb33-470a-af61-76a62b2950f6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:19.475383 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d36a6862-bb33-470a-af61-76a62b2950f6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:19.488548 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0d61f13f-166d-42f5-9348-860032bdf023 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:19.489677 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0d61f13f-166d-42f5-9348-860032bdf023 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] [instance: e8c8969d-7c0d-4bfe-bd49-6271193614b9] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:19.507539 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0d61f13f-166d-42f5-9348-860032bdf023 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:19.510993 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0d61f13f-166d-42f5-9348-860032bdf023 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:19.511788 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0d61f13f-166d-42f5-9348-860032bdf023 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:19.513653 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0d61f13f-166d-42f5-9348-860032bdf023 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:19.516013 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0d61f13f-166d-42f5-9348-860032bdf023 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:19.519227 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0d61f13f-166d-42f5-9348-860032bdf023 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:19.833351 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d36a6862-bb33-470a-af61-76a62b2950f6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:19.848225 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d36a6862-bb33-470a-af61-76a62b2950f6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:19.851309 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d36a6862-bb33-470a-af61-76a62b2950f6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:19.852955 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0d61f13f-166d-42f5-9348-860032bdf023 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c5683ddbb047348d4924b7ce957472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10cd073476b420c89d93ce9c5a608c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:19.855117 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d36a6862-bb33-470a-af61-76a62b2950f6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933" status: 200 len: 1569 microversion: 2.25 time: 0.427209 Sep 16 12:53:19.858117 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 991/1930] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:53:19 2022] GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933 => generated 1569 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:53:19.875742 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0d61f13f-166d-42f5-9348-860032bdf023 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] 10.222.0.67 "GET /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9" status: 200 len: 1316 microversion: 2.1 time: 0.399948 Sep 16 12:53:19.875742 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 940/1931] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:19 2022] GET /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9 => generated 1316 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:19.875742 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-b7ab19b4-0d37-48f7-b7ee-21902c9533ef req-6a62ec7a-333f-49b8-a02d-f2d893fce95f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1afdaec3-fdf0-4eac-a324-c0f8eaa6797b", "name": "network-vif-unplugged", "status": "completed", "tag": "bf12465f-8132-474a-94b1-e3b53f03df41"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:19.880269 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-b7ab19b4-0d37-48f7-b7ee-21902c9533ef req-6a62ec7a-333f-49b8-a02d-f2d893fce95f service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:19.880269 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-b7ab19b4-0d37-48f7-b7ee-21902c9533ef req-6a62ec7a-333f-49b8-a02d-f2d893fce95f service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:19.880630 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-b7ab19b4-0d37-48f7-b7ee-21902c9533ef req-6a62ec7a-333f-49b8-a02d-f2d893fce95f service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:19.893449 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-b7ab19b4-0d37-48f7-b7ee-21902c9533ef req-6a62ec7a-333f-49b8-a02d-f2d893fce95f service nova] Creating event network-vif-unplugged:bf12465f-8132-474a-94b1-e3b53f03df41 for instance 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b on n-h2-858094-4 Sep 16 12:53:19.897741 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4f3fc3b8-0f91-423d-b258-577949b7ef8a tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:19.898642 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-b7ab19b4-0d37-48f7-b7ee-21902c9533ef req-6a62ec7a-333f-49b8-a02d-f2d893fce95f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034512 Sep 16 12:53:19.899228 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 941/1932] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:53:19.904492 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4f3fc3b8-0f91-423d-b258-577949b7ef8a tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] [instance: c97d5f35-6ea1-4ec7-88f5-9da9dbe81182] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:19.905895 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-c4825888-31d9-4c48-8e6b-166dd2885842 req-b0b0d854-f8bc-46bd-9654-5aab02e12343 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1afdaec3-fdf0-4eac-a324-c0f8eaa6797b", "name": "network-vif-deleted", "tag": "bf12465f-8132-474a-94b1-e3b53f03df41"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:19.917534 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-c4825888-31d9-4c48-8e6b-166dd2885842 req-b0b0d854-f8bc-46bd-9654-5aab02e12343 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:19.918377 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-c4825888-31d9-4c48-8e6b-166dd2885842 req-b0b0d854-f8bc-46bd-9654-5aab02e12343 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:19.918979 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-c4825888-31d9-4c48-8e6b-166dd2885842 req-b0b0d854-f8bc-46bd-9654-5aab02e12343 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:19.927529 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f3fc3b8-0f91-423d-b258-577949b7ef8a tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:19.931984 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f3fc3b8-0f91-423d-b258-577949b7ef8a tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:19.932796 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f3fc3b8-0f91-423d-b258-577949b7ef8a tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:19.933901 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f3fc3b8-0f91-423d-b258-577949b7ef8a tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:19.937731 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-c4825888-31d9-4c48-8e6b-166dd2885842 req-b0b0d854-f8bc-46bd-9654-5aab02e12343 service nova] Creating event network-vif-deleted:bf12465f-8132-474a-94b1-e3b53f03df41 for instance 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b on n-h2-858094-4 Sep 16 12:53:19.938345 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f3fc3b8-0f91-423d-b258-577949b7ef8a tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:19.938884 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f3fc3b8-0f91-423d-b258-577949b7ef8a tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:19.944071 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-c4825888-31d9-4c48-8e6b-166dd2885842 req-b0b0d854-f8bc-46bd-9654-5aab02e12343 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043253 Sep 16 12:53:19.944794 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 942/1933] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:53:19.976963 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-227b773c-761e-428f-9cc3-fec7c576809b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-701897308", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3f814bae-963f-4f23-965e-dabc87858a1e"}], "security_groups": [{"name": "tempest-securitygroup--319040827"}], "key_name": "tempest-keypair-1009663872", "user_data": "}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:20.179825 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4f3fc3b8-0f91-423d-b258-577949b7ef8a tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63998619bf654ebb8d74f91e42c8c780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e81fca8624d18b9415a46e158d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:20.190040 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4f3fc3b8-0f91-423d-b258-577949b7ef8a tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182" status: 200 len: 1317 microversion: 2.1 time: 0.299223 Sep 16 12:53:20.191548 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 992/1934] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:19 2022] GET /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182 => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:20.211344 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-227b773c-761e-428f-9cc3-fec7c576809b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] validate_networks() for [('3f814bae-963f-4f23-965e-dabc87858a1e', None, None, None, None, None)] {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:53:20.212568 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e0fcb746-82c6-417d-8469-6c5328e589f2 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1125208036", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": [{"uuid": "2a6f5c27-4e22-4940-b2ce-5570b20e4dba"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:20.297269 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-e0fcb746-82c6-417d-8469-6c5328e589f2 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] validate_networks() for [('2a6f5c27-4e22-4940-b2ce-5570b20e4dba', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:53:21.041739 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-227b773c-761e-428f-9cc3-fec7c576809b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:53:21.042131 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-227b773c-761e-428f-9cc3-fec7c576809b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:53:21.042805 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-227b773c-761e-428f-9cc3-fec7c576809b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:53:21.043403 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-227b773c-761e-428f-9cc3-fec7c576809b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:53:21.044008 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-227b773c-761e-428f-9cc3-fec7c576809b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:53:21.053725 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-227b773c-761e-428f-9cc3-fec7c576809b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:21.055377 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-227b773c-761e-428f-9cc3-fec7c576809b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:21.056050 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-227b773c-761e-428f-9cc3-fec7c576809b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:21.057130 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-227b773c-761e-428f-9cc3-fec7c576809b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:21.057637 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-227b773c-761e-428f-9cc3-fec7c576809b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:21.058112 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-227b773c-761e-428f-9cc3-fec7c576809b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:21.077995 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-227b773c-761e-428f-9cc3-fec7c576809b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Getting quotas for project 7a67136b9d8041fd8e62a81be2d6b48d. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:53:21.084500 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-227b773c-761e-428f-9cc3-fec7c576809b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Getting quotas for user 65566509bf544a398cbb9c29ace613c5 and project 7a67136b9d8041fd8e62a81be2d6b48d. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:53:21.099742 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-227b773c-761e-428f-9cc3-fec7c576809b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:53:21.103017 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-227b773c-761e-428f-9cc3-fec7c576809b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:53:21.170757 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-227b773c-761e-428f-9cc3-fec7c576809b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.206780 Sep 16 12:53:21.171325 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 943/1935] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:53:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 1226 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:53:21.181286 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-00da7828-63ca-4619-bc03-9145fc8e54c5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:21.181909 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-00da7828-63ca-4619-bc03-9145fc8e54c5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:21.215483 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-00da7828-63ca-4619-bc03-9145fc8e54c5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:21.216195 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-00da7828-63ca-4619-bc03-9145fc8e54c5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:21.216440 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-00da7828-63ca-4619-bc03-9145fc8e54c5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:21.217159 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-00da7828-63ca-4619-bc03-9145fc8e54c5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:21.217617 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-00da7828-63ca-4619-bc03-9145fc8e54c5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:21.218033 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-00da7828-63ca-4619-bc03-9145fc8e54c5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:21.238431 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-e0fcb746-82c6-417d-8469-6c5328e589f2 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:53:21.240808 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-e0fcb746-82c6-417d-8469-6c5328e589f2 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:53:21.242398 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-e0fcb746-82c6-417d-8469-6c5328e589f2 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:53:21.243054 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-e0fcb746-82c6-417d-8469-6c5328e589f2 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:53:21.243857 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-e0fcb746-82c6-417d-8469-6c5328e589f2 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:53:21.264436 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0fcb746-82c6-417d-8469-6c5328e589f2 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:21.265361 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0fcb746-82c6-417d-8469-6c5328e589f2 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:21.265987 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0fcb746-82c6-417d-8469-6c5328e589f2 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:21.266990 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0fcb746-82c6-417d-8469-6c5328e589f2 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:21.267698 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0fcb746-82c6-417d-8469-6c5328e589f2 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:21.268342 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0fcb746-82c6-417d-8469-6c5328e589f2 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:21.279774 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:53:21.293522 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-e0fcb746-82c6-417d-8469-6c5328e589f2 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Getting quotas for project 1e41136645964ea98a675833bd73299f. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:53:21.308480 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-e0fcb746-82c6-417d-8469-6c5328e589f2 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Getting quotas for user b9101f5af9e34d21bb8e872d337d3545 and project 1e41136645964ea98a675833bd73299f. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:53:21.330435 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e0fcb746-82c6-417d-8469-6c5328e589f2 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:53:21.333230 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e0fcb746-82c6-417d-8469-6c5328e589f2 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 227a8a0b-2a0c-48f8-976a-a176a9039a2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:53:21.443249 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-00da7828-63ca-4619-bc03-9145fc8e54c5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:21.456039 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-00da7828-63ca-4619-bc03-9145fc8e54c5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1169 microversion: 2.1 time: 0.283628 Sep 16 12:53:21.456486 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e0fcb746-82c6-417d-8469-6c5328e589f2 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.260084 Sep 16 12:53:21.458877 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 993/1936] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:53:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:53:21.467990 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 944/1937] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:21 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1169 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:21.471861 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-636d176e-168b-4fe3-8f97-3d4d4ee7bb65 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '.version_select at 0x7f103529a700>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:21.473004 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4afcbfe8-5b0a-4750-9b50-e0b7ff7b25f0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:21.473696 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-4afcbfe8-5b0a-4750-9b50-e0b7ff7b25f0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:21.490271 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4afcbfe8-5b0a-4750-9b50-e0b7ff7b25f0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:21.491173 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4afcbfe8-5b0a-4750-9b50-e0b7ff7b25f0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:21.492419 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4afcbfe8-5b0a-4750-9b50-e0b7ff7b25f0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:21.493374 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4afcbfe8-5b0a-4750-9b50-e0b7ff7b25f0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:21.495268 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4afcbfe8-5b0a-4750-9b50-e0b7ff7b25f0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:21.496714 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4afcbfe8-5b0a-4750-9b50-e0b7ff7b25f0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:21.529115 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-4afcbfe8-5b0a-4750-9b50-e0b7ff7b25f0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] HTTP exception thrown: Instance 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b could not be found. Sep 16 12:53:21.541703 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4afcbfe8-5b0a-4750-9b50-e0b7ff7b25f0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Request method failure captured: Sep 16 12:53:21.541703 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b HTTP/1.1 Sep 16 12:53:21.541703 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:53:21.541703 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:53:21.541703 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:53:21.541703 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:53:21.541703 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:53:21.541703 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:53:21.541703 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:53:21.541703 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:53:21.541703 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHBRVCNZh7s3qiWk8e7dDntjLmx7Uq1o7Yz49PjdhXkeDEhxCJvSqDNaxFYD4ZTfwTB9gBWkkSsrzbdLOsywrJgACtdvqsMnejhS1OJL2U_sNrRKxh64yJLlkXbgE9PesdSsC3g-sqzkc1hnbiJ_-JHqu8VW7vvaYO1adojxOefjq2Q Sep 16 12:53:21.541703 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:53:21.541703 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:53:21.541703 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:53:21.541703 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:53:21.541703 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:53:21.541703 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:53:21.541703 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 0b18ec5302634d2a95e51547e0019d40 Sep 16 12:53:21.541703 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-MigrationsAdminTest-25653665 Sep 16 12:53:21.541703 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:53:21.541703 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:53:21.543751 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0b18ec5302634d2a95e51547e0019d40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0b18ec5302634d2a95e51547e0019d40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0b18ec5302634d2a95e51547e0019d40", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0b18ec5302634d2a95e51547e0019d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:53:21.543751 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-MigrationsAdminTest-25653665 Sep 16 12:53:21.543751 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 0b18ec5302634d2a95e51547e0019d40 Sep 16 12:53:21.543751 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-MigrationsAdminTest-25653665 Sep 16 12:53:21.543751 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-MigrationsAdminTest-25653665-project Sep 16 12:53:21.543751 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:53:21.543751 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:53:21.543751 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: f3e2827a76d14e4a88c4562f1c0351ac Sep 16 12:53:21.543751 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-MigrationsAdminTest-25653665-project Sep 16 12:53:21.543751 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:53:21.543751 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b could not be found. Sep 16 12:53:21.543751 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '1afdaec3-fdf0-4eac-a324-c0f8eaa6797b'} Sep 16 12:53:21.545143 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:53:21.545143 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:53:21.545143 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:53:21.545143 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:53:21.545143 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:53:21.545143 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:53:21.545143 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:53:21.545143 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:53:21.545143 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:53:21.545143 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:53:21.545143 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b could not be found. Sep 16 12:53:21.545143 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:53:21.545143 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:53:21.545143 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:53:21.545143 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:53:21.545143 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:53:21.545143 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:53:21.545143 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:53:21.545143 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:53:21.545143 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:53:21.546933 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:53:21.546933 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:53:21.546933 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:53:21.546933 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:53:21.546933 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:53:21.546933 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:53:21.546933 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:53:21.546933 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b could not be found. Sep 16 12:53:21.546933 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:53:21.546933 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:53:21.546933 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:53:21.546933 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:53:21.546933 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:53:21.546933 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:53:21.546933 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:53:21.546933 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:53:21.546933 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b could not be found. Sep 16 12:53:21.546933 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:53:21.550305 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4afcbfe8-5b0a-4750-9b50-e0b7ff7b25f0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Returning 404 to user: Instance 1afdaec3-fdf0-4eac-a324-c0f8eaa6797b could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:53:21.553025 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4afcbfe8-5b0a-4750-9b50-e0b7ff7b25f0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b" status: 404 len: 111 microversion: 2.1 time: 0.083683 Sep 16 12:53:21.553619 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 945/1938] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:21 2022] GET /compute/v2.1/servers/1afdaec3-fdf0-4eac-a324-c0f8eaa6797b => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:53:21.607421 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f13799b0-ddeb-49a9-87e9-e1a666eaef99 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:21.608225 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-636d176e-168b-4fe3-8f97-3d4d4ee7bb65 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/images/a14d99e9-0c3f-4440-a1b8-2513d1ea03c3" status: 200 len: 1433 microversion: 2.1 time: 0.136039 Sep 16 12:53:21.609821 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 994/1939] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:53:21 2022] GET /compute/v2.1/images/a14d99e9-0c3f-4440-a1b8-2513d1ea03c3 => generated 1433 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:21.610090 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f13799b0-ddeb-49a9-87e9-e1a666eaef99 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 4fbd6b22-2181-4786-9116-a8c8eafb9933] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:21.626612 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-aa00dd41-6780-4cec-99a6-d9b968949d42 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:21.627238 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-aa00dd41-6780-4cec-99a6-d9b968949d42 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] [instance: e8c8969d-7c0d-4bfe-bd49-6271193614b9] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:21.629389 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f13799b0-ddeb-49a9-87e9-e1a666eaef99 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:21.629862 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f13799b0-ddeb-49a9-87e9-e1a666eaef99 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:21.631707 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f13799b0-ddeb-49a9-87e9-e1a666eaef99 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:21.634210 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f13799b0-ddeb-49a9-87e9-e1a666eaef99 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:21.636562 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f13799b0-ddeb-49a9-87e9-e1a666eaef99 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:21.638484 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f13799b0-ddeb-49a9-87e9-e1a666eaef99 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:21.646646 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa00dd41-6780-4cec-99a6-d9b968949d42 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:21.647384 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa00dd41-6780-4cec-99a6-d9b968949d42 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:21.649275 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa00dd41-6780-4cec-99a6-d9b968949d42 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:21.650697 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa00dd41-6780-4cec-99a6-d9b968949d42 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:21.653392 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa00dd41-6780-4cec-99a6-d9b968949d42 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:21.654055 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa00dd41-6780-4cec-99a6-d9b968949d42 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:21.687763 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=100 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:53:22.715691 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-aa00dd41-6780-4cec-99a6-d9b968949d42 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c5683ddbb047348d4924b7ce957472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10cd073476b420c89d93ce9c5a608c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:22.732860 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-aa00dd41-6780-4cec-99a6-d9b968949d42 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] 10.222.0.67 "GET /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9" status: 200 len: 1316 microversion: 2.1 time: 1.119945 Sep 16 12:53:22.733994 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 995/1940] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:21 2022] GET /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9 => generated 1316 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:22.740985 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b7c979e6-8685-48b4-b85d-34cb89484fc1 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:22.745073 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b7c979e6-8685-48b4-b85d-34cb89484fc1 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:22.760408 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7c979e6-8685-48b4-b85d-34cb89484fc1 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:22.761231 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7c979e6-8685-48b4-b85d-34cb89484fc1 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:22.761859 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7c979e6-8685-48b4-b85d-34cb89484fc1 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:22.762869 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7c979e6-8685-48b4-b85d-34cb89484fc1 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:22.766648 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7c979e6-8685-48b4-b85d-34cb89484fc1 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:22.767264 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7c979e6-8685-48b4-b85d-34cb89484fc1 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:22.941407 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b7c979e6-8685-48b4-b85d-34cb89484fc1 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:22.956075 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b7c979e6-8685-48b4-b85d-34cb89484fc1 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1289 microversion: 2.1 time: 0.220938 Sep 16 12:53:22.956715 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 996/1941] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:22 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1289 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:22.974376 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f331e9e0-bdd3-4435-83e0-a5b22a46c0b7 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:22.974995 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f331e9e0-bdd3-4435-83e0-a5b22a46c0b7 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] [instance: c97d5f35-6ea1-4ec7-88f5-9da9dbe81182] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:23.002946 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f331e9e0-bdd3-4435-83e0-a5b22a46c0b7 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:23.003461 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f331e9e0-bdd3-4435-83e0-a5b22a46c0b7 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:23.012504 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f331e9e0-bdd3-4435-83e0-a5b22a46c0b7 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:23.016825 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f331e9e0-bdd3-4435-83e0-a5b22a46c0b7 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:23.018632 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f331e9e0-bdd3-4435-83e0-a5b22a46c0b7 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:23.020438 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f331e9e0-bdd3-4435-83e0-a5b22a46c0b7 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:23.093351 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f13799b0-ddeb-49a9-87e9-e1a666eaef99 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:23.106088 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f13799b0-ddeb-49a9-87e9-e1a666eaef99 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:23.107835 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f13799b0-ddeb-49a9-87e9-e1a666eaef99 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:23.111089 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f13799b0-ddeb-49a9-87e9-e1a666eaef99 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933" status: 200 len: 1569 microversion: 2.25 time: 1.539249 Sep 16 12:53:23.114358 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 946/1942] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:53:21 2022] GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933 => generated 1569 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:53:23.129303 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7adfaef8-3903-46cd-815b-f98ee4ed52fd tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:23.156958 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7adfaef8-3903-46cd-815b-f98ee4ed52fd tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 227a8a0b-2a0c-48f8-976a-a176a9039a2d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:23.167384 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7adfaef8-3903-46cd-815b-f98ee4ed52fd tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:23.168164 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7adfaef8-3903-46cd-815b-f98ee4ed52fd tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:23.168743 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7adfaef8-3903-46cd-815b-f98ee4ed52fd tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:23.169995 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7adfaef8-3903-46cd-815b-f98ee4ed52fd tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:23.176042 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7adfaef8-3903-46cd-815b-f98ee4ed52fd tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:23.176808 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7adfaef8-3903-46cd-815b-f98ee4ed52fd tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:23.514017 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7adfaef8-3903-46cd-815b-f98ee4ed52fd tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9101f5af9e34d21bb8e872d337d3545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e41136645964ea98a675833bd73299f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:23.534056 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7adfaef8-3903-46cd-815b-f98ee4ed52fd tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "GET /compute/v2.1/servers/227a8a0b-2a0c-48f8-976a-a176a9039a2d" status: 200 len: 1220 microversion: 2.1 time: 0.418320 Sep 16 12:53:23.535053 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 947/1943] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:23 2022] GET /compute/v2.1/servers/227a8a0b-2a0c-48f8-976a-a176a9039a2d => generated 1220 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:23.549046 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-69fd78fe-fe9f-41bc-b351-5e6bf99abedc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:23.552540 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-69fd78fe-fe9f-41bc-b351-5e6bf99abedc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:23.569648 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-69fd78fe-fe9f-41bc-b351-5e6bf99abedc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:23.572920 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-69fd78fe-fe9f-41bc-b351-5e6bf99abedc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:23.573800 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-69fd78fe-fe9f-41bc-b351-5e6bf99abedc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:23.576633 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-69fd78fe-fe9f-41bc-b351-5e6bf99abedc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:23.577510 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-69fd78fe-fe9f-41bc-b351-5e6bf99abedc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:23.578128 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-69fd78fe-fe9f-41bc-b351-5e6bf99abedc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:23.593706 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f331e9e0-bdd3-4435-83e0-a5b22a46c0b7 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63998619bf654ebb8d74f91e42c8c780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e81fca8624d18b9415a46e158d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:23.601822 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f331e9e0-bdd3-4435-83e0-a5b22a46c0b7 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182" status: 200 len: 1317 microversion: 2.1 time: 0.631170 Sep 16 12:53:23.616378 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-69fd78fe-fe9f-41bc-b351-5e6bf99abedc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:53:23.616556 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 997/1944] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:22 2022] GET /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182 => generated 1317 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:23.626985 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-40874be2-ee26-4711-ab77-94a6d8b5976e tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '.version_select at 0x7f1035195670>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:23.720917 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-40874be2-ee26-4711-ab77-94a6d8b5976e tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/images/a14d99e9-0c3f-4440-a1b8-2513d1ea03c3" status: 200 len: 1433 microversion: 2.1 time: 0.094953 Sep 16 12:53:23.722014 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 998/1945] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:53:23 2022] GET /compute/v2.1/images/a14d99e9-0c3f-4440-a1b8-2513d1ea03c3 => generated 1433 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:23.727899 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-6699af36-f49e-4460-b413-9887f932683d req-a2236cec-1225-4610-999d-b15bd7f17a78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c97d5f35-6ea1-4ec7-88f5-9da9dbe81182", "name": "network-vif-plugged", "status": "completed", "tag": "81054b4c-c45a-4833-ae83-e752ff18ff48"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:23.756755 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-6699af36-f49e-4460-b413-9887f932683d req-a2236cec-1225-4610-999d-b15bd7f17a78 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:23.757294 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-6699af36-f49e-4460-b413-9887f932683d req-a2236cec-1225-4610-999d-b15bd7f17a78 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:23.760854 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-6699af36-f49e-4460-b413-9887f932683d req-a2236cec-1225-4610-999d-b15bd7f17a78 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:23.771411 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-69fd78fe-fe9f-41bc-b351-5e6bf99abedc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 204 len: 0 microversion: 2.1 time: 0.234855 Sep 16 12:53:23.773102 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 948/1946] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:53:23 2022] DELETE /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:53:23.786435 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-6699af36-f49e-4460-b413-9887f932683d req-a2236cec-1225-4610-999d-b15bd7f17a78 service nova] Creating event network-vif-plugged:81054b4c-c45a-4833-ae83-e752ff18ff48 for instance c97d5f35-6ea1-4ec7-88f5-9da9dbe81182 on n-h1-858094-4 Sep 16 12:53:23.805508 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b7df11ad-b57f-4dbf-a404-f8d0d82b9dea tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:23.807524 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b7df11ad-b57f-4dbf-a404-f8d0d82b9dea tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:23.830274 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b7df11ad-b57f-4dbf-a404-f8d0d82b9dea tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:23.833259 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b7df11ad-b57f-4dbf-a404-f8d0d82b9dea tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:23.833552 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-6699af36-f49e-4460-b413-9887f932683d req-a2236cec-1225-4610-999d-b15bd7f17a78 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080250 Sep 16 12:53:23.834151 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b7df11ad-b57f-4dbf-a404-f8d0d82b9dea tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:23.836559 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b7df11ad-b57f-4dbf-a404-f8d0d82b9dea tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:23.837138 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 999/1947] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:53:23.839554 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b7df11ad-b57f-4dbf-a404-f8d0d82b9dea tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:23.840272 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b7df11ad-b57f-4dbf-a404-f8d0d82b9dea tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:23.842508 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-6ab0606d-0960-4361-9440-639383c8d827 req-2368bad9-e0c3-4e24-a6f4-20a6fcc14c97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd1530a2-c78e-419d-a65e-fc5baf53d939", "tag": "efae6ffd-f514-46a4-ad30-4fa3504874c8"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:23.876836 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-6ab0606d-0960-4361-9440-639383c8d827 req-2368bad9-e0c3-4e24-a6f4-20a6fcc14c97 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:23.877310 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-6ab0606d-0960-4361-9440-639383c8d827 req-2368bad9-e0c3-4e24-a6f4-20a6fcc14c97 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:23.877927 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-6ab0606d-0960-4361-9440-639383c8d827 req-2368bad9-e0c3-4e24-a6f4-20a6fcc14c97 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:23.897525 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-6ab0606d-0960-4361-9440-639383c8d827 req-2368bad9-e0c3-4e24-a6f4-20a6fcc14c97 service nova] Creating event network-changed:efae6ffd-f514-46a4-ad30-4fa3504874c8 for instance bd1530a2-c78e-419d-a65e-fc5baf53d939 on n-h2-858094-4 Sep 16 12:53:23.908986 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-6ab0606d-0960-4361-9440-639383c8d827 req-2368bad9-e0c3-4e24-a6f4-20a6fcc14c97 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070346 Sep 16 12:53:23.916083 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1000/1948] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:53:23.923579 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3e579375-7597-41d7-8120-56c9ec55f04f tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:23.924581 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3e579375-7597-41d7-8120-56c9ec55f04f tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] [instance: 345ee81d-c503-421c-90ea-218ac1c98600] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:23.932338 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e579375-7597-41d7-8120-56c9ec55f04f tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:23.933256 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e579375-7597-41d7-8120-56c9ec55f04f tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:23.936897 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e579375-7597-41d7-8120-56c9ec55f04f tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:23.937909 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e579375-7597-41d7-8120-56c9ec55f04f tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:23.938459 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e579375-7597-41d7-8120-56c9ec55f04f tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:23.938970 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e579375-7597-41d7-8120-56c9ec55f04f tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:24.210980 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-b7df11ad-b57f-4dbf-a404-f8d0d82b9dea tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:24.220456 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b7df11ad-b57f-4dbf-a404-f8d0d82b9dea tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1211 microversion: 2.1 time: 0.444744 Sep 16 12:53:24.221388 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 949/1949] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:23 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1211 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:24.226450 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-822ea0f2-524a-4bae-b9eb-9a8f606081ff tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:24.227492 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-822ea0f2-524a-4bae-b9eb-9a8f606081ff tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] [instance: e8c8969d-7c0d-4bfe-bd49-6271193614b9] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:24.233005 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3e579375-7597-41d7-8120-56c9ec55f04f tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d4c5f7ddf5432ba8b4eac2cb6a9860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b7d059fb70415fb5dc20e3a921d189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:24.239528 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-822ea0f2-524a-4bae-b9eb-9a8f606081ff tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:24.240015 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-822ea0f2-524a-4bae-b9eb-9a8f606081ff tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:24.240469 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-822ea0f2-524a-4bae-b9eb-9a8f606081ff tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:24.241166 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-822ea0f2-524a-4bae-b9eb-9a8f606081ff tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:24.241626 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-822ea0f2-524a-4bae-b9eb-9a8f606081ff tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:24.242040 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-822ea0f2-524a-4bae-b9eb-9a8f606081ff tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:24.248661 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3e579375-7597-41d7-8120-56c9ec55f04f tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600" status: 200 len: 1466 microversion: 2.1 time: 0.331033 Sep 16 12:53:24.249248 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1001/1950] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:23 2022] GET /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600 => generated 1466 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:24.254250 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5715e540-cd51-4454-abe7-8fb6774eb4e0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:24.255116 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5715e540-cd51-4454-abe7-8fb6774eb4e0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:24.263692 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5715e540-cd51-4454-abe7-8fb6774eb4e0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:24.264527 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5715e540-cd51-4454-abe7-8fb6774eb4e0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:24.265181 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5715e540-cd51-4454-abe7-8fb6774eb4e0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:24.266143 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5715e540-cd51-4454-abe7-8fb6774eb4e0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:24.266828 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5715e540-cd51-4454-abe7-8fb6774eb4e0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:24.267317 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5715e540-cd51-4454-abe7-8fb6774eb4e0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:24.456869 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-822ea0f2-524a-4bae-b9eb-9a8f606081ff tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c5683ddbb047348d4924b7ce957472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10cd073476b420c89d93ce9c5a608c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:24.465228 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5715e540-cd51-4454-abe7-8fb6774eb4e0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:24.471747 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-822ea0f2-524a-4bae-b9eb-9a8f606081ff tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] 10.222.0.67 "GET /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9" status: 200 len: 1316 microversion: 2.1 time: 0.248936 Sep 16 12:53:24.472383 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 950/1951] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:24 2022] GET /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9 => generated 1316 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:24.477079 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4e1a48fb-b4d6-493e-b39e-566972a09be1 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:24.477789 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-4e1a48fb-b4d6-493e-b39e-566972a09be1 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:24.486389 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5715e540-cd51-4454-abe7-8fb6774eb4e0 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1534 microversion: 2.1 time: 0.235845 Sep 16 12:53:24.486805 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4e1a48fb-b4d6-493e-b39e-566972a09be1 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:24.487321 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1002/1952] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:24 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1534 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:24.487796 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4e1a48fb-b4d6-493e-b39e-566972a09be1 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:24.488510 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4e1a48fb-b4d6-493e-b39e-566972a09be1 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:24.489498 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4e1a48fb-b4d6-493e-b39e-566972a09be1 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:24.490576 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4e1a48fb-b4d6-493e-b39e-566972a09be1 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:24.491234 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4e1a48fb-b4d6-493e-b39e-566972a09be1 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:24.491821 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-28a16fbd-2018-463f-953e-0a092f4a8b92 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:24.493129 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-28a16fbd-2018-463f-953e-0a092f4a8b92 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 4fbd6b22-2181-4786-9116-a8c8eafb9933] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:24.499535 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28a16fbd-2018-463f-953e-0a092f4a8b92 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:24.500398 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28a16fbd-2018-463f-953e-0a092f4a8b92 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:24.501110 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28a16fbd-2018-463f-953e-0a092f4a8b92 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:24.502052 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28a16fbd-2018-463f-953e-0a092f4a8b92 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:24.502855 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28a16fbd-2018-463f-953e-0a092f4a8b92 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:24.503353 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28a16fbd-2018-463f-953e-0a092f4a8b92 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:24.569014 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4e1a48fb-b4d6-493e-b39e-566972a09be1 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:24.578152 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4e1a48fb-b4d6-493e-b39e-566972a09be1 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1295 microversion: 2.1 time: 0.104614 Sep 16 12:53:24.578748 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 951/1953] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:24 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1295 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:24.583544 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a9728eba-1115-4e4b-88a5-d16a6fd3428a tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '.version_select at 0x7f1035ee3a60>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:24.630555 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a9728eba-1115-4e4b-88a5-d16a6fd3428a tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/images/7df4548b-8809-4742-80bd-4e4e6dcafc91" status: 200 len: 784 microversion: 2.1 time: 0.050488 Sep 16 12:53:24.631159 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 952/1954] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:53:24 2022] GET /compute/v2.1/images/7df4548b-8809-4742-80bd-4e4e6dcafc91 => generated 784 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:53:24.636599 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-af4b88d3-e478-4a99-9c89-d1fc7d351662 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:24.638140 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-af4b88d3-e478-4a99-9c89-d1fc7d351662 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 227a8a0b-2a0c-48f8-976a-a176a9039a2d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:24.645399 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-af4b88d3-e478-4a99-9c89-d1fc7d351662 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:24.645979 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-af4b88d3-e478-4a99-9c89-d1fc7d351662 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:24.646486 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-af4b88d3-e478-4a99-9c89-d1fc7d351662 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:24.647261 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-af4b88d3-e478-4a99-9c89-d1fc7d351662 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:24.647792 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-af4b88d3-e478-4a99-9c89-d1fc7d351662 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:24.649264 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-af4b88d3-e478-4a99-9c89-d1fc7d351662 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:24.683838 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-28a16fbd-2018-463f-953e-0a092f4a8b92 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:24.692749 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-28a16fbd-2018-463f-953e-0a092f4a8b92 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:24.694197 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-28a16fbd-2018-463f-953e-0a092f4a8b92 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:24.695380 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-28a16fbd-2018-463f-953e-0a092f4a8b92 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933" status: 200 len: 1544 microversion: 2.25 time: 0.207100 Sep 16 12:53:24.696939 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1003/1955] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:53:24 2022] GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933 => generated 1544 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:53:24.704072 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d957d3fe-0018-4c6c-8a1f-694a898c1bac tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:24.704916 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d957d3fe-0018-4c6c-8a1f-694a898c1bac tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] [instance: c97d5f35-6ea1-4ec7-88f5-9da9dbe81182] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:24.712227 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d957d3fe-0018-4c6c-8a1f-694a898c1bac tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:24.713459 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d957d3fe-0018-4c6c-8a1f-694a898c1bac tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:24.713912 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d957d3fe-0018-4c6c-8a1f-694a898c1bac tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:24.714624 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d957d3fe-0018-4c6c-8a1f-694a898c1bac tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:24.715078 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d957d3fe-0018-4c6c-8a1f-694a898c1bac tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:24.715504 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d957d3fe-0018-4c6c-8a1f-694a898c1bac tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:24.719457 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-af4b88d3-e478-4a99-9c89-d1fc7d351662 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9101f5af9e34d21bb8e872d337d3545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e41136645964ea98a675833bd73299f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:24.728037 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-af4b88d3-e478-4a99-9c89-d1fc7d351662 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "GET /compute/v2.1/servers/227a8a0b-2a0c-48f8-976a-a176a9039a2d" status: 200 len: 1276 microversion: 2.1 time: 0.095696 Sep 16 12:53:24.729254 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 953/1956] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:24 2022] GET /compute/v2.1/servers/227a8a0b-2a0c-48f8-976a-a176a9039a2d => generated 1276 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:24.734218 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f9e9058f-30be-4756-a106-6d9936b6f7cf tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:24.744702 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f9e9058f-30be-4756-a106-6d9936b6f7cf tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014066 Sep 16 12:53:24.745448 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 954/1957] 10.222.0.67 () {58 vars in 1137 bytes} [Fri Sep 16 12:53:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:53:24.750625 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c996096e-4339-4044-ae9a-078bbb7f7aa3 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Calling method '.version_select at 0x7f1035afdca0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:24.757316 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c996096e-4339-4044-ae9a-078bbb7f7aa3 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:24.757802 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c996096e-4339-4044-ae9a-078bbb7f7aa3 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:24.758848 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c996096e-4339-4044-ae9a-078bbb7f7aa3 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:24.775317 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c996096e-4339-4044-ae9a-078bbb7f7aa3 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] 10.222.0.67 "GET /compute/v2.1/os-migrations" status: 200 len: 3625 microversion: 2.25 time: 0.028534 Sep 16 12:53:24.775950 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 955/1958] 10.222.0.67 () {60 vars in 1184 bytes} [Fri Sep 16 12:53:24 2022] GET /compute/v2.1/os-migrations => generated 3625 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:53:24.785954 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-36e846c1-f531-4316-bf7e-805fc863b1a6 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '.version_select at 0x7f1035af4280>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:24.887946 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d957d3fe-0018-4c6c-8a1f-694a898c1bac tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63998619bf654ebb8d74f91e42c8c780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e81fca8624d18b9415a46e158d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:24.896580 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d957d3fe-0018-4c6c-8a1f-694a898c1bac tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182" status: 200 len: 1317 microversion: 2.1 time: 0.197807 Sep 16 12:53:24.897631 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1004/1959] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:24 2022] GET /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182 => generated 1317 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:24.903513 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0ef668d9-1fa2-4182-bcb4-0b4ee845729f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:24.904468 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0ef668d9-1fa2-4182-bcb4-0b4ee845729f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] [instance: 4fbd6b22-2181-4786-9116-a8c8eafb9933] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:24.917701 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ef668d9-1fa2-4182-bcb4-0b4ee845729f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:24.918383 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ef668d9-1fa2-4182-bcb4-0b4ee845729f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:24.919306 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ef668d9-1fa2-4182-bcb4-0b4ee845729f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:24.920360 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ef668d9-1fa2-4182-bcb4-0b4ee845729f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:24.920987 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ef668d9-1fa2-4182-bcb4-0b4ee845729f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:24.921581 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ef668d9-1fa2-4182-bcb4-0b4ee845729f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:25.071043 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-0ef668d9-1fa2-4182-bcb4-0b4ee845729f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lazy-loading 'services' on Instance uuid 4fbd6b22-2181-4786-9116-a8c8eafb9933 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:53:25.088903 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0ef668d9-1fa2-4182-bcb4-0b4ee845729f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933" status: 200 len: 2037 microversion: 2.25 time: 0.190047 Sep 16 12:53:25.089505 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1005/1960] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:53:24 2022] GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933 => generated 2037 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:53:25.123519 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b7e882f4-69f4-499c-921a-36810e40c40d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Action: 'create', calling method: .version_select at 0x7f1035195790>, body: {"keypair": {"name": "tempest-keypair-1607659794", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNDhVpeEV08NEPtKO1mqTxE20aelzLRpAsDSplFEbqibgIlmbAmPTecqt1LkBb9HBa9tufDyY0GMBT3GHaAjSLYtWdPaOnnfqxSEHMy41SARgvwzDiQKUG0KoPPEUecvQ=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:25.145643 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-b7e882f4-69f4-499c-921a-36810e40c40d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Getting quotas for project da915844493a4928ac8830897afa126f. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:53:25.152881 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-b7e882f4-69f4-499c-921a-36810e40c40d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Getting quotas for user ab6ca4cf98e14358bf8e0f625812fbb9 and project da915844493a4928ac8830897afa126f. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:53:25.189425 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b7e882f4-69f4-499c-921a-36810e40c40d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.069917 Sep 16 12:53:25.199711 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1006/1961] 10.222.0.67 () {62 vars in 1200 bytes} [Fri Sep 16 12:53:25 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 81 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 16 12:53:25.257965 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ad7b2957-804f-41d7-bd8b-6bb9fb7708ce tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:25.261104 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ad7b2957-804f-41d7-bd8b-6bb9fb7708ce tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:25.265447 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:53:25.292715 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad7b2957-804f-41d7-bd8b-6bb9fb7708ce tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:25.300679 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad7b2957-804f-41d7-bd8b-6bb9fb7708ce tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:25.308409 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad7b2957-804f-41d7-bd8b-6bb9fb7708ce tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:25.309476 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad7b2957-804f-41d7-bd8b-6bb9fb7708ce tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:25.311920 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad7b2957-804f-41d7-bd8b-6bb9fb7708ce tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:25.314444 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad7b2957-804f-41d7-bd8b-6bb9fb7708ce tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:25.502046 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-36e846c1-f531-4316-bf7e-805fc863b1a6 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "DELETE /compute/v2.1/images/a14d99e9-0c3f-4440-a1b8-2513d1ea03c3" status: 204 len: 0 microversion: 2.1 time: 0.721041 Sep 16 12:53:25.505748 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 956/1962] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:24 2022] DELETE /compute/v2.1/images/a14d99e9-0c3f-4440-a1b8-2513d1ea03c3 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:53:25.511186 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e8013deb-db70-4b48-9aeb-cbe9573e6185 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:25.511926 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e8013deb-db70-4b48-9aeb-cbe9573e6185 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] [instance: e8c8969d-7c0d-4bfe-bd49-6271193614b9] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:25.525776 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e8013deb-db70-4b48-9aeb-cbe9573e6185 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:25.526458 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e8013deb-db70-4b48-9aeb-cbe9573e6185 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:25.527397 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e8013deb-db70-4b48-9aeb-cbe9573e6185 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:25.530184 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e8013deb-db70-4b48-9aeb-cbe9573e6185 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:25.530795 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e8013deb-db70-4b48-9aeb-cbe9573e6185 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:25.540850 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e8013deb-db70-4b48-9aeb-cbe9573e6185 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:26.075454 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ad7b2957-804f-41d7-bd8b-6bb9fb7708ce tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:26.085363 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ad7b2957-804f-41d7-bd8b-6bb9fb7708ce tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1211 microversion: 2.1 time: 0.845334 Sep 16 12:53:26.088388 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1007/1963] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:25 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1211 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:26.102048 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cd947a6c-87da-46c6-b37e-4d79fd6737b5 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:26.103445 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cd947a6c-87da-46c6-b37e-4d79fd6737b5 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:26.118089 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd947a6c-87da-46c6-b37e-4d79fd6737b5 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:26.118757 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd947a6c-87da-46c6-b37e-4d79fd6737b5 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:26.119426 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd947a6c-87da-46c6-b37e-4d79fd6737b5 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:26.120375 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd947a6c-87da-46c6-b37e-4d79fd6737b5 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:26.122103 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd947a6c-87da-46c6-b37e-4d79fd6737b5 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:26.124354 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd947a6c-87da-46c6-b37e-4d79fd6737b5 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:26.326159 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e8013deb-db70-4b48-9aeb-cbe9573e6185 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c5683ddbb047348d4924b7ce957472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10cd073476b420c89d93ce9c5a608c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:26.348952 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e8013deb-db70-4b48-9aeb-cbe9573e6185 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] 10.222.0.67 "GET /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9" status: 200 len: 1316 microversion: 2.1 time: 0.840500 Sep 16 12:53:26.350574 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 957/1964] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:25 2022] GET /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9 => generated 1316 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:26.364413 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-cf81c3bd-10b8-4caf-bd23-34b2c00e0e98 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '.version_select at 0x7f1035af4550>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:26.411601 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-cf81c3bd-10b8-4caf-bd23-34b2c00e0e98 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] HTTP exception thrown: Image not found. Sep 16 12:53:26.414150 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-cf81c3bd-10b8-4caf-bd23-34b2c00e0e98 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Request method failure captured: Sep 16 12:53:26.414150 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/images/a14d99e9-0c3f-4440-a1b8-2513d1ea03c3 HTTP/1.1 Sep 16 12:53:26.414150 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:53:26.414150 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:53:26.414150 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:53:26.414150 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:53:26.414150 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:53:26.414150 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:53:26.414150 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:53:26.414150 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:53:26.414150 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHGC1tLC4Hwvx6NHhPA7kXnEWOqckp907sAMNKZNblBrHEC1mNwTYzTCvIQfMCl7A4tTw0g1fnaX_HyKI_f-70EvldXE1PJoBDtPX0XHIrxwLJLAfXY_1lCY4JPxZ1UFIZK-I060ouY7VXyXkfdKzmkeNXUl-Nyj1oJ2vxDk_ZtwTbo Sep 16 12:53:26.414150 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:53:26.414150 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:53:26.414150 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:53:26.414150 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:53:26.414150 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:53:26.414150 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:53:26.414150 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 69b7d059fb70415fb5dc20e3a921d189 Sep 16 12:53:26.414150 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ImagesOneServerTestJSON-2064562372 Sep 16 12:53:26.414150 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:53:26.414150 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:53:26.415787 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/69b7d059fb70415fb5dc20e3a921d189"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/69b7d059fb70415fb5dc20e3a921d189"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_69b7d059fb70415fb5dc20e3a921d189", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/69b7d059fb70415fb5dc20e3a921d189"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:53:26.415787 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ImagesOneServerTestJSON-2064562372 Sep 16 12:53:26.415787 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 69b7d059fb70415fb5dc20e3a921d189 Sep 16 12:53:26.415787 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2064562372 Sep 16 12:53:26.415787 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ImagesOneServerTestJSON-2064562372-project Sep 16 12:53:26.415787 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:53:26.415787 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:53:26.415787 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 45d4c5f7ddf5432ba8b4eac2cb6a9860 Sep 16 12:53:26.415787 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ImagesOneServerTestJSON-2064562372-project Sep 16 12:53:26.415787 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 12:53:26.415787 n-d-858094-4 devstack@n-api.service[128780]: exception: Image not found. Sep 16 12:53:26.415787 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'a14d99e9-0c3f-4440-a1b8-2513d1ea03c3'} Sep 16 12:53:26.415787 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:53:26.417551 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:53:26.417551 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 16 12:53:26.417551 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 16 12:53:26.417551 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 12:53:26.417551 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 12:53:26.417551 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 16 12:53:26.417551 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 16 12:53:26.417551 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 12:53:26.417551 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 12:53:26.417551 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 16 12:53:26.417551 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 16 12:53:26.417551 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 16 12:53:26.417551 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 16 12:53:26.417551 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 12:53:26.417551 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 12:53:26.417551 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 12:53:26.417551 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 12:53:26.417551 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a14d99e9-0c3f-4440-a1b8-2513d1ea03c3 Sep 16 12:53:26.418849 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:53:26.418849 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:53:26.418849 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:53:26.418849 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:53:26.418849 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 16 12:53:26.418849 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 16 12:53:26.418849 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 16 12:53:26.418849 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 16 12:53:26.418849 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 16 12:53:26.418849 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 16 12:53:26.418849 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 16 12:53:26.418849 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 16 12:53:26.418849 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 16 12:53:26.418849 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 16 12:53:26.418849 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 12:53:26.418849 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 12:53:26.418849 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 16 12:53:26.418849 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 16 12:53:26.418849 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 12:53:26.418849 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 12:53:26.420212 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 16 12:53:26.420212 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 16 12:53:26.420212 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 16 12:53:26.420212 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 16 12:53:26.420212 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 12:53:26.420212 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 12:53:26.420212 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 12:53:26.420212 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 12:53:26.420212 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a14d99e9-0c3f-4440-a1b8-2513d1ea03c3 could not be found. Sep 16 12:53:26.420212 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:53:26.420212 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:53:26.420212 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:53:26.420212 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:53:26.420212 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:53:26.420212 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:53:26.420212 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:53:26.420212 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:53:26.420212 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:53:26.420212 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:53:26.421616 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:53:26.421616 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:53:26.421616 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 16 12:53:26.421616 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 16 12:53:26.421616 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 12:53:26.421616 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:53:26.421616 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:53:26.421616 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:53:26.421616 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:53:26.421616 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:53:26.421616 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:53:26.421616 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:53:26.421616 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:53:26.421616 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 12:53:26.421616 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:53:26.421616 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-cf81c3bd-10b8-4caf-bd23-34b2c00e0e98 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Returning 404 to user: Image not found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:53:26.421616 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-cf81c3bd-10b8-4caf-bd23-34b2c00e0e98 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/images/a14d99e9-0c3f-4440-a1b8-2513d1ea03c3" status: 404 len: 62 microversion: 2.1 time: 0.064331 Sep 16 12:53:26.422822 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 958/1965] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:53:26 2022] GET /compute/v2.1/images/a14d99e9-0c3f-4440-a1b8-2513d1ea03c3 => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 12:53:26.430688 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-92480bd2-f488-4c31-a9d8-e5b6d9dcc957 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:26.431322 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-92480bd2-f488-4c31-a9d8-e5b6d9dcc957 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:26.460471 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92480bd2-f488-4c31-a9d8-e5b6d9dcc957 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:26.461170 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92480bd2-f488-4c31-a9d8-e5b6d9dcc957 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:26.462302 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92480bd2-f488-4c31-a9d8-e5b6d9dcc957 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:26.463113 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92480bd2-f488-4c31-a9d8-e5b6d9dcc957 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:26.463572 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92480bd2-f488-4c31-a9d8-e5b6d9dcc957 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:26.463997 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92480bd2-f488-4c31-a9d8-e5b6d9dcc957 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:26.580795 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-92480bd2-f488-4c31-a9d8-e5b6d9dcc957 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:26.605499 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-92480bd2-f488-4c31-a9d8-e5b6d9dcc957 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1295 microversion: 2.1 time: 0.180304 Sep 16 12:53:26.607854 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 959/1966] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:26 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1295 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:26.626674 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7042712a-8313-4974-87f6-a6a070251824 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:26.628466 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7042712a-8313-4974-87f6-a6a070251824 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 227a8a0b-2a0c-48f8-976a-a176a9039a2d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:26.643374 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:53:26.647397 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7042712a-8313-4974-87f6-a6a070251824 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:26.647900 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7042712a-8313-4974-87f6-a6a070251824 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:26.648373 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7042712a-8313-4974-87f6-a6a070251824 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:26.657188 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7042712a-8313-4974-87f6-a6a070251824 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:26.658010 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7042712a-8313-4974-87f6-a6a070251824 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:26.658651 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7042712a-8313-4974-87f6-a6a070251824 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:26.661143 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cd947a6c-87da-46c6-b37e-4d79fd6737b5 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:26.682803 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cd947a6c-87da-46c6-b37e-4d79fd6737b5 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1534 microversion: 2.1 time: 0.593109 Sep 16 12:53:26.708148 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1008/1967] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:26 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1534 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:26.717489 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-e8fe0fe8-1e9e-482f-95b5-aaa4c3cba6ec req-f84342ec-8be4-4dbf-b710-2cd8941aeea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8c8969d-7c0d-4bfe-bd49-6271193614b9", "name": "network-vif-plugged", "status": "completed", "tag": "7612ea0a-26f5-4749-ac66-963beed5e38a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:26.738404 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e8fe0fe8-1e9e-482f-95b5-aaa4c3cba6ec req-f84342ec-8be4-4dbf-b710-2cd8941aeea3 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:26.739656 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e8fe0fe8-1e9e-482f-95b5-aaa4c3cba6ec req-f84342ec-8be4-4dbf-b710-2cd8941aeea3 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:26.740793 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e8fe0fe8-1e9e-482f-95b5-aaa4c3cba6ec req-f84342ec-8be4-4dbf-b710-2cd8941aeea3 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:26.763838 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-e8fe0fe8-1e9e-482f-95b5-aaa4c3cba6ec req-f84342ec-8be4-4dbf-b710-2cd8941aeea3 service nova] Creating event network-vif-plugged:7612ea0a-26f5-4749-ac66-963beed5e38a for instance e8c8969d-7c0d-4bfe-bd49-6271193614b9 on n-h1-858094-4 Sep 16 12:53:26.771100 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-e8fe0fe8-1e9e-482f-95b5-aaa4c3cba6ec req-f84342ec-8be4-4dbf-b710-2cd8941aeea3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060761 Sep 16 12:53:26.772565 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1009/1968] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:53:26.780632 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dca9fb00-9490-4699-a34b-335a0c28b7d8 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:26.781739 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dca9fb00-9490-4699-a34b-335a0c28b7d8 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] [instance: c97d5f35-6ea1-4ec7-88f5-9da9dbe81182] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:26.789667 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dca9fb00-9490-4699-a34b-335a0c28b7d8 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:26.790561 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dca9fb00-9490-4699-a34b-335a0c28b7d8 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:26.791282 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dca9fb00-9490-4699-a34b-335a0c28b7d8 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:26.792600 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dca9fb00-9490-4699-a34b-335a0c28b7d8 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:26.793617 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dca9fb00-9490-4699-a34b-335a0c28b7d8 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:26.794291 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dca9fb00-9490-4699-a34b-335a0c28b7d8 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:27.055886 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7042712a-8313-4974-87f6-a6a070251824 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9101f5af9e34d21bb8e872d337d3545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e41136645964ea98a675833bd73299f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:27.065835 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7042712a-8313-4974-87f6-a6a070251824 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "GET /compute/v2.1/servers/227a8a0b-2a0c-48f8-976a-a176a9039a2d" status: 200 len: 1282 microversion: 2.1 time: 0.454994 Sep 16 12:53:27.073991 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 960/1969] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:26 2022] GET /compute/v2.1/servers/227a8a0b-2a0c-48f8-976a-a176a9039a2d => generated 1282 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:27.079063 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-95a619c8-4b86-481b-bf54-dbde52c61498 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1754509110"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:27.089905 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-95a619c8-4b86-481b-bf54-dbde52c61498 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] [instance: 345ee81d-c503-421c-90ea-218ac1c98600] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:27.106018 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-95a619c8-4b86-481b-bf54-dbde52c61498 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:27.106920 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-95a619c8-4b86-481b-bf54-dbde52c61498 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:27.107587 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-95a619c8-4b86-481b-bf54-dbde52c61498 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:27.108565 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-95a619c8-4b86-481b-bf54-dbde52c61498 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:27.109247 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-95a619c8-4b86-481b-bf54-dbde52c61498 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:27.109894 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-95a619c8-4b86-481b-bf54-dbde52c61498 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:27.303033 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dca9fb00-9490-4699-a34b-335a0c28b7d8 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63998619bf654ebb8d74f91e42c8c780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e81fca8624d18b9415a46e158d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:27.316957 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dca9fb00-9490-4699-a34b-335a0c28b7d8 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182" status: 200 len: 1466 microversion: 2.1 time: 0.541146 Sep 16 12:53:27.333339 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1010/1970] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:26 2022] GET /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182 => generated 1466 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:27.347445 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-13dcd117-868b-4df4-a1d2-04f4bcdfca7c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:27.348072 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-13dcd117-868b-4df4-a1d2-04f4bcdfca7c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:27.363004 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13dcd117-868b-4df4-a1d2-04f4bcdfca7c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:27.363498 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13dcd117-868b-4df4-a1d2-04f4bcdfca7c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:27.363938 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13dcd117-868b-4df4-a1d2-04f4bcdfca7c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:27.364678 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13dcd117-868b-4df4-a1d2-04f4bcdfca7c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:27.365132 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13dcd117-868b-4df4-a1d2-04f4bcdfca7c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:27.365557 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13dcd117-868b-4df4-a1d2-04f4bcdfca7c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:27.762373 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-95a619c8-4b86-481b-bf54-dbde52c61498 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "POST /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600/action" status: 202 len: 0 microversion: 2.1 time: 0.681730 Sep 16 12:53:27.766840 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 961/1971] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:53:27 2022] POST /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600/action => generated 0 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 16 12:53:27.792629 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3c7ecb71-0d0e-4352-83fb-39bc6f990da8 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:27.795176 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3c7ecb71-0d0e-4352-83fb-39bc6f990da8 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] [instance: 5219baf4-bfde-4037-a511-88ff2690ea6a] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:27.818636 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3c7ecb71-0d0e-4352-83fb-39bc6f990da8 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:27.820256 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3c7ecb71-0d0e-4352-83fb-39bc6f990da8 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:27.823120 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3c7ecb71-0d0e-4352-83fb-39bc6f990da8 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:27.824109 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3c7ecb71-0d0e-4352-83fb-39bc6f990da8 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:27.824830 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3c7ecb71-0d0e-4352-83fb-39bc6f990da8 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:27.825829 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3c7ecb71-0d0e-4352-83fb-39bc6f990da8 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:27.844898 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-13dcd117-868b-4df4-a1d2-04f4bcdfca7c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:27.857915 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-13dcd117-868b-4df4-a1d2-04f4bcdfca7c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1211 microversion: 2.1 time: 0.521723 Sep 16 12:53:27.860185 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1011/1972] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:27 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1211 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:27.866769 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0a6a8165-cc5d-4404-90f0-8eecf0a75bf7 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:27.867695 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0a6a8165-cc5d-4404-90f0-8eecf0a75bf7 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] [instance: e8c8969d-7c0d-4bfe-bd49-6271193614b9] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:27.889790 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a6a8165-cc5d-4404-90f0-8eecf0a75bf7 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:27.894119 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a6a8165-cc5d-4404-90f0-8eecf0a75bf7 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:27.897825 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a6a8165-cc5d-4404-90f0-8eecf0a75bf7 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:27.899146 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a6a8165-cc5d-4404-90f0-8eecf0a75bf7 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:27.901009 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a6a8165-cc5d-4404-90f0-8eecf0a75bf7 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:27.902334 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a6a8165-cc5d-4404-90f0-8eecf0a75bf7 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:28.328439 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3c7ecb71-0d0e-4352-83fb-39bc6f990da8 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63998619bf654ebb8d74f91e42c8c780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e81fca8624d18b9415a46e158d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:28.339755 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3c7ecb71-0d0e-4352-83fb-39bc6f990da8 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/servers/5219baf4-bfde-4037-a511-88ff2690ea6a" status: 200 len: 1466 microversion: 2.1 time: 0.571314 Sep 16 12:53:28.353881 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 962/1973] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:27 2022] GET /compute/v2.1/servers/5219baf4-bfde-4037-a511-88ff2690ea6a => generated 1466 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:28.367979 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7374a804-fd4c-444c-924f-080e8c074dfe tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:28.369560 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7374a804-fd4c-444c-924f-080e8c074dfe tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:28.378254 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7374a804-fd4c-444c-924f-080e8c074dfe tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:28.378752 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7374a804-fd4c-444c-924f-080e8c074dfe tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:28.379190 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7374a804-fd4c-444c-924f-080e8c074dfe tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:28.379902 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7374a804-fd4c-444c-924f-080e8c074dfe tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:28.380386 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7374a804-fd4c-444c-924f-080e8c074dfe tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:28.381132 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7374a804-fd4c-444c-924f-080e8c074dfe tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:28.391783 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0a6a8165-cc5d-4404-90f0-8eecf0a75bf7 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c5683ddbb047348d4924b7ce957472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10cd073476b420c89d93ce9c5a608c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:28.402759 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0a6a8165-cc5d-4404-90f0-8eecf0a75bf7 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] 10.222.0.67 "GET /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9" status: 200 len: 1316 microversion: 2.1 time: 0.538622 Sep 16 12:53:28.416163 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1012/1974] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:27 2022] GET /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9 => generated 1316 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:28.416163 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4df3f256-4841-4ae5-841e-ae52047c6ae8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:28.416163 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4df3f256-4841-4ae5-841e-ae52047c6ae8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:28.424785 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4df3f256-4841-4ae5-841e-ae52047c6ae8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:28.425590 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4df3f256-4841-4ae5-841e-ae52047c6ae8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:28.426233 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4df3f256-4841-4ae5-841e-ae52047c6ae8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:28.427163 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4df3f256-4841-4ae5-841e-ae52047c6ae8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:28.427987 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4df3f256-4841-4ae5-841e-ae52047c6ae8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:28.428639 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4df3f256-4841-4ae5-841e-ae52047c6ae8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:28.469826 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4df3f256-4841-4ae5-841e-ae52047c6ae8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:28.470698 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4df3f256-4841-4ae5-841e-ae52047c6ae8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:28.471768 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4df3f256-4841-4ae5-841e-ae52047c6ae8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:28.472464 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-4df3f256-4841-4ae5-841e-ae52047c6ae8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lazy-loading 'fault' on Instance uuid a439c4ea-46f5-4571-9d87-96a91a6359f7 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:53:28.595605 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4df3f256-4841-4ae5-841e-ae52047c6ae8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:28.605568 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4df3f256-4841-4ae5-841e-ae52047c6ae8 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 200 len: 1368 microversion: 2.1 time: 0.200630 Sep 16 12:53:28.625573 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1013/1975] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:28 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 1368 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:28.640069 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-8e51d7ec-f6f8-4997-be6c-f1ac5064e704 req-3fa93cc9-568e-4ff2-aaa3-8a2e5e129068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a439c4ea-46f5-4571-9d87-96a91a6359f7", "name": "network-vif-deleted", "tag": "76e2deeb-80ac-4c0d-98b8-96091a5ab0d2"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:28.660468 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8e51d7ec-f6f8-4997-be6c-f1ac5064e704 req-3fa93cc9-568e-4ff2-aaa3-8a2e5e129068 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:28.661055 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8e51d7ec-f6f8-4997-be6c-f1ac5064e704 req-3fa93cc9-568e-4ff2-aaa3-8a2e5e129068 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:28.662201 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8e51d7ec-f6f8-4997-be6c-f1ac5064e704 req-3fa93cc9-568e-4ff2-aaa3-8a2e5e129068 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:28.677324 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-8e51d7ec-f6f8-4997-be6c-f1ac5064e704 req-3fa93cc9-568e-4ff2-aaa3-8a2e5e129068 service nova] Creating event network-vif-deleted:76e2deeb-80ac-4c0d-98b8-96091a5ab0d2 for instance a439c4ea-46f5-4571-9d87-96a91a6359f7 on n-h2-858094-4 Sep 16 12:53:28.686511 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-8e51d7ec-f6f8-4997-be6c-f1ac5064e704 req-3fa93cc9-568e-4ff2-aaa3-8a2e5e129068 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057745 Sep 16 12:53:28.687283 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1014/1976] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:53:28.694164 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f57cdc38-f276-4524-99e1-a8fdde341437 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '.version_select at 0x7f103526ec10>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:28.763508 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f57cdc38-f276-4524-99e1-a8fdde341437 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/images/186744c5-e6ba-4599-82dd-52b3517a8795" status: 200 len: 1429 microversion: 2.1 time: 0.074392 Sep 16 12:53:28.764913 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1015/1977] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:53:28 2022] GET /compute/v2.1/images/186744c5-e6ba-4599-82dd-52b3517a8795 => generated 1429 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:28.772783 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4bfc73ef-060f-4cfe-9ff2-95b552e80be5 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:28.773954 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4bfc73ef-060f-4cfe-9ff2-95b552e80be5 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 227a8a0b-2a0c-48f8-976a-a176a9039a2d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:28.781843 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4bfc73ef-060f-4cfe-9ff2-95b552e80be5 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:28.782704 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4bfc73ef-060f-4cfe-9ff2-95b552e80be5 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:28.783429 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4bfc73ef-060f-4cfe-9ff2-95b552e80be5 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:28.785119 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4bfc73ef-060f-4cfe-9ff2-95b552e80be5 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:28.785830 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4bfc73ef-060f-4cfe-9ff2-95b552e80be5 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:28.786648 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4bfc73ef-060f-4cfe-9ff2-95b552e80be5 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:28.819883 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:53:29.011425 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7374a804-fd4c-444c-924f-080e8c074dfe tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:29.027644 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7374a804-fd4c-444c-924f-080e8c074dfe tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1362 microversion: 2.1 time: 0.665996 Sep 16 12:53:29.028361 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 963/1978] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:28 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1362 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:29.033221 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3f2866cf-9343-46bd-8bd3-67afec380c77 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1653858688"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:29.042032 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3f2866cf-9343-46bd-8bd3-67afec380c77 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] [instance: 5219baf4-bfde-4037-a511-88ff2690ea6a] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:29.062907 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3f2866cf-9343-46bd-8bd3-67afec380c77 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:29.067638 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3f2866cf-9343-46bd-8bd3-67afec380c77 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:29.068533 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3f2866cf-9343-46bd-8bd3-67afec380c77 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:29.069676 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3f2866cf-9343-46bd-8bd3-67afec380c77 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:29.070515 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3f2866cf-9343-46bd-8bd3-67afec380c77 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:29.071688 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3f2866cf-9343-46bd-8bd3-67afec380c77 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:29.137666 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:53:29.193960 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4bfc73ef-060f-4cfe-9ff2-95b552e80be5 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9101f5af9e34d21bb8e872d337d3545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e41136645964ea98a675833bd73299f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:29.207217 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4bfc73ef-060f-4cfe-9ff2-95b552e80be5 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "GET /compute/v2.1/servers/227a8a0b-2a0c-48f8-976a-a176a9039a2d" status: 200 len: 1324 microversion: 2.1 time: 0.440909 Sep 16 12:53:29.210849 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1016/1979] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:28 2022] GET /compute/v2.1/servers/227a8a0b-2a0c-48f8-976a-a176a9039a2d => generated 1324 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:29.218686 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-7702c2ee-83e9-433c-96cf-bb815c0941c0 req-f183a647-6672-493d-ba43-1bdaa2181ef2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "345ee81d-c503-421c-90ea-218ac1c98600", "name": "network-vif-unplugged", "status": "completed", "tag": "56c49806-0b21-4f4b-9b96-195fc33fcba5"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:29.234962 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7702c2ee-83e9-433c-96cf-bb815c0941c0 req-f183a647-6672-493d-ba43-1bdaa2181ef2 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:29.235750 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7702c2ee-83e9-433c-96cf-bb815c0941c0 req-f183a647-6672-493d-ba43-1bdaa2181ef2 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:29.236381 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7702c2ee-83e9-433c-96cf-bb815c0941c0 req-f183a647-6672-493d-ba43-1bdaa2181ef2 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:29.256007 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-7702c2ee-83e9-433c-96cf-bb815c0941c0 req-f183a647-6672-493d-ba43-1bdaa2181ef2 service nova] Creating event network-vif-unplugged:56c49806-0b21-4f4b-9b96-195fc33fcba5 for instance 345ee81d-c503-421c-90ea-218ac1c98600 on n-h1-858094-4 Sep 16 12:53:29.272361 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-7702c2ee-83e9-433c-96cf-bb815c0941c0 req-f183a647-6672-493d-ba43-1bdaa2181ef2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060014 Sep 16 12:53:29.277239 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1017/1980] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:53:29.282680 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0d303868-1236-4c4e-990f-9003e2efd241 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:29.287129 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0d303868-1236-4c4e-990f-9003e2efd241 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:29.300419 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d303868-1236-4c4e-990f-9003e2efd241 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:29.301310 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d303868-1236-4c4e-990f-9003e2efd241 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:29.301997 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d303868-1236-4c4e-990f-9003e2efd241 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:29.303279 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d303868-1236-4c4e-990f-9003e2efd241 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:29.304062 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d303868-1236-4c4e-990f-9003e2efd241 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:29.304807 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d303868-1236-4c4e-990f-9003e2efd241 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:29.457165 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3f2866cf-9343-46bd-8bd3-67afec380c77 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "POST /compute/v2.1/servers/5219baf4-bfde-4037-a511-88ff2690ea6a/action" status: 202 len: 0 microversion: 2.1 time: 0.427133 Sep 16 12:53:29.458532 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 964/1981] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:53:29 2022] POST /compute/v2.1/servers/5219baf4-bfde-4037-a511-88ff2690ea6a/action => generated 0 bytes in 429 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 16 12:53:29.464919 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-93cf60bc-a8e8-49e0-af59-26b2805326da tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:29.465978 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-93cf60bc-a8e8-49e0-af59-26b2805326da tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] [instance: e8c8969d-7c0d-4bfe-bd49-6271193614b9] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:29.476501 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-93cf60bc-a8e8-49e0-af59-26b2805326da tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:29.476989 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-93cf60bc-a8e8-49e0-af59-26b2805326da tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:29.477427 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-93cf60bc-a8e8-49e0-af59-26b2805326da tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:29.479617 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-93cf60bc-a8e8-49e0-af59-26b2805326da tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:29.480112 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-93cf60bc-a8e8-49e0-af59-26b2805326da tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:29.481036 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-93cf60bc-a8e8-49e0-af59-26b2805326da tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:29.637325 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0d303868-1236-4c4e-990f-9003e2efd241 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:29.648891 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0d303868-1236-4c4e-990f-9003e2efd241 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1211 microversion: 2.1 time: 0.370147 Sep 16 12:53:29.649572 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1018/1982] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:29 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1211 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:29.655349 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-91c8344c-b95f-4b48-9db0-d9f256173a4c tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f1035235b80>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:29.725299 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-91c8344c-b95f-4b48-9db0-d9f256173a4c tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/0c37e3b2-0f5c-45c2-a28a-7e732c529930" status: 200 len: 1453 microversion: 2.1 time: 0.071285 Sep 16 12:53:29.734465 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1019/1983] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:53:29 2022] GET /compute/v2.1/images/0c37e3b2-0f5c-45c2-a28a-7e732c529930 => generated 1453 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:29.746566 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b7d928e0-88e2-449d-99e1-7e3f9682ba12 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:29.747191 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b7d928e0-88e2-449d-99e1-7e3f9682ba12 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: a439c4ea-46f5-4571-9d87-96a91a6359f7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:29.753973 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7d928e0-88e2-449d-99e1-7e3f9682ba12 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:29.755389 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7d928e0-88e2-449d-99e1-7e3f9682ba12 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:29.756016 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7d928e0-88e2-449d-99e1-7e3f9682ba12 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:29.756941 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7d928e0-88e2-449d-99e1-7e3f9682ba12 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:29.757567 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7d928e0-88e2-449d-99e1-7e3f9682ba12 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:29.758159 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7d928e0-88e2-449d-99e1-7e3f9682ba12 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:29.776479 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-93cf60bc-a8e8-49e0-af59-26b2805326da tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c5683ddbb047348d4924b7ce957472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10cd073476b420c89d93ce9c5a608c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:29.776842 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-b7d928e0-88e2-449d-99e1-7e3f9682ba12 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] HTTP exception thrown: Instance a439c4ea-46f5-4571-9d87-96a91a6359f7 could not be found. Sep 16 12:53:29.778749 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b7d928e0-88e2-449d-99e1-7e3f9682ba12 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Request method failure captured: Sep 16 12:53:29.778749 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 HTTP/1.1 Sep 16 12:53:29.778749 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:53:29.778749 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:53:29.778749 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:53:29.778749 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:53:29.778749 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:53:29.778749 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:53:29.778749 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:53:29.778749 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:53:29.778749 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHBRVCNZh7s3qiWk8e7dDntjLmx7Uq1o7Yz49PjdhXkeDEhxCJvSqDNaxFYD4ZTfwTB9gBWkkSsrzbdLOsywrJgACtdvqsMnejhS1OJL2U_sNrRKxh64yJLlkXbgE9PesdSsC3g-sqzkc1hnbiJ_-JHqu8VW7vvaYO1adojxOefjq2Q Sep 16 12:53:29.778749 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:53:29.778749 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:53:29.778749 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:53:29.778749 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:53:29.778749 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:53:29.778749 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:53:29.778749 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 0b18ec5302634d2a95e51547e0019d40 Sep 16 12:53:29.778749 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-MigrationsAdminTest-25653665 Sep 16 12:53:29.778749 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:53:29.778749 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:53:29.780840 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0b18ec5302634d2a95e51547e0019d40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0b18ec5302634d2a95e51547e0019d40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0b18ec5302634d2a95e51547e0019d40", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0b18ec5302634d2a95e51547e0019d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:53:29.780840 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-MigrationsAdminTest-25653665 Sep 16 12:53:29.780840 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 0b18ec5302634d2a95e51547e0019d40 Sep 16 12:53:29.780840 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-MigrationsAdminTest-25653665 Sep 16 12:53:29.780840 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-MigrationsAdminTest-25653665-project Sep 16 12:53:29.780840 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:53:29.780840 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:53:29.780840 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: f3e2827a76d14e4a88c4562f1c0351ac Sep 16 12:53:29.780840 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-MigrationsAdminTest-25653665-project Sep 16 12:53:29.780840 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:53:29.780840 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance a439c4ea-46f5-4571-9d87-96a91a6359f7 could not be found. Sep 16 12:53:29.780840 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': 'a439c4ea-46f5-4571-9d87-96a91a6359f7'} Sep 16 12:53:29.781956 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:53:29.781956 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:53:29.781956 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:53:29.781956 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:53:29.781956 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:53:29.781956 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:53:29.781956 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:53:29.781956 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:53:29.781956 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:53:29.781956 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:53:29.781956 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a439c4ea-46f5-4571-9d87-96a91a6359f7 could not be found. Sep 16 12:53:29.781956 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:53:29.781956 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:53:29.781956 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:53:29.781956 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:53:29.781956 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:53:29.781956 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:53:29.781956 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:53:29.781956 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:53:29.781956 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:53:29.783829 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:53:29.783829 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:53:29.783829 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:53:29.783829 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:53:29.783829 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:53:29.783829 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:53:29.783829 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:53:29.783829 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a439c4ea-46f5-4571-9d87-96a91a6359f7 could not be found. Sep 16 12:53:29.783829 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:53:29.783829 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:53:29.783829 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:53:29.783829 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:53:29.783829 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:53:29.783829 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:53:29.783829 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:53:29.783829 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:53:29.783829 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a439c4ea-46f5-4571-9d87-96a91a6359f7 could not be found. Sep 16 12:53:29.783829 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:53:29.786875 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b7d928e0-88e2-449d-99e1-7e3f9682ba12 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Returning 404 to user: Instance a439c4ea-46f5-4571-9d87-96a91a6359f7 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:53:29.788621 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b7d928e0-88e2-449d-99e1-7e3f9682ba12 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7" status: 404 len: 111 microversion: 2.1 time: 0.052959 Sep 16 12:53:29.789674 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1020/1984] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:29 2022] GET /compute/v2.1/servers/a439c4ea-46f5-4571-9d87-96a91a6359f7 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:53:29.795835 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-7b940445-71b1-44f7-8235-9e43cdc3fbbf req-7fafad33-bd4a-4969-af6b-d53dfbad4f52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "227a8a0b-2a0c-48f8-976a-a176a9039a2d", "tag": "586b7cfc-f67a-48f3-beb9-5cd2ca16334c"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:29.797547 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-93cf60bc-a8e8-49e0-af59-26b2805326da tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] 10.222.0.67 "GET /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9" status: 200 len: 1504 microversion: 2.1 time: 0.337706 Sep 16 12:53:29.798153 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 965/1985] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:29 2022] GET /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9 => generated 1504 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:29.804045 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ec0422ee-47af-49e4-a2a3-a460b7ebc885 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '.version_select at 0x7f1035ee34c0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:29.806920 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7b940445-71b1-44f7-8235-9e43cdc3fbbf req-7fafad33-bd4a-4969-af6b-d53dfbad4f52 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:29.807624 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7b940445-71b1-44f7-8235-9e43cdc3fbbf req-7fafad33-bd4a-4969-af6b-d53dfbad4f52 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:29.808252 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7b940445-71b1-44f7-8235-9e43cdc3fbbf req-7fafad33-bd4a-4969-af6b-d53dfbad4f52 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:29.855090 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-7b940445-71b1-44f7-8235-9e43cdc3fbbf req-7fafad33-bd4a-4969-af6b-d53dfbad4f52 service nova] Creating event network-changed:586b7cfc-f67a-48f3-beb9-5cd2ca16334c for instance 227a8a0b-2a0c-48f8-976a-a176a9039a2d on n-h2-858094-4 Sep 16 12:53:29.860587 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-7b940445-71b1-44f7-8235-9e43cdc3fbbf req-7fafad33-bd4a-4969-af6b-d53dfbad4f52 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068375 Sep 16 12:53:29.873375 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1021/1986] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:53:29.879632 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ec0422ee-47af-49e4-a2a3-a460b7ebc885 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/images/186744c5-e6ba-4599-82dd-52b3517a8795" status: 200 len: 1429 microversion: 2.1 time: 0.079998 Sep 16 12:53:29.882159 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dcd44c61-1706-447a-b86f-85cfbf7e7fd2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '.version_select at 0x7f103546ca60>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:29.893454 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 966/1987] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:53:29 2022] GET /compute/v2.1/images/186744c5-e6ba-4599-82dd-52b3517a8795 => generated 1429 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:29.901475 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-19291453-fb37-442e-88ac-48c51647cc3f tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:29.901995 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-19291453-fb37-442e-88ac-48c51647cc3f tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] [instance: e8c8969d-7c0d-4bfe-bd49-6271193614b9] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:29.909374 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dcd44c61-1706-447a-b86f-85cfbf7e7fd2 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2047555437" status: 202 len: 0 microversion: 2.1 time: 0.033224 Sep 16 12:53:29.910758 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1022/1988] 10.222.0.67 () {58 vars in 1221 bytes} [Fri Sep 16 12:53:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2047555437 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:53:29.917138 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19291453-fb37-442e-88ac-48c51647cc3f tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:29.917269 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19291453-fb37-442e-88ac-48c51647cc3f tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:29.917675 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19291453-fb37-442e-88ac-48c51647cc3f tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:29.918406 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19291453-fb37-442e-88ac-48c51647cc3f tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:29.918943 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19291453-fb37-442e-88ac-48c51647cc3f tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:29.919389 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19291453-fb37-442e-88ac-48c51647cc3f tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:29.950625 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-19291453-fb37-442e-88ac-48c51647cc3f tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] [instance: e8c8969d-7c0d-4bfe-bd49-6271193614b9] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:53:30.056578 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-87fd9ad9-2cd7-47b5-b5f9-746d4d80bc6b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:30.057598 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-87fd9ad9-2cd7-47b5-b5f9-746d4d80bc6b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:30.064799 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87fd9ad9-2cd7-47b5-b5f9-746d4d80bc6b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:30.065829 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87fd9ad9-2cd7-47b5-b5f9-746d4d80bc6b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:30.066553 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87fd9ad9-2cd7-47b5-b5f9-746d4d80bc6b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:30.067538 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87fd9ad9-2cd7-47b5-b5f9-746d4d80bc6b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:30.068289 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87fd9ad9-2cd7-47b5-b5f9-746d4d80bc6b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:30.069205 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87fd9ad9-2cd7-47b5-b5f9-746d4d80bc6b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:30.074551 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-19291453-fb37-442e-88ac-48c51647cc3f tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9" status: 204 len: 0 microversion: 2.1 time: 0.179651 Sep 16 12:53:30.075408 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 967/1989] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:53:29 2022] DELETE /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:53:30.086114 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3279363c-84dc-44a1-adf0-55d155f16a2c tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:30.087099 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3279363c-84dc-44a1-adf0-55d155f16a2c tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] [instance: e8c8969d-7c0d-4bfe-bd49-6271193614b9] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:30.095125 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3279363c-84dc-44a1-adf0-55d155f16a2c tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:30.095862 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3279363c-84dc-44a1-adf0-55d155f16a2c tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:30.096351 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3279363c-84dc-44a1-adf0-55d155f16a2c tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:30.097254 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3279363c-84dc-44a1-adf0-55d155f16a2c tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:30.097770 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3279363c-84dc-44a1-adf0-55d155f16a2c tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:30.098360 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3279363c-84dc-44a1-adf0-55d155f16a2c tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:30.934866 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-87fd9ad9-2cd7-47b5-b5f9-746d4d80bc6b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:30.943030 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-87fd9ad9-2cd7-47b5-b5f9-746d4d80bc6b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1362 microversion: 2.1 time: 0.890666 Sep 16 12:53:30.943623 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1023/1990] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:30 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1362 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:30.949514 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-25b242f3-1f6d-4d5a-a023-cd167a6d9f63 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:30.950163 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-25b242f3-1f6d-4d5a-a023-cd167a6d9f63 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 227a8a0b-2a0c-48f8-976a-a176a9039a2d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:30.956613 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25b242f3-1f6d-4d5a-a023-cd167a6d9f63 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:30.957144 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25b242f3-1f6d-4d5a-a023-cd167a6d9f63 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:30.957617 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25b242f3-1f6d-4d5a-a023-cd167a6d9f63 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:30.958283 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25b242f3-1f6d-4d5a-a023-cd167a6d9f63 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:30.958930 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25b242f3-1f6d-4d5a-a023-cd167a6d9f63 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:30.959358 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25b242f3-1f6d-4d5a-a023-cd167a6d9f63 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:30.961095 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3279363c-84dc-44a1-adf0-55d155f16a2c tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c5683ddbb047348d4924b7ce957472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10cd073476b420c89d93ce9c5a608c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:30.971312 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3279363c-84dc-44a1-adf0-55d155f16a2c tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] 10.222.0.67 "GET /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9" status: 200 len: 1510 microversion: 2.1 time: 0.891222 Sep 16 12:53:30.972417 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 968/1991] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:30 2022] GET /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9 => generated 1510 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:30.977934 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9ce56427-2613-4014-801d-3206b99d0fe6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-434291063", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": [{"uuid": "1e927054-126f-4e94-8719-fa14f3244a7f"}], "security_groups": [{"name": "tempest-securitygroup--2135770466"}], "key_name": "tempest-keypair-1607659794", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:31.068296 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:53:31.092915 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=6 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:53:31.175456 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-9ce56427-2613-4014-801d-3206b99d0fe6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] validate_networks() for [('1e927054-126f-4e94-8719-fa14f3244a7f', None, None, None, None, None)] {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:53:31.232096 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-25b242f3-1f6d-4d5a-a023-cd167a6d9f63 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9101f5af9e34d21bb8e872d337d3545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e41136645964ea98a675833bd73299f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:31.242138 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-25b242f3-1f6d-4d5a-a023-cd167a6d9f63 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "GET /compute/v2.1/servers/227a8a0b-2a0c-48f8-976a-a176a9039a2d" status: 200 len: 1324 microversion: 2.1 time: 0.297337 Sep 16 12:53:31.259784 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1024/1992] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:30 2022] GET /compute/v2.1/servers/227a8a0b-2a0c-48f8-976a-a176a9039a2d => generated 1324 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:31.259784 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e22babce-4b31-4564-aa37-95c13b0c64c1 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:31.259784 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e22babce-4b31-4564-aa37-95c13b0c64c1 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:31.263891 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e22babce-4b31-4564-aa37-95c13b0c64c1 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:31.264868 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e22babce-4b31-4564-aa37-95c13b0c64c1 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:31.265496 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e22babce-4b31-4564-aa37-95c13b0c64c1 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:31.266727 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e22babce-4b31-4564-aa37-95c13b0c64c1 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:31.267180 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e22babce-4b31-4564-aa37-95c13b0c64c1 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:31.267601 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e22babce-4b31-4564-aa37-95c13b0c64c1 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:31.285708 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:53:31.529866 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e22babce-4b31-4564-aa37-95c13b0c64c1 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:31.543054 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e22babce-4b31-4564-aa37-95c13b0c64c1 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1199 microversion: 2.1 time: 0.297612 Sep 16 12:53:31.544433 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1025/1993] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:31 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1199 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:31.549345 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-213a5e87-698a-4231-a92c-302c248a6fbc req-897ee4ea-ead8-4d60-8e0b-92d7394cc023 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ad8536a-46b8-4821-8fb0-2c743927bb88", "tag": "c0c1968f-d991-4e36-8062-6ff62eb7adfb"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:31.561847 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-213a5e87-698a-4231-a92c-302c248a6fbc req-897ee4ea-ead8-4d60-8e0b-92d7394cc023 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:31.562391 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-213a5e87-698a-4231-a92c-302c248a6fbc req-897ee4ea-ead8-4d60-8e0b-92d7394cc023 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:31.562914 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-213a5e87-698a-4231-a92c-302c248a6fbc req-897ee4ea-ead8-4d60-8e0b-92d7394cc023 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:31.578066 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-213a5e87-698a-4231-a92c-302c248a6fbc req-897ee4ea-ead8-4d60-8e0b-92d7394cc023 service nova] Creating event network-changed:c0c1968f-d991-4e36-8062-6ff62eb7adfb for instance 9ad8536a-46b8-4821-8fb0-2c743927bb88 on n-h2-858094-4 Sep 16 12:53:31.584216 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-213a5e87-698a-4231-a92c-302c248a6fbc req-897ee4ea-ead8-4d60-8e0b-92d7394cc023 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038369 Sep 16 12:53:31.584815 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1026/1994] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:53:31.590344 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f8b40175-5c5c-419c-a054-ae280367c585 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f1035195af0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:31.640735 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f8b40175-5c5c-419c-a054-ae280367c585 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/0c37e3b2-0f5c-45c2-a28a-7e732c529930" status: 200 len: 1453 microversion: 2.1 time: 0.054661 Sep 16 12:53:31.649840 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1027/1995] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:53:31 2022] GET /compute/v2.1/images/0c37e3b2-0f5c-45c2-a28a-7e732c529930 => generated 1453 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:31.649840 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dd5ee7c8-d465-4593-b0aa-c8ea811d90fd tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '.version_select at 0x7f1035bf4430>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:31.695918 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dd5ee7c8-d465-4593-b0aa-c8ea811d90fd tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/images/186744c5-e6ba-4599-82dd-52b3517a8795" status: 200 len: 1429 microversion: 2.1 time: 0.053285 Sep 16 12:53:31.696533 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1028/1996] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:53:31 2022] GET /compute/v2.1/images/186744c5-e6ba-4599-82dd-52b3517a8795 => generated 1429 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:31.701604 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dbc3e386-7549-4c9d-8988-d9484bb255c6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:31.702224 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dbc3e386-7549-4c9d-8988-d9484bb255c6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:31.708906 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dbc3e386-7549-4c9d-8988-d9484bb255c6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:31.709389 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dbc3e386-7549-4c9d-8988-d9484bb255c6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:31.709829 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dbc3e386-7549-4c9d-8988-d9484bb255c6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:31.710518 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dbc3e386-7549-4c9d-8988-d9484bb255c6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:31.710968 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dbc3e386-7549-4c9d-8988-d9484bb255c6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:31.711411 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dbc3e386-7549-4c9d-8988-d9484bb255c6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:31.738180 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dbc3e386-7549-4c9d-8988-d9484bb255c6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:53:31.799093 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-9ce56427-2613-4014-801d-3206b99d0fe6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:53:31.799575 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-9ce56427-2613-4014-801d-3206b99d0fe6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:53:31.800421 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-9ce56427-2613-4014-801d-3206b99d0fe6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:53:31.800896 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-9ce56427-2613-4014-801d-3206b99d0fe6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:53:31.801567 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-9ce56427-2613-4014-801d-3206b99d0fe6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:53:31.813838 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9ce56427-2613-4014-801d-3206b99d0fe6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:31.814320 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9ce56427-2613-4014-801d-3206b99d0fe6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:31.814767 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9ce56427-2613-4014-801d-3206b99d0fe6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:31.815501 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9ce56427-2613-4014-801d-3206b99d0fe6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:31.816155 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9ce56427-2613-4014-801d-3206b99d0fe6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:31.816566 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9ce56427-2613-4014-801d-3206b99d0fe6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:31.849271 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dbc3e386-7549-4c9d-8988-d9484bb255c6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 204 len: 0 microversion: 2.1 time: 0.150156 Sep 16 12:53:31.850874 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1029/1997] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:53:31 2022] DELETE /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:53:31.855234 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-9ce56427-2613-4014-801d-3206b99d0fe6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Getting quotas for project da915844493a4928ac8830897afa126f. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:53:31.859872 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e306712e-3941-4656-8daf-20f1d82f980b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:31.860707 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e306712e-3941-4656-8daf-20f1d82f980b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:31.863881 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-9ce56427-2613-4014-801d-3206b99d0fe6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Getting quotas for user ab6ca4cf98e14358bf8e0f625812fbb9 and project da915844493a4928ac8830897afa126f. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:53:31.867080 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e306712e-3941-4656-8daf-20f1d82f980b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:31.867242 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e306712e-3941-4656-8daf-20f1d82f980b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:31.867725 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e306712e-3941-4656-8daf-20f1d82f980b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:31.868688 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e306712e-3941-4656-8daf-20f1d82f980b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:31.870202 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e306712e-3941-4656-8daf-20f1d82f980b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:31.871138 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e306712e-3941-4656-8daf-20f1d82f980b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:31.881129 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9ce56427-2613-4014-801d-3206b99d0fe6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:53:31.883960 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9ce56427-2613-4014-801d-3206b99d0fe6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:53:31.943729 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9ce56427-2613-4014-801d-3206b99d0fe6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 0.970175 Sep 16 12:53:31.944597 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 969/1998] 10.222.0.67 () {62 vars in 1188 bytes} [Fri Sep 16 12:53:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 971 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 16 12:53:31.955875 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7c012879-64d9-43c2-8625-ac0eb5f9b54e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:31.956730 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7c012879-64d9-43c2-8625-ac0eb5f9b54e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:32.100984 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7c012879-64d9-43c2-8625-ac0eb5f9b54e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:32.110266 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7c012879-64d9-43c2-8625-ac0eb5f9b54e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:32.111702 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7c012879-64d9-43c2-8625-ac0eb5f9b54e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:32.112851 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7c012879-64d9-43c2-8625-ac0eb5f9b54e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 1285 microversion: 2.25 time: 0.160851 Sep 16 12:53:32.113415 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 970/1999] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:53:31 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 1285 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:53:32.117750 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-91494868-51b8-4163-98d1-39121a16a377 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:32.118353 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-91494868-51b8-4163-98d1-39121a16a377 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:32.126736 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-91494868-51b8-4163-98d1-39121a16a377 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:32.127261 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-91494868-51b8-4163-98d1-39121a16a377 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:32.127649 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-91494868-51b8-4163-98d1-39121a16a377 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:32.128381 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-91494868-51b8-4163-98d1-39121a16a377 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:32.128976 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-91494868-51b8-4163-98d1-39121a16a377 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:32.129665 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-91494868-51b8-4163-98d1-39121a16a377 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:32.370136 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e306712e-3941-4656-8daf-20f1d82f980b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:32.379683 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e306712e-3941-4656-8daf-20f1d82f980b tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1468 microversion: 2.1 time: 0.524847 Sep 16 12:53:32.385091 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1030/2000] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:31 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1468 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:53:32.390589 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-79b566b9-90c6-46c3-a52c-524db3b596b9 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:32.391274 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-79b566b9-90c6-46c3-a52c-524db3b596b9 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] [instance: e8c8969d-7c0d-4bfe-bd49-6271193614b9] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:32.397865 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79b566b9-90c6-46c3-a52c-524db3b596b9 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:32.398613 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79b566b9-90c6-46c3-a52c-524db3b596b9 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:32.399266 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79b566b9-90c6-46c3-a52c-524db3b596b9 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:32.400271 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79b566b9-90c6-46c3-a52c-524db3b596b9 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:32.401431 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79b566b9-90c6-46c3-a52c-524db3b596b9 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:32.402048 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79b566b9-90c6-46c3-a52c-524db3b596b9 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:32.597703 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-91494868-51b8-4163-98d1-39121a16a377 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:32.606013 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-91494868-51b8-4163-98d1-39121a16a377 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1362 microversion: 2.1 time: 0.491514 Sep 16 12:53:32.606487 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 971/2001] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:32 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1362 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:32.625944 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-53b4e4cf-f093-47e4-b902-d59709e223d6 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:32.626572 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-53b4e4cf-f093-47e4-b902-d59709e223d6 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 227a8a0b-2a0c-48f8-976a-a176a9039a2d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:32.633496 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-53b4e4cf-f093-47e4-b902-d59709e223d6 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:32.633984 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-53b4e4cf-f093-47e4-b902-d59709e223d6 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:32.634422 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-53b4e4cf-f093-47e4-b902-d59709e223d6 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:32.635826 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-53b4e4cf-f093-47e4-b902-d59709e223d6 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:32.636518 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-53b4e4cf-f093-47e4-b902-d59709e223d6 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:32.636950 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-53b4e4cf-f093-47e4-b902-d59709e223d6 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:32.785492 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-79b566b9-90c6-46c3-a52c-524db3b596b9 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c5683ddbb047348d4924b7ce957472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10cd073476b420c89d93ce9c5a608c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:32.793822 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-79b566b9-90c6-46c3-a52c-524db3b596b9 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] 10.222.0.67 "GET /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9" status: 200 len: 1510 microversion: 2.1 time: 0.407379 Sep 16 12:53:32.803190 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1031/2002] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:32 2022] GET /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9 => generated 1510 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:32.803190 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-673dafe9-a471-4d05-a4ed-d25cca0b7231 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:32.803190 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-673dafe9-a471-4d05-a4ed-d25cca0b7231 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:32.810363 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-673dafe9-a471-4d05-a4ed-d25cca0b7231 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:32.810872 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-673dafe9-a471-4d05-a4ed-d25cca0b7231 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:32.811316 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-673dafe9-a471-4d05-a4ed-d25cca0b7231 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:32.812318 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-673dafe9-a471-4d05-a4ed-d25cca0b7231 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:32.812776 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-673dafe9-a471-4d05-a4ed-d25cca0b7231 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:32.813204 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-673dafe9-a471-4d05-a4ed-d25cca0b7231 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:32.940009 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-53b4e4cf-f093-47e4-b902-d59709e223d6 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9101f5af9e34d21bb8e872d337d3545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e41136645964ea98a675833bd73299f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:32.950040 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-53b4e4cf-f093-47e4-b902-d59709e223d6 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "GET /compute/v2.1/servers/227a8a0b-2a0c-48f8-976a-a176a9039a2d" status: 200 len: 1324 microversion: 2.1 time: 0.328606 Sep 16 12:53:32.951374 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 972/2003] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:32 2022] GET /compute/v2.1/servers/227a8a0b-2a0c-48f8-976a-a176a9039a2d => generated 1324 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:32.957057 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2e921cd3-5260-44d9-8f56-46e2502b4aac tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f10358cd550>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:33.028855 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2e921cd3-5260-44d9-8f56-46e2502b4aac tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/0c37e3b2-0f5c-45c2-a28a-7e732c529930" status: 200 len: 1453 microversion: 2.1 time: 0.075868 Sep 16 12:53:33.030048 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 973/2004] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:53:32 2022] GET /compute/v2.1/images/0c37e3b2-0f5c-45c2-a28a-7e732c529930 => generated 1453 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:33.040455 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-22a98c34-14d6-411e-b3e2-6d9ea49e8ead tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '.version_select at 0x7f103614b8b0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:33.096065 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-22a98c34-14d6-411e-b3e2-6d9ea49e8ead tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/images/186744c5-e6ba-4599-82dd-52b3517a8795" status: 200 len: 1429 microversion: 2.1 time: 0.064222 Sep 16 12:53:33.097278 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-673dafe9-a471-4d05-a4ed-d25cca0b7231 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:33.099455 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 974/2005] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:53:33 2022] GET /compute/v2.1/images/186744c5-e6ba-4599-82dd-52b3517a8795 => generated 1429 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:33.111222 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-673dafe9-a471-4d05-a4ed-d25cca0b7231 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1199 microversion: 2.1 time: 0.315440 Sep 16 12:53:33.124364 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1032/2006] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:32 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1199 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:33.140777 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6eedddcb-5b41-4ef4-9342-f7f1c71bb391 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:33.141707 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6eedddcb-5b41-4ef4-9342-f7f1c71bb391 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:33.148789 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6eedddcb-5b41-4ef4-9342-f7f1c71bb391 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:33.149515 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6eedddcb-5b41-4ef4-9342-f7f1c71bb391 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:33.151303 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6eedddcb-5b41-4ef4-9342-f7f1c71bb391 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:33.152297 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6eedddcb-5b41-4ef4-9342-f7f1c71bb391 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:33.152867 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6eedddcb-5b41-4ef4-9342-f7f1c71bb391 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:33.154196 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6eedddcb-5b41-4ef4-9342-f7f1c71bb391 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:33.303284 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6eedddcb-5b41-4ef4-9342-f7f1c71bb391 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:33.317546 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6eedddcb-5b41-4ef4-9342-f7f1c71bb391 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:33.322167 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6eedddcb-5b41-4ef4-9342-f7f1c71bb391 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:33.327305 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6eedddcb-5b41-4ef4-9342-f7f1c71bb391 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 1281 microversion: 2.25 time: 0.190399 Sep 16 12:53:33.329281 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 975/2007] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:53:33 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 1281 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:53:33.369070 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-9f5b1dee-1441-4086-807f-cde8dbd29ca2 req-a2904620-30cb-4d1e-bd82-388d7d0e1068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8c8969d-7c0d-4bfe-bd49-6271193614b9", "name": "network-vif-deleted", "tag": "7612ea0a-26f5-4749-ac66-963beed5e38a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:33.383739 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9f5b1dee-1441-4086-807f-cde8dbd29ca2 req-a2904620-30cb-4d1e-bd82-388d7d0e1068 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:33.385488 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9f5b1dee-1441-4086-807f-cde8dbd29ca2 req-a2904620-30cb-4d1e-bd82-388d7d0e1068 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:33.386398 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9f5b1dee-1441-4086-807f-cde8dbd29ca2 req-a2904620-30cb-4d1e-bd82-388d7d0e1068 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:33.406509 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-9f5b1dee-1441-4086-807f-cde8dbd29ca2 req-a2904620-30cb-4d1e-bd82-388d7d0e1068 service nova] Creating event network-vif-deleted:7612ea0a-26f5-4749-ac66-963beed5e38a for instance e8c8969d-7c0d-4bfe-bd49-6271193614b9 on n-h1-858094-4 Sep 16 12:53:33.409096 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d1492c39-943a-4ec5-9a85-1a6d242e67dc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:33.409941 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d1492c39-943a-4ec5-9a85-1a6d242e67dc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:33.412573 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-9f5b1dee-1441-4086-807f-cde8dbd29ca2 req-a2904620-30cb-4d1e-bd82-388d7d0e1068 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048660 Sep 16 12:53:33.413488 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1033/2008] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:53:33.439592 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d1492c39-943a-4ec5-9a85-1a6d242e67dc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:33.440090 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d1492c39-943a-4ec5-9a85-1a6d242e67dc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:33.440603 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d1492c39-943a-4ec5-9a85-1a6d242e67dc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:33.441288 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d1492c39-943a-4ec5-9a85-1a6d242e67dc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:33.443044 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d1492c39-943a-4ec5-9a85-1a6d242e67dc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:33.443044 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d1492c39-943a-4ec5-9a85-1a6d242e67dc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:33.608587 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d1492c39-943a-4ec5-9a85-1a6d242e67dc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:33.617566 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d1492c39-943a-4ec5-9a85-1a6d242e67dc tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1468 microversion: 2.1 time: 0.212532 Sep 16 12:53:33.628305 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 976/2009] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:33 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1468 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:53:33.641841 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e81980af-1795-4960-8c97-b51bfb6c2e3b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:33.642540 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e81980af-1795-4960-8c97-b51bfb6c2e3b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:33.649689 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e81980af-1795-4960-8c97-b51bfb6c2e3b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:33.650181 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e81980af-1795-4960-8c97-b51bfb6c2e3b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:33.651360 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e81980af-1795-4960-8c97-b51bfb6c2e3b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:33.652448 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e81980af-1795-4960-8c97-b51bfb6c2e3b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:33.653098 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e81980af-1795-4960-8c97-b51bfb6c2e3b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:33.653524 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e81980af-1795-4960-8c97-b51bfb6c2e3b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:33.805184 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e81980af-1795-4960-8c97-b51bfb6c2e3b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:33.814672 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e81980af-1795-4960-8c97-b51bfb6c2e3b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1362 microversion: 2.1 time: 0.177454 Sep 16 12:53:33.815490 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1034/2010] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:33 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:33.819139 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-68c9fbaa-527e-45ca-abbd-c53ff91cfbc4 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:33.820540 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-68c9fbaa-527e-45ca-abbd-c53ff91cfbc4 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] [instance: e8c8969d-7c0d-4bfe-bd49-6271193614b9] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:33.833245 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-68c9fbaa-527e-45ca-abbd-c53ff91cfbc4 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:33.833826 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-68c9fbaa-527e-45ca-abbd-c53ff91cfbc4 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:33.834337 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-68c9fbaa-527e-45ca-abbd-c53ff91cfbc4 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:33.835146 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-68c9fbaa-527e-45ca-abbd-c53ff91cfbc4 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:33.835666 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-68c9fbaa-527e-45ca-abbd-c53ff91cfbc4 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:33.836206 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-68c9fbaa-527e-45ca-abbd-c53ff91cfbc4 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:33.873610 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-68c9fbaa-527e-45ca-abbd-c53ff91cfbc4 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:33.874109 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-68c9fbaa-527e-45ca-abbd-c53ff91cfbc4 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:33.874544 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-68c9fbaa-527e-45ca-abbd-c53ff91cfbc4 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:33.874999 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-68c9fbaa-527e-45ca-abbd-c53ff91cfbc4 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lazy-loading 'fault' on Instance uuid e8c8969d-7c0d-4bfe-bd49-6271193614b9 {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:53:33.920838 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-68c9fbaa-527e-45ca-abbd-c53ff91cfbc4 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c5683ddbb047348d4924b7ce957472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10cd073476b420c89d93ce9c5a608c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:33.928723 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-68c9fbaa-527e-45ca-abbd-c53ff91cfbc4 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] 10.222.0.67 "GET /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9" status: 200 len: 1306 microversion: 2.1 time: 0.114887 Sep 16 12:53:33.929305 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 977/2011] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:33 2022] GET /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9 => generated 1306 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:53:33.977272 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5a48000e-dc93-451e-bf05-ef87e8c9198b tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:33.978097 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5a48000e-dc93-451e-bf05-ef87e8c9198b tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 227a8a0b-2a0c-48f8-976a-a176a9039a2d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:33.995732 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a48000e-dc93-451e-bf05-ef87e8c9198b tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:33.996498 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a48000e-dc93-451e-bf05-ef87e8c9198b tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:33.997372 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a48000e-dc93-451e-bf05-ef87e8c9198b tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:33.998105 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a48000e-dc93-451e-bf05-ef87e8c9198b tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:33.998614 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a48000e-dc93-451e-bf05-ef87e8c9198b tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:33.999274 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a48000e-dc93-451e-bf05-ef87e8c9198b tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:34.048241 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-15d7b2a2-e021-4b7a-8500-83e02518dec7 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f1039aae160>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:34.094438 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-15d7b2a2-e021-4b7a-8500-83e02518dec7 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/0c37e3b2-0f5c-45c2-a28a-7e732c529930" status: 200 len: 1453 microversion: 2.1 time: 0.052376 Sep 16 12:53:34.096189 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 978/2012] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:53:34 2022] GET /compute/v2.1/images/0c37e3b2-0f5c-45c2-a28a-7e732c529930 => generated 1453 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:53:34.112323 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-03f27975-db37-46b9-956a-298aa0570cd6 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '.version_select at 0x7f1035ea60d0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:34.145100 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5a48000e-dc93-451e-bf05-ef87e8c9198b tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9101f5af9e34d21bb8e872d337d3545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e41136645964ea98a675833bd73299f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:34.154201 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5a48000e-dc93-451e-bf05-ef87e8c9198b tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "GET /compute/v2.1/servers/227a8a0b-2a0c-48f8-976a-a176a9039a2d" status: 200 len: 1324 microversion: 2.1 time: 0.181323 Sep 16 12:53:34.154766 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1035/2013] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:33 2022] GET /compute/v2.1/servers/227a8a0b-2a0c-48f8-976a-a176a9039a2d => generated 1324 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:34.159745 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9e1b868e-3dc2-4ef5-841e-3787a80ccaaa tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:34.160585 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9e1b868e-3dc2-4ef5-841e-3787a80ccaaa tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:34.162326 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-03f27975-db37-46b9-956a-298aa0570cd6 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/images/186744c5-e6ba-4599-82dd-52b3517a8795" status: 200 len: 1429 microversion: 2.1 time: 0.053892 Sep 16 12:53:34.162912 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 979/2014] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:53:34 2022] GET /compute/v2.1/images/186744c5-e6ba-4599-82dd-52b3517a8795 => generated 1429 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:53:34.166767 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e1b868e-3dc2-4ef5-841e-3787a80ccaaa tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:34.167747 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e1b868e-3dc2-4ef5-841e-3787a80ccaaa tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:34.168650 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e1b868e-3dc2-4ef5-841e-3787a80ccaaa tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:34.168987 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e1b868e-3dc2-4ef5-841e-3787a80ccaaa tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:34.169453 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e1b868e-3dc2-4ef5-841e-3787a80ccaaa tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:34.169882 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e1b868e-3dc2-4ef5-841e-3787a80ccaaa tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:34.328425 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9e1b868e-3dc2-4ef5-841e-3787a80ccaaa tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:34.342815 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9e1b868e-3dc2-4ef5-841e-3787a80ccaaa tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1199 microversion: 2.1 time: 0.186630 Sep 16 12:53:34.344958 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1036/2015] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:34 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1199 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:34.355739 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-dd9bdcad-9163-4f08-8703-a7d833a527cf tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:34.357240 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-dd9bdcad-9163-4f08-8703-a7d833a527cf tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:34.367605 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dd9bdcad-9163-4f08-8703-a7d833a527cf tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:34.368116 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dd9bdcad-9163-4f08-8703-a7d833a527cf tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:34.368591 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dd9bdcad-9163-4f08-8703-a7d833a527cf tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:34.370022 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dd9bdcad-9163-4f08-8703-a7d833a527cf tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:34.370973 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dd9bdcad-9163-4f08-8703-a7d833a527cf tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:34.371637 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dd9bdcad-9163-4f08-8703-a7d833a527cf tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:34.592103 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-dd9bdcad-9163-4f08-8703-a7d833a527cf tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:34.605100 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-dd9bdcad-9163-4f08-8703-a7d833a527cf tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:34.606656 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-dd9bdcad-9163-4f08-8703-a7d833a527cf tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:34.607832 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-dd9bdcad-9163-4f08-8703-a7d833a527cf tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 1337 microversion: 2.25 time: 0.256710 Sep 16 12:53:34.620383 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 980/2016] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:53:34 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 1337 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:53:34.645618 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ab0ebe86-cb98-4c18-8d49-177633d5b9d6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:34.646238 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ab0ebe86-cb98-4c18-8d49-177633d5b9d6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:34.664534 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab0ebe86-cb98-4c18-8d49-177633d5b9d6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:34.665481 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab0ebe86-cb98-4c18-8d49-177633d5b9d6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:34.667377 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab0ebe86-cb98-4c18-8d49-177633d5b9d6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:34.668431 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab0ebe86-cb98-4c18-8d49-177633d5b9d6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:34.672878 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab0ebe86-cb98-4c18-8d49-177633d5b9d6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:34.673703 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab0ebe86-cb98-4c18-8d49-177633d5b9d6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:34.838862 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-58039fc6-43e8-48b7-b3a9-0b4e1b308574 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:34.839870 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-58039fc6-43e8-48b7-b3a9-0b4e1b308574 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:34.858064 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-58039fc6-43e8-48b7-b3a9-0b4e1b308574 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:34.858946 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-58039fc6-43e8-48b7-b3a9-0b4e1b308574 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:34.859612 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-58039fc6-43e8-48b7-b3a9-0b4e1b308574 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:34.860701 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-58039fc6-43e8-48b7-b3a9-0b4e1b308574 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:34.861383 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-58039fc6-43e8-48b7-b3a9-0b4e1b308574 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:34.862058 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-58039fc6-43e8-48b7-b3a9-0b4e1b308574 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:35.028477 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ab0ebe86-cb98-4c18-8d49-177633d5b9d6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:35.038331 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ab0ebe86-cb98-4c18-8d49-177633d5b9d6 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1468 microversion: 2.1 time: 0.396717 Sep 16 12:53:35.047357 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1037/2017] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:34 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1468 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:35.058018 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f0c088d3-16f2-4d06-acd7-f0a4c4cfd393 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:35.059023 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f0c088d3-16f2-4d06-acd7-f0a4c4cfd393 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] [instance: e8c8969d-7c0d-4bfe-bd49-6271193614b9] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:35.066196 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0c088d3-16f2-4d06-acd7-f0a4c4cfd393 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:35.067028 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0c088d3-16f2-4d06-acd7-f0a4c4cfd393 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:35.067707 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0c088d3-16f2-4d06-acd7-f0a4c4cfd393 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:35.068717 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0c088d3-16f2-4d06-acd7-f0a4c4cfd393 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:35.069409 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0c088d3-16f2-4d06-acd7-f0a4c4cfd393 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:35.070088 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0c088d3-16f2-4d06-acd7-f0a4c4cfd393 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:35.108136 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0c088d3-16f2-4d06-acd7-f0a4c4cfd393 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:35.109089 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0c088d3-16f2-4d06-acd7-f0a4c4cfd393 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:35.109736 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0c088d3-16f2-4d06-acd7-f0a4c4cfd393 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:35.110455 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-f0c088d3-16f2-4d06-acd7-f0a4c4cfd393 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lazy-loading 'fault' on Instance uuid e8c8969d-7c0d-4bfe-bd49-6271193614b9 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:53:35.114032 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:53:35.164907 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=20 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:53:35.188997 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f0c088d3-16f2-4d06-acd7-f0a4c4cfd393 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c5683ddbb047348d4924b7ce957472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10cd073476b420c89d93ce9c5a608c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:35.189948 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-58039fc6-43e8-48b7-b3a9-0b4e1b308574 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:35.199283 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-58039fc6-43e8-48b7-b3a9-0b4e1b308574 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1362 microversion: 2.1 time: 0.364567 Sep 16 12:53:35.200228 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f0c088d3-16f2-4d06-acd7-f0a4c4cfd393 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] 10.222.0.67 "GET /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9" status: 200 len: 1306 microversion: 2.1 time: 0.151278 Sep 16 12:53:35.201368 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1038/2018] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:35 2022] GET /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9 => generated 1306 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:35.207193 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 981/2019] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:34 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1362 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:35.211330 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-70b13baf-5d1d-490d-8853-1b11fc40df9a tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f1035bf4430>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:35.219364 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-cc3465d2-ecb8-48d7-8217-ff9b93fe7b94 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:35.220976 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-cc3465d2-ecb8-48d7-8217-ff9b93fe7b94 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 227a8a0b-2a0c-48f8-976a-a176a9039a2d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:35.231571 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cc3465d2-ecb8-48d7-8217-ff9b93fe7b94 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:35.232139 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cc3465d2-ecb8-48d7-8217-ff9b93fe7b94 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:35.232567 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cc3465d2-ecb8-48d7-8217-ff9b93fe7b94 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:35.233271 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cc3465d2-ecb8-48d7-8217-ff9b93fe7b94 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:35.233773 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cc3465d2-ecb8-48d7-8217-ff9b93fe7b94 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:35.234339 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cc3465d2-ecb8-48d7-8217-ff9b93fe7b94 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:35.282801 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-70b13baf-5d1d-490d-8853-1b11fc40df9a tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/0c37e3b2-0f5c-45c2-a28a-7e732c529930" status: 200 len: 1453 microversion: 2.1 time: 0.080152 Sep 16 12:53:35.283408 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1039/2020] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:53:35 2022] GET /compute/v2.1/images/0c37e3b2-0f5c-45c2-a28a-7e732c529930 => generated 1453 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:35.292805 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-348d340c-8543-463c-a14b-ae217cfc417f tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '.version_select at 0x7f103529a4c0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:35.346608 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-348d340c-8543-463c-a14b-ae217cfc417f tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/images/186744c5-e6ba-4599-82dd-52b3517a8795" status: 200 len: 1429 microversion: 2.1 time: 0.061458 Sep 16 12:53:35.347201 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1040/2021] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:53:35 2022] GET /compute/v2.1/images/186744c5-e6ba-4599-82dd-52b3517a8795 => generated 1429 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:35.365348 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-b4f1f25d-34aa-4698-ab1a-ea8ed627b47d req-b4ab7e18-0b5b-4161-b6a2-987412caaad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6b4a601-8b6e-498e-8c17-9e689c13db74", "name": "network-vif-deleted", "tag": "c82c5517-9370-47b7-870d-b1c0f066ce8a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:35.376902 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b4f1f25d-34aa-4698-ab1a-ea8ed627b47d req-b4ab7e18-0b5b-4161-b6a2-987412caaad1 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:35.377449 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b4f1f25d-34aa-4698-ab1a-ea8ed627b47d req-b4ab7e18-0b5b-4161-b6a2-987412caaad1 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:35.377881 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b4f1f25d-34aa-4698-ab1a-ea8ed627b47d req-b4ab7e18-0b5b-4161-b6a2-987412caaad1 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:35.389601 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-b4f1f25d-34aa-4698-ab1a-ea8ed627b47d req-b4ab7e18-0b5b-4161-b6a2-987412caaad1 service nova] Creating event network-vif-deleted:c82c5517-9370-47b7-870d-b1c0f066ce8a for instance c6b4a601-8b6e-498e-8c17-9e689c13db74 on n-h2-858094-4 Sep 16 12:53:35.394588 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-b4f1f25d-34aa-4698-ab1a-ea8ed627b47d req-b4ab7e18-0b5b-4161-b6a2-987412caaad1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045965 Sep 16 12:53:35.395757 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1041/2022] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:53:35.402189 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f0d04378-8ce2-497f-9dac-a8a683d6d0fb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:35.403119 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f0d04378-8ce2-497f-9dac-a8a683d6d0fb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:35.410052 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0d04378-8ce2-497f-9dac-a8a683d6d0fb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:35.410787 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0d04378-8ce2-497f-9dac-a8a683d6d0fb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:35.411459 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0d04378-8ce2-497f-9dac-a8a683d6d0fb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:35.412038 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0d04378-8ce2-497f-9dac-a8a683d6d0fb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:35.412595 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0d04378-8ce2-497f-9dac-a8a683d6d0fb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:35.413021 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0d04378-8ce2-497f-9dac-a8a683d6d0fb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:35.426174 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-cc3465d2-ecb8-48d7-8217-ff9b93fe7b94 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9101f5af9e34d21bb8e872d337d3545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e41136645964ea98a675833bd73299f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:35.435408 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-cc3465d2-ecb8-48d7-8217-ff9b93fe7b94 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "GET /compute/v2.1/servers/227a8a0b-2a0c-48f8-976a-a176a9039a2d" status: 200 len: 1324 microversion: 2.1 time: 0.226964 Sep 16 12:53:35.436164 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 982/2023] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:35 2022] GET /compute/v2.1/servers/227a8a0b-2a0c-48f8-976a-a176a9039a2d => generated 1324 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:35.553697 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f0d04378-8ce2-497f-9dac-a8a683d6d0fb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:35.565552 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f0d04378-8ce2-497f-9dac-a8a683d6d0fb tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1199 microversion: 2.1 time: 0.168328 Sep 16 12:53:35.580774 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1042/2024] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:35 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1199 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:35.647829 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-56b7b401-2772-40dd-9ec2-e185c3e5a57b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:35.648702 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-56b7b401-2772-40dd-9ec2-e185c3e5a57b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:35.663490 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-56b7b401-2772-40dd-9ec2-e185c3e5a57b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:35.664074 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-56b7b401-2772-40dd-9ec2-e185c3e5a57b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:35.668103 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-56b7b401-2772-40dd-9ec2-e185c3e5a57b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:35.669900 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-56b7b401-2772-40dd-9ec2-e185c3e5a57b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:35.670469 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-56b7b401-2772-40dd-9ec2-e185c3e5a57b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:35.671034 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-56b7b401-2772-40dd-9ec2-e185c3e5a57b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:35.795629 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-56b7b401-2772-40dd-9ec2-e185c3e5a57b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:35.804702 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-56b7b401-2772-40dd-9ec2-e185c3e5a57b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:35.806210 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-56b7b401-2772-40dd-9ec2-e185c3e5a57b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:35.807436 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-56b7b401-2772-40dd-9ec2-e185c3e5a57b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 1337 microversion: 2.25 time: 0.167209 Sep 16 12:53:35.808285 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 983/2025] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:53:35 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 1337 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:53:36.070165 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-51f54031-da85-4f49-aad4-2f99f9e22bc7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:36.073541 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-51f54031-da85-4f49-aad4-2f99f9e22bc7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:36.097753 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-51f54031-da85-4f49-aad4-2f99f9e22bc7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:36.101509 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-51f54031-da85-4f49-aad4-2f99f9e22bc7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:36.102208 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-51f54031-da85-4f49-aad4-2f99f9e22bc7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:36.103214 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-51f54031-da85-4f49-aad4-2f99f9e22bc7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:36.105619 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-51f54031-da85-4f49-aad4-2f99f9e22bc7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:36.106512 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-51f54031-da85-4f49-aad4-2f99f9e22bc7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:36.149992 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-789d6716-d16f-4ee3-9308-6c61e4b5bd38 req-bc575255-0e55-4f56-b941-d92d2be2002d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ad8536a-46b8-4821-8fb0-2c743927bb88", "name": "network-vif-plugged", "status": "completed", "tag": "c0c1968f-d991-4e36-8062-6ff62eb7adfb"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:36.202637 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-789d6716-d16f-4ee3-9308-6c61e4b5bd38 req-bc575255-0e55-4f56-b941-d92d2be2002d service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:36.203318 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-789d6716-d16f-4ee3-9308-6c61e4b5bd38 req-bc575255-0e55-4f56-b941-d92d2be2002d service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:36.203545 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-789d6716-d16f-4ee3-9308-6c61e4b5bd38 req-bc575255-0e55-4f56-b941-d92d2be2002d service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:36.237257 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-789d6716-d16f-4ee3-9308-6c61e4b5bd38 req-bc575255-0e55-4f56-b941-d92d2be2002d service nova] Creating event network-vif-plugged:c0c1968f-d991-4e36-8062-6ff62eb7adfb for instance 9ad8536a-46b8-4821-8fb0-2c743927bb88 on n-h2-858094-4 Sep 16 12:53:36.250167 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-789d6716-d16f-4ee3-9308-6c61e4b5bd38 req-bc575255-0e55-4f56-b941-d92d2be2002d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104032 Sep 16 12:53:36.252167 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 984/2026] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:53:36.267124 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4b45ed3e-eca0-4343-90c5-67fe5f2395ca tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:36.270774 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-4b45ed3e-eca0-4343-90c5-67fe5f2395ca tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:36.287262 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-51f54031-da85-4f49-aad4-2f99f9e22bc7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:36.290482 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-51f54031-da85-4f49-aad4-2f99f9e22bc7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:36.295529 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-51f54031-da85-4f49-aad4-2f99f9e22bc7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:36.298075 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4b45ed3e-eca0-4343-90c5-67fe5f2395ca tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:36.298896 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4b45ed3e-eca0-4343-90c5-67fe5f2395ca tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:36.300354 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-51f54031-da85-4f49-aad4-2f99f9e22bc7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lazy-loading 'fault' on Instance uuid c6b4a601-8b6e-498e-8c17-9e689c13db74 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:53:36.301017 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4b45ed3e-eca0-4343-90c5-67fe5f2395ca tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:36.301962 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4b45ed3e-eca0-4343-90c5-67fe5f2395ca tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:36.304563 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4b45ed3e-eca0-4343-90c5-67fe5f2395ca tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:36.305845 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4b45ed3e-eca0-4343-90c5-67fe5f2395ca tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:36.397557 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:53:36.513201 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-51f54031-da85-4f49-aad4-2f99f9e22bc7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:36.524607 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-51f54031-da85-4f49-aad4-2f99f9e22bc7 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 200 len: 1303 microversion: 2.1 time: 0.464614 Sep 16 12:53:36.543361 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1043/2027] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:36 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 1303 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:36.559774 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2078f644-2599-4d62-ab2e-22220798c4b8 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:36.560446 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2078f644-2599-4d62-ab2e-22220798c4b8 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] [instance: e8c8969d-7c0d-4bfe-bd49-6271193614b9] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:36.568204 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2078f644-2599-4d62-ab2e-22220798c4b8 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:36.568717 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2078f644-2599-4d62-ab2e-22220798c4b8 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:36.569157 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2078f644-2599-4d62-ab2e-22220798c4b8 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:36.569878 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2078f644-2599-4d62-ab2e-22220798c4b8 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:36.570337 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2078f644-2599-4d62-ab2e-22220798c4b8 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:36.570766 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2078f644-2599-4d62-ab2e-22220798c4b8 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:36.606613 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-2078f644-2599-4d62-ab2e-22220798c4b8 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] HTTP exception thrown: Instance e8c8969d-7c0d-4bfe-bd49-6271193614b9 could not be found. Sep 16 12:53:36.608326 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2078f644-2599-4d62-ab2e-22220798c4b8 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Request method failure captured: Sep 16 12:53:36.608326 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9 HTTP/1.1 Sep 16 12:53:36.608326 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:53:36.608326 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:53:36.608326 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:53:36.608326 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:53:36.608326 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:53:36.608326 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:53:36.608326 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:53:36.608326 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:53:36.608326 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHGjayKbq0g69LWdUnsegLU1jLLzP69B_sKbVtz9AX0KlcgpEUmuZ5fub7ppq1hm9y-1wU2wwxTD-hK36pIAZKZn5AFFB_eITAH6DCP42u-Y1g63RE4rzUIYUJ11Ddft1JRun44t5rJZoPEL4ruvlE_DjRP04Z5ImwhcghnQwyHeVSU Sep 16 12:53:36.608326 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:53:36.608326 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:53:36.608326 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:53:36.608326 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:53:36.608326 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:53:36.608326 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:53:36.608326 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: b10cd073476b420c89d93ce9c5a608c5 Sep 16 12:53:36.608326 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesNegativeTestJSON-203448148 Sep 16 12:53:36.608326 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:53:36.608326 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:53:36.610122 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b10cd073476b420c89d93ce9c5a608c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b10cd073476b420c89d93ce9c5a608c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b10cd073476b420c89d93ce9c5a608c5", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b10cd073476b420c89d93ce9c5a608c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:53:36.610122 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesNegativeTestJSON-203448148 Sep 16 12:53:36.610122 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: b10cd073476b420c89d93ce9c5a608c5 Sep 16 12:53:36.610122 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-203448148 Sep 16 12:53:36.610122 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ImagesNegativeTestJSON-203448148-project Sep 16 12:53:36.610122 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:53:36.610122 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:53:36.610122 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 59c5683ddbb047348d4924b7ce957472 Sep 16 12:53:36.610122 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesNegativeTestJSON-203448148-project Sep 16 12:53:36.610122 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:53:36.610122 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance e8c8969d-7c0d-4bfe-bd49-6271193614b9 could not be found. Sep 16 12:53:36.610122 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': 'e8c8969d-7c0d-4bfe-bd49-6271193614b9'} Sep 16 12:53:36.611162 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:53:36.611162 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:53:36.611162 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:53:36.611162 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:53:36.611162 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:53:36.611162 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:53:36.611162 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:53:36.611162 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:53:36.611162 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:53:36.611162 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:53:36.611162 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8c8969d-7c0d-4bfe-bd49-6271193614b9 could not be found. Sep 16 12:53:36.611162 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:53:36.611162 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:53:36.611162 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:53:36.611162 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:53:36.611162 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:53:36.611162 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:53:36.611162 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:53:36.611162 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:53:36.611162 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:53:36.612845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:53:36.612845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:53:36.612845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:53:36.612845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:53:36.612845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:53:36.612845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:53:36.612845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:53:36.612845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8c8969d-7c0d-4bfe-bd49-6271193614b9 could not be found. Sep 16 12:53:36.612845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:53:36.612845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:53:36.612845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:53:36.612845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:53:36.612845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:53:36.612845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:53:36.612845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:53:36.612845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:53:36.612845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8c8969d-7c0d-4bfe-bd49-6271193614b9 could not be found. Sep 16 12:53:36.612845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:53:36.615965 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2078f644-2599-4d62-ab2e-22220798c4b8 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Returning 404 to user: Instance e8c8969d-7c0d-4bfe-bd49-6271193614b9 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:53:36.615965 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2078f644-2599-4d62-ab2e-22220798c4b8 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] 10.222.0.67 "GET /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9" status: 404 len: 111 microversion: 2.1 time: 0.065298 Sep 16 12:53:36.615965 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1044/2028] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:36 2022] GET /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:53:36.621171 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-12aa9b49-62fb-4592-a105-3fb4a3bee866 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f103514f280>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:36.726455 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-12aa9b49-62fb-4592-a105-3fb4a3bee866 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/0c37e3b2-0f5c-45c2-a28a-7e732c529930" status: 200 len: 1453 microversion: 2.1 time: 0.112194 Sep 16 12:53:36.732179 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1045/2029] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:53:36 2022] GET /compute/v2.1/images/0c37e3b2-0f5c-45c2-a28a-7e732c529930 => generated 1453 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:36.739662 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-042e68ac-99a1-44d0-9387-a15bef66e4d4 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '.version_select at 0x7f10351fed30>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:36.800897 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4b45ed3e-eca0-4343-90c5-67fe5f2395ca tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:36.811306 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4b45ed3e-eca0-4343-90c5-67fe5f2395ca tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1362 microversion: 2.1 time: 0.557625 Sep 16 12:53:36.812928 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 985/2030] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:36 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1362 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:36.818746 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-88908a3f-0992-4603-bcf6-4968f28b0eda tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:36.820368 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-88908a3f-0992-4603-bcf6-4968f28b0eda tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 227a8a0b-2a0c-48f8-976a-a176a9039a2d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:36.829172 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-042e68ac-99a1-44d0-9387-a15bef66e4d4 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/images/186744c5-e6ba-4599-82dd-52b3517a8795" status: 200 len: 1429 microversion: 2.1 time: 0.100256 Sep 16 12:53:36.832055 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1046/2031] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:53:36 2022] GET /compute/v2.1/images/186744c5-e6ba-4599-82dd-52b3517a8795 => generated 1429 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:36.832671 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-88908a3f-0992-4603-bcf6-4968f28b0eda tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:36.834271 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-88908a3f-0992-4603-bcf6-4968f28b0eda tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:36.835275 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-88908a3f-0992-4603-bcf6-4968f28b0eda tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:36.836383 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-88908a3f-0992-4603-bcf6-4968f28b0eda tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:36.837011 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-88908a3f-0992-4603-bcf6-4968f28b0eda tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:36.837626 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-88908a3f-0992-4603-bcf6-4968f28b0eda tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:36.845732 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-58ef4599-6608-46b1-a718-410aa3bc032d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:36.846804 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-58ef4599-6608-46b1-a718-410aa3bc032d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:36.866472 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58ef4599-6608-46b1-a718-410aa3bc032d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:36.868294 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58ef4599-6608-46b1-a718-410aa3bc032d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:36.868859 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58ef4599-6608-46b1-a718-410aa3bc032d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:36.870737 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58ef4599-6608-46b1-a718-410aa3bc032d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:36.872433 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58ef4599-6608-46b1-a718-410aa3bc032d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:36.874458 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58ef4599-6608-46b1-a718-410aa3bc032d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:37.044915 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-88908a3f-0992-4603-bcf6-4968f28b0eda tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9101f5af9e34d21bb8e872d337d3545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e41136645964ea98a675833bd73299f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:37.062578 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-88908a3f-0992-4603-bcf6-4968f28b0eda tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "GET /compute/v2.1/servers/227a8a0b-2a0c-48f8-976a-a176a9039a2d" status: 200 len: 1324 microversion: 2.1 time: 0.248269 Sep 16 12:53:37.065705 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 986/2032] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:36 2022] GET /compute/v2.1/servers/227a8a0b-2a0c-48f8-976a-a176a9039a2d => generated 1324 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:37.082460 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d2c38d23-4699-4b73-8e5d-147217a63c0c tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1300506398", "metadata": {"image_type": "test"}}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:37.105014 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d2c38d23-4699-4b73-8e5d-147217a63c0c tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] [instance: e8c8969d-7c0d-4bfe-bd49-6271193614b9] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:37.132446 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d2c38d23-4699-4b73-8e5d-147217a63c0c tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:37.134185 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d2c38d23-4699-4b73-8e5d-147217a63c0c tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:37.135149 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d2c38d23-4699-4b73-8e5d-147217a63c0c tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:37.139236 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d2c38d23-4699-4b73-8e5d-147217a63c0c tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:37.140705 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d2c38d23-4699-4b73-8e5d-147217a63c0c tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:37.141343 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d2c38d23-4699-4b73-8e5d-147217a63c0c tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:37.167217 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-d2c38d23-4699-4b73-8e5d-147217a63c0c tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] HTTP exception thrown: Instance e8c8969d-7c0d-4bfe-bd49-6271193614b9 could not be found. Sep 16 12:53:37.169694 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d2c38d23-4699-4b73-8e5d-147217a63c0c tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Request method failure captured: Sep 16 12:53:37.169694 n-d-858094-4 devstack@n-api.service[128780]: request: POST /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9/action HTTP/1.1 Sep 16 12:53:37.169694 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:53:37.169694 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:53:37.169694 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:53:37.169694 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 112 Sep 16 12:53:37.169694 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:53:37.169694 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:53:37.169694 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:53:37.169694 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:53:37.169694 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHGjayKbq0g69LWdUnsegLU1jLLzP69B_sKbVtz9AX0KlcgpEUmuZ5fub7ppq1hm9y-1wU2wwxTD-hK36pIAZKZn5AFFB_eITAH6DCP42u-Y1g63RE4rzUIYUJ11Ddft1JRun44t5rJZoPEL4ruvlE_DjRP04Z5ImwhcghnQwyHeVSU Sep 16 12:53:37.169694 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:53:37.169694 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:53:37.169694 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:53:37.169694 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:53:37.169694 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:53:37.169694 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:53:37.169694 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: b10cd073476b420c89d93ce9c5a608c5 Sep 16 12:53:37.169694 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ImagesNegativeTestJSON-203448148 Sep 16 12:53:37.169694 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:53:37.169694 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:53:37.171504 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b10cd073476b420c89d93ce9c5a608c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b10cd073476b420c89d93ce9c5a608c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b10cd073476b420c89d93ce9c5a608c5", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b10cd073476b420c89d93ce9c5a608c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:53:37.171504 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ImagesNegativeTestJSON-203448148 Sep 16 12:53:37.171504 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: b10cd073476b420c89d93ce9c5a608c5 Sep 16 12:53:37.171504 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-203448148 Sep 16 12:53:37.171504 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ImagesNegativeTestJSON-203448148-project Sep 16 12:53:37.171504 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:53:37.171504 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:53:37.171504 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 59c5683ddbb047348d4924b7ce957472 Sep 16 12:53:37.171504 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ImagesNegativeTestJSON-203448148-project Sep 16 12:53:37.171504 n-d-858094-4 devstack@n-api.service[128780]: Sep 16 12:53:37.171504 n-d-858094-4 devstack@n-api.service[128780]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1300506398", "metadata": {"image_type": "test"}}} Sep 16 12:53:37.171504 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:53:37.172572 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance e8c8969d-7c0d-4bfe-bd49-6271193614b9 could not be found. Sep 16 12:53:37.172572 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'e8c8969d-7c0d-4bfe-bd49-6271193614b9', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1300506398', 'metadata': {'image_type': 'test'}}}} Sep 16 12:53:37.172572 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:53:37.172572 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:53:37.172572 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:53:37.172572 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:53:37.172572 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:53:37.172572 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:53:37.172572 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:53:37.172572 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:53:37.172572 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:53:37.172572 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:53:37.172572 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8c8969d-7c0d-4bfe-bd49-6271193614b9 could not be found. Sep 16 12:53:37.172572 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:53:37.172572 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:53:37.172572 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:53:37.172572 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:53:37.172572 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:53:37.172572 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:53:37.174262 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:53:37.174262 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:53:37.174262 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:53:37.174262 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:53:37.174262 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:53:37.174262 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:53:37.174262 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:53:37.174262 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:53:37.174262 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 16 12:53:37.174262 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 16 12:53:37.174262 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:53:37.174262 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:53:37.174262 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:53:37.174262 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:53:37.174262 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8c8969d-7c0d-4bfe-bd49-6271193614b9 could not be found. Sep 16 12:53:37.174262 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:53:37.174262 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:53:37.174262 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:53:37.174262 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:53:37.174262 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:53:37.175921 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:53:37.175921 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:53:37.175921 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:53:37.175921 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8c8969d-7c0d-4bfe-bd49-6271193614b9 could not be found. Sep 16 12:53:37.175921 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:53:37.178635 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d2c38d23-4699-4b73-8e5d-147217a63c0c tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Returning 404 to user: Instance e8c8969d-7c0d-4bfe-bd49-6271193614b9 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:53:37.180747 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d2c38d23-4699-4b73-8e5d-147217a63c0c tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] 10.222.0.67 "POST /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9/action" status: 404 len: 111 microversion: 2.1 time: 0.112272 Sep 16 12:53:37.181883 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 987/2033] 10.222.0.67 () {60 vars in 1279 bytes} [Fri Sep 16 12:53:37 2022] POST /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9/action => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:53:37.188593 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2e44bb40-3b52-4d4f-9d4a-1ba3ce132064 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:37.189743 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-2e44bb40-3b52-4d4f-9d4a-1ba3ce132064 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:37.197115 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2e44bb40-3b52-4d4f-9d4a-1ba3ce132064 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:37.198999 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2e44bb40-3b52-4d4f-9d4a-1ba3ce132064 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:37.200072 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2e44bb40-3b52-4d4f-9d4a-1ba3ce132064 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:37.201009 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2e44bb40-3b52-4d4f-9d4a-1ba3ce132064 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:37.201644 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2e44bb40-3b52-4d4f-9d4a-1ba3ce132064 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:37.202278 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2e44bb40-3b52-4d4f-9d4a-1ba3ce132064 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:37.320421 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-2e44bb40-3b52-4d4f-9d4a-1ba3ce132064 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:37.329670 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-2e44bb40-3b52-4d4f-9d4a-1ba3ce132064 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:37.331299 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-2e44bb40-3b52-4d4f-9d4a-1ba3ce132064 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:37.332891 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2e44bb40-3b52-4d4f-9d4a-1ba3ce132064 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 1343 microversion: 2.25 time: 0.149451 Sep 16 12:53:37.348907 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 988/2034] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:53:37 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 1343 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:53:37.356673 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-58ef4599-6608-46b1-a718-410aa3bc032d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:37.359384 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a7399e99-6f8c-42cc-b64e-2d6e3a9cbb00 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1389037669", "metadata": {"image_type": "test"}}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:37.363105 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a7399e99-6f8c-42cc-b64e-2d6e3a9cbb00 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Failed to fetch instance by id tempest-invalid-1174928555 {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 16 12:53:37.363854 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-a7399e99-6f8c-42cc-b64e-2d6e3a9cbb00 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] HTTP exception thrown: Instance tempest-invalid-1174928555 could not be found. Sep 16 12:53:37.365683 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a7399e99-6f8c-42cc-b64e-2d6e3a9cbb00 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Request method failure captured: Sep 16 12:53:37.365683 n-d-858094-4 devstack@n-api.service[128780]: request: POST /compute/v2.1/servers/tempest-invalid-1174928555/action HTTP/1.1 Sep 16 12:53:37.365683 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:53:37.365683 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:53:37.365683 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:53:37.365683 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 112 Sep 16 12:53:37.365683 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:53:37.365683 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:53:37.365683 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:53:37.365683 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:53:37.365683 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHGjayKbq0g69LWdUnsegLU1jLLzP69B_sKbVtz9AX0KlcgpEUmuZ5fub7ppq1hm9y-1wU2wwxTD-hK36pIAZKZn5AFFB_eITAH6DCP42u-Y1g63RE4rzUIYUJ11Ddft1JRun44t5rJZoPEL4ruvlE_DjRP04Z5ImwhcghnQwyHeVSU Sep 16 12:53:37.365683 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:53:37.365683 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:53:37.365683 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:53:37.365683 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:53:37.365683 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:53:37.365683 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:53:37.365683 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: b10cd073476b420c89d93ce9c5a608c5 Sep 16 12:53:37.365683 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ImagesNegativeTestJSON-203448148 Sep 16 12:53:37.365683 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:53:37.365683 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:53:37.367488 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b10cd073476b420c89d93ce9c5a608c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b10cd073476b420c89d93ce9c5a608c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b10cd073476b420c89d93ce9c5a608c5", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b10cd073476b420c89d93ce9c5a608c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:53:37.367488 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ImagesNegativeTestJSON-203448148 Sep 16 12:53:37.367488 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: b10cd073476b420c89d93ce9c5a608c5 Sep 16 12:53:37.367488 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-203448148 Sep 16 12:53:37.367488 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ImagesNegativeTestJSON-203448148-project Sep 16 12:53:37.367488 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:53:37.367488 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:53:37.367488 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 59c5683ddbb047348d4924b7ce957472 Sep 16 12:53:37.367488 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ImagesNegativeTestJSON-203448148-project Sep 16 12:53:37.367488 n-d-858094-4 devstack@n-api.service[128780]: Sep 16 12:53:37.367488 n-d-858094-4 devstack@n-api.service[128780]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1389037669", "metadata": {"image_type": "test"}}} Sep 16 12:53:37.367488 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:53:37.367488 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance tempest-invalid-1174928555 could not be found. Sep 16 12:53:37.368730 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'tempest-invalid-1174928555', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1389037669', 'metadata': {'image_type': 'test'}}}} Sep 16 12:53:37.368730 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:53:37.368730 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:53:37.368730 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:53:37.368730 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:53:37.368730 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 16 12:53:37.368730 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 16 12:53:37.368730 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1174928555 could not be found. Sep 16 12:53:37.368730 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:53:37.368730 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:53:37.368730 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:53:37.368730 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:53:37.368730 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:53:37.368730 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:53:37.368730 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:53:37.368730 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:53:37.368730 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:53:37.368730 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:53:37.368730 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:53:37.368730 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:53:37.370707 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:53:37.370707 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:53:37.370707 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 16 12:53:37.370707 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 16 12:53:37.370707 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:53:37.370707 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:53:37.370707 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:53:37.370707 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:53:37.370707 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1174928555 could not be found. Sep 16 12:53:37.370707 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:53:37.370707 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:53:37.370707 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:53:37.370707 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:53:37.370707 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:53:37.370707 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:53:37.370707 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:53:37.370707 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:53:37.370707 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1174928555 could not be found. Sep 16 12:53:37.370707 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:53:37.387504 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-58ef4599-6608-46b1-a718-410aa3bc032d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1199 microversion: 2.1 time: 0.534369 Sep 16 12:53:37.387504 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1047/2035] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:36 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1199 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:37.390636 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a7399e99-6f8c-42cc-b64e-2d6e3a9cbb00 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Returning 404 to user: Instance tempest-invalid-1174928555 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:53:37.391782 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a7399e99-6f8c-42cc-b64e-2d6e3a9cbb00 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] 10.222.0.67 "POST /compute/v2.1/servers/tempest-invalid-1174928555/action" status: 404 len: 101 microversion: 2.1 time: 0.041425 Sep 16 12:53:37.392964 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 989/2036] 10.222.0.67 () {60 vars in 1249 bytes} [Fri Sep 16 12:53:37 2022] POST /compute/v2.1/servers/tempest-invalid-1174928555/action => generated 101 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:53:37.404607 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6b4204c9-1b1d-4c44-93ae-3a6993f6e06d tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1531826140"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:37.406983 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6b4204c9-1b1d-4c44-93ae-3a6993f6e06d tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 16 12:53:37.407495 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-6b4204c9-1b1d-4c44-93ae-3a6993f6e06d tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 16 12:53:37.409682 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6b4204c9-1b1d-4c44-93ae-3a6993f6e06d tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Request method failure captured: Sep 16 12:53:37.409682 n-d-858094-4 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 16 12:53:37.409682 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:53:37.409682 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:53:37.409682 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:53:37.409682 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 57 Sep 16 12:53:37.409682 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:53:37.409682 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:53:37.409682 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:53:37.409682 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:53:37.409682 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHGjayKbq0g69LWdUnsegLU1jLLzP69B_sKbVtz9AX0KlcgpEUmuZ5fub7ppq1hm9y-1wU2wwxTD-hK36pIAZKZn5AFFB_eITAH6DCP42u-Y1g63RE4rzUIYUJ11Ddft1JRun44t5rJZoPEL4ruvlE_DjRP04Z5ImwhcghnQwyHeVSU Sep 16 12:53:37.409682 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:53:37.409682 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:53:37.409682 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:53:37.409682 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:53:37.409682 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:53:37.409682 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:53:37.409682 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: b10cd073476b420c89d93ce9c5a608c5 Sep 16 12:53:37.409682 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesNegativeTestJSON-203448148 Sep 16 12:53:37.409682 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:53:37.409682 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:53:37.411534 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b10cd073476b420c89d93ce9c5a608c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b10cd073476b420c89d93ce9c5a608c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b10cd073476b420c89d93ce9c5a608c5", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b10cd073476b420c89d93ce9c5a608c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:53:37.411534 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesNegativeTestJSON-203448148 Sep 16 12:53:37.411534 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: b10cd073476b420c89d93ce9c5a608c5 Sep 16 12:53:37.411534 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-203448148 Sep 16 12:53:37.411534 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ImagesNegativeTestJSON-203448148-project Sep 16 12:53:37.411534 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:53:37.411534 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:53:37.411534 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 59c5683ddbb047348d4924b7ce957472 Sep 16 12:53:37.411534 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesNegativeTestJSON-203448148-project Sep 16 12:53:37.411534 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 12:53:37.411534 n-d-858094-4 devstack@n-api.service[128779]: {"createImage": {"name": "tempest-test-snap-1531826140"}} Sep 16 12:53:37.411534 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:53:37.411534 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 16 12:53:37.412656 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1531826140'}}} Sep 16 12:53:37.412656 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:53:37.412656 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:53:37.412656 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:53:37.412656 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:53:37.412656 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 16 12:53:37.412656 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 16 12:53:37.412656 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 16 12:53:37.412656 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:53:37.412656 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:53:37.412656 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:53:37.412656 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:53:37.412656 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:53:37.412656 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:53:37.412656 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:53:37.412656 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:53:37.412656 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:53:37.412656 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:53:37.412656 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:53:37.412656 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:53:37.414219 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:53:37.414219 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:53:37.414219 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 16 12:53:37.414219 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 16 12:53:37.414219 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:53:37.414219 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:53:37.414219 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:53:37.414219 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:53:37.414219 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 16 12:53:37.414219 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:53:37.414219 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:53:37.414219 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:53:37.414219 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:53:37.414219 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:53:37.414219 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:53:37.414219 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:53:37.414219 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:53:37.414219 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 16 12:53:37.414219 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:53:37.415537 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6b4204c9-1b1d-4c44-93ae-3a6993f6e06d tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:53:37.415537 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6b4204c9-1b1d-4c44-93ae-3a6993f6e06d tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] 10.222.0.67 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.011700 Sep 16 12:53:37.415972 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1048/2037] 10.222.0.67 () {60 vars in 1275 bytes} [Fri Sep 16 12:53:37 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:53:37.421740 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c3f1a610-9e4f-4682-81e0-ff9d134239e2 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1288173606"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:37.424436 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c3f1a610-9e4f-4682-81e0-ff9d134239e2 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 16 12:53:37.425198 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-c3f1a610-9e4f-4682-81e0-ff9d134239e2 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 16 12:53:37.426964 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c3f1a610-9e4f-4682-81e0-ff9d134239e2 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Request method failure captured: Sep 16 12:53:37.426964 n-d-858094-4 devstack@n-api.service[128780]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 16 12:53:37.426964 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:53:37.426964 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:53:37.426964 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:53:37.426964 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 57 Sep 16 12:53:37.426964 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:53:37.426964 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:53:37.426964 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:53:37.426964 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:53:37.426964 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHGjayKbq0g69LWdUnsegLU1jLLzP69B_sKbVtz9AX0KlcgpEUmuZ5fub7ppq1hm9y-1wU2wwxTD-hK36pIAZKZn5AFFB_eITAH6DCP42u-Y1g63RE4rzUIYUJ11Ddft1JRun44t5rJZoPEL4ruvlE_DjRP04Z5ImwhcghnQwyHeVSU Sep 16 12:53:37.426964 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:53:37.426964 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:53:37.426964 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:53:37.426964 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:53:37.426964 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:53:37.426964 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:53:37.426964 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: b10cd073476b420c89d93ce9c5a608c5 Sep 16 12:53:37.426964 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ImagesNegativeTestJSON-203448148 Sep 16 12:53:37.426964 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:53:37.426964 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:53:37.428842 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b10cd073476b420c89d93ce9c5a608c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b10cd073476b420c89d93ce9c5a608c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b10cd073476b420c89d93ce9c5a608c5", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b10cd073476b420c89d93ce9c5a608c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:53:37.428842 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ImagesNegativeTestJSON-203448148 Sep 16 12:53:37.428842 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: b10cd073476b420c89d93ce9c5a608c5 Sep 16 12:53:37.428842 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-203448148 Sep 16 12:53:37.428842 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ImagesNegativeTestJSON-203448148-project Sep 16 12:53:37.428842 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:53:37.428842 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:53:37.428842 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 59c5683ddbb047348d4924b7ce957472 Sep 16 12:53:37.428842 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ImagesNegativeTestJSON-203448148-project Sep 16 12:53:37.428842 n-d-858094-4 devstack@n-api.service[128780]: Sep 16 12:53:37.428842 n-d-858094-4 devstack@n-api.service[128780]: {"createImage": {"name": "tempest-test-snap-1288173606"}} Sep 16 12:53:37.428842 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:53:37.428842 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 16 12:53:37.429950 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1288173606'}}} Sep 16 12:53:37.429950 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:53:37.429950 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:53:37.429950 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:53:37.429950 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:53:37.429950 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 16 12:53:37.429950 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 16 12:53:37.429950 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 16 12:53:37.429950 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:53:37.429950 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:53:37.429950 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:53:37.429950 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:53:37.429950 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:53:37.429950 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:53:37.429950 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:53:37.429950 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:53:37.429950 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:53:37.429950 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:53:37.429950 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:53:37.429950 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:53:37.432045 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:53:37.432045 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:53:37.432045 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 16 12:53:37.432045 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 16 12:53:37.432045 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:53:37.432045 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:53:37.432045 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:53:37.432045 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:53:37.432045 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 16 12:53:37.432045 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:53:37.432045 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:53:37.432045 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:53:37.432045 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:53:37.432045 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:53:37.432045 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:53:37.432045 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:53:37.432045 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:53:37.432045 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 16 12:53:37.432045 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:53:37.435691 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c3f1a610-9e4f-4682-81e0-ff9d134239e2 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:53:37.436975 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c3f1a610-9e4f-4682-81e0-ff9d134239e2 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] 10.222.0.67 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.019973 Sep 16 12:53:37.438362 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 990/2038] 10.222.0.67 () {60 vars in 1281 bytes} [Fri Sep 16 12:53:37 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:53:37.448569 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-99f67c03-f64e-4698-9a87-0e6efc4f2249 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:37.449071 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-99f67c03-f64e-4698-9a87-0e6efc4f2249 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] [instance: e8c8969d-7c0d-4bfe-bd49-6271193614b9] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:37.459812 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99f67c03-f64e-4698-9a87-0e6efc4f2249 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:37.460408 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99f67c03-f64e-4698-9a87-0e6efc4f2249 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:37.460856 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99f67c03-f64e-4698-9a87-0e6efc4f2249 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:37.462420 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99f67c03-f64e-4698-9a87-0e6efc4f2249 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:37.462420 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99f67c03-f64e-4698-9a87-0e6efc4f2249 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:37.462645 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99f67c03-f64e-4698-9a87-0e6efc4f2249 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:37.480206 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-99f67c03-f64e-4698-9a87-0e6efc4f2249 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] HTTP exception thrown: Instance e8c8969d-7c0d-4bfe-bd49-6271193614b9 could not be found. Sep 16 12:53:37.482420 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-99f67c03-f64e-4698-9a87-0e6efc4f2249 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Request method failure captured: Sep 16 12:53:37.482420 n-d-858094-4 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9 HTTP/1.1 Sep 16 12:53:37.482420 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:53:37.482420 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:53:37.482420 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:53:37.482420 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:53:37.482420 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:53:37.482420 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:53:37.482420 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:53:37.482420 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:53:37.482420 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHGjayKbq0g69LWdUnsegLU1jLLzP69B_sKbVtz9AX0KlcgpEUmuZ5fub7ppq1hm9y-1wU2wwxTD-hK36pIAZKZn5AFFB_eITAH6DCP42u-Y1g63RE4rzUIYUJ11Ddft1JRun44t5rJZoPEL4ruvlE_DjRP04Z5ImwhcghnQwyHeVSU Sep 16 12:53:37.482420 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:53:37.482420 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:53:37.482420 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:53:37.482420 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:53:37.482420 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:53:37.482420 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:53:37.482420 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: b10cd073476b420c89d93ce9c5a608c5 Sep 16 12:53:37.482420 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesNegativeTestJSON-203448148 Sep 16 12:53:37.482420 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:53:37.482420 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:53:37.484060 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b10cd073476b420c89d93ce9c5a608c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b10cd073476b420c89d93ce9c5a608c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b10cd073476b420c89d93ce9c5a608c5", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b10cd073476b420c89d93ce9c5a608c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:53:37.484060 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesNegativeTestJSON-203448148 Sep 16 12:53:37.484060 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: b10cd073476b420c89d93ce9c5a608c5 Sep 16 12:53:37.484060 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-203448148 Sep 16 12:53:37.484060 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ImagesNegativeTestJSON-203448148-project Sep 16 12:53:37.484060 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:53:37.484060 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:53:37.484060 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 59c5683ddbb047348d4924b7ce957472 Sep 16 12:53:37.484060 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesNegativeTestJSON-203448148-project Sep 16 12:53:37.484060 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:53:37.484060 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance e8c8969d-7c0d-4bfe-bd49-6271193614b9 could not be found. Sep 16 12:53:37.484060 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': 'e8c8969d-7c0d-4bfe-bd49-6271193614b9'} Sep 16 12:53:37.484953 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:53:37.484953 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:53:37.484953 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:53:37.484953 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:53:37.484953 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:53:37.484953 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:53:37.484953 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:53:37.484953 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:53:37.484953 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:53:37.484953 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:53:37.484953 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8c8969d-7c0d-4bfe-bd49-6271193614b9 could not be found. Sep 16 12:53:37.484953 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:53:37.484953 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:53:37.484953 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:53:37.484953 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:53:37.484953 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:53:37.484953 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:53:37.484953 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:53:37.484953 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:53:37.484953 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:53:37.486364 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:53:37.486364 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 12:53:37.486364 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 12:53:37.486364 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 12:53:37.486364 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 12:53:37.486364 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:53:37.486364 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:53:37.486364 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:53:37.486364 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:53:37.486364 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8c8969d-7c0d-4bfe-bd49-6271193614b9 could not be found. Sep 16 12:53:37.486364 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:53:37.486364 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:53:37.486364 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:53:37.486364 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:53:37.486364 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:53:37.486364 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:53:37.486364 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:53:37.486364 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:53:37.486364 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8c8969d-7c0d-4bfe-bd49-6271193614b9 could not be found. Sep 16 12:53:37.486364 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:53:37.490443 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-99f67c03-f64e-4698-9a87-0e6efc4f2249 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Returning 404 to user: Instance e8c8969d-7c0d-4bfe-bd49-6271193614b9 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:53:37.490443 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-99f67c03-f64e-4698-9a87-0e6efc4f2249 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9" status: 404 len: 111 microversion: 2.1 time: 0.039759 Sep 16 12:53:37.490443 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1049/2039] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:53:37 2022] DELETE /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:53:37.497274 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-596c44e9-7d1d-4b91-993b-87dc1d565e88 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:37.498456 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-596c44e9-7d1d-4b91-993b-87dc1d565e88 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] [instance: e8c8969d-7c0d-4bfe-bd49-6271193614b9] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:37.508701 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-596c44e9-7d1d-4b91-993b-87dc1d565e88 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:37.509558 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-596c44e9-7d1d-4b91-993b-87dc1d565e88 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:37.510186 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-596c44e9-7d1d-4b91-993b-87dc1d565e88 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:37.511737 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-596c44e9-7d1d-4b91-993b-87dc1d565e88 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:37.512521 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-596c44e9-7d1d-4b91-993b-87dc1d565e88 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:37.513245 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-596c44e9-7d1d-4b91-993b-87dc1d565e88 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:37.529399 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-596c44e9-7d1d-4b91-993b-87dc1d565e88 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] HTTP exception thrown: Instance e8c8969d-7c0d-4bfe-bd49-6271193614b9 could not be found. Sep 16 12:53:37.531278 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-596c44e9-7d1d-4b91-993b-87dc1d565e88 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Request method failure captured: Sep 16 12:53:37.531278 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9 HTTP/1.1 Sep 16 12:53:37.531278 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:53:37.531278 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:53:37.531278 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:53:37.531278 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:53:37.531278 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:53:37.531278 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:53:37.531278 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:53:37.531278 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:53:37.531278 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHGjayKbq0g69LWdUnsegLU1jLLzP69B_sKbVtz9AX0KlcgpEUmuZ5fub7ppq1hm9y-1wU2wwxTD-hK36pIAZKZn5AFFB_eITAH6DCP42u-Y1g63RE4rzUIYUJ11Ddft1JRun44t5rJZoPEL4ruvlE_DjRP04Z5ImwhcghnQwyHeVSU Sep 16 12:53:37.531278 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:53:37.531278 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:53:37.531278 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:53:37.531278 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:53:37.531278 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:53:37.531278 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:53:37.531278 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: b10cd073476b420c89d93ce9c5a608c5 Sep 16 12:53:37.531278 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ImagesNegativeTestJSON-203448148 Sep 16 12:53:37.531278 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:53:37.531278 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:53:37.532895 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b10cd073476b420c89d93ce9c5a608c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b10cd073476b420c89d93ce9c5a608c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b10cd073476b420c89d93ce9c5a608c5", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b10cd073476b420c89d93ce9c5a608c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:53:37.532895 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ImagesNegativeTestJSON-203448148 Sep 16 12:53:37.532895 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: b10cd073476b420c89d93ce9c5a608c5 Sep 16 12:53:37.532895 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-203448148 Sep 16 12:53:37.532895 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ImagesNegativeTestJSON-203448148-project Sep 16 12:53:37.532895 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:53:37.532895 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:53:37.532895 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 59c5683ddbb047348d4924b7ce957472 Sep 16 12:53:37.532895 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ImagesNegativeTestJSON-203448148-project Sep 16 12:53:37.532895 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:53:37.532895 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance e8c8969d-7c0d-4bfe-bd49-6271193614b9 could not be found. Sep 16 12:53:37.532895 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'e8c8969d-7c0d-4bfe-bd49-6271193614b9'} Sep 16 12:53:37.533821 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:53:37.533821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:53:37.533821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:53:37.533821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:53:37.533821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:53:37.533821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:53:37.533821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:53:37.533821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:53:37.533821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:53:37.533821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:53:37.533821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8c8969d-7c0d-4bfe-bd49-6271193614b9 could not be found. Sep 16 12:53:37.533821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:53:37.533821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:53:37.533821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:53:37.533821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:53:37.533821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:53:37.533821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:53:37.533821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:53:37.533821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:53:37.533821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:53:37.535201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:53:37.535201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:53:37.535201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:53:37.535201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:53:37.535201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:53:37.535201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:53:37.535201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:53:37.535201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8c8969d-7c0d-4bfe-bd49-6271193614b9 could not be found. Sep 16 12:53:37.535201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:53:37.535201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:53:37.535201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:53:37.535201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:53:37.535201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:53:37.535201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:53:37.535201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:53:37.535201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:53:37.535201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8c8969d-7c0d-4bfe-bd49-6271193614b9 could not be found. Sep 16 12:53:37.535201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:53:37.537868 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-596c44e9-7d1d-4b91-993b-87dc1d565e88 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] Returning 404 to user: Instance e8c8969d-7c0d-4bfe-bd49-6271193614b9 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:53:37.538742 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-596c44e9-7d1d-4b91-993b-87dc1d565e88 tempest-ImagesNegativeTestJSON-203448148 tempest-ImagesNegativeTestJSON-203448148-project] 10.222.0.67 "GET /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9" status: 404 len: 111 microversion: 2.1 time: 0.049120 Sep 16 12:53:37.539474 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 991/2040] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:37 2022] GET /compute/v2.1/servers/e8c8969d-7c0d-4bfe-bd49-6271193614b9 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 12:53:37.548097 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fc289d59-5d7b-40b3-bde4-c8d523f66879 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:37.548736 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fc289d59-5d7b-40b3-bde4-c8d523f66879 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: c6b4a601-8b6e-498e-8c17-9e689c13db74] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:37.554999 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc289d59-5d7b-40b3-bde4-c8d523f66879 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:37.555427 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc289d59-5d7b-40b3-bde4-c8d523f66879 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:37.555865 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc289d59-5d7b-40b3-bde4-c8d523f66879 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:37.556640 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc289d59-5d7b-40b3-bde4-c8d523f66879 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:37.563325 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc289d59-5d7b-40b3-bde4-c8d523f66879 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:37.563907 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc289d59-5d7b-40b3-bde4-c8d523f66879 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:37.594377 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-fc289d59-5d7b-40b3-bde4-c8d523f66879 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] HTTP exception thrown: Instance c6b4a601-8b6e-498e-8c17-9e689c13db74 could not be found. Sep 16 12:53:37.600922 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fc289d59-5d7b-40b3-bde4-c8d523f66879 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Request method failure captured: Sep 16 12:53:37.600922 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 HTTP/1.1 Sep 16 12:53:37.600922 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:53:37.600922 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:53:37.600922 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:53:37.600922 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:53:37.600922 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:53:37.600922 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:53:37.600922 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:53:37.600922 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:53:37.600922 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHBRVCNZh7s3qiWk8e7dDntjLmx7Uq1o7Yz49PjdhXkeDEhxCJvSqDNaxFYD4ZTfwTB9gBWkkSsrzbdLOsywrJgACtdvqsMnejhS1OJL2U_sNrRKxh64yJLlkXbgE9PesdSsC3g-sqzkc1hnbiJ_-JHqu8VW7vvaYO1adojxOefjq2Q Sep 16 12:53:37.600922 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:53:37.600922 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:53:37.600922 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:53:37.600922 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:53:37.600922 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:53:37.600922 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:53:37.600922 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 0b18ec5302634d2a95e51547e0019d40 Sep 16 12:53:37.600922 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-MigrationsAdminTest-25653665 Sep 16 12:53:37.600922 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:53:37.600922 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:53:37.602525 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0b18ec5302634d2a95e51547e0019d40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0b18ec5302634d2a95e51547e0019d40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0b18ec5302634d2a95e51547e0019d40", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0b18ec5302634d2a95e51547e0019d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:53:37.602525 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-MigrationsAdminTest-25653665 Sep 16 12:53:37.602525 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 0b18ec5302634d2a95e51547e0019d40 Sep 16 12:53:37.602525 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-MigrationsAdminTest-25653665 Sep 16 12:53:37.602525 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-MigrationsAdminTest-25653665-project Sep 16 12:53:37.602525 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:53:37.602525 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:53:37.602525 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: f3e2827a76d14e4a88c4562f1c0351ac Sep 16 12:53:37.602525 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-MigrationsAdminTest-25653665-project Sep 16 12:53:37.602525 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:53:37.602525 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance c6b4a601-8b6e-498e-8c17-9e689c13db74 could not be found. Sep 16 12:53:37.602525 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': 'c6b4a601-8b6e-498e-8c17-9e689c13db74'} Sep 16 12:53:37.604265 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:53:37.604265 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:53:37.604265 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:53:37.604265 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:53:37.604265 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:53:37.604265 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:53:37.604265 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:53:37.604265 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:53:37.604265 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:53:37.604265 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:53:37.604265 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6b4a601-8b6e-498e-8c17-9e689c13db74 could not be found. Sep 16 12:53:37.604265 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:53:37.604265 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:53:37.604265 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:53:37.604265 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:53:37.604265 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:53:37.604265 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:53:37.604265 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:53:37.604265 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:53:37.604265 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:53:37.606729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:53:37.606729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:53:37.606729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:53:37.606729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:53:37.606729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:53:37.606729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:53:37.606729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:53:37.606729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6b4a601-8b6e-498e-8c17-9e689c13db74 could not be found. Sep 16 12:53:37.606729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:53:37.606729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:53:37.606729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:53:37.606729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:53:37.606729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:53:37.606729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:53:37.606729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:53:37.606729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:53:37.606729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6b4a601-8b6e-498e-8c17-9e689c13db74 could not be found. Sep 16 12:53:37.606729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:53:37.608266 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fc289d59-5d7b-40b3-bde4-c8d523f66879 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Returning 404 to user: Instance c6b4a601-8b6e-498e-8c17-9e689c13db74 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:53:37.608266 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fc289d59-5d7b-40b3-bde4-c8d523f66879 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74" status: 404 len: 111 microversion: 2.1 time: 0.058207 Sep 16 12:53:37.608266 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1050/2041] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:37 2022] GET /compute/v2.1/servers/c6b4a601-8b6e-498e-8c17-9e689c13db74 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:53:37.611963 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9090f7d0-a9db-4406-9423-145716b83fe9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:37.612220 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9090f7d0-a9db-4406-9423-145716b83fe9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: efea200a-0b78-42de-a9e2-febab9817590] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:37.618629 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9090f7d0-a9db-4406-9423-145716b83fe9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:37.619117 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9090f7d0-a9db-4406-9423-145716b83fe9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:37.619554 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9090f7d0-a9db-4406-9423-145716b83fe9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:37.620325 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9090f7d0-a9db-4406-9423-145716b83fe9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:37.620777 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9090f7d0-a9db-4406-9423-145716b83fe9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:37.621196 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9090f7d0-a9db-4406-9423-145716b83fe9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:37.661443 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9090f7d0-a9db-4406-9423-145716b83fe9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: efea200a-0b78-42de-a9e2-febab9817590] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:53:37.746372 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-da1eab4e-4af4-49df-a572-2022806745fb tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f1035181820>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:37.785523 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9090f7d0-a9db-4406-9423-145716b83fe9 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "DELETE /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590" status: 204 len: 0 microversion: 2.1 time: 0.177267 Sep 16 12:53:37.786479 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 992/2042] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:53:37 2022] DELETE /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:53:37.799197 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e363c5ef-54de-4c43-b1c7-16ed56f282d5 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:37.799910 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e363c5ef-54de-4c43-b1c7-16ed56f282d5 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: efea200a-0b78-42de-a9e2-febab9817590] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:37.827233 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-da1eab4e-4af4-49df-a572-2022806745fb tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/0c37e3b2-0f5c-45c2-a28a-7e732c529930" status: 200 len: 1453 microversion: 2.1 time: 0.087316 Sep 16 12:53:37.827817 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1051/2043] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:53:37 2022] GET /compute/v2.1/images/0c37e3b2-0f5c-45c2-a28a-7e732c529930 => generated 1453 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:37.835052 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e363c5ef-54de-4c43-b1c7-16ed56f282d5 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:37.835696 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e363c5ef-54de-4c43-b1c7-16ed56f282d5 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:37.836162 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e363c5ef-54de-4c43-b1c7-16ed56f282d5 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:37.836905 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e363c5ef-54de-4c43-b1c7-16ed56f282d5 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:37.837806 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e363c5ef-54de-4c43-b1c7-16ed56f282d5 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:37.837806 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e363c5ef-54de-4c43-b1c7-16ed56f282d5 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:37.850313 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b5eb89c5-d043-438e-9e24-d596518f3d0c tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:37.850942 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b5eb89c5-d043-438e-9e24-d596518f3d0c tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:37.874869 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b5eb89c5-d043-438e-9e24-d596518f3d0c tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:37.875364 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b5eb89c5-d043-438e-9e24-d596518f3d0c tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:37.875801 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b5eb89c5-d043-438e-9e24-d596518f3d0c tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:37.876534 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b5eb89c5-d043-438e-9e24-d596518f3d0c tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:37.877176 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b5eb89c5-d043-438e-9e24-d596518f3d0c tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:37.877766 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b5eb89c5-d043-438e-9e24-d596518f3d0c tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:38.288079 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b5eb89c5-d043-438e-9e24-d596518f3d0c tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:38.302612 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b5eb89c5-d043-438e-9e24-d596518f3d0c tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1362 microversion: 2.1 time: 0.468065 Sep 16 12:53:38.309090 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1052/2044] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:37 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1362 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:38.318934 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d679b95c-b5f2-4b81-9da4-268a03d3cd18 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '.version_select at 0x7f1035235670>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:38.402546 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d679b95c-b5f2-4b81-9da4-268a03d3cd18 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/images/186744c5-e6ba-4599-82dd-52b3517a8795" status: 200 len: 1429 microversion: 2.1 time: 0.091597 Sep 16 12:53:38.405314 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1053/2045] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:53:38 2022] GET /compute/v2.1/images/186744c5-e6ba-4599-82dd-52b3517a8795 => generated 1429 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:38.419074 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5443d321-2b79-4992-83a0-ec4e4441d484 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:38.420057 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5443d321-2b79-4992-83a0-ec4e4441d484 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 227a8a0b-2a0c-48f8-976a-a176a9039a2d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:38.438612 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5443d321-2b79-4992-83a0-ec4e4441d484 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:38.439894 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5443d321-2b79-4992-83a0-ec4e4441d484 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:38.440355 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5443d321-2b79-4992-83a0-ec4e4441d484 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:38.443920 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5443d321-2b79-4992-83a0-ec4e4441d484 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:38.444542 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5443d321-2b79-4992-83a0-ec4e4441d484 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:38.445003 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5443d321-2b79-4992-83a0-ec4e4441d484 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:38.452559 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e363c5ef-54de-4c43-b1c7-16ed56f282d5 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e2827a76d14e4a88c4562f1c0351ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18ec5302634d2a95e51547e0019d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:38.462278 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e363c5ef-54de-4c43-b1c7-16ed56f282d5 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590" status: 200 len: 1468 microversion: 2.1 time: 0.670945 Sep 16 12:53:38.463063 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 993/2046] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:37 2022] GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590 => generated 1468 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:38.477463 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-046eefdf-936f-4f30-b73a-e18545923bd1 req-eb0b518c-3a2c-4218-8a86-7ced4746d74b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "345ee81d-c503-421c-90ea-218ac1c98600", "name": "network-vif-plugged", "status": "completed", "tag": "56c49806-0b21-4f4b-9b96-195fc33fcba5"}, {"server_uuid": "5219baf4-bfde-4037-a511-88ff2690ea6a", "name": "network-vif-plugged", "status": "completed", "tag": "537bc282-546d-4a7e-b32f-2149067cc012"}, {"server_uuid": "227a8a0b-2a0c-48f8-976a-a176a9039a2d", "name": "network-vif-plugged", "status": "completed", "tag": "586b7cfc-f67a-48f3-beb9-5cd2ca16334c"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:38.517846 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-046eefdf-936f-4f30-b73a-e18545923bd1 req-eb0b518c-3a2c-4218-8a86-7ced4746d74b service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:38.518417 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-046eefdf-936f-4f30-b73a-e18545923bd1 req-eb0b518c-3a2c-4218-8a86-7ced4746d74b service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:38.518954 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-046eefdf-936f-4f30-b73a-e18545923bd1 req-eb0b518c-3a2c-4218-8a86-7ced4746d74b service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:38.566471 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-046eefdf-936f-4f30-b73a-e18545923bd1 req-eb0b518c-3a2c-4218-8a86-7ced4746d74b service nova] Creating event network-vif-plugged:56c49806-0b21-4f4b-9b96-195fc33fcba5 for instance 345ee81d-c503-421c-90ea-218ac1c98600 on n-h1-858094-4 Sep 16 12:53:38.571646 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-046eefdf-936f-4f30-b73a-e18545923bd1 req-eb0b518c-3a2c-4218-8a86-7ced4746d74b service nova] Creating event network-vif-plugged:537bc282-546d-4a7e-b32f-2149067cc012 for instance 5219baf4-bfde-4037-a511-88ff2690ea6a on n-h2-858094-4 Sep 16 12:53:38.576708 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-046eefdf-936f-4f30-b73a-e18545923bd1 req-eb0b518c-3a2c-4218-8a86-7ced4746d74b service nova] Creating event network-vif-plugged:586b7cfc-f67a-48f3-beb9-5cd2ca16334c for instance 227a8a0b-2a0c-48f8-976a-a176a9039a2d on n-h2-858094-4 Sep 16 12:53:38.594701 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-046eefdf-936f-4f30-b73a-e18545923bd1 req-eb0b518c-3a2c-4218-8a86-7ced4746d74b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.124110 Sep 16 12:53:38.595718 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 994/2047] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:53:38.609855 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-71cd46a0-48d6-4fa5-806d-aea75ed3644d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:38.610909 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-71cd46a0-48d6-4fa5-806d-aea75ed3644d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:38.636736 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-71cd46a0-48d6-4fa5-806d-aea75ed3644d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:38.637379 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-71cd46a0-48d6-4fa5-806d-aea75ed3644d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:38.638052 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-71cd46a0-48d6-4fa5-806d-aea75ed3644d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:38.638843 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-71cd46a0-48d6-4fa5-806d-aea75ed3644d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:38.639374 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-71cd46a0-48d6-4fa5-806d-aea75ed3644d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:38.639874 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-71cd46a0-48d6-4fa5-806d-aea75ed3644d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:39.548544 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-71cd46a0-48d6-4fa5-806d-aea75ed3644d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:39.562167 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-71cd46a0-48d6-4fa5-806d-aea75ed3644d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:39.564932 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-71cd46a0-48d6-4fa5-806d-aea75ed3644d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:39.569371 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-71cd46a0-48d6-4fa5-806d-aea75ed3644d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 1411 microversion: 2.25 time: 0.972278 Sep 16 12:53:39.583657 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 995/2048] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:53:38 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 1411 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:53:39.583657 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8c4bd388-9d4c-4634-ae69-75a21d7f0512 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:39.585163 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8c4bd388-9d4c-4634-ae69-75a21d7f0512 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:39.607549 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8c4bd388-9d4c-4634-ae69-75a21d7f0512 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:39.608432 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8c4bd388-9d4c-4634-ae69-75a21d7f0512 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:39.609053 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8c4bd388-9d4c-4634-ae69-75a21d7f0512 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:39.609979 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8c4bd388-9d4c-4634-ae69-75a21d7f0512 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:39.610948 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8c4bd388-9d4c-4634-ae69-75a21d7f0512 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:39.612172 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8c4bd388-9d4c-4634-ae69-75a21d7f0512 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:40.418582 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5443d321-2b79-4992-83a0-ec4e4441d484 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9101f5af9e34d21bb8e872d337d3545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e41136645964ea98a675833bd73299f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:40.440758 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5443d321-2b79-4992-83a0-ec4e4441d484 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "GET /compute/v2.1/servers/227a8a0b-2a0c-48f8-976a-a176a9039a2d" status: 200 len: 1324 microversion: 2.1 time: 2.028208 Sep 16 12:53:40.442278 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1054/2049] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:38 2022] GET /compute/v2.1/servers/227a8a0b-2a0c-48f8-976a-a176a9039a2d => generated 1324 bytes in 2036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:40.461581 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-04af6e01-022b-462e-a7df-c7871bfa03d1 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f1035195d30>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:40.909834 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8c4bd388-9d4c-4634-ae69-75a21d7f0512 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:40.952964 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8c4bd388-9d4c-4634-ae69-75a21d7f0512 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1199 microversion: 2.1 time: 1.380684 Sep 16 12:53:40.982240 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 996/2050] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:39 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1199 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:40.996763 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-248b66f4-19c3-4dd4-a137-55bab35b0c70 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:40.997744 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-248b66f4-19c3-4dd4-a137-55bab35b0c70 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:41.016903 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-248b66f4-19c3-4dd4-a137-55bab35b0c70 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:41.032919 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-248b66f4-19c3-4dd4-a137-55bab35b0c70 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:41.035034 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-248b66f4-19c3-4dd4-a137-55bab35b0c70 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:41.036937 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-248b66f4-19c3-4dd4-a137-55bab35b0c70 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:41.038196 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-248b66f4-19c3-4dd4-a137-55bab35b0c70 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:41.040646 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-248b66f4-19c3-4dd4-a137-55bab35b0c70 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:41.825817 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:53:42.018453 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-248b66f4-19c3-4dd4-a137-55bab35b0c70 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:42.030711 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-248b66f4-19c3-4dd4-a137-55bab35b0c70 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1549 microversion: 2.1 time: 1.046773 Sep 16 12:53:42.034969 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 997/2051] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:40 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1549 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:42.050545 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-505ffabf-2b5b-4422-9d5c-76597e95d738 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '.version_select at 0x7f10358deb80>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:42.106947 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=8 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:53:48.433739 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:53:50.429968 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=42 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:53:51.006522 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:53:52.023425 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:53:54.222197 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-04af6e01-022b-462e-a7df-c7871bfa03d1 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/0c37e3b2-0f5c-45c2-a28a-7e732c529930" status: 200 len: 1462 microversion: 2.1 time: 13.777949 Sep 16 12:53:54.237111 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1055/2052] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:53:40 2022] GET /compute/v2.1/images/0c37e3b2-0f5c-45c2-a28a-7e732c529930 => generated 1462 bytes in 13793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:54.244028 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d0463eeb-a8f6-465f-a888-79e1c7256171 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:54.244683 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d0463eeb-a8f6-465f-a888-79e1c7256171 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] [instance: efea200a-0b78-42de-a9e2-febab9817590] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:54.266243 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0463eeb-a8f6-465f-a888-79e1c7256171 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:54.266768 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0463eeb-a8f6-465f-a888-79e1c7256171 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:54.267242 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0463eeb-a8f6-465f-a888-79e1c7256171 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:54.267998 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0463eeb-a8f6-465f-a888-79e1c7256171 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:54.268501 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0463eeb-a8f6-465f-a888-79e1c7256171 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:54.268928 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0463eeb-a8f6-465f-a888-79e1c7256171 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:54.283530 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-505ffabf-2b5b-4422-9d5c-76597e95d738 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/images/186744c5-e6ba-4599-82dd-52b3517a8795" status: 200 len: 1429 microversion: 2.1 time: 12.247251 Sep 16 12:53:54.300075 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 998/2053] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:53:42 2022] GET /compute/v2.1/images/186744c5-e6ba-4599-82dd-52b3517a8795 => generated 1429 bytes in 12264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:54.318004 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-1ed72440-48ac-4878-b60b-ff41da4b54f6 req-9caaf68e-5ecf-4bca-b7e2-b4a33cf7a0f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d49156a2-d78c-4601-a431-e09716c76ce8", "tag": "d289a714-1b0e-4177-adf6-0d59780fa902"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:54.327878 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-d0463eeb-a8f6-465f-a888-79e1c7256171 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] HTTP exception thrown: Instance efea200a-0b78-42de-a9e2-febab9817590 could not be found. Sep 16 12:53:54.330490 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d0463eeb-a8f6-465f-a888-79e1c7256171 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Request method failure captured: Sep 16 12:53:54.330490 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590 HTTP/1.1 Sep 16 12:53:54.330490 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:53:54.330490 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:53:54.330490 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:53:54.330490 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:53:54.330490 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:53:54.330490 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:53:54.330490 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:53:54.330490 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:53:54.330490 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHBRVCNZh7s3qiWk8e7dDntjLmx7Uq1o7Yz49PjdhXkeDEhxCJvSqDNaxFYD4ZTfwTB9gBWkkSsrzbdLOsywrJgACtdvqsMnejhS1OJL2U_sNrRKxh64yJLlkXbgE9PesdSsC3g-sqzkc1hnbiJ_-JHqu8VW7vvaYO1adojxOefjq2Q Sep 16 12:53:54.330490 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:53:54.330490 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:53:54.330490 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:53:54.330490 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:53:54.330490 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:53:54.330490 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:53:54.330490 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 0b18ec5302634d2a95e51547e0019d40 Sep 16 12:53:54.330490 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-MigrationsAdminTest-25653665 Sep 16 12:53:54.330490 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:53:54.330490 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:53:54.332998 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0b18ec5302634d2a95e51547e0019d40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0b18ec5302634d2a95e51547e0019d40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0b18ec5302634d2a95e51547e0019d40", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0b18ec5302634d2a95e51547e0019d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:53:54.332998 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-MigrationsAdminTest-25653665 Sep 16 12:53:54.332998 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 0b18ec5302634d2a95e51547e0019d40 Sep 16 12:53:54.332998 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-MigrationsAdminTest-25653665 Sep 16 12:53:54.332998 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-MigrationsAdminTest-25653665-project Sep 16 12:53:54.332998 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:53:54.332998 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:53:54.332998 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: f3e2827a76d14e4a88c4562f1c0351ac Sep 16 12:53:54.332998 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-MigrationsAdminTest-25653665-project Sep 16 12:53:54.332998 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:53:54.332998 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance efea200a-0b78-42de-a9e2-febab9817590 could not be found. Sep 16 12:53:54.332998 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': 'efea200a-0b78-42de-a9e2-febab9817590'} Sep 16 12:53:54.334302 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:53:54.334302 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:53:54.334302 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:53:54.334302 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:53:54.334302 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:53:54.334302 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:53:54.334302 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:53:54.334302 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:53:54.334302 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:53:54.334302 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:53:54.334302 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efea200a-0b78-42de-a9e2-febab9817590 could not be found. Sep 16 12:53:54.334302 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:53:54.334302 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:53:54.334302 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:53:54.334302 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:53:54.334302 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:53:54.334302 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:53:54.334302 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:53:54.334302 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:53:54.334302 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:53:54.336651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:53:54.336651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:53:54.336651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:53:54.336651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:53:54.336651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:53:54.336651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:53:54.336651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:53:54.336651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efea200a-0b78-42de-a9e2-febab9817590 could not be found. Sep 16 12:53:54.336651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:53:54.336651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:53:54.336651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:53:54.336651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:53:54.336651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:53:54.336651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:53:54.336651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:53:54.336651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:53:54.336651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efea200a-0b78-42de-a9e2-febab9817590 could not be found. Sep 16 12:53:54.336651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:53:54.340221 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d0463eeb-a8f6-465f-a888-79e1c7256171 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] Returning 404 to user: Instance efea200a-0b78-42de-a9e2-febab9817590 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:53:54.342182 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d0463eeb-a8f6-465f-a888-79e1c7256171 tempest-MigrationsAdminTest-25653665 tempest-MigrationsAdminTest-25653665-project] 10.222.0.67 "GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590" status: 404 len: 111 microversion: 2.1 time: 0.103392 Sep 16 12:53:54.344850 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1056/2054] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:54 2022] GET /compute/v2.1/servers/efea200a-0b78-42de-a9e2-febab9817590 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:53:54.356344 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bcdbc043-ab66-45af-8dea-0d56989a52f5 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:54.364648 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-1ed72440-48ac-4878-b60b-ff41da4b54f6 req-9caaf68e-5ecf-4bca-b7e2-b4a33cf7a0f4 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:54.366414 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-1ed72440-48ac-4878-b60b-ff41da4b54f6 req-9caaf68e-5ecf-4bca-b7e2-b4a33cf7a0f4 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:54.366981 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bcdbc043-ab66-45af-8dea-0d56989a52f5 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:54.367853 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-1ed72440-48ac-4878-b60b-ff41da4b54f6 req-9caaf68e-5ecf-4bca-b7e2-b4a33cf7a0f4 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:54.386727 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bcdbc043-ab66-45af-8dea-0d56989a52f5 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:54.390716 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bcdbc043-ab66-45af-8dea-0d56989a52f5 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:54.391814 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bcdbc043-ab66-45af-8dea-0d56989a52f5 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:54.393140 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bcdbc043-ab66-45af-8dea-0d56989a52f5 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:54.398206 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bcdbc043-ab66-45af-8dea-0d56989a52f5 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:54.399086 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bcdbc043-ab66-45af-8dea-0d56989a52f5 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:54.408014 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-1ed72440-48ac-4878-b60b-ff41da4b54f6 req-9caaf68e-5ecf-4bca-b7e2-b4a33cf7a0f4 service nova] Creating event network-changed:d289a714-1b0e-4177-adf6-0d59780fa902 for instance d49156a2-d78c-4601-a431-e09716c76ce8 on n-h2-858094-4 Sep 16 12:53:54.429361 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-1ed72440-48ac-4878-b60b-ff41da4b54f6 req-9caaf68e-5ecf-4bca-b7e2-b4a33cf7a0f4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127394 Sep 16 12:53:54.430174 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 999/2055] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:53:54.454572 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-73148758-a2db-4c78-bf1a-e9e4bb5f18d1 req-090c6df8-efa3-4f82-b29b-dac76144df15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd1530a2-c78e-419d-a65e-fc5baf53d939", "name": "network-vif-plugged", "status": "completed", "tag": "efae6ffd-f514-46a4-ad30-4fa3504874c8"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:54.501893 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-73148758-a2db-4c78-bf1a-e9e4bb5f18d1 req-090c6df8-efa3-4f82-b29b-dac76144df15 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:54.507101 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-73148758-a2db-4c78-bf1a-e9e4bb5f18d1 req-090c6df8-efa3-4f82-b29b-dac76144df15 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:54.521562 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-73148758-a2db-4c78-bf1a-e9e4bb5f18d1 req-090c6df8-efa3-4f82-b29b-dac76144df15 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:54.567064 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-73148758-a2db-4c78-bf1a-e9e4bb5f18d1 req-090c6df8-efa3-4f82-b29b-dac76144df15 service nova] Creating event network-vif-plugged:efae6ffd-f514-46a4-ad30-4fa3504874c8 for instance bd1530a2-c78e-419d-a65e-fc5baf53d939 on n-h2-858094-4 Sep 16 12:53:54.591324 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-73148758-a2db-4c78-bf1a-e9e4bb5f18d1 req-090c6df8-efa3-4f82-b29b-dac76144df15 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154996 Sep 16 12:53:54.595796 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1000/2056] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:53:54.621113 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-3ea110b1-774f-46a4-ad2d-1828b5ea2473 req-02c61a6f-b17c-4fc7-8941-c699c7c42acf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efea200a-0b78-42de-a9e2-febab9817590", "name": "network-vif-deleted", "tag": "3fe50ad6-99ae-4c0b-a11b-3e41218b0317"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:54.639698 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-3ea110b1-774f-46a4-ad2d-1828b5ea2473 req-02c61a6f-b17c-4fc7-8941-c699c7c42acf service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:54.652963 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-3ea110b1-774f-46a4-ad2d-1828b5ea2473 req-02c61a6f-b17c-4fc7-8941-c699c7c42acf service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:54.654142 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-3ea110b1-774f-46a4-ad2d-1828b5ea2473 req-02c61a6f-b17c-4fc7-8941-c699c7c42acf service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:54.713962 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-3ea110b1-774f-46a4-ad2d-1828b5ea2473 req-02c61a6f-b17c-4fc7-8941-c699c7c42acf service nova] Creating event network-vif-deleted:3fe50ad6-99ae-4c0b-a11b-3e41218b0317 for instance efea200a-0b78-42de-a9e2-febab9817590 on n-h1-858094-4 Sep 16 12:53:54.744443 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-3ea110b1-774f-46a4-ad2d-1828b5ea2473 req-02c61a6f-b17c-4fc7-8941-c699c7c42acf service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146703 Sep 16 12:53:54.750817 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1001/2057] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:53:54.768734 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fac495f9-bfcc-47d8-8270-916564570ccd tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:54.769837 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-fac495f9-bfcc-47d8-8270-916564570ccd tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 227a8a0b-2a0c-48f8-976a-a176a9039a2d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:54.789557 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fac495f9-bfcc-47d8-8270-916564570ccd tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:54.792446 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fac495f9-bfcc-47d8-8270-916564570ccd tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:54.794078 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fac495f9-bfcc-47d8-8270-916564570ccd tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:54.798583 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fac495f9-bfcc-47d8-8270-916564570ccd tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:54.799410 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fac495f9-bfcc-47d8-8270-916564570ccd tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:54.800020 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fac495f9-bfcc-47d8-8270-916564570ccd tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:54.874341 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bcdbc043-ab66-45af-8dea-0d56989a52f5 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:54.915315 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bcdbc043-ab66-45af-8dea-0d56989a52f5 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:54.926926 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bcdbc043-ab66-45af-8dea-0d56989a52f5 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:54.932336 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bcdbc043-ab66-45af-8dea-0d56989a52f5 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 1411 microversion: 2.25 time: 0.581342 Sep 16 12:53:54.960987 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1057/2058] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:53:54 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 1411 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:53:54.986730 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-54d40df0-c47e-4e76-b378-d5b8c506f024 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:54.990931 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-54d40df0-c47e-4e76-b378-d5b8c506f024 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:55.022293 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54d40df0-c47e-4e76-b378-d5b8c506f024 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:55.025019 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54d40df0-c47e-4e76-b378-d5b8c506f024 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:55.027291 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54d40df0-c47e-4e76-b378-d5b8c506f024 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:55.036387 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54d40df0-c47e-4e76-b378-d5b8c506f024 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:55.039509 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54d40df0-c47e-4e76-b378-d5b8c506f024 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:55.040663 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54d40df0-c47e-4e76-b378-d5b8c506f024 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:55.298740 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-fac495f9-bfcc-47d8-8270-916564570ccd tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9101f5af9e34d21bb8e872d337d3545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e41136645964ea98a675833bd73299f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:55.342676 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-fac495f9-bfcc-47d8-8270-916564570ccd tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "GET /compute/v2.1/servers/227a8a0b-2a0c-48f8-976a-a176a9039a2d" status: 200 len: 1520 microversion: 2.1 time: 0.584077 Sep 16 12:53:55.353114 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1002/2059] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:54 2022] GET /compute/v2.1/servers/227a8a0b-2a0c-48f8-976a-a176a9039a2d => generated 1520 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:55.366402 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-749d2cd7-b3fc-4fdc-83f8-e13d12bcf300 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:55.370006 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-749d2cd7-b3fc-4fdc-83f8-e13d12bcf300 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:55.381170 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-749d2cd7-b3fc-4fdc-83f8-e13d12bcf300 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:55.386825 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-749d2cd7-b3fc-4fdc-83f8-e13d12bcf300 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:55.387588 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-749d2cd7-b3fc-4fdc-83f8-e13d12bcf300 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:55.389924 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-749d2cd7-b3fc-4fdc-83f8-e13d12bcf300 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:55.393601 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-749d2cd7-b3fc-4fdc-83f8-e13d12bcf300 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:55.394390 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-749d2cd7-b3fc-4fdc-83f8-e13d12bcf300 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:55.541152 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-749d2cd7-b3fc-4fdc-83f8-e13d12bcf300 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.185785 Sep 16 12:53:55.542164 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1003/2060] 10.222.0.67 () {58 vars in 1275 bytes} [Fri Sep 16 12:53:55 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88/os-interface => generated 285 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:53:55.551755 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b4554df0-a0e7-470e-bc77-6fd9705d16c9 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f1035eeeee0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:55.637292 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b4554df0-a0e7-470e-bc77-6fd9705d16c9 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/0c37e3b2-0f5c-45c2-a28a-7e732c529930" status: 200 len: 1462 microversion: 2.1 time: 0.093631 Sep 16 12:53:55.648273 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1004/2061] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:53:55 2022] GET /compute/v2.1/images/0c37e3b2-0f5c-45c2-a28a-7e732c529930 => generated 1462 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:55.659915 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-368862c0-d34c-4428-ba51-4ad8bf7bc4b3 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '.version_select at 0x7f1035ee63a0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:55.784517 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-368862c0-d34c-4428-ba51-4ad8bf7bc4b3 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/images/186744c5-e6ba-4599-82dd-52b3517a8795" status: 200 len: 1438 microversion: 2.1 time: 0.134537 Sep 16 12:53:55.785126 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1005/2062] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:53:55 2022] GET /compute/v2.1/images/186744c5-e6ba-4599-82dd-52b3517a8795 => generated 1438 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:55.802107 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-35bdf970-3f23-48bd-8621-32d63bf4eaa7 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.147"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:55.805272 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-35bdf970-3f23-48bd-8621-32d63bf4eaa7 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 5c161179-0b93-4676-86f7-2f507a3ebeb3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:55.812881 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-35bdf970-3f23-48bd-8621-32d63bf4eaa7 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:55.814122 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-35bdf970-3f23-48bd-8621-32d63bf4eaa7 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:55.815092 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-35bdf970-3f23-48bd-8621-32d63bf4eaa7 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:55.816251 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-35bdf970-3f23-48bd-8621-32d63bf4eaa7 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:55.817260 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-35bdf970-3f23-48bd-8621-32d63bf4eaa7 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:55.817940 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-35bdf970-3f23-48bd-8621-32d63bf4eaa7 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:55.851395 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-35bdf970-3f23-48bd-8621-32d63bf4eaa7 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "refresh_cache-5c161179-0b93-4676-86f7-2f507a3ebeb3" {{(pid=128780) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 16 12:53:55.852357 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-35bdf970-3f23-48bd-8621-32d63bf4eaa7 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquired lock "refresh_cache-5c161179-0b93-4676-86f7-2f507a3ebeb3" {{(pid=128780) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 16 12:53:55.948158 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-54d40df0-c47e-4e76-b378-d5b8c506f024 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:55.967000 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-54d40df0-c47e-4e76-b378-d5b8c506f024 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1199 microversion: 2.1 time: 1.003694 Sep 16 12:53:55.982172 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1058/2063] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:54 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1199 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:56.001303 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-83236363-ff62-4d00-84c9-eb5be020f023 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:56.005631 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-83236363-ff62-4d00-84c9-eb5be020f023 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] [instance: 5219baf4-bfde-4037-a511-88ff2690ea6a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:56.024500 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83236363-ff62-4d00-84c9-eb5be020f023 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:56.026355 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83236363-ff62-4d00-84c9-eb5be020f023 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:56.027518 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83236363-ff62-4d00-84c9-eb5be020f023 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:56.032345 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83236363-ff62-4d00-84c9-eb5be020f023 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:56.033782 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83236363-ff62-4d00-84c9-eb5be020f023 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:56.034456 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83236363-ff62-4d00-84c9-eb5be020f023 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:56.639065 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-83236363-ff62-4d00-84c9-eb5be020f023 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63998619bf654ebb8d74f91e42c8c780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e81fca8624d18b9415a46e158d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:56.664174 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-83236363-ff62-4d00-84c9-eb5be020f023 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/servers/5219baf4-bfde-4037-a511-88ff2690ea6a" status: 200 len: 1466 microversion: 2.1 time: 0.678420 Sep 16 12:53:56.666150 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1059/2064] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:55 2022] GET /compute/v2.1/servers/5219baf4-bfde-4037-a511-88ff2690ea6a => generated 1466 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:56.686410 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-43de1364-1a4d-4fb4-99d3-61dc72beb7b9 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '.version_select at 0x7f1035190d30>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:56.840676 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-43de1364-1a4d-4fb4-99d3-61dc72beb7b9 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/images/186744c5-e6ba-4599-82dd-52b3517a8795" status: 200 len: 1438 microversion: 2.1 time: 0.168475 Sep 16 12:53:56.841979 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1060/2065] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:53:56 2022] GET /compute/v2.1/images/186744c5-e6ba-4599-82dd-52b3517a8795 => generated 1438 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:56.852712 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9aea411f-7209-4195-8edb-d175190a5e43 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:56.857913 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9aea411f-7209-4195-8edb-d175190a5e43 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:56.869159 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9aea411f-7209-4195-8edb-d175190a5e43 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:56.871568 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9aea411f-7209-4195-8edb-d175190a5e43 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:56.872530 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9aea411f-7209-4195-8edb-d175190a5e43 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:56.873588 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9aea411f-7209-4195-8edb-d175190a5e43 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:56.875425 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9aea411f-7209-4195-8edb-d175190a5e43 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:56.876702 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9aea411f-7209-4195-8edb-d175190a5e43 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:57.690958 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9aea411f-7209-4195-8edb-d175190a5e43 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:57.709781 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9aea411f-7209-4195-8edb-d175190a5e43 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:57.711923 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9aea411f-7209-4195-8edb-d175190a5e43 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:57.713524 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9aea411f-7209-4195-8edb-d175190a5e43 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 1411 microversion: 2.25 time: 0.869185 Sep 16 12:53:57.736916 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1061/2066] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:53:56 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 1411 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:53:57.745452 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-29d0c0a7-16a8-499b-ba4e-4298f293f445 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2081410671"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:57.748466 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-29d0c0a7-16a8-499b-ba4e-4298f293f445 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] [instance: c97d5f35-6ea1-4ec7-88f5-9da9dbe81182] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:57.756023 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29d0c0a7-16a8-499b-ba4e-4298f293f445 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:57.756888 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29d0c0a7-16a8-499b-ba4e-4298f293f445 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:57.757506 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29d0c0a7-16a8-499b-ba4e-4298f293f445 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:57.758443 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29d0c0a7-16a8-499b-ba4e-4298f293f445 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:57.759107 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29d0c0a7-16a8-499b-ba4e-4298f293f445 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:57.759719 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29d0c0a7-16a8-499b-ba4e-4298f293f445 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:58.220571 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-29d0c0a7-16a8-499b-ba4e-4298f293f445 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "POST /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182/action" status: 202 len: 0 microversion: 2.1 time: 0.481315 Sep 16 12:53:58.221248 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1062/2067] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:53:57 2022] POST /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182/action => generated 0 bytes in 483 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 16 12:53:58.229176 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-a9a56fce-3280-4a37-8f57-537aacdd6064 req-8abe2e89-279b-4d82-9f8b-3e44e5c6ed24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d49156a2-d78c-4601-a431-e09716c76ce8", "name": "network-vif-plugged", "status": "completed", "tag": "d289a714-1b0e-4177-adf6-0d59780fa902"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:53:58.263659 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a9a56fce-3280-4a37-8f57-537aacdd6064 req-8abe2e89-279b-4d82-9f8b-3e44e5c6ed24 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:58.264369 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a9a56fce-3280-4a37-8f57-537aacdd6064 req-8abe2e89-279b-4d82-9f8b-3e44e5c6ed24 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:58.264920 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a9a56fce-3280-4a37-8f57-537aacdd6064 req-8abe2e89-279b-4d82-9f8b-3e44e5c6ed24 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:58.336941 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-a9a56fce-3280-4a37-8f57-537aacdd6064 req-8abe2e89-279b-4d82-9f8b-3e44e5c6ed24 service nova] Creating event network-vif-plugged:d289a714-1b0e-4177-adf6-0d59780fa902 for instance d49156a2-d78c-4601-a431-e09716c76ce8 on n-h2-858094-4 Sep 16 12:53:58.359434 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-a9a56fce-3280-4a37-8f57-537aacdd6064 req-8abe2e89-279b-4d82-9f8b-3e44e5c6ed24 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133764 Sep 16 12:53:58.363340 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1063/2068] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:53:58.375478 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-119ae307-57f8-408d-8923-71ca4b95412d tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:58.376248 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-119ae307-57f8-408d-8923-71ca4b95412d tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] [instance: 345ee81d-c503-421c-90ea-218ac1c98600] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:58.397877 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-119ae307-57f8-408d-8923-71ca4b95412d tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:58.398376 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-119ae307-57f8-408d-8923-71ca4b95412d tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:58.398828 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-119ae307-57f8-408d-8923-71ca4b95412d tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:58.399561 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-119ae307-57f8-408d-8923-71ca4b95412d tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:58.400022 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-119ae307-57f8-408d-8923-71ca4b95412d tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:58.400792 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-119ae307-57f8-408d-8923-71ca4b95412d tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:58.728837 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-119ae307-57f8-408d-8923-71ca4b95412d tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d4c5f7ddf5432ba8b4eac2cb6a9860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b7d059fb70415fb5dc20e3a921d189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:58.748612 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-119ae307-57f8-408d-8923-71ca4b95412d tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600" status: 200 len: 1466 microversion: 2.1 time: 0.376178 Sep 16 12:53:58.785361 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1064/2069] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:58 2022] GET /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600 => generated 1466 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:58.796956 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4f370bb1-9b0c-475a-8387-d92971ee71ce tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:58.798289 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4f370bb1-9b0c-475a-8387-d92971ee71ce tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:58.811321 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f370bb1-9b0c-475a-8387-d92971ee71ce tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:58.812856 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f370bb1-9b0c-475a-8387-d92971ee71ce tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:58.814111 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f370bb1-9b0c-475a-8387-d92971ee71ce tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:58.815500 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f370bb1-9b0c-475a-8387-d92971ee71ce tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:58.816470 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f370bb1-9b0c-475a-8387-d92971ee71ce tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:58.817153 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f370bb1-9b0c-475a-8387-d92971ee71ce tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:59.216669 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4f370bb1-9b0c-475a-8387-d92971ee71ce tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:59.240596 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4f370bb1-9b0c-475a-8387-d92971ee71ce tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1383 microversion: 2.1 time: 0.453120 Sep 16 12:53:59.244866 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1065/2070] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:58 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1383 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:59.252243 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6ead2b11-4d9f-4a6f-ad7a-111036ce2a73 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f10351bd5e0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:59.346096 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6ead2b11-4d9f-4a6f-ad7a-111036ce2a73 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/991a3348-5f7a-42cc-8d4f-71f5840a425f" status: 200 len: 1453 microversion: 2.1 time: 0.099518 Sep 16 12:53:59.355413 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1066/2071] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:53:59 2022] GET /compute/v2.1/images/991a3348-5f7a-42cc-8d4f-71f5840a425f => generated 1453 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:53:59.366816 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5f9bcb6d-8eab-4980-985e-edc288464e4e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:53:59.367448 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5f9bcb6d-8eab-4980-985e-edc288464e4e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:53:59.392392 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f9bcb6d-8eab-4980-985e-edc288464e4e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:59.392392 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f9bcb6d-8eab-4980-985e-edc288464e4e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:59.392392 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f9bcb6d-8eab-4980-985e-edc288464e4e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:59.392392 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f9bcb6d-8eab-4980-985e-edc288464e4e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:53:59.392943 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f9bcb6d-8eab-4980-985e-edc288464e4e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:53:59.392943 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f9bcb6d-8eab-4980-985e-edc288464e4e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:53:59.672511 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-35bdf970-3f23-48bd-8621-32d63bf4eaa7 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 5c161179-0b93-4676-86f7-2f507a3ebeb3] Building network info cache for instance {{(pid=128780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 16 12:53:59.791368 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5f9bcb6d-8eab-4980-985e-edc288464e4e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:59.802507 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5f9bcb6d-8eab-4980-985e-edc288464e4e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:59.807036 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5f9bcb6d-8eab-4980-985e-edc288464e4e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:53:59.810777 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5f9bcb6d-8eab-4980-985e-edc288464e4e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 1411 microversion: 2.25 time: 0.454126 Sep 16 12:53:59.815558 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1067/2072] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:53:59 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 1411 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:53:59.821250 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-eeb4bf00-d4d8-4dfb-a0eb-308e273b92da tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '.version_select at 0x7f10351cd700>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:00.991501 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-35bdf970-3f23-48bd-8621-32d63bf4eaa7 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 5c161179-0b93-4676-86f7-2f507a3ebeb3] Updating instance_info_cache with network_info: [{"id": "d5a5f978-c5f0-4476-91cc-2b79e48ec4a7", "address": "fa:16:3e:43:b5:d4", "network": {"id": "2a6f5c27-4e22-4940-b2ce-5570b20e4dba", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1692283097-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1e41136645964ea98a675833bd73299f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd5a5f978-c5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 16 12:54:01.042822 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-35bdf970-3f23-48bd-8621-32d63bf4eaa7 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Releasing lock "refresh_cache-5c161179-0b93-4676-86f7-2f507a3ebeb3" {{(pid=128780) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 16 12:54:01.045123 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-35bdf970-3f23-48bd-8621-32d63bf4eaa7 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "POST /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3/action" status: 202 len: 0 microversion: 2.1 time: 5.246535 Sep 16 12:54:01.046115 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1006/2073] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:53:55 2022] POST /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3/action => generated 0 bytes in 5250 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 16 12:54:01.055734 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7e2923d9-5182-4b26-810d-7a84964d5fc3 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:01.058138 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7e2923d9-5182-4b26-810d-7a84964d5fc3 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:01.074743 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7e2923d9-5182-4b26-810d-7a84964d5fc3 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:01.075246 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7e2923d9-5182-4b26-810d-7a84964d5fc3 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:01.075689 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7e2923d9-5182-4b26-810d-7a84964d5fc3 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:01.078691 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7e2923d9-5182-4b26-810d-7a84964d5fc3 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:01.079205 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7e2923d9-5182-4b26-810d-7a84964d5fc3 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:01.079643 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7e2923d9-5182-4b26-810d-7a84964d5fc3 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:01.213362 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-eeb4bf00-d4d8-4dfb-a0eb-308e273b92da tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "DELETE /compute/v2.1/images/186744c5-e6ba-4599-82dd-52b3517a8795" status: 204 len: 0 microversion: 2.1 time: 1.396241 Sep 16 12:54:01.217923 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1068/2074] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:53:59 2022] DELETE /compute/v2.1/images/186744c5-e6ba-4599-82dd-52b3517a8795 => generated 0 bytes in 1398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:54:01.223687 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-fb60a2e1-543e-42c8-94b8-19b5619d27bc req-c6d13d0a-e1c0-4476-b937-faaf0d400691 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ad8536a-46b8-4821-8fb0-2c743927bb88", "tag": "c0c1968f-d991-4e36-8062-6ff62eb7adfb"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:01.239069 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-fb60a2e1-543e-42c8-94b8-19b5619d27bc req-c6d13d0a-e1c0-4476-b937-faaf0d400691 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:01.239957 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-fb60a2e1-543e-42c8-94b8-19b5619d27bc req-c6d13d0a-e1c0-4476-b937-faaf0d400691 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:01.240928 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-fb60a2e1-543e-42c8-94b8-19b5619d27bc req-c6d13d0a-e1c0-4476-b937-faaf0d400691 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:01.254116 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-fb60a2e1-543e-42c8-94b8-19b5619d27bc req-c6d13d0a-e1c0-4476-b937-faaf0d400691 service nova] Creating event network-changed:c0c1968f-d991-4e36-8062-6ff62eb7adfb for instance 9ad8536a-46b8-4821-8fb0-2c743927bb88 on n-h2-858094-4 Sep 16 12:54:01.261329 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-fb60a2e1-543e-42c8-94b8-19b5619d27bc req-c6d13d0a-e1c0-4476-b937-faaf0d400691 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040584 Sep 16 12:54:01.262826 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1069/2075] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:54:01.403923 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7e2923d9-5182-4b26-810d-7a84964d5fc3 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1534 microversion: 2.1 time: 0.354663 Sep 16 12:54:01.408452 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1007/2076] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:01 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1534 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:01.419813 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b895c024-f386-43a2-b983-da7f6b99bc3d tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f10358b1670>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:01.503306 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b895c024-f386-43a2-b983-da7f6b99bc3d tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/991a3348-5f7a-42cc-8d4f-71f5840a425f" status: 200 len: 1453 microversion: 2.1 time: 0.093698 Sep 16 12:54:01.503922 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1008/2077] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:54:01 2022] GET /compute/v2.1/images/991a3348-5f7a-42cc-8d4f-71f5840a425f => generated 1453 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:01.520735 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-d0a1cea6-4694-43f1-8420-0f3bec675f01 req-f6726817-4e00-446a-a1c1-bdf153478d27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5219baf4-bfde-4037-a511-88ff2690ea6a", "name": "network-vif-unplugged", "status": "completed", "tag": "537bc282-546d-4a7e-b32f-2149067cc012"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:01.551194 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-d0a1cea6-4694-43f1-8420-0f3bec675f01 req-f6726817-4e00-446a-a1c1-bdf153478d27 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:01.553453 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-d0a1cea6-4694-43f1-8420-0f3bec675f01 req-f6726817-4e00-446a-a1c1-bdf153478d27 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:01.555790 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-d0a1cea6-4694-43f1-8420-0f3bec675f01 req-f6726817-4e00-446a-a1c1-bdf153478d27 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:01.580784 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-d0a1cea6-4694-43f1-8420-0f3bec675f01 req-f6726817-4e00-446a-a1c1-bdf153478d27 service nova] Creating event network-vif-unplugged:537bc282-546d-4a7e-b32f-2149067cc012 for instance 5219baf4-bfde-4037-a511-88ff2690ea6a on n-h2-858094-4 Sep 16 12:54:01.587020 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-d0a1cea6-4694-43f1-8420-0f3bec675f01 req-f6726817-4e00-446a-a1c1-bdf153478d27 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072617 Sep 16 12:54:01.588106 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1009/2078] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:54:01.596913 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0d65dfbd-aabe-45d8-af4a-491d160005ff tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:01.597964 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0d65dfbd-aabe-45d8-af4a-491d160005ff tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:01.614786 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0d65dfbd-aabe-45d8-af4a-491d160005ff tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:01.615679 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0d65dfbd-aabe-45d8-af4a-491d160005ff tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:01.616748 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0d65dfbd-aabe-45d8-af4a-491d160005ff tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:01.618220 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0d65dfbd-aabe-45d8-af4a-491d160005ff tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:01.618946 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0d65dfbd-aabe-45d8-af4a-491d160005ff tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:01.619609 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0d65dfbd-aabe-45d8-af4a-491d160005ff tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:01.762477 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9e9389cf-aaf1-46c4-b35a-338ee16657df tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-4070965", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": [{"uuid": "ad265caa-a590-4a61-93ec-155fc1127ff1"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:01.829932 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0d65dfbd-aabe-45d8-af4a-491d160005ff tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:01.839567 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0d65dfbd-aabe-45d8-af4a-491d160005ff tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:01.841495 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0d65dfbd-aabe-45d8-af4a-491d160005ff tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:01.842790 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0d65dfbd-aabe-45d8-af4a-491d160005ff tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 1608 microversion: 2.25 time: 0.253161 Sep 16 12:54:01.844611 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1010/2079] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:54:01 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 1608 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:54:01.850375 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3c0955ac-4daa-489d-b8e4-8c4f3a57c7ef tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.147"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:01.854330 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3c0955ac-4daa-489d-b8e4-8c4f3a57c7ef tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 227a8a0b-2a0c-48f8-976a-a176a9039a2d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:01.869814 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3c0955ac-4daa-489d-b8e4-8c4f3a57c7ef tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:01.870295 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3c0955ac-4daa-489d-b8e4-8c4f3a57c7ef tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:01.870710 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3c0955ac-4daa-489d-b8e4-8c4f3a57c7ef tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:01.871418 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3c0955ac-4daa-489d-b8e4-8c4f3a57c7ef tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:01.871866 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3c0955ac-4daa-489d-b8e4-8c4f3a57c7ef tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:01.872333 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3c0955ac-4daa-489d-b8e4-8c4f3a57c7ef tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:01.879061 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-9e9389cf-aaf1-46c4-b35a-338ee16657df tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] validate_networks() for [('ad265caa-a590-4a61-93ec-155fc1127ff1', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:54:01.910330 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3c0955ac-4daa-489d-b8e4-8c4f3a57c7ef tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "refresh_cache-227a8a0b-2a0c-48f8-976a-a176a9039a2d" {{(pid=128780) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 16 12:54:01.912173 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3c0955ac-4daa-489d-b8e4-8c4f3a57c7ef tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquired lock "refresh_cache-227a8a0b-2a0c-48f8-976a-a176a9039a2d" {{(pid=128780) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 16 12:54:02.997804 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-9e9389cf-aaf1-46c4-b35a-338ee16657df tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:54:02.998376 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-9e9389cf-aaf1-46c4-b35a-338ee16657df tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:54:02.998826 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-9e9389cf-aaf1-46c4-b35a-338ee16657df tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:54:02.999316 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-9e9389cf-aaf1-46c4-b35a-338ee16657df tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:54:02.999828 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-9e9389cf-aaf1-46c4-b35a-338ee16657df tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:54:03.010382 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e9389cf-aaf1-46c4-b35a-338ee16657df tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:03.011183 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e9389cf-aaf1-46c4-b35a-338ee16657df tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:03.011905 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e9389cf-aaf1-46c4-b35a-338ee16657df tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:03.012848 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e9389cf-aaf1-46c4-b35a-338ee16657df tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:03.013416 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e9389cf-aaf1-46c4-b35a-338ee16657df tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:03.014119 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e9389cf-aaf1-46c4-b35a-338ee16657df tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:03.040697 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-9e9389cf-aaf1-46c4-b35a-338ee16657df tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Getting quotas for project 101be406faff40d9a001aa76e5f3a19e. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:54:03.050251 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-9e9389cf-aaf1-46c4-b35a-338ee16657df tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Getting quotas for user 78a6e736e1d3417cafc9c42a60693be0 and project 101be406faff40d9a001aa76e5f3a19e. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:54:03.066422 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9e9389cf-aaf1-46c4-b35a-338ee16657df tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:54:03.070013 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9e9389cf-aaf1-46c4-b35a-338ee16657df tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] [instance: dd721f2f-0f2f-4315-b101-d8140c7d94a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:54:03.122105 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9e9389cf-aaf1-46c4-b35a-338ee16657df tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.857588 Sep 16 12:54:03.122778 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1070/2080] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:54:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:54:03.130526 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-700fa6e4-2068-4f5a-9ac9-68b1367fc6d4 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '.version_select at 0x7f103529a0d0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:03.170288 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-700fa6e4-2068-4f5a-9ac9-68b1367fc6d4 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] HTTP exception thrown: Image not found. Sep 16 12:54:03.173329 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-700fa6e4-2068-4f5a-9ac9-68b1367fc6d4 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Request method failure captured: Sep 16 12:54:03.173329 n-d-858094-4 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/images/a14d99e9-0c3f-4440-a1b8-2513d1ea03c3 HTTP/1.1 Sep 16 12:54:03.173329 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:54:03.173329 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:54:03.173329 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:54:03.173329 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:54:03.173329 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:54:03.173329 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:54:03.173329 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:54:03.173329 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:54:03.173329 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHGC1tLC4Hwvx6NHhPA7kXnEWOqckp907sAMNKZNblBrHEC1mNwTYzTCvIQfMCl7A4tTw0g1fnaX_HyKI_f-70EvldXE1PJoBDtPX0XHIrxwLJLAfXY_1lCY4JPxZ1UFIZK-I060ouY7VXyXkfdKzmkeNXUl-Nyj1oJ2vxDk_ZtwTbo Sep 16 12:54:03.173329 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:54:03.173329 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:54:03.173329 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:54:03.173329 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:54:03.173329 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:54:03.173329 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:54:03.173329 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 69b7d059fb70415fb5dc20e3a921d189 Sep 16 12:54:03.173329 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesOneServerTestJSON-2064562372 Sep 16 12:54:03.173329 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:54:03.173329 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:54:03.175001 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/69b7d059fb70415fb5dc20e3a921d189"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/69b7d059fb70415fb5dc20e3a921d189"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_69b7d059fb70415fb5dc20e3a921d189", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/69b7d059fb70415fb5dc20e3a921d189"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:54:03.175001 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesOneServerTestJSON-2064562372 Sep 16 12:54:03.175001 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 69b7d059fb70415fb5dc20e3a921d189 Sep 16 12:54:03.175001 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2064562372 Sep 16 12:54:03.175001 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ImagesOneServerTestJSON-2064562372-project Sep 16 12:54:03.175001 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:54:03.175001 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:54:03.175001 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 45d4c5f7ddf5432ba8b4eac2cb6a9860 Sep 16 12:54:03.175001 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesOneServerTestJSON-2064562372-project Sep 16 12:54:03.175001 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 12:54:03.175001 n-d-858094-4 devstack@n-api.service[128779]: exception: Image not found. Sep 16 12:54:03.175001 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': 'a14d99e9-0c3f-4440-a1b8-2513d1ea03c3'} Sep 16 12:54:03.175001 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:54:03.176164 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:03.176164 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 16 12:54:03.176164 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 16 12:54:03.176164 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 12:54:03.176164 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 12:54:03.176164 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 12:54:03.176164 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 12:54:03.176164 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 16 12:54:03.176164 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 16 12:54:03.176164 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 16 12:54:03.176164 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 16 12:54:03.176164 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 12:54:03.176164 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 12:54:03.176164 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 12:54:03.176164 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 12:54:03.176164 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a14d99e9-0c3f-4440-a1b8-2513d1ea03c3 to delete Sep 16 12:54:03.176164 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:03.176164 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:54:03.176164 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:03.177774 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:03.177774 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 16 12:54:03.177774 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 16 12:54:03.177774 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 16 12:54:03.177774 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 16 12:54:03.177774 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 16 12:54:03.177774 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 16 12:54:03.177774 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a14d99e9-0c3f-4440-a1b8-2513d1ea03c3 could not be found. Sep 16 12:54:03.177774 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:03.177774 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:54:03.177774 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:03.177774 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:03.177774 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:54:03.177774 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:54:03.177774 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:54:03.177774 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:54:03.177774 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:54:03.177774 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:54:03.177774 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:54:03.177774 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:54:03.179551 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 16 12:54:03.179551 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 16 12:54:03.179551 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 12:54:03.179551 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:03.179551 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:54:03.179551 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:03.179551 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:03.179551 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:54:03.179551 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:54:03.179551 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:54:03.179551 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:54:03.179551 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 12:54:03.179551 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:03.180972 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-700fa6e4-2068-4f5a-9ac9-68b1367fc6d4 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Returning 404 to user: Image not found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:54:03.181867 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-700fa6e4-2068-4f5a-9ac9-68b1367fc6d4 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "DELETE /compute/v2.1/images/a14d99e9-0c3f-4440-a1b8-2513d1ea03c3" status: 404 len: 62 microversion: 2.1 time: 0.057899 Sep 16 12:54:03.182804 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1071/2081] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:03 2022] DELETE /compute/v2.1/images/a14d99e9-0c3f-4440-a1b8-2513d1ea03c3 => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 12:54:03.187209 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fe9ab166-fc7c-46cf-9fc9-6c8cd2503fbb tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:03.188525 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fe9ab166-fc7c-46cf-9fc9-6c8cd2503fbb tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:03.196863 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe9ab166-fc7c-46cf-9fc9-6c8cd2503fbb tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:03.197308 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe9ab166-fc7c-46cf-9fc9-6c8cd2503fbb tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:03.197752 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe9ab166-fc7c-46cf-9fc9-6c8cd2503fbb tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:03.198472 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe9ab166-fc7c-46cf-9fc9-6c8cd2503fbb tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:03.198929 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe9ab166-fc7c-46cf-9fc9-6c8cd2503fbb tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:03.199584 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe9ab166-fc7c-46cf-9fc9-6c8cd2503fbb tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:03.359095 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fe9ab166-fc7c-46cf-9fc9-6c8cd2503fbb tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1534 microversion: 2.1 time: 0.175386 Sep 16 12:54:03.371375 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1072/2082] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:03 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1534 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:03.510867 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3e7bfa72-32fa-4e35-bf53-5e8714ca6556 tempest-QuotasAdminTestV236-2031111600 tempest-QuotasAdminTestV236-2031111600-project-admin] Action: 'update', calling method: .version_select at 0x7f103529a310>, body: {"quota_set": {"ram": "5120"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:03.601471 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e7bfa72-32fa-4e35-bf53-5e8714ca6556 tempest-QuotasAdminTestV236-2031111600 tempest-QuotasAdminTestV236-2031111600-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:03.601965 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e7bfa72-32fa-4e35-bf53-5e8714ca6556 tempest-QuotasAdminTestV236-2031111600 tempest-QuotasAdminTestV236-2031111600-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:03.602440 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e7bfa72-32fa-4e35-bf53-5e8714ca6556 tempest-QuotasAdminTestV236-2031111600 tempest-QuotasAdminTestV236-2031111600-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:03.603128 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e7bfa72-32fa-4e35-bf53-5e8714ca6556 tempest-QuotasAdminTestV236-2031111600 tempest-QuotasAdminTestV236-2031111600-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:03.603707 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e7bfa72-32fa-4e35-bf53-5e8714ca6556 tempest-QuotasAdminTestV236-2031111600 tempest-QuotasAdminTestV236-2031111600-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:03.614709 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e7bfa72-32fa-4e35-bf53-5e8714ca6556 tempest-QuotasAdminTestV236-2031111600 tempest-QuotasAdminTestV236-2031111600-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:03.680855 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3e7bfa72-32fa-4e35-bf53-5e8714ca6556 tempest-QuotasAdminTestV236-2031111600 tempest-QuotasAdminTestV236-2031111600-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/68675b1003c2464f9f60e1a111af23d1" status: 200 len: 240 microversion: 2.36 time: 0.313976 Sep 16 12:54:03.681604 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1073/2083] 10.222.0.67 () {62 vars in 1303 bytes} [Fri Sep 16 12:54:03 2022] PUT /compute/v2.1/os-quota-sets/68675b1003c2464f9f60e1a111af23d1 => generated 240 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:54:03.686816 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9b4f66f1-7ad6-4e2c-9fa2-707c52e98bac tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:03.687390 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9b4f66f1-7ad6-4e2c-9fa2-707c52e98bac tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:03.694000 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b4f66f1-7ad6-4e2c-9fa2-707c52e98bac tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:03.694709 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b4f66f1-7ad6-4e2c-9fa2-707c52e98bac tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:03.695549 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b4f66f1-7ad6-4e2c-9fa2-707c52e98bac tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:03.696570 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b4f66f1-7ad6-4e2c-9fa2-707c52e98bac tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:03.697283 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b4f66f1-7ad6-4e2c-9fa2-707c52e98bac tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:03.698074 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b4f66f1-7ad6-4e2c-9fa2-707c52e98bac tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:03.857977 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9b4f66f1-7ad6-4e2c-9fa2-707c52e98bac tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.174954 Sep 16 12:54:03.872443 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1074/2084] 10.222.0.67 () {60 vars in 1316 bytes} [Fri Sep 16 12:54:03 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8/os-interface => generated 285 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:54:03.885538 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-de34b396-81d3-4e76-af6f-3d0fb202fbef tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f10351551f0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:03.948688 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-de34b396-81d3-4e76-af6f-3d0fb202fbef tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/991a3348-5f7a-42cc-8d4f-71f5840a425f" status: 200 len: 1453 microversion: 2.1 time: 0.063087 Sep 16 12:54:03.955472 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1075/2085] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:54:03 2022] GET /compute/v2.1/images/991a3348-5f7a-42cc-8d4f-71f5840a425f => generated 1453 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:03.962235 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f9069bd5-5bde-474b-8ff6-d0053d8f412e tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:03.967519 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f9069bd5-5bde-474b-8ff6-d0053d8f412e tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] [instance: dd721f2f-0f2f-4315-b101-d8140c7d94a0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:03.984627 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9069bd5-5bde-474b-8ff6-d0053d8f412e tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:03.985474 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9069bd5-5bde-474b-8ff6-d0053d8f412e tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:03.985851 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9069bd5-5bde-474b-8ff6-d0053d8f412e tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:03.986598 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9069bd5-5bde-474b-8ff6-d0053d8f412e tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:03.987089 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9069bd5-5bde-474b-8ff6-d0053d8f412e tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:03.987528 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9069bd5-5bde-474b-8ff6-d0053d8f412e tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:04.236829 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f9069bd5-5bde-474b-8ff6-d0053d8f412e tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a6e736e1d3417cafc9c42a60693be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101be406faff40d9a001aa76e5f3a19e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:04.250524 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f9069bd5-5bde-474b-8ff6-d0053d8f412e tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] 10.222.0.67 "GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0" status: 200 len: 1210 microversion: 2.1 time: 0.292186 Sep 16 12:54:04.253379 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1076/2086] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:03 2022] GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0 => generated 1210 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:04.268630 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0292d2ba-e746-497f-951e-a825234fd310 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:04.268630 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0292d2ba-e746-497f-951e-a825234fd310 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] [instance: 345ee81d-c503-421c-90ea-218ac1c98600] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:04.283426 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0292d2ba-e746-497f-951e-a825234fd310 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:04.284008 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0292d2ba-e746-497f-951e-a825234fd310 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:04.284485 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0292d2ba-e746-497f-951e-a825234fd310 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:04.285242 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0292d2ba-e746-497f-951e-a825234fd310 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:04.285700 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0292d2ba-e746-497f-951e-a825234fd310 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:04.286130 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0292d2ba-e746-497f-951e-a825234fd310 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:04.353313 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0292d2ba-e746-497f-951e-a825234fd310 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] [instance: 345ee81d-c503-421c-90ea-218ac1c98600] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:54:04.534001 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0292d2ba-e746-497f-951e-a825234fd310 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "DELETE /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600" status: 204 len: 0 microversion: 2.1 time: 0.279141 Sep 16 12:54:04.537169 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1077/2087] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:54:04 2022] DELETE /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:54:04.551251 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-14b4592b-48f6-4101-9004-0f88cacbfbfc req-905e29cc-91cd-430c-b33f-9757417b7e38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c161179-0b93-4676-86f7-2f507a3ebeb3", "tag": "d5a5f978-c5f0-4476-91cc-2b79e48ec4a7"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:04.576090 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-14b4592b-48f6-4101-9004-0f88cacbfbfc req-905e29cc-91cd-430c-b33f-9757417b7e38 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:04.577037 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-14b4592b-48f6-4101-9004-0f88cacbfbfc req-905e29cc-91cd-430c-b33f-9757417b7e38 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:04.579123 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-14b4592b-48f6-4101-9004-0f88cacbfbfc req-905e29cc-91cd-430c-b33f-9757417b7e38 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:04.587352 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:54:04.614005 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-14b4592b-48f6-4101-9004-0f88cacbfbfc req-905e29cc-91cd-430c-b33f-9757417b7e38 service nova] Creating event network-changed:d5a5f978-c5f0-4476-91cc-2b79e48ec4a7 for instance 5c161179-0b93-4676-86f7-2f507a3ebeb3 on n-h1-858094-4 Sep 16 12:54:04.627650 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-14b4592b-48f6-4101-9004-0f88cacbfbfc req-905e29cc-91cd-430c-b33f-9757417b7e38 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088351 Sep 16 12:54:04.631906 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1078/2088] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:54:04.645740 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c9984bbf-947d-4666-a3c4-0eb24cd14354 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:04.656397 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9984bbf-947d-4666-a3c4-0eb24cd14354 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:04.657198 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9984bbf-947d-4666-a3c4-0eb24cd14354 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:04.657857 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9984bbf-947d-4666-a3c4-0eb24cd14354 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:04.658879 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9984bbf-947d-4666-a3c4-0eb24cd14354 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:04.659579 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9984bbf-947d-4666-a3c4-0eb24cd14354 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:04.660485 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9984bbf-947d-4666-a3c4-0eb24cd14354 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:04.698266 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c9984bbf-947d-4666-a3c4-0eb24cd14354 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.061798 Sep 16 12:54:04.699896 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1079/2089] 10.222.0.67 () {58 vars in 1176 bytes} [Fri Sep 16 12:54:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:54:04.708641 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-e5da9ed9-94fe-47d5-941d-44fb28e2e60b req-68322d38-8a00-4818-a8e0-078481503f0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "345ee81d-c503-421c-90ea-218ac1c98600", "name": "network-vif-unplugged", "status": "completed", "tag": "56c49806-0b21-4f4b-9b96-195fc33fcba5"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:04.722018 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e5da9ed9-94fe-47d5-941d-44fb28e2e60b req-68322d38-8a00-4818-a8e0-078481503f0e service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:04.722699 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e5da9ed9-94fe-47d5-941d-44fb28e2e60b req-68322d38-8a00-4818-a8e0-078481503f0e service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:04.723552 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e5da9ed9-94fe-47d5-941d-44fb28e2e60b req-68322d38-8a00-4818-a8e0-078481503f0e service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:04.742752 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-e5da9ed9-94fe-47d5-941d-44fb28e2e60b req-68322d38-8a00-4818-a8e0-078481503f0e service nova] Creating event network-vif-unplugged:56c49806-0b21-4f4b-9b96-195fc33fcba5 for instance 345ee81d-c503-421c-90ea-218ac1c98600 on n-h1-858094-4 Sep 16 12:54:04.749759 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-e5da9ed9-94fe-47d5-941d-44fb28e2e60b req-68322d38-8a00-4818-a8e0-078481503f0e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048291 Sep 16 12:54:04.751946 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1080/2090] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:54:04.760888 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8352adb8-c502-4959-acb6-2ca61f8f6272 tempest-QuotasAdminTestV236-2031111600 tempest-QuotasAdminTestV236-2031111600-project-admin] Calling method '.version_select at 0x7f103533e430>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:04.881189 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8352adb8-c502-4959-acb6-2ca61f8f6272 tempest-QuotasAdminTestV236-2031111600 tempest-QuotasAdminTestV236-2031111600-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:04.882380 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8352adb8-c502-4959-acb6-2ca61f8f6272 tempest-QuotasAdminTestV236-2031111600 tempest-QuotasAdminTestV236-2031111600-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:04.883111 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8352adb8-c502-4959-acb6-2ca61f8f6272 tempest-QuotasAdminTestV236-2031111600 tempest-QuotasAdminTestV236-2031111600-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:04.884218 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8352adb8-c502-4959-acb6-2ca61f8f6272 tempest-QuotasAdminTestV236-2031111600 tempest-QuotasAdminTestV236-2031111600-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:04.885033 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8352adb8-c502-4959-acb6-2ca61f8f6272 tempest-QuotasAdminTestV236-2031111600 tempest-QuotasAdminTestV236-2031111600-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:04.885767 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8352adb8-c502-4959-acb6-2ca61f8f6272 tempest-QuotasAdminTestV236-2031111600 tempest-QuotasAdminTestV236-2031111600-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:04.914550 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8352adb8-c502-4959-acb6-2ca61f8f6272 tempest-QuotasAdminTestV236-2031111600 tempest-QuotasAdminTestV236-2031111600-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/68675b1003c2464f9f60e1a111af23d1/detail" status: 200 len: 672 microversion: 2.36 time: 0.160129 Sep 16 12:54:04.917686 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1081/2091] 10.222.0.67 () {60 vars in 1304 bytes} [Fri Sep 16 12:54:04 2022] GET /compute/v2.1/os-quota-sets/68675b1003c2464f9f60e1a111af23d1/detail => generated 672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:54:04.924946 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-74f0fc77-03a3-4a00-ae4f-8ed3538a9c72 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:04.926271 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-74f0fc77-03a3-4a00-ae4f-8ed3538a9c72 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] [instance: 345ee81d-c503-421c-90ea-218ac1c98600] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:04.955633 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74f0fc77-03a3-4a00-ae4f-8ed3538a9c72 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:04.963526 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74f0fc77-03a3-4a00-ae4f-8ed3538a9c72 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:04.966809 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74f0fc77-03a3-4a00-ae4f-8ed3538a9c72 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:04.971722 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74f0fc77-03a3-4a00-ae4f-8ed3538a9c72 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:04.975308 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74f0fc77-03a3-4a00-ae4f-8ed3538a9c72 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:04.978095 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74f0fc77-03a3-4a00-ae4f-8ed3538a9c72 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:05.377343 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-74f0fc77-03a3-4a00-ae4f-8ed3538a9c72 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d4c5f7ddf5432ba8b4eac2cb6a9860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b7d059fb70415fb5dc20e3a921d189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:05.387061 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-74f0fc77-03a3-4a00-ae4f-8ed3538a9c72 tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600" status: 200 len: 1472 microversion: 2.1 time: 0.467509 Sep 16 12:54:05.388006 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1082/2092] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:04 2022] GET /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600 => generated 1472 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:05.409088 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0f675ed2-77e2-4676-8ade-9ecd5dca4927 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858094-4", "block_migration": false, "disk_over_commit": false}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:05.412795 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0f675ed2-77e2-4676-8ade-9ecd5dca4927 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:05.420421 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f675ed2-77e2-4676-8ade-9ecd5dca4927 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:05.421066 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f675ed2-77e2-4676-8ade-9ecd5dca4927 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:05.421582 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f675ed2-77e2-4676-8ade-9ecd5dca4927 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:05.422441 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f675ed2-77e2-4676-8ade-9ecd5dca4927 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:05.423229 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f675ed2-77e2-4676-8ade-9ecd5dca4927 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:05.423844 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f675ed2-77e2-4676-8ade-9ecd5dca4927 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:05.459707 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-0f675ed2-77e2-4676-8ade-9ecd5dca4927 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lazy-loading 'flavor' on Instance uuid bd1530a2-c78e-419d-a65e-fc5baf53d939 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:54:05.475353 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0f675ed2-77e2-4676-8ade-9ecd5dca4927 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Going to try to live migrate instance to n-h1-858094-4 {{(pid=128779) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 16 12:54:06.194696 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.network.neutron [None req-3c0955ac-4daa-489d-b8e4-8c4f3a57c7ef tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 227a8a0b-2a0c-48f8-976a-a176a9039a2d] re-assign floating IP 172.25.2.147 from instance 5c161179-0b93-4676-86f7-2f507a3ebeb3 Sep 16 12:54:06.211077 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-3c0955ac-4daa-489d-b8e4-8c4f3a57c7ef tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 5c161179-0b93-4676-86f7-2f507a3ebeb3] Building network info cache for instance {{(pid=128780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 16 12:54:06.955768 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-3c0955ac-4daa-489d-b8e4-8c4f3a57c7ef tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 5c161179-0b93-4676-86f7-2f507a3ebeb3] Updating instance_info_cache with network_info: [{"id": "d5a5f978-c5f0-4476-91cc-2b79e48ec4a7", "address": "fa:16:3e:43:b5:d4", "network": {"id": "2a6f5c27-4e22-4940-b2ce-5570b20e4dba", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1692283097-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1e41136645964ea98a675833bd73299f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd5a5f978-c5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 16 12:54:06.971892 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-3c0955ac-4daa-489d-b8e4-8c4f3a57c7ef tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 227a8a0b-2a0c-48f8-976a-a176a9039a2d] Building network info cache for instance {{(pid=128780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 16 12:54:08.684473 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0f675ed2-77e2-4676-8ade-9ecd5dca4927 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939/action" status: 202 len: 0 microversion: 2.1 time: 3.294659 Sep 16 12:54:08.686205 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1083/2093] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:54:05 2022] POST /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939/action => generated 0 bytes in 3297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:54:08.692699 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2fbdddae-f0ec-4461-84a3-ad098ebcdc85 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f103533e040>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:08.810500 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2fbdddae-f0ec-4461-84a3-ad098ebcdc85 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/991a3348-5f7a-42cc-8d4f-71f5840a425f" status: 200 len: 1453 microversion: 2.1 time: 0.122929 Sep 16 12:54:08.813201 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1084/2094] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:54:08 2022] GET /compute/v2.1/images/991a3348-5f7a-42cc-8d4f-71f5840a425f => generated 1453 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:08.827151 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f67dbc50-8015-4ef5-905c-13b399003a81 tempest-QuotasAdminTestV236-2031111600 tempest-QuotasAdminTestV236-2031111600-project-admin] Action: 'update', calling method: .version_select at 0x7f103533ea60>, body: {"quota_set": {"ram": "2048"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:08.959573 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f67dbc50-8015-4ef5-905c-13b399003a81 tempest-QuotasAdminTestV236-2031111600 tempest-QuotasAdminTestV236-2031111600-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:08.961559 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f67dbc50-8015-4ef5-905c-13b399003a81 tempest-QuotasAdminTestV236-2031111600 tempest-QuotasAdminTestV236-2031111600-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:08.962206 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f67dbc50-8015-4ef5-905c-13b399003a81 tempest-QuotasAdminTestV236-2031111600 tempest-QuotasAdminTestV236-2031111600-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:08.963809 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f67dbc50-8015-4ef5-905c-13b399003a81 tempest-QuotasAdminTestV236-2031111600 tempest-QuotasAdminTestV236-2031111600-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:08.964608 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f67dbc50-8015-4ef5-905c-13b399003a81 tempest-QuotasAdminTestV236-2031111600 tempest-QuotasAdminTestV236-2031111600-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:08.965844 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f67dbc50-8015-4ef5-905c-13b399003a81 tempest-QuotasAdminTestV236-2031111600 tempest-QuotasAdminTestV236-2031111600-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:09.023608 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f67dbc50-8015-4ef5-905c-13b399003a81 tempest-QuotasAdminTestV236-2031111600 tempest-QuotasAdminTestV236-2031111600-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:09.024474 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f67dbc50-8015-4ef5-905c-13b399003a81 tempest-QuotasAdminTestV236-2031111600 tempest-QuotasAdminTestV236-2031111600-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:09.025624 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f67dbc50-8015-4ef5-905c-13b399003a81 tempest-QuotasAdminTestV236-2031111600 tempest-QuotasAdminTestV236-2031111600-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:09.026628 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f67dbc50-8015-4ef5-905c-13b399003a81 tempest-QuotasAdminTestV236-2031111600 tempest-QuotasAdminTestV236-2031111600-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:09.027095 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f67dbc50-8015-4ef5-905c-13b399003a81 tempest-QuotasAdminTestV236-2031111600 tempest-QuotasAdminTestV236-2031111600-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:09.027547 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f67dbc50-8015-4ef5-905c-13b399003a81 tempest-QuotasAdminTestV236-2031111600 tempest-QuotasAdminTestV236-2031111600-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:09.072630 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:54:09.127250 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f67dbc50-8015-4ef5-905c-13b399003a81 tempest-QuotasAdminTestV236-2031111600 tempest-QuotasAdminTestV236-2031111600-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/68675b1003c2464f9f60e1a111af23d1?user_id=ffbec85d733c43c09a6e39510802b3cf" status: 200 len: 240 microversion: 2.36 time: 0.312174 Sep 16 12:54:09.135592 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1085/2095] 10.222.0.67 () {62 vars in 1384 bytes} [Fri Sep 16 12:54:08 2022] PUT /compute/v2.1/os-quota-sets/68675b1003c2464f9f60e1a111af23d1?user_id=ffbec85d733c43c09a6e39510802b3cf => generated 240 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:54:09.141156 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a79e51ac-9cf2-4ac6-bb02-3b9db4bf690f tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:09.142625 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a79e51ac-9cf2-4ac6-bb02-3b9db4bf690f tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] [instance: dd721f2f-0f2f-4315-b101-d8140c7d94a0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:09.153175 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a79e51ac-9cf2-4ac6-bb02-3b9db4bf690f tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:09.154330 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a79e51ac-9cf2-4ac6-bb02-3b9db4bf690f tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:09.155062 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a79e51ac-9cf2-4ac6-bb02-3b9db4bf690f tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:09.156313 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a79e51ac-9cf2-4ac6-bb02-3b9db4bf690f tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:09.156780 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a79e51ac-9cf2-4ac6-bb02-3b9db4bf690f tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:09.158116 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a79e51ac-9cf2-4ac6-bb02-3b9db4bf690f tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:09.358560 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a79e51ac-9cf2-4ac6-bb02-3b9db4bf690f tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a6e736e1d3417cafc9c42a60693be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101be406faff40d9a001aa76e5f3a19e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:09.368581 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a79e51ac-9cf2-4ac6-bb02-3b9db4bf690f tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] 10.222.0.67 "GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0" status: 200 len: 1272 microversion: 2.1 time: 0.231318 Sep 16 12:54:09.372059 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1086/2096] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:09 2022] GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0 => generated 1272 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:09.378139 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-68a48330-7037-407a-9cac-04a53b326143 req-9b6420ed-cb97-4246-9d79-3ef4a3184844 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d49156a2-d78c-4601-a431-e09716c76ce8", "tag": "d289a714-1b0e-4177-adf6-0d59780fa902"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:09.412405 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-68a48330-7037-407a-9cac-04a53b326143 req-9b6420ed-cb97-4246-9d79-3ef4a3184844 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:09.412931 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-68a48330-7037-407a-9cac-04a53b326143 req-9b6420ed-cb97-4246-9d79-3ef4a3184844 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:09.413363 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-68a48330-7037-407a-9cac-04a53b326143 req-9b6420ed-cb97-4246-9d79-3ef4a3184844 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:09.450588 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-68a48330-7037-407a-9cac-04a53b326143 req-9b6420ed-cb97-4246-9d79-3ef4a3184844 service nova] Creating event network-changed:d289a714-1b0e-4177-adf6-0d59780fa902 for instance d49156a2-d78c-4601-a431-e09716c76ce8 on n-h2-858094-4 Sep 16 12:54:09.463898 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-68a48330-7037-407a-9cac-04a53b326143 req-9b6420ed-cb97-4246-9d79-3ef4a3184844 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090245 Sep 16 12:54:09.464597 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1087/2097] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:54:09.477194 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-abe3d4f4-c7c2-408d-b626-d37cc772918e tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:09.478049 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-abe3d4f4-c7c2-408d-b626-d37cc772918e tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] [instance: 345ee81d-c503-421c-90ea-218ac1c98600] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:09.493113 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abe3d4f4-c7c2-408d-b626-d37cc772918e tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:09.493659 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abe3d4f4-c7c2-408d-b626-d37cc772918e tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:09.494106 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abe3d4f4-c7c2-408d-b626-d37cc772918e tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:09.497986 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abe3d4f4-c7c2-408d-b626-d37cc772918e tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:09.498542 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abe3d4f4-c7c2-408d-b626-d37cc772918e tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:09.498923 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abe3d4f4-c7c2-408d-b626-d37cc772918e tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:09.594631 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abe3d4f4-c7c2-408d-b626-d37cc772918e tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:09.595415 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abe3d4f4-c7c2-408d-b626-d37cc772918e tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:09.595870 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abe3d4f4-c7c2-408d-b626-d37cc772918e tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:09.598857 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-abe3d4f4-c7c2-408d-b626-d37cc772918e tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lazy-loading 'fault' on Instance uuid 345ee81d-c503-421c-90ea-218ac1c98600 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:54:09.805201 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-abe3d4f4-c7c2-408d-b626-d37cc772918e tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d4c5f7ddf5432ba8b4eac2cb6a9860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b7d059fb70415fb5dc20e3a921d189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:09.828579 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-abe3d4f4-c7c2-408d-b626-d37cc772918e tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600" status: 200 len: 1307 microversion: 2.1 time: 0.362474 Sep 16 12:54:09.846507 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1088/2098] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:09 2022] GET /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600 => generated 1307 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:09.867771 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-bf68f35e-b3a6-4228-908e-b5cdfd05b046 req-511d5660-17da-436c-a47e-79a07ab064fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c161179-0b93-4676-86f7-2f507a3ebeb3", "tag": "d5a5f978-c5f0-4476-91cc-2b79e48ec4a7"}, {"name": "network-changed", "server_uuid": "227a8a0b-2a0c-48f8-976a-a176a9039a2d", "tag": "586b7cfc-f67a-48f3-beb9-5cd2ca16334c"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:09.913186 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bf68f35e-b3a6-4228-908e-b5cdfd05b046 req-511d5660-17da-436c-a47e-79a07ab064fe service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:09.916102 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bf68f35e-b3a6-4228-908e-b5cdfd05b046 req-511d5660-17da-436c-a47e-79a07ab064fe service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:09.916728 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bf68f35e-b3a6-4228-908e-b5cdfd05b046 req-511d5660-17da-436c-a47e-79a07ab064fe service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:09.993701 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-bf68f35e-b3a6-4228-908e-b5cdfd05b046 req-511d5660-17da-436c-a47e-79a07ab064fe service nova] Creating event network-changed:d5a5f978-c5f0-4476-91cc-2b79e48ec4a7 for instance 5c161179-0b93-4676-86f7-2f507a3ebeb3 on n-h1-858094-4 Sep 16 12:54:09.995429 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-bf68f35e-b3a6-4228-908e-b5cdfd05b046 req-511d5660-17da-436c-a47e-79a07ab064fe service nova] Creating event network-changed:586b7cfc-f67a-48f3-beb9-5cd2ca16334c for instance 227a8a0b-2a0c-48f8-976a-a176a9039a2d on n-h2-858094-4 Sep 16 12:54:10.028279 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-bf68f35e-b3a6-4228-908e-b5cdfd05b046 req-511d5660-17da-436c-a47e-79a07ab064fe service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.187175 Sep 16 12:54:10.032099 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1089/2099] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:54:10.062151 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-6c63c632-30ec-40dd-937b-8d70e3fc0647 req-2c161f26-83d2-41aa-9902-eac9ce85bf03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c97d5f35-6ea1-4ec7-88f5-9da9dbe81182", "name": "network-vif-plugged", "status": "completed", "tag": "81054b4c-c45a-4833-ae83-e752ff18ff48"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:10.099853 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-6c63c632-30ec-40dd-937b-8d70e3fc0647 req-2c161f26-83d2-41aa-9902-eac9ce85bf03 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:10.100812 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-6c63c632-30ec-40dd-937b-8d70e3fc0647 req-2c161f26-83d2-41aa-9902-eac9ce85bf03 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:10.101582 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-6c63c632-30ec-40dd-937b-8d70e3fc0647 req-2c161f26-83d2-41aa-9902-eac9ce85bf03 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:10.136950 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-6c63c632-30ec-40dd-937b-8d70e3fc0647 req-2c161f26-83d2-41aa-9902-eac9ce85bf03 service nova] Creating event network-vif-plugged:81054b4c-c45a-4833-ae83-e752ff18ff48 for instance c97d5f35-6ea1-4ec7-88f5-9da9dbe81182 on n-h1-858094-4 Sep 16 12:54:10.156753 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-6c63c632-30ec-40dd-937b-8d70e3fc0647 req-2c161f26-83d2-41aa-9902-eac9ce85bf03 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121671 Sep 16 12:54:10.159049 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1090/2100] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:54:10.168628 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b0137ebc-da55-41e4-89d7-2e6faa5ead52 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:10.169667 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b0137ebc-da55-41e4-89d7-2e6faa5ead52 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:10.180463 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0137ebc-da55-41e4-89d7-2e6faa5ead52 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:10.181460 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0137ebc-da55-41e4-89d7-2e6faa5ead52 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:10.182095 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0137ebc-da55-41e4-89d7-2e6faa5ead52 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:10.183277 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0137ebc-da55-41e4-89d7-2e6faa5ead52 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:10.183896 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0137ebc-da55-41e4-89d7-2e6faa5ead52 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:10.185018 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0137ebc-da55-41e4-89d7-2e6faa5ead52 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:10.241006 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-3c0955ac-4daa-489d-b8e4-8c4f3a57c7ef tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 227a8a0b-2a0c-48f8-976a-a176a9039a2d] Updating instance_info_cache with network_info: [{"id": "586b7cfc-f67a-48f3-beb9-5cd2ca16334c", "address": "fa:16:3e:b0:2b:3c", "network": {"id": "2a6f5c27-4e22-4940-b2ce-5570b20e4dba", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1692283097-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1e41136645964ea98a675833bd73299f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap586b7cfc-f6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 16 12:54:10.260857 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3c0955ac-4daa-489d-b8e4-8c4f3a57c7ef tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Releasing lock "refresh_cache-227a8a0b-2a0c-48f8-976a-a176a9039a2d" {{(pid=128780) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 16 12:54:10.262141 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3c0955ac-4daa-489d-b8e4-8c4f3a57c7ef tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "POST /compute/v2.1/servers/227a8a0b-2a0c-48f8-976a-a176a9039a2d/action" status: 202 len: 0 microversion: 2.1 time: 8.415609 Sep 16 12:54:10.265282 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1011/2101] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:54:01 2022] POST /compute/v2.1/servers/227a8a0b-2a0c-48f8-976a-a176a9039a2d/action => generated 0 bytes in 8420 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 16 12:54:10.276633 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f590b6b0-f48a-4fe4-9127-7f28216ad5db tempest-QuotasAdminTestV236-2031111600 tempest-QuotasAdminTestV236-2031111600-project-admin] Calling method '.version_select at 0x7f1039b5fd30>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:10.457016 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f590b6b0-f48a-4fe4-9127-7f28216ad5db tempest-QuotasAdminTestV236-2031111600 tempest-QuotasAdminTestV236-2031111600-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/68675b1003c2464f9f60e1a111af23d1?user_id=ffbec85d733c43c09a6e39510802b3cf" status: 200 len: 282 microversion: 2.36 time: 0.187126 Sep 16 12:54:10.465425 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1012/2102] 10.222.0.67 () {60 vars in 1364 bytes} [Fri Sep 16 12:54:10 2022] GET /compute/v2.1/os-quota-sets/68675b1003c2464f9f60e1a111af23d1?user_id=ffbec85d733c43c09a6e39510802b3cf => generated 282 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:54:10.486906 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9baf4230-04a3-4981-b1cf-054e8a8b28ae tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f10358744c0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:10.620327 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9baf4230-04a3-4981-b1cf-054e8a8b28ae tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/991a3348-5f7a-42cc-8d4f-71f5840a425f" status: 200 len: 1453 microversion: 2.1 time: 0.161039 Sep 16 12:54:10.625162 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1013/2103] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:54:10 2022] GET /compute/v2.1/images/991a3348-5f7a-42cc-8d4f-71f5840a425f => generated 1453 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:10.638666 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c8d8c342-ba1d-44d1-a342-a8296ebd4e32 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.147"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:10.996770 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b0137ebc-da55-41e4-89d7-2e6faa5ead52 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:11.007857 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b0137ebc-da55-41e4-89d7-2e6faa5ead52 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1393 microversion: 2.1 time: 0.845163 Sep 16 12:54:11.009008 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1091/2104] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:10 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1393 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:11.014638 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-04bc9a07-ac14-4c39-8a12-93b431479b92 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:11.015627 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-04bc9a07-ac14-4c39-8a12-93b431479b92 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] [instance: dd721f2f-0f2f-4315-b101-d8140c7d94a0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:11.022382 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04bc9a07-ac14-4c39-8a12-93b431479b92 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:11.023615 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04bc9a07-ac14-4c39-8a12-93b431479b92 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:11.024279 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04bc9a07-ac14-4c39-8a12-93b431479b92 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:11.025175 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04bc9a07-ac14-4c39-8a12-93b431479b92 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:11.025804 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04bc9a07-ac14-4c39-8a12-93b431479b92 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:11.026400 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04bc9a07-ac14-4c39-8a12-93b431479b92 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:11.088463 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c8d8c342-ba1d-44d1-a342-a8296ebd4e32 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 227a8a0b-2a0c-48f8-976a-a176a9039a2d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:11.099733 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c8d8c342-ba1d-44d1-a342-a8296ebd4e32 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:11.100153 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c8d8c342-ba1d-44d1-a342-a8296ebd4e32 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:11.100660 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c8d8c342-ba1d-44d1-a342-a8296ebd4e32 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:11.104596 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c8d8c342-ba1d-44d1-a342-a8296ebd4e32 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:11.105818 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c8d8c342-ba1d-44d1-a342-a8296ebd4e32 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:11.106450 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c8d8c342-ba1d-44d1-a342-a8296ebd4e32 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:11.347395 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-04bc9a07-ac14-4c39-8a12-93b431479b92 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a6e736e1d3417cafc9c42a60693be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101be406faff40d9a001aa76e5f3a19e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:11.356654 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-04bc9a07-ac14-4c39-8a12-93b431479b92 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] 10.222.0.67 "GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0" status: 200 len: 1272 microversion: 2.1 time: 0.346098 Sep 16 12:54:11.357237 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1092/2105] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:11 2022] GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0 => generated 1272 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:11.375738 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e098e20d-a972-45ec-bc8f-550f76283aaf tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:11.376655 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e098e20d-a972-45ec-bc8f-550f76283aaf tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] [instance: 345ee81d-c503-421c-90ea-218ac1c98600] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:11.386090 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e098e20d-a972-45ec-bc8f-550f76283aaf tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:11.386604 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e098e20d-a972-45ec-bc8f-550f76283aaf tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:11.387124 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e098e20d-a972-45ec-bc8f-550f76283aaf tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:11.387941 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e098e20d-a972-45ec-bc8f-550f76283aaf tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:11.388535 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e098e20d-a972-45ec-bc8f-550f76283aaf tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:11.388963 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e098e20d-a972-45ec-bc8f-550f76283aaf tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:11.422184 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-e098e20d-a972-45ec-bc8f-550f76283aaf tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] HTTP exception thrown: Instance 345ee81d-c503-421c-90ea-218ac1c98600 could not be found. Sep 16 12:54:11.424392 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e098e20d-a972-45ec-bc8f-550f76283aaf tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Request method failure captured: Sep 16 12:54:11.424392 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600 HTTP/1.1 Sep 16 12:54:11.424392 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:54:11.424392 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:54:11.424392 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:54:11.424392 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:54:11.424392 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:54:11.424392 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:54:11.424392 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:54:11.424392 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:54:11.424392 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHGC1tLC4Hwvx6NHhPA7kXnEWOqckp907sAMNKZNblBrHEC1mNwTYzTCvIQfMCl7A4tTw0g1fnaX_HyKI_f-70EvldXE1PJoBDtPX0XHIrxwLJLAfXY_1lCY4JPxZ1UFIZK-I060ouY7VXyXkfdKzmkeNXUl-Nyj1oJ2vxDk_ZtwTbo Sep 16 12:54:11.424392 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:54:11.424392 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:54:11.424392 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:54:11.424392 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:54:11.424392 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:54:11.424392 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:54:11.424392 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 69b7d059fb70415fb5dc20e3a921d189 Sep 16 12:54:11.424392 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesOneServerTestJSON-2064562372 Sep 16 12:54:11.424392 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:54:11.424392 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:54:11.426352 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/69b7d059fb70415fb5dc20e3a921d189"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/69b7d059fb70415fb5dc20e3a921d189"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_69b7d059fb70415fb5dc20e3a921d189", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/69b7d059fb70415fb5dc20e3a921d189"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:54:11.426352 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesOneServerTestJSON-2064562372 Sep 16 12:54:11.426352 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 69b7d059fb70415fb5dc20e3a921d189 Sep 16 12:54:11.426352 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2064562372 Sep 16 12:54:11.426352 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ImagesOneServerTestJSON-2064562372-project Sep 16 12:54:11.426352 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:54:11.426352 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:54:11.426352 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 45d4c5f7ddf5432ba8b4eac2cb6a9860 Sep 16 12:54:11.426352 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesOneServerTestJSON-2064562372-project Sep 16 12:54:11.426352 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:54:11.426352 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 345ee81d-c503-421c-90ea-218ac1c98600 could not be found. Sep 16 12:54:11.426352 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '345ee81d-c503-421c-90ea-218ac1c98600'} Sep 16 12:54:11.427393 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:54:11.427393 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:11.427393 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:54:11.427393 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:54:11.427393 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:54:11.427393 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:54:11.427393 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:54:11.427393 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:54:11.427393 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:54:11.427393 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:54:11.427393 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 345ee81d-c503-421c-90ea-218ac1c98600 could not be found. Sep 16 12:54:11.427393 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:11.427393 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:54:11.427393 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:11.427393 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:11.427393 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:54:11.427393 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:54:11.427393 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:54:11.427393 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:54:11.427393 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:54:11.430435 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:54:11.430435 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:54:11.430435 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:54:11.430435 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:54:11.430435 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:54:11.430435 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:54:11.430435 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:54:11.430435 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 345ee81d-c503-421c-90ea-218ac1c98600 could not be found. Sep 16 12:54:11.430435 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:11.430435 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:54:11.430435 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:11.430435 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:11.430435 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:54:11.430435 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:54:11.430435 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:54:11.430435 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:54:11.430435 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 345ee81d-c503-421c-90ea-218ac1c98600 could not be found. Sep 16 12:54:11.430435 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:11.431932 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e098e20d-a972-45ec-bc8f-550f76283aaf tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] Returning 404 to user: Instance 345ee81d-c503-421c-90ea-218ac1c98600 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:54:11.431932 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e098e20d-a972-45ec-bc8f-550f76283aaf tempest-ImagesOneServerTestJSON-2064562372 tempest-ImagesOneServerTestJSON-2064562372-project] 10.222.0.67 "GET /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600" status: 404 len: 111 microversion: 2.1 time: 0.069429 Sep 16 12:54:11.431932 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1093/2106] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:11 2022] GET /compute/v2.1/servers/345ee81d-c503-421c-90ea-218ac1c98600 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:54:11.640889 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-869bafb8-652b-4783-8f67-c0f137bf9b75 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f103533e550>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:11.736316 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-869bafb8-652b-4783-8f67-c0f137bf9b75 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/991a3348-5f7a-42cc-8d4f-71f5840a425f" status: 200 len: 1453 microversion: 2.1 time: 0.098749 Sep 16 12:54:11.744569 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1094/2107] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:54:11 2022] GET /compute/v2.1/images/991a3348-5f7a-42cc-8d4f-71f5840a425f => generated 1453 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:12.040216 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-10fed0d3-04cd-4b0d-b28a-a415b6ac9034 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:12.053921 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-10fed0d3-04cd-4b0d-b28a-a415b6ac9034 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:12.073878 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10fed0d3-04cd-4b0d-b28a-a415b6ac9034 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:12.077752 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10fed0d3-04cd-4b0d-b28a-a415b6ac9034 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:12.078569 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10fed0d3-04cd-4b0d-b28a-a415b6ac9034 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:12.081596 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10fed0d3-04cd-4b0d-b28a-a415b6ac9034 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:12.083249 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10fed0d3-04cd-4b0d-b28a-a415b6ac9034 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:12.083910 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10fed0d3-04cd-4b0d-b28a-a415b6ac9034 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:12.245518 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-c8d8c342-ba1d-44d1-a342-a8296ebd4e32 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] HTTP exception thrown: Floating IP 172.25.2.147 is not associated with instance 5c161179-0b93-4676-86f7-2f507a3ebeb3. Sep 16 12:54:12.248359 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c8d8c342-ba1d-44d1-a342-a8296ebd4e32 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Request method failure captured: Sep 16 12:54:12.248359 n-d-858094-4 devstack@n-api.service[128780]: request: POST /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3/action HTTP/1.1 Sep 16 12:54:12.248359 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:54:12.248359 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:54:12.248359 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:54:12.248359 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 49 Sep 16 12:54:12.248359 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:54:12.248359 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:54:12.248359 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:54:12.248359 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:54:12.248359 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHGPxXZmiUHmt_dft1sdeEgjV0q4vNJkDpEBpD7Lb6hm-ShiDSpwUsuAGMIDYs53IqH8teRtSeFQObdyYjE3XcRcXacV21t-Y8PCaBxxYQREooFypQxs0XfP2jQBOGa7A08HB97lM2M2qPxnRpWViNO6K_WoCZqu2H5gM_K0wP8DNYI Sep 16 12:54:12.248359 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:54:12.248359 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:54:12.248359 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:54:12.248359 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:54:12.248359 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:54:12.248359 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:54:12.248359 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 1e41136645964ea98a675833bd73299f Sep 16 12:54:12.248359 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-195341858 Sep 16 12:54:12.248359 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:54:12.248359 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:54:12.249995 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1e41136645964ea98a675833bd73299f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1e41136645964ea98a675833bd73299f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1e41136645964ea98a675833bd73299f", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1e41136645964ea98a675833bd73299f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:54:12.249995 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-195341858 Sep 16 12:54:12.249995 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 1e41136645964ea98a675833bd73299f Sep 16 12:54:12.249995 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-195341858 Sep 16 12:54:12.249995 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-FloatingIPsAssociationTestJSON-195341858-project Sep 16 12:54:12.249995 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:54:12.249995 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:54:12.249995 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: b9101f5af9e34d21bb8e872d337d3545 Sep 16 12:54:12.249995 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-195341858-project Sep 16 12:54:12.249995 n-d-858094-4 devstack@n-api.service[128780]: Sep 16 12:54:12.249995 n-d-858094-4 devstack@n-api.service[128780]: {"removeFloatingIp": {"address": "172.25.2.147"}} Sep 16 12:54:12.249995 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 12:54:12.249995 n-d-858094-4 devstack@n-api.service[128780]: exception: Floating IP 172.25.2.147 is not associated with instance 5c161179-0b93-4676-86f7-2f507a3ebeb3. Sep 16 12:54:12.251036 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '5c161179-0b93-4676-86f7-2f507a3ebeb3', 'body': {'removeFloatingIp': {'address': '172.25.2.147'}}} Sep 16 12:54:12.251036 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:54:12.251036 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:12.251036 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:54:12.251036 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:54:12.251036 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:54:12.251036 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:54:12.251036 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:54:12.251036 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:54:12.251036 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:54:12.251036 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:54:12.251036 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:54:12.251036 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:54:12.251036 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Sep 16 12:54:12.251036 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 16 12:54:12.251036 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.2.147 is not associated with instance 5c161179-0b93-4676-86f7-2f507a3ebeb3. Sep 16 12:54:12.251036 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:54:12.251036 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:54:12.251036 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:54:12.251036 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:12.253075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:54:12.253075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:54:12.253075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:54:12.253075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:54:12.253075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.2.147 is not associated with instance 5c161179-0b93-4676-86f7-2f507a3ebeb3. Sep 16 12:54:12.253075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:54:12.255807 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c8d8c342-ba1d-44d1-a342-a8296ebd4e32 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Returning 409 to user: Floating IP 172.25.2.147 is not associated with instance 5c161179-0b93-4676-86f7-2f507a3ebeb3. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:54:12.257393 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c8d8c342-ba1d-44d1-a342-a8296ebd4e32 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "POST /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3/action" status: 409 len: 146 microversion: 2.1 time: 1.631012 Sep 16 12:54:12.262304 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1014/2108] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:54:10 2022] POST /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3/action => generated 146 bytes in 1636 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 16 12:54:12.276692 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-586ca077-03ea-4c58-864b-25b31ad115f4 req-03eeb409-c695-4e8f-a3d8-9a68ee2ecc70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "345ee81d-c503-421c-90ea-218ac1c98600", "name": "network-vif-deleted", "tag": "56c49806-0b21-4f4b-9b96-195fc33fcba5"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:12.300382 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-586ca077-03ea-4c58-864b-25b31ad115f4 req-03eeb409-c695-4e8f-a3d8-9a68ee2ecc70 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:12.305372 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-586ca077-03ea-4c58-864b-25b31ad115f4 req-03eeb409-c695-4e8f-a3d8-9a68ee2ecc70 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:12.306668 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-586ca077-03ea-4c58-864b-25b31ad115f4 req-03eeb409-c695-4e8f-a3d8-9a68ee2ecc70 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:12.327781 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-586ca077-03ea-4c58-864b-25b31ad115f4 req-03eeb409-c695-4e8f-a3d8-9a68ee2ecc70 service nova] Creating event network-vif-deleted:56c49806-0b21-4f4b-9b96-195fc33fcba5 for instance 345ee81d-c503-421c-90ea-218ac1c98600 on n-h1-858094-4 Sep 16 12:54:12.337136 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-586ca077-03ea-4c58-864b-25b31ad115f4 req-03eeb409-c695-4e8f-a3d8-9a68ee2ecc70 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072345 Sep 16 12:54:12.339012 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1015/2109] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:54:12.354416 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b28ff62f-3656-4ec2-bfad-39091cb8e4e2 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.147"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:12.958479 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b28ff62f-3656-4ec2-bfad-39091cb8e4e2 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 227a8a0b-2a0c-48f8-976a-a176a9039a2d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:12.970354 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b28ff62f-3656-4ec2-bfad-39091cb8e4e2 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:12.971518 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b28ff62f-3656-4ec2-bfad-39091cb8e4e2 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:12.977603 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b28ff62f-3656-4ec2-bfad-39091cb8e4e2 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:12.978513 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b28ff62f-3656-4ec2-bfad-39091cb8e4e2 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:12.981355 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b28ff62f-3656-4ec2-bfad-39091cb8e4e2 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:12.983025 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b28ff62f-3656-4ec2-bfad-39091cb8e4e2 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:13.193338 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-10fed0d3-04cd-4b0d-b28a-a415b6ac9034 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:13.210844 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-10fed0d3-04cd-4b0d-b28a-a415b6ac9034 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1393 microversion: 2.1 time: 1.183163 Sep 16 12:54:13.214426 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1095/2110] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:12 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1393 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:13.220410 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-43efd1e7-c1f2-48bd-b149-689ee3931aba tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:13.222135 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-43efd1e7-c1f2-48bd-b149-689ee3931aba tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] [instance: dd721f2f-0f2f-4315-b101-d8140c7d94a0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:13.232795 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43efd1e7-c1f2-48bd-b149-689ee3931aba tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:13.233922 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43efd1e7-c1f2-48bd-b149-689ee3931aba tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:13.234961 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43efd1e7-c1f2-48bd-b149-689ee3931aba tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:13.236109 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43efd1e7-c1f2-48bd-b149-689ee3931aba tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:13.237215 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43efd1e7-c1f2-48bd-b149-689ee3931aba tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:13.238393 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43efd1e7-c1f2-48bd-b149-689ee3931aba tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:14.721848 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-43efd1e7-c1f2-48bd-b149-689ee3931aba tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a6e736e1d3417cafc9c42a60693be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101be406faff40d9a001aa76e5f3a19e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:14.739268 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-43efd1e7-c1f2-48bd-b149-689ee3931aba tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] 10.222.0.67 "GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0" status: 200 len: 1314 microversion: 2.1 time: 1.519142 Sep 16 12:54:14.740529 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1096/2111] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:13 2022] GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0 => generated 1314 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:14.747232 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2203143b-8148-4101-a8be-8c68c60c98f3 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f103533e4c0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:14.857552 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2203143b-8148-4101-a8be-8c68c60c98f3 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/991a3348-5f7a-42cc-8d4f-71f5840a425f" status: 200 len: 1453 microversion: 2.1 time: 0.115534 Sep 16 12:54:14.859185 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1097/2112] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:54:14 2022] GET /compute/v2.1/images/991a3348-5f7a-42cc-8d4f-71f5840a425f => generated 1453 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:14.872178 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-afac8571-bab4-47cc-8d6f-2d7f216b181b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:14.873747 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-afac8571-bab4-47cc-8d6f-2d7f216b181b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:14.887596 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afac8571-bab4-47cc-8d6f-2d7f216b181b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:14.895714 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afac8571-bab4-47cc-8d6f-2d7f216b181b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:14.897303 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b28ff62f-3656-4ec2-bfad-39091cb8e4e2 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "refresh_cache-227a8a0b-2a0c-48f8-976a-a176a9039a2d" {{(pid=128780) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 16 12:54:14.897898 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b28ff62f-3656-4ec2-bfad-39091cb8e4e2 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquired lock "refresh_cache-227a8a0b-2a0c-48f8-976a-a176a9039a2d" {{(pid=128780) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 16 12:54:14.898541 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afac8571-bab4-47cc-8d6f-2d7f216b181b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:14.899571 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afac8571-bab4-47cc-8d6f-2d7f216b181b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:14.902426 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afac8571-bab4-47cc-8d6f-2d7f216b181b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:14.903998 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afac8571-bab4-47cc-8d6f-2d7f216b181b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:15.381787 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-afac8571-bab4-47cc-8d6f-2d7f216b181b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:15.404221 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-afac8571-bab4-47cc-8d6f-2d7f216b181b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1393 microversion: 2.1 time: 0.543328 Sep 16 12:54:15.409072 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1098/2113] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:14 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1393 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:15.969125 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-deb50342-aa4f-47aa-b466-a1abc7457239 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] Action: 'create', calling method: .version_select at 0x7f10353f0c10>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTYWoNBlDyDVQgW4ZrP9KnkMMgHzKIUpxj3TTH+kEe9zvx7n4f2YajuI+0qTPhulQEMLeYyorKOke16g0MGl8H3t1v6/33vt+KhXVi8UJg0jq5DyvpW8YNwJG3fb8a9oQ=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:15.974926 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-deb50342-aa4f-47aa-b466-a1abc7457239 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] Request method failure captured: Sep 16 12:54:15.974926 n-d-858094-4 devstack@n-api.service[128779]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 16 12:54:15.974926 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:54:15.974926 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:54:15.974926 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:54:15.974926 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 257 Sep 16 12:54:15.974926 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:54:15.974926 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:54:15.974926 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:54:15.974926 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:54:15.974926 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHH260JCnB1nlxV7nJ_KalNXPmI9E8-1oM2z0K5oyn3Hf7d_cSdQSIIZ7EUGZ9CTv5DTGv2xWJJOTZ9h4giYPLWkkngiutSliFrjQKVn8PwC35lZk02MBzPhMariYswbYVbkUBLQyeiSZyyD9w2CzB5vrhcCDjmFZwmUsG3ccNP3JH8 Sep 16 12:54:15.974926 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:54:15.974926 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:54:15.974926 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:54:15.974926 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:54:15.974926 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:54:15.974926 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:54:15.974926 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 1ee866793a574d59aa08ba65c114f1a5 Sep 16 12:54:15.974926 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-170841773 Sep 16 12:54:15.974926 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:54:15.974926 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:54:15.979722 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1ee866793a574d59aa08ba65c114f1a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1ee866793a574d59aa08ba65c114f1a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1ee866793a574d59aa08ba65c114f1a5", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1ee866793a574d59aa08ba65c114f1a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:54:15.979722 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-KeyPairsNegativeTestJSON-170841773 Sep 16 12:54:15.979722 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 1ee866793a574d59aa08ba65c114f1a5 Sep 16 12:54:15.979722 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-170841773 Sep 16 12:54:15.979722 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-KeyPairsNegativeTestJSON-170841773-project Sep 16 12:54:15.979722 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:54:15.979722 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:54:15.979722 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 534bd13a2dd9471fa366bd0b0b78e50a Sep 16 12:54:15.979722 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-KeyPairsNegativeTestJSON-170841773-project Sep 16 12:54:15.979722 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 12:54:15.979722 n-d-858094-4 devstack@n-api.service[128779]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTYWoNBlDyDVQgW4ZrP9KnkMMgHzKIUpxj3TTH+kEe9zvx7n4f2YajuI+0qTPhulQEMLeYyorKOke16g0MGl8H3t1v6/33vt+KhXVi8UJg0jq5DyvpW8YNwJG3fb8a9oQ=="}} Sep 16 12:54:15.980742 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 12:54:15.980742 n-d-858094-4 devstack@n-api.service[128779]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 16 12:54:15.980742 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTYWoNBlDyDVQgW4ZrP9KnkMMgHzKIUpxj3TTH+kEe9zvx7n4f2YajuI+0qTPhulQEMLeYyorKOke16g0MGl8H3t1v6/33vt+KhXVi8UJg0jq5DyvpW8YNwJG3fb8a9oQ=='}}} Sep 16 12:54:15.980742 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:54:15.980742 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:15.980742 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 16 12:54:15.980742 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 16 12:54:15.980742 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Sep 16 12:54:15.980742 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Sep 16 12:54:15.980742 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Sep 16 12:54:15.980742 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Sep 16 12:54:15.980742 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 16 12:54:15.980742 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:15.980742 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 16 12:54:15.980742 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:15.980742 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:15.980742 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 12:54:15.982918 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 12:54:15.982918 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 12:54:15.982918 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise error Sep 16 12:54:15.982918 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Sep 16 12:54:15.982918 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:15.982918 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Sep 16 12:54:15.982918 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Sep 16 12:54:15.982918 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Sep 16 12:54:15.982918 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'minLength': 1, Sep 16 12:54:15.982918 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 16 12:54:15.982918 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:15.982918 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Sep 16 12:54:15.982918 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Sep 16 12:54:15.982918 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:15.982918 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:54:15.982918 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:15.982918 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:15.982918 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:54:15.982918 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:54:15.982918 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:54:15.982918 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:54:15.982918 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:54:15.982918 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:54:15.986205 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:54:15.986205 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:54:15.986205 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:54:15.986205 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:54:15.986205 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 12:54:15.986205 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 12:54:15.986205 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 12:54:15.986205 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 12:54:15.986205 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 12:54:15.986205 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 12:54:15.986205 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 16 12:54:15.986205 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:15.986205 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:54:15.986205 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:15.986205 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:15.986205 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:54:15.986205 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:54:15.986205 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 12:54:15.986205 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 12:54:15.989013 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 16 12:54:15.989013 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:15.989013 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-deb50342-aa4f-47aa-b466-a1abc7457239 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:54:15.989013 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-deb50342-aa4f-47aa-b466-a1abc7457239 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.565411 Sep 16 12:54:15.989013 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1099/2114] 10.222.0.67 () {60 vars in 1159 bytes} [Fri Sep 16 12:54:15 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 567 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 12:54:16.001202 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-881618e6-6c17-48bd-ab5f-44f718091737 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:16.001840 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-881618e6-6c17-48bd-ab5f-44f718091737 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] [instance: dd721f2f-0f2f-4315-b101-d8140c7d94a0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:16.025223 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-881618e6-6c17-48bd-ab5f-44f718091737 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:16.025700 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-881618e6-6c17-48bd-ab5f-44f718091737 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:16.026144 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-881618e6-6c17-48bd-ab5f-44f718091737 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:16.026886 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-881618e6-6c17-48bd-ab5f-44f718091737 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:16.027363 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-881618e6-6c17-48bd-ab5f-44f718091737 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:16.027776 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-881618e6-6c17-48bd-ab5f-44f718091737 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:16.425660 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-881618e6-6c17-48bd-ab5f-44f718091737 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a6e736e1d3417cafc9c42a60693be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101be406faff40d9a001aa76e5f3a19e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:16.434345 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-881618e6-6c17-48bd-ab5f-44f718091737 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] 10.222.0.67 "GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0" status: 200 len: 1314 microversion: 2.1 time: 0.456358 Sep 16 12:54:16.434925 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1100/2115] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:15 2022] GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0 => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:16.447329 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6974df60-b03d-413c-8563-1933e97d8f75 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f103514f820>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:16.499521 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6974df60-b03d-413c-8563-1933e97d8f75 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/991a3348-5f7a-42cc-8d4f-71f5840a425f" status: 200 len: 1453 microversion: 2.1 time: 0.063532 Sep 16 12:54:16.508048 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1101/2116] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:54:16 2022] GET /compute/v2.1/images/991a3348-5f7a-42cc-8d4f-71f5840a425f => generated 1453 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:16.508048 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-e328b5bc-f6d9-4e9a-bc4b-028cec9e8012 req-0317f913-1f0a-4377-a5b8-a3c50df796fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd721f2f-0f2f-4315-b101-d8140c7d94a0", "tag": "ee76b399-9246-48fa-9c23-18309e9b0a92"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:16.535956 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e328b5bc-f6d9-4e9a-bc4b-028cec9e8012 req-0317f913-1f0a-4377-a5b8-a3c50df796fe service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:16.536735 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e328b5bc-f6d9-4e9a-bc4b-028cec9e8012 req-0317f913-1f0a-4377-a5b8-a3c50df796fe service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:16.537195 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e328b5bc-f6d9-4e9a-bc4b-028cec9e8012 req-0317f913-1f0a-4377-a5b8-a3c50df796fe service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:16.565914 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-e328b5bc-f6d9-4e9a-bc4b-028cec9e8012 req-0317f913-1f0a-4377-a5b8-a3c50df796fe service nova] Creating event network-changed:ee76b399-9246-48fa-9c23-18309e9b0a92 for instance dd721f2f-0f2f-4315-b101-d8140c7d94a0 on n-h1-858094-4 Sep 16 12:54:16.577974 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-e328b5bc-f6d9-4e9a-bc4b-028cec9e8012 req-0317f913-1f0a-4377-a5b8-a3c50df796fe service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075794 Sep 16 12:54:16.581121 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1102/2117] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:54:16.588057 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dc523728-5f14-4cbd-9432-6e9a632d448f tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] Action: 'create', calling method: .version_select at 0x7f103533eca0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1266915467", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:16.614194 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-dc523728-5f14-4cbd-9432-6e9a632d448f tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] Getting quotas for project 1ee866793a574d59aa08ba65c114f1a5. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:54:16.623034 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-dc523728-5f14-4cbd-9432-6e9a632d448f tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] Getting quotas for user 534bd13a2dd9471fa366bd0b0b78e50a and project 1ee866793a574d59aa08ba65c114f1a5. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:54:16.652565 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-dc523728-5f14-4cbd-9432-6e9a632d448f tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 16 12:54:16.685776 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dc523728-5f14-4cbd-9432-6e9a632d448f tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] Request method failure captured: Sep 16 12:54:16.685776 n-d-858094-4 devstack@n-api.service[128779]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 16 12:54:16.685776 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:54:16.685776 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:54:16.685776 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:54:16.685776 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 2167 Sep 16 12:54:16.685776 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:54:16.685776 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:54:16.685776 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:54:16.685776 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:54:16.685776 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHH260JCnB1nlxV7nJ_KalNXPmI9E8-1oM2z0K5oyn3Hf7d_cSdQSIIZ7EUGZ9CTv5DTGv2xWJJOTZ9h4giYPLWkkngiutSliFrjQKVn8PwC35lZk02MBzPhMariYswbYVbkUBLQyeiSZyyD9w2CzB5vrhcCDjmFZwmUsG3ccNP3JH8 Sep 16 12:54:16.685776 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:54:16.685776 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:54:16.685776 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:54:16.685776 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:54:16.685776 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:54:16.685776 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:54:16.685776 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 1ee866793a574d59aa08ba65c114f1a5 Sep 16 12:54:16.685776 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-170841773 Sep 16 12:54:16.685776 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:54:16.685776 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:54:16.685776 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1ee866793a574d59aa08ba65c114f1a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1ee866793a574d59aa08ba65c114f1a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1ee866793a574d59aa08ba65c114f1a5", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1ee866793a574d59aa08ba65c114f1a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:54:16.685776 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-KeyPairsNegativeTestJSON-170841773 Sep 16 12:54:16.685776 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 1ee866793a574d59aa08ba65c114f1a5 Sep 16 12:54:16.685776 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-170841773 Sep 16 12:54:16.685776 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-KeyPairsNegativeTestJSON-170841773-project Sep 16 12:54:16.685776 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:54:16.685776 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:54:16.685776 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 534bd13a2dd9471fa366bd0b0b78e50a Sep 16 12:54:16.685776 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-KeyPairsNegativeTestJSON-170841773-project Sep 16 12:54:16.685776 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 12:54:16.685776 n-d-858094-4 devstack@n-api.service[128779]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1266915467", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Sep 16 12:54:16.685776 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 12:54:16.685776 n-d-858094-4 devstack@n-api.service[128779]: exception: Keypair data is invalid: failed to generate fingerprint Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1266915467', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:54:16.688575 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:54:16.692359 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:54:16.692359 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:54:16.692359 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:54:16.692359 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:54:16.692359 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 16 12:54:16.692359 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 16 12:54:16.692359 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 16 12:54:16.692359 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 16 12:54:16.692359 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 16 12:54:16.692359 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:16.692359 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:54:16.692359 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:16.692359 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:16.692359 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:54:16.692359 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:54:16.692359 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:54:16.692359 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:54:16.692359 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 16 12:54:16.692359 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:16.692359 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dc523728-5f14-4cbd-9432-6e9a632d448f tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:54:16.692359 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dc523728-5f14-4cbd-9432-6e9a632d448f tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.104068 Sep 16 12:54:16.692359 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1103/2118] 10.222.0.67 () {60 vars in 1160 bytes} [Fri Sep 16 12:54:16 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 16 12:54:16.702933 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-568b7d62-3e69-4e38-89a8-45946aac0964 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:16.704489 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-568b7d62-3e69-4e38-89a8-45946aac0964 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:16.724652 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-568b7d62-3e69-4e38-89a8-45946aac0964 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:16.725137 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-568b7d62-3e69-4e38-89a8-45946aac0964 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:16.725582 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-568b7d62-3e69-4e38-89a8-45946aac0964 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:16.728066 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-568b7d62-3e69-4e38-89a8-45946aac0964 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:16.728578 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-568b7d62-3e69-4e38-89a8-45946aac0964 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:16.730791 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-568b7d62-3e69-4e38-89a8-45946aac0964 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:17.134938 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-568b7d62-3e69-4e38-89a8-45946aac0964 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:17.139269 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:54:17.153656 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-568b7d62-3e69-4e38-89a8-45946aac0964 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1393 microversion: 2.1 time: 0.452573 Sep 16 12:54:17.171484 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1104/2119] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:16 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1393 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:17.188972 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-89bddbd5-f5c3-49b9-8978-937f703a17f1 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] Action: 'create', calling method: .version_select at 0x7f103533ee50>, body: {"keypair": {"name": "tempest-keypair-904406978", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJYUrg2MhKk4FzqLsyKAv+zJoL8eWCwsXQb3PVqPjlO2f0LVP0p0UcNZ72ubGWMLI5xT5rqqLyRPDgs73K7394TuMtBexIzLy2774xegJdb0a1Ym8fZXbWZfyyRbXlXVbQ=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:17.230852 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-89bddbd5-f5c3-49b9-8978-937f703a17f1 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] Getting quotas for project 1ee866793a574d59aa08ba65c114f1a5. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:54:17.237819 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-89bddbd5-f5c3-49b9-8978-937f703a17f1 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] Getting quotas for user 534bd13a2dd9471fa366bd0b0b78e50a and project 1ee866793a574d59aa08ba65c114f1a5. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:54:17.273923 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-89bddbd5-f5c3-49b9-8978-937f703a17f1 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.100627 Sep 16 12:54:17.277289 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1105/2120] 10.222.0.67 () {60 vars in 1159 bytes} [Fri Sep 16 12:54:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:54:17.471449 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-b28ff62f-3656-4ec2-bfad-39091cb8e4e2 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 227a8a0b-2a0c-48f8-976a-a176a9039a2d] Building network info cache for instance {{(pid=128780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 16 12:54:17.554968 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b4c77cab-3f4b-4518-9835-a53efed46ec7 tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:17.563806 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4c77cab-3f4b-4518-9835-a53efed46ec7 tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:17.564558 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4c77cab-3f4b-4518-9835-a53efed46ec7 tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:17.565436 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4c77cab-3f4b-4518-9835-a53efed46ec7 tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:17.566551 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4c77cab-3f4b-4518-9835-a53efed46ec7 tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:17.570329 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4c77cab-3f4b-4518-9835-a53efed46ec7 tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:17.571062 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4c77cab-3f4b-4518-9835-a53efed46ec7 tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:17.637357 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b4c77cab-3f4b-4518-9835-a53efed46ec7 tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.358610 Sep 16 12:54:17.638823 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1106/2121] 10.222.0.67 () {58 vars in 1137 bytes} [Fri Sep 16 12:54:17 2022] GET /compute/v2.1/os-services => generated 944 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:54:17.650717 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-04b0ba94-c2ca-415b-be12-664bb05cf039 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] Action: 'create', calling method: .version_select at 0x7f10353b3dc0>, body: {"keypair": {"name": "tempest-keypair-904406978", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4GXbBVg2pMxcHbHubWGXc8R5kYFjFqLwCPNUblJUpQWCZBz+TYVtaHzoj/K/N7OZzaHIKKm/8L2rv9i2rqi5OhU4yQuKlkV31CLq78Y3UGnsV507/ETO8kK3+EfzvFaQ=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:17.687378 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-04b0ba94-c2ca-415b-be12-664bb05cf039 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] Getting quotas for project 1ee866793a574d59aa08ba65c114f1a5. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:54:17.701017 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-04b0ba94-c2ca-415b-be12-664bb05cf039 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] Getting quotas for user 534bd13a2dd9471fa366bd0b0b78e50a and project 1ee866793a574d59aa08ba65c114f1a5. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:54:17.767967 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-04b0ba94-c2ca-415b-be12-664bb05cf039 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] HTTP exception thrown: Key pair 'tempest-keypair-904406978' already exists. Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-04b0ba94-c2ca-415b-be12-664bb05cf039 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] Request method failure captured: Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 272 Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHH260JCnB1nlxV7nJ_KalNXPmI9E8-1oM2z0K5oyn3Hf7d_cSdQSIIZ7EUGZ9CTv5DTGv2xWJJOTZ9h4giYPLWkkngiutSliFrjQKVn8PwC35lZk02MBzPhMariYswbYVbkUBLQyeiSZyyD9w2CzB5vrhcCDjmFZwmUsG3ccNP3JH8 Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 1ee866793a574d59aa08ba65c114f1a5 Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-170841773 Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1ee866793a574d59aa08ba65c114f1a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1ee866793a574d59aa08ba65c114f1a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1ee866793a574d59aa08ba65c114f1a5", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1ee866793a574d59aa08ba65c114f1a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-KeyPairsNegativeTestJSON-170841773 Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 1ee866793a574d59aa08ba65c114f1a5 Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-170841773 Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-KeyPairsNegativeTestJSON-170841773-project Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 534bd13a2dd9471fa366bd0b0b78e50a Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-KeyPairsNegativeTestJSON-170841773-project Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: {"keypair": {"name": "tempest-keypair-904406978", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4GXbBVg2pMxcHbHubWGXc8R5kYFjFqLwCPNUblJUpQWCZBz+TYVtaHzoj/K/N7OZzaHIKKm/8L2rv9i2rqi5OhU4yQuKlkV31CLq78Y3UGnsV507/ETO8kK3+EfzvFaQ=="}} Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: exception: Key pair 'tempest-keypair-904406978' already exists. Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-904406978', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4GXbBVg2pMxcHbHubWGXc8R5kYFjFqLwCPNUblJUpQWCZBz+TYVtaHzoj/K/N7OZzaHIKKm/8L2rv9i2rqi5OhU4yQuKlkV31CLq78Y3UGnsV507/ETO8kK3+EfzvFaQ=='}}} Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result.read() Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '534bd13a2dd9471fa366bd0b0b78e50a-tempest-keypair-904406978' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 16 12:54:17.792729 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi kp.save(context.session) Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi session.flush() Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result.read() Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 16 12:54:17.798126 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '534bd13a2dd9471fa366bd0b0b78e50a-tempest-keypair-904406978' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 16, 12, 54, 17, 759292), 'updated_at': None, 'name': 'tempest-keypair-904406978', 'user_id': '534bd13a2dd9471fa366bd0b0b78e50a', 'fingerprint': '3c:2f:b5:80:fa:39:72:03:95:f2:38:66:09:bd:a5:18', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4GXbBVg2pMxcHbHubWGXc8R5kYFjFqLwCPNUblJUpQWCZBz+TYVtaHzoj/K/N7OZzaHIKKm/8L2rv9i2rqi5OhU4yQuKlkV31CLq78Y3UGnsV507/ETO8kK3+EfzvFaQ==', 'type': 'ssh'}] Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi keypair.create() Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._create() Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-904406978' already exists. Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Sep 16 12:54:17.805518 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-904406978' already exists. Sep 16 12:54:17.815626 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:17.815626 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:54:17.815626 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:17.815626 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:17.815626 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:54:17.815626 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:54:17.815626 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:54:17.815626 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:54:17.815626 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-904406978' already exists. Sep 16 12:54:17.815626 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:17.815626 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-04b0ba94-c2ca-415b-be12-664bb05cf039 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] Returning 409 to user: Key pair 'tempest-keypair-904406978' already exists. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:54:17.815626 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-04b0ba94-c2ca-415b-be12-664bb05cf039 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.173824 Sep 16 12:54:17.817430 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1107/2122] 10.222.0.67 () {60 vars in 1159 bytes} [Fri Sep 16 12:54:17 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 178 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 16 12:54:17.825678 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5a57ae4c-9659-4538-9263-9d55de55a3e3 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:17.826689 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5a57ae4c-9659-4538-9263-9d55de55a3e3 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] [instance: dd721f2f-0f2f-4315-b101-d8140c7d94a0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:17.834461 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a57ae4c-9659-4538-9263-9d55de55a3e3 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:17.835473 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a57ae4c-9659-4538-9263-9d55de55a3e3 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:17.836166 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a57ae4c-9659-4538-9263-9d55de55a3e3 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:17.836995 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a57ae4c-9659-4538-9263-9d55de55a3e3 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:17.837608 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a57ae4c-9659-4538-9263-9d55de55a3e3 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:17.838114 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a57ae4c-9659-4538-9263-9d55de55a3e3 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:18.375038 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5a57ae4c-9659-4538-9263-9d55de55a3e3 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a6e736e1d3417cafc9c42a60693be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101be406faff40d9a001aa76e5f3a19e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:18.388944 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5a57ae4c-9659-4538-9263-9d55de55a3e3 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] 10.222.0.67 "GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0" status: 200 len: 1314 microversion: 2.1 time: 0.570184 Sep 16 12:54:18.389544 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1108/2123] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:17 2022] GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0 => generated 1314 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:18.420262 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0baff472-5418-454a-9881-171685aeeb86 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f10353a4ee0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:18.562437 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0baff472-5418-454a-9881-171685aeeb86 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/991a3348-5f7a-42cc-8d4f-71f5840a425f" status: 200 len: 1453 microversion: 2.1 time: 0.170189 Sep 16 12:54:18.567119 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1109/2124] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:54:18 2022] GET /compute/v2.1/images/991a3348-5f7a-42cc-8d4f-71f5840a425f => generated 1453 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:18.591661 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ebf8930c-a555-40db-b627-6bc3b93f4d59 tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:18.607352 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebf8930c-a555-40db-b627-6bc3b93f4d59 tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:18.607865 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebf8930c-a555-40db-b627-6bc3b93f4d59 tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:18.608358 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebf8930c-a555-40db-b627-6bc3b93f4d59 tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:18.609126 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebf8930c-a555-40db-b627-6bc3b93f4d59 tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:18.609597 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebf8930c-a555-40db-b627-6bc3b93f4d59 tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:18.610036 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebf8930c-a555-40db-b627-6bc3b93f4d59 tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:18.665116 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ebf8930c-a555-40db-b627-6bc3b93f4d59 tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.096451 Sep 16 12:54:18.677626 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1110/2125] 10.222.0.67 () {58 vars in 1170 bytes} [Fri Sep 16 12:54:18 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:54:18.684505 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-659968e2-2362-4bb4-bb93-6f24afa9f3f2 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] Calling method '.version_select at 0x7f10353a4280>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:18.741717 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-659968e2-2362-4bb4-bb93-6f24afa9f3f2 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-904406978" status: 202 len: 0 microversion: 2.1 time: 0.061106 Sep 16 12:54:18.743779 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1111/2126] 10.222.0.67 () {58 vars in 1218 bytes} [Fri Sep 16 12:54:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-904406978 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:54:18.750489 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6118dcb4-73d5-4972-bc76-0e025585225a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:18.755916 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6118dcb4-73d5-4972-bc76-0e025585225a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:18.773725 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6118dcb4-73d5-4972-bc76-0e025585225a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:18.776289 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6118dcb4-73d5-4972-bc76-0e025585225a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:18.777679 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6118dcb4-73d5-4972-bc76-0e025585225a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:18.779910 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6118dcb4-73d5-4972-bc76-0e025585225a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:18.780641 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6118dcb4-73d5-4972-bc76-0e025585225a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:18.785798 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6118dcb4-73d5-4972-bc76-0e025585225a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:18.889596 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-b28ff62f-3656-4ec2-bfad-39091cb8e4e2 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 227a8a0b-2a0c-48f8-976a-a176a9039a2d] Updating instance_info_cache with network_info: [{"id": "586b7cfc-f67a-48f3-beb9-5cd2ca16334c", "address": "fa:16:3e:b0:2b:3c", "network": {"id": "2a6f5c27-4e22-4940-b2ce-5570b20e4dba", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1692283097-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1e41136645964ea98a675833bd73299f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap586b7cfc-f6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 16 12:54:18.908603 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b28ff62f-3656-4ec2-bfad-39091cb8e4e2 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Releasing lock "refresh_cache-227a8a0b-2a0c-48f8-976a-a176a9039a2d" {{(pid=128780) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 16 12:54:18.911027 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b28ff62f-3656-4ec2-bfad-39091cb8e4e2 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "POST /compute/v2.1/servers/227a8a0b-2a0c-48f8-976a-a176a9039a2d/action" status: 202 len: 0 microversion: 2.1 time: 6.569774 Sep 16 12:54:18.913387 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1016/2127] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:54:12 2022] POST /compute/v2.1/servers/227a8a0b-2a0c-48f8-976a-a176a9039a2d/action => generated 0 bytes in 6573 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 16 12:54:18.932863 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-868b9bc4-891e-45c3-9d6e-fba34d5392c9 req-a4fc0106-0169-4154-8f21-5a99175060b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "227a8a0b-2a0c-48f8-976a-a176a9039a2d", "tag": "586b7cfc-f67a-48f3-beb9-5cd2ca16334c"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:18.960694 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-868b9bc4-891e-45c3-9d6e-fba34d5392c9 req-a4fc0106-0169-4154-8f21-5a99175060b9 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:18.961565 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-868b9bc4-891e-45c3-9d6e-fba34d5392c9 req-a4fc0106-0169-4154-8f21-5a99175060b9 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:18.962233 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-868b9bc4-891e-45c3-9d6e-fba34d5392c9 req-a4fc0106-0169-4154-8f21-5a99175060b9 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:18.994902 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-868b9bc4-891e-45c3-9d6e-fba34d5392c9 req-a4fc0106-0169-4154-8f21-5a99175060b9 service nova] Creating event network-changed:586b7cfc-f67a-48f3-beb9-5cd2ca16334c for instance 227a8a0b-2a0c-48f8-976a-a176a9039a2d on n-h2-858094-4 Sep 16 12:54:19.001144 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-868b9bc4-891e-45c3-9d6e-fba34d5392c9 req-a4fc0106-0169-4154-8f21-5a99175060b9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085292 Sep 16 12:54:19.006502 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1017/2128] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:54:19.031213 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-11ccc175-f8d6-468c-af1c-ea75edca018c tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:19.038841 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-11ccc175-f8d6-468c-af1c-ea75edca018c tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:19.039338 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-11ccc175-f8d6-468c-af1c-ea75edca018c tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:19.039782 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-11ccc175-f8d6-468c-af1c-ea75edca018c tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:19.044620 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-11ccc175-f8d6-468c-af1c-ea75edca018c tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:19.045126 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-11ccc175-f8d6-468c-af1c-ea75edca018c tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:19.045580 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-11ccc175-f8d6-468c-af1c-ea75edca018c tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:19.111390 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-11ccc175-f8d6-468c-af1c-ea75edca018c tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.103100 Sep 16 12:54:19.122410 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1018/2129] 10.222.0.67 () {58 vars in 1137 bytes} [Fri Sep 16 12:54:19 2022] GET /compute/v2.1/os-services => generated 944 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:54:19.128428 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-18d94403-baa0-4e72-aa0d-679742b8c017 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] Action: 'create', calling method: .version_select at 0x7f1035af7550>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEz5CZZ2uqATVXubp7SPbWY44zPjWQSL4ul5BNL+RBUSdQVTkH4AfWXlc6Mwyd4OADcoZ/jbKE53jOQOkYzMrU2tQ4B/l6wlgVFKoIAIc58/zA/TPYPI+wqqgL82nbvcbg=="}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-18d94403-baa0-4e72-aa0d-679742b8c017 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] Request method failure captured: Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 247 Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHH260JCnB1nlxV7nJ_KalNXPmI9E8-1oM2z0K5oyn3Hf7d_cSdQSIIZ7EUGZ9CTv5DTGv2xWJJOTZ9h4giYPLWkkngiutSliFrjQKVn8PwC35lZk02MBzPhMariYswbYVbkUBLQyeiSZyyD9w2CzB5vrhcCDjmFZwmUsG3ccNP3JH8 Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 1ee866793a574d59aa08ba65c114f1a5 Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-170841773 Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1ee866793a574d59aa08ba65c114f1a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1ee866793a574d59aa08ba65c114f1a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1ee866793a574d59aa08ba65c114f1a5", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1ee866793a574d59aa08ba65c114f1a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-KeyPairsNegativeTestJSON-170841773 Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 1ee866793a574d59aa08ba65c114f1a5 Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-170841773 Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-KeyPairsNegativeTestJSON-170841773-project Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 534bd13a2dd9471fa366bd0b0b78e50a Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-KeyPairsNegativeTestJSON-170841773-project Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEz5CZZ2uqATVXubp7SPbWY44zPjWQSL4ul5BNL+RBUSdQVTkH4AfWXlc6Mwyd4OADcoZ/jbKE53jOQOkYzMrU2tQ4B/l6wlgVFKoIAIc58/zA/TPYPI+wqqgL82nbvcbg=="}} Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEz5CZZ2uqATVXubp7SPbWY44zPjWQSL4ul5BNL+RBUSdQVTkH4AfWXlc6Mwyd4OADcoZ/jbKE53jOQOkYzMrU2tQ4B/l6wlgVFKoIAIc58/zA/TPYPI+wqqgL82nbvcbg=='}}} Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise error Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi '' Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 12:54:19.133678 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 12:54:19.138481 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 12:54:19.138481 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 12:54:19.138481 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 12:54:19.138481 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 12:54:19.138481 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 16 12:54:19.138481 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:54:19.138481 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:54:19.138481 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:54:19.138481 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:19.138481 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:54:19.138481 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:54:19.138481 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 12:54:19.138481 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 12:54:19.138481 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 16 12:54:19.138481 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:54:19.138481 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-18d94403-baa0-4e72-aa0d-679742b8c017 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:54:19.138481 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-18d94403-baa0-4e72-aa0d-679742b8c017 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.013920 Sep 16 12:54:19.138481 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1019/2130] 10.222.0.67 () {60 vars in 1159 bytes} [Fri Sep 16 12:54:19 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 12:54:19.151295 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e5676996-814d-4437-bac6-2f26f735a0ed tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:19.152270 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e5676996-814d-4437-bac6-2f26f735a0ed tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 227a8a0b-2a0c-48f8-976a-a176a9039a2d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:19.163991 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e5676996-814d-4437-bac6-2f26f735a0ed tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:19.164775 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e5676996-814d-4437-bac6-2f26f735a0ed tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:19.165406 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e5676996-814d-4437-bac6-2f26f735a0ed tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:19.166321 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e5676996-814d-4437-bac6-2f26f735a0ed tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:19.166931 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e5676996-814d-4437-bac6-2f26f735a0ed tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:19.167725 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e5676996-814d-4437-bac6-2f26f735a0ed tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:19.172416 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6118dcb4-73d5-4972-bc76-0e025585225a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:19.191763 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6118dcb4-73d5-4972-bc76-0e025585225a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1393 microversion: 2.1 time: 0.446530 Sep 16 12:54:19.192994 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1112/2131] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:18 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1393 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:19.200413 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dcda36f7-3828-4a16-9327-4b7f577ebc99 tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:19.205548 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dcda36f7-3828-4a16-9327-4b7f577ebc99 tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:19.206919 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dcda36f7-3828-4a16-9327-4b7f577ebc99 tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:19.207505 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dcda36f7-3828-4a16-9327-4b7f577ebc99 tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:19.209096 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dcda36f7-3828-4a16-9327-4b7f577ebc99 tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:19.209739 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dcda36f7-3828-4a16-9327-4b7f577ebc99 tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:19.211696 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dcda36f7-3828-4a16-9327-4b7f577ebc99 tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:19.239199 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e5676996-814d-4437-bac6-2f26f735a0ed tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 227a8a0b-2a0c-48f8-976a-a176a9039a2d] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:54:19.257364 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dcda36f7-3828-4a16-9327-4b7f577ebc99 tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?host=n-d-858094-4&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.063040 Sep 16 12:54:19.258679 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1113/2132] 10.222.0.67 () {58 vars in 1194 bytes} [Fri Sep 16 12:54:19 2022] GET /compute/v2.1/os-services?host=n-d-858094-4&binary=xxx => generated 16 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 12:54:19.265236 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f723ab12-c59e-4dcb-9a4b-7e779e7ff235 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] Action: 'create', calling method: .version_select at 0x7f10353a44c0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-351118009", "public_key": " "}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:19.287093 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-f723ab12-c59e-4dcb-9a4b-7e779e7ff235 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] Getting quotas for project 1ee866793a574d59aa08ba65c114f1a5. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:54:19.296670 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-f723ab12-c59e-4dcb-9a4b-7e779e7ff235 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] Getting quotas for user 534bd13a2dd9471fa366bd0b0b78e50a and project 1ee866793a574d59aa08ba65c114f1a5. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:54:19.305347 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:54:19.346085 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-f723ab12-c59e-4dcb-9a4b-7e779e7ff235 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f723ab12-c59e-4dcb-9a4b-7e779e7ff235 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] Request method failure captured: Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 94 Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHH260JCnB1nlxV7nJ_KalNXPmI9E8-1oM2z0K5oyn3Hf7d_cSdQSIIZ7EUGZ9CTv5DTGv2xWJJOTZ9h4giYPLWkkngiutSliFrjQKVn8PwC35lZk02MBzPhMariYswbYVbkUBLQyeiSZyyD9w2CzB5vrhcCDjmFZwmUsG3ccNP3JH8 Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 1ee866793a574d59aa08ba65c114f1a5 Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-170841773 Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1ee866793a574d59aa08ba65c114f1a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1ee866793a574d59aa08ba65c114f1a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1ee866793a574d59aa08ba65c114f1a5", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1ee866793a574d59aa08ba65c114f1a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-KeyPairsNegativeTestJSON-170841773 Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 1ee866793a574d59aa08ba65c114f1a5 Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-170841773 Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-KeyPairsNegativeTestJSON-170841773-project Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 534bd13a2dd9471fa366bd0b0b78e50a Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-KeyPairsNegativeTestJSON-170841773-project Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-351118009", "public_key": " "}} Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: exception: Keypair data is invalid: failed to generate fingerprint Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-351118009', 'public_key': ' '}}} Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:54:19.351382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:19.357130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:19.357130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:54:19.357130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:54:19.357130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:54:19.357130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:54:19.357130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:54:19.357130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:54:19.357130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:54:19.357130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:54:19.357130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:54:19.357130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:54:19.357130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:54:19.357130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:54:19.357130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 16 12:54:19.357130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 16 12:54:19.357130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 16 12:54:19.357130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 16 12:54:19.357130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 16 12:54:19.357130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:19.357130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:54:19.357130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:19.357130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:19.357130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:54:19.357130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:54:19.357130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:54:19.357130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:54:19.357130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 16 12:54:19.357130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:19.361906 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f723ab12-c59e-4dcb-9a4b-7e779e7ff235 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:54:19.363825 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f723ab12-c59e-4dcb-9a4b-7e779e7ff235 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.103646 Sep 16 12:54:19.373594 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1114/2133] 10.222.0.67 () {60 vars in 1158 bytes} [Fri Sep 16 12:54:19 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 16 12:54:19.397993 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-af157f1d-f5bc-41a5-8d7f-42fd74291712 tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:19.405293 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af157f1d-f5bc-41a5-8d7f-42fd74291712 tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:19.405801 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af157f1d-f5bc-41a5-8d7f-42fd74291712 tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:19.406253 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af157f1d-f5bc-41a5-8d7f-42fd74291712 tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:19.407142 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af157f1d-f5bc-41a5-8d7f-42fd74291712 tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:19.417856 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af157f1d-f5bc-41a5-8d7f-42fd74291712 tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:19.418634 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af157f1d-f5bc-41a5-8d7f-42fd74291712 tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:19.483001 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-af157f1d-f5bc-41a5-8d7f-42fd74291712 tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.108199 Sep 16 12:54:19.492864 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1115/2134] 10.222.0.67 () {58 vars in 1137 bytes} [Fri Sep 16 12:54:19 2022] GET /compute/v2.1/os-services => generated 944 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:54:19.498439 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e5676996-814d-4437-bac6-2f26f735a0ed tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "DELETE /compute/v2.1/servers/227a8a0b-2a0c-48f8-976a-a176a9039a2d" status: 204 len: 0 microversion: 2.1 time: 0.359519 Sep 16 12:54:19.498674 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5776ae06-5a26-42e5-854d-4c6fc758b700 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] Action: 'create', calling method: .version_select at 0x7f103558e820>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/ZbkV5IU9LEwt4Fefi/vzSq5P+PrBOfflUWg58m3/8HsVD6wgE4UifH8lGHwGGvdAlGu7jNkTYOCFZBEONh/htcWGrprYShfm5PwgU71B54qu3g3Ie06MNdYC7pTYnJQ=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5776ae06-5a26-42e5-854d-4c6fc758b700 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] Request method failure captured: Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 507 Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHH260JCnB1nlxV7nJ_KalNXPmI9E8-1oM2z0K5oyn3Hf7d_cSdQSIIZ7EUGZ9CTv5DTGv2xWJJOTZ9h4giYPLWkkngiutSliFrjQKVn8PwC35lZk02MBzPhMariYswbYVbkUBLQyeiSZyyD9w2CzB5vrhcCDjmFZwmUsG3ccNP3JH8 Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 1ee866793a574d59aa08ba65c114f1a5 Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-170841773 Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1ee866793a574d59aa08ba65c114f1a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1ee866793a574d59aa08ba65c114f1a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1ee866793a574d59aa08ba65c114f1a5", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1ee866793a574d59aa08ba65c114f1a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-KeyPairsNegativeTestJSON-170841773 Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 1ee866793a574d59aa08ba65c114f1a5 Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-170841773 Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-KeyPairsNegativeTestJSON-170841773-project Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 534bd13a2dd9471fa366bd0b0b78e50a Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-KeyPairsNegativeTestJSON-170841773-project Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/ZbkV5IU9LEwt4Fefi/vzSq5P+PrBOfflUWg58m3/8HsVD6wgE4UifH8lGHwGGvdAlGu7jNkTYOCFZBEONh/htcWGrprYShfm5PwgU71B54qu3g3Ie06MNdYC7pTYnJQ=="}} Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/ZbkV5IU9LEwt4Fefi/vzSq5P+PrBOfflUWg58m3/8HsVD6wgE4UifH8lGHwGGvdAlGu7jNkTYOCFZBEONh/htcWGrprYShfm5PwgU71B54qu3g3Ie06MNdYC7pTYnJQ=='}}} Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise error Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 16 12:54:19.507289 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Sep 16 12:54:19.511493 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:19.511493 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:54:19.511493 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:19.511493 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:19.511493 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:54:19.511493 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:54:19.511493 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:54:19.511493 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:54:19.511493 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:54:19.511493 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:54:19.511493 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:54:19.511493 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:54:19.511493 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:54:19.511493 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:54:19.511493 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 12:54:19.511493 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 12:54:19.511493 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 12:54:19.511493 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 12:54:19.511493 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 12:54:19.511493 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 12:54:19.511493 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 16 12:54:19.511493 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:19.511493 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:54:19.511493 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:19.511493 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:19.511493 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:54:19.511493 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:54:19.511493 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 12:54:19.511493 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 12:54:19.511493 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 16 12:54:19.511493 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:19.511493 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5776ae06-5a26-42e5-854d-4c6fc758b700 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:54:19.511493 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5776ae06-5a26-42e5-854d-4c6fc758b700 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.012242 Sep 16 12:54:19.520983 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1020/2135] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:54:19 2022] DELETE /compute/v2.1/servers/227a8a0b-2a0c-48f8-976a-a176a9039a2d => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:54:19.525353 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1116/2136] 10.222.0.67 () {60 vars in 1159 bytes} [Fri Sep 16 12:54:19 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 12:54:19.529233 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-76032c8a-dff9-4047-868a-5d5f0d88d102 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:19.530004 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-76032c8a-dff9-4047-868a-5d5f0d88d102 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] [instance: dd721f2f-0f2f-4315-b101-d8140c7d94a0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:19.534652 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-50e21f9f-63dc-4c0c-b85e-2bd8d8a155a8 tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:19.542134 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-50e21f9f-63dc-4c0c-b85e-2bd8d8a155a8 tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:19.543085 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-50e21f9f-63dc-4c0c-b85e-2bd8d8a155a8 tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:19.544065 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-50e21f9f-63dc-4c0c-b85e-2bd8d8a155a8 tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:19.545100 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-50e21f9f-63dc-4c0c-b85e-2bd8d8a155a8 tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:19.545850 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-50e21f9f-63dc-4c0c-b85e-2bd8d8a155a8 tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:19.546311 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76032c8a-dff9-4047-868a-5d5f0d88d102 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:19.547832 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-50e21f9f-63dc-4c0c-b85e-2bd8d8a155a8 tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:19.548514 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76032c8a-dff9-4047-868a-5d5f0d88d102 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:19.549077 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76032c8a-dff9-4047-868a-5d5f0d88d102 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:19.550546 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76032c8a-dff9-4047-868a-5d5f0d88d102 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:19.557251 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76032c8a-dff9-4047-868a-5d5f0d88d102 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:19.557852 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76032c8a-dff9-4047-868a-5d5f0d88d102 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:19.571660 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=86,nova_cell1:SAVEPOINT=4,nova_cell1:UPDATE=5,nova_cell1:RELEASE=4,nova_cell1:INSERT=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:54:19.626437 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-50e21f9f-63dc-4c0c-b85e-2bd8d8a155a8 tempest-ServicesAdminNegativeTestJSON-1063800317 tempest-ServicesAdminNegativeTestJSON-1063800317-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.097803 Sep 16 12:54:19.627185 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1021/2137] 10.222.0.67 () {58 vars in 1198 bytes} [Fri Sep 16 12:54:19 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 12:54:19.641460 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0661e896-4d3d-4d68-9f5d-21573591e8a5 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.147"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:19.644746 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0661e896-4d3d-4d68-9f5d-21573591e8a5 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 5c161179-0b93-4676-86f7-2f507a3ebeb3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:19.659967 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0661e896-4d3d-4d68-9f5d-21573591e8a5 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:19.660823 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0661e896-4d3d-4d68-9f5d-21573591e8a5 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:19.661477 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0661e896-4d3d-4d68-9f5d-21573591e8a5 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:19.662479 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0661e896-4d3d-4d68-9f5d-21573591e8a5 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:19.663102 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0661e896-4d3d-4d68-9f5d-21573591e8a5 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:19.663712 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0661e896-4d3d-4d68-9f5d-21573591e8a5 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:19.704577 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0661e896-4d3d-4d68-9f5d-21573591e8a5 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "refresh_cache-5c161179-0b93-4676-86f7-2f507a3ebeb3" {{(pid=128780) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 16 12:54:19.707492 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0661e896-4d3d-4d68-9f5d-21573591e8a5 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquired lock "refresh_cache-5c161179-0b93-4676-86f7-2f507a3ebeb3" {{(pid=128780) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 16 12:54:19.883366 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-76032c8a-dff9-4047-868a-5d5f0d88d102 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a6e736e1d3417cafc9c42a60693be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101be406faff40d9a001aa76e5f3a19e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:19.894860 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-76032c8a-dff9-4047-868a-5d5f0d88d102 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] 10.222.0.67 "GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0" status: 200 len: 1314 microversion: 2.1 time: 0.371622 Sep 16 12:54:19.915715 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1117/2138] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:19 2022] GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0 => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:19.921180 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-de7e726f-c93a-4ae8-96b4-8f4271d6ce52 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] Action: 'create', calling method: .version_select at 0x7f1035195c10>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1101904772", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:19.941926 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-de7e726f-c93a-4ae8-96b4-8f4271d6ce52 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] Getting quotas for project 1ee866793a574d59aa08ba65c114f1a5. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:54:19.952784 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-de7e726f-c93a-4ae8-96b4-8f4271d6ce52 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] Getting quotas for user 534bd13a2dd9471fa366bd0b0b78e50a and project 1ee866793a574d59aa08ba65c114f1a5. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:54:19.997584 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-de7e726f-c93a-4ae8-96b4-8f4271d6ce52 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-de7e726f-c93a-4ae8-96b4-8f4271d6ce52 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] Request method failure captured: Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 118 Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHH260JCnB1nlxV7nJ_KalNXPmI9E8-1oM2z0K5oyn3Hf7d_cSdQSIIZ7EUGZ9CTv5DTGv2xWJJOTZ9h4giYPLWkkngiutSliFrjQKVn8PwC35lZk02MBzPhMariYswbYVbkUBLQyeiSZyyD9w2CzB5vrhcCDjmFZwmUsG3ccNP3JH8 Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 1ee866793a574d59aa08ba65c114f1a5 Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-170841773 Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1ee866793a574d59aa08ba65c114f1a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1ee866793a574d59aa08ba65c114f1a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1ee866793a574d59aa08ba65c114f1a5", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1ee866793a574d59aa08ba65c114f1a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-KeyPairsNegativeTestJSON-170841773 Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 1ee866793a574d59aa08ba65c114f1a5 Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-170841773 Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-KeyPairsNegativeTestJSON-170841773-project Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 534bd13a2dd9471fa366bd0b0b78e50a Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-KeyPairsNegativeTestJSON-170841773-project Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1101904772", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: exception: Keypair data is invalid: failed to generate fingerprint Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1101904772', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 16 12:54:20.005110 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 16 12:54:20.011645 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 16 12:54:20.011645 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 16 12:54:20.011645 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 16 12:54:20.011645 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:20.011645 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:54:20.011645 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:20.011645 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:20.011645 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:54:20.011645 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:54:20.011645 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:54:20.011645 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:54:20.011645 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:54:20.011645 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:54:20.011645 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:54:20.011645 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:54:20.011645 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:54:20.011645 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:54:20.011645 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:54:20.011645 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:54:20.011645 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 16 12:54:20.011645 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 16 12:54:20.011645 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 16 12:54:20.011645 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 16 12:54:20.011645 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 16 12:54:20.011645 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:20.011645 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:54:20.011645 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:20.011645 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:20.011645 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:54:20.011645 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:54:20.011645 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:54:20.011645 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:54:20.011645 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 16 12:54:20.011645 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:20.016227 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-de7e726f-c93a-4ae8-96b4-8f4271d6ce52 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:54:20.017033 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-de7e726f-c93a-4ae8-96b4-8f4271d6ce52 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.099742 Sep 16 12:54:20.023201 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1118/2139] 10.222.0.67 () {60 vars in 1159 bytes} [Fri Sep 16 12:54:19 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 16 12:54:20.038216 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9f53dffb-8c2c-489d-b1a3-37d6c51ad487 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f10351bd160>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:20.112870 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9f53dffb-8c2c-489d-b1a3-37d6c51ad487 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/991a3348-5f7a-42cc-8d4f-71f5840a425f" status: 200 len: 1453 microversion: 2.1 time: 0.086736 Sep 16 12:54:20.113751 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1119/2140] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:54:20 2022] GET /compute/v2.1/images/991a3348-5f7a-42cc-8d4f-71f5840a425f => generated 1453 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:20.371119 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1ee4e565-e18a-4f3c-9b28-cb8ed1fdc56b tempest-ServicesAdminNegativeTestJSON-563836445 tempest-ServicesAdminNegativeTestJSON-563836445-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:20.375387 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1ee4e565-e18a-4f3c-9b28-cb8ed1fdc56b tempest-ServicesAdminNegativeTestJSON-563836445 tempest-ServicesAdminNegativeTestJSON-563836445-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '995c10cf6bd84fecb8515b6b2329ab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7257ee949a2648988cdf0147a3e18619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1ee4e565-e18a-4f3c-9b28-cb8ed1fdc56b tempest-ServicesAdminNegativeTestJSON-563836445 tempest-ServicesAdminNegativeTestJSON-563836445-project] Request method failure captured: Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHH3ZyzLHOY-rVzZ783b4UAGZrTXgB_sSzPz3P06IsajJ9pYagOoi26QAPZ1OW07f77Q52xq6Sf8fGLLgxyNXLkQH0fGLwEwUIVmyAYCysTiy7H6CxIB-tFX4Y6dRNe2_BGY3fSEsMo3QJI0ECQLWhBjDoTccRXMWGYoFOOoDz8Ii4E Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 7257ee949a2648988cdf0147a3e18619 Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-563836445 Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7257ee949a2648988cdf0147a3e18619"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7257ee949a2648988cdf0147a3e18619"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7257ee949a2648988cdf0147a3e18619", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7257ee949a2648988cdf0147a3e18619"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-563836445 Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 7257ee949a2648988cdf0147a3e18619 Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-563836445 Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ServicesAdminNegativeTestJSON-563836445-project Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 995c10cf6bd84fecb8515b6b2329ab0b Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-563836445-project Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: action_args: {} Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 16 12:54:20.378114 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:20.384483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:54:20.384483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:20.384483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:20.384483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:54:20.384483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:54:20.384483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 12:54:20.384483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 12:54:20.384483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 16 12:54:20.384483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:20.387992 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1ee4e565-e18a-4f3c-9b28-cb8ed1fdc56b tempest-ServicesAdminNegativeTestJSON-563836445 tempest-ServicesAdminNegativeTestJSON-563836445-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:54:20.389646 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1ee4e565-e18a-4f3c-9b28-cb8ed1fdc56b tempest-ServicesAdminNegativeTestJSON-563836445 tempest-ServicesAdminNegativeTestJSON-563836445-project] 10.222.0.67 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.274245 Sep 16 12:54:20.391421 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1120/2141] 10.222.0.67 () {58 vars in 1137 bytes} [Fri Sep 16 12:54:20 2022] GET /compute/v2.1/os-services => generated 112 bytes in 277 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:54:20.410411 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bafd6974-ebca-4858-898c-ae62d00d3766 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] Calling method '.version_select at 0x7f10351bdaf0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:20.430495 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=4 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:54:20.433353 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-bafd6974-ebca-4858-898c-ae62d00d3766 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-535107894 not found for user 534bd13a2dd9471fa366bd0b0b78e50a Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bafd6974-ebca-4858-898c-ae62d00d3766 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] Request method failure captured: Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-535107894 HTTP/1.1 Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHH260JCnB1nlxV7nJ_KalNXPmI9E8-1oM2z0K5oyn3Hf7d_cSdQSIIZ7EUGZ9CTv5DTGv2xWJJOTZ9h4giYPLWkkngiutSliFrjQKVn8PwC35lZk02MBzPhMariYswbYVbkUBLQyeiSZyyD9w2CzB5vrhcCDjmFZwmUsG3ccNP3JH8 Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 1ee866793a574d59aa08ba65c114f1a5 Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-170841773 Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1ee866793a574d59aa08ba65c114f1a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1ee866793a574d59aa08ba65c114f1a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1ee866793a574d59aa08ba65c114f1a5", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1ee866793a574d59aa08ba65c114f1a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-KeyPairsNegativeTestJSON-170841773 Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 1ee866793a574d59aa08ba65c114f1a5 Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-170841773 Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-KeyPairsNegativeTestJSON-170841773-project Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 534bd13a2dd9471fa366bd0b0b78e50a Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-KeyPairsNegativeTestJSON-170841773-project Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: exception: Keypair tempest-keypair-non-existent-535107894 not found for user 534bd13a2dd9471fa366bd0b0b78e50a Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': 'tempest-keypair-non-existent-535107894'} Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-535107894 not found for user 534bd13a2dd9471fa366bd0b0b78e50a Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:20.436012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:54:20.442246 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:20.442246 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:20.442246 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:54:20.442246 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:54:20.442246 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:54:20.442246 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:54:20.442246 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:54:20.442246 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:54:20.442246 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 12:54:20.442246 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:54:20.442246 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:54:20.442246 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:54:20.442246 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Sep 16 12:54:20.442246 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req, id) Sep 16 12:54:20.442246 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Sep 16 12:54:20.442246 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Sep 16 12:54:20.442246 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-535107894 not found for user 534bd13a2dd9471fa366bd0b0b78e50a Sep 16 12:54:20.442246 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:20.442246 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:54:20.442246 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:20.442246 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:20.442246 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:54:20.442246 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:54:20.442246 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:54:20.442246 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:54:20.442246 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-535107894 not found for user 534bd13a2dd9471fa366bd0b0b78e50a Sep 16 12:54:20.442246 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:20.446903 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bafd6974-ebca-4858-898c-ae62d00d3766 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] Returning 404 to user: Keypair tempest-keypair-non-existent-535107894 not found for user 534bd13a2dd9471fa366bd0b0b78e50a {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:54:20.449324 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bafd6974-ebca-4858-898c-ae62d00d3766 tempest-KeyPairsNegativeTestJSON-170841773 tempest-KeyPairsNegativeTestJSON-170841773-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-535107894" status: 404 len: 144 microversion: 2.1 time: 0.056631 Sep 16 12:54:20.450447 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1121/2142] 10.222.0.67 () {58 vars in 1257 bytes} [Fri Sep 16 12:54:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-535107894 => generated 144 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:54:20.472269 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1c709408-219b-4a01-8c94-1b8ed37e334f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:20.484614 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1c709408-219b-4a01-8c94-1b8ed37e334f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:20.499109 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c709408-219b-4a01-8c94-1b8ed37e334f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:20.499618 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c709408-219b-4a01-8c94-1b8ed37e334f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:20.502772 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c709408-219b-4a01-8c94-1b8ed37e334f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:20.505374 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c709408-219b-4a01-8c94-1b8ed37e334f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:20.505855 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c709408-219b-4a01-8c94-1b8ed37e334f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:20.506289 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c709408-219b-4a01-8c94-1b8ed37e334f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:20.943949 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1c709408-219b-4a01-8c94-1b8ed37e334f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:20.957721 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1c709408-219b-4a01-8c94-1b8ed37e334f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1393 microversion: 2.1 time: 0.505932 Sep 16 12:54:20.958689 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1122/2143] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:20 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1393 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:20.970010 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d9421de4-0395-455c-a98c-a3a419737917 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:20.972896 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d9421de4-0395-455c-a98c-a3a419737917 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] [instance: dd721f2f-0f2f-4315-b101-d8140c7d94a0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:20.989119 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9421de4-0395-455c-a98c-a3a419737917 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:20.989621 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9421de4-0395-455c-a98c-a3a419737917 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:20.990063 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9421de4-0395-455c-a98c-a3a419737917 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:20.992015 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9421de4-0395-455c-a98c-a3a419737917 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:20.992675 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9421de4-0395-455c-a98c-a3a419737917 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:20.993120 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9421de4-0395-455c-a98c-a3a419737917 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:21.942217 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d9421de4-0395-455c-a98c-a3a419737917 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a6e736e1d3417cafc9c42a60693be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101be406faff40d9a001aa76e5f3a19e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:21.952208 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d9421de4-0395-455c-a98c-a3a419737917 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] 10.222.0.67 "GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0" status: 200 len: 1314 microversion: 2.1 time: 0.990172 Sep 16 12:54:21.953349 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1123/2144] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:20 2022] GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0 => generated 1314 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:21.959172 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-512746e4-19ae-4080-9be7-a3a029574ecf tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f10353b3ca0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:22.018612 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-512746e4-19ae-4080-9be7-a3a029574ecf tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/991a3348-5f7a-42cc-8d4f-71f5840a425f" status: 200 len: 1453 microversion: 2.1 time: 0.063852 Sep 16 12:54:22.020964 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1124/2145] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:54:21 2022] GET /compute/v2.1/images/991a3348-5f7a-42cc-8d4f-71f5840a425f => generated 1453 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:22.026977 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e931874c-7505-4a33-8c5c-ba225e6fdb0b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:22.027751 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e931874c-7505-4a33-8c5c-ba225e6fdb0b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:22.039744 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e931874c-7505-4a33-8c5c-ba225e6fdb0b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:22.048076 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e931874c-7505-4a33-8c5c-ba225e6fdb0b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:22.048979 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e931874c-7505-4a33-8c5c-ba225e6fdb0b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:22.050569 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e931874c-7505-4a33-8c5c-ba225e6fdb0b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:22.051472 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e931874c-7505-4a33-8c5c-ba225e6fdb0b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:22.052089 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e931874c-7505-4a33-8c5c-ba225e6fdb0b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:22.088487 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e931874c-7505-4a33-8c5c-ba225e6fdb0b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88/ips" status: 200 len: 147 microversion: 2.1 time: 0.065952 Sep 16 12:54:22.096258 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1125/2146] 10.222.0.67 () {58 vars in 1248 bytes} [Fri Sep 16 12:54:22 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88/ips => generated 147 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:54:22.103687 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4b13bada-681b-4811-8d27-1072a8f15315 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:22.104654 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4b13bada-681b-4811-8d27-1072a8f15315 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:22.111533 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b13bada-681b-4811-8d27-1072a8f15315 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:22.112736 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b13bada-681b-4811-8d27-1072a8f15315 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:22.113405 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b13bada-681b-4811-8d27-1072a8f15315 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:22.114834 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b13bada-681b-4811-8d27-1072a8f15315 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:22.115508 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b13bada-681b-4811-8d27-1072a8f15315 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:22.116163 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b13bada-681b-4811-8d27-1072a8f15315 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:22.358435 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4b13bada-681b-4811-8d27-1072a8f15315 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:22.370545 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4b13bada-681b-4811-8d27-1072a8f15315 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1393 microversion: 2.1 time: 0.272293 Sep 16 12:54:22.381776 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1126/2147] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:22 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1393 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:22.671888 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-2db42dfe-7145-4db4-8e14-a9ad5b099d2d req-bf33e7e9-a5a3-4106-8de8-ffce24683d03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "227a8a0b-2a0c-48f8-976a-a176a9039a2d", "name": "network-vif-deleted", "tag": "586b7cfc-f67a-48f3-beb9-5cd2ca16334c"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:22.732507 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2db42dfe-7145-4db4-8e14-a9ad5b099d2d req-bf33e7e9-a5a3-4106-8de8-ffce24683d03 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:22.734328 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2db42dfe-7145-4db4-8e14-a9ad5b099d2d req-bf33e7e9-a5a3-4106-8de8-ffce24683d03 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:22.735114 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2db42dfe-7145-4db4-8e14-a9ad5b099d2d req-bf33e7e9-a5a3-4106-8de8-ffce24683d03 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:22.763623 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-2db42dfe-7145-4db4-8e14-a9ad5b099d2d req-bf33e7e9-a5a3-4106-8de8-ffce24683d03 service nova] Creating event network-vif-deleted:586b7cfc-f67a-48f3-beb9-5cd2ca16334c for instance 227a8a0b-2a0c-48f8-976a-a176a9039a2d on n-h2-858094-4 Sep 16 12:54:22.777085 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-2db42dfe-7145-4db4-8e14-a9ad5b099d2d req-bf33e7e9-a5a3-4106-8de8-ffce24683d03 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113246 Sep 16 12:54:22.790811 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1127/2148] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:54:22.987745 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5ddfafaf-1c6d-4e4f-8775-57583437e375 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:22.988963 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5ddfafaf-1c6d-4e4f-8775-57583437e375 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] [instance: dd721f2f-0f2f-4315-b101-d8140c7d94a0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:23.009056 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ddfafaf-1c6d-4e4f-8775-57583437e375 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:23.015102 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ddfafaf-1c6d-4e4f-8775-57583437e375 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:23.017638 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ddfafaf-1c6d-4e4f-8775-57583437e375 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:23.019769 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ddfafaf-1c6d-4e4f-8775-57583437e375 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:23.021309 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ddfafaf-1c6d-4e4f-8775-57583437e375 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:23.025477 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ddfafaf-1c6d-4e4f-8775-57583437e375 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:23.487185 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5ddfafaf-1c6d-4e4f-8775-57583437e375 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a6e736e1d3417cafc9c42a60693be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101be406faff40d9a001aa76e5f3a19e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:23.499122 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5ddfafaf-1c6d-4e4f-8775-57583437e375 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] 10.222.0.67 "GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0" status: 200 len: 1314 microversion: 2.1 time: 0.524017 Sep 16 12:54:23.512146 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1128/2149] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:22 2022] GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0 => generated 1314 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:23.512146 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-26c71d1a-8419-48b1-ab7a-fc0d6daf39c9 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f103514f700>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:23.541779 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-0661e896-4d3d-4d68-9f5d-21573591e8a5 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 5c161179-0b93-4676-86f7-2f507a3ebeb3] Building network info cache for instance {{(pid=128780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 16 12:54:23.670438 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-26c71d1a-8419-48b1-ab7a-fc0d6daf39c9 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/991a3348-5f7a-42cc-8d4f-71f5840a425f" status: 200 len: 1453 microversion: 2.1 time: 0.160344 Sep 16 12:54:23.671088 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1129/2150] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:54:23 2022] GET /compute/v2.1/images/991a3348-5f7a-42cc-8d4f-71f5840a425f => generated 1453 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:23.687560 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0e804f07-965e-4867-b16f-32644dcd780e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:23.688208 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0e804f07-965e-4867-b16f-32644dcd780e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:23.736004 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e804f07-965e-4867-b16f-32644dcd780e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:23.736535 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e804f07-965e-4867-b16f-32644dcd780e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:23.736973 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e804f07-965e-4867-b16f-32644dcd780e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:23.737725 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e804f07-965e-4867-b16f-32644dcd780e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:23.738183 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e804f07-965e-4867-b16f-32644dcd780e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:23.738773 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e804f07-965e-4867-b16f-32644dcd780e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:24.365285 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0e804f07-965e-4867-b16f-32644dcd780e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:24.386419 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0e804f07-965e-4867-b16f-32644dcd780e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1393 microversion: 2.1 time: 0.714242 Sep 16 12:54:24.391707 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1130/2151] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:23 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1393 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:24.398249 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-ae2e0146-c641-4eee-8499-3aa9a0219f7d req-136d39a7-c891-4d3b-ae49-9ad9cfd7f6b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c161179-0b93-4676-86f7-2f507a3ebeb3", "tag": "d5a5f978-c5f0-4476-91cc-2b79e48ec4a7"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:24.443586 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ae2e0146-c641-4eee-8499-3aa9a0219f7d req-136d39a7-c891-4d3b-ae49-9ad9cfd7f6b1 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:24.445145 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ae2e0146-c641-4eee-8499-3aa9a0219f7d req-136d39a7-c891-4d3b-ae49-9ad9cfd7f6b1 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:24.446330 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ae2e0146-c641-4eee-8499-3aa9a0219f7d req-136d39a7-c891-4d3b-ae49-9ad9cfd7f6b1 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:24.466579 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-ae2e0146-c641-4eee-8499-3aa9a0219f7d req-136d39a7-c891-4d3b-ae49-9ad9cfd7f6b1 service nova] Creating event network-changed:d5a5f978-c5f0-4476-91cc-2b79e48ec4a7 for instance 5c161179-0b93-4676-86f7-2f507a3ebeb3 on n-h1-858094-4 Sep 16 12:54:24.474974 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-ae2e0146-c641-4eee-8499-3aa9a0219f7d req-136d39a7-c891-4d3b-ae49-9ad9cfd7f6b1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080012 Sep 16 12:54:24.476797 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1131/2152] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:54:24.530745 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a7700878-4c52-4c82-b183-603ddfa0773c tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:24.534446 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a7700878-4c52-4c82-b183-603ddfa0773c tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] [instance: dd721f2f-0f2f-4315-b101-d8140c7d94a0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:24.561687 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7700878-4c52-4c82-b183-603ddfa0773c tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:24.564626 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7700878-4c52-4c82-b183-603ddfa0773c tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:24.565096 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7700878-4c52-4c82-b183-603ddfa0773c tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:24.568116 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7700878-4c52-4c82-b183-603ddfa0773c tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:24.570893 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7700878-4c52-4c82-b183-603ddfa0773c tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:24.571276 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7700878-4c52-4c82-b183-603ddfa0773c tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:25.239295 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-0661e896-4d3d-4d68-9f5d-21573591e8a5 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 5c161179-0b93-4676-86f7-2f507a3ebeb3] Updating instance_info_cache with network_info: [{"id": "d5a5f978-c5f0-4476-91cc-2b79e48ec4a7", "address": "fa:16:3e:43:b5:d4", "network": {"id": "2a6f5c27-4e22-4940-b2ce-5570b20e4dba", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1692283097-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1e41136645964ea98a675833bd73299f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd5a5f978-c5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 16 12:54:25.257182 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0661e896-4d3d-4d68-9f5d-21573591e8a5 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Releasing lock "refresh_cache-5c161179-0b93-4676-86f7-2f507a3ebeb3" {{(pid=128780) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 16 12:54:25.258079 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0661e896-4d3d-4d68-9f5d-21573591e8a5 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "POST /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3/action" status: 202 len: 0 microversion: 2.1 time: 5.620795 Sep 16 12:54:25.262006 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1022/2153] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:54:19 2022] POST /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3/action => generated 0 bytes in 5625 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 16 12:54:25.266896 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2ed31521-f5df-4353-9638-5acbaefb8460 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f1035eeec10>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:25.341767 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a7700878-4c52-4c82-b183-603ddfa0773c tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a6e736e1d3417cafc9c42a60693be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101be406faff40d9a001aa76e5f3a19e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:25.352349 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2ed31521-f5df-4353-9638-5acbaefb8460 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/991a3348-5f7a-42cc-8d4f-71f5840a425f" status: 200 len: 1453 microversion: 2.1 time: 0.089131 Sep 16 12:54:25.363624 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1023/2154] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:54:25 2022] GET /compute/v2.1/images/991a3348-5f7a-42cc-8d4f-71f5840a425f => generated 1453 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:25.365641 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a7700878-4c52-4c82-b183-603ddfa0773c tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] 10.222.0.67 "GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0" status: 200 len: 1314 microversion: 2.1 time: 0.841185 Sep 16 12:54:25.376828 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1132/2155] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:24 2022] GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0 => generated 1314 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:54:25.378655 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-8513a5af-fdc9-4d52-8ad6-0455b0ef9da3 req-3c06931c-40c7-4968-af0f-4a286a57b09e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd721f2f-0f2f-4315-b101-d8140c7d94a0", "name": "network-vif-plugged", "status": "completed", "tag": "ee76b399-9246-48fa-9c23-18309e9b0a92"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:25.378655 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:54:25.383725 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d3beaf16-53d9-4fb8-b3cb-2903a542db32 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Calling method '.version_select at 0x7f103558ed30>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:25.446149 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-8513a5af-fdc9-4d52-8ad6-0455b0ef9da3 req-3c06931c-40c7-4968-af0f-4a286a57b09e service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:25.447713 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-8513a5af-fdc9-4d52-8ad6-0455b0ef9da3 req-3c06931c-40c7-4968-af0f-4a286a57b09e service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:25.451197 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-8513a5af-fdc9-4d52-8ad6-0455b0ef9da3 req-3c06931c-40c7-4968-af0f-4a286a57b09e service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:25.489184 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-8513a5af-fdc9-4d52-8ad6-0455b0ef9da3 req-3c06931c-40c7-4968-af0f-4a286a57b09e service nova] Creating event network-vif-plugged:ee76b399-9246-48fa-9c23-18309e9b0a92 for instance dd721f2f-0f2f-4315-b101-d8140c7d94a0 on n-h1-858094-4 Sep 16 12:54:25.502872 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-8513a5af-fdc9-4d52-8ad6-0455b0ef9da3 req-3c06931c-40c7-4968-af0f-4a286a57b09e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136859 Sep 16 12:54:25.511340 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1024/2156] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:54:25.533475 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-77e2bb78-0a7b-4407-963c-f0beb50f5dd9 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:25.535947 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-77e2bb78-0a7b-4407-963c-f0beb50f5dd9 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:25.560625 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-77e2bb78-0a7b-4407-963c-f0beb50f5dd9 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:25.561148 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-77e2bb78-0a7b-4407-963c-f0beb50f5dd9 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:25.565143 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-77e2bb78-0a7b-4407-963c-f0beb50f5dd9 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:25.567275 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-77e2bb78-0a7b-4407-963c-f0beb50f5dd9 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:25.569928 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-77e2bb78-0a7b-4407-963c-f0beb50f5dd9 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:25.572447 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-77e2bb78-0a7b-4407-963c-f0beb50f5dd9 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:26.142851 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-77e2bb78-0a7b-4407-963c-f0beb50f5dd9 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:26.166793 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-77e2bb78-0a7b-4407-963c-f0beb50f5dd9 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1393 microversion: 2.1 time: 0.650622 Sep 16 12:54:26.185330 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1025/2157] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:25 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1393 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:26.372830 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ded847ee-7e79-4d61-b38f-66ca2d76fef3 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f1035ee3af0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:26.522544 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ded847ee-7e79-4d61-b38f-66ca2d76fef3 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/991a3348-5f7a-42cc-8d4f-71f5840a425f" status: 200 len: 1453 microversion: 2.1 time: 0.154947 Sep 16 12:54:26.531804 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1026/2158] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:54:26 2022] GET /compute/v2.1/images/991a3348-5f7a-42cc-8d4f-71f5840a425f => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:26.571223 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4b3351d1-a273-4937-a45d-a90a55f7150b tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:26.579611 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-4b3351d1-a273-4937-a45d-a90a55f7150b tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] [instance: dd721f2f-0f2f-4315-b101-d8140c7d94a0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:26.600200 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4b3351d1-a273-4937-a45d-a90a55f7150b tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:26.614703 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d3beaf16-53d9-4fb8-b3cb-2903a542db32 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "GET /compute/v2.1/os-floating-ips/6257e01b-c989-43a0-afca-8c210713ffa3" status: 200 len: 185 microversion: 2.1 time: 1.243355 Sep 16 12:54:26.616433 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1133/2159] 10.222.0.67 () {58 vars in 1260 bytes} [Fri Sep 16 12:54:25 2022] GET /compute/v2.1/os-floating-ips/6257e01b-c989-43a0-afca-8c210713ffa3 => generated 185 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:54:26.620966 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4b3351d1-a273-4937-a45d-a90a55f7150b tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:26.621515 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4b3351d1-a273-4937-a45d-a90a55f7150b tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:26.622282 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4b3351d1-a273-4937-a45d-a90a55f7150b tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:26.622756 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4b3351d1-a273-4937-a45d-a90a55f7150b tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:26.623188 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4b3351d1-a273-4937-a45d-a90a55f7150b tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:26.630943 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1fd5dc96-d9ee-469f-9d98-53a40a72c587 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Action: 'action', calling method: .version_select at 0x7f1037ead820>, body: {"removeFloatingIp": {"address": "172.25.2.147"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:27.158379 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4b3351d1-a273-4937-a45d-a90a55f7150b tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a6e736e1d3417cafc9c42a60693be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101be406faff40d9a001aa76e5f3a19e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:27.171690 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4b3351d1-a273-4937-a45d-a90a55f7150b tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] 10.222.0.67 "GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0" status: 200 len: 1314 microversion: 2.1 time: 0.639318 Sep 16 12:54:27.172325 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1027/2160] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:26 2022] GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0 => generated 1314 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:27.201168 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ce44ef07-60de-4b98-824d-4ce96d29bff7 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb60e29d-4ea1-43df-a4be-d22834c80ee8"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:27.204156 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ce44ef07-60de-4b98-824d-4ce96d29bff7 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:27.212639 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce44ef07-60de-4b98-824d-4ce96d29bff7 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:27.213534 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce44ef07-60de-4b98-824d-4ce96d29bff7 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:27.214207 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce44ef07-60de-4b98-824d-4ce96d29bff7 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:27.215206 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce44ef07-60de-4b98-824d-4ce96d29bff7 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:27.215953 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce44ef07-60de-4b98-824d-4ce96d29bff7 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:27.216703 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce44ef07-60de-4b98-824d-4ce96d29bff7 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:27.255428 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1fd5dc96-d9ee-469f-9d98-53a40a72c587 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 5c161179-0b93-4676-86f7-2f507a3ebeb3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:27.265410 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1fd5dc96-d9ee-469f-9d98-53a40a72c587 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:27.266557 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1fd5dc96-d9ee-469f-9d98-53a40a72c587 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:27.267008 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1fd5dc96-d9ee-469f-9d98-53a40a72c587 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:27.267748 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1fd5dc96-d9ee-469f-9d98-53a40a72c587 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:27.268245 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1fd5dc96-d9ee-469f-9d98-53a40a72c587 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:27.268966 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1fd5dc96-d9ee-469f-9d98-53a40a72c587 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:27.555904 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1fd5dc96-d9ee-469f-9d98-53a40a72c587 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "refresh_cache-5c161179-0b93-4676-86f7-2f507a3ebeb3" {{(pid=128779) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 16 12:54:27.556344 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1fd5dc96-d9ee-469f-9d98-53a40a72c587 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquired lock "refresh_cache-5c161179-0b93-4676-86f7-2f507a3ebeb3" {{(pid=128779) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 16 12:54:27.625791 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ce44ef07-60de-4b98-824d-4ce96d29bff7 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "POST /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.436702 Sep 16 12:54:27.634843 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1028/2161] 10.222.0.67 () {60 vars in 1323 bytes} [Fri Sep 16 12:54:27 2022] POST /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88/os-volume_attachments => generated 194 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:54:28.007329 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-de66a511-c5d5-453f-bab0-73e4e95e05c7 tempest-TenantUsagesNegativeTestJSON-1587452395 tempest-TenantUsagesNegativeTestJSON-1587452395-project-admin] 10.222.0.67 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-15T12%3A54%3A27.015389&end=2022-09-17T12%3A54%3A27.015389" status: 404 len: 112 microversion: - time: 0.369571 Sep 16 12:54:28.007871 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1029/2162] 10.222.0.67 () {58 vars in 1316 bytes} [Fri Sep 16 12:54:27 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-15T12%3A54%3A27.015389&end=2022-09-17T12%3A54%3A27.015389 => generated 112 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 16 12:54:28.023989 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7a731573-0daa-48e7-a498-8330245e1f9e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:28.026148 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7a731573-0daa-48e7-a498-8330245e1f9e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:28.049710 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7a731573-0daa-48e7-a498-8330245e1f9e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:28.050211 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7a731573-0daa-48e7-a498-8330245e1f9e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:28.051818 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7a731573-0daa-48e7-a498-8330245e1f9e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:28.055554 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7a731573-0daa-48e7-a498-8330245e1f9e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:28.056417 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7a731573-0daa-48e7-a498-8330245e1f9e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:28.057093 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7a731573-0daa-48e7-a498-8330245e1f9e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:28.701290 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7a731573-0daa-48e7-a498-8330245e1f9e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:28.721444 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7a731573-0daa-48e7-a498-8330245e1f9e tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1393 microversion: 2.1 time: 0.712194 Sep 16 12:54:28.722070 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1030/2163] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:28 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1393 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:28.729589 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-245a6ffe-69f3-4123-b578-5031b2224e8d tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f1035afd160>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:28.819597 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-245a6ffe-69f3-4123-b578-5031b2224e8d tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/991a3348-5f7a-42cc-8d4f-71f5840a425f" status: 200 len: 1453 microversion: 2.1 time: 0.095079 Sep 16 12:54:28.819597 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1031/2164] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:54:28 2022] GET /compute/v2.1/images/991a3348-5f7a-42cc-8d4f-71f5840a425f => generated 1453 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:28.839779 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ed741306-a575-4f57-bc44-ad7bba45be26 tempest-TenantUsagesNegativeTestJSON-1587452395 tempest-TenantUsagesNegativeTestJSON-1587452395-project-admin] Calling method '.version_select at 0x7f1035ee65e0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:28.846341 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-ed741306-a575-4f57-bc44-ad7bba45be26 tempest-TenantUsagesNegativeTestJSON-1587452395 tempest-TenantUsagesNegativeTestJSON-1587452395-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ed741306-a575-4f57-bc44-ad7bba45be26 tempest-TenantUsagesNegativeTestJSON-1587452395 tempest-TenantUsagesNegativeTestJSON-1587452395-project-admin] Request method failure captured: Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/os-simple-tenant-usage/0f6ff900a0814e33b685c5ef2d2b5467?start=2022-09-17T12%3A54%3A27.015389&end=2022-09-15T12%3A54%3A27.015389 HTTP/1.1 Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHICeGdEl9BwF6y38sjQx_czXpzyyZ0fKOOiwpNMaId0DG_f16OM2y-O3veGC_meHeNnTwQmi5iliAN4KuDPTio7jzBX6GgaC5tpeEn87VAhM-06MYMc1bDEUulFTlI-PD828l6JlComH3XGycTjdcO87FIxqtvDWc9hyfUyiGTJTr8 Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: fb86c654f2174f2fb273df5882df281f Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1587452395 Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,admin,reader Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,admin,reader Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fb86c654f2174f2fb273df5882df281f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/fb86c654f2174f2fb273df5882df281f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_fb86c654f2174f2fb273df5882df281f", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fb86c654f2174f2fb273df5882df281f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1587452395 Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: fb86c654f2174f2fb273df5882df281f Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1587452395 Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-TenantUsagesNegativeTestJSON-1587452395-project-admin Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 02fb510cfd29477ea6c4fa2ff90403ee Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1587452395-project-admin Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: exception: Invalid start time. The start time cannot occur after the end time. Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '0f6ff900a0814e33b685c5ef2d2b5467'} Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Sep 16 12:54:28.863101 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:54:28.871094 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ed741306-a575-4f57-bc44-ad7bba45be26 tempest-TenantUsagesNegativeTestJSON-1587452395 tempest-TenantUsagesNegativeTestJSON-1587452395-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:54:28.871955 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ed741306-a575-4f57-bc44-ad7bba45be26 tempest-TenantUsagesNegativeTestJSON-1587452395 tempest-TenantUsagesNegativeTestJSON-1587452395-project-admin] 10.222.0.67 "GET /compute/v2.1/os-simple-tenant-usage/0f6ff900a0814e33b685c5ef2d2b5467?start=2022-09-17T12%3A54%3A27.015389&end=2022-09-15T12%3A54%3A27.015389" status: 400 len: 111 microversion: 2.1 time: 0.052166 Sep 16 12:54:28.875174 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1032/2165] 10.222.0.67 () {58 vars in 1412 bytes} [Fri Sep 16 12:54:28 2022] GET /compute/v2.1/os-simple-tenant-usage/0f6ff900a0814e33b685c5ef2d2b5467?start=2022-09-17T12%3A54%3A27.015389&end=2022-09-15T12%3A54%3A27.015389 => generated 111 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 12:54:28.893753 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-60d49254-5c95-413d-b404-54e59735aa25 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:28.894718 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-60d49254-5c95-413d-b404-54e59735aa25 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] [instance: dd721f2f-0f2f-4315-b101-d8140c7d94a0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:28.926940 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-60d49254-5c95-413d-b404-54e59735aa25 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:28.934461 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-60d49254-5c95-413d-b404-54e59735aa25 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:28.935129 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-60d49254-5c95-413d-b404-54e59735aa25 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:28.936016 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-60d49254-5c95-413d-b404-54e59735aa25 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:28.936664 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-60d49254-5c95-413d-b404-54e59735aa25 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:28.937235 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-60d49254-5c95-413d-b404-54e59735aa25 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:29.438243 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=21 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:54:29.567705 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=4 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:54:29.712695 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-60d49254-5c95-413d-b404-54e59735aa25 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a6e736e1d3417cafc9c42a60693be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101be406faff40d9a001aa76e5f3a19e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:29.727572 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-60d49254-5c95-413d-b404-54e59735aa25 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] 10.222.0.67 "GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0" status: 200 len: 1314 microversion: 2.1 time: 0.847482 Sep 16 12:54:29.728811 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1033/2166] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:28 2022] GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0 => generated 1314 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:29.968711 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=48 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:54:30.076663 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-32867d1e-3a57-49c9-91de-9cba2891e38a tempest-TenantUsagesNegativeTestJSON-1707705375 tempest-TenantUsagesNegativeTestJSON-1707705375-project] Calling method '.version_select at 0x7f10399fb1f0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:30.082268 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-32867d1e-3a57-49c9-91de-9cba2891e38a tempest-TenantUsagesNegativeTestJSON-1707705375 tempest-TenantUsagesNegativeTestJSON-1707705375-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'c2ce7f11a89b4c18aea5ac20f1032d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6ff900a0814e33b685c5ef2d2b5467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-32867d1e-3a57-49c9-91de-9cba2891e38a tempest-TenantUsagesNegativeTestJSON-1707705375 tempest-TenantUsagesNegativeTestJSON-1707705375-project] Request method failure captured: Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-15T12%3A54%3A27.015389&end=2022-09-17T12%3A54%3A27.015389&detailed=1 HTTP/1.1 Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHIB4mkFda3ItypVRBG_prWW6IJlWrhjHBnElaoKsFXbc2nAQ5yOM8ruHj5_WzI4esYVukpyFFWDfxgDHetAICvoa9suBbTuP7S1z7M045LTVsSYtF05fMJBpWl4qWGugBvMvTbTKrhJU4rTi1H3x8cNNewZlG7vsgD3lQYgElR2g0k Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 0f6ff900a0814e33b685c5ef2d2b5467 Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1707705375 Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0f6ff900a0814e33b685c5ef2d2b5467"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0f6ff900a0814e33b685c5ef2d2b5467"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0f6ff900a0814e33b685c5ef2d2b5467", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0f6ff900a0814e33b685c5ef2d2b5467"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1707705375 Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 0f6ff900a0814e33b685c5ef2d2b5467 Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1707705375 Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-TenantUsagesNegativeTestJSON-1707705375-project Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: c2ce7f11a89b4c18aea5ac20f1032d20 Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1707705375-project Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: action_args: {} Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 12:54:30.088510 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 12:54:30.094218 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 12:54:30.094218 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 16 12:54:30.094218 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:54:30.094218 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:54:30.094218 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:54:30.094218 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:30.094218 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:54:30.094218 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:54:30.094218 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 12:54:30.094218 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 12:54:30.094218 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 16 12:54:30.094218 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:54:30.099134 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-32867d1e-3a57-49c9-91de-9cba2891e38a tempest-TenantUsagesNegativeTestJSON-1707705375 tempest-TenantUsagesNegativeTestJSON-1707705375-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:54:30.100438 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-32867d1e-3a57-49c9-91de-9cba2891e38a tempest-TenantUsagesNegativeTestJSON-1707705375 tempest-TenantUsagesNegativeTestJSON-1707705375-project] 10.222.0.67 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-15T12%3A54%3A27.015389&end=2022-09-17T12%3A54%3A27.015389&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.352492 Sep 16 12:54:30.107846 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1034/2167] 10.222.0.67 () {58 vars in 1335 bytes} [Fri Sep 16 12:54:29 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-15T12%3A54%3A27.015389&end=2022-09-17T12%3A54%3A27.015389&detailed=1 => generated 123 bytes in 378 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:54:30.114139 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-032e1fe4-e17b-43c9-a2e1-15d76d4d1728 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:30.120675 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-032e1fe4-e17b-43c9-a2e1-15d76d4d1728 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:30.154613 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-032e1fe4-e17b-43c9-a2e1-15d76d4d1728 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:30.157591 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-032e1fe4-e17b-43c9-a2e1-15d76d4d1728 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:30.162106 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-032e1fe4-e17b-43c9-a2e1-15d76d4d1728 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:30.172864 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-032e1fe4-e17b-43c9-a2e1-15d76d4d1728 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:30.173594 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-032e1fe4-e17b-43c9-a2e1-15d76d4d1728 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:30.174187 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-032e1fe4-e17b-43c9-a2e1-15d76d4d1728 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:30.803216 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-1fd5dc96-d9ee-469f-9d98-53a40a72c587 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 5c161179-0b93-4676-86f7-2f507a3ebeb3] Building network info cache for instance {{(pid=128779) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 16 12:54:30.813605 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-032e1fe4-e17b-43c9-a2e1-15d76d4d1728 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:30.827220 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-032e1fe4-e17b-43c9-a2e1-15d76d4d1728 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1393 microversion: 2.1 time: 0.717207 Sep 16 12:54:30.855455 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1035/2168] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:30 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1393 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:30.861713 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8a157774-573b-4406-9b71-95d448fb455b tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f1035825160>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:30.990846 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8a157774-573b-4406-9b71-95d448fb455b tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/991a3348-5f7a-42cc-8d4f-71f5840a425f" status: 200 len: 1453 microversion: 2.1 time: 0.133900 Sep 16 12:54:30.995775 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1036/2169] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:54:30 2022] GET /compute/v2.1/images/991a3348-5f7a-42cc-8d4f-71f5840a425f => generated 1453 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:31.011351 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-270e3d5b-60c7-4482-9ed0-e7a0f8ac8517 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:31.017832 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-270e3d5b-60c7-4482-9ed0-e7a0f8ac8517 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] [instance: dd721f2f-0f2f-4315-b101-d8140c7d94a0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:31.055326 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-270e3d5b-60c7-4482-9ed0-e7a0f8ac8517 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:31.055905 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-270e3d5b-60c7-4482-9ed0-e7a0f8ac8517 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:31.056476 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-270e3d5b-60c7-4482-9ed0-e7a0f8ac8517 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:31.057369 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-270e3d5b-60c7-4482-9ed0-e7a0f8ac8517 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:31.058032 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-270e3d5b-60c7-4482-9ed0-e7a0f8ac8517 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:31.058529 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-270e3d5b-60c7-4482-9ed0-e7a0f8ac8517 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:32.177810 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-270e3d5b-60c7-4482-9ed0-e7a0f8ac8517 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a6e736e1d3417cafc9c42a60693be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101be406faff40d9a001aa76e5f3a19e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:32.189848 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-270e3d5b-60c7-4482-9ed0-e7a0f8ac8517 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] 10.222.0.67 "GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0" status: 200 len: 1503 microversion: 2.1 time: 1.192770 Sep 16 12:54:32.195694 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1037/2170] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:30 2022] GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0 => generated 1503 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:32.208699 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-627cb8e2-55cd-49ae-b5a6-1e2de2b97e27 req-77507449-7f95-4e1c-b109-aff512243ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c161179-0b93-4676-86f7-2f507a3ebeb3", "tag": "d5a5f978-c5f0-4476-91cc-2b79e48ec4a7"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:32.233942 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-627cb8e2-55cd-49ae-b5a6-1e2de2b97e27 req-77507449-7f95-4e1c-b109-aff512243ff8 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:32.235045 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-627cb8e2-55cd-49ae-b5a6-1e2de2b97e27 req-77507449-7f95-4e1c-b109-aff512243ff8 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:32.238179 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-627cb8e2-55cd-49ae-b5a6-1e2de2b97e27 req-77507449-7f95-4e1c-b109-aff512243ff8 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:32.268378 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-627cb8e2-55cd-49ae-b5a6-1e2de2b97e27 req-77507449-7f95-4e1c-b109-aff512243ff8 service nova] Creating event network-changed:d5a5f978-c5f0-4476-91cc-2b79e48ec4a7 for instance 5c161179-0b93-4676-86f7-2f507a3ebeb3 on n-h1-858094-4 Sep 16 12:54:32.287451 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-627cb8e2-55cd-49ae-b5a6-1e2de2b97e27 req-77507449-7f95-4e1c-b109-aff512243ff8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090106 Sep 16 12:54:32.288673 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1038/2171] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:54:32.295207 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6df8b128-5f39-4fb4-9b4d-279134d46118 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:32.295910 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6df8b128-5f39-4fb4-9b4d-279134d46118 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:32.312204 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6df8b128-5f39-4fb4-9b4d-279134d46118 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:32.313247 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6df8b128-5f39-4fb4-9b4d-279134d46118 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:32.328836 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6df8b128-5f39-4fb4-9b4d-279134d46118 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:32.329585 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6df8b128-5f39-4fb4-9b4d-279134d46118 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:32.330245 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6df8b128-5f39-4fb4-9b4d-279134d46118 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:32.330680 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6df8b128-5f39-4fb4-9b4d-279134d46118 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:33.179325 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6df8b128-5f39-4fb4-9b4d-279134d46118 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:33.194395 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6df8b128-5f39-4fb4-9b4d-279134d46118 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1393 microversion: 2.1 time: 0.903569 Sep 16 12:54:33.196629 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1039/2172] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:32 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1393 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:33.209825 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-16fa8ec7-f009-471c-8172-217d35dd1a37 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f1036129ca0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:33.284446 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-16fa8ec7-f009-471c-8172-217d35dd1a37 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/991a3348-5f7a-42cc-8d4f-71f5840a425f" status: 200 len: 1462 microversion: 2.1 time: 0.085197 Sep 16 12:54:33.285376 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1040/2173] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:54:33 2022] GET /compute/v2.1/images/991a3348-5f7a-42cc-8d4f-71f5840a425f => generated 1462 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:33.305673 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ace5ed21-be82-4d62-bc86-73777f8949d5 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:33.309115 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ace5ed21-be82-4d62-bc86-73777f8949d5 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] [instance: dd721f2f-0f2f-4315-b101-d8140c7d94a0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:33.322812 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ace5ed21-be82-4d62-bc86-73777f8949d5 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:33.326298 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ace5ed21-be82-4d62-bc86-73777f8949d5 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:33.327155 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ace5ed21-be82-4d62-bc86-73777f8949d5 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:33.334217 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ace5ed21-be82-4d62-bc86-73777f8949d5 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:33.335050 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ace5ed21-be82-4d62-bc86-73777f8949d5 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:33.335672 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ace5ed21-be82-4d62-bc86-73777f8949d5 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:33.410083 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ace5ed21-be82-4d62-bc86-73777f8949d5 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '78a6e736e1d3417cafc9c42a60693be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101be406faff40d9a001aa76e5f3a19e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:33.412663 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ace5ed21-be82-4d62-bc86-73777f8949d5 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] 10.222.0.67 "GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0/os-instance-actions/req-9e9389cf-aaf1-46c4-b35a-338ee16657df" status: 200 len: 313 microversion: 2.1 time: 0.116315 Sep 16 12:54:33.416068 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1041/2174] 10.222.0.67 () {58 vars in 1419 bytes} [Fri Sep 16 12:54:33 2022] GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0/os-instance-actions/req-9e9389cf-aaf1-46c4-b35a-338ee16657df => generated 313 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:54:33.423078 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-960ac69f-51a4-4bcc-a94c-df16de9cb7de tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f10358b6550>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:33.505629 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-960ac69f-51a4-4bcc-a94c-df16de9cb7de tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/991a3348-5f7a-42cc-8d4f-71f5840a425f" status: 200 len: 1462 microversion: 2.1 time: 0.087656 Sep 16 12:54:33.507116 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1042/2175] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:54:33 2022] GET /compute/v2.1/images/991a3348-5f7a-42cc-8d4f-71f5840a425f => generated 1462 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:33.512990 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-74418e46-d8d7-4bd6-acd9-a9698416e070 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:33.517595 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-74418e46-d8d7-4bd6-acd9-a9698416e070 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] [instance: dd721f2f-0f2f-4315-b101-d8140c7d94a0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:33.528429 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-74418e46-d8d7-4bd6-acd9-a9698416e070 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:33.529229 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-74418e46-d8d7-4bd6-acd9-a9698416e070 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:33.539870 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-74418e46-d8d7-4bd6-acd9-a9698416e070 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:33.542706 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-74418e46-d8d7-4bd6-acd9-a9698416e070 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:33.543474 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-74418e46-d8d7-4bd6-acd9-a9698416e070 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:33.544348 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-74418e46-d8d7-4bd6-acd9-a9698416e070 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:33.734712 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-74418e46-d8d7-4bd6-acd9-a9698416e070 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] 10.222.0.67 "POST /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0/action" status: 202 len: 0 microversion: 2.1 time: 0.225741 Sep 16 12:54:33.737217 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1043/2176] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:54:33 2022] POST /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:54:33.766846 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-07995945-430f-4b52-8f53-f22a6facc991 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:33.767752 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-07995945-430f-4b52-8f53-f22a6facc991 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] [instance: c97d5f35-6ea1-4ec7-88f5-9da9dbe81182] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:33.778857 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-07995945-430f-4b52-8f53-f22a6facc991 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:33.779466 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-07995945-430f-4b52-8f53-f22a6facc991 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:33.779970 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-07995945-430f-4b52-8f53-f22a6facc991 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:33.780768 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-07995945-430f-4b52-8f53-f22a6facc991 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:33.781229 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-07995945-430f-4b52-8f53-f22a6facc991 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:33.781658 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-07995945-430f-4b52-8f53-f22a6facc991 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:34.870360 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-07995945-430f-4b52-8f53-f22a6facc991 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63998619bf654ebb8d74f91e42c8c780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e81fca8624d18b9415a46e158d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:34.882753 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-07995945-430f-4b52-8f53-f22a6facc991 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182" status: 200 len: 1466 microversion: 2.1 time: 1.145206 Sep 16 12:54:34.883775 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1044/2177] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:33 2022] GET /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182 => generated 1466 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:34.893861 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a5905155-4e24-458c-985b-01088d5f59a6 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:34.894899 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a5905155-4e24-458c-985b-01088d5f59a6 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] [instance: dd721f2f-0f2f-4315-b101-d8140c7d94a0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:34.904934 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a5905155-4e24-458c-985b-01088d5f59a6 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:34.905524 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a5905155-4e24-458c-985b-01088d5f59a6 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:34.906523 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a5905155-4e24-458c-985b-01088d5f59a6 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:34.907413 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a5905155-4e24-458c-985b-01088d5f59a6 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:34.907955 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a5905155-4e24-458c-985b-01088d5f59a6 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:34.908473 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a5905155-4e24-458c-985b-01088d5f59a6 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:35.187634 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-1fd5dc96-d9ee-469f-9d98-53a40a72c587 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 5c161179-0b93-4676-86f7-2f507a3ebeb3] Updating instance_info_cache with network_info: [{"id": "d5a5f978-c5f0-4476-91cc-2b79e48ec4a7", "address": "fa:16:3e:43:b5:d4", "network": {"id": "2a6f5c27-4e22-4940-b2ce-5570b20e4dba", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1692283097-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1e41136645964ea98a675833bd73299f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd5a5f978-c5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128779) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 16 12:54:35.216930 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1fd5dc96-d9ee-469f-9d98-53a40a72c587 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Releasing lock "refresh_cache-5c161179-0b93-4676-86f7-2f507a3ebeb3" {{(pid=128779) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 16 12:54:35.217820 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1fd5dc96-d9ee-469f-9d98-53a40a72c587 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "POST /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3/action" status: 202 len: 0 microversion: 2.1 time: 8.592583 Sep 16 12:54:35.219131 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1134/2178] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:54:26 2022] POST /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3/action => generated 0 bytes in 8595 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Sep 16 12:54:35.227079 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ee855f5e-79ce-47aa-9660-447fd4bd89b8 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:35.227706 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ee855f5e-79ce-47aa-9660-447fd4bd89b8 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:35.245831 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee855f5e-79ce-47aa-9660-447fd4bd89b8 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:35.246308 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee855f5e-79ce-47aa-9660-447fd4bd89b8 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:35.246760 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee855f5e-79ce-47aa-9660-447fd4bd89b8 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:35.247466 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee855f5e-79ce-47aa-9660-447fd4bd89b8 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:35.247921 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee855f5e-79ce-47aa-9660-447fd4bd89b8 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:35.250417 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee855f5e-79ce-47aa-9660-447fd4bd89b8 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:35.305247 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a5905155-4e24-458c-985b-01088d5f59a6 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a6e736e1d3417cafc9c42a60693be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101be406faff40d9a001aa76e5f3a19e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:35.307635 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=4,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:54:35.317448 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a5905155-4e24-458c-985b-01088d5f59a6 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] 10.222.0.67 "GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0" status: 200 len: 1505 microversion: 2.1 time: 0.432494 Sep 16 12:54:35.319258 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1045/2179] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:34 2022] GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0 => generated 1505 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:35.326326 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-1ff8dfa1-3be9-4efc-8f04-ea2d8ecdeafe req-65ea228e-4b4c-4ca3-af72-c26f59b9001c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd1530a2-c78e-419d-a65e-fc5baf53d939", "name": "network-vif-unplugged", "status": "completed", "tag": "efae6ffd-f514-46a4-ad30-4fa3504874c8"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:35.347752 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-1ff8dfa1-3be9-4efc-8f04-ea2d8ecdeafe req-65ea228e-4b4c-4ca3-af72-c26f59b9001c service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:35.361922 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-1ff8dfa1-3be9-4efc-8f04-ea2d8ecdeafe req-65ea228e-4b4c-4ca3-af72-c26f59b9001c service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:35.362835 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-1ff8dfa1-3be9-4efc-8f04-ea2d8ecdeafe req-65ea228e-4b4c-4ca3-af72-c26f59b9001c service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:35.387139 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-1ff8dfa1-3be9-4efc-8f04-ea2d8ecdeafe req-65ea228e-4b4c-4ca3-af72-c26f59b9001c service nova] Creating event network-vif-unplugged:efae6ffd-f514-46a4-ad30-4fa3504874c8 for instance bd1530a2-c78e-419d-a65e-fc5baf53d939 on n-h2-858094-4 Sep 16 12:54:35.405572 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-1ff8dfa1-3be9-4efc-8f04-ea2d8ecdeafe req-65ea228e-4b4c-4ca3-af72-c26f59b9001c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084886 Sep 16 12:54:35.407787 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1046/2180] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:54:35.670822 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ee855f5e-79ce-47aa-9660-447fd4bd89b8 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:35.695025 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ee855f5e-79ce-47aa-9660-447fd4bd89b8 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1393 microversion: 2.1 time: 0.474200 Sep 16 12:54:35.695635 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1135/2181] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:35 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1393 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:35.699790 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c85d4096-6c63-4046-9a80-b9472247b3e5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-471476573", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:35.726036 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3ce1c4de-8353-4799-b762-d15b8035490e tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1491663833"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:35.732827 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3ce1c4de-8353-4799-b762-d15b8035490e tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] [instance: 5219baf4-bfde-4037-a511-88ff2690ea6a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:35.742037 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ce1c4de-8353-4799-b762-d15b8035490e tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:35.743073 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ce1c4de-8353-4799-b762-d15b8035490e tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:35.743843 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ce1c4de-8353-4799-b762-d15b8035490e tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:35.745019 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ce1c4de-8353-4799-b762-d15b8035490e tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:35.745803 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ce1c4de-8353-4799-b762-d15b8035490e tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:35.746437 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ce1c4de-8353-4799-b762-d15b8035490e tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:35.827211 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-c85d4096-6c63-4046-9a80-b9472247b3e5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] validate_networks() for [('e39821aa-60f0-44e0-aa25-da05e5161c83', None, None, None, None, None)] {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:54:36.119124 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:54:36.263294 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3ce1c4de-8353-4799-b762-d15b8035490e tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "POST /compute/v2.1/servers/5219baf4-bfde-4037-a511-88ff2690ea6a/action" status: 202 len: 0 microversion: 2.1 time: 0.546436 Sep 16 12:54:36.277824 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1136/2182] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:54:35 2022] POST /compute/v2.1/servers/5219baf4-bfde-4037-a511-88ff2690ea6a/action => generated 0 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 16 12:54:36.297854 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-08e7fe3a-2d0a-4b5a-ae34-481ce2ec9b75 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:36.299965 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-08e7fe3a-2d0a-4b5a-ae34-481ce2ec9b75 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 227a8a0b-2a0c-48f8-976a-a176a9039a2d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:36.327100 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08e7fe3a-2d0a-4b5a-ae34-481ce2ec9b75 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:36.330136 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08e7fe3a-2d0a-4b5a-ae34-481ce2ec9b75 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:36.331576 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08e7fe3a-2d0a-4b5a-ae34-481ce2ec9b75 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:36.333204 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08e7fe3a-2d0a-4b5a-ae34-481ce2ec9b75 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:36.335098 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08e7fe3a-2d0a-4b5a-ae34-481ce2ec9b75 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:36.338337 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08e7fe3a-2d0a-4b5a-ae34-481ce2ec9b75 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:36.362458 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-08e7fe3a-2d0a-4b5a-ae34-481ce2ec9b75 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] HTTP exception thrown: Instance 227a8a0b-2a0c-48f8-976a-a176a9039a2d could not be found. Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-08e7fe3a-2d0a-4b5a-ae34-481ce2ec9b75 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Request method failure captured: Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/227a8a0b-2a0c-48f8-976a-a176a9039a2d HTTP/1.1 Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHGPxXZmiUHmt_dft1sdeEgjV0q4vNJkDpEBpD7Lb6hm-ShiDSpwUsuAGMIDYs53IqH8teRtSeFQObdyYjE3XcRcXacV21t-Y8PCaBxxYQREooFypQxs0XfP2jQBOGa7A08HB97lM2M2qPxnRpWViNO6K_WoCZqu2H5gM_K0wP8DNYI Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 1e41136645964ea98a675833bd73299f Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-195341858 Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1e41136645964ea98a675833bd73299f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1e41136645964ea98a675833bd73299f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1e41136645964ea98a675833bd73299f", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1e41136645964ea98a675833bd73299f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-195341858 Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 1e41136645964ea98a675833bd73299f Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-195341858 Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-FloatingIPsAssociationTestJSON-195341858-project Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: b9101f5af9e34d21bb8e872d337d3545 Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-195341858-project Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 227a8a0b-2a0c-48f8-976a-a176a9039a2d could not be found. Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '227a8a0b-2a0c-48f8-976a-a176a9039a2d'} Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 227a8a0b-2a0c-48f8-976a-a176a9039a2d could not be found. Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:54:36.364206 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:54:36.371747 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 227a8a0b-2a0c-48f8-976a-a176a9039a2d could not be found. Sep 16 12:54:36.371747 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:36.371747 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:54:36.371747 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:36.371747 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:36.371747 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:54:36.371747 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:54:36.371747 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:54:36.371747 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:54:36.371747 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 227a8a0b-2a0c-48f8-976a-a176a9039a2d could not be found. Sep 16 12:54:36.371747 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:36.371747 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-08e7fe3a-2d0a-4b5a-ae34-481ce2ec9b75 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Returning 404 to user: Instance 227a8a0b-2a0c-48f8-976a-a176a9039a2d could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:54:36.371747 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-08e7fe3a-2d0a-4b5a-ae34-481ce2ec9b75 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "DELETE /compute/v2.1/servers/227a8a0b-2a0c-48f8-976a-a176a9039a2d" status: 404 len: 111 microversion: 2.1 time: 0.084726 Sep 16 12:54:36.371747 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1137/2183] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:54:36 2022] DELETE /compute/v2.1/servers/227a8a0b-2a0c-48f8-976a-a176a9039a2d => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:54:36.375439 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c4135140-7048-49ea-af17-f1fe24f2b8c9 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f10354e7ee0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:36.432612 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c4135140-7048-49ea-af17-f1fe24f2b8c9 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70" status: 200 len: 1453 microversion: 2.1 time: 0.061409 Sep 16 12:54:36.433597 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1138/2184] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:54:36 2022] GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70 => generated 1453 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:36.438797 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-526961b9-7267-4204-ab89-174c4af34da4 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:36.439665 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-526961b9-7267-4204-ab89-174c4af34da4 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] [instance: dd721f2f-0f2f-4315-b101-d8140c7d94a0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:36.447245 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-526961b9-7267-4204-ab89-174c4af34da4 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:36.448096 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-526961b9-7267-4204-ab89-174c4af34da4 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:36.448744 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-526961b9-7267-4204-ab89-174c4af34da4 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:36.450513 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-526961b9-7267-4204-ab89-174c4af34da4 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:36.451317 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-526961b9-7267-4204-ab89-174c4af34da4 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:36.452036 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-526961b9-7267-4204-ab89-174c4af34da4 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:36.670014 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-526961b9-7267-4204-ab89-174c4af34da4 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a6e736e1d3417cafc9c42a60693be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101be406faff40d9a001aa76e5f3a19e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:36.684617 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-526961b9-7267-4204-ab89-174c4af34da4 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] 10.222.0.67 "GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0" status: 200 len: 1505 microversion: 2.1 time: 0.247337 Sep 16 12:54:36.685487 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1139/2185] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:36 2022] GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0 => generated 1505 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:36.696757 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8b1ec9cc-ef11-447a-89a7-2459a07f20b6 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:36.698002 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8b1ec9cc-ef11-447a-89a7-2459a07f20b6 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 227a8a0b-2a0c-48f8-976a-a176a9039a2d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:36.713113 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b1ec9cc-ef11-447a-89a7-2459a07f20b6 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:36.713750 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b1ec9cc-ef11-447a-89a7-2459a07f20b6 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:36.715745 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b1ec9cc-ef11-447a-89a7-2459a07f20b6 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:36.718052 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b1ec9cc-ef11-447a-89a7-2459a07f20b6 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:36.718719 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b1ec9cc-ef11-447a-89a7-2459a07f20b6 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:36.719255 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b1ec9cc-ef11-447a-89a7-2459a07f20b6 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:36.762554 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-8b1ec9cc-ef11-447a-89a7-2459a07f20b6 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] HTTP exception thrown: Instance 227a8a0b-2a0c-48f8-976a-a176a9039a2d could not be found. Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8b1ec9cc-ef11-447a-89a7-2459a07f20b6 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Request method failure captured: Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/227a8a0b-2a0c-48f8-976a-a176a9039a2d HTTP/1.1 Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHGPxXZmiUHmt_dft1sdeEgjV0q4vNJkDpEBpD7Lb6hm-ShiDSpwUsuAGMIDYs53IqH8teRtSeFQObdyYjE3XcRcXacV21t-Y8PCaBxxYQREooFypQxs0XfP2jQBOGa7A08HB97lM2M2qPxnRpWViNO6K_WoCZqu2H5gM_K0wP8DNYI Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 1e41136645964ea98a675833bd73299f Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-195341858 Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1e41136645964ea98a675833bd73299f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1e41136645964ea98a675833bd73299f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1e41136645964ea98a675833bd73299f", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1e41136645964ea98a675833bd73299f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-195341858 Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 1e41136645964ea98a675833bd73299f Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-195341858 Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-FloatingIPsAssociationTestJSON-195341858-project Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: b9101f5af9e34d21bb8e872d337d3545 Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-195341858-project Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 227a8a0b-2a0c-48f8-976a-a176a9039a2d could not be found. Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '227a8a0b-2a0c-48f8-976a-a176a9039a2d'} Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 227a8a0b-2a0c-48f8-976a-a176a9039a2d could not be found. Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 227a8a0b-2a0c-48f8-976a-a176a9039a2d could not be found. Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:36.764808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:54:36.771224 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:36.771224 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:36.771224 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:54:36.771224 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:54:36.771224 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:54:36.771224 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:54:36.771224 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 227a8a0b-2a0c-48f8-976a-a176a9039a2d could not be found. Sep 16 12:54:36.771224 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:36.775318 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8b1ec9cc-ef11-447a-89a7-2459a07f20b6 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Returning 404 to user: Instance 227a8a0b-2a0c-48f8-976a-a176a9039a2d could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:54:36.776923 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8b1ec9cc-ef11-447a-89a7-2459a07f20b6 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "GET /compute/v2.1/servers/227a8a0b-2a0c-48f8-976a-a176a9039a2d" status: 404 len: 111 microversion: 2.1 time: 0.090164 Sep 16 12:54:36.777743 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1140/2186] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:36 2022] GET /compute/v2.1/servers/227a8a0b-2a0c-48f8-976a-a176a9039a2d => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:54:36.783359 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e2fffb5f-8141-46a0-948e-d28c266b93d9 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:36.784910 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e2fffb5f-8141-46a0-948e-d28c266b93d9 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:36.786372 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-c85d4096-6c63-4046-9a80-b9472247b3e5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:54:36.787939 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-c85d4096-6c63-4046-9a80-b9472247b3e5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:54:36.788869 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-c85d4096-6c63-4046-9a80-b9472247b3e5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:54:36.789510 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-c85d4096-6c63-4046-9a80-b9472247b3e5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:54:36.790120 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-c85d4096-6c63-4046-9a80-b9472247b3e5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:54:36.795906 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2fffb5f-8141-46a0-948e-d28c266b93d9 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:36.796736 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2fffb5f-8141-46a0-948e-d28c266b93d9 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:36.797489 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2fffb5f-8141-46a0-948e-d28c266b93d9 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:36.798633 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2fffb5f-8141-46a0-948e-d28c266b93d9 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:36.799366 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2fffb5f-8141-46a0-948e-d28c266b93d9 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:36.800961 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2fffb5f-8141-46a0-948e-d28c266b93d9 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:36.807593 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c85d4096-6c63-4046-9a80-b9472247b3e5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:36.808338 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c85d4096-6c63-4046-9a80-b9472247b3e5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:36.808947 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c85d4096-6c63-4046-9a80-b9472247b3e5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:36.809698 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c85d4096-6c63-4046-9a80-b9472247b3e5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:36.810488 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c85d4096-6c63-4046-9a80-b9472247b3e5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:36.810926 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c85d4096-6c63-4046-9a80-b9472247b3e5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:36.836578 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-c85d4096-6c63-4046-9a80-b9472247b3e5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Getting quotas for project f2d50b9f6b084e40971269e8b882516c. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:54:36.843935 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-c85d4096-6c63-4046-9a80-b9472247b3e5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Getting quotas for user 1f32bbd973c449a9aeddcdfacc9a814b and project f2d50b9f6b084e40971269e8b882516c. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:54:36.882198 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c85d4096-6c63-4046-9a80-b9472247b3e5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:54:36.888999 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c85d4096-6c63-4046-9a80-b9472247b3e5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: dcadec98-4bc0-4ac3-9dfa-a17b52f40010] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:54:37.000245 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c85d4096-6c63-4046-9a80-b9472247b3e5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.590840 Sep 16 12:54:37.001905 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1047/2187] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:54:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 1593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:54:37.009764 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-11dec004-32ad-4143-8649-25a2ceb61c36 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Calling method '.version_select at 0x7f1035874d30>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:37.056864 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e2fffb5f-8141-46a0-948e-d28c266b93d9 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:37.065597 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e2fffb5f-8141-46a0-948e-d28c266b93d9 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1393 microversion: 2.1 time: 0.286381 Sep 16 12:54:37.066394 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1141/2188] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:36 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1393 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:37.097958 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f9b14258-6b96-4bfb-935c-9cef041407b5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:37.101235 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f9b14258-6b96-4bfb-935c-9cef041407b5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: dcadec98-4bc0-4ac3-9dfa-a17b52f40010] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:37.208189 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f9b14258-6b96-4bfb-935c-9cef041407b5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:37.220502 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f9b14258-6b96-4bfb-935c-9cef041407b5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010" status: 200 len: 1213 microversion: 2.1 time: 0.127307 Sep 16 12:54:37.237227 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1142/2189] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:37 2022] GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010 => generated 1213 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:37.447665 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-7eb398e3-fcfe-4fa7-9b43-26ba14815f66 req-36199d85-a0a9-45d1-9843-6838874b3145 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd1530a2-c78e-419d-a65e-fc5baf53d939", "tag": "efae6ffd-f514-46a4-ad30-4fa3504874c8"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:37.468574 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7eb398e3-fcfe-4fa7-9b43-26ba14815f66 req-36199d85-a0a9-45d1-9843-6838874b3145 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:37.476908 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7eb398e3-fcfe-4fa7-9b43-26ba14815f66 req-36199d85-a0a9-45d1-9843-6838874b3145 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:37.477622 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7eb398e3-fcfe-4fa7-9b43-26ba14815f66 req-36199d85-a0a9-45d1-9843-6838874b3145 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:37.496311 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-7eb398e3-fcfe-4fa7-9b43-26ba14815f66 req-36199d85-a0a9-45d1-9843-6838874b3145 service nova] Creating event network-changed:efae6ffd-f514-46a4-ad30-4fa3504874c8 for instance bd1530a2-c78e-419d-a65e-fc5baf53d939 on n-h2-858094-4 Sep 16 12:54:37.504200 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-7eb398e3-fcfe-4fa7-9b43-26ba14815f66 req-36199d85-a0a9-45d1-9843-6838874b3145 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060005 Sep 16 12:54:37.505448 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1143/2190] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:54:37.531160 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f3b47fff-b776-4020-aacd-03e95f472d40 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f103558e670>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:37.596173 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f3b47fff-b776-4020-aacd-03e95f472d40 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70" status: 200 len: 1453 microversion: 2.1 time: 0.087994 Sep 16 12:54:37.606780 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1144/2191] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:54:37 2022] GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70 => generated 1453 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:37.713350 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8c3028ca-6e9b-42f5-835c-db3b96a7a3c8 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:37.714097 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8c3028ca-6e9b-42f5-835c-db3b96a7a3c8 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] [instance: dd721f2f-0f2f-4315-b101-d8140c7d94a0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:37.726027 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c3028ca-6e9b-42f5-835c-db3b96a7a3c8 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:37.726538 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c3028ca-6e9b-42f5-835c-db3b96a7a3c8 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:37.726987 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c3028ca-6e9b-42f5-835c-db3b96a7a3c8 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:37.727716 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c3028ca-6e9b-42f5-835c-db3b96a7a3c8 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:37.728207 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c3028ca-6e9b-42f5-835c-db3b96a7a3c8 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:37.728645 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c3028ca-6e9b-42f5-835c-db3b96a7a3c8 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:38.110953 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8c3028ca-6e9b-42f5-835c-db3b96a7a3c8 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a6e736e1d3417cafc9c42a60693be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101be406faff40d9a001aa76e5f3a19e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:38.179960 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8c3028ca-6e9b-42f5-835c-db3b96a7a3c8 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] 10.222.0.67 "GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0" status: 200 len: 1503 microversion: 2.1 time: 0.471608 Sep 16 12:54:38.182470 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1145/2192] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:37 2022] GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0 => generated 1503 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:38.189607 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ea3ed67b-22c7-4fed-a070-7e8bc6febccd tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:38.190247 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ea3ed67b-22c7-4fed-a070-7e8bc6febccd tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:38.201894 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea3ed67b-22c7-4fed-a070-7e8bc6febccd tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:38.202413 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea3ed67b-22c7-4fed-a070-7e8bc6febccd tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:38.203667 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea3ed67b-22c7-4fed-a070-7e8bc6febccd tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:38.204553 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea3ed67b-22c7-4fed-a070-7e8bc6febccd tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:38.205084 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea3ed67b-22c7-4fed-a070-7e8bc6febccd tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:38.205643 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea3ed67b-22c7-4fed-a070-7e8bc6febccd tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:38.564631 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ea3ed67b-22c7-4fed-a070-7e8bc6febccd tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:38.595187 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ea3ed67b-22c7-4fed-a070-7e8bc6febccd tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1393 microversion: 2.1 time: 0.411589 Sep 16 12:54:38.598621 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1146/2193] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:38 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1393 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:38.606289 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-42b5dfb5-0f59-4ea2-8992-4881c9946732 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Calling method '.version_select at 0x7f10355b6ca0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:38.607386 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-42b5dfb5-0f59-4ea2-8992-4881c9946732 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] [instance: dd721f2f-0f2f-4315-b101-d8140c7d94a0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:38.615625 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-42b5dfb5-0f59-4ea2-8992-4881c9946732 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:38.616454 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-42b5dfb5-0f59-4ea2-8992-4881c9946732 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:38.617044 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-42b5dfb5-0f59-4ea2-8992-4881c9946732 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:38.617928 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-42b5dfb5-0f59-4ea2-8992-4881c9946732 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:38.618578 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-42b5dfb5-0f59-4ea2-8992-4881c9946732 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:38.619009 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-42b5dfb5-0f59-4ea2-8992-4881c9946732 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:38.657970 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-42b5dfb5-0f59-4ea2-8992-4881c9946732 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] 10.222.0.67 "GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.058169 Sep 16 12:54:38.666694 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1147/2194] 10.222.0.67 () {58 vars in 1296 bytes} [Fri Sep 16 12:54:38 2022] GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0/os-instance-actions => generated 611 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:54:38.671892 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-93124096-0455-4362-8b0c-7fca3aa913b5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:38.672728 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-93124096-0455-4362-8b0c-7fca3aa913b5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: dcadec98-4bc0-4ac3-9dfa-a17b52f40010] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:38.680277 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93124096-0455-4362-8b0c-7fca3aa913b5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:38.681000 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93124096-0455-4362-8b0c-7fca3aa913b5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:38.681577 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93124096-0455-4362-8b0c-7fca3aa913b5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:38.682460 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93124096-0455-4362-8b0c-7fca3aa913b5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:38.683102 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93124096-0455-4362-8b0c-7fca3aa913b5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:38.683670 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93124096-0455-4362-8b0c-7fca3aa913b5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:38.715912 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-11dec004-32ad-4143-8649-25a2ceb61c36 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "DELETE /compute/v2.1/os-floating-ips/6257e01b-c989-43a0-afca-8c210713ffa3" status: 202 len: 0 microversion: 2.1 time: 1.711402 Sep 16 12:54:38.717139 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1048/2195] 10.222.0.67 () {58 vars in 1263 bytes} [Fri Sep 16 12:54:37 2022] DELETE /compute/v2.1/os-floating-ips/6257e01b-c989-43a0-afca-8c210713ffa3 => generated 0 bytes in 1715 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:54:38.723005 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5bcad2d0-f843-4090-b717-8723bb133914 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f10358b1670>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:38.779328 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-93124096-0455-4362-8b0c-7fca3aa913b5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:38.793361 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-93124096-0455-4362-8b0c-7fca3aa913b5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010" status: 200 len: 1265 microversion: 2.1 time: 0.125143 Sep 16 12:54:38.794519 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1148/2196] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:38 2022] GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010 => generated 1265 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:38.803112 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4ee6c131-d3a0-4175-b0eb-5628b9ff3b9e tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:38.803711 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4ee6c131-d3a0-4175-b0eb-5628b9ff3b9e tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] [instance: dd721f2f-0f2f-4315-b101-d8140c7d94a0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:38.810586 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ee6c131-d3a0-4175-b0eb-5628b9ff3b9e tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:38.811450 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ee6c131-d3a0-4175-b0eb-5628b9ff3b9e tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:38.812036 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ee6c131-d3a0-4175-b0eb-5628b9ff3b9e tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:38.824889 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ee6c131-d3a0-4175-b0eb-5628b9ff3b9e tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:38.826046 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ee6c131-d3a0-4175-b0eb-5628b9ff3b9e tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:38.828984 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ee6c131-d3a0-4175-b0eb-5628b9ff3b9e tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:38.839420 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5bcad2d0-f843-4090-b717-8723bb133914 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70" status: 200 len: 1453 microversion: 2.1 time: 0.118292 Sep 16 12:54:38.841580 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1049/2197] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:54:38 2022] GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70 => generated 1453 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:38.854170 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-978d71eb-71a6-4d2b-8d8a-e024e8e85538 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:38.854950 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-978d71eb-71a6-4d2b-8d8a-e024e8e85538 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 5c161179-0b93-4676-86f7-2f507a3ebeb3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:38.863315 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-978d71eb-71a6-4d2b-8d8a-e024e8e85538 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:38.864075 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-978d71eb-71a6-4d2b-8d8a-e024e8e85538 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:38.864692 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-978d71eb-71a6-4d2b-8d8a-e024e8e85538 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:38.866206 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-978d71eb-71a6-4d2b-8d8a-e024e8e85538 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:38.866843 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-978d71eb-71a6-4d2b-8d8a-e024e8e85538 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:38.867425 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-978d71eb-71a6-4d2b-8d8a-e024e8e85538 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:38.893183 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4ee6c131-d3a0-4175-b0eb-5628b9ff3b9e tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] [instance: dd721f2f-0f2f-4315-b101-d8140c7d94a0] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:54:38.909822 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-978d71eb-71a6-4d2b-8d8a-e024e8e85538 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 5c161179-0b93-4676-86f7-2f507a3ebeb3] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:54:38.999222 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4ee6c131-d3a0-4175-b0eb-5628b9ff3b9e tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] 10.222.0.67 "DELETE /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0" status: 204 len: 0 microversion: 2.1 time: 0.201659 Sep 16 12:54:39.001640 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1149/2198] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:54:38 2022] DELETE /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:54:39.015724 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-babf2773-2744-4212-b699-d20dcb4cc0a7 req-61538aae-00d6-409a-a112-d289deedfdc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c97d5f35-6ea1-4ec7-88f5-9da9dbe81182", "name": "network-vif-unplugged", "status": "completed", "tag": "81054b4c-c45a-4833-ae83-e752ff18ff48"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:39.056443 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-babf2773-2744-4212-b699-d20dcb4cc0a7 req-61538aae-00d6-409a-a112-d289deedfdc9 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:39.056942 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-babf2773-2744-4212-b699-d20dcb4cc0a7 req-61538aae-00d6-409a-a112-d289deedfdc9 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:39.059572 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-babf2773-2744-4212-b699-d20dcb4cc0a7 req-61538aae-00d6-409a-a112-d289deedfdc9 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:39.088199 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-978d71eb-71a6-4d2b-8d8a-e024e8e85538 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "DELETE /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3" status: 204 len: 0 microversion: 2.1 time: 0.244105 Sep 16 12:54:39.089130 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1050/2199] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:54:38 2022] DELETE /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:54:39.096423 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e6b3e182-8327-4770-9940-409194be1edf tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:39.097186 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e6b3e182-8327-4770-9940-409194be1edf tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] [instance: dd721f2f-0f2f-4315-b101-d8140c7d94a0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:39.103611 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-babf2773-2744-4212-b699-d20dcb4cc0a7 req-61538aae-00d6-409a-a112-d289deedfdc9 service nova] Creating event network-vif-unplugged:81054b4c-c45a-4833-ae83-e752ff18ff48 for instance c97d5f35-6ea1-4ec7-88f5-9da9dbe81182 on n-h1-858094-4 Sep 16 12:54:39.104747 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e6b3e182-8327-4770-9940-409194be1edf tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:39.105589 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e6b3e182-8327-4770-9940-409194be1edf tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:39.106211 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e6b3e182-8327-4770-9940-409194be1edf tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:39.108274 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e6b3e182-8327-4770-9940-409194be1edf tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:39.109112 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e6b3e182-8327-4770-9940-409194be1edf tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:39.109728 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e6b3e182-8327-4770-9940-409194be1edf tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:39.114814 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-babf2773-2744-4212-b699-d20dcb4cc0a7 req-61538aae-00d6-409a-a112-d289deedfdc9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109557 Sep 16 12:54:39.117115 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1150/2200] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:54:39.127884 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2222c14b-9ede-477d-b434-307de395cbd9 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:39.128940 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2222c14b-9ede-477d-b434-307de395cbd9 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 5c161179-0b93-4676-86f7-2f507a3ebeb3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:39.151073 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2222c14b-9ede-477d-b434-307de395cbd9 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:39.151771 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2222c14b-9ede-477d-b434-307de395cbd9 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:39.152424 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2222c14b-9ede-477d-b434-307de395cbd9 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:39.153297 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2222c14b-9ede-477d-b434-307de395cbd9 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:39.153904 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2222c14b-9ede-477d-b434-307de395cbd9 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:39.154588 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2222c14b-9ede-477d-b434-307de395cbd9 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:39.444805 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2222c14b-9ede-477d-b434-307de395cbd9 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9101f5af9e34d21bb8e872d337d3545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e41136645964ea98a675833bd73299f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:39.456294 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2222c14b-9ede-477d-b434-307de395cbd9 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3" status: 200 len: 1526 microversion: 2.1 time: 0.332845 Sep 16 12:54:39.465433 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1151/2201] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:39 2022] GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3 => generated 1526 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:39.515150 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e6b3e182-8327-4770-9940-409194be1edf tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a6e736e1d3417cafc9c42a60693be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101be406faff40d9a001aa76e5f3a19e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:39.526621 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e6b3e182-8327-4770-9940-409194be1edf tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] 10.222.0.67 "GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0" status: 200 len: 1509 microversion: 2.1 time: 0.436011 Sep 16 12:54:39.527705 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1051/2202] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:39 2022] GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0 => generated 1509 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:39.619600 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9f933a1f-cb0f-4997-8712-e816f4db302d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:39.620198 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9f933a1f-cb0f-4997-8712-e816f4db302d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:39.631897 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f933a1f-cb0f-4997-8712-e816f4db302d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:39.633117 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f933a1f-cb0f-4997-8712-e816f4db302d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:39.633746 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f933a1f-cb0f-4997-8712-e816f4db302d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:39.634869 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f933a1f-cb0f-4997-8712-e816f4db302d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:39.635632 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f933a1f-cb0f-4997-8712-e816f4db302d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:39.636266 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f933a1f-cb0f-4997-8712-e816f4db302d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:39.822551 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ea33e4a8-4800-4cb6-a1fd-a1a5ee9ddc63 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:39.823408 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ea33e4a8-4800-4cb6-a1fd-a1a5ee9ddc63 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: dcadec98-4bc0-4ac3-9dfa-a17b52f40010] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:39.842644 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ea33e4a8-4800-4cb6-a1fd-a1a5ee9ddc63 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:39.843157 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ea33e4a8-4800-4cb6-a1fd-a1a5ee9ddc63 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:39.843670 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ea33e4a8-4800-4cb6-a1fd-a1a5ee9ddc63 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:39.844481 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ea33e4a8-4800-4cb6-a1fd-a1a5ee9ddc63 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:39.845006 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ea33e4a8-4800-4cb6-a1fd-a1a5ee9ddc63 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:39.845511 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ea33e4a8-4800-4cb6-a1fd-a1a5ee9ddc63 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:40.516376 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9f933a1f-cb0f-4997-8712-e816f4db302d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:40.532453 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ea33e4a8-4800-4cb6-a1fd-a1a5ee9ddc63 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:40.544325 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9f933a1f-cb0f-4997-8712-e816f4db302d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1393 microversion: 2.1 time: 0.929077 Sep 16 12:54:40.547919 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1152/2203] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:39 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1393 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:40.549728 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ea33e4a8-4800-4cb6-a1fd-a1a5ee9ddc63 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010" status: 200 len: 1271 microversion: 2.1 time: 0.732993 Sep 16 12:54:40.564149 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1052/2204] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:39 2022] GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010 => generated 1271 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:54:40.572827 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6dabfc01-259d-48fd-a45a-ea9f215ed4f6 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:40.574218 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6dabfc01-259d-48fd-a45a-ea9f215ed4f6 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 5c161179-0b93-4676-86f7-2f507a3ebeb3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:40.579274 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ce59ce81-0737-44cb-97fd-974683912901 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f10351cd5e0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:40.595072 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6dabfc01-259d-48fd-a45a-ea9f215ed4f6 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:40.595809 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6dabfc01-259d-48fd-a45a-ea9f215ed4f6 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:40.596321 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6dabfc01-259d-48fd-a45a-ea9f215ed4f6 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:40.596987 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6dabfc01-259d-48fd-a45a-ea9f215ed4f6 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:40.597452 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6dabfc01-259d-48fd-a45a-ea9f215ed4f6 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:40.599335 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6dabfc01-259d-48fd-a45a-ea9f215ed4f6 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:40.683838 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ce59ce81-0737-44cb-97fd-974683912901 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70" status: 200 len: 1453 microversion: 2.1 time: 0.133054 Sep 16 12:54:40.697490 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1153/2205] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:54:40 2022] GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70 => generated 1453 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:40.710922 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-03a5d3f4-4fd3-41c8-bb62-3b4d7d497b11 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:40.713370 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-03a5d3f4-4fd3-41c8-bb62-3b4d7d497b11 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] [instance: dd721f2f-0f2f-4315-b101-d8140c7d94a0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:40.726864 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-03a5d3f4-4fd3-41c8-bb62-3b4d7d497b11 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:40.731346 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-03a5d3f4-4fd3-41c8-bb62-3b4d7d497b11 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:40.732479 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-03a5d3f4-4fd3-41c8-bb62-3b4d7d497b11 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:40.735484 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-03a5d3f4-4fd3-41c8-bb62-3b4d7d497b11 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:40.737011 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-03a5d3f4-4fd3-41c8-bb62-3b4d7d497b11 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:40.737978 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-03a5d3f4-4fd3-41c8-bb62-3b4d7d497b11 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:40.932776 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6dabfc01-259d-48fd-a45a-ea9f215ed4f6 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9101f5af9e34d21bb8e872d337d3545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e41136645964ea98a675833bd73299f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:40.941918 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6dabfc01-259d-48fd-a45a-ea9f215ed4f6 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3" status: 200 len: 1526 microversion: 2.1 time: 0.389420 Sep 16 12:54:40.943023 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1053/2206] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:40 2022] GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3 => generated 1526 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:41.012852 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-03a5d3f4-4fd3-41c8-bb62-3b4d7d497b11 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a6e736e1d3417cafc9c42a60693be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101be406faff40d9a001aa76e5f3a19e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:41.027471 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-03a5d3f4-4fd3-41c8-bb62-3b4d7d497b11 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] 10.222.0.67 "GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0" status: 200 len: 1509 microversion: 2.1 time: 0.328497 Sep 16 12:54:41.028532 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1154/2207] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:40 2022] GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0 => generated 1509 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:41.582134 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-41f143e5-560b-451c-b3e0-2092a2c89f6a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:41.585232 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-943a4895-e162-48f3-9495-b28e72e265c8 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:41.586413 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-41f143e5-560b-451c-b3e0-2092a2c89f6a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: dcadec98-4bc0-4ac3-9dfa-a17b52f40010] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:41.587277 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-943a4895-e162-48f3-9495-b28e72e265c8 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:41.609882 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-943a4895-e162-48f3-9495-b28e72e265c8 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:41.610888 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-943a4895-e162-48f3-9495-b28e72e265c8 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:41.611374 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41f143e5-560b-451c-b3e0-2092a2c89f6a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:41.613371 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-943a4895-e162-48f3-9495-b28e72e265c8 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:41.614337 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41f143e5-560b-451c-b3e0-2092a2c89f6a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:41.617435 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41f143e5-560b-451c-b3e0-2092a2c89f6a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:41.624577 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41f143e5-560b-451c-b3e0-2092a2c89f6a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:41.625066 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41f143e5-560b-451c-b3e0-2092a2c89f6a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:41.625511 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41f143e5-560b-451c-b3e0-2092a2c89f6a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:41.627871 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-943a4895-e162-48f3-9495-b28e72e265c8 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:41.628870 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-943a4895-e162-48f3-9495-b28e72e265c8 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:41.629375 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-943a4895-e162-48f3-9495-b28e72e265c8 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:42.327315 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-41f143e5-560b-451c-b3e0-2092a2c89f6a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:42.344947 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-41f143e5-560b-451c-b3e0-2092a2c89f6a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010" status: 200 len: 1313 microversion: 2.1 time: 0.766854 Sep 16 12:54:42.345566 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1155/2208] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:41 2022] GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010 => generated 1313 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:42.358322 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-70749966-49a4-458c-8951-ef54172be6ca tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f103533eb80>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:42.432235 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-70749966-49a4-458c-8951-ef54172be6ca tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70" status: 200 len: 1453 microversion: 2.1 time: 0.084823 Sep 16 12:54:42.433019 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1156/2209] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:54:42 2022] GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70 => generated 1453 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:42.445330 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-943a4895-e162-48f3-9495-b28e72e265c8 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:42.458108 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0049a5b2-21d8-4f8f-8dff-1bc7380075a9 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:42.462340 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-943a4895-e162-48f3-9495-b28e72e265c8 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1393 microversion: 2.1 time: 0.889526 Sep 16 12:54:42.463102 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0049a5b2-21d8-4f8f-8dff-1bc7380075a9 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 5c161179-0b93-4676-86f7-2f507a3ebeb3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:42.471523 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0049a5b2-21d8-4f8f-8dff-1bc7380075a9 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:42.472482 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0049a5b2-21d8-4f8f-8dff-1bc7380075a9 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:42.473075 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0049a5b2-21d8-4f8f-8dff-1bc7380075a9 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:42.473939 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0049a5b2-21d8-4f8f-8dff-1bc7380075a9 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:42.474539 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0049a5b2-21d8-4f8f-8dff-1bc7380075a9 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:42.475144 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0049a5b2-21d8-4f8f-8dff-1bc7380075a9 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:42.483064 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1054/2210] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:41 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1393 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:42.496233 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ada2e321-457e-446e-9eac-065d14f94572 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:42.499242 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ada2e321-457e-446e-9eac-065d14f94572 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] [instance: dd721f2f-0f2f-4315-b101-d8140c7d94a0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:42.520473 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ada2e321-457e-446e-9eac-065d14f94572 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:42.520984 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ada2e321-457e-446e-9eac-065d14f94572 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:42.521430 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ada2e321-457e-446e-9eac-065d14f94572 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:42.526638 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ada2e321-457e-446e-9eac-065d14f94572 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:42.529286 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ada2e321-457e-446e-9eac-065d14f94572 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:42.531559 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ada2e321-457e-446e-9eac-065d14f94572 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:43.661631 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ada2e321-457e-446e-9eac-065d14f94572 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a6e736e1d3417cafc9c42a60693be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101be406faff40d9a001aa76e5f3a19e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:43.677620 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ada2e321-457e-446e-9eac-065d14f94572 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] 10.222.0.67 "GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0" status: 200 len: 1509 microversion: 2.1 time: 1.191244 Sep 16 12:54:43.679885 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1055/2211] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:42 2022] GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0 => generated 1509 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:43.702411 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b703062e-cbb3-423e-8285-7f4f5e20d245 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:43.724962 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b703062e-cbb3-423e-8285-7f4f5e20d245 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:43.729766 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b703062e-cbb3-423e-8285-7f4f5e20d245 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:43.730510 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b703062e-cbb3-423e-8285-7f4f5e20d245 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:43.978714 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b703062e-cbb3-423e-8285-7f4f5e20d245 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Going to try to stop instance {{(pid=128780) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 16 12:54:44.093845 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b703062e-cbb3-423e-8285-7f4f5e20d245 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "POST /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88/action" status: 202 len: 0 microversion: 2.1 time: 0.409737 Sep 16 12:54:44.094973 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1056/2212] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:54:43 2022] POST /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:54:44.101108 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0049a5b2-21d8-4f8f-8dff-1bc7380075a9 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9101f5af9e34d21bb8e872d337d3545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e41136645964ea98a675833bd73299f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:44.108677 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0efb01b5-02d9-4000-b193-1821aea69c98 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:44.110028 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0efb01b5-02d9-4000-b193-1821aea69c98 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:44.121894 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0049a5b2-21d8-4f8f-8dff-1bc7380075a9 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3" status: 200 len: 1526 microversion: 2.1 time: 1.687594 Sep 16 12:54:44.125628 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1157/2213] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:42 2022] GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3 => generated 1526 bytes in 1692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:44.145588 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0efb01b5-02d9-4000-b193-1821aea69c98 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:44.146102 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0efb01b5-02d9-4000-b193-1821aea69c98 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:44.146595 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0efb01b5-02d9-4000-b193-1821aea69c98 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:44.147980 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0efb01b5-02d9-4000-b193-1821aea69c98 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:44.148486 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0efb01b5-02d9-4000-b193-1821aea69c98 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:44.148924 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0efb01b5-02d9-4000-b193-1821aea69c98 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:44.152567 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-296b4abe-922e-427e-ba70-4664bcdd2ed7 req-30cf725e-60d2-4633-aec7-f66b5ac3841d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5219baf4-bfde-4037-a511-88ff2690ea6a", "name": "network-vif-plugged", "status": "completed", "tag": "537bc282-546d-4a7e-b32f-2149067cc012"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:44.215068 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-296b4abe-922e-427e-ba70-4664bcdd2ed7 req-30cf725e-60d2-4633-aec7-f66b5ac3841d service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:44.218786 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-296b4abe-922e-427e-ba70-4664bcdd2ed7 req-30cf725e-60d2-4633-aec7-f66b5ac3841d service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:44.220484 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-296b4abe-922e-427e-ba70-4664bcdd2ed7 req-30cf725e-60d2-4633-aec7-f66b5ac3841d service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:44.265452 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-296b4abe-922e-427e-ba70-4664bcdd2ed7 req-30cf725e-60d2-4633-aec7-f66b5ac3841d service nova] Creating event network-vif-plugged:537bc282-546d-4a7e-b32f-2149067cc012 for instance 5219baf4-bfde-4037-a511-88ff2690ea6a on n-h2-858094-4 Sep 16 12:54:44.291608 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-296b4abe-922e-427e-ba70-4664bcdd2ed7 req-30cf725e-60d2-4633-aec7-f66b5ac3841d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160100 Sep 16 12:54:44.295762 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1158/2214] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:54:44.310379 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fd37021a-46ed-434b-aa0e-2d66431fa42c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:44.311669 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fd37021a-46ed-434b-aa0e-2d66431fa42c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: dcadec98-4bc0-4ac3-9dfa-a17b52f40010] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:44.330581 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd37021a-46ed-434b-aa0e-2d66431fa42c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:44.331327 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd37021a-46ed-434b-aa0e-2d66431fa42c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:44.331906 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd37021a-46ed-434b-aa0e-2d66431fa42c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:44.332987 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd37021a-46ed-434b-aa0e-2d66431fa42c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:44.341064 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd37021a-46ed-434b-aa0e-2d66431fa42c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:44.341733 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd37021a-46ed-434b-aa0e-2d66431fa42c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:44.793588 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fd37021a-46ed-434b-aa0e-2d66431fa42c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:44.806600 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:54:44.820499 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fd37021a-46ed-434b-aa0e-2d66431fa42c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010" status: 200 len: 1313 microversion: 2.1 time: 0.521134 Sep 16 12:54:44.829315 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1159/2215] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:44 2022] GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010 => generated 1313 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:44.832002 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-0efb01b5-02d9-4000-b193-1821aea69c98 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lazy-loading 'services' on Instance uuid d49156a2-d78c-4601-a431-e09716c76ce8 {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:54:44.843276 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fcc642cb-d487-45b9-b21f-b912deb765a6 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f103541a3a0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:44.874855 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0efb01b5-02d9-4000-b193-1821aea69c98 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 2344 microversion: 2.25 time: 0.778359 Sep 16 12:54:44.875476 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1057/2216] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:54:44 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 2344 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:54:44.896636 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d098247e-8ad4-4797-b45c-564dffcc7d4b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:44.898545 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d098247e-8ad4-4797-b45c-564dffcc7d4b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:44.912734 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d098247e-8ad4-4797-b45c-564dffcc7d4b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:44.914157 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d098247e-8ad4-4797-b45c-564dffcc7d4b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:44.915543 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d098247e-8ad4-4797-b45c-564dffcc7d4b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:44.917287 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d098247e-8ad4-4797-b45c-564dffcc7d4b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:44.918570 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d098247e-8ad4-4797-b45c-564dffcc7d4b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:44.922871 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d098247e-8ad4-4797-b45c-564dffcc7d4b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:44.959565 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fcc642cb-d487-45b9-b21f-b912deb765a6 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70" status: 200 len: 1453 microversion: 2.1 time: 0.128737 Sep 16 12:54:44.960427 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1160/2217] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:54:44 2022] GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70 => generated 1453 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:44.969851 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dfb5680a-eefb-4109-9d25-875133d63039 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:44.972886 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dfb5680a-eefb-4109-9d25-875133d63039 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:44.993010 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfb5680a-eefb-4109-9d25-875133d63039 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:44.996060 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfb5680a-eefb-4109-9d25-875133d63039 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:44.996921 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfb5680a-eefb-4109-9d25-875133d63039 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:44.997969 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfb5680a-eefb-4109-9d25-875133d63039 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:45.005693 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfb5680a-eefb-4109-9d25-875133d63039 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:45.007391 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfb5680a-eefb-4109-9d25-875133d63039 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:45.527977 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d098247e-8ad4-4797-b45c-564dffcc7d4b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:45.546047 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d098247e-8ad4-4797-b45c-564dffcc7d4b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1393 microversion: 2.1 time: 0.664915 Sep 16 12:54:45.574099 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1058/2218] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:44 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1393 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:45.601669 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-31a9e15c-b6b2-4ef9-a21b-91065f2066ab req-ba2fc8a1-b0c0-450e-9108-ee7f91d59d4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcadec98-4bc0-4ac3-9dfa-a17b52f40010", "tag": "60ac9746-6fd2-4524-bc83-9f6c7c18aa9f"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:45.638059 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-31a9e15c-b6b2-4ef9-a21b-91065f2066ab req-ba2fc8a1-b0c0-450e-9108-ee7f91d59d4f service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:45.639992 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-31a9e15c-b6b2-4ef9-a21b-91065f2066ab req-ba2fc8a1-b0c0-450e-9108-ee7f91d59d4f service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:45.642467 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-31a9e15c-b6b2-4ef9-a21b-91065f2066ab req-ba2fc8a1-b0c0-450e-9108-ee7f91d59d4f service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:45.688159 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-31a9e15c-b6b2-4ef9-a21b-91065f2066ab req-ba2fc8a1-b0c0-450e-9108-ee7f91d59d4f service nova] Creating event network-changed:60ac9746-6fd2-4524-bc83-9f6c7c18aa9f for instance dcadec98-4bc0-4ac3-9dfa-a17b52f40010 on n-h2-858094-4 Sep 16 12:54:45.713840 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-31a9e15c-b6b2-4ef9-a21b-91065f2066ab req-ba2fc8a1-b0c0-450e-9108-ee7f91d59d4f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130175 Sep 16 12:54:45.714999 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1059/2219] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:54:45.725780 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dfb5680a-eefb-4109-9d25-875133d63039 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:45.745378 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-763f8b11-ed24-4fa0-a90d-e75f193c2ba8 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:45.746571 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-763f8b11-ed24-4fa0-a90d-e75f193c2ba8 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] [instance: dd721f2f-0f2f-4315-b101-d8140c7d94a0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:45.767548 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-763f8b11-ed24-4fa0-a90d-e75f193c2ba8 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:45.771634 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-763f8b11-ed24-4fa0-a90d-e75f193c2ba8 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:45.773182 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-763f8b11-ed24-4fa0-a90d-e75f193c2ba8 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:45.775792 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-763f8b11-ed24-4fa0-a90d-e75f193c2ba8 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:45.776433 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-763f8b11-ed24-4fa0-a90d-e75f193c2ba8 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:45.776938 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-763f8b11-ed24-4fa0-a90d-e75f193c2ba8 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:45.781992 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dfb5680a-eefb-4109-9d25-875133d63039 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1724 microversion: 2.1 time: 0.815734 Sep 16 12:54:45.791321 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1161/2220] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:44 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1724 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:45.801743 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fe897dfe-54e1-4fcf-9771-9c2cef1cabe2 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:45.815335 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe897dfe-54e1-4fcf-9771-9c2cef1cabe2 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:45.815868 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe897dfe-54e1-4fcf-9771-9c2cef1cabe2 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:45.816350 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe897dfe-54e1-4fcf-9771-9c2cef1cabe2 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:45.820151 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe897dfe-54e1-4fcf-9771-9c2cef1cabe2 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:45.820649 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe897dfe-54e1-4fcf-9771-9c2cef1cabe2 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:45.825459 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe897dfe-54e1-4fcf-9771-9c2cef1cabe2 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:45.905793 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fe897dfe-54e1-4fcf-9771-9c2cef1cabe2 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.109129 Sep 16 12:54:45.906536 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1162/2221] 10.222.0.67 () {60 vars in 1217 bytes} [Fri Sep 16 12:54:45 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:54:45.922473 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-eb998245-a864-4a2a-8c45-50b4b6b541a1 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:45.923116 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-eb998245-a864-4a2a-8c45-50b4b6b541a1 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 5c161179-0b93-4676-86f7-2f507a3ebeb3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:45.930513 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-763f8b11-ed24-4fa0-a90d-e75f193c2ba8 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:45.931039 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-763f8b11-ed24-4fa0-a90d-e75f193c2ba8 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:45.931444 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-763f8b11-ed24-4fa0-a90d-e75f193c2ba8 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:45.938589 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eb998245-a864-4a2a-8c45-50b4b6b541a1 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:45.938810 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-763f8b11-ed24-4fa0-a90d-e75f193c2ba8 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lazy-loading 'fault' on Instance uuid dd721f2f-0f2f-4315-b101-d8140c7d94a0 {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:54:45.939092 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eb998245-a864-4a2a-8c45-50b4b6b541a1 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:45.939536 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eb998245-a864-4a2a-8c45-50b4b6b541a1 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:45.946027 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eb998245-a864-4a2a-8c45-50b4b6b541a1 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:45.946546 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eb998245-a864-4a2a-8c45-50b4b6b541a1 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:45.946995 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eb998245-a864-4a2a-8c45-50b4b6b541a1 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:46.097578 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-763f8b11-ed24-4fa0-a90d-e75f193c2ba8 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a6e736e1d3417cafc9c42a60693be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101be406faff40d9a001aa76e5f3a19e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:46.136795 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-763f8b11-ed24-4fa0-a90d-e75f193c2ba8 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] 10.222.0.67 "GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0" status: 200 len: 1304 microversion: 2.1 time: 0.420465 Sep 16 12:54:46.145639 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1060/2222] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:45 2022] GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0 => generated 1304 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:46.192406 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-d0aeb1c7-5891-4ede-8c9e-c4ce0338cb08 req-0cc5984a-ea30-4613-baf2-844006501cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd721f2f-0f2f-4315-b101-d8140c7d94a0", "name": "network-vif-deleted", "tag": "ee76b399-9246-48fa-9c23-18309e9b0a92"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:46.233257 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-d0aeb1c7-5891-4ede-8c9e-c4ce0338cb08 req-0cc5984a-ea30-4613-baf2-844006501cb7 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:46.237093 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-d0aeb1c7-5891-4ede-8c9e-c4ce0338cb08 req-0cc5984a-ea30-4613-baf2-844006501cb7 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:46.237590 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-d0aeb1c7-5891-4ede-8c9e-c4ce0338cb08 req-0cc5984a-ea30-4613-baf2-844006501cb7 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:46.271477 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-eb998245-a864-4a2a-8c45-50b4b6b541a1 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9101f5af9e34d21bb8e872d337d3545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e41136645964ea98a675833bd73299f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:46.273513 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-d0aeb1c7-5891-4ede-8c9e-c4ce0338cb08 req-0cc5984a-ea30-4613-baf2-844006501cb7 service nova] Creating event network-vif-deleted:ee76b399-9246-48fa-9c23-18309e9b0a92 for instance dd721f2f-0f2f-4315-b101-d8140c7d94a0 on n-h1-858094-4 Sep 16 12:54:46.285440 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-d0aeb1c7-5891-4ede-8c9e-c4ce0338cb08 req-0cc5984a-ea30-4613-baf2-844006501cb7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138368 Sep 16 12:54:46.288272 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1061/2223] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:54:46.290388 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-eb998245-a864-4a2a-8c45-50b4b6b541a1 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3" status: 200 len: 1484 microversion: 2.1 time: 0.378102 Sep 16 12:54:46.291789 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1163/2224] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:45 2022] GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3 => generated 1484 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:46.311892 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-01e7c352-4e31-4be6-9c5a-4f2d1171094e tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:46.314694 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a750c3b4-b947-40af-8487-c86041b6ffd8 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f1035656ca0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:46.323546 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-01e7c352-4e31-4be6-9c5a-4f2d1171094e tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: dcadec98-4bc0-4ac3-9dfa-a17b52f40010] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:46.344511 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-01e7c352-4e31-4be6-9c5a-4f2d1171094e tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:46.345546 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-01e7c352-4e31-4be6-9c5a-4f2d1171094e tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:46.345546 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-01e7c352-4e31-4be6-9c5a-4f2d1171094e tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:46.346306 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-01e7c352-4e31-4be6-9c5a-4f2d1171094e tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:46.346791 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-01e7c352-4e31-4be6-9c5a-4f2d1171094e tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:46.347706 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-01e7c352-4e31-4be6-9c5a-4f2d1171094e tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:46.443823 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a750c3b4-b947-40af-8487-c86041b6ffd8 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70" status: 200 len: 1453 microversion: 2.1 time: 0.147771 Sep 16 12:54:46.447439 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1164/2225] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:54:46 2022] GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:46.603226 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9def53bb-00aa-45f9-918d-40b6fa59abbd tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:46.606198 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9def53bb-00aa-45f9-918d-40b6fa59abbd tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:46.627965 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:54:46.638566 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9def53bb-00aa-45f9-918d-40b6fa59abbd tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:46.641199 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9def53bb-00aa-45f9-918d-40b6fa59abbd tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:46.643582 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9def53bb-00aa-45f9-918d-40b6fa59abbd tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:46.648255 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9def53bb-00aa-45f9-918d-40b6fa59abbd tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:46.650821 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9def53bb-00aa-45f9-918d-40b6fa59abbd tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:46.651482 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9def53bb-00aa-45f9-918d-40b6fa59abbd tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:46.825795 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:54:46.859267 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=6 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:54:47.083449 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-01e7c352-4e31-4be6-9c5a-4f2d1171094e tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:47.099487 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-01e7c352-4e31-4be6-9c5a-4f2d1171094e tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010" status: 200 len: 1313 microversion: 2.1 time: 0.805537 Sep 16 12:54:47.119729 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1062/2226] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:46 2022] GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010 => generated 1313 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:47.138286 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-848d86c4-10d1-49fd-9911-2e8d64f96e4f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:47.140364 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-848d86c4-10d1-49fd-9911-2e8d64f96e4f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:47.158964 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-848d86c4-10d1-49fd-9911-2e8d64f96e4f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:47.166337 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-848d86c4-10d1-49fd-9911-2e8d64f96e4f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:47.169677 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-848d86c4-10d1-49fd-9911-2e8d64f96e4f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:47.171822 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-848d86c4-10d1-49fd-9911-2e8d64f96e4f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:47.172700 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-848d86c4-10d1-49fd-9911-2e8d64f96e4f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:47.174875 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-848d86c4-10d1-49fd-9911-2e8d64f96e4f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:47.220472 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:54:47.280630 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9def53bb-00aa-45f9-918d-40b6fa59abbd tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:47.294467 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9def53bb-00aa-45f9-918d-40b6fa59abbd tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1393 microversion: 2.1 time: 0.703094 Sep 16 12:54:47.308881 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1165/2227] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:46 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1393 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:54:47.335869 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3167669b-4717-4ffd-ac80-399fba5cd232 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:47.346792 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3167669b-4717-4ffd-ac80-399fba5cd232 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] [instance: dd721f2f-0f2f-4315-b101-d8140c7d94a0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:47.361261 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3167669b-4717-4ffd-ac80-399fba5cd232 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:47.362580 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3167669b-4717-4ffd-ac80-399fba5cd232 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:47.363134 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3167669b-4717-4ffd-ac80-399fba5cd232 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:47.368296 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3167669b-4717-4ffd-ac80-399fba5cd232 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:47.368907 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3167669b-4717-4ffd-ac80-399fba5cd232 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:47.369622 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3167669b-4717-4ffd-ac80-399fba5cd232 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:47.401447 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-3167669b-4717-4ffd-ac80-399fba5cd232 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] HTTP exception thrown: Instance dd721f2f-0f2f-4315-b101-d8140c7d94a0 could not be found. Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3167669b-4717-4ffd-ac80-399fba5cd232 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Request method failure captured: Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0 HTTP/1.1 Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHHn5VJdy41UvdW81dWaGGK2OFAWMISAJnVLusSuehPs26DOF7igc7JH6VvfqNp7KtUQ5_Qzrbd1P7oW1jiHqzzRHHWvUz1Q0Jlcl_WNIEnf-c_p2pwWFc9Jr8JOVirPJieOErfmlZnAv8frvYVnmaEp8_wGHHYGpxYkMXDGca6XhAQ Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 101be406faff40d9a001aa76e5f3a19e Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-InstanceActionsTestJSON-1321990069 Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/101be406faff40d9a001aa76e5f3a19e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/101be406faff40d9a001aa76e5f3a19e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_101be406faff40d9a001aa76e5f3a19e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/101be406faff40d9a001aa76e5f3a19e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-InstanceActionsTestJSON-1321990069 Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 101be406faff40d9a001aa76e5f3a19e Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1321990069 Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-InstanceActionsTestJSON-1321990069-project Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 78a6e736e1d3417cafc9c42a60693be0 Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-InstanceActionsTestJSON-1321990069-project Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance dd721f2f-0f2f-4315-b101-d8140c7d94a0 could not be found. Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': 'dd721f2f-0f2f-4315-b101-d8140c7d94a0'} Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd721f2f-0f2f-4315-b101-d8140c7d94a0 could not be found. Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd721f2f-0f2f-4315-b101-d8140c7d94a0 could not be found. Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:54:47.403290 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:47.407854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:47.407854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:54:47.407854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:54:47.407854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:54:47.407854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:54:47.407854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd721f2f-0f2f-4315-b101-d8140c7d94a0 could not be found. Sep 16 12:54:47.407854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:54:47.410532 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3167669b-4717-4ffd-ac80-399fba5cd232 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] Returning 404 to user: Instance dd721f2f-0f2f-4315-b101-d8140c7d94a0 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:54:47.411586 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3167669b-4717-4ffd-ac80-399fba5cd232 tempest-InstanceActionsTestJSON-1321990069 tempest-InstanceActionsTestJSON-1321990069-project] 10.222.0.67 "GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0" status: 404 len: 111 microversion: 2.1 time: 0.101193 Sep 16 12:54:47.414342 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1166/2228] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:47 2022] GET /compute/v2.1/servers/dd721f2f-0f2f-4315-b101-d8140c7d94a0 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:54:47.423728 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-188ffc90-c4db-498d-8b40-6b18982f22eb tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:47.427260 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-188ffc90-c4db-498d-8b40-6b18982f22eb tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 5c161179-0b93-4676-86f7-2f507a3ebeb3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:47.445370 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-188ffc90-c4db-498d-8b40-6b18982f22eb tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:47.449062 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-188ffc90-c4db-498d-8b40-6b18982f22eb tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:47.449580 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-188ffc90-c4db-498d-8b40-6b18982f22eb tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:47.450459 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-188ffc90-c4db-498d-8b40-6b18982f22eb tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:47.458106 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-188ffc90-c4db-498d-8b40-6b18982f22eb tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:47.458730 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-188ffc90-c4db-498d-8b40-6b18982f22eb tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:47.525462 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-188ffc90-c4db-498d-8b40-6b18982f22eb tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:47.525659 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-188ffc90-c4db-498d-8b40-6b18982f22eb tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:47.526195 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-188ffc90-c4db-498d-8b40-6b18982f22eb tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:47.526776 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-188ffc90-c4db-498d-8b40-6b18982f22eb tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lazy-loading 'fault' on Instance uuid 5c161179-0b93-4676-86f7-2f507a3ebeb3 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:54:47.796555 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-188ffc90-c4db-498d-8b40-6b18982f22eb tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9101f5af9e34d21bb8e872d337d3545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e41136645964ea98a675833bd73299f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:47.805755 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-848d86c4-10d1-49fd-9911-2e8d64f96e4f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:47.808315 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:54:47.823205 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-848d86c4-10d1-49fd-9911-2e8d64f96e4f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1724 microversion: 2.1 time: 0.701883 Sep 16 12:54:47.823806 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1063/2229] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:47 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1724 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:47.840480 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-188ffc90-c4db-498d-8b40-6b18982f22eb tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3" status: 200 len: 1313 microversion: 2.1 time: 0.421009 Sep 16 12:54:47.841908 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1167/2230] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:47 2022] GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3 => generated 1313 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:47.850341 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6e1a16b7-74e3-4e2a-b0a1-3adaf209b681 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f10358b1040>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:47.982363 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6e1a16b7-74e3-4e2a-b0a1-3adaf209b681 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70" status: 200 len: 1453 microversion: 2.1 time: 0.156705 Sep 16 12:54:47.983536 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1064/2231] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:54:47 2022] GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:48.130003 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ccd97cd0-75a7-46ea-bc63-ab4a1da893ec tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:48.137751 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ccd97cd0-75a7-46ea-bc63-ab4a1da893ec tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: dcadec98-4bc0-4ac3-9dfa-a17b52f40010] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:48.162714 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ccd97cd0-75a7-46ea-bc63-ab4a1da893ec tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:48.165289 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ccd97cd0-75a7-46ea-bc63-ab4a1da893ec tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:48.169046 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ccd97cd0-75a7-46ea-bc63-ab4a1da893ec tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:48.172187 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ccd97cd0-75a7-46ea-bc63-ab4a1da893ec tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:48.174282 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ccd97cd0-75a7-46ea-bc63-ab4a1da893ec tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:48.175508 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ccd97cd0-75a7-46ea-bc63-ab4a1da893ec tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:48.321880 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-314d2326-4153-484a-bd6f-9b344a9bb6f6 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:48.323078 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-314d2326-4153-484a-bd6f-9b344a9bb6f6 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:48.331945 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-314d2326-4153-484a-bd6f-9b344a9bb6f6 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:48.345780 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-314d2326-4153-484a-bd6f-9b344a9bb6f6 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:48.348942 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-314d2326-4153-484a-bd6f-9b344a9bb6f6 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:48.352477 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-314d2326-4153-484a-bd6f-9b344a9bb6f6 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:48.358266 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-314d2326-4153-484a-bd6f-9b344a9bb6f6 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:48.360322 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-314d2326-4153-484a-bd6f-9b344a9bb6f6 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:49.086815 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ccd97cd0-75a7-46ea-bc63-ab4a1da893ec tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:49.102996 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ccd97cd0-75a7-46ea-bc63-ab4a1da893ec tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010" status: 200 len: 1313 microversion: 2.1 time: 0.977511 Sep 16 12:54:49.118971 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1168/2232] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:48 2022] GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010 => generated 1313 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:49.118971 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-66cffa8e-37e4-4038-94ce-6640c5d02dba req-1e71d7e3-3448-4eea-acec-0baafd4cfea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c161179-0b93-4676-86f7-2f507a3ebeb3", "name": "network-vif-deleted", "tag": "d5a5f978-c5f0-4476-91cc-2b79e48ec4a7"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:49.138885 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-66cffa8e-37e4-4038-94ce-6640c5d02dba req-1e71d7e3-3448-4eea-acec-0baafd4cfea6 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:49.140681 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-66cffa8e-37e4-4038-94ce-6640c5d02dba req-1e71d7e3-3448-4eea-acec-0baafd4cfea6 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:49.141584 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-66cffa8e-37e4-4038-94ce-6640c5d02dba req-1e71d7e3-3448-4eea-acec-0baafd4cfea6 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:49.162352 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-66cffa8e-37e4-4038-94ce-6640c5d02dba req-1e71d7e3-3448-4eea-acec-0baafd4cfea6 service nova] Creating event network-vif-deleted:d5a5f978-c5f0-4476-91cc-2b79e48ec4a7 for instance 5c161179-0b93-4676-86f7-2f507a3ebeb3 on n-h1-858094-4 Sep 16 12:54:49.171329 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-66cffa8e-37e4-4038-94ce-6640c5d02dba req-1e71d7e3-3448-4eea-acec-0baafd4cfea6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065976 Sep 16 12:54:49.172625 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1169/2233] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:54:49.181468 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1d321174-9a7f-405c-ad8b-7c74e423ceb3 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:49.182346 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1d321174-9a7f-405c-ad8b-7c74e423ceb3 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:49.205780 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d321174-9a7f-405c-ad8b-7c74e423ceb3 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:49.206808 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d321174-9a7f-405c-ad8b-7c74e423ceb3 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:49.207325 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d321174-9a7f-405c-ad8b-7c74e423ceb3 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:49.208112 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d321174-9a7f-405c-ad8b-7c74e423ceb3 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:49.208662 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d321174-9a7f-405c-ad8b-7c74e423ceb3 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:49.209164 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d321174-9a7f-405c-ad8b-7c74e423ceb3 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:49.240023 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-314d2326-4153-484a-bd6f-9b344a9bb6f6 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:49.253788 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-314d2326-4153-484a-bd6f-9b344a9bb6f6 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1393 microversion: 2.1 time: 0.934700 Sep 16 12:54:49.255837 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1065/2234] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:48 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1393 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:54:49.270519 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6db4fe09-0f44-44a6-b20e-76831995c9d1 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:49.271161 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6db4fe09-0f44-44a6-b20e-76831995c9d1 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] [instance: 5c161179-0b93-4676-86f7-2f507a3ebeb3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:49.296801 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6db4fe09-0f44-44a6-b20e-76831995c9d1 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:49.297678 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6db4fe09-0f44-44a6-b20e-76831995c9d1 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:49.298304 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6db4fe09-0f44-44a6-b20e-76831995c9d1 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:49.299249 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6db4fe09-0f44-44a6-b20e-76831995c9d1 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:49.300854 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6db4fe09-0f44-44a6-b20e-76831995c9d1 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:49.301473 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6db4fe09-0f44-44a6-b20e-76831995c9d1 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:49.345424 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-6db4fe09-0f44-44a6-b20e-76831995c9d1 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] HTTP exception thrown: Instance 5c161179-0b93-4676-86f7-2f507a3ebeb3 could not be found. Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6db4fe09-0f44-44a6-b20e-76831995c9d1 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Request method failure captured: Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3 HTTP/1.1 Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHGPxXZmiUHmt_dft1sdeEgjV0q4vNJkDpEBpD7Lb6hm-ShiDSpwUsuAGMIDYs53IqH8teRtSeFQObdyYjE3XcRcXacV21t-Y8PCaBxxYQREooFypQxs0XfP2jQBOGa7A08HB97lM2M2qPxnRpWViNO6K_WoCZqu2H5gM_K0wP8DNYI Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 1e41136645964ea98a675833bd73299f Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-195341858 Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1e41136645964ea98a675833bd73299f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1e41136645964ea98a675833bd73299f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1e41136645964ea98a675833bd73299f", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1e41136645964ea98a675833bd73299f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-195341858 Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 1e41136645964ea98a675833bd73299f Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-195341858 Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-FloatingIPsAssociationTestJSON-195341858-project Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: b9101f5af9e34d21bb8e872d337d3545 Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-195341858-project Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance 5c161179-0b93-4676-86f7-2f507a3ebeb3 could not be found. Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '5c161179-0b93-4676-86f7-2f507a3ebeb3'} Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c161179-0b93-4676-86f7-2f507a3ebeb3 could not be found. Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c161179-0b93-4676-86f7-2f507a3ebeb3 could not be found. Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:54:49.348653 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:54:49.353042 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:54:49.353042 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:54:49.353042 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:54:49.353042 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:54:49.353042 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:54:49.353042 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:54:49.353042 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c161179-0b93-4676-86f7-2f507a3ebeb3 could not be found. Sep 16 12:54:49.353042 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:54:49.355284 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6db4fe09-0f44-44a6-b20e-76831995c9d1 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] Returning 404 to user: Instance 5c161179-0b93-4676-86f7-2f507a3ebeb3 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:54:49.357160 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6db4fe09-0f44-44a6-b20e-76831995c9d1 tempest-FloatingIPsAssociationTestJSON-195341858 tempest-FloatingIPsAssociationTestJSON-195341858-project] 10.222.0.67 "GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3" status: 404 len: 111 microversion: 2.1 time: 0.098073 Sep 16 12:54:49.358375 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1066/2235] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:49 2022] GET /compute/v2.1/servers/5c161179-0b93-4676-86f7-2f507a3ebeb3 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:54:49.372521 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d368d114-036e-48f8-bc01-9021dd3dfd8a tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f1035463f70>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:49.491226 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d368d114-036e-48f8-bc01-9021dd3dfd8a tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70" status: 200 len: 1453 microversion: 2.1 time: 0.131486 Sep 16 12:54:49.507410 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1067/2236] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:54:49 2022] GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70 => generated 1453 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:49.514058 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5642d8eb-5724-48a3-95ef-93ca77f9316a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a716d145-bf0f-4ddc-91a3-122aa4ae12e7", "device": "/dev/xvdb"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:49.521247 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5642d8eb-5724-48a3-95ef-93ca77f9316a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:49.533755 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5642d8eb-5724-48a3-95ef-93ca77f9316a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:49.534473 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5642d8eb-5724-48a3-95ef-93ca77f9316a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:49.535145 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5642d8eb-5724-48a3-95ef-93ca77f9316a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:49.536017 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5642d8eb-5724-48a3-95ef-93ca77f9316a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:49.536657 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5642d8eb-5724-48a3-95ef-93ca77f9316a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:49.537234 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5642d8eb-5724-48a3-95ef-93ca77f9316a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:49.548080 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1d321174-9a7f-405c-ad8b-7c74e423ceb3 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:49.560792 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1d321174-9a7f-405c-ad8b-7c74e423ceb3 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1724 microversion: 2.1 time: 0.386706 Sep 16 12:54:49.567106 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1170/2237] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:49 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1724 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:50.148547 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2f3164fa-7267-4afc-b97a-f487312b4995 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:50.149985 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2f3164fa-7267-4afc-b97a-f487312b4995 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: dcadec98-4bc0-4ac3-9dfa-a17b52f40010] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:50.167826 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f3164fa-7267-4afc-b97a-f487312b4995 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:50.169238 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f3164fa-7267-4afc-b97a-f487312b4995 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:50.170649 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f3164fa-7267-4afc-b97a-f487312b4995 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:50.180153 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f3164fa-7267-4afc-b97a-f487312b4995 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:50.181065 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f3164fa-7267-4afc-b97a-f487312b4995 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:50.181595 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f3164fa-7267-4afc-b97a-f487312b4995 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:50.206785 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5642d8eb-5724-48a3-95ef-93ca77f9316a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "POST /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.697567 Sep 16 12:54:50.210250 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1068/2238] 10.222.0.67 () {62 vars in 1364 bytes} [Fri Sep 16 12:54:49 2022] POST /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8/os-volume_attachments => generated 194 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:54:50.280681 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8f1de149-f6f0-46da-a806-4c34be569a25 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:50.281822 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8f1de149-f6f0-46da-a806-4c34be569a25 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:50.295811 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8f1de149-f6f0-46da-a806-4c34be569a25 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:50.297046 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8f1de149-f6f0-46da-a806-4c34be569a25 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:50.297822 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8f1de149-f6f0-46da-a806-4c34be569a25 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:50.300522 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8f1de149-f6f0-46da-a806-4c34be569a25 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:50.303347 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8f1de149-f6f0-46da-a806-4c34be569a25 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:50.304023 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8f1de149-f6f0-46da-a806-4c34be569a25 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:50.957560 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8f1de149-f6f0-46da-a806-4c34be569a25 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:50.966501 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8f1de149-f6f0-46da-a806-4c34be569a25 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1393 microversion: 2.1 time: 0.691177 Sep 16 12:54:50.973176 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1069/2239] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:50 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1393 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:50.978929 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-44746398-4d3b-4d59-842e-9cc3a5a09d74 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f103583b430>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:51.065805 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-44746398-4d3b-4d59-842e-9cc3a5a09d74 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70" status: 200 len: 1453 microversion: 2.1 time: 0.091281 Sep 16 12:54:51.066555 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1070/2240] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:54:50 2022] GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70 => generated 1453 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:51.085345 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a7f5f530-5cf0-46be-a410-1517fd20e65b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:51.090499 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a7f5f530-5cf0-46be-a410-1517fd20e65b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:51.117527 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a7f5f530-5cf0-46be-a410-1517fd20e65b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:51.118578 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a7f5f530-5cf0-46be-a410-1517fd20e65b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:51.124771 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a7f5f530-5cf0-46be-a410-1517fd20e65b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:51.127213 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a7f5f530-5cf0-46be-a410-1517fd20e65b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:51.131199 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a7f5f530-5cf0-46be-a410-1517fd20e65b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:51.134875 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a7f5f530-5cf0-46be-a410-1517fd20e65b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:51.268450 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2f3164fa-7267-4afc-b97a-f487312b4995 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:51.278468 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2f3164fa-7267-4afc-b97a-f487312b4995 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010" status: 200 len: 1313 microversion: 2.1 time: 1.144790 Sep 16 12:54:51.283374 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1171/2241] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:50 2022] GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010 => generated 1313 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:51.999194 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3cd05546-0c23-4c5c-b4bf-867b2558391b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:52.000170 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3cd05546-0c23-4c5c-b4bf-867b2558391b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:52.016831 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3cd05546-0c23-4c5c-b4bf-867b2558391b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:52.017803 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3cd05546-0c23-4c5c-b4bf-867b2558391b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:52.026620 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3cd05546-0c23-4c5c-b4bf-867b2558391b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:52.027691 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3cd05546-0c23-4c5c-b4bf-867b2558391b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:52.028407 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3cd05546-0c23-4c5c-b4bf-867b2558391b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:52.029041 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3cd05546-0c23-4c5c-b4bf-867b2558391b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:52.318172 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a7f5f530-5cf0-46be-a410-1517fd20e65b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:52.331486 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a7f5f530-5cf0-46be-a410-1517fd20e65b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1724 microversion: 2.1 time: 1.261816 Sep 16 12:54:52.332308 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1071/2242] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:51 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1724 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:52.380622 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f89b094d-f669-4b2d-81b9-855ffea064fe tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f103572cc10>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:52.486686 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f89b094d-f669-4b2d-81b9-855ffea064fe tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70" status: 200 len: 1453 microversion: 2.1 time: 0.129630 Sep 16 12:54:52.487298 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1072/2243] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:54:52 2022] GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:52.505290 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-006d437a-e882-4be3-b0aa-5bea4c8dbf2d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:52.505603 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-006d437a-e882-4be3-b0aa-5bea4c8dbf2d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: dcadec98-4bc0-4ac3-9dfa-a17b52f40010] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:52.537804 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-006d437a-e882-4be3-b0aa-5bea4c8dbf2d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:52.540712 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-006d437a-e882-4be3-b0aa-5bea4c8dbf2d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:52.541204 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-006d437a-e882-4be3-b0aa-5bea4c8dbf2d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:52.543256 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-006d437a-e882-4be3-b0aa-5bea4c8dbf2d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:52.543745 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-006d437a-e882-4be3-b0aa-5bea4c8dbf2d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:52.553892 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-006d437a-e882-4be3-b0aa-5bea4c8dbf2d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:53.690970 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3cd05546-0c23-4c5c-b4bf-867b2558391b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:53.709686 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-006d437a-e882-4be3-b0aa-5bea4c8dbf2d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:53.716238 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3cd05546-0c23-4c5c-b4bf-867b2558391b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1393 microversion: 2.1 time: 1.719084 Sep 16 12:54:53.719709 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1172/2244] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:51 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1393 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:54:53.729035 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-006d437a-e882-4be3-b0aa-5bea4c8dbf2d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010" status: 200 len: 1313 microversion: 2.1 time: 1.236479 Sep 16 12:54:53.729882 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1073/2245] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:52 2022] GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010 => generated 1313 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:53.752621 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f8eb0307-0da7-430f-959f-b09e7588bd0b tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f103578b280>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:53.756155 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-795a6d63-8ba8-44f0-96f3-14c4416254a6 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:53.768062 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-795a6d63-8ba8-44f0-96f3-14c4416254a6 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:53.779112 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-795a6d63-8ba8-44f0-96f3-14c4416254a6 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:53.797506 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-795a6d63-8ba8-44f0-96f3-14c4416254a6 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:53.798183 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-795a6d63-8ba8-44f0-96f3-14c4416254a6 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:53.799620 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-795a6d63-8ba8-44f0-96f3-14c4416254a6 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:53.801563 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-795a6d63-8ba8-44f0-96f3-14c4416254a6 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:53.803591 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-795a6d63-8ba8-44f0-96f3-14c4416254a6 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:53.817610 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f8eb0307-0da7-430f-959f-b09e7588bd0b tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70" status: 200 len: 1453 microversion: 2.1 time: 0.071999 Sep 16 12:54:53.818512 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1074/2246] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:54:53 2022] GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70 => generated 1453 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:54.748103 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7b5c2e8b-fae9-4f74-97ba-0f76643c268b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:54.748746 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7b5c2e8b-fae9-4f74-97ba-0f76643c268b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:54.765862 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7b5c2e8b-fae9-4f74-97ba-0f76643c268b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:54.767503 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7b5c2e8b-fae9-4f74-97ba-0f76643c268b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:54.774900 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7b5c2e8b-fae9-4f74-97ba-0f76643c268b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:54.775920 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7b5c2e8b-fae9-4f74-97ba-0f76643c268b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:54.776629 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7b5c2e8b-fae9-4f74-97ba-0f76643c268b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:54.777435 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7b5c2e8b-fae9-4f74-97ba-0f76643c268b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:54.983606 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-795a6d63-8ba8-44f0-96f3-14c4416254a6 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:55.005185 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-795a6d63-8ba8-44f0-96f3-14c4416254a6 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1724 microversion: 2.1 time: 1.281697 Sep 16 12:54:55.018932 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1173/2247] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:53 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1724 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:55.037461 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4b21ac45-29df-43a3-ac16-d96d0b3e1786 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:55.040410 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4b21ac45-29df-43a3-ac16-d96d0b3e1786 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: dcadec98-4bc0-4ac3-9dfa-a17b52f40010] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:55.081286 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b21ac45-29df-43a3-ac16-d96d0b3e1786 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:55.081800 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b21ac45-29df-43a3-ac16-d96d0b3e1786 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:55.082252 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b21ac45-29df-43a3-ac16-d96d0b3e1786 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:55.082987 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b21ac45-29df-43a3-ac16-d96d0b3e1786 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:55.083461 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b21ac45-29df-43a3-ac16-d96d0b3e1786 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:55.083892 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b21ac45-29df-43a3-ac16-d96d0b3e1786 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:55.838322 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:54:56.307875 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4b21ac45-29df-43a3-ac16-d96d0b3e1786 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:56.323275 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4b21ac45-29df-43a3-ac16-d96d0b3e1786 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010" status: 200 len: 1313 microversion: 2.1 time: 1.301440 Sep 16 12:54:56.326334 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1174/2248] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:55 2022] GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010 => generated 1313 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:56.349568 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-83502773-6f1c-4a3f-b420-a803f2f04344 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f1035695dc0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:56.489264 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-83502773-6f1c-4a3f-b420-a803f2f04344 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70" status: 200 len: 1453 microversion: 2.1 time: 0.137161 Sep 16 12:54:56.491862 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1175/2249] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:54:56 2022] GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70 => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:56.497284 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0365795e-683c-41f9-8926-d3027454c491 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:56.520114 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0365795e-683c-41f9-8926-d3027454c491 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:56.541311 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0365795e-683c-41f9-8926-d3027454c491 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:56.541827 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0365795e-683c-41f9-8926-d3027454c491 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:56.542276 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0365795e-683c-41f9-8926-d3027454c491 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:56.543019 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0365795e-683c-41f9-8926-d3027454c491 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:56.543481 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0365795e-683c-41f9-8926-d3027454c491 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:56.543916 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0365795e-683c-41f9-8926-d3027454c491 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:56.676508 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7b5c2e8b-fae9-4f74-97ba-0f76643c268b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:56.690841 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7b5c2e8b-fae9-4f74-97ba-0f76643c268b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1383 microversion: 2.1 time: 1.947667 Sep 16 12:54:56.723649 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1075/2250] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:54 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1383 bytes in 1981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:54:56.734055 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-960d9473-688d-4c57-b709-74a370e3bded req-3e1bffe4-edec-4c99-ab08-77961260452c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcadec98-4bc0-4ac3-9dfa-a17b52f40010", "name": "network-vif-plugged", "status": "completed", "tag": "60ac9746-6fd2-4524-bc83-9f6c7c18aa9f"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:54:56.761808 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:54:56.768184 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-960d9473-688d-4c57-b709-74a370e3bded req-3e1bffe4-edec-4c99-ab08-77961260452c service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:56.773184 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-960d9473-688d-4c57-b709-74a370e3bded req-3e1bffe4-edec-4c99-ab08-77961260452c service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:56.774098 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-960d9473-688d-4c57-b709-74a370e3bded req-3e1bffe4-edec-4c99-ab08-77961260452c service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:56.846369 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-960d9473-688d-4c57-b709-74a370e3bded req-3e1bffe4-edec-4c99-ab08-77961260452c service nova] Creating event network-vif-plugged:60ac9746-6fd2-4524-bc83-9f6c7c18aa9f for instance dcadec98-4bc0-4ac3-9dfa-a17b52f40010 on n-h2-858094-4 Sep 16 12:54:56.872768 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-960d9473-688d-4c57-b709-74a370e3bded req-3e1bffe4-edec-4c99-ab08-77961260452c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146214 Sep 16 12:54:56.875849 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1076/2251] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:54:56.900705 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-190ac44e-2a95-45b6-a0ea-7e5e4b2d023d tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Calling method '.version_select at 0x7f10358b64c0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:56.914235 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-190ac44e-2a95-45b6-a0ea-7e5e4b2d023d tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:56.924491 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-190ac44e-2a95-45b6-a0ea-7e5e4b2d023d tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:56.926487 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-190ac44e-2a95-45b6-a0ea-7e5e4b2d023d tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:56.955559 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-190ac44e-2a95-45b6-a0ea-7e5e4b2d023d tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] 10.222.0.67 "GET /compute/v2.1/os-migrations" status: 200 len: 2321 microversion: 2.1 time: 0.072934 Sep 16 12:54:56.978911 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1077/2252] 10.222.0.67 () {58 vars in 1143 bytes} [Fri Sep 16 12:54:56 2022] GET /compute/v2.1/os-migrations => generated 2321 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:56.992289 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-cf7a636e-7a44-47c9-b879-015cd0ad02a8 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:56.993600 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-cf7a636e-7a44-47c9-b879-015cd0ad02a8 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:57.011171 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cf7a636e-7a44-47c9-b879-015cd0ad02a8 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:57.011944 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cf7a636e-7a44-47c9-b879-015cd0ad02a8 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:57.012588 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cf7a636e-7a44-47c9-b879-015cd0ad02a8 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:57.013511 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cf7a636e-7a44-47c9-b879-015cd0ad02a8 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:57.014162 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cf7a636e-7a44-47c9-b879-015cd0ad02a8 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:57.014801 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cf7a636e-7a44-47c9-b879-015cd0ad02a8 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:58.192429 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0365795e-683c-41f9-8926-d3027454c491 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:58.217691 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0365795e-683c-41f9-8926-d3027454c491 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1724 microversion: 2.1 time: 1.724263 Sep 16 12:54:58.218294 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1176/2253] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:56 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1724 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:58.249354 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c1d0f6df-9aac-48a8-9dd3-132c44e330b1 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:58.276519 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c1d0f6df-9aac-48a8-9dd3-132c44e330b1 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: dcadec98-4bc0-4ac3-9dfa-a17b52f40010] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:58.304823 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c1d0f6df-9aac-48a8-9dd3-132c44e330b1 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:58.305860 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c1d0f6df-9aac-48a8-9dd3-132c44e330b1 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:58.307782 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c1d0f6df-9aac-48a8-9dd3-132c44e330b1 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:58.308741 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c1d0f6df-9aac-48a8-9dd3-132c44e330b1 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:58.309392 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c1d0f6df-9aac-48a8-9dd3-132c44e330b1 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:58.310189 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c1d0f6df-9aac-48a8-9dd3-132c44e330b1 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:58.411916 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-cf7a636e-7a44-47c9-b879-015cd0ad02a8 tempest-LiveMigrationTest-1741614437 tempest-LiveMigrationTest-1741614437-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1534 microversion: 2.1 time: 1.431589 Sep 16 12:54:58.412641 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1078/2254] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:56 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1534 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:58.473915 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-34d3b57d-f25c-4533-a504-310c52330323 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f1035739e50>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:58.591050 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-34d3b57d-f25c-4533-a504-310c52330323 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70" status: 200 len: 1453 microversion: 2.1 time: 0.135334 Sep 16 12:54:58.603097 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1079/2255] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:54:58 2022] GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70 => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:58.617366 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d96ad3e7-42c3-44a3-9a48-ee1fc399960f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:58.625537 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d96ad3e7-42c3-44a3-9a48-ee1fc399960f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:58.664942 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d96ad3e7-42c3-44a3-9a48-ee1fc399960f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:58.667840 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d96ad3e7-42c3-44a3-9a48-ee1fc399960f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:58.671859 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d96ad3e7-42c3-44a3-9a48-ee1fc399960f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:58.675037 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d96ad3e7-42c3-44a3-9a48-ee1fc399960f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:58.681232 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d96ad3e7-42c3-44a3-9a48-ee1fc399960f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:58.685429 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d96ad3e7-42c3-44a3-9a48-ee1fc399960f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:58.779312 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d96ad3e7-42c3-44a3-9a48-ee1fc399960f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:54:58.975863 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d96ad3e7-42c3-44a3-9a48-ee1fc399960f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "DELETE /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 204 len: 0 microversion: 2.1 time: 0.368572 Sep 16 12:54:58.979915 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1080/2256] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:54:58 2022] DELETE /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:54:58.992548 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-727b656d-81be-4fd5-acb5-51b194a1316a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:58.993305 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-727b656d-81be-4fd5-acb5-51b194a1316a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:59.015129 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-727b656d-81be-4fd5-acb5-51b194a1316a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:59.015915 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-727b656d-81be-4fd5-acb5-51b194a1316a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:59.017262 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-727b656d-81be-4fd5-acb5-51b194a1316a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:59.021590 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-727b656d-81be-4fd5-acb5-51b194a1316a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:59.022423 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-727b656d-81be-4fd5-acb5-51b194a1316a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:59.023005 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-727b656d-81be-4fd5-acb5-51b194a1316a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:59.237638 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c1d0f6df-9aac-48a8-9dd3-132c44e330b1 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:59.255280 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c1d0f6df-9aac-48a8-9dd3-132c44e330b1 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010" status: 200 len: 1313 microversion: 2.1 time: 1.006612 Sep 16 12:54:59.275704 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1177/2257] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:58 2022] GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010 => generated 1313 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:59.306896 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-25ccc8c5-003c-47a2-a7bb-9d4dec331b9d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:59.307549 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-25ccc8c5-003c-47a2-a7bb-9d4dec331b9d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:54:59.320934 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25ccc8c5-003c-47a2-a7bb-9d4dec331b9d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:59.321976 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25ccc8c5-003c-47a2-a7bb-9d4dec331b9d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:59.327339 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25ccc8c5-003c-47a2-a7bb-9d4dec331b9d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:59.332945 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25ccc8c5-003c-47a2-a7bb-9d4dec331b9d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:54:59.333642 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25ccc8c5-003c-47a2-a7bb-9d4dec331b9d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:54:59.334231 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25ccc8c5-003c-47a2-a7bb-9d4dec331b9d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:54:59.579243 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-727b656d-81be-4fd5-acb5-51b194a1316a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:59.589287 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-727b656d-81be-4fd5-acb5-51b194a1316a tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1389 microversion: 2.1 time: 0.607988 Sep 16 12:54:59.590089 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1081/2258] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:58 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1389 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:59.619759 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f7e3041e-cf47-4297-94ca-6d70d8592335 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f10355b6a60>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:54:59.747018 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f7e3041e-cf47-4297-94ca-6d70d8592335 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70" status: 200 len: 1453 microversion: 2.1 time: 0.133586 Sep 16 12:54:59.747792 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1082/2259] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:54:59 2022] GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70 => generated 1453 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:54:59.849349 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-25ccc8c5-003c-47a2-a7bb-9d4dec331b9d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:54:59.862784 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-25ccc8c5-003c-47a2-a7bb-9d4dec331b9d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1724 microversion: 2.1 time: 0.566379 Sep 16 12:54:59.863370 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1178/2260] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:54:59 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1724 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:00.281739 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-18f52cf5-dddb-4681-81f3-54d7108c94ba tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:00.282593 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-18f52cf5-dddb-4681-81f3-54d7108c94ba tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: dcadec98-4bc0-4ac3-9dfa-a17b52f40010] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:00.300322 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-18f52cf5-dddb-4681-81f3-54d7108c94ba tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:00.303125 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-18f52cf5-dddb-4681-81f3-54d7108c94ba tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:00.306318 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-18f52cf5-dddb-4681-81f3-54d7108c94ba tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:00.307301 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-18f52cf5-dddb-4681-81f3-54d7108c94ba tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:00.307959 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-18f52cf5-dddb-4681-81f3-54d7108c94ba tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:00.311242 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-18f52cf5-dddb-4681-81f3-54d7108c94ba tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:00.660275 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f5980cc3-7e7a-41de-b3a7-0f8cff76df8b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:00.660903 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f5980cc3-7e7a-41de-b3a7-0f8cff76df8b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:00.686210 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5980cc3-7e7a-41de-b3a7-0f8cff76df8b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:00.686731 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5980cc3-7e7a-41de-b3a7-0f8cff76df8b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:00.687169 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5980cc3-7e7a-41de-b3a7-0f8cff76df8b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:00.700031 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5980cc3-7e7a-41de-b3a7-0f8cff76df8b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:00.700588 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5980cc3-7e7a-41de-b3a7-0f8cff76df8b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:00.701048 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5980cc3-7e7a-41de-b3a7-0f8cff76df8b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:02.020465 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-18f52cf5-dddb-4681-81f3-54d7108c94ba tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:02.030863 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-18f52cf5-dddb-4681-81f3-54d7108c94ba tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010" status: 200 len: 1498 microversion: 2.1 time: 1.754800 Sep 16 12:55:02.052573 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1083/2261] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:00 2022] GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010 => generated 1498 bytes in 1778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:02.065445 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-50285b8a-78aa-475a-babd-6c09ff57d317 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f1035ee6550>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:02.176791 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-50285b8a-78aa-475a-babd-6c09ff57d317 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70" status: 200 len: 1453 microversion: 2.1 time: 0.122740 Sep 16 12:55:02.178513 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1084/2262] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:55:02 2022] GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70 => generated 1453 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:02.206621 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2c143d81-912c-4551-92bd-f8ecd673d357 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:02.214131 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-2c143d81-912c-4551-92bd-f8ecd673d357 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:02.244785 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c143d81-912c-4551-92bd-f8ecd673d357 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:02.255364 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c143d81-912c-4551-92bd-f8ecd673d357 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:02.256234 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c143d81-912c-4551-92bd-f8ecd673d357 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:02.258732 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c143d81-912c-4551-92bd-f8ecd673d357 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:02.259830 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f5980cc3-7e7a-41de-b3a7-0f8cff76df8b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:02.260928 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c143d81-912c-4551-92bd-f8ecd673d357 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:02.265641 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c143d81-912c-4551-92bd-f8ecd673d357 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:02.274357 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f5980cc3-7e7a-41de-b3a7-0f8cff76df8b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1389 microversion: 2.1 time: 1.661422 Sep 16 12:55:02.275043 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1179/2263] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:00 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1389 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:02.293472 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dfbc108e-af32-40bc-8ef4-0758ee6a519a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:55:02.303825 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dfbc108e-af32-40bc-8ef4-0758ee6a519a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: dcadec98-4bc0-4ac3-9dfa-a17b52f40010] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:02.315262 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfbc108e-af32-40bc-8ef4-0758ee6a519a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:02.319365 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfbc108e-af32-40bc-8ef4-0758ee6a519a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:02.320012 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfbc108e-af32-40bc-8ef4-0758ee6a519a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:02.321158 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfbc108e-af32-40bc-8ef4-0758ee6a519a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:02.322447 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfbc108e-af32-40bc-8ef4-0758ee6a519a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:02.324375 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfbc108e-af32-40bc-8ef4-0758ee6a519a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:02.394073 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-dfbc108e-af32-40bc-8ef4-0758ee6a519a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lazy-loading 'flavor' on Instance uuid dcadec98-4bc0-4ac3-9dfa-a17b52f40010 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:55:02.432631 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:55:02.594949 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dfbc108e-af32-40bc-8ef4-0758ee6a519a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "POST /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010/action" status: 200 len: 32 microversion: 2.1 time: 0.312535 Sep 16 12:55:02.599870 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1180/2264] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:55:02 2022] POST /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010/action => generated 32 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 12:55:02.608426 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-db4ea031-80e6-4f57-a8f4-93d6af22dca1 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:02.610422 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-db4ea031-80e6-4f57-a8f4-93d6af22dca1 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: dcadec98-4bc0-4ac3-9dfa-a17b52f40010] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:02.627600 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db4ea031-80e6-4f57-a8f4-93d6af22dca1 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:02.628116 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db4ea031-80e6-4f57-a8f4-93d6af22dca1 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:02.628586 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db4ea031-80e6-4f57-a8f4-93d6af22dca1 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:02.629310 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db4ea031-80e6-4f57-a8f4-93d6af22dca1 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:02.629775 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db4ea031-80e6-4f57-a8f4-93d6af22dca1 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:02.636535 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db4ea031-80e6-4f57-a8f4-93d6af22dca1 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:02.870572 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-2c143d81-912c-4551-92bd-f8ecd673d357 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:02.893369 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2c143d81-912c-4551-92bd-f8ecd673d357 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1724 microversion: 2.1 time: 0.713565 Sep 16 12:55:02.894597 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1085/2265] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:02 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1724 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:02.912323 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-64155e09-7e6a-4f10-bb08-e818f7384c47 req-943021ae-d176-43d5-a108-656913a0b158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd1530a2-c78e-419d-a65e-fc5baf53d939", "name": "network-vif-deleted", "tag": "efae6ffd-f514-46a4-ad30-4fa3504874c8"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:55:02.924221 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-64155e09-7e6a-4f10-bb08-e818f7384c47 req-943021ae-d176-43d5-a108-656913a0b158 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:02.924653 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-64155e09-7e6a-4f10-bb08-e818f7384c47 req-943021ae-d176-43d5-a108-656913a0b158 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:02.925078 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-64155e09-7e6a-4f10-bb08-e818f7384c47 req-943021ae-d176-43d5-a108-656913a0b158 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:03.008998 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-64155e09-7e6a-4f10-bb08-e818f7384c47 req-943021ae-d176-43d5-a108-656913a0b158 service nova] Creating event network-vif-deleted:efae6ffd-f514-46a4-ad30-4fa3504874c8 for instance bd1530a2-c78e-419d-a65e-fc5baf53d939 on n-h1-858094-4 Sep 16 12:55:03.038074 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-64155e09-7e6a-4f10-bb08-e818f7384c47 req-943021ae-d176-43d5-a108-656913a0b158 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141887 Sep 16 12:55:03.044103 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1086/2266] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:55:03.153546 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-db4ea031-80e6-4f57-a8f4-93d6af22dca1 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:03.186194 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-db4ea031-80e6-4f57-a8f4-93d6af22dca1 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010" status: 200 len: 1504 microversion: 2.1 time: 0.578864 Sep 16 12:55:03.192665 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1181/2267] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:02 2022] GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010 => generated 1504 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:55:03.195542 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c5a3ecaf-47a2-4990-a21a-015fe25b7674 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f103542b4c0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:03.286089 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c5a3ecaf-47a2-4990-a21a-015fe25b7674 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70" status: 200 len: 1453 microversion: 2.1 time: 0.094835 Sep 16 12:55:03.296299 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1087/2268] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:55:03 2022] GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70 => generated 1453 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:03.299162 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4401b1f0-1199-415f-bae2-b649786d8b33 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:03.299990 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4401b1f0-1199-415f-bae2-b649786d8b33 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:03.311848 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4401b1f0-1199-415f-bae2-b649786d8b33 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:03.321362 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4401b1f0-1199-415f-bae2-b649786d8b33 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:03.322759 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4401b1f0-1199-415f-bae2-b649786d8b33 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:03.324695 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4401b1f0-1199-415f-bae2-b649786d8b33 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:03.329515 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4401b1f0-1199-415f-bae2-b649786d8b33 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:03.330821 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4401b1f0-1199-415f-bae2-b649786d8b33 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:03.922901 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7577fa91-9840-4ca6-b4e0-fe02f1b76d56 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:03.924960 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7577fa91-9840-4ca6-b4e0-fe02f1b76d56 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:03.943257 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7577fa91-9840-4ca6-b4e0-fe02f1b76d56 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:03.949148 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7577fa91-9840-4ca6-b4e0-fe02f1b76d56 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:03.950777 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7577fa91-9840-4ca6-b4e0-fe02f1b76d56 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:03.952517 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7577fa91-9840-4ca6-b4e0-fe02f1b76d56 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:03.956665 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7577fa91-9840-4ca6-b4e0-fe02f1b76d56 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:03.958502 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7577fa91-9840-4ca6-b4e0-fe02f1b76d56 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:03.966824 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4401b1f0-1199-415f-bae2-b649786d8b33 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:03.982808 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4401b1f0-1199-415f-bae2-b649786d8b33 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1184 microversion: 2.1 time: 0.687817 Sep 16 12:55:03.983405 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1182/2269] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:03 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1184 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:55:04.217742 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-99908206-50bb-47ba-9683-1aed154618ea tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:04.218375 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-99908206-50bb-47ba-9683-1aed154618ea tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: dcadec98-4bc0-4ac3-9dfa-a17b52f40010] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:04.239988 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99908206-50bb-47ba-9683-1aed154618ea tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:04.240506 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99908206-50bb-47ba-9683-1aed154618ea tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:04.240966 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99908206-50bb-47ba-9683-1aed154618ea tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:04.254274 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99908206-50bb-47ba-9683-1aed154618ea tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:04.254916 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99908206-50bb-47ba-9683-1aed154618ea tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:04.255343 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99908206-50bb-47ba-9683-1aed154618ea tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:04.599362 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7577fa91-9840-4ca6-b4e0-fe02f1b76d56 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:04.614485 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7577fa91-9840-4ca6-b4e0-fe02f1b76d56 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1724 microversion: 2.1 time: 0.698987 Sep 16 12:55:04.616239 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1088/2270] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:03 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1724 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:04.636755 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-78a64118-b735-451f-9450-6a2939d53ee6 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f103578b790>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:04.716729 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-99908206-50bb-47ba-9683-1aed154618ea tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:04.719004 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-78a64118-b735-451f-9450-6a2939d53ee6 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70" status: 200 len: 1453 microversion: 2.1 time: 0.101371 Sep 16 12:55:04.721074 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1089/2271] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:55:04 2022] GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70 => generated 1453 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:04.726428 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-99908206-50bb-47ba-9683-1aed154618ea tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010" status: 200 len: 1504 microversion: 2.1 time: 0.512824 Sep 16 12:55:04.731184 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1183/2272] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:04 2022] GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010 => generated 1504 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:05.011161 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-790d040b-58fc-45c7-8a63-85b15eac0a20 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:05.011806 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-790d040b-58fc-45c7-8a63-85b15eac0a20 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:05.021528 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-790d040b-58fc-45c7-8a63-85b15eac0a20 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:05.027390 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-790d040b-58fc-45c7-8a63-85b15eac0a20 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:05.035852 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-790d040b-58fc-45c7-8a63-85b15eac0a20 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:05.045211 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-790d040b-58fc-45c7-8a63-85b15eac0a20 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:05.045988 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-790d040b-58fc-45c7-8a63-85b15eac0a20 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:05.046799 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-790d040b-58fc-45c7-8a63-85b15eac0a20 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:05.050925 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:55:05.167967 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-790d040b-58fc-45c7-8a63-85b15eac0a20 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:05.190589 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-790d040b-58fc-45c7-8a63-85b15eac0a20 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1184 microversion: 2.1 time: 0.184536 Sep 16 12:55:05.191204 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1090/2273] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:05 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1184 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:05.640708 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-164ccf34-8032-4ef6-880e-1e89bf159dcc tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:05.641584 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-164ccf34-8032-4ef6-880e-1e89bf159dcc tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:05.654959 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-164ccf34-8032-4ef6-880e-1e89bf159dcc tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:05.655841 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-164ccf34-8032-4ef6-880e-1e89bf159dcc tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:05.660840 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-164ccf34-8032-4ef6-880e-1e89bf159dcc tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:05.662242 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-164ccf34-8032-4ef6-880e-1e89bf159dcc tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:05.663110 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-164ccf34-8032-4ef6-880e-1e89bf159dcc tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:05.663846 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-164ccf34-8032-4ef6-880e-1e89bf159dcc tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:05.734941 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9d91cf00-b28a-437d-9ed5-db13a4b87a36 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f10358deca0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:05.831900 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9d91cf00-b28a-437d-9ed5-db13a4b87a36 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70" status: 200 len: 1453 microversion: 2.1 time: 0.100685 Sep 16 12:55:05.839864 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1091/2274] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:55:05 2022] GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70 => generated 1453 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:05.840753 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-739847bb-f486-415b-82a3-f6fcdf98314b tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:05.842476 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-739847bb-f486-415b-82a3-f6fcdf98314b tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: dcadec98-4bc0-4ac3-9dfa-a17b52f40010] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:05.857854 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-739847bb-f486-415b-82a3-f6fcdf98314b tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:05.858872 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-739847bb-f486-415b-82a3-f6fcdf98314b tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:05.859463 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-739847bb-f486-415b-82a3-f6fcdf98314b tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:05.862329 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-739847bb-f486-415b-82a3-f6fcdf98314b tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:05.864586 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-739847bb-f486-415b-82a3-f6fcdf98314b tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:05.866512 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-739847bb-f486-415b-82a3-f6fcdf98314b tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:06.304194 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-164ccf34-8032-4ef6-880e-1e89bf159dcc tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:06.321447 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-164ccf34-8032-4ef6-880e-1e89bf159dcc tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1724 microversion: 2.1 time: 0.684696 Sep 16 12:55:06.326524 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1184/2275] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:05 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1724 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:06.348445 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7cb01e1f-72de-4b0b-8a9f-c157429f4f3d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:06.356398 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-739847bb-f486-415b-82a3-f6fcdf98314b tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:06.363217 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7cb01e1f-72de-4b0b-8a9f-c157429f4f3d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:06.378432 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-739847bb-f486-415b-82a3-f6fcdf98314b tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010" status: 200 len: 1504 microversion: 2.1 time: 0.540068 Sep 16 12:55:06.393076 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1092/2276] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:05 2022] GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010 => generated 1504 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:06.408991 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cb01e1f-72de-4b0b-8a9f-c157429f4f3d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:06.414870 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cb01e1f-72de-4b0b-8a9f-c157429f4f3d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:06.417056 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cb01e1f-72de-4b0b-8a9f-c157429f4f3d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:06.418791 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cb01e1f-72de-4b0b-8a9f-c157429f4f3d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:06.419531 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cb01e1f-72de-4b0b-8a9f-c157429f4f3d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:06.420276 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cb01e1f-72de-4b0b-8a9f-c157429f4f3d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:06.768911 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7cb01e1f-72de-4b0b-8a9f-c157429f4f3d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:06.784870 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7cb01e1f-72de-4b0b-8a9f-c157429f4f3d tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1184 microversion: 2.1 time: 0.455501 Sep 16 12:55:06.808116 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1185/2277] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:06 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1184 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:06.849182 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-411ab177-5e88-4788-9901-82e3d01f9f50 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f10354d7b80>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:06.943748 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-411ab177-5e88-4788-9901-82e3d01f9f50 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70" status: 200 len: 1453 microversion: 2.1 time: 0.100471 Sep 16 12:55:06.944599 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1093/2278] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:55:06 2022] GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70 => generated 1453 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:07.350678 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d13bc988-a833-4841-8674-6fe9b654f05e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:07.351307 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d13bc988-a833-4841-8674-6fe9b654f05e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:07.362816 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d13bc988-a833-4841-8674-6fe9b654f05e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:07.364099 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d13bc988-a833-4841-8674-6fe9b654f05e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:07.364572 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d13bc988-a833-4841-8674-6fe9b654f05e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:07.365863 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d13bc988-a833-4841-8674-6fe9b654f05e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:07.366331 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d13bc988-a833-4841-8674-6fe9b654f05e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:07.368435 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d13bc988-a833-4841-8674-6fe9b654f05e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:07.408198 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7e169be2-c48e-4857-8e7d-52e62a578bf8 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:07.409584 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7e169be2-c48e-4857-8e7d-52e62a578bf8 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: dcadec98-4bc0-4ac3-9dfa-a17b52f40010] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:07.435113 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7e169be2-c48e-4857-8e7d-52e62a578bf8 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:07.436739 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7e169be2-c48e-4857-8e7d-52e62a578bf8 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:07.437364 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7e169be2-c48e-4857-8e7d-52e62a578bf8 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:07.441160 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7e169be2-c48e-4857-8e7d-52e62a578bf8 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:07.442309 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7e169be2-c48e-4857-8e7d-52e62a578bf8 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:07.443945 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7e169be2-c48e-4857-8e7d-52e62a578bf8 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:07.948200 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d13bc988-a833-4841-8674-6fe9b654f05e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:07.977160 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d13bc988-a833-4841-8674-6fe9b654f05e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1724 microversion: 2.1 time: 0.631086 Sep 16 12:55:07.986257 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1186/2279] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:07 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1724 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:55:07.998411 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0a63a339-dd75-4ee1-89c9-ed7fc69dc4b3 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:07.999278 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0a63a339-dd75-4ee1-89c9-ed7fc69dc4b3 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:08.015131 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a63a339-dd75-4ee1-89c9-ed7fc69dc4b3 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:08.017273 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a63a339-dd75-4ee1-89c9-ed7fc69dc4b3 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:08.017935 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a63a339-dd75-4ee1-89c9-ed7fc69dc4b3 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:08.021446 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7e169be2-c48e-4857-8e7d-52e62a578bf8 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:08.031379 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7e169be2-c48e-4857-8e7d-52e62a578bf8 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010" status: 200 len: 1504 microversion: 2.1 time: 0.626991 Sep 16 12:55:08.036207 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a63a339-dd75-4ee1-89c9-ed7fc69dc4b3 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:08.037030 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a63a339-dd75-4ee1-89c9-ed7fc69dc4b3 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:08.038410 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1094/2280] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:07 2022] GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010 => generated 1504 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:55:08.038796 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a63a339-dd75-4ee1-89c9-ed7fc69dc4b3 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:08.156998 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0a63a339-dd75-4ee1-89c9-ed7fc69dc4b3 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:08.180758 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0a63a339-dd75-4ee1-89c9-ed7fc69dc4b3 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1184 microversion: 2.1 time: 0.192662 Sep 16 12:55:08.181391 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1187/2281] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:07 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1184 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:08.200318 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-df0b9749-fc8f-4293-bc31-c569340e2046 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f10353f0b80>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:08.290115 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-df0b9749-fc8f-4293-bc31-c569340e2046 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70" status: 200 len: 1453 microversion: 2.1 time: 0.103722 Sep 16 12:55:08.294517 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1188/2282] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:55:08 2022] GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70 => generated 1453 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:08.698027 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-df7a9c43-ff9e-4715-981d-6cd13d4a4461 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Action: 'create', calling method: .version_select at 0x7f1035469700>, body: {"keypair": {"name": "tempest-keypair-1064043531", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICDZbXbCaKL7zVcdbku76YtnhM4OLFGIRf7ROhSVFHxkxSjfF1LrB8rNcSCRaMCDTDGDMjWZSLNPL1P+kK8oEYCuk6gG1OTXrkSY9kyBgu+BY8VDiABUJLySuy018ma2A=="}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:55:08.738687 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-df7a9c43-ff9e-4715-981d-6cd13d4a4461 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Getting quotas for project 6e940a963f7740dea44034d06e8c2a77. Resources: {'key_pairs'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:55:08.755928 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-df7a9c43-ff9e-4715-981d-6cd13d4a4461 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Getting quotas for user 37316c1f04764255a2a9466676502c35 and project 6e940a963f7740dea44034d06e8c2a77. Resources: {'key_pairs'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:55:08.812547 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-df7a9c43-ff9e-4715-981d-6cd13d4a4461 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.772525 Sep 16 12:55:08.813671 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1095/2283] 10.222.0.67 () {60 vars in 1159 bytes} [Fri Sep 16 12:55:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:55:09.011866 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9fb4fc68-b200-4b26-8b48-2ea36d37f668 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:09.013356 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9fb4fc68-b200-4b26-8b48-2ea36d37f668 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:09.028747 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9fb4fc68-b200-4b26-8b48-2ea36d37f668 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:09.030968 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9fb4fc68-b200-4b26-8b48-2ea36d37f668 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:09.032614 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9fb4fc68-b200-4b26-8b48-2ea36d37f668 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:09.033599 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f6a4598d-f8dc-4551-9618-27552b28356e tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:09.034165 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f6a4598d-f8dc-4551-9618-27552b28356e tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:09.035589 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9fb4fc68-b200-4b26-8b48-2ea36d37f668 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:09.036987 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9fb4fc68-b200-4b26-8b48-2ea36d37f668 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:09.038602 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9fb4fc68-b200-4b26-8b48-2ea36d37f668 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:09.049713 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f6a4598d-f8dc-4551-9618-27552b28356e tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:09.050228 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f6a4598d-f8dc-4551-9618-27552b28356e tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:09.050676 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f6a4598d-f8dc-4551-9618-27552b28356e tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:09.060674 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f6a4598d-f8dc-4551-9618-27552b28356e tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:09.060674 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f6a4598d-f8dc-4551-9618-27552b28356e tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:09.061172 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f6a4598d-f8dc-4551-9618-27552b28356e tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:10.217925 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-f6a4598d-f8dc-4551-9618-27552b28356e tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lazy-loading 'services' on Instance uuid d49156a2-d78c-4601-a431-e09716c76ce8 {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:55:10.239318 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f6a4598d-f8dc-4551-9618-27552b28356e tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 2422 microversion: 2.25 time: 1.210356 Sep 16 12:55:10.240613 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1096/2284] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:09 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 2422 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:55:10.247148 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6ae865e2-81a2-49da-8480-dd534f54dbd4 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:10.248081 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6ae865e2-81a2-49da-8480-dd534f54dbd4 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: dcadec98-4bc0-4ac3-9dfa-a17b52f40010] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:10.255899 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6ae865e2-81a2-49da-8480-dd534f54dbd4 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:10.257363 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6ae865e2-81a2-49da-8480-dd534f54dbd4 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:10.258028 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6ae865e2-81a2-49da-8480-dd534f54dbd4 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:10.258973 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6ae865e2-81a2-49da-8480-dd534f54dbd4 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:10.259763 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6ae865e2-81a2-49da-8480-dd534f54dbd4 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:10.261225 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6ae865e2-81a2-49da-8480-dd534f54dbd4 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:10.329774 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9fb4fc68-b200-4b26-8b48-2ea36d37f668 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:10.344028 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9fb4fc68-b200-4b26-8b48-2ea36d37f668 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1724 microversion: 2.1 time: 1.337161 Sep 16 12:55:10.345385 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1189/2285] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:09 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1724 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:10.350734 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-82706b16-ab02-4fe9-87be-9389284399c4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:10.352062 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-82706b16-ab02-4fe9-87be-9389284399c4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:10.360002 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82706b16-ab02-4fe9-87be-9389284399c4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:10.360961 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82706b16-ab02-4fe9-87be-9389284399c4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:10.362144 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82706b16-ab02-4fe9-87be-9389284399c4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:10.363473 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82706b16-ab02-4fe9-87be-9389284399c4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:10.364230 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82706b16-ab02-4fe9-87be-9389284399c4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:10.364885 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82706b16-ab02-4fe9-87be-9389284399c4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:10.548983 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-82706b16-ab02-4fe9-87be-9389284399c4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:10.564892 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-82706b16-ab02-4fe9-87be-9389284399c4 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1184 microversion: 2.1 time: 0.218067 Sep 16 12:55:10.573937 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1190/2286] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:10 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1184 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:10.598125 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-188f8a22-fd88-469a-9d5e-4c086ff7c8d9 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f10351904c0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:10.696612 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-188f8a22-fd88-469a-9d5e-4c086ff7c8d9 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70" status: 200 len: 1453 microversion: 2.1 time: 0.119617 Sep 16 12:55:10.704283 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1191/2287] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:55:10 2022] GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70 => generated 1453 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:10.705563 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6ae865e2-81a2-49da-8480-dd534f54dbd4 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:10.720453 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5132ebbc-f1ab-412f-8bce-a61ace2b7e83 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858094-4", "block_migration": "auto"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:55:10.722799 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6ae865e2-81a2-49da-8480-dd534f54dbd4 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010" status: 200 len: 1504 microversion: 2.1 time: 0.476748 Sep 16 12:55:10.724929 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5132ebbc-f1ab-412f-8bce-a61ace2b7e83 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:10.726405 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1097/2288] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:10 2022] GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010 => generated 1504 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:10.738204 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5132ebbc-f1ab-412f-8bce-a61ace2b7e83 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:10.740629 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5132ebbc-f1ab-412f-8bce-a61ace2b7e83 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:10.741198 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5132ebbc-f1ab-412f-8bce-a61ace2b7e83 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:10.742050 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5132ebbc-f1ab-412f-8bce-a61ace2b7e83 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:10.745589 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5132ebbc-f1ab-412f-8bce-a61ace2b7e83 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:10.748749 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5132ebbc-f1ab-412f-8bce-a61ace2b7e83 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:10.819244 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-5132ebbc-f1ab-412f-8bce-a61ace2b7e83 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lazy-loading 'flavor' on Instance uuid d49156a2-d78c-4601-a431-e09716c76ce8 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:55:10.852196 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5132ebbc-f1ab-412f-8bce-a61ace2b7e83 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Going to try to live migrate instance to n-h1-858094-4 {{(pid=128779) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 16 12:55:11.367889 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-042f8954-fda1-41ca-bbe3-9c1acb52968d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:11.370973 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-042f8954-fda1-41ca-bbe3-9c1acb52968d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:11.384209 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-042f8954-fda1-41ca-bbe3-9c1acb52968d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:11.388242 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-042f8954-fda1-41ca-bbe3-9c1acb52968d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:11.391400 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-042f8954-fda1-41ca-bbe3-9c1acb52968d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:11.392380 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-042f8954-fda1-41ca-bbe3-9c1acb52968d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:11.396532 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-042f8954-fda1-41ca-bbe3-9c1acb52968d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:11.400277 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-042f8954-fda1-41ca-bbe3-9c1acb52968d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:12.057387 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-042f8954-fda1-41ca-bbe3-9c1acb52968d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:12.075723 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-042f8954-fda1-41ca-bbe3-9c1acb52968d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1724 microversion: 2.1 time: 0.711587 Sep 16 12:55:12.078229 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1098/2289] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:11 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1724 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:55:12.125278 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-925a16e8-8e10-4b69-bfc5-131ae9e2587b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:12.128776 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-925a16e8-8e10-4b69-bfc5-131ae9e2587b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:12.164203 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-925a16e8-8e10-4b69-bfc5-131ae9e2587b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:12.164893 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-925a16e8-8e10-4b69-bfc5-131ae9e2587b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:12.166794 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-925a16e8-8e10-4b69-bfc5-131ae9e2587b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:12.171522 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-925a16e8-8e10-4b69-bfc5-131ae9e2587b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:12.172351 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-925a16e8-8e10-4b69-bfc5-131ae9e2587b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:12.172907 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-925a16e8-8e10-4b69-bfc5-131ae9e2587b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:12.327266 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-925a16e8-8e10-4b69-bfc5-131ae9e2587b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:12.349449 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-925a16e8-8e10-4b69-bfc5-131ae9e2587b tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 200 len: 1184 microversion: 2.1 time: 0.246236 Sep 16 12:55:12.350779 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1099/2290] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:12 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 1184 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:12.368916 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2c1ed503-e74b-4021-94d7-534c6c41c530 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f103572c160>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:12.485303 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2c1ed503-e74b-4021-94d7-534c6c41c530 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70" status: 200 len: 1453 microversion: 2.1 time: 0.132587 Sep 16 12:55:12.491777 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1100/2291] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:55:12 2022] GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70 => generated 1453 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:12.501708 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-44b25e10-1ae8-46d7-87ca-8587321819e9 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:12.502481 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-44b25e10-1ae8-46d7-87ca-8587321819e9 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: dcadec98-4bc0-4ac3-9dfa-a17b52f40010] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:12.521193 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-44b25e10-1ae8-46d7-87ca-8587321819e9 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:12.523309 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-44b25e10-1ae8-46d7-87ca-8587321819e9 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:12.524495 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-44b25e10-1ae8-46d7-87ca-8587321819e9 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:12.528305 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-44b25e10-1ae8-46d7-87ca-8587321819e9 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:12.529029 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-44b25e10-1ae8-46d7-87ca-8587321819e9 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:12.529617 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-44b25e10-1ae8-46d7-87ca-8587321819e9 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:13.019735 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-44b25e10-1ae8-46d7-87ca-8587321819e9 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:13.028980 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-44b25e10-1ae8-46d7-87ca-8587321819e9 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010" status: 200 len: 1504 microversion: 2.1 time: 0.535670 Sep 16 12:55:13.050343 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1101/2292] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:12 2022] GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010 => generated 1504 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:13.107642 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f0fb03e8-4961-4fdc-8077-f8e79234a257 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:13.108627 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f0fb03e8-4961-4fdc-8077-f8e79234a257 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:13.127354 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f0fb03e8-4961-4fdc-8077-f8e79234a257 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:13.130063 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f0fb03e8-4961-4fdc-8077-f8e79234a257 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:13.133816 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f0fb03e8-4961-4fdc-8077-f8e79234a257 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:13.138668 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f0fb03e8-4961-4fdc-8077-f8e79234a257 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:13.139435 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f0fb03e8-4961-4fdc-8077-f8e79234a257 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:13.140051 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f0fb03e8-4961-4fdc-8077-f8e79234a257 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:13.467463 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f0fb03e8-4961-4fdc-8077-f8e79234a257 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:13.489597 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f0fb03e8-4961-4fdc-8077-f8e79234a257 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1724 microversion: 2.1 time: 0.385928 Sep 16 12:55:13.504924 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1102/2293] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:13 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1724 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:13.540537 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6ac633e9-439e-43d9-845d-b3ac517637e0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:13.541625 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6ac633e9-439e-43d9-845d-b3ac517637e0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: bd1530a2-c78e-419d-a65e-fc5baf53d939] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:13.550100 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6ac633e9-439e-43d9-845d-b3ac517637e0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:13.551993 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6ac633e9-439e-43d9-845d-b3ac517637e0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:13.552656 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6ac633e9-439e-43d9-845d-b3ac517637e0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:13.556415 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6ac633e9-439e-43d9-845d-b3ac517637e0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:13.557148 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6ac633e9-439e-43d9-845d-b3ac517637e0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:13.558721 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6ac633e9-439e-43d9-845d-b3ac517637e0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:13.580686 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-6ac633e9-439e-43d9-845d-b3ac517637e0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] HTTP exception thrown: Instance bd1530a2-c78e-419d-a65e-fc5baf53d939 could not be found. Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6ac633e9-439e-43d9-845d-b3ac517637e0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Request method failure captured: Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 HTTP/1.1 Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHA2k7I_Nlb7ALNJZ9Q994AgJQQSVayIRfXZwkHIKWObv5ojlKNex5wQePttzrHwxCfD_v8XkqrmNTqITWzqKUEvx7gP1nhAAJVgboAk9sHePDTro3y1EuuyPAxHLfA4fiYFESzV7eY_EcJ7TztpomOPr8eDk3XA9yTci_TiYj7fcpE Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: dd7ec914bffb4743921e4116b0c399eb Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-LiveMigrationTest-924693802 Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dd7ec914bffb4743921e4116b0c399eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/dd7ec914bffb4743921e4116b0c399eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_dd7ec914bffb4743921e4116b0c399eb", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dd7ec914bffb4743921e4116b0c399eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-LiveMigrationTest-924693802 Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: dd7ec914bffb4743921e4116b0c399eb Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-LiveMigrationTest-924693802 Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-LiveMigrationTest-924693802-project Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 745ef253e9844572a0f081955b3e9a90 Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-LiveMigrationTest-924693802-project Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance bd1530a2-c78e-419d-a65e-fc5baf53d939 could not be found. Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'bd1530a2-c78e-419d-a65e-fc5baf53d939'} Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd1530a2-c78e-419d-a65e-fc5baf53d939 could not be found. Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd1530a2-c78e-419d-a65e-fc5baf53d939 could not be found. Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:55:13.583927 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:55:13.587929 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:55:13.587929 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:55:13.587929 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:55:13.587929 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:55:13.587929 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:55:13.587929 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd1530a2-c78e-419d-a65e-fc5baf53d939 could not be found. Sep 16 12:55:13.587929 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:55:13.590914 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6ac633e9-439e-43d9-845d-b3ac517637e0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Returning 404 to user: Instance bd1530a2-c78e-419d-a65e-fc5baf53d939 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:55:13.593197 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6ac633e9-439e-43d9-845d-b3ac517637e0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939" status: 404 len: 111 microversion: 2.1 time: 0.086882 Sep 16 12:55:13.597690 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1103/2294] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:13 2022] GET /compute/v2.1/servers/bd1530a2-c78e-419d-a65e-fc5baf53d939 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:55:13.603875 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f1d5c995-4e74-4ae1-87f1-4b59ee97f264 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f10354635e0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:13.667420 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f1d5c995-4e74-4ae1-87f1-4b59ee97f264 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70" status: 200 len: 1462 microversion: 2.1 time: 0.067786 Sep 16 12:55:13.668439 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1104/2295] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:55:13 2022] GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70 => generated 1462 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:13.684573 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7040ad8d-3f22-415a-8c2a-74363eb82790 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f1035b11280>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:13.780724 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7040ad8d-3f22-415a-8c2a-74363eb82790 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70" status: 200 len: 1462 microversion: 2.1 time: 0.101130 Sep 16 12:55:13.784512 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1105/2296] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:55:13 2022] GET /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70 => generated 1462 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:13.800386 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ca6f195f-bd14-47b1-a528-5a99fef11e0a tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:13.801170 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ca6f195f-bd14-47b1-a528-5a99fef11e0a tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] [instance: 5219baf4-bfde-4037-a511-88ff2690ea6a] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:13.814216 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ca6f195f-bd14-47b1-a528-5a99fef11e0a tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:13.815013 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ca6f195f-bd14-47b1-a528-5a99fef11e0a tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:13.816449 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ca6f195f-bd14-47b1-a528-5a99fef11e0a tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:13.817490 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ca6f195f-bd14-47b1-a528-5a99fef11e0a tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:13.818262 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ca6f195f-bd14-47b1-a528-5a99fef11e0a tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:13.819087 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ca6f195f-bd14-47b1-a528-5a99fef11e0a tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:14.097242 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ca6f195f-bd14-47b1-a528-5a99fef11e0a tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63998619bf654ebb8d74f91e42c8c780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e81fca8624d18b9415a46e158d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:14.109915 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ca6f195f-bd14-47b1-a528-5a99fef11e0a tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/servers/5219baf4-bfde-4037-a511-88ff2690ea6a" status: 200 len: 1466 microversion: 2.1 time: 0.315028 Sep 16 12:55:14.115912 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1106/2297] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:13 2022] GET /compute/v2.1/servers/5219baf4-bfde-4037-a511-88ff2690ea6a => generated 1466 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:14.129414 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-38920f0f-1b59-486b-892d-d4d7d938e041 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:14.130089 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-38920f0f-1b59-486b-892d-d4d7d938e041 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: dcadec98-4bc0-4ac3-9dfa-a17b52f40010] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:14.153694 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-38920f0f-1b59-486b-892d-d4d7d938e041 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:14.153890 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-38920f0f-1b59-486b-892d-d4d7d938e041 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:14.154663 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-38920f0f-1b59-486b-892d-d4d7d938e041 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:14.156109 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-38920f0f-1b59-486b-892d-d4d7d938e041 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:14.156607 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-38920f0f-1b59-486b-892d-d4d7d938e041 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:14.157041 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-38920f0f-1b59-486b-892d-d4d7d938e041 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:14.356453 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5132ebbc-f1ab-412f-8bce-a61ace2b7e83 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8/action" status: 202 len: 0 microversion: 2.25 time: 3.649095 Sep 16 12:55:14.357304 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1192/2298] 10.222.0.67 () {62 vars in 1319 bytes} [Fri Sep 16 12:55:10 2022] POST /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8/action => generated 0 bytes in 3651 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:55:14.363997 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-612730dc-9d6b-4ae3-b236-3d444ff30d8c tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f1035a61af0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:14.606338 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-38920f0f-1b59-486b-892d-d4d7d938e041 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:14.623370 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-612730dc-9d6b-4ae3-b236-3d444ff30d8c tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images?changes-since=2022-09-16T12%3A52%3A49Z" status: 200 len: 1902 microversion: 2.1 time: 0.262971 Sep 16 12:55:14.625624 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1193/2299] 10.222.0.67 () {58 vars in 1199 bytes} [Fri Sep 16 12:55:14 2022] GET /compute/v2.1/images?changes-since=2022-09-16T12%3A52%3A49Z => generated 1902 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:14.636437 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-38920f0f-1b59-486b-892d-d4d7d938e041 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010" status: 200 len: 1504 microversion: 2.1 time: 0.518678 Sep 16 12:55:14.639469 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1107/2300] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:14 2022] GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010 => generated 1504 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:14.641520 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f334e9c5-2644-47ba-9b5a-21835fb146c1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1606663628", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": [{"uuid": "d07f81e7-3dc4-4b39-ad5d-bffdea9cea45"}], "security_groups": [{"name": "tempest-securitygroup--691017496"}], "key_name": "tempest-keypair-1064043531", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:55:14.645500 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3cac2244-5735-4381-8d6f-334185cba372 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:14.646356 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3cac2244-5735-4381-8d6f-334185cba372 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:14.656454 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3cac2244-5735-4381-8d6f-334185cba372 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:14.676374 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3cac2244-5735-4381-8d6f-334185cba372 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:14.680063 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3cac2244-5735-4381-8d6f-334185cba372 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:14.682222 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3cac2244-5735-4381-8d6f-334185cba372 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:14.689530 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3cac2244-5735-4381-8d6f-334185cba372 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:14.690304 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3cac2244-5735-4381-8d6f-334185cba372 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:15.446296 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-f334e9c5-2644-47ba-9b5a-21835fb146c1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] validate_networks() for [('d07f81e7-3dc4-4b39-ad5d-bffdea9cea45', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:55:15.686649 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3cac2244-5735-4381-8d6f-334185cba372 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:15.706825 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3cac2244-5735-4381-8d6f-334185cba372 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:15.708892 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3cac2244-5735-4381-8d6f-334185cba372 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:15.710634 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3cac2244-5735-4381-8d6f-334185cba372 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 1814 microversion: 2.25 time: 1.069919 Sep 16 12:55:15.711386 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1108/2301] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:14 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 1814 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:55:15.737283 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-313d4f1f-e7e0-4146-9774-1ce8095ad0e0 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:15.744355 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-313d4f1f-e7e0-4146-9774-1ce8095ad0e0 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:15.753896 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-313d4f1f-e7e0-4146-9774-1ce8095ad0e0 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:15.754682 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-313d4f1f-e7e0-4146-9774-1ce8095ad0e0 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:15.755334 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-313d4f1f-e7e0-4146-9774-1ce8095ad0e0 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:15.756262 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-313d4f1f-e7e0-4146-9774-1ce8095ad0e0 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:15.756916 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-313d4f1f-e7e0-4146-9774-1ce8095ad0e0 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:15.757524 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-313d4f1f-e7e0-4146-9774-1ce8095ad0e0 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:16.349443 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-313d4f1f-e7e0-4146-9774-1ce8095ad0e0 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:16.360301 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-313d4f1f-e7e0-4146-9774-1ce8095ad0e0 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1701 microversion: 2.1 time: 0.635989 Sep 16 12:55:16.377238 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1109/2302] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:15 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1701 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:16.389645 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-024b0569-39db-4745-aa91-47f0665f264e tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f1035469820>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:16.539649 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-024b0569-39db-4745-aa91-47f0665f264e tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-710034981" status: 200 len: 484 microversion: 2.1 time: 0.160982 Sep 16 12:55:16.543270 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1110/2303] 10.222.0.67 () {58 vars in 1229 bytes} [Fri Sep 16 12:55:16 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-710034981 => generated 484 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:55:16.553890 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c9a01d77-2c11-4c0a-bb81-aafc0a5f91e5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:16.560950 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c9a01d77-2c11-4c0a-bb81-aafc0a5f91e5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: dcadec98-4bc0-4ac3-9dfa-a17b52f40010] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:16.571161 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c9a01d77-2c11-4c0a-bb81-aafc0a5f91e5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:16.574837 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c9a01d77-2c11-4c0a-bb81-aafc0a5f91e5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:16.575308 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c9a01d77-2c11-4c0a-bb81-aafc0a5f91e5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:16.576069 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c9a01d77-2c11-4c0a-bb81-aafc0a5f91e5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:16.576570 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c9a01d77-2c11-4c0a-bb81-aafc0a5f91e5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:16.577007 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c9a01d77-2c11-4c0a-bb81-aafc0a5f91e5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:18.217175 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-f334e9c5-2644-47ba-9b5a-21835fb146c1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:55:18.218335 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-f334e9c5-2644-47ba-9b5a-21835fb146c1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:55:18.219169 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-f334e9c5-2644-47ba-9b5a-21835fb146c1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:55:18.220422 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-f334e9c5-2644-47ba-9b5a-21835fb146c1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:55:18.226752 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c9a01d77-2c11-4c0a-bb81-aafc0a5f91e5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:18.230670 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-f334e9c5-2644-47ba-9b5a-21835fb146c1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:55:18.249835 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=58 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:55:18.254936 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c9a01d77-2c11-4c0a-bb81-aafc0a5f91e5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010" status: 200 len: 1504 microversion: 2.1 time: 1.707339 Sep 16 12:55:18.258559 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1111/2304] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:16 2022] GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010 => generated 1504 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:18.276062 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f334e9c5-2644-47ba-9b5a-21835fb146c1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:18.276891 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1a9490b4-5606-400e-aa8c-86b17cc9f3f8 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:55:18.277765 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f334e9c5-2644-47ba-9b5a-21835fb146c1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:18.281355 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f334e9c5-2644-47ba-9b5a-21835fb146c1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:18.284311 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f334e9c5-2644-47ba-9b5a-21835fb146c1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:18.285575 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f334e9c5-2644-47ba-9b5a-21835fb146c1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:18.289409 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f334e9c5-2644-47ba-9b5a-21835fb146c1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:18.302059 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1a9490b4-5606-400e-aa8c-86b17cc9f3f8 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:18.303429 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1a9490b4-5606-400e-aa8c-86b17cc9f3f8 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:18.305793 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1a9490b4-5606-400e-aa8c-86b17cc9f3f8 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:18.338458 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-f334e9c5-2644-47ba-9b5a-21835fb146c1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Getting quotas for project 6e940a963f7740dea44034d06e8c2a77. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:55:18.350183 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-f334e9c5-2644-47ba-9b5a-21835fb146c1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Getting quotas for user 37316c1f04764255a2a9466676502c35 and project 6e940a963f7740dea44034d06e8c2a77. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:55:18.389662 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f334e9c5-2644-47ba-9b5a-21835fb146c1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:55:18.391854 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f334e9c5-2644-47ba-9b5a-21835fb146c1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 8d3df84c-ed0d-41a9-8632-63591274c2eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:55:18.393444 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-1a9490b4-5606-400e-aa8c-86b17cc9f3f8 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Going to try to start instance {{(pid=128780) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 16 12:55:18.507782 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1a9490b4-5606-400e-aa8c-86b17cc9f3f8 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "POST /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88/action" status: 202 len: 0 microversion: 2.1 time: 0.246790 Sep 16 12:55:18.510114 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1112/2305] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:55:18 2022] POST /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:55:18.529643 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6c6738a7-cf9d-4b5a-830b-3ece41644a1f tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f10358fa430>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:18.600034 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f334e9c5-2644-47ba-9b5a-21835fb146c1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.968445 Sep 16 12:55:18.612409 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1194/2306] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:55:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 3986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:55:18.627908 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7c6f02ed-5403-42e1-931c-d6a5bd02ee8a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:18.628825 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7c6f02ed-5403-42e1-931c-d6a5bd02ee8a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:18.649939 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c6f02ed-5403-42e1-931c-d6a5bd02ee8a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:18.651223 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c6f02ed-5403-42e1-931c-d6a5bd02ee8a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:18.655271 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c6f02ed-5403-42e1-931c-d6a5bd02ee8a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:18.659565 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c6f02ed-5403-42e1-931c-d6a5bd02ee8a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:18.660400 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c6f02ed-5403-42e1-931c-d6a5bd02ee8a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:18.662432 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c6f02ed-5403-42e1-931c-d6a5bd02ee8a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:18.771613 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=4 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:55:19.288519 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7c6f02ed-5403-42e1-931c-d6a5bd02ee8a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:19.320623 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7c6f02ed-5403-42e1-931c-d6a5bd02ee8a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:19.324173 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7c6f02ed-5403-42e1-931c-d6a5bd02ee8a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:19.325976 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7c6f02ed-5403-42e1-931c-d6a5bd02ee8a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 1814 microversion: 2.25 time: 0.712192 Sep 16 12:55:19.334022 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1195/2307] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:18 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 1814 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:55:19.343302 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-095128f4-071b-4ea2-8f43-69b2afd04207 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:19.350964 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-095128f4-071b-4ea2-8f43-69b2afd04207 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:19.366448 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-095128f4-071b-4ea2-8f43-69b2afd04207 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:19.376802 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-095128f4-071b-4ea2-8f43-69b2afd04207 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:19.378254 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-095128f4-071b-4ea2-8f43-69b2afd04207 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:19.379391 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-095128f4-071b-4ea2-8f43-69b2afd04207 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:19.380146 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-095128f4-071b-4ea2-8f43-69b2afd04207 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:19.386495 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-095128f4-071b-4ea2-8f43-69b2afd04207 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:19.528021 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6c6738a7-cf9d-4b5a-830b-3ece41644a1f tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images?server=5219baf4-bfde-4037-a511-88ff2690ea6a" status: 200 len: 958 microversion: 2.1 time: 1.011826 Sep 16 12:55:19.533185 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1113/2308] 10.222.0.67 () {58 vars in 1209 bytes} [Fri Sep 16 12:55:18 2022] GET /compute/v2.1/images?server=5219baf4-bfde-4037-a511-88ff2690ea6a => generated 958 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:55:19.554932 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-81708d95-f954-4719-90fe-e2a66beb7813 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:19.560632 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-81708d95-f954-4719-90fe-e2a66beb7813 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 8d3df84c-ed0d-41a9-8632-63591274c2eb] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:19.759715 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-81708d95-f954-4719-90fe-e2a66beb7813 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37316c1f04764255a2a9466676502c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e940a963f7740dea44034d06e8c2a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:19.770706 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-81708d95-f954-4719-90fe-e2a66beb7813 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb" status: 200 len: 1242 microversion: 2.1 time: 0.236068 Sep 16 12:55:19.773894 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1114/2309] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:19 2022] GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb => generated 1242 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:19.797267 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1d1148ce-1a6a-4aa5-8d21-203ca89e39df tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:19.801995 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-1d1148ce-1a6a-4aa5-8d21-203ca89e39df tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: dcadec98-4bc0-4ac3-9dfa-a17b52f40010] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:19.827198 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1d1148ce-1a6a-4aa5-8d21-203ca89e39df tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:19.828093 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1d1148ce-1a6a-4aa5-8d21-203ca89e39df tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:19.828720 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1d1148ce-1a6a-4aa5-8d21-203ca89e39df tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:19.833709 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-095128f4-071b-4ea2-8f43-69b2afd04207 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:19.835134 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1d1148ce-1a6a-4aa5-8d21-203ca89e39df tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:19.835670 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1d1148ce-1a6a-4aa5-8d21-203ca89e39df tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:19.836139 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1d1148ce-1a6a-4aa5-8d21-203ca89e39df tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:19.848984 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-095128f4-071b-4ea2-8f43-69b2afd04207 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1710 microversion: 2.1 time: 0.511179 Sep 16 12:55:19.851062 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1196/2310] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:19 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1710 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:19.875836 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-27d434bb-342f-41a0-baf7-3a51e8f1dc80 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f1035a9a670>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:19.938546 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:55:19.991236 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-27d434bb-342f-41a0-baf7-3a51e8f1dc80 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.67%2Fcompute%2Fv2.1%2Fservers%2Fc97d5f35-6ea1-4ec7-88f5-9da9dbe81182" status: 200 len: 485 microversion: 2.1 time: 0.138630 Sep 16 12:55:19.993590 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1197/2311] 10.222.0.67 () {58 vars in 1317 bytes} [Fri Sep 16 12:55:19 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.67%2Fcompute%2Fv2.1%2Fservers%2Fc97d5f35-6ea1-4ec7-88f5-9da9dbe81182 => generated 485 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:55:20.009734 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d02f18e7-4053-4588-9160-4af43b7ccd41 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f103514f670>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:20.160894 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d02f18e7-4053-4588-9160-4af43b7ccd41 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.67%2Fcompute%2Fservers%2Fc97d5f35-6ea1-4ec7-88f5-9da9dbe81182" status: 200 len: 485 microversion: 2.1 time: 0.155516 Sep 16 12:55:20.161991 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1198/2312] 10.222.0.67 () {58 vars in 1303 bytes} [Fri Sep 16 12:55:20 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.67%2Fcompute%2Fservers%2Fc97d5f35-6ea1-4ec7-88f5-9da9dbe81182 => generated 485 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:55:20.179063 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-218e7586-4e41-46ec-bdc7-aa53365f6392 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f10351955e0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:20.299402 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1d1148ce-1a6a-4aa5-8d21-203ca89e39df tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:20.315858 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1d1148ce-1a6a-4aa5-8d21-203ca89e39df tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010" status: 200 len: 1504 microversion: 2.1 time: 0.536294 Sep 16 12:55:20.332153 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1115/2313] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:19 2022] GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010 => generated 1504 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:20.365083 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9b26d47c-527f-4261-99c0-6326f1163b0b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:20.375032 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9b26d47c-527f-4261-99c0-6326f1163b0b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:20.396637 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9b26d47c-527f-4261-99c0-6326f1163b0b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:20.397141 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9b26d47c-527f-4261-99c0-6326f1163b0b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:20.398129 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9b26d47c-527f-4261-99c0-6326f1163b0b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:20.398871 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9b26d47c-527f-4261-99c0-6326f1163b0b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:20.399330 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9b26d47c-527f-4261-99c0-6326f1163b0b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:20.401210 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9b26d47c-527f-4261-99c0-6326f1163b0b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:20.733882 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-218e7586-4e41-46ec-bdc7-aa53365f6392 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.562491 Sep 16 12:55:20.737598 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1199/2314] 10.222.0.67 () {58 vars in 1149 bytes} [Fri Sep 16 12:55:20 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:20.743907 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-bddee145-c716-4176-b7ac-726cd363e7ce req-146443ad-467a-4947-a2ae-f1f69016919d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5219baf4-bfde-4037-a511-88ff2690ea6a", "name": "network-vif-unplugged", "status": "completed", "tag": "537bc282-546d-4a7e-b32f-2149067cc012"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:55:20.789289 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bddee145-c716-4176-b7ac-726cd363e7ce req-146443ad-467a-4947-a2ae-f1f69016919d service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:20.789780 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bddee145-c716-4176-b7ac-726cd363e7ce req-146443ad-467a-4947-a2ae-f1f69016919d service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:20.790219 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bddee145-c716-4176-b7ac-726cd363e7ce req-146443ad-467a-4947-a2ae-f1f69016919d service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:20.844774 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9b26d47c-527f-4261-99c0-6326f1163b0b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:20.846485 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-bddee145-c716-4176-b7ac-726cd363e7ce req-146443ad-467a-4947-a2ae-f1f69016919d service nova] Creating event network-vif-unplugged:537bc282-546d-4a7e-b32f-2149067cc012 for instance 5219baf4-bfde-4037-a511-88ff2690ea6a on n-h2-858094-4 Sep 16 12:55:20.854416 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9b26d47c-527f-4261-99c0-6326f1163b0b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:20.855912 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9b26d47c-527f-4261-99c0-6326f1163b0b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:20.873532 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9b26d47c-527f-4261-99c0-6326f1163b0b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 1814 microversion: 2.25 time: 0.517182 Sep 16 12:55:20.877809 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-bddee145-c716-4176-b7ac-726cd363e7ce req-146443ad-467a-4947-a2ae-f1f69016919d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.123147 Sep 16 12:55:20.887804 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1200/2315] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:55:20.896107 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1116/2316] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:20 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 1814 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:55:20.907696 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-25aac080-622f-4ad3-9eaf-a79721a9f188 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f1035695700>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:20.915124 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c06fa980-8800-4dcf-897d-cb2416be42df tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:20.915779 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c06fa980-8800-4dcf-897d-cb2416be42df tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 8d3df84c-ed0d-41a9-8632-63591274c2eb] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:20.934496 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c06fa980-8800-4dcf-897d-cb2416be42df tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:20.935191 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c06fa980-8800-4dcf-897d-cb2416be42df tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:20.935631 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c06fa980-8800-4dcf-897d-cb2416be42df tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:20.953896 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c06fa980-8800-4dcf-897d-cb2416be42df tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:20.954506 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c06fa980-8800-4dcf-897d-cb2416be42df tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:20.954951 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c06fa980-8800-4dcf-897d-cb2416be42df tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:21.039833 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-25aac080-622f-4ad3-9eaf-a79721a9f188 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1431 microversion: 2.1 time: 0.150544 Sep 16 12:55:21.051229 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1201/2317] 10.222.0.67 () {58 vars in 1149 bytes} [Fri Sep 16 12:55:20 2022] GET /compute/v2.1/images?type=snapshot => generated 1431 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:21.056655 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e13e9ef9-a60d-4bbd-82f4-d42297a3541d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:21.060615 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e13e9ef9-a60d-4bbd-82f4-d42297a3541d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:21.095162 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e13e9ef9-a60d-4bbd-82f4-d42297a3541d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:21.096362 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e13e9ef9-a60d-4bbd-82f4-d42297a3541d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:21.097042 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e13e9ef9-a60d-4bbd-82f4-d42297a3541d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:21.098256 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e13e9ef9-a60d-4bbd-82f4-d42297a3541d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:21.098959 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e13e9ef9-a60d-4bbd-82f4-d42297a3541d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:21.099616 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e13e9ef9-a60d-4bbd-82f4-d42297a3541d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:21.120167 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c06fa980-8800-4dcf-897d-cb2416be42df tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37316c1f04764255a2a9466676502c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e940a963f7740dea44034d06e8c2a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:21.145838 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:55:21.152844 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c06fa980-8800-4dcf-897d-cb2416be42df tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb" status: 200 len: 1294 microversion: 2.1 time: 0.255450 Sep 16 12:55:21.155772 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1117/2318] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:20 2022] GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb => generated 1294 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:21.170381 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3f1f99a4-b99f-48fd-8554-87ee2a884be6 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f1039b460d0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:21.367652 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3f1f99a4-b99f-48fd-8554-87ee2a884be6 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.208947 Sep 16 12:55:21.368414 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1118/2319] 10.222.0.67 () {58 vars in 1137 bytes} [Fri Sep 16 12:55:21 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:55:21.392085 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9677ec31-a68f-4370-b634-c593cdd21e07 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:21.392759 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9677ec31-a68f-4370-b634-c593cdd21e07 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: dcadec98-4bc0-4ac3-9dfa-a17b52f40010] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:21.426116 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9677ec31-a68f-4370-b634-c593cdd21e07 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:21.426552 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9677ec31-a68f-4370-b634-c593cdd21e07 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:21.427005 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9677ec31-a68f-4370-b634-c593cdd21e07 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:21.437910 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9677ec31-a68f-4370-b634-c593cdd21e07 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:21.438666 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9677ec31-a68f-4370-b634-c593cdd21e07 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:21.439125 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9677ec31-a68f-4370-b634-c593cdd21e07 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:21.760535 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e13e9ef9-a60d-4bbd-82f4-d42297a3541d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:21.775152 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e13e9ef9-a60d-4bbd-82f4-d42297a3541d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1710 microversion: 2.1 time: 0.722481 Sep 16 12:55:21.780935 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1202/2320] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:21 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1710 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:21.809358 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-85c162fe-f133-4349-b469-dc0004920067 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f1035632790>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:22.127953 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9677ec31-a68f-4370-b634-c593cdd21e07 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:22.144522 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9677ec31-a68f-4370-b634-c593cdd21e07 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010" status: 200 len: 1504 microversion: 2.1 time: 0.770838 Sep 16 12:55:22.151452 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1119/2321] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:21 2022] GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010 => generated 1504 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:22.164324 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e8fcbd9c-06d3-4203-8f81-ea9a9818f35e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:22.164989 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e8fcbd9c-06d3-4203-8f81-ea9a9818f35e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:22.191543 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-85c162fe-f133-4349-b469-dc0004920067 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/detail?changes-since=2022-09-16T12%3A52%3A43Z" status: 200 len: 6326 microversion: 2.1 time: 0.408545 Sep 16 12:55:22.197037 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e8fcbd9c-06d3-4203-8f81-ea9a9818f35e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:22.197645 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e8fcbd9c-06d3-4203-8f81-ea9a9818f35e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:22.201884 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e8fcbd9c-06d3-4203-8f81-ea9a9818f35e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:22.204061 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e8fcbd9c-06d3-4203-8f81-ea9a9818f35e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:22.206522 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1203/2322] 10.222.0.67 () {58 vars in 1220 bytes} [Fri Sep 16 12:55:21 2022] GET /compute/v2.1/images/detail?changes-since=2022-09-16T12%3A52%3A43Z => generated 6326 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:22.206928 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e8fcbd9c-06d3-4203-8f81-ea9a9818f35e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:22.208828 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e8fcbd9c-06d3-4203-8f81-ea9a9818f35e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:22.219009 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ecdb2d04-110c-4156-b32d-7699ed829ac7 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:22.219845 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ecdb2d04-110c-4156-b32d-7699ed829ac7 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 8d3df84c-ed0d-41a9-8632-63591274c2eb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:22.239321 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecdb2d04-110c-4156-b32d-7699ed829ac7 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:22.242695 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecdb2d04-110c-4156-b32d-7699ed829ac7 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:22.246170 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecdb2d04-110c-4156-b32d-7699ed829ac7 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:22.248714 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecdb2d04-110c-4156-b32d-7699ed829ac7 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:22.253826 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecdb2d04-110c-4156-b32d-7699ed829ac7 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:22.254589 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecdb2d04-110c-4156-b32d-7699ed829ac7 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:22.484814 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ecdb2d04-110c-4156-b32d-7699ed829ac7 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37316c1f04764255a2a9466676502c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e940a963f7740dea44034d06e8c2a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:22.499276 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ecdb2d04-110c-4156-b32d-7699ed829ac7 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb" status: 200 len: 1300 microversion: 2.1 time: 0.291321 Sep 16 12:55:22.499867 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1204/2323] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:22 2022] GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb => generated 1300 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:22.504643 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bfd7f790-2d48-4ff8-8f41-008dfa508260 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f1035632670>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:22.593564 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bfd7f790-2d48-4ff8-8f41-008dfa508260 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-710034981" status: 200 len: 664 microversion: 2.1 time: 0.092450 Sep 16 12:55:22.594167 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1205/2324] 10.222.0.67 () {58 vars in 1250 bytes} [Fri Sep 16 12:55:22 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-710034981 => generated 664 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:55:22.609856 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fdefc540-1595-47a8-9cc2-b504e9826c31 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f1035a21550>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:22.806967 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e8fcbd9c-06d3-4203-8f81-ea9a9818f35e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:22.815811 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fdefc540-1595-47a8-9cc2-b504e9826c31 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.67%2Fcompute%2Fv2.1%2Fservers%2Fc97d5f35-6ea1-4ec7-88f5-9da9dbe81182" status: 200 len: 1465 microversion: 2.1 time: 0.205800 Sep 16 12:55:22.830020 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1206/2325] 10.222.0.67 () {58 vars in 1338 bytes} [Fri Sep 16 12:55:22 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.67%2Fcompute%2Fv2.1%2Fservers%2Fc97d5f35-6ea1-4ec7-88f5-9da9dbe81182 => generated 1465 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:55:22.832561 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e8fcbd9c-06d3-4203-8f81-ea9a9818f35e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:22.843464 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e8fcbd9c-06d3-4203-8f81-ea9a9818f35e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:22.844759 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e8fcbd9c-06d3-4203-8f81-ea9a9818f35e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 1814 microversion: 2.25 time: 0.690136 Sep 16 12:55:22.853288 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1120/2326] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:22 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 1814 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:55:22.858185 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-335a785b-dac5-4664-ae6b-6510b2772501 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f10358b6430>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:22.862250 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a82b462e-c620-458f-90c3-950e2082d1d7 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:22.862892 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a82b462e-c620-458f-90c3-950e2082d1d7 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:22.893571 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a82b462e-c620-458f-90c3-950e2082d1d7 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:22.896545 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a82b462e-c620-458f-90c3-950e2082d1d7 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:22.897246 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a82b462e-c620-458f-90c3-950e2082d1d7 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:22.898969 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a82b462e-c620-458f-90c3-950e2082d1d7 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:22.899449 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a82b462e-c620-458f-90c3-950e2082d1d7 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:22.900037 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a82b462e-c620-458f-90c3-950e2082d1d7 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:22.966739 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-335a785b-dac5-4664-ae6b-6510b2772501 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.67%2Fcompute%2Fservers%2Fc97d5f35-6ea1-4ec7-88f5-9da9dbe81182" status: 200 len: 1465 microversion: 2.1 time: 0.112289 Sep 16 12:55:22.967647 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1121/2327] 10.222.0.67 () {58 vars in 1324 bytes} [Fri Sep 16 12:55:22 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.67%2Fcompute%2Fservers%2Fc97d5f35-6ea1-4ec7-88f5-9da9dbe81182 => generated 1465 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:22.984673 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-90227946-aa48-49a1-835e-18255a431bb5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:22.985181 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-90227946-aa48-49a1-835e-18255a431bb5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:23.005112 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-90227946-aa48-49a1-835e-18255a431bb5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:23.005524 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-90227946-aa48-49a1-835e-18255a431bb5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:23.005970 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-90227946-aa48-49a1-835e-18255a431bb5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:23.006689 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-90227946-aa48-49a1-835e-18255a431bb5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:23.007146 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-90227946-aa48-49a1-835e-18255a431bb5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:23.007572 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-90227946-aa48-49a1-835e-18255a431bb5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:23.096717 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-90227946-aa48-49a1-835e-18255a431bb5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:55:23.375636 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-90227946-aa48-49a1-835e-18255a431bb5 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 204 len: 0 microversion: 2.1 time: 0.405324 Sep 16 12:55:23.378542 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1122/2328] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:55:22 2022] DELETE /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:55:23.393647 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6b09c004-8d25-45f2-8cff-cf927dd8cbca tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f10363a3310>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:23.445929 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a82b462e-c620-458f-90c3-950e2082d1d7 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:23.455136 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a82b462e-c620-458f-90c3-950e2082d1d7 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1714 microversion: 2.1 time: 0.623944 Sep 16 12:55:23.463160 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1207/2329] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:22 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1714 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:23.481755 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b1af5c0c-497d-4b40-b92c-08cc9be6363c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:23.483151 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b1af5c0c-497d-4b40-b92c-08cc9be6363c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: dcadec98-4bc0-4ac3-9dfa-a17b52f40010] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:23.505214 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1af5c0c-497d-4b40-b92c-08cc9be6363c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:23.512296 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1af5c0c-497d-4b40-b92c-08cc9be6363c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:23.512834 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1af5c0c-497d-4b40-b92c-08cc9be6363c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:23.513613 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1af5c0c-497d-4b40-b92c-08cc9be6363c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:23.514095 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1af5c0c-497d-4b40-b92c-08cc9be6363c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:23.514533 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1af5c0c-497d-4b40-b92c-08cc9be6363c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:23.676801 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6b09c004-8d25-45f2-8cff-cf927dd8cbca tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7101 microversion: 2.1 time: 0.296698 Sep 16 12:55:23.710887 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1123/2330] 10.222.0.67 () {58 vars in 1170 bytes} [Fri Sep 16 12:55:23 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7101 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:23.725273 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-09873a64-0607-4758-a158-46cd3c63a3c3 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:23.726082 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-09873a64-0607-4758-a158-46cd3c63a3c3 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:23.743253 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-09873a64-0607-4758-a158-46cd3c63a3c3 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:23.745783 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-09873a64-0607-4758-a158-46cd3c63a3c3 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:23.746685 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-09873a64-0607-4758-a158-46cd3c63a3c3 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:23.747818 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-09873a64-0607-4758-a158-46cd3c63a3c3 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:23.750011 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-09873a64-0607-4758-a158-46cd3c63a3c3 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:23.750653 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-09873a64-0607-4758-a158-46cd3c63a3c3 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:24.169733 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b1af5c0c-497d-4b40-b92c-08cc9be6363c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:24.184288 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b1af5c0c-497d-4b40-b92c-08cc9be6363c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010" status: 200 len: 1504 microversion: 2.1 time: 0.719548 Sep 16 12:55:24.204618 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1208/2331] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:23 2022] GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010 => generated 1504 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:24.218581 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-11ac42fb-dee6-4f86-b003-fbabdbd1f6d7 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:24.230262 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-11ac42fb-dee6-4f86-b003-fbabdbd1f6d7 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 8d3df84c-ed0d-41a9-8632-63591274c2eb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:24.247087 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11ac42fb-dee6-4f86-b003-fbabdbd1f6d7 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:24.247980 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11ac42fb-dee6-4f86-b003-fbabdbd1f6d7 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:24.248671 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11ac42fb-dee6-4f86-b003-fbabdbd1f6d7 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:24.263418 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11ac42fb-dee6-4f86-b003-fbabdbd1f6d7 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:24.270228 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11ac42fb-dee6-4f86-b003-fbabdbd1f6d7 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:24.271266 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11ac42fb-dee6-4f86-b003-fbabdbd1f6d7 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:24.369407 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-09873a64-0607-4758-a158-46cd3c63a3c3 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:24.382669 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-09873a64-0607-4758-a158-46cd3c63a3c3 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1666 microversion: 2.1 time: 0.670468 Sep 16 12:55:24.388142 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1124/2332] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:23 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1666 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:24.405999 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-68d3f2cc-0b75-4981-b3cd-af68e6ec826b tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f10354699d0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:24.462172 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-11ac42fb-dee6-4f86-b003-fbabdbd1f6d7 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37316c1f04764255a2a9466676502c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e940a963f7740dea44034d06e8c2a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:24.477864 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-11ac42fb-dee6-4f86-b003-fbabdbd1f6d7 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb" status: 200 len: 1300 microversion: 2.1 time: 0.271074 Sep 16 12:55:24.490721 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1209/2333] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:24 2022] GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb => generated 1300 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:24.503643 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7767aeb8-6919-4930-bb25-d81c611d3ded tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:24.504512 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7767aeb8-6919-4930-bb25-d81c611d3ded tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:24.510998 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7767aeb8-6919-4930-bb25-d81c611d3ded tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:24.513036 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7767aeb8-6919-4930-bb25-d81c611d3ded tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:24.513769 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7767aeb8-6919-4930-bb25-d81c611d3ded tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:24.514678 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7767aeb8-6919-4930-bb25-d81c611d3ded tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:24.515316 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7767aeb8-6919-4930-bb25-d81c611d3ded tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:24.515961 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7767aeb8-6919-4930-bb25-d81c611d3ded tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:24.571663 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-68d3f2cc-0b75-4981-b3cd-af68e6ec826b tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4371 microversion: 2.1 time: 0.181462 Sep 16 12:55:24.575194 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1125/2334] 10.222.0.67 () {58 vars in 1170 bytes} [Fri Sep 16 12:55:24 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:24.695660 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d6eaa668-8dc8-4930-b1ed-f59a25aa6fcf tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-389791182", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": [{"uuid": "4f690fd7-a007-4db5-a7d2-6b0378c9fb20"}]}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:55:24.792878 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-d6eaa668-8dc8-4930-b1ed-f59a25aa6fcf tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] validate_networks() for [('4f690fd7-a007-4db5-a7d2-6b0378c9fb20', None, None, None, None, None)] {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:55:25.369580 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7767aeb8-6919-4930-bb25-d81c611d3ded tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:25.398799 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7767aeb8-6919-4930-bb25-d81c611d3ded tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:25.409112 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7767aeb8-6919-4930-bb25-d81c611d3ded tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:25.412602 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7767aeb8-6919-4930-bb25-d81c611d3ded tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 1814 microversion: 2.25 time: 0.917561 Sep 16 12:55:25.416459 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1210/2335] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:24 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 1814 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:55:25.437781 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8ad2e1a4-97a6-4077-8b9e-ccd6c944cdc3 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f10359e5ee0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:25.534525 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8ad2e1a4-97a6-4077-8b9e-ccd6c944cdc3 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/7df4548b-8809-4742-80bd-4e4e6dcafc91" status: 200 len: 784 microversion: 2.1 time: 0.116694 Sep 16 12:55:25.535756 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1211/2336] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:55:25 2022] GET /compute/v2.1/images/7df4548b-8809-4742-80bd-4e4e6dcafc91 => generated 784 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:55:25.546697 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1e3b0384-5327-4f6e-86d9-7a7d70a7c2a0 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:25.553742 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1e3b0384-5327-4f6e-86d9-7a7d70a7c2a0 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: dcadec98-4bc0-4ac3-9dfa-a17b52f40010] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:25.574608 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1e3b0384-5327-4f6e-86d9-7a7d70a7c2a0 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:25.575155 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1e3b0384-5327-4f6e-86d9-7a7d70a7c2a0 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:25.575605 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1e3b0384-5327-4f6e-86d9-7a7d70a7c2a0 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:25.584899 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1e3b0384-5327-4f6e-86d9-7a7d70a7c2a0 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:25.587246 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1e3b0384-5327-4f6e-86d9-7a7d70a7c2a0 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:25.590649 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1e3b0384-5327-4f6e-86d9-7a7d70a7c2a0 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:26.022357 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-d6eaa668-8dc8-4930-b1ed-f59a25aa6fcf tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:55:26.022839 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-d6eaa668-8dc8-4930-b1ed-f59a25aa6fcf tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:55:26.023311 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-d6eaa668-8dc8-4930-b1ed-f59a25aa6fcf tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:55:26.023734 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-d6eaa668-8dc8-4930-b1ed-f59a25aa6fcf tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:55:26.024182 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-d6eaa668-8dc8-4930-b1ed-f59a25aa6fcf tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:55:26.043823 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1e3b0384-5327-4f6e-86d9-7a7d70a7c2a0 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:26.055879 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1e3b0384-5327-4f6e-86d9-7a7d70a7c2a0 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010" status: 200 len: 1504 microversion: 2.1 time: 0.516984 Sep 16 12:55:26.057791 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1212/2337] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:25 2022] GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010 => generated 1504 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:26.065243 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d6eaa668-8dc8-4930-b1ed-f59a25aa6fcf tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:26.066943 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d6eaa668-8dc8-4930-b1ed-f59a25aa6fcf tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:26.068571 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d6eaa668-8dc8-4930-b1ed-f59a25aa6fcf tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:26.069486 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d6eaa668-8dc8-4930-b1ed-f59a25aa6fcf tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:26.071757 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d6eaa668-8dc8-4930-b1ed-f59a25aa6fcf tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:26.071883 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-78df7e89-0190-4f73-937e-928ac74a215c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:26.072303 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d6eaa668-8dc8-4930-b1ed-f59a25aa6fcf tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:26.072432 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-78df7e89-0190-4f73-937e-928ac74a215c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:26.093906 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78df7e89-0190-4f73-937e-928ac74a215c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:26.094518 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78df7e89-0190-4f73-937e-928ac74a215c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:26.094873 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78df7e89-0190-4f73-937e-928ac74a215c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:26.103372 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78df7e89-0190-4f73-937e-928ac74a215c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:26.105435 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78df7e89-0190-4f73-937e-928ac74a215c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:26.106466 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78df7e89-0190-4f73-937e-928ac74a215c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:26.193958 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-d6eaa668-8dc8-4930-b1ed-f59a25aa6fcf tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Getting quotas for project c88ea8e8750c440e86d3c1eb4ab6110e. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:55:26.203109 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-d6eaa668-8dc8-4930-b1ed-f59a25aa6fcf tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Getting quotas for user 973378f0eed8476eb41a29d5ce57ed65 and project c88ea8e8750c440e86d3c1eb4ab6110e. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:55:26.224942 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:55:26.227645 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d6eaa668-8dc8-4930-b1ed-f59a25aa6fcf tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:55:26.231127 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d6eaa668-8dc8-4930-b1ed-f59a25aa6fcf tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:55:26.305106 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-78df7e89-0190-4f73-937e-928ac74a215c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:26.321831 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-78df7e89-0190-4f73-937e-928ac74a215c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1598 microversion: 2.1 time: 0.260772 Sep 16 12:55:26.322461 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1213/2338] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:26 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1598 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:26.327268 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0e74acdf-9979-4f75-b7e0-1cee0a4c70e6 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:26.327891 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0e74acdf-9979-4f75-b7e0-1cee0a4c70e6 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 8d3df84c-ed0d-41a9-8632-63591274c2eb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:26.349218 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e74acdf-9979-4f75-b7e0-1cee0a4c70e6 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:26.349977 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e74acdf-9979-4f75-b7e0-1cee0a4c70e6 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:26.351181 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e74acdf-9979-4f75-b7e0-1cee0a4c70e6 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:26.352098 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e74acdf-9979-4f75-b7e0-1cee0a4c70e6 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:26.352752 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e74acdf-9979-4f75-b7e0-1cee0a4c70e6 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:26.353340 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e74acdf-9979-4f75-b7e0-1cee0a4c70e6 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:26.356503 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d6eaa668-8dc8-4930-b1ed-f59a25aa6fcf tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.779330 Sep 16 12:55:26.358558 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1126/2339] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:55:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:55:26.363615 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d1b01105-0ac1-4812-8148-f9f63b6158aa tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f103583caf0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:26.596370 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d1b01105-0ac1-4812-8148-f9f63b6158aa tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.236584 Sep 16 12:55:26.597206 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1127/2340] 10.222.0.67 () {58 vars in 1158 bytes} [Fri Sep 16 12:55:26 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:26.623369 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-70c27ea0-a9c9-42c6-8171-fcdcb9c303b7 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:26.638627 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-70c27ea0-a9c9-42c6-8171-fcdcb9c303b7 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:27.042444 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-70c27ea0-a9c9-42c6-8171-fcdcb9c303b7 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:27.055389 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-70c27ea0-a9c9-42c6-8171-fcdcb9c303b7 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e" status: 200 len: 1224 microversion: 2.1 time: 0.456951 Sep 16 12:55:27.057716 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1128/2341] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:26 2022] GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e => generated 1224 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:27.099846 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ce991137-35c8-4c8e-b125-0e0896b6b467 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:27.100712 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ce991137-35c8-4c8e-b125-0e0896b6b467 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:27.142817 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce991137-35c8-4c8e-b125-0e0896b6b467 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:27.143418 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce991137-35c8-4c8e-b125-0e0896b6b467 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:27.143879 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce991137-35c8-4c8e-b125-0e0896b6b467 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:27.144674 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce991137-35c8-4c8e-b125-0e0896b6b467 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:27.145139 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce991137-35c8-4c8e-b125-0e0896b6b467 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:27.145574 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce991137-35c8-4c8e-b125-0e0896b6b467 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:27.291368 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0e74acdf-9979-4f75-b7e0-1cee0a4c70e6 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37316c1f04764255a2a9466676502c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e940a963f7740dea44034d06e8c2a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:27.306284 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0e74acdf-9979-4f75-b7e0-1cee0a4c70e6 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb" status: 200 len: 1367 microversion: 2.1 time: 0.982576 Sep 16 12:55:27.321882 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1214/2342] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:26 2022] GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb => generated 1367 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:27.340812 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-616ec556-5054-44c5-82d7-b0363b2781e4 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f10351bd280>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:27.658680 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ce991137-35c8-4c8e-b125-0e0896b6b467 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:27.677357 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ce991137-35c8-4c8e-b125-0e0896b6b467 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:27.687191 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ce991137-35c8-4c8e-b125-0e0896b6b467 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:27.693128 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ce991137-35c8-4c8e-b125-0e0896b6b467 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 1814 microversion: 2.25 time: 0.613134 Sep 16 12:55:27.697059 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1129/2343] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:27 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 1814 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:55:27.709653 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c62726c8-e5ab-4b6a-8996-025c404ab85c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:27.732464 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c62726c8-e5ab-4b6a-8996-025c404ab85c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: dcadec98-4bc0-4ac3-9dfa-a17b52f40010] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:27.753259 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c62726c8-e5ab-4b6a-8996-025c404ab85c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:27.755071 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c62726c8-e5ab-4b6a-8996-025c404ab85c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:27.759007 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c62726c8-e5ab-4b6a-8996-025c404ab85c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:27.761779 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c62726c8-e5ab-4b6a-8996-025c404ab85c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:27.763253 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c62726c8-e5ab-4b6a-8996-025c404ab85c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:27.766131 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c62726c8-e5ab-4b6a-8996-025c404ab85c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:28.323077 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:55:28.373764 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:55:28.533720 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c62726c8-e5ab-4b6a-8996-025c404ab85c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:28.543636 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c62726c8-e5ab-4b6a-8996-025c404ab85c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010" status: 200 len: 1504 microversion: 2.1 time: 0.841688 Sep 16 12:55:28.552415 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1130/2344] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:27 2022] GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010 => generated 1504 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:28.571049 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-f76ceb7e-b6ca-4beb-85b4-3164fd36c6b4 req-322f3ead-1b81-441d-a33b-a0b19d85360d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3085e02c-a09e-4bc5-a8c4-87ab1cedfc16", "name": "network-vif-deleted", "tag": "065308fc-710e-4f14-b3d0-e976788d4def"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:55:28.610653 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-f76ceb7e-b6ca-4beb-85b4-3164fd36c6b4 req-322f3ead-1b81-441d-a33b-a0b19d85360d service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:28.611166 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-f76ceb7e-b6ca-4beb-85b4-3164fd36c6b4 req-322f3ead-1b81-441d-a33b-a0b19d85360d service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:28.611705 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-f76ceb7e-b6ca-4beb-85b4-3164fd36c6b4 req-322f3ead-1b81-441d-a33b-a0b19d85360d service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:28.664411 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-f76ceb7e-b6ca-4beb-85b4-3164fd36c6b4 req-322f3ead-1b81-441d-a33b-a0b19d85360d service nova] Creating event network-vif-deleted:065308fc-710e-4f14-b3d0-e976788d4def for instance 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 on n-h2-858094-4 Sep 16 12:55:28.687503 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-f76ceb7e-b6ca-4beb-85b4-3164fd36c6b4 req-322f3ead-1b81-441d-a33b-a0b19d85360d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132966 Sep 16 12:55:28.696861 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1131/2345] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:55:28.721081 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8bd60668-6f03-4eec-a657-e0dbe6fa81bd tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:28.722423 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8bd60668-6f03-4eec-a657-e0dbe6fa81bd tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:28.743437 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bd60668-6f03-4eec-a657-e0dbe6fa81bd tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:28.743940 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bd60668-6f03-4eec-a657-e0dbe6fa81bd tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:28.744521 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bd60668-6f03-4eec-a657-e0dbe6fa81bd tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:28.748509 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bd60668-6f03-4eec-a657-e0dbe6fa81bd tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:28.751436 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bd60668-6f03-4eec-a657-e0dbe6fa81bd tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:28.755187 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bd60668-6f03-4eec-a657-e0dbe6fa81bd tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:28.879224 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bd60668-6f03-4eec-a657-e0dbe6fa81bd tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:28.881561 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bd60668-6f03-4eec-a657-e0dbe6fa81bd tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:28.882732 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bd60668-6f03-4eec-a657-e0dbe6fa81bd tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:28.884858 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-8bd60668-6f03-4eec-a657-e0dbe6fa81bd tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lazy-loading 'fault' on Instance uuid 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:55:28.970823 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8bd60668-6f03-4eec-a657-e0dbe6fa81bd tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:28.983986 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8bd60668-6f03-4eec-a657-e0dbe6fa81bd tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 200 len: 1323 microversion: 2.1 time: 0.284277 Sep 16 12:55:28.996191 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1132/2346] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:28 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 1323 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:29.004085 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-88e78447-ef43-4929-a83b-feed8d7d62bf tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:29.004894 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-88e78447-ef43-4929-a83b-feed8d7d62bf tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:29.020439 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-88e78447-ef43-4929-a83b-feed8d7d62bf tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:29.023225 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-88e78447-ef43-4929-a83b-feed8d7d62bf tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:29.024482 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-88e78447-ef43-4929-a83b-feed8d7d62bf tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:29.027236 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-88e78447-ef43-4929-a83b-feed8d7d62bf tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:29.027852 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-88e78447-ef43-4929-a83b-feed8d7d62bf tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:29.029807 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-88e78447-ef43-4929-a83b-feed8d7d62bf tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:29.106418 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-616ec556-5054-44c5-82d7-b0363b2781e4 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "DELETE /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70" status: 204 len: 0 microversion: 2.1 time: 1.781828 Sep 16 12:55:29.107550 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1215/2347] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:27 2022] DELETE /compute/v2.1/images/65b6d749-31fe-4fe0-a93e-6c131fbfdd70 => generated 0 bytes in 1785 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:55:29.236187 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8f3e2a5a-699b-46ab-a4a1-d8073ee2c19a tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-580974821", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": [{"uuid": "5ac72d42-af2b-460f-9eec-dac013f5a977"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:55:29.298452 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-88e78447-ef43-4929-a83b-feed8d7d62bf tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:29.311112 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-88e78447-ef43-4929-a83b-feed8d7d62bf tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e" status: 200 len: 1220 microversion: 2.1 time: 0.321738 Sep 16 12:55:29.315590 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1133/2348] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:28 2022] GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e => generated 1220 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:29.344021 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-8f3e2a5a-699b-46ab-a4a1-d8073ee2c19a tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] validate_networks() for [('5ac72d42-af2b-460f-9eec-dac013f5a977', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:55:29.351282 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e6a1eb0d-3e08-49b6-8268-a8710428a981 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:29.351964 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e6a1eb0d-3e08-49b6-8268-a8710428a981 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 8d3df84c-ed0d-41a9-8632-63591274c2eb] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:29.365716 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e6a1eb0d-3e08-49b6-8268-a8710428a981 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:29.367045 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e6a1eb0d-3e08-49b6-8268-a8710428a981 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:29.367562 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e6a1eb0d-3e08-49b6-8268-a8710428a981 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:29.370029 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e6a1eb0d-3e08-49b6-8268-a8710428a981 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:29.374922 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e6a1eb0d-3e08-49b6-8268-a8710428a981 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:29.375516 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e6a1eb0d-3e08-49b6-8268-a8710428a981 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:30.382390 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e6a1eb0d-3e08-49b6-8268-a8710428a981 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37316c1f04764255a2a9466676502c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e940a963f7740dea44034d06e8c2a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:30.396788 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e6a1eb0d-3e08-49b6-8268-a8710428a981 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb" status: 200 len: 1367 microversion: 2.1 time: 1.066714 Sep 16 12:55:30.397673 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1134/2349] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:29 2022] GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb => generated 1367 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:30.408518 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7ae04888-7069-471a-9ea8-5db70d88c551 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:30.415009 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7ae04888-7069-471a-9ea8-5db70d88c551 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:30.433323 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7ae04888-7069-471a-9ea8-5db70d88c551 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:30.434266 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7ae04888-7069-471a-9ea8-5db70d88c551 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:30.434963 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7ae04888-7069-471a-9ea8-5db70d88c551 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:30.435912 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7ae04888-7069-471a-9ea8-5db70d88c551 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:30.436617 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7ae04888-7069-471a-9ea8-5db70d88c551 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:30.437262 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7ae04888-7069-471a-9ea8-5db70d88c551 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:31.415845 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7ae04888-7069-471a-9ea8-5db70d88c551 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:31.437916 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7ae04888-7069-471a-9ea8-5db70d88c551 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:31.443532 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7ae04888-7069-471a-9ea8-5db70d88c551 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:31.448428 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7ae04888-7069-471a-9ea8-5db70d88c551 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 1814 microversion: 2.25 time: 1.049356 Sep 16 12:55:31.451745 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1135/2350] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:30 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 1814 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:55:31.478888 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4a096113-a6cf-43c4-82bf-7a57920f8bd3 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f103542b4c0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:31.770230 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-8f3e2a5a-699b-46ab-a4a1-d8073ee2c19a tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:55:31.770745 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-8f3e2a5a-699b-46ab-a4a1-d8073ee2c19a tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:55:31.772039 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-8f3e2a5a-699b-46ab-a4a1-d8073ee2c19a tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:55:31.772914 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-8f3e2a5a-699b-46ab-a4a1-d8073ee2c19a tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:55:31.773413 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-8f3e2a5a-699b-46ab-a4a1-d8073ee2c19a tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:55:31.797769 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f3e2a5a-699b-46ab-a4a1-d8073ee2c19a tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:31.798472 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f3e2a5a-699b-46ab-a4a1-d8073ee2c19a tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:31.798990 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f3e2a5a-699b-46ab-a4a1-d8073ee2c19a tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:31.799815 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f3e2a5a-699b-46ab-a4a1-d8073ee2c19a tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:31.800404 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f3e2a5a-699b-46ab-a4a1-d8073ee2c19a tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:31.800915 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f3e2a5a-699b-46ab-a4a1-d8073ee2c19a tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:31.823497 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-8f3e2a5a-699b-46ab-a4a1-d8073ee2c19a tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Getting quotas for project a66c708b229645a6afdae93e4b5b1b0c. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:55:31.833692 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-8f3e2a5a-699b-46ab-a4a1-d8073ee2c19a tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Getting quotas for user 550acfff5ad24023b78badaca2bc6909 and project a66c708b229645a6afdae93e4b5b1b0c. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:55:31.853720 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8f3e2a5a-699b-46ab-a4a1-d8073ee2c19a tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:55:31.856633 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8f3e2a5a-699b-46ab-a4a1-d8073ee2c19a tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] [instance: aa4ce353-1393-4c5a-a229-6aee69ce030c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:55:31.926898 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8f3e2a5a-699b-46ab-a4a1-d8073ee2c19a tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.816591 Sep 16 12:55:31.928291 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1216/2351] 10.222.0.67 () {62 vars in 1188 bytes} [Fri Sep 16 12:55:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2820 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 16 12:55:31.934146 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-dda18440-9282-444a-a599-3e283d8df40c req-65e1b8be-abe1-4913-91cf-b556ff120ea7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d3df84c-ed0d-41a9-8632-63591274c2eb", "tag": "efcaf7d0-199c-4298-8d5d-68962f80ca3b"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:55:31.956040 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dda18440-9282-444a-a599-3e283d8df40c req-65e1b8be-abe1-4913-91cf-b556ff120ea7 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:31.956656 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dda18440-9282-444a-a599-3e283d8df40c req-65e1b8be-abe1-4913-91cf-b556ff120ea7 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:31.957617 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dda18440-9282-444a-a599-3e283d8df40c req-65e1b8be-abe1-4913-91cf-b556ff120ea7 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:31.976293 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-dda18440-9282-444a-a599-3e283d8df40c req-65e1b8be-abe1-4913-91cf-b556ff120ea7 service nova] Creating event network-changed:efcaf7d0-199c-4298-8d5d-68962f80ca3b for instance 8d3df84c-ed0d-41a9-8632-63591274c2eb on n-h1-858094-4 Sep 16 12:55:31.987184 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-dda18440-9282-444a-a599-3e283d8df40c req-65e1b8be-abe1-4913-91cf-b556ff120ea7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057282 Sep 16 12:55:31.988771 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1217/2352] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:55:31.998574 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-88479e93-70db-456b-b4e1-ce6f3602f405 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:31.999502 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-88479e93-70db-456b-b4e1-ce6f3602f405 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: dcadec98-4bc0-4ac3-9dfa-a17b52f40010] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:32.008995 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88479e93-70db-456b-b4e1-ce6f3602f405 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:32.009740 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88479e93-70db-456b-b4e1-ce6f3602f405 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:32.010386 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88479e93-70db-456b-b4e1-ce6f3602f405 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:32.011188 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88479e93-70db-456b-b4e1-ce6f3602f405 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:32.011722 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88479e93-70db-456b-b4e1-ce6f3602f405 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:32.012350 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88479e93-70db-456b-b4e1-ce6f3602f405 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:32.260026 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-88479e93-70db-456b-b4e1-ce6f3602f405 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:32.271537 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-88479e93-70db-456b-b4e1-ce6f3602f405 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010" status: 200 len: 1484 microversion: 2.1 time: 0.281041 Sep 16 12:55:32.273337 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1218/2353] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:31 2022] GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010 => generated 1484 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:32.281115 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4c017051-0a6e-4b6a-80f5-ae24df2e50c0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:32.282019 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4c017051-0a6e-4b6a-80f5-ae24df2e50c0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:32.288903 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c017051-0a6e-4b6a-80f5-ae24df2e50c0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:32.290119 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c017051-0a6e-4b6a-80f5-ae24df2e50c0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:32.291358 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c017051-0a6e-4b6a-80f5-ae24df2e50c0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:32.292343 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c017051-0a6e-4b6a-80f5-ae24df2e50c0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:32.293107 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c017051-0a6e-4b6a-80f5-ae24df2e50c0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:32.295313 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c017051-0a6e-4b6a-80f5-ae24df2e50c0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:32.317934 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-4c017051-0a6e-4b6a-80f5-ae24df2e50c0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] HTTP exception thrown: Instance 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 could not be found. Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4c017051-0a6e-4b6a-80f5-ae24df2e50c0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Request method failure captured: Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 HTTP/1.1 Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHA2k7I_Nlb7ALNJZ9Q994AgJQQSVayIRfXZwkHIKWObv5ojlKNex5wQePttzrHwxCfD_v8XkqrmNTqITWzqKUEvx7gP1nhAAJVgboAk9sHePDTro3y1EuuyPAxHLfA4fiYFESzV7eY_EcJ7TztpomOPr8eDk3XA9yTci_TiYj7fcpE Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: dd7ec914bffb4743921e4116b0c399eb Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-LiveMigrationTest-924693802 Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dd7ec914bffb4743921e4116b0c399eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/dd7ec914bffb4743921e4116b0c399eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_dd7ec914bffb4743921e4116b0c399eb", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dd7ec914bffb4743921e4116b0c399eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-LiveMigrationTest-924693802 Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: dd7ec914bffb4743921e4116b0c399eb Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-LiveMigrationTest-924693802 Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-LiveMigrationTest-924693802-project Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 745ef253e9844572a0f081955b3e9a90 Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-LiveMigrationTest-924693802-project Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 could not be found. Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '3085e02c-a09e-4bc5-a8c4-87ab1cedfc16'} Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 could not be found. Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 could not be found. Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:55:32.319801 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:55:32.323542 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:55:32.323542 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:55:32.323542 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:55:32.323542 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:55:32.323542 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:55:32.323542 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 could not be found. Sep 16 12:55:32.323542 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:55:32.323542 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4c017051-0a6e-4b6a-80f5-ae24df2e50c0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Returning 404 to user: Instance 3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:55:32.331175 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4c017051-0a6e-4b6a-80f5-ae24df2e50c0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16" status: 404 len: 111 microversion: 2.1 time: 0.056145 Sep 16 12:55:32.335652 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1219/2354] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:32 2022] GET /compute/v2.1/servers/3085e02c-a09e-4bc5-a8c4-87ab1cedfc16 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:55:32.342642 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f9335993-edf8-485e-a184-f04f546067f2 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:32.343389 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f9335993-edf8-485e-a184-f04f546067f2 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:32.356067 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9335993-edf8-485e-a184-f04f546067f2 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:32.356666 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9335993-edf8-485e-a184-f04f546067f2 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:32.357313 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9335993-edf8-485e-a184-f04f546067f2 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:32.358242 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9335993-edf8-485e-a184-f04f546067f2 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:32.358912 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9335993-edf8-485e-a184-f04f546067f2 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:32.359503 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9335993-edf8-485e-a184-f04f546067f2 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:32.374473 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4a096113-a6cf-43c4-82bf-7a57920f8bd3 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "DELETE /compute/v2.1/images/991a3348-5f7a-42cc-8d4f-71f5840a425f" status: 204 len: 0 microversion: 2.1 time: 0.920296 Sep 16 12:55:32.375352 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1136/2355] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:31 2022] DELETE /compute/v2.1/images/991a3348-5f7a-42cc-8d4f-71f5840a425f => generated 0 bytes in 923 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:55:32.380781 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-aacf9a66-201e-4181-8341-175f33490de8 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:32.381408 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-aacf9a66-201e-4181-8341-175f33490de8 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 8d3df84c-ed0d-41a9-8632-63591274c2eb] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:32.396479 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aacf9a66-201e-4181-8341-175f33490de8 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:32.397027 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aacf9a66-201e-4181-8341-175f33490de8 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:32.400077 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aacf9a66-201e-4181-8341-175f33490de8 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:32.401256 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aacf9a66-201e-4181-8341-175f33490de8 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:32.401896 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aacf9a66-201e-4181-8341-175f33490de8 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:32.403636 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aacf9a66-201e-4181-8341-175f33490de8 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:32.576294 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f9335993-edf8-485e-a184-f04f546067f2 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:32.597629 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f9335993-edf8-485e-a184-f04f546067f2 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e" status: 200 len: 1324 microversion: 2.1 time: 0.259972 Sep 16 12:55:32.598449 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1220/2356] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:32 2022] GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e => generated 1324 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:32.621624 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c0e1ef1c-3543-4ada-a040-86b3eddf0ba3 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:32.625484 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c0e1ef1c-3543-4ada-a040-86b3eddf0ba3 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] [instance: aa4ce353-1393-4c5a-a229-6aee69ce030c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:32.713549 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-aacf9a66-201e-4181-8341-175f33490de8 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37316c1f04764255a2a9466676502c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e940a963f7740dea44034d06e8c2a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:32.728708 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-aacf9a66-201e-4181-8341-175f33490de8 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb" status: 200 len: 1367 microversion: 2.1 time: 0.351776 Sep 16 12:55:32.743199 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1137/2357] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:32 2022] GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb => generated 1367 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:32.743199 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-03f50d00-e687-40a9-a49a-e0e07033f6da tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '.version_select at 0x7f103583c670>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:32.764591 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c0e1ef1c-3543-4ada-a040-86b3eddf0ba3 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:32.777921 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c0e1ef1c-3543-4ada-a040-86b3eddf0ba3 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:32.780501 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c0e1ef1c-3543-4ada-a040-86b3eddf0ba3 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:32.782101 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c0e1ef1c-3543-4ada-a040-86b3eddf0ba3 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] 10.222.0.67 "GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c" status: 200 len: 1258 microversion: 2.21 time: 0.167583 Sep 16 12:55:32.782282 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-03f50d00-e687-40a9-a49a-e0e07033f6da tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-654045276" status: 202 len: 0 microversion: 2.1 time: 0.045350 Sep 16 12:55:32.783308 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1138/2358] 10.222.0.67 () {58 vars in 1218 bytes} [Fri Sep 16 12:55:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-654045276 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:55:32.789404 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b146b6cb-c65a-4440-8cd6-b5bc6b793591 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f1034b8b280>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:32.793132 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1221/2359] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:32 2022] GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c => generated 1258 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:55:32.853301 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8568c849-cbc7-4d98-a617-d93e0acc094f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:32.854309 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8568c849-cbc7-4d98-a617-d93e0acc094f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:32.864492 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8568c849-cbc7-4d98-a617-d93e0acc094f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:32.866775 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8568c849-cbc7-4d98-a617-d93e0acc094f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:32.867961 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8568c849-cbc7-4d98-a617-d93e0acc094f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:32.870544 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8568c849-cbc7-4d98-a617-d93e0acc094f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:32.871100 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8568c849-cbc7-4d98-a617-d93e0acc094f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:32.874580 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8568c849-cbc7-4d98-a617-d93e0acc094f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:33.160479 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8568c849-cbc7-4d98-a617-d93e0acc094f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:33.182816 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8568c849-cbc7-4d98-a617-d93e0acc094f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:33.186347 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8568c849-cbc7-4d98-a617-d93e0acc094f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:33.189107 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8568c849-cbc7-4d98-a617-d93e0acc094f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 1814 microversion: 2.25 time: 0.349849 Sep 16 12:55:33.208634 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1222/2360] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:32 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 1814 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:55:33.210206 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1ca05ae8-6eba-4410-a80e-c5d5f4414a54 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-78840080", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:55:33.337489 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-1ca05ae8-6eba-4410-a80e-c5d5f4414a54 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] validate_networks() for [('e39821aa-60f0-44e0-aa25-da05e5161c83', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:55:33.470330 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b146b6cb-c65a-4440-8cd6-b5bc6b793591 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "DELETE /compute/v2.1/images/0c37e3b2-0f5c-45c2-a28a-7e732c529930" status: 204 len: 0 microversion: 2.1 time: 0.685313 Sep 16 12:55:33.471460 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1139/2361] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:32 2022] DELETE /compute/v2.1/images/0c37e3b2-0f5c-45c2-a28a-7e732c529930 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:55:33.550748 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-cc56dee2-e71d-4950-bf16-48d73acca287 req-42140901-7d2d-4cbd-a222-4e071d5285e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e", "tag": "0ce5e362-3ed5-4bc9-a8bf-6141e6997ba5"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:55:33.565915 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-cc56dee2-e71d-4950-bf16-48d73acca287 req-42140901-7d2d-4cbd-a222-4e071d5285e2 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:33.566544 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-cc56dee2-e71d-4950-bf16-48d73acca287 req-42140901-7d2d-4cbd-a222-4e071d5285e2 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:33.567073 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-cc56dee2-e71d-4950-bf16-48d73acca287 req-42140901-7d2d-4cbd-a222-4e071d5285e2 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:33.571470 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:55:33.579971 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-cc56dee2-e71d-4950-bf16-48d73acca287 req-42140901-7d2d-4cbd-a222-4e071d5285e2 service nova] Creating event network-changed:0ce5e362-3ed5-4bc9-a8bf-6141e6997ba5 for instance 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e on n-h2-858094-4 Sep 16 12:55:33.585637 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-cc56dee2-e71d-4950-bf16-48d73acca287 req-42140901-7d2d-4cbd-a222-4e071d5285e2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112385 Sep 16 12:55:33.586340 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1140/2362] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:55:33.592511 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a8311671-8cd2-4e0f-822c-f66ac6963648 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:33.593446 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a8311671-8cd2-4e0f-822c-f66ac6963648 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] [instance: c97d5f35-6ea1-4ec7-88f5-9da9dbe81182] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:33.601572 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8311671-8cd2-4e0f-822c-f66ac6963648 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:33.602402 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8311671-8cd2-4e0f-822c-f66ac6963648 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:33.603089 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8311671-8cd2-4e0f-822c-f66ac6963648 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:33.604054 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8311671-8cd2-4e0f-822c-f66ac6963648 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:33.604768 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8311671-8cd2-4e0f-822c-f66ac6963648 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:33.605396 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8311671-8cd2-4e0f-822c-f66ac6963648 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:33.641534 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a8311671-8cd2-4e0f-822c-f66ac6963648 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] [instance: c97d5f35-6ea1-4ec7-88f5-9da9dbe81182] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:55:33.741428 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a8311671-8cd2-4e0f-822c-f66ac6963648 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182" status: 204 len: 0 microversion: 2.1 time: 0.152316 Sep 16 12:55:33.742899 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1141/2363] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:55:33 2022] DELETE /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:55:33.760482 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a9e8ec65-1723-426a-84e0-f67af0e90f57 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:33.761988 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a9e8ec65-1723-426a-84e0-f67af0e90f57 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:33.770849 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a9e8ec65-1723-426a-84e0-f67af0e90f57 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:33.771811 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a9e8ec65-1723-426a-84e0-f67af0e90f57 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:33.772929 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a9e8ec65-1723-426a-84e0-f67af0e90f57 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:33.774022 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a9e8ec65-1723-426a-84e0-f67af0e90f57 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:33.774550 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a9e8ec65-1723-426a-84e0-f67af0e90f57 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:33.774763 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a9e8ec65-1723-426a-84e0-f67af0e90f57 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:34.203044 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a9e8ec65-1723-426a-84e0-f67af0e90f57 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:34.211134 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a9e8ec65-1723-426a-84e0-f67af0e90f57 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e" status: 200 len: 1324 microversion: 2.1 time: 0.466343 Sep 16 12:55:34.211718 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1142/2364] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:33 2022] GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e => generated 1324 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:34.217407 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-51176ead-c716-4553-b8fe-8b647d96be0c tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:34.218304 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-51176ead-c716-4553-b8fe-8b647d96be0c tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] [instance: c97d5f35-6ea1-4ec7-88f5-9da9dbe81182] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:34.224815 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-51176ead-c716-4553-b8fe-8b647d96be0c tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:34.225290 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-51176ead-c716-4553-b8fe-8b647d96be0c tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:34.225717 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-51176ead-c716-4553-b8fe-8b647d96be0c tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:34.226412 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-51176ead-c716-4553-b8fe-8b647d96be0c tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:34.226858 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-51176ead-c716-4553-b8fe-8b647d96be0c tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:34.227276 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-51176ead-c716-4553-b8fe-8b647d96be0c tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:34.292097 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-1ca05ae8-6eba-4410-a80e-c5d5f4414a54 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:55:34.292711 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-1ca05ae8-6eba-4410-a80e-c5d5f4414a54 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:55:34.293221 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-1ca05ae8-6eba-4410-a80e-c5d5f4414a54 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:55:34.293634 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-1ca05ae8-6eba-4410-a80e-c5d5f4414a54 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:55:34.294117 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-1ca05ae8-6eba-4410-a80e-c5d5f4414a54 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:55:34.304398 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ca05ae8-6eba-4410-a80e-c5d5f4414a54 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:34.305272 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ca05ae8-6eba-4410-a80e-c5d5f4414a54 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:34.305746 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ca05ae8-6eba-4410-a80e-c5d5f4414a54 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:34.307463 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ca05ae8-6eba-4410-a80e-c5d5f4414a54 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:34.308165 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ca05ae8-6eba-4410-a80e-c5d5f4414a54 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:34.308610 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ca05ae8-6eba-4410-a80e-c5d5f4414a54 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:34.327471 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-1ca05ae8-6eba-4410-a80e-c5d5f4414a54 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Getting quotas for project f2d50b9f6b084e40971269e8b882516c. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:55:34.333344 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-1ca05ae8-6eba-4410-a80e-c5d5f4414a54 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Getting quotas for user 1f32bbd973c449a9aeddcdfacc9a814b and project f2d50b9f6b084e40971269e8b882516c. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:55:34.347707 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1ca05ae8-6eba-4410-a80e-c5d5f4414a54 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:55:34.350691 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1ca05ae8-6eba-4410-a80e-c5d5f4414a54 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:55:34.410904 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1ca05ae8-6eba-4410-a80e-c5d5f4414a54 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.206902 Sep 16 12:55:34.411558 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1223/2365] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:55:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 1208 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:55:34.416901 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6fb349b0-39c9-46e1-b847-7adc7e5f501b tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:34.417910 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6fb349b0-39c9-46e1-b847-7adc7e5f501b tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 8d3df84c-ed0d-41a9-8632-63591274c2eb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:34.426321 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6fb349b0-39c9-46e1-b847-7adc7e5f501b tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:34.427153 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6fb349b0-39c9-46e1-b847-7adc7e5f501b tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:34.427754 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6fb349b0-39c9-46e1-b847-7adc7e5f501b tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:34.428687 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6fb349b0-39c9-46e1-b847-7adc7e5f501b tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:34.429290 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6fb349b0-39c9-46e1-b847-7adc7e5f501b tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:34.429875 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6fb349b0-39c9-46e1-b847-7adc7e5f501b tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:34.445208 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-51176ead-c716-4553-b8fe-8b647d96be0c tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63998619bf654ebb8d74f91e42c8c780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e81fca8624d18b9415a46e158d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:34.456876 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-51176ead-c716-4553-b8fe-8b647d96be0c tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182" status: 200 len: 1472 microversion: 2.1 time: 0.243917 Sep 16 12:55:34.457768 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1143/2366] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:34 2022] GET /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182 => generated 1472 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:34.463289 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6a1aa4b9-030d-422f-9cf1-28b59bfc9bbd tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:34.464102 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6a1aa4b9-030d-422f-9cf1-28b59bfc9bbd tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] [instance: aa4ce353-1393-4c5a-a229-6aee69ce030c] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:34.477423 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6a1aa4b9-030d-422f-9cf1-28b59bfc9bbd tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:34.478081 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6a1aa4b9-030d-422f-9cf1-28b59bfc9bbd tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:34.478519 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6a1aa4b9-030d-422f-9cf1-28b59bfc9bbd tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:34.479225 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6a1aa4b9-030d-422f-9cf1-28b59bfc9bbd tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:34.479911 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6a1aa4b9-030d-422f-9cf1-28b59bfc9bbd tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:34.480375 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6a1aa4b9-030d-422f-9cf1-28b59bfc9bbd tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:34.567413 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6a1aa4b9-030d-422f-9cf1-28b59bfc9bbd tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:34.577401 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6a1aa4b9-030d-422f-9cf1-28b59bfc9bbd tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:34.579970 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6a1aa4b9-030d-422f-9cf1-28b59bfc9bbd tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:34.582438 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6a1aa4b9-030d-422f-9cf1-28b59bfc9bbd tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] 10.222.0.67 "GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c" status: 200 len: 1262 microversion: 2.21 time: 0.123418 Sep 16 12:55:34.596148 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1144/2367] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:34 2022] GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c => generated 1262 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:55:34.596148 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f41c3dd8-5f19-4220-a945-8d73f052b3b2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:34.596148 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f41c3dd8-5f19-4220-a945-8d73f052b3b2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:34.601232 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6fb349b0-39c9-46e1-b847-7adc7e5f501b tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37316c1f04764255a2a9466676502c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e940a963f7740dea44034d06e8c2a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:34.612583 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6fb349b0-39c9-46e1-b847-7adc7e5f501b tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb" status: 200 len: 1367 microversion: 2.1 time: 0.199836 Sep 16 12:55:34.615019 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1224/2368] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:34 2022] GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:34.624419 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f41c3dd8-5f19-4220-a945-8d73f052b3b2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:34.624419 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f41c3dd8-5f19-4220-a945-8d73f052b3b2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:34.624419 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f41c3dd8-5f19-4220-a945-8d73f052b3b2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:34.624419 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f41c3dd8-5f19-4220-a945-8d73f052b3b2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:34.624419 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f41c3dd8-5f19-4220-a945-8d73f052b3b2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:34.624419 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f41c3dd8-5f19-4220-a945-8d73f052b3b2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:34.631049 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b12b910e-e69e-4add-abaf-13a997bc55d1 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:34.631929 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b12b910e-e69e-4add-abaf-13a997bc55d1 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: a1f478b9-b8e1-40a8-9232-34eb6df9ad7a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:34.642423 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b12b910e-e69e-4add-abaf-13a997bc55d1 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:34.643007 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b12b910e-e69e-4add-abaf-13a997bc55d1 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:34.643659 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b12b910e-e69e-4add-abaf-13a997bc55d1 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:34.644598 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b12b910e-e69e-4add-abaf-13a997bc55d1 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:34.645078 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b12b910e-e69e-4add-abaf-13a997bc55d1 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:34.645595 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b12b910e-e69e-4add-abaf-13a997bc55d1 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:34.675022 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b12b910e-e69e-4add-abaf-13a997bc55d1 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: a1f478b9-b8e1-40a8-9232-34eb6df9ad7a] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:55:34.739234 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:55:34.776524 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b12b910e-e69e-4add-abaf-13a997bc55d1 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a" status: 204 len: 0 microversion: 2.1 time: 0.160792 Sep 16 12:55:34.777032 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1225/2369] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:55:34 2022] DELETE /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:55:34.785698 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4eeef4c8-6c8d-4763-a148-43b9f0cf0e08 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:34.786465 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4eeef4c8-6c8d-4763-a148-43b9f0cf0e08 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:34.791069 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f41c3dd8-5f19-4220-a945-8d73f052b3b2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:34.804660 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f41c3dd8-5f19-4220-a945-8d73f052b3b2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:34.806514 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f41c3dd8-5f19-4220-a945-8d73f052b3b2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:34.807729 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f41c3dd8-5f19-4220-a945-8d73f052b3b2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 1814 microversion: 2.25 time: 0.221379 Sep 16 12:55:34.812841 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1145/2370] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:34 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 1814 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:55:34.829853 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-dce2810f-e6eb-4b5c-a65e-41482ceb1218 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:34.830572 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-dce2810f-e6eb-4b5c-a65e-41482ceb1218 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: a1f478b9-b8e1-40a8-9232-34eb6df9ad7a] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:34.837187 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dce2810f-e6eb-4b5c-a65e-41482ceb1218 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:34.837682 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dce2810f-e6eb-4b5c-a65e-41482ceb1218 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:34.838110 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dce2810f-e6eb-4b5c-a65e-41482ceb1218 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:34.838798 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dce2810f-e6eb-4b5c-a65e-41482ceb1218 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:34.839242 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dce2810f-e6eb-4b5c-a65e-41482ceb1218 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:34.839656 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dce2810f-e6eb-4b5c-a65e-41482ceb1218 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:34.848517 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4eeef4c8-6c8d-4763-a148-43b9f0cf0e08 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:34.855373 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4eeef4c8-6c8d-4763-a148-43b9f0cf0e08 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1212 microversion: 2.1 time: 0.075947 Sep 16 12:55:34.855946 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1226/2371] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:34 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1212 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:34.983429 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-dce2810f-e6eb-4b5c-a65e-41482ceb1218 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:34.991989 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-dce2810f-e6eb-4b5c-a65e-41482ceb1218 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a" status: 200 len: 1485 microversion: 2.1 time: 0.177938 Sep 16 12:55:34.992644 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1146/2372] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:34 2022] GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a => generated 1485 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:35.236754 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f25bfee0-1dcf-4855-a508-3d97117ee42c tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:35.237381 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f25bfee0-1dcf-4855-a508-3d97117ee42c tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:35.244765 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f25bfee0-1dcf-4855-a508-3d97117ee42c tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:35.245262 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f25bfee0-1dcf-4855-a508-3d97117ee42c tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:35.245702 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f25bfee0-1dcf-4855-a508-3d97117ee42c tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:35.246434 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f25bfee0-1dcf-4855-a508-3d97117ee42c tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:35.246870 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f25bfee0-1dcf-4855-a508-3d97117ee42c tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:35.248156 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f25bfee0-1dcf-4855-a508-3d97117ee42c tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:35.400086 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f25bfee0-1dcf-4855-a508-3d97117ee42c tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:35.408344 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f25bfee0-1dcf-4855-a508-3d97117ee42c tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e" status: 200 len: 1324 microversion: 2.1 time: 0.176282 Sep 16 12:55:35.408929 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1227/2373] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:35 2022] GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e => generated 1324 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:35.481690 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0fba2a4d-d1e6-4ea8-88ba-ee074f281902 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:35.482315 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0fba2a4d-d1e6-4ea8-88ba-ee074f281902 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] [instance: c97d5f35-6ea1-4ec7-88f5-9da9dbe81182] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:35.488471 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0fba2a4d-d1e6-4ea8-88ba-ee074f281902 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:35.488951 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0fba2a4d-d1e6-4ea8-88ba-ee074f281902 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:35.489381 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0fba2a4d-d1e6-4ea8-88ba-ee074f281902 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:35.490077 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0fba2a4d-d1e6-4ea8-88ba-ee074f281902 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:35.490521 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0fba2a4d-d1e6-4ea8-88ba-ee074f281902 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:35.490985 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0fba2a4d-d1e6-4ea8-88ba-ee074f281902 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:35.616318 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c871ffef-6e91-40a0-89bb-82e977f6509e tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:35.617580 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c871ffef-6e91-40a0-89bb-82e977f6509e tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] [instance: aa4ce353-1393-4c5a-a229-6aee69ce030c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:35.619648 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:55:35.625993 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c871ffef-6e91-40a0-89bb-82e977f6509e tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:35.626486 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c871ffef-6e91-40a0-89bb-82e977f6509e tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:35.626922 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c871ffef-6e91-40a0-89bb-82e977f6509e tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:35.627619 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c871ffef-6e91-40a0-89bb-82e977f6509e tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:35.628243 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c871ffef-6e91-40a0-89bb-82e977f6509e tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:35.628902 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c871ffef-6e91-40a0-89bb-82e977f6509e tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:35.637481 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0fba2a4d-d1e6-4ea8-88ba-ee074f281902 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63998619bf654ebb8d74f91e42c8c780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e81fca8624d18b9415a46e158d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:35.647049 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0fba2a4d-d1e6-4ea8-88ba-ee074f281902 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182" status: 200 len: 1472 microversion: 2.1 time: 0.169523 Sep 16 12:55:35.647651 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1147/2374] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:35 2022] GET /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182 => generated 1472 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:55:35.652688 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2542a4f2-1855-444d-9bf1-36e5134c6108 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:35.653407 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-2542a4f2-1855-444d-9bf1-36e5134c6108 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 8d3df84c-ed0d-41a9-8632-63591274c2eb] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:35.659472 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2542a4f2-1855-444d-9bf1-36e5134c6108 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:35.660040 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2542a4f2-1855-444d-9bf1-36e5134c6108 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:35.660579 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2542a4f2-1855-444d-9bf1-36e5134c6108 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:35.661516 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2542a4f2-1855-444d-9bf1-36e5134c6108 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:35.662036 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2542a4f2-1855-444d-9bf1-36e5134c6108 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:35.662551 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2542a4f2-1855-444d-9bf1-36e5134c6108 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:35.703519 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c871ffef-6e91-40a0-89bb-82e977f6509e tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:35.712235 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c871ffef-6e91-40a0-89bb-82e977f6509e tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:35.713667 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c871ffef-6e91-40a0-89bb-82e977f6509e tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:35.714775 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c871ffef-6e91-40a0-89bb-82e977f6509e tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] 10.222.0.67 "GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c" status: 200 len: 1254 microversion: 2.21 time: 0.102644 Sep 16 12:55:35.715369 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1228/2375] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:35 2022] GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c => generated 1254 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:55:35.834591 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-2542a4f2-1855-444d-9bf1-36e5134c6108 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37316c1f04764255a2a9466676502c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e940a963f7740dea44034d06e8c2a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:35.835078 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-80c8e104-06e1-49ee-a44f-85f549b5b715 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:35.835622 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-80c8e104-06e1-49ee-a44f-85f549b5b715 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:35.842717 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80c8e104-06e1-49ee-a44f-85f549b5b715 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:35.843206 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80c8e104-06e1-49ee-a44f-85f549b5b715 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:35.843312 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2542a4f2-1855-444d-9bf1-36e5134c6108 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb" status: 200 len: 1367 microversion: 2.1 time: 0.194437 Sep 16 12:55:35.843656 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80c8e104-06e1-49ee-a44f-85f549b5b715 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:35.844009 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1148/2376] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:35 2022] GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:35.844380 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80c8e104-06e1-49ee-a44f-85f549b5b715 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:35.844834 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80c8e104-06e1-49ee-a44f-85f549b5b715 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:35.845257 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80c8e104-06e1-49ee-a44f-85f549b5b715 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:35.878754 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-bb4ac878-6017-4caf-83d6-a63bfc82ddec tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:35.879370 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-bb4ac878-6017-4caf-83d6-a63bfc82ddec tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:35.886418 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bb4ac878-6017-4caf-83d6-a63bfc82ddec tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:35.886914 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bb4ac878-6017-4caf-83d6-a63bfc82ddec tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:35.887351 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bb4ac878-6017-4caf-83d6-a63bfc82ddec tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:35.888192 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bb4ac878-6017-4caf-83d6-a63bfc82ddec tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:35.888652 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bb4ac878-6017-4caf-83d6-a63bfc82ddec tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:35.889074 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bb4ac878-6017-4caf-83d6-a63bfc82ddec tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:36.044224 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-bb4ac878-6017-4caf-83d6-a63bfc82ddec tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:36.062770 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-bb4ac878-6017-4caf-83d6-a63bfc82ddec tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1208 microversion: 2.1 time: 0.187726 Sep 16 12:55:36.074567 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1149/2377] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:35 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1208 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:55:36.082288 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2b415862-813c-462e-a742-2f5eeafaa054 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:36.083817 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-2b415862-813c-462e-a742-2f5eeafaa054 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: a1f478b9-b8e1-40a8-9232-34eb6df9ad7a] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:36.093661 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2b415862-813c-462e-a742-2f5eeafaa054 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:36.094157 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2b415862-813c-462e-a742-2f5eeafaa054 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:36.095122 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2b415862-813c-462e-a742-2f5eeafaa054 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:36.095846 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2b415862-813c-462e-a742-2f5eeafaa054 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:36.096335 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2b415862-813c-462e-a742-2f5eeafaa054 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:36.098384 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2b415862-813c-462e-a742-2f5eeafaa054 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:36.098384 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:55:36.291231 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-80c8e104-06e1-49ee-a44f-85f549b5b715 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:36.301178 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-80c8e104-06e1-49ee-a44f-85f549b5b715 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:36.302633 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-80c8e104-06e1-49ee-a44f-85f549b5b715 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:36.303853 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-80c8e104-06e1-49ee-a44f-85f549b5b715 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 1814 microversion: 2.25 time: 0.472981 Sep 16 12:55:36.304459 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1229/2378] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:35 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 1814 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:55:36.434251 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d8e57893-58fd-4314-8be4-7e8cef7e86fa tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:36.434862 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d8e57893-58fd-4314-8be4-7e8cef7e86fa tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:36.441173 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8e57893-58fd-4314-8be4-7e8cef7e86fa tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:36.441668 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8e57893-58fd-4314-8be4-7e8cef7e86fa tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:36.442105 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8e57893-58fd-4314-8be4-7e8cef7e86fa tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:36.442803 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8e57893-58fd-4314-8be4-7e8cef7e86fa tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:36.443266 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8e57893-58fd-4314-8be4-7e8cef7e86fa tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:36.443690 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8e57893-58fd-4314-8be4-7e8cef7e86fa tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:36.895462 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-2b415862-813c-462e-a742-2f5eeafaa054 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:36.905062 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2b415862-813c-462e-a742-2f5eeafaa054 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a" status: 200 len: 1485 microversion: 2.1 time: 0.828821 Sep 16 12:55:36.905857 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1150/2379] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:36 2022] GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a => generated 1485 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:36.911542 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-efd26a03-6a59-4b2e-81f6-dd5879a9bd11 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:36.912548 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-efd26a03-6a59-4b2e-81f6-dd5879a9bd11 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] [instance: c97d5f35-6ea1-4ec7-88f5-9da9dbe81182] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:36.920225 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-efd26a03-6a59-4b2e-81f6-dd5879a9bd11 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:36.921042 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-efd26a03-6a59-4b2e-81f6-dd5879a9bd11 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:36.921693 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-efd26a03-6a59-4b2e-81f6-dd5879a9bd11 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:36.922652 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-efd26a03-6a59-4b2e-81f6-dd5879a9bd11 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:36.924083 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-efd26a03-6a59-4b2e-81f6-dd5879a9bd11 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:36.925181 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-efd26a03-6a59-4b2e-81f6-dd5879a9bd11 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:37.048255 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=10 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:55:37.268612 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d8e57893-58fd-4314-8be4-7e8cef7e86fa tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:37.283740 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d8e57893-58fd-4314-8be4-7e8cef7e86fa tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e" status: 200 len: 1324 microversion: 2.1 time: 0.853385 Sep 16 12:55:37.286238 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1230/2380] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:36 2022] GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e => generated 1324 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:55:37.306483 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-aa1b9959-b226-4813-a307-01b72b8b92f5 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:37.307927 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-aa1b9959-b226-4813-a307-01b72b8b92f5 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] [instance: aa4ce353-1393-4c5a-a229-6aee69ce030c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:37.317199 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa1b9959-b226-4813-a307-01b72b8b92f5 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:37.317861 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa1b9959-b226-4813-a307-01b72b8b92f5 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:37.318579 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa1b9959-b226-4813-a307-01b72b8b92f5 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:37.319506 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa1b9959-b226-4813-a307-01b72b8b92f5 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:37.320600 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa1b9959-b226-4813-a307-01b72b8b92f5 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:37.322126 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa1b9959-b226-4813-a307-01b72b8b92f5 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:37.489016 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-efd26a03-6a59-4b2e-81f6-dd5879a9bd11 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63998619bf654ebb8d74f91e42c8c780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e81fca8624d18b9415a46e158d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:37.496797 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-efd26a03-6a59-4b2e-81f6-dd5879a9bd11 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182" status: 200 len: 1472 microversion: 2.1 time: 0.589253 Sep 16 12:55:37.497378 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1151/2381] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:36 2022] GET /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182 => generated 1472 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:37.502624 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-cd253c0d-75c7-4dff-afc1-bfe33250e61e tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:37.503223 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-cd253c0d-75c7-4dff-afc1-bfe33250e61e tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 8d3df84c-ed0d-41a9-8632-63591274c2eb] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:37.509010 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cd253c0d-75c7-4dff-afc1-bfe33250e61e tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:37.509666 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cd253c0d-75c7-4dff-afc1-bfe33250e61e tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:37.510242 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cd253c0d-75c7-4dff-afc1-bfe33250e61e tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:37.511078 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cd253c0d-75c7-4dff-afc1-bfe33250e61e tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:37.511670 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cd253c0d-75c7-4dff-afc1-bfe33250e61e tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:37.512340 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cd253c0d-75c7-4dff-afc1-bfe33250e61e tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:37.537371 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-aa1b9959-b226-4813-a307-01b72b8b92f5 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:37.552057 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-aa1b9959-b226-4813-a307-01b72b8b92f5 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:37.554838 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-aa1b9959-b226-4813-a307-01b72b8b92f5 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:37.556418 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-aa1b9959-b226-4813-a307-01b72b8b92f5 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] 10.222.0.67 "GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c" status: 200 len: 1318 microversion: 2.21 time: 0.268951 Sep 16 12:55:37.557948 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1231/2382] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:37 2022] GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:55:37.566202 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a25ac33c-c229-4e5d-9dd9-bde7c429bdf8 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:37.567821 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a25ac33c-c229-4e5d-9dd9-bde7c429bdf8 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:37.574636 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a25ac33c-c229-4e5d-9dd9-bde7c429bdf8 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:37.575278 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a25ac33c-c229-4e5d-9dd9-bde7c429bdf8 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:37.576022 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a25ac33c-c229-4e5d-9dd9-bde7c429bdf8 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:37.577265 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a25ac33c-c229-4e5d-9dd9-bde7c429bdf8 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:37.578024 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a25ac33c-c229-4e5d-9dd9-bde7c429bdf8 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:37.578455 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a25ac33c-c229-4e5d-9dd9-bde7c429bdf8 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:37.745380 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a25ac33c-c229-4e5d-9dd9-bde7c429bdf8 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:37.754632 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a25ac33c-c229-4e5d-9dd9-bde7c429bdf8 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1264 microversion: 2.1 time: 0.194989 Sep 16 12:55:37.755316 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1232/2383] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:37 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1264 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:37.761841 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c574236a-868f-4707-a105-4fb28ed093c6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:37.762641 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c574236a-868f-4707-a105-4fb28ed093c6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:37.771975 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c574236a-868f-4707-a105-4fb28ed093c6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:37.772971 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c574236a-868f-4707-a105-4fb28ed093c6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:37.773566 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c574236a-868f-4707-a105-4fb28ed093c6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:37.774577 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c574236a-868f-4707-a105-4fb28ed093c6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:37.775337 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c574236a-868f-4707-a105-4fb28ed093c6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:37.775767 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c574236a-868f-4707-a105-4fb28ed093c6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:38.083999 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-cd253c0d-75c7-4dff-afc1-bfe33250e61e tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37316c1f04764255a2a9466676502c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e940a963f7740dea44034d06e8c2a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:38.093466 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-cd253c0d-75c7-4dff-afc1-bfe33250e61e tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb" status: 200 len: 1367 microversion: 2.1 time: 0.594533 Sep 16 12:55:38.095000 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1152/2384] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:37 2022] GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb => generated 1367 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:38.100246 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c5f98950-c5d2-4f12-956e-baaa8b605982 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:38.100960 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c5f98950-c5d2-4f12-956e-baaa8b605982 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: a1f478b9-b8e1-40a8-9232-34eb6df9ad7a] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:38.114242 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c5f98950-c5d2-4f12-956e-baaa8b605982 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:38.115110 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c5f98950-c5d2-4f12-956e-baaa8b605982 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:38.116391 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c5f98950-c5d2-4f12-956e-baaa8b605982 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:38.117699 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c5f98950-c5d2-4f12-956e-baaa8b605982 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:38.118259 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c5f98950-c5d2-4f12-956e-baaa8b605982 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:38.118785 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c5f98950-c5d2-4f12-956e-baaa8b605982 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:38.297010 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c5f98950-c5d2-4f12-956e-baaa8b605982 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:38.308665 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c5f98950-c5d2-4f12-956e-baaa8b605982 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a" status: 200 len: 1443 microversion: 2.1 time: 0.211066 Sep 16 12:55:38.324833 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1153/2385] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:38 2022] GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a => generated 1443 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:38.330303 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-5e88f3b6-9879-4a34-a0da-f6da0949ae61 req-4962907b-c412-4c55-a7a4-b6f8fa7d4975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c97d5f35-6ea1-4ec7-88f5-9da9dbe81182", "name": "network-vif-deleted", "tag": "81054b4c-c45a-4833-ae83-e752ff18ff48"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:55:38.330726 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c574236a-868f-4707-a105-4fb28ed093c6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:38.346362 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-5e88f3b6-9879-4a34-a0da-f6da0949ae61 req-4962907b-c412-4c55-a7a4-b6f8fa7d4975 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:38.347049 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-5e88f3b6-9879-4a34-a0da-f6da0949ae61 req-4962907b-c412-4c55-a7a4-b6f8fa7d4975 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:38.347653 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-5e88f3b6-9879-4a34-a0da-f6da0949ae61 req-4962907b-c412-4c55-a7a4-b6f8fa7d4975 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:38.350132 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c574236a-868f-4707-a105-4fb28ed093c6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:38.351797 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c574236a-868f-4707-a105-4fb28ed093c6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:38.353069 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c574236a-868f-4707-a105-4fb28ed093c6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 1814 microversion: 2.25 time: 0.596416 Sep 16 12:55:38.380469 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-5e88f3b6-9879-4a34-a0da-f6da0949ae61 req-4962907b-c412-4c55-a7a4-b6f8fa7d4975 service nova] Creating event network-vif-deleted:81054b4c-c45a-4833-ae83-e752ff18ff48 for instance c97d5f35-6ea1-4ec7-88f5-9da9dbe81182 on n-h1-858094-4 Sep 16 12:55:38.380885 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1233/2386] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:37 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 1814 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:55:38.384055 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-5e88f3b6-9879-4a34-a0da-f6da0949ae61 req-4962907b-c412-4c55-a7a4-b6f8fa7d4975 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057760 Sep 16 12:55:38.387606 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1154/2387] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:55:38.389682 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-83df31bb-e7ca-4de4-b531-3e832a480099 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:38.392720 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-83df31bb-e7ca-4de4-b531-3e832a480099 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:38.407275 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83df31bb-e7ca-4de4-b531-3e832a480099 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:38.408164 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83df31bb-e7ca-4de4-b531-3e832a480099 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:38.408766 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83df31bb-e7ca-4de4-b531-3e832a480099 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:38.409784 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83df31bb-e7ca-4de4-b531-3e832a480099 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:38.413013 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83df31bb-e7ca-4de4-b531-3e832a480099 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:38.413739 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83df31bb-e7ca-4de4-b531-3e832a480099 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:38.521184 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fe9516cb-36fb-424d-a15d-ccf429e692b6 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:38.522167 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-fe9516cb-36fb-424d-a15d-ccf429e692b6 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] [instance: c97d5f35-6ea1-4ec7-88f5-9da9dbe81182] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:38.530603 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe9516cb-36fb-424d-a15d-ccf429e692b6 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:38.531445 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe9516cb-36fb-424d-a15d-ccf429e692b6 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:38.532388 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe9516cb-36fb-424d-a15d-ccf429e692b6 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:38.538145 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe9516cb-36fb-424d-a15d-ccf429e692b6 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:38.538822 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe9516cb-36fb-424d-a15d-ccf429e692b6 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:38.539369 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe9516cb-36fb-424d-a15d-ccf429e692b6 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:38.682764 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-fe9516cb-36fb-424d-a15d-ccf429e692b6 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63998619bf654ebb8d74f91e42c8c780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e81fca8624d18b9415a46e158d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:38.690857 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-fe9516cb-36fb-424d-a15d-ccf429e692b6 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182" status: 200 len: 1302 microversion: 2.1 time: 0.173947 Sep 16 12:55:38.691454 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1155/2388] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:38 2022] GET /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182 => generated 1302 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:55:38.696529 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f3f4e1c1-7f3a-4866-aa92-c34340523118 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:38.696820 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f3f4e1c1-7f3a-4866-aa92-c34340523118 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] [instance: aa4ce353-1393-4c5a-a229-6aee69ce030c] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:38.703247 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f3f4e1c1-7f3a-4866-aa92-c34340523118 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:38.703924 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f3f4e1c1-7f3a-4866-aa92-c34340523118 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:38.704562 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f3f4e1c1-7f3a-4866-aa92-c34340523118 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:38.705265 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f3f4e1c1-7f3a-4866-aa92-c34340523118 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:38.705966 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f3f4e1c1-7f3a-4866-aa92-c34340523118 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:38.706546 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f3f4e1c1-7f3a-4866-aa92-c34340523118 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:38.728155 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:55:38.835156 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-83df31bb-e7ca-4de4-b531-3e832a480099 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:38.848350 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-83df31bb-e7ca-4de4-b531-3e832a480099 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e" status: 200 len: 1324 microversion: 2.1 time: 0.465286 Sep 16 12:55:38.849591 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1234/2389] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:38 2022] GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e => generated 1324 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:38.855440 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-272d8a1e-41f2-4e71-917f-6b6ce08ce358 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:38.856073 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-272d8a1e-41f2-4e71-917f-6b6ce08ce358 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:38.863047 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-272d8a1e-41f2-4e71-917f-6b6ce08ce358 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:38.863814 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-272d8a1e-41f2-4e71-917f-6b6ce08ce358 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:38.864416 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-272d8a1e-41f2-4e71-917f-6b6ce08ce358 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:38.866074 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-272d8a1e-41f2-4e71-917f-6b6ce08ce358 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:38.866697 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-272d8a1e-41f2-4e71-917f-6b6ce08ce358 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:38.867280 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-272d8a1e-41f2-4e71-917f-6b6ce08ce358 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:38.898120 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f3f4e1c1-7f3a-4866-aa92-c34340523118 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:38.914509 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f3f4e1c1-7f3a-4866-aa92-c34340523118 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:38.916247 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f3f4e1c1-7f3a-4866-aa92-c34340523118 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:38.917565 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f3f4e1c1-7f3a-4866-aa92-c34340523118 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] 10.222.0.67 "GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c" status: 200 len: 1316 microversion: 2.21 time: 0.225196 Sep 16 12:55:38.918586 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1156/2390] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:38 2022] GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c => generated 1316 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:55:39.025397 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-272d8a1e-41f2-4e71-917f-6b6ce08ce358 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:39.039593 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-272d8a1e-41f2-4e71-917f-6b6ce08ce358 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1282 microversion: 2.1 time: 0.188206 Sep 16 12:55:39.043354 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-7c185c34-e391-469c-a53d-6f45514a7289 req-a4593092-e30b-43fb-9103-d982e568167e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e", "name": "network-vif-plugged", "status": "completed", "tag": "0ce5e362-3ed5-4bc9-a8bf-6141e6997ba5"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:55:39.055477 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1235/2391] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:38 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1282 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:39.062823 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-7c185c34-e391-469c-a53d-6f45514a7289 req-a4593092-e30b-43fb-9103-d982e568167e service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:39.063315 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-7c185c34-e391-469c-a53d-6f45514a7289 req-a4593092-e30b-43fb-9103-d982e568167e service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:39.063749 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-7c185c34-e391-469c-a53d-6f45514a7289 req-a4593092-e30b-43fb-9103-d982e568167e service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:39.079231 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-7c185c34-e391-469c-a53d-6f45514a7289 req-a4593092-e30b-43fb-9103-d982e568167e service nova] Creating event network-vif-plugged:0ce5e362-3ed5-4bc9-a8bf-6141e6997ba5 for instance 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e on n-h2-858094-4 Sep 16 12:55:39.085238 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-7c185c34-e391-469c-a53d-6f45514a7289 req-a4593092-e30b-43fb-9103-d982e568167e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050104 Sep 16 12:55:39.087130 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1157/2392] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:55:39.121512 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-328d038f-9f20-44c4-9663-02766e952ae7 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:39.122332 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-328d038f-9f20-44c4-9663-02766e952ae7 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 8d3df84c-ed0d-41a9-8632-63591274c2eb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:39.151622 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-328d038f-9f20-44c4-9663-02766e952ae7 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:39.152322 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-328d038f-9f20-44c4-9663-02766e952ae7 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:39.155677 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-328d038f-9f20-44c4-9663-02766e952ae7 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:39.157535 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-328d038f-9f20-44c4-9663-02766e952ae7 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:39.159557 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-328d038f-9f20-44c4-9663-02766e952ae7 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:39.162521 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-328d038f-9f20-44c4-9663-02766e952ae7 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:39.332372 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-77c6fda9-dd2d-44da-9d1a-066c2235aff2 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:39.332992 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-77c6fda9-dd2d-44da-9d1a-066c2235aff2 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: a1f478b9-b8e1-40a8-9232-34eb6df9ad7a] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:39.344540 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-77c6fda9-dd2d-44da-9d1a-066c2235aff2 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:39.345033 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-77c6fda9-dd2d-44da-9d1a-066c2235aff2 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:39.345464 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-77c6fda9-dd2d-44da-9d1a-066c2235aff2 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:39.346243 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-77c6fda9-dd2d-44da-9d1a-066c2235aff2 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:39.346593 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-77c6fda9-dd2d-44da-9d1a-066c2235aff2 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:39.347008 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-77c6fda9-dd2d-44da-9d1a-066c2235aff2 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:39.402686 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-77c6fda9-dd2d-44da-9d1a-066c2235aff2 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:39.403353 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-77c6fda9-dd2d-44da-9d1a-066c2235aff2 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:39.403933 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-77c6fda9-dd2d-44da-9d1a-066c2235aff2 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:39.405119 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-77c6fda9-dd2d-44da-9d1a-066c2235aff2 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lazy-loading 'fault' on Instance uuid a1f478b9-b8e1-40a8-9232-34eb6df9ad7a {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:55:39.537855 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-77c6fda9-dd2d-44da-9d1a-066c2235aff2 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:39.548263 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-77c6fda9-dd2d-44da-9d1a-066c2235aff2 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a" status: 200 len: 1301 microversion: 2.1 time: 0.221068 Sep 16 12:55:39.548982 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1158/2393] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:39 2022] GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a => generated 1301 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:39.554487 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-00e0331c-e796-40af-b077-5ad7ebf910f1 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:39.555212 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-00e0331c-e796-40af-b077-5ad7ebf910f1 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:39.566660 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-00e0331c-e796-40af-b077-5ad7ebf910f1 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:39.567267 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-00e0331c-e796-40af-b077-5ad7ebf910f1 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:39.567865 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-00e0331c-e796-40af-b077-5ad7ebf910f1 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:39.568859 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-00e0331c-e796-40af-b077-5ad7ebf910f1 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:39.569418 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-00e0331c-e796-40af-b077-5ad7ebf910f1 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:39.569952 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-00e0331c-e796-40af-b077-5ad7ebf910f1 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:39.706830 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-328d038f-9f20-44c4-9663-02766e952ae7 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37316c1f04764255a2a9466676502c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e940a963f7740dea44034d06e8c2a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:39.718659 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-328d038f-9f20-44c4-9663-02766e952ae7 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb" status: 200 len: 1367 microversion: 2.1 time: 0.603993 Sep 16 12:55:39.730063 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1236/2394] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:39 2022] GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb => generated 1367 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:39.730063 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c15d5edd-f4cc-4116-a8e1-0bfeb6ae1f7d tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:39.730063 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c15d5edd-f4cc-4116-a8e1-0bfeb6ae1f7d tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] [instance: c97d5f35-6ea1-4ec7-88f5-9da9dbe81182] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:39.735278 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c15d5edd-f4cc-4116-a8e1-0bfeb6ae1f7d tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:39.735870 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c15d5edd-f4cc-4116-a8e1-0bfeb6ae1f7d tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:39.736338 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c15d5edd-f4cc-4116-a8e1-0bfeb6ae1f7d tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:39.737119 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c15d5edd-f4cc-4116-a8e1-0bfeb6ae1f7d tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:39.738136 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c15d5edd-f4cc-4116-a8e1-0bfeb6ae1f7d tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:39.738591 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c15d5edd-f4cc-4116-a8e1-0bfeb6ae1f7d tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:39.772658 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c15d5edd-f4cc-4116-a8e1-0bfeb6ae1f7d tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:39.773145 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c15d5edd-f4cc-4116-a8e1-0bfeb6ae1f7d tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:39.773578 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c15d5edd-f4cc-4116-a8e1-0bfeb6ae1f7d tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:39.774079 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-c15d5edd-f4cc-4116-a8e1-0bfeb6ae1f7d tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lazy-loading 'fault' on Instance uuid c97d5f35-6ea1-4ec7-88f5-9da9dbe81182 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:55:39.911867 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c15d5edd-f4cc-4116-a8e1-0bfeb6ae1f7d tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63998619bf654ebb8d74f91e42c8c780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e81fca8624d18b9415a46e158d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:39.920985 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c15d5edd-f4cc-4116-a8e1-0bfeb6ae1f7d tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182" status: 200 len: 1307 microversion: 2.1 time: 0.199411 Sep 16 12:55:39.921592 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1237/2395] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:39 2022] GET /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182 => generated 1307 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:39.927081 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c735694f-31b3-4c1e-9925-eac5c658a31b tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:39.927854 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c735694f-31b3-4c1e-9925-eac5c658a31b tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:39.936471 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c735694f-31b3-4c1e-9925-eac5c658a31b tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:39.937468 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c735694f-31b3-4c1e-9925-eac5c658a31b tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:39.938068 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c735694f-31b3-4c1e-9925-eac5c658a31b tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:39.938929 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c735694f-31b3-4c1e-9925-eac5c658a31b tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:39.939558 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c735694f-31b3-4c1e-9925-eac5c658a31b tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:39.940152 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c735694f-31b3-4c1e-9925-eac5c658a31b tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:40.479441 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-00e0331c-e796-40af-b077-5ad7ebf910f1 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:40.491260 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-00e0331c-e796-40af-b077-5ad7ebf910f1 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:40.498742 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-00e0331c-e796-40af-b077-5ad7ebf910f1 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:40.502968 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-00e0331c-e796-40af-b077-5ad7ebf910f1 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 1814 microversion: 2.25 time: 0.952114 Sep 16 12:55:40.504516 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1159/2396] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:39 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 1814 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:55:40.512873 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0def9d36-5289-4532-9eeb-4e215eccf6af tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:40.514791 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0def9d36-5289-4532-9eeb-4e215eccf6af tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] [instance: aa4ce353-1393-4c5a-a229-6aee69ce030c] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:40.526173 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0def9d36-5289-4532-9eeb-4e215eccf6af tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:40.527245 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0def9d36-5289-4532-9eeb-4e215eccf6af tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:40.528075 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0def9d36-5289-4532-9eeb-4e215eccf6af tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:40.529572 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0def9d36-5289-4532-9eeb-4e215eccf6af tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:40.530409 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0def9d36-5289-4532-9eeb-4e215eccf6af tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:40.531512 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0def9d36-5289-4532-9eeb-4e215eccf6af tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:40.915705 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c735694f-31b3-4c1e-9925-eac5c658a31b tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:40.924512 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c735694f-31b3-4c1e-9925-eac5c658a31b tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e" status: 200 len: 1324 microversion: 2.1 time: 1.001607 Sep 16 12:55:40.925107 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1238/2397] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:39 2022] GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e => generated 1324 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:40.929756 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-56a72974-7cec-42f4-b5b4-ee237825d10b tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:40.931319 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-56a72974-7cec-42f4-b5b4-ee237825d10b tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:40.938471 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56a72974-7cec-42f4-b5b4-ee237825d10b tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:40.939197 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56a72974-7cec-42f4-b5b4-ee237825d10b tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:40.939952 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56a72974-7cec-42f4-b5b4-ee237825d10b tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:40.942413 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56a72974-7cec-42f4-b5b4-ee237825d10b tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:40.942889 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56a72974-7cec-42f4-b5b4-ee237825d10b tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:40.943330 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56a72974-7cec-42f4-b5b4-ee237825d10b tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:41.077602 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-56a72974-7cec-42f4-b5b4-ee237825d10b tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:41.086797 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0def9d36-5289-4532-9eeb-4e215eccf6af tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:41.087975 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-56a72974-7cec-42f4-b5b4-ee237825d10b tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1270 microversion: 2.1 time: 0.161815 Sep 16 12:55:41.088611 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1239/2398] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:40 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1270 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:41.093773 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-cfde6145-6dad-4f0c-921d-66ec38357c8c req-db6bb0c2-1d95-4736-a9b7-6c904d0b75f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1f478b9-b8e1-40a8-9232-34eb6df9ad7a", "name": "network-vif-deleted", "tag": "8109ea32-2ace-4f1c-be0b-e7fa4599d05e"}, {"server_uuid": "d49156a2-d78c-4601-a431-e09716c76ce8", "name": "network-vif-unplugged", "status": "completed", "tag": "d289a714-1b0e-4177-adf6-0d59780fa902"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:55:41.106036 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-cfde6145-6dad-4f0c-921d-66ec38357c8c req-db6bb0c2-1d95-4736-a9b7-6c904d0b75f9 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:41.106760 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0def9d36-5289-4532-9eeb-4e215eccf6af tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:41.107123 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-cfde6145-6dad-4f0c-921d-66ec38357c8c req-db6bb0c2-1d95-4736-a9b7-6c904d0b75f9 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:41.108913 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-cfde6145-6dad-4f0c-921d-66ec38357c8c req-db6bb0c2-1d95-4736-a9b7-6c904d0b75f9 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:41.109105 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0def9d36-5289-4532-9eeb-4e215eccf6af tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:41.110816 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0def9d36-5289-4532-9eeb-4e215eccf6af tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] 10.222.0.67 "GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c" status: 200 len: 1358 microversion: 2.21 time: 0.604008 Sep 16 12:55:41.111403 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1160/2399] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:40 2022] GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c => generated 1358 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:55:41.115895 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4d189ed1-cfb4-4642-bfaf-38d4e08bda19 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:41.116544 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-4d189ed1-cfb4-4642-bfaf-38d4e08bda19 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: a1f478b9-b8e1-40a8-9232-34eb6df9ad7a] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:41.147812 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4d189ed1-cfb4-4642-bfaf-38d4e08bda19 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:41.148360 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4d189ed1-cfb4-4642-bfaf-38d4e08bda19 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:41.148804 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4d189ed1-cfb4-4642-bfaf-38d4e08bda19 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:41.149519 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4d189ed1-cfb4-4642-bfaf-38d4e08bda19 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:41.149972 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4d189ed1-cfb4-4642-bfaf-38d4e08bda19 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:41.150121 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-cfde6145-6dad-4f0c-921d-66ec38357c8c req-db6bb0c2-1d95-4736-a9b7-6c904d0b75f9 service nova] Creating event network-vif-deleted:8109ea32-2ace-4f1c-be0b-e7fa4599d05e for instance a1f478b9-b8e1-40a8-9232-34eb6df9ad7a on n-h1-858094-4 Sep 16 12:55:41.150389 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4d189ed1-cfb4-4642-bfaf-38d4e08bda19 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:41.151400 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-cfde6145-6dad-4f0c-921d-66ec38357c8c req-db6bb0c2-1d95-4736-a9b7-6c904d0b75f9 service nova] Creating event network-vif-unplugged:d289a714-1b0e-4177-adf6-0d59780fa902 for instance d49156a2-d78c-4601-a431-e09716c76ce8 on n-h2-858094-4 Sep 16 12:55:41.165976 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-cfde6145-6dad-4f0c-921d-66ec38357c8c req-db6bb0c2-1d95-4736-a9b7-6c904d0b75f9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.075835 Sep 16 12:55:41.166512 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1240/2400] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:55:41.172292 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a6ad3af1-692d-4bc0-a674-423cc37a0f7a tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:41.173641 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a6ad3af1-692d-4bc0-a674-423cc37a0f7a tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 8d3df84c-ed0d-41a9-8632-63591274c2eb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:41.175740 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-4d189ed1-cfb4-4642-bfaf-38d4e08bda19 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] HTTP exception thrown: Instance a1f478b9-b8e1-40a8-9232-34eb6df9ad7a could not be found. Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4d189ed1-cfb4-4642-bfaf-38d4e08bda19 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Request method failure captured: Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a HTTP/1.1 Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHA2k7I_Nlb7ALNJZ9Q994AgJQQSVayIRfXZwkHIKWObv5ojlKNex5wQePttzrHwxCfD_v8XkqrmNTqITWzqKUEvx7gP1nhAAJVgboAk9sHePDTro3y1EuuyPAxHLfA4fiYFESzV7eY_EcJ7TztpomOPr8eDk3XA9yTci_TiYj7fcpE Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: dd7ec914bffb4743921e4116b0c399eb Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-LiveMigrationTest-924693802 Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dd7ec914bffb4743921e4116b0c399eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/dd7ec914bffb4743921e4116b0c399eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_dd7ec914bffb4743921e4116b0c399eb", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dd7ec914bffb4743921e4116b0c399eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-LiveMigrationTest-924693802 Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: dd7ec914bffb4743921e4116b0c399eb Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-LiveMigrationTest-924693802 Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-LiveMigrationTest-924693802-project Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 745ef253e9844572a0f081955b3e9a90 Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-LiveMigrationTest-924693802-project Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance a1f478b9-b8e1-40a8-9232-34eb6df9ad7a could not be found. Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'a1f478b9-b8e1-40a8-9232-34eb6df9ad7a'} Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1f478b9-b8e1-40a8-9232-34eb6df9ad7a could not be found. Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1f478b9-b8e1-40a8-9232-34eb6df9ad7a could not be found. Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:55:41.178279 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:55:41.183946 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:55:41.183946 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:55:41.183946 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:55:41.183946 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:55:41.183946 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:55:41.183946 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1f478b9-b8e1-40a8-9232-34eb6df9ad7a could not be found. Sep 16 12:55:41.183946 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:55:41.184425 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a6ad3af1-692d-4bc0-a674-423cc37a0f7a tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:41.184425 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a6ad3af1-692d-4bc0-a674-423cc37a0f7a tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:41.184425 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a6ad3af1-692d-4bc0-a674-423cc37a0f7a tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:41.184425 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a6ad3af1-692d-4bc0-a674-423cc37a0f7a tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:41.184425 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a6ad3af1-692d-4bc0-a674-423cc37a0f7a tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:41.184425 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a6ad3af1-692d-4bc0-a674-423cc37a0f7a tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:41.195053 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4d189ed1-cfb4-4642-bfaf-38d4e08bda19 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Returning 404 to user: Instance a1f478b9-b8e1-40a8-9232-34eb6df9ad7a could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:55:41.195947 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4d189ed1-cfb4-4642-bfaf-38d4e08bda19 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a" status: 404 len: 111 microversion: 2.1 time: 0.083619 Sep 16 12:55:41.196552 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1161/2401] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:41 2022] GET /compute/v2.1/servers/a1f478b9-b8e1-40a8-9232-34eb6df9ad7a => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:55:41.201719 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8e0d4b01-a7ea-4d80-b48b-38d84468e0d2 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:41.202611 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8e0d4b01-a7ea-4d80-b48b-38d84468e0d2 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] [instance: c97d5f35-6ea1-4ec7-88f5-9da9dbe81182] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:41.209342 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8e0d4b01-a7ea-4d80-b48b-38d84468e0d2 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:41.210037 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8e0d4b01-a7ea-4d80-b48b-38d84468e0d2 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:41.210640 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8e0d4b01-a7ea-4d80-b48b-38d84468e0d2 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:41.211756 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8e0d4b01-a7ea-4d80-b48b-38d84468e0d2 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:41.212371 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8e0d4b01-a7ea-4d80-b48b-38d84468e0d2 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:41.212928 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8e0d4b01-a7ea-4d80-b48b-38d84468e0d2 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:41.249188 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8e0d4b01-a7ea-4d80-b48b-38d84468e0d2 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:41.249735 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8e0d4b01-a7ea-4d80-b48b-38d84468e0d2 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:41.250171 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8e0d4b01-a7ea-4d80-b48b-38d84468e0d2 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:41.250616 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-8e0d4b01-a7ea-4d80-b48b-38d84468e0d2 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lazy-loading 'fault' on Instance uuid c97d5f35-6ea1-4ec7-88f5-9da9dbe81182 {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:55:41.369109 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8e0d4b01-a7ea-4d80-b48b-38d84468e0d2 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63998619bf654ebb8d74f91e42c8c780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e81fca8624d18b9415a46e158d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:41.379864 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8e0d4b01-a7ea-4d80-b48b-38d84468e0d2 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182" status: 200 len: 1307 microversion: 2.1 time: 0.182098 Sep 16 12:55:41.381399 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1162/2402] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:41 2022] GET /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182 => generated 1307 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:41.396450 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-c79bd7c1-80b6-4ae2-9c3d-202a66161620 req-2c55dcfe-07ec-43ef-a250-afbdd4ea712b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d3df84c-ed0d-41a9-8632-63591274c2eb", "name": "network-vif-plugged", "status": "completed", "tag": "efcaf7d0-199c-4298-8d5d-68962f80ca3b"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:55:41.420890 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-c79bd7c1-80b6-4ae2-9c3d-202a66161620 req-2c55dcfe-07ec-43ef-a250-afbdd4ea712b service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:41.421609 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-c79bd7c1-80b6-4ae2-9c3d-202a66161620 req-2c55dcfe-07ec-43ef-a250-afbdd4ea712b service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:41.422209 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-c79bd7c1-80b6-4ae2-9c3d-202a66161620 req-2c55dcfe-07ec-43ef-a250-afbdd4ea712b service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:41.436054 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-c79bd7c1-80b6-4ae2-9c3d-202a66161620 req-2c55dcfe-07ec-43ef-a250-afbdd4ea712b service nova] Creating event network-vif-plugged:efcaf7d0-199c-4298-8d5d-68962f80ca3b for instance 8d3df84c-ed0d-41a9-8632-63591274c2eb on n-h1-858094-4 Sep 16 12:55:41.442264 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-c79bd7c1-80b6-4ae2-9c3d-202a66161620 req-2c55dcfe-07ec-43ef-a250-afbdd4ea712b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058478 Sep 16 12:55:41.443363 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1163/2403] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:55:41.449132 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ea3bcaa7-442e-49b1-9c47-879912e21e69 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:41.449727 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ea3bcaa7-442e-49b1-9c47-879912e21e69 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 566f231d-345e-4665-bf9a-b61004b954ed] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:41.456107 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ea3bcaa7-442e-49b1-9c47-879912e21e69 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:41.456626 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ea3bcaa7-442e-49b1-9c47-879912e21e69 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:41.457218 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ea3bcaa7-442e-49b1-9c47-879912e21e69 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:41.457938 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ea3bcaa7-442e-49b1-9c47-879912e21e69 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:41.458384 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ea3bcaa7-442e-49b1-9c47-879912e21e69 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:41.458830 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ea3bcaa7-442e-49b1-9c47-879912e21e69 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:41.489862 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ea3bcaa7-442e-49b1-9c47-879912e21e69 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 566f231d-345e-4665-bf9a-b61004b954ed] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:55:41.599279 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ea3bcaa7-442e-49b1-9c47-879912e21e69 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "DELETE /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed" status: 204 len: 0 microversion: 2.1 time: 0.154028 Sep 16 12:55:41.599944 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1164/2404] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:55:41 2022] DELETE /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:55:41.609240 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f2f35cd8-6939-48be-a246-79f3bb4b0119 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:41.610176 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f2f35cd8-6939-48be-a246-79f3bb4b0119 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:41.618790 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f2f35cd8-6939-48be-a246-79f3bb4b0119 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:41.619634 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f2f35cd8-6939-48be-a246-79f3bb4b0119 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:41.620266 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f2f35cd8-6939-48be-a246-79f3bb4b0119 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:41.621278 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f2f35cd8-6939-48be-a246-79f3bb4b0119 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:41.622009 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f2f35cd8-6939-48be-a246-79f3bb4b0119 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:41.622841 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f2f35cd8-6939-48be-a246-79f3bb4b0119 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:41.689539 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a6ad3af1-692d-4bc0-a674-423cc37a0f7a tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37316c1f04764255a2a9466676502c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e940a963f7740dea44034d06e8c2a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:41.698094 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a6ad3af1-692d-4bc0-a674-423cc37a0f7a tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb" status: 200 len: 1367 microversion: 2.1 time: 0.530380 Sep 16 12:55:41.712549 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1241/2405] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:41 2022] GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb => generated 1367 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:41.721127 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e153b9a0-06bb-4942-ab7f-c9ad5d3c7496 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:41.722573 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e153b9a0-06bb-4942-ab7f-c9ad5d3c7496 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 566f231d-345e-4665-bf9a-b61004b954ed] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:41.728954 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e153b9a0-06bb-4942-ab7f-c9ad5d3c7496 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:41.729649 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e153b9a0-06bb-4942-ab7f-c9ad5d3c7496 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:41.730312 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e153b9a0-06bb-4942-ab7f-c9ad5d3c7496 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:41.731411 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e153b9a0-06bb-4942-ab7f-c9ad5d3c7496 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:41.732080 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e153b9a0-06bb-4942-ab7f-c9ad5d3c7496 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:41.733247 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e153b9a0-06bb-4942-ab7f-c9ad5d3c7496 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:42.193199 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f2f35cd8-6939-48be-a246-79f3bb4b0119 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:42.202329 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e153b9a0-06bb-4942-ab7f-c9ad5d3c7496 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:42.209343 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f2f35cd8-6939-48be-a246-79f3bb4b0119 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:42.211734 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f2f35cd8-6939-48be-a246-79f3bb4b0119 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:42.215140 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f2f35cd8-6939-48be-a246-79f3bb4b0119 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 1814 microversion: 2.25 time: 0.612192 Sep 16 12:55:42.218504 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e153b9a0-06bb-4942-ab7f-c9ad5d3c7496 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed" status: 200 len: 1500 microversion: 2.1 time: 0.504604 Sep 16 12:55:42.219349 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1242/2406] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:41 2022] GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed => generated 1500 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:42.236193 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1165/2407] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:41 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 1814 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:55:42.241889 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c95b27d0-8b12-4387-bcfb-f3f8678c2bd0 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:42.242515 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c95b27d0-8b12-4387-bcfb-f3f8678c2bd0 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:42.249684 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8cfeb684-c041-44a2-a93e-af4ba78f3aa5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:42.251332 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8cfeb684-c041-44a2-a93e-af4ba78f3aa5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:42.253602 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:55:42.260403 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8cfeb684-c041-44a2-a93e-af4ba78f3aa5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:42.261108 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8cfeb684-c041-44a2-a93e-af4ba78f3aa5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:42.261725 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8cfeb684-c041-44a2-a93e-af4ba78f3aa5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:42.262593 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8cfeb684-c041-44a2-a93e-af4ba78f3aa5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:42.263054 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c95b27d0-8b12-4387-bcfb-f3f8678c2bd0 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:42.263373 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8cfeb684-c041-44a2-a93e-af4ba78f3aa5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:42.263547 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c95b27d0-8b12-4387-bcfb-f3f8678c2bd0 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:42.264012 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c95b27d0-8b12-4387-bcfb-f3f8678c2bd0 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:42.264336 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8cfeb684-c041-44a2-a93e-af4ba78f3aa5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:42.264750 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c95b27d0-8b12-4387-bcfb-f3f8678c2bd0 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:42.265211 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c95b27d0-8b12-4387-bcfb-f3f8678c2bd0 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:42.265640 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c95b27d0-8b12-4387-bcfb-f3f8678c2bd0 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:42.658133 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8cfeb684-c041-44a2-a93e-af4ba78f3aa5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:42.663992 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c95b27d0-8b12-4387-bcfb-f3f8678c2bd0 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:42.666857 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8cfeb684-c041-44a2-a93e-af4ba78f3aa5 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1312 microversion: 2.1 time: 0.422399 Sep 16 12:55:42.667640 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:55:42.673157 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c95b27d0-8b12-4387-bcfb-f3f8678c2bd0 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e" status: 200 len: 1521 microversion: 2.1 time: 0.452083 Sep 16 12:55:42.673737 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1243/2408] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:42 2022] GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e => generated 1521 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:42.679993 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5fe63a09-0996-46c8-82e8-43fae1d9fe34 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:42.680807 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5fe63a09-0996-46c8-82e8-43fae1d9fe34 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] [instance: aa4ce353-1393-4c5a-a229-6aee69ce030c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:42.686063 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1166/2409] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:42 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1312 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:42.693223 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fe63a09-0996-46c8-82e8-43fae1d9fe34 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:42.693770 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a38520a8-81b2-4092-964f-a1ea238cc177 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:42.693916 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fe63a09-0996-46c8-82e8-43fae1d9fe34 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:42.694311 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fe63a09-0996-46c8-82e8-43fae1d9fe34 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:42.694950 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a38520a8-81b2-4092-964f-a1ea238cc177 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] [instance: c97d5f35-6ea1-4ec7-88f5-9da9dbe81182] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:42.696172 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fe63a09-0996-46c8-82e8-43fae1d9fe34 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:42.697093 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fe63a09-0996-46c8-82e8-43fae1d9fe34 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:42.697681 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fe63a09-0996-46c8-82e8-43fae1d9fe34 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:42.703739 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a38520a8-81b2-4092-964f-a1ea238cc177 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:42.705060 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a38520a8-81b2-4092-964f-a1ea238cc177 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:42.705642 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a38520a8-81b2-4092-964f-a1ea238cc177 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:42.706483 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a38520a8-81b2-4092-964f-a1ea238cc177 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:42.707625 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a38520a8-81b2-4092-964f-a1ea238cc177 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:42.708185 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a38520a8-81b2-4092-964f-a1ea238cc177 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:42.726204 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-a38520a8-81b2-4092-964f-a1ea238cc177 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] HTTP exception thrown: Instance c97d5f35-6ea1-4ec7-88f5-9da9dbe81182 could not be found. Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a38520a8-81b2-4092-964f-a1ea238cc177 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Request method failure captured: Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182 HTTP/1.1 Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHGaIAOdxMYEkT64GzmtsRHk8boM-HkgMp2TcuzXhZ0Ysn4rv5N3dkw1hBTzHgesJhqdCQgZEWB31U9_8-GR28KKqRBru66x8owLMsnkeG63FRagXuw5WRkDgkjiuLErIxDDFUqU2EN7xsUM39H_2YSaR5IMCBpz7i110so2nWbVIq0 Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 051e81fca8624d18b9415a46e158d243 Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ListImageFiltersTestJSON-603980476 Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/051e81fca8624d18b9415a46e158d243"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/051e81fca8624d18b9415a46e158d243"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_051e81fca8624d18b9415a46e158d243", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/051e81fca8624d18b9415a46e158d243"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ListImageFiltersTestJSON-603980476 Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 051e81fca8624d18b9415a46e158d243 Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-603980476 Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ListImageFiltersTestJSON-603980476-project Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 63998619bf654ebb8d74f91e42c8c780 Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ListImageFiltersTestJSON-603980476-project Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance c97d5f35-6ea1-4ec7-88f5-9da9dbe81182 could not be found. Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'c97d5f35-6ea1-4ec7-88f5-9da9dbe81182'} Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c97d5f35-6ea1-4ec7-88f5-9da9dbe81182 could not be found. Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c97d5f35-6ea1-4ec7-88f5-9da9dbe81182 could not be found. Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:55:42.730383 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:55:42.735216 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:55:42.735216 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:55:42.735216 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:55:42.735216 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:55:42.735216 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:55:42.735216 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c97d5f35-6ea1-4ec7-88f5-9da9dbe81182 could not be found. Sep 16 12:55:42.735216 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:55:42.735216 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a38520a8-81b2-4092-964f-a1ea238cc177 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Returning 404 to user: Instance c97d5f35-6ea1-4ec7-88f5-9da9dbe81182 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:55:42.736729 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a38520a8-81b2-4092-964f-a1ea238cc177 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182" status: 404 len: 111 microversion: 2.1 time: 0.048222 Sep 16 12:55:42.737433 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1167/2410] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:42 2022] GET /compute/v2.1/servers/c97d5f35-6ea1-4ec7-88f5-9da9dbe81182 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:55:42.742516 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-509f05fb-0f55-47de-ae16-d958d9463b14 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:42.743280 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-509f05fb-0f55-47de-ae16-d958d9463b14 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:42.751947 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-509f05fb-0f55-47de-ae16-d958d9463b14 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:42.752657 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-509f05fb-0f55-47de-ae16-d958d9463b14 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:42.753196 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-509f05fb-0f55-47de-ae16-d958d9463b14 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:42.754486 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-509f05fb-0f55-47de-ae16-d958d9463b14 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:42.755759 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-509f05fb-0f55-47de-ae16-d958d9463b14 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:42.756584 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-509f05fb-0f55-47de-ae16-d958d9463b14 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:43.126027 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5fe63a09-0996-46c8-82e8-43fae1d9fe34 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:43.136561 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5fe63a09-0996-46c8-82e8-43fae1d9fe34 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:43.139319 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5fe63a09-0996-46c8-82e8-43fae1d9fe34 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:43.140850 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5fe63a09-0996-46c8-82e8-43fae1d9fe34 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] 10.222.0.67 "GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c" status: 200 len: 1358 microversion: 2.21 time: 0.465884 Sep 16 12:55:43.152535 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1244/2411] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:42 2022] GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c => generated 1358 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:55:43.160279 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-587fe60e-ee45-48dc-89ca-fa69201a03f3 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:43.161218 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-587fe60e-ee45-48dc-89ca-fa69201a03f3 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 8d3df84c-ed0d-41a9-8632-63591274c2eb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:43.167754 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-587fe60e-ee45-48dc-89ca-fa69201a03f3 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:43.168293 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-587fe60e-ee45-48dc-89ca-fa69201a03f3 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:43.168796 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-587fe60e-ee45-48dc-89ca-fa69201a03f3 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:43.169433 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-587fe60e-ee45-48dc-89ca-fa69201a03f3 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:43.169884 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-587fe60e-ee45-48dc-89ca-fa69201a03f3 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:43.170560 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-587fe60e-ee45-48dc-89ca-fa69201a03f3 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:43.235803 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-509f05fb-0f55-47de-ae16-d958d9463b14 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:43.245498 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-509f05fb-0f55-47de-ae16-d958d9463b14 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e" status: 200 len: 1521 microversion: 2.1 time: 0.506918 Sep 16 12:55:43.246086 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1168/2412] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:42 2022] GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e => generated 1521 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:43.252109 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d05663b7-3661-48da-bf26-bc05eaeb0832 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:43.252642 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d05663b7-3661-48da-bf26-bc05eaeb0832 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] [instance: 5219baf4-bfde-4037-a511-88ff2690ea6a] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:43.261186 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d05663b7-3661-48da-bf26-bc05eaeb0832 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:43.261904 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d05663b7-3661-48da-bf26-bc05eaeb0832 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:43.262486 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d05663b7-3661-48da-bf26-bc05eaeb0832 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:43.263435 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d05663b7-3661-48da-bf26-bc05eaeb0832 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:43.264758 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d05663b7-3661-48da-bf26-bc05eaeb0832 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:43.265506 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d05663b7-3661-48da-bf26-bc05eaeb0832 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:43.292796 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d05663b7-3661-48da-bf26-bc05eaeb0832 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] [instance: 5219baf4-bfde-4037-a511-88ff2690ea6a] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:55:43.375317 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d05663b7-3661-48da-bf26-bc05eaeb0832 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "DELETE /compute/v2.1/servers/5219baf4-bfde-4037-a511-88ff2690ea6a" status: 204 len: 0 microversion: 2.1 time: 0.127814 Sep 16 12:55:43.376502 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1169/2413] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:55:43 2022] DELETE /compute/v2.1/servers/5219baf4-bfde-4037-a511-88ff2690ea6a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:55:43.382241 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-88f5e844-6f84-4592-8863-dcea27cd038c req-b8adf4fe-4b1a-4103-a14b-e636a3fa0f3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d49156a2-d78c-4601-a431-e09716c76ce8", "tag": "d289a714-1b0e-4177-adf6-0d59780fa902"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:55:43.393074 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-88f5e844-6f84-4592-8863-dcea27cd038c req-b8adf4fe-4b1a-4103-a14b-e636a3fa0f3d service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:43.393835 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-88f5e844-6f84-4592-8863-dcea27cd038c req-b8adf4fe-4b1a-4103-a14b-e636a3fa0f3d service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:43.394273 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-88f5e844-6f84-4592-8863-dcea27cd038c req-b8adf4fe-4b1a-4103-a14b-e636a3fa0f3d service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:43.406868 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-88f5e844-6f84-4592-8863-dcea27cd038c req-b8adf4fe-4b1a-4103-a14b-e636a3fa0f3d service nova] Creating event network-changed:d289a714-1b0e-4177-adf6-0d59780fa902 for instance d49156a2-d78c-4601-a431-e09716c76ce8 on n-h2-858094-4 Sep 16 12:55:43.411826 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-88f5e844-6f84-4592-8863-dcea27cd038c req-b8adf4fe-4b1a-4103-a14b-e636a3fa0f3d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033813 Sep 16 12:55:43.412656 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1170/2414] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:55:43.417488 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-35c57d5a-b096-4192-93cf-5343e9c79d8c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:43.418184 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-35c57d5a-b096-4192-93cf-5343e9c79d8c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 566f231d-345e-4665-bf9a-b61004b954ed] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:43.424921 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-35c57d5a-b096-4192-93cf-5343e9c79d8c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:43.425430 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-35c57d5a-b096-4192-93cf-5343e9c79d8c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:43.425905 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-35c57d5a-b096-4192-93cf-5343e9c79d8c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:43.426511 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-35c57d5a-b096-4192-93cf-5343e9c79d8c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:43.426966 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-35c57d5a-b096-4192-93cf-5343e9c79d8c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:43.427391 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-35c57d5a-b096-4192-93cf-5343e9c79d8c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:43.690686 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-587fe60e-ee45-48dc-89ca-fa69201a03f3 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37316c1f04764255a2a9466676502c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e940a963f7740dea44034d06e8c2a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:43.699962 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-587fe60e-ee45-48dc-89ca-fa69201a03f3 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb" status: 200 len: 1367 microversion: 2.1 time: 0.546306 Sep 16 12:55:43.701427 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1245/2415] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:43 2022] GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb => generated 1367 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:43.716754 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-393a95fb-b379-4a06-9860-de75b597c7e6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:43.718365 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-393a95fb-b379-4a06-9860-de75b597c7e6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:43.725568 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-393a95fb-b379-4a06-9860-de75b597c7e6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:43.726217 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-393a95fb-b379-4a06-9860-de75b597c7e6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:43.726754 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-393a95fb-b379-4a06-9860-de75b597c7e6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:43.728267 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-393a95fb-b379-4a06-9860-de75b597c7e6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:43.728733 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-393a95fb-b379-4a06-9860-de75b597c7e6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:43.729347 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-393a95fb-b379-4a06-9860-de75b597c7e6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:43.957614 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-35c57d5a-b096-4192-93cf-5343e9c79d8c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:43.965747 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-35c57d5a-b096-4192-93cf-5343e9c79d8c tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed" status: 200 len: 1500 microversion: 2.1 time: 0.552113 Sep 16 12:55:43.966331 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1171/2416] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:43 2022] GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed => generated 1500 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:43.987609 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a13a3cb3-8f4a-4982-8757-651c159171d8 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2121675162", "metadata": {"": ""}}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a13a3cb3-8f4a-4982-8757-651c159171d8 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Request method failure captured: Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: request: POST /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e/action HTTP/1.1 Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 107 Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHI8T7yGPRAc3c6MPrRyvBn0sjBikdgUA-hTw5OumPvmvZhNIoTMLBQsFbEvX79WgLzGGVd0Tyjqag2EpyljzbSAD20HzRS6IC0nQYJFElFV23Kk60KxHTZ6ulzDMTvWGrZByycegK-oPTtKgXmNPoQq1DgmwbeXyTMrKt2g_ITcKgg Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: c88ea8e8750c440e86d3c1eb4ab6110e Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c88ea8e8750c440e86d3c1eb4ab6110e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: c88ea8e8750c440e86d3c1eb4ab6110e Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ImagesOneServerNegativeTestJSON-682956668-project Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 973378f0eed8476eb41a29d5ce57ed65 Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-682956668-project Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2121675162", "metadata": {"": ""}}} Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-2121675162', 'metadata': {'': ''}}}} Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise error Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi {'': ''} Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:55:43.992046 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 12:55:43.997226 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 12:55:43.997226 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 12:55:43.997226 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 12:55:43.997226 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 12:55:43.997226 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 12:55:43.997226 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 12:55:43.997226 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:55:43.997226 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:55:43.997226 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:55:43.997226 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:55:43.997226 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:55:43.997226 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:55:43.997226 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 12:55:43.997226 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 12:55:43.997226 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 12:55:43.997226 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:55:43.997226 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a13a3cb3-8f4a-4982-8757-651c159171d8 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:55:43.997226 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a13a3cb3-8f4a-4982-8757-651c159171d8 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "POST /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e/action" status: 400 len: 170 microversion: 2.1 time: 0.012341 Sep 16 12:55:43.999266 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1172/2417] 10.222.0.67 () {60 vars in 1279 bytes} [Fri Sep 16 12:55:43 2022] POST /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e/action => generated 170 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 12:55:44.002778 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c75d0961-8fa3-4ac9-9406-6f4d4755852e tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:44.003399 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c75d0961-8fa3-4ac9-9406-6f4d4755852e tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] [instance: 5219baf4-bfde-4037-a511-88ff2690ea6a] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:44.010310 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c75d0961-8fa3-4ac9-9406-6f4d4755852e tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:44.010799 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c75d0961-8fa3-4ac9-9406-6f4d4755852e tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:44.011231 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c75d0961-8fa3-4ac9-9406-6f4d4755852e tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:44.011950 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c75d0961-8fa3-4ac9-9406-6f4d4755852e tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:44.012442 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c75d0961-8fa3-4ac9-9406-6f4d4755852e tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:44.012856 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c75d0961-8fa3-4ac9-9406-6f4d4755852e tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:44.028883 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:55:44.221778 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-393a95fb-b379-4a06-9860-de75b597c7e6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:44.230568 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-393a95fb-b379-4a06-9860-de75b597c7e6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:44.232013 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-393a95fb-b379-4a06-9860-de75b597c7e6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:44.233411 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-393a95fb-b379-4a06-9860-de75b597c7e6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 1814 microversion: 2.25 time: 0.530581 Sep 16 12:55:44.233980 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1246/2418] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:43 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 1814 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:55:44.238943 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3f7fd46e-1075-47f0-a5d7-5cfeab6e8e87 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:44.239808 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3f7fd46e-1075-47f0-a5d7-5cfeab6e8e87 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:44.245825 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3f7fd46e-1075-47f0-a5d7-5cfeab6e8e87 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:44.246314 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3f7fd46e-1075-47f0-a5d7-5cfeab6e8e87 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:44.246750 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3f7fd46e-1075-47f0-a5d7-5cfeab6e8e87 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:44.247450 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3f7fd46e-1075-47f0-a5d7-5cfeab6e8e87 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:44.248060 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3f7fd46e-1075-47f0-a5d7-5cfeab6e8e87 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:44.249668 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3f7fd46e-1075-47f0-a5d7-5cfeab6e8e87 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:44.316084 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:55:44.772316 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c75d0961-8fa3-4ac9-9406-6f4d4755852e tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63998619bf654ebb8d74f91e42c8c780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e81fca8624d18b9415a46e158d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:44.780623 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c75d0961-8fa3-4ac9-9406-6f4d4755852e tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/servers/5219baf4-bfde-4037-a511-88ff2690ea6a" status: 200 len: 1472 microversion: 2.1 time: 0.781755 Sep 16 12:55:44.781129 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1173/2419] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:43 2022] GET /compute/v2.1/servers/5219baf4-bfde-4037-a511-88ff2690ea6a => generated 1472 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:44.785670 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-014c5407-d700-4cca-9245-82bd405cd5d1 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:44.786265 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-014c5407-d700-4cca-9245-82bd405cd5d1 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:44.792247 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-014c5407-d700-4cca-9245-82bd405cd5d1 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:44.792743 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-014c5407-d700-4cca-9245-82bd405cd5d1 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:44.793181 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-014c5407-d700-4cca-9245-82bd405cd5d1 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:44.793940 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-014c5407-d700-4cca-9245-82bd405cd5d1 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:44.794391 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-014c5407-d700-4cca-9245-82bd405cd5d1 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:44.794819 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-014c5407-d700-4cca-9245-82bd405cd5d1 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:44.852751 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=16 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:55:45.023587 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3f7fd46e-1075-47f0-a5d7-5cfeab6e8e87 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:45.032459 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3f7fd46e-1075-47f0-a5d7-5cfeab6e8e87 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1312 microversion: 2.1 time: 0.797021 Sep 16 12:55:45.033108 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1247/2420] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:44 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1312 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:45.038006 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8ec64b8d-ab2a-4363-b865-a1e29a745cb5 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:45.038436 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8ec64b8d-ab2a-4363-b865-a1e29a745cb5 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] [instance: aa4ce353-1393-4c5a-a229-6aee69ce030c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:45.044437 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ec64b8d-ab2a-4363-b865-a1e29a745cb5 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:45.045010 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ec64b8d-ab2a-4363-b865-a1e29a745cb5 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:45.046196 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ec64b8d-ab2a-4363-b865-a1e29a745cb5 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:45.047400 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ec64b8d-ab2a-4363-b865-a1e29a745cb5 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:45.047953 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ec64b8d-ab2a-4363-b865-a1e29a745cb5 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:45.048595 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ec64b8d-ab2a-4363-b865-a1e29a745cb5 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:45.265902 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-014c5407-d700-4cca-9245-82bd405cd5d1 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:45.274301 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-014c5407-d700-4cca-9245-82bd405cd5d1 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e" status: 200 len: 1521 microversion: 2.1 time: 0.492080 Sep 16 12:55:45.275478 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1174/2421] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:44 2022] GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e => generated 1521 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:45.282467 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-89395d6d-911b-49fb-a65d-ce11aeba4655 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:45.284199 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-89395d6d-911b-49fb-a65d-ce11aeba4655 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 8d3df84c-ed0d-41a9-8632-63591274c2eb] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:45.300211 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-89395d6d-911b-49fb-a65d-ce11aeba4655 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:45.300939 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-89395d6d-911b-49fb-a65d-ce11aeba4655 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:45.301520 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-89395d6d-911b-49fb-a65d-ce11aeba4655 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:45.302371 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-89395d6d-911b-49fb-a65d-ce11aeba4655 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:45.302973 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-89395d6d-911b-49fb-a65d-ce11aeba4655 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:45.303418 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-89395d6d-911b-49fb-a65d-ce11aeba4655 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:45.389667 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8ec64b8d-ab2a-4363-b865-a1e29a745cb5 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:45.398474 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8ec64b8d-ab2a-4363-b865-a1e29a745cb5 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:45.400220 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8ec64b8d-ab2a-4363-b865-a1e29a745cb5 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:45.401603 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8ec64b8d-ab2a-4363-b865-a1e29a745cb5 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] 10.222.0.67 "GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c" status: 200 len: 1358 microversion: 2.21 time: 0.367372 Sep 16 12:55:45.402280 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1248/2422] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:45 2022] GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c => generated 1358 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:55:45.408519 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f7fbdb9c-e65d-48ba-a07d-59cb1ae6983f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:45.409220 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f7fbdb9c-e65d-48ba-a07d-59cb1ae6983f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 566f231d-345e-4665-bf9a-b61004b954ed] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:45.422957 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7fbdb9c-e65d-48ba-a07d-59cb1ae6983f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:45.423990 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7fbdb9c-e65d-48ba-a07d-59cb1ae6983f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:45.424587 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7fbdb9c-e65d-48ba-a07d-59cb1ae6983f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:45.425403 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7fbdb9c-e65d-48ba-a07d-59cb1ae6983f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:45.426109 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7fbdb9c-e65d-48ba-a07d-59cb1ae6983f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:45.426891 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7fbdb9c-e65d-48ba-a07d-59cb1ae6983f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:45.498052 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-89395d6d-911b-49fb-a65d-ce11aeba4655 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37316c1f04764255a2a9466676502c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e940a963f7740dea44034d06e8c2a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:45.508659 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-89395d6d-911b-49fb-a65d-ce11aeba4655 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb" status: 200 len: 1557 microversion: 2.1 time: 0.231734 Sep 16 12:55:45.510530 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1175/2423] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:45 2022] GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb => generated 1557 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:45.517093 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-286983cd-1a34-4afe-875d-ce6c3a4010a2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:45.518047 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-286983cd-1a34-4afe-875d-ce6c3a4010a2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:45.530859 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f7fbdb9c-e65d-48ba-a07d-59cb1ae6983f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:45.531769 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-286983cd-1a34-4afe-875d-ce6c3a4010a2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:45.532293 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-286983cd-1a34-4afe-875d-ce6c3a4010a2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:45.532732 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-286983cd-1a34-4afe-875d-ce6c3a4010a2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:45.533629 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-286983cd-1a34-4afe-875d-ce6c3a4010a2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:45.534087 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-286983cd-1a34-4afe-875d-ce6c3a4010a2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:45.535210 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-286983cd-1a34-4afe-875d-ce6c3a4010a2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:45.544348 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f7fbdb9c-e65d-48ba-a07d-59cb1ae6983f tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed" status: 200 len: 1296 microversion: 2.1 time: 0.136170 Sep 16 12:55:45.544348 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1249/2424] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:45 2022] GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed => generated 1296 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:45.546062 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-77cce46e-9f7d-490e-9eff-19d7db891871 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:45.547135 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-77cce46e-9f7d-490e-9eff-19d7db891871 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:45.553987 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77cce46e-9f7d-490e-9eff-19d7db891871 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:45.554478 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77cce46e-9f7d-490e-9eff-19d7db891871 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:45.555233 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77cce46e-9f7d-490e-9eff-19d7db891871 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:45.556145 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77cce46e-9f7d-490e-9eff-19d7db891871 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:45.556759 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77cce46e-9f7d-490e-9eff-19d7db891871 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:45.557193 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77cce46e-9f7d-490e-9eff-19d7db891871 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:45.752045 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-286983cd-1a34-4afe-875d-ce6c3a4010a2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:45.764889 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-286983cd-1a34-4afe-875d-ce6c3a4010a2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:45.766566 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-286983cd-1a34-4afe-875d-ce6c3a4010a2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:45.766953 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-77cce46e-9f7d-490e-9eff-19d7db891871 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:45.768012 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-286983cd-1a34-4afe-875d-ce6c3a4010a2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 1814 microversion: 2.25 time: 0.255881 Sep 16 12:55:45.768800 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1176/2425] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:45 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 1814 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:55:45.773684 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-5b3b4367-ae65-4ae4-9aa6-74e9fbc12f8b req-58461c3e-7894-4426-93b9-94ae553c6827 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa4ce353-1393-4c5a-a229-6aee69ce030c", "tag": "81dc42ba-a9cc-4752-9e18-84676c9fb431"}, {"server_uuid": "566f231d-345e-4665-bf9a-b61004b954ed", "name": "network-vif-deleted", "tag": "924f27c6-9b29-461f-bbff-57520beb8e29"}, {"name": "network-changed", "server_uuid": "f648b7b7-38c9-4dff-8d24-039d1b9d9115", "tag": "71269ced-342c-468f-8025-bba5b93b85be"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:55:45.777458 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-77cce46e-9f7d-490e-9eff-19d7db891871 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e" status: 200 len: 1521 microversion: 2.1 time: 0.235790 Sep 16 12:55:45.778575 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1250/2426] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:45 2022] GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:45.786369 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7d0fa4db-961f-4009-ace2-8407a3f998a8 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:45.787181 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7d0fa4db-961f-4009-ace2-8407a3f998a8 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 8d3df84c-ed0d-41a9-8632-63591274c2eb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:45.797650 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-5b3b4367-ae65-4ae4-9aa6-74e9fbc12f8b req-58461c3e-7894-4426-93b9-94ae553c6827 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:45.798151 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d0fa4db-961f-4009-ace2-8407a3f998a8 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:45.798541 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-5b3b4367-ae65-4ae4-9aa6-74e9fbc12f8b req-58461c3e-7894-4426-93b9-94ae553c6827 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:45.799040 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-5b3b4367-ae65-4ae4-9aa6-74e9fbc12f8b req-58461c3e-7894-4426-93b9-94ae553c6827 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:45.799201 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d0fa4db-961f-4009-ace2-8407a3f998a8 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:45.799830 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d0fa4db-961f-4009-ace2-8407a3f998a8 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:45.800911 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d0fa4db-961f-4009-ace2-8407a3f998a8 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:45.801600 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d0fa4db-961f-4009-ace2-8407a3f998a8 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:45.802887 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d0fa4db-961f-4009-ace2-8407a3f998a8 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:45.817543 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-5b3b4367-ae65-4ae4-9aa6-74e9fbc12f8b req-58461c3e-7894-4426-93b9-94ae553c6827 service nova] Creating event network-changed:81dc42ba-a9cc-4752-9e18-84676c9fb431 for instance aa4ce353-1393-4c5a-a229-6aee69ce030c on n-h1-858094-4 Sep 16 12:55:45.818058 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-5b3b4367-ae65-4ae4-9aa6-74e9fbc12f8b req-58461c3e-7894-4426-93b9-94ae553c6827 service nova] Creating event network-vif-deleted:924f27c6-9b29-461f-bbff-57520beb8e29 for instance 566f231d-345e-4665-bf9a-b61004b954ed on n-h1-858094-4 Sep 16 12:55:45.818703 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-5b3b4367-ae65-4ae4-9aa6-74e9fbc12f8b req-58461c3e-7894-4426-93b9-94ae553c6827 service nova] Creating event network-changed:71269ced-342c-468f-8025-bba5b93b85be for instance f648b7b7-38c9-4dff-8d24-039d1b9d9115 on n-h1-858094-4 Sep 16 12:55:45.827422 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-5b3b4367-ae65-4ae4-9aa6-74e9fbc12f8b req-58461c3e-7894-4426-93b9-94ae553c6827 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.057194 Sep 16 12:55:45.828499 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1177/2427] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:55:45.834223 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-71a67b9a-7421-4440-86b5-c696024dfa5d tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-716331465", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-71a67b9a-7421-4440-86b5-c696024dfa5d tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Request method failure captured: Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: request: POST /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e/action HTTP/1.1 Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 618 Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHI8T7yGPRAc3c6MPrRyvBn0sjBikdgUA-hTw5OumPvmvZhNIoTMLBQsFbEvX79WgLzGGVd0Tyjqag2EpyljzbSAD20HzRS6IC0nQYJFElFV23Kk60KxHTZ6ulzDMTvWGrZByycegK-oPTtKgXmNPoQq1DgmwbeXyTMrKt2g_ITcKgg Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: c88ea8e8750c440e86d3c1eb4ab6110e Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c88ea8e8750c440e86d3c1eb4ab6110e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: c88ea8e8750c440e86d3c1eb4ab6110e Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ImagesOneServerNegativeTestJSON-682956668-project Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 973378f0eed8476eb41a29d5ce57ed65 Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-682956668-project Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-716331465", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-716331465', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 12:55:45.839560 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise error Sep 16 12:55:45.843005 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 12:55:45.843005 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:55:45.843005 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 16 12:55:45.843005 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 16 12:55:45.843005 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 16 12:55:45.843005 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 16 12:55:45.843005 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 16 12:55:45.843005 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:55:45.843005 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 16 12:55:45.843005 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Sep 16 12:55:45.843005 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:55:45.843005 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:55:45.843005 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:55:45.843005 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:55:45.843005 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:55:45.843005 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:55:45.843005 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:55:45.843005 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:55:45.843005 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:55:45.843005 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:55:45.843005 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:55:45.843005 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:55:45.843005 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 12:55:45.843005 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 12:55:45.843005 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 12:55:45.843005 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 12:55:45.843005 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 12:55:45.843005 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 12:55:45.843005 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 12:55:45.843005 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:55:45.843005 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:55:45.843005 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:55:45.843005 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:55:45.843005 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:55:45.843005 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:55:45.843005 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 12:55:45.843005 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 12:55:45.843005 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 12:55:45.843005 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:55:45.849478 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-71a67b9a-7421-4440-86b5-c696024dfa5d tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:55:45.849478 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-71a67b9a-7421-4440-86b5-c696024dfa5d tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "POST /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e/action" status: 400 len: 938 microversion: 2.1 time: 0.011451 Sep 16 12:55:45.849478 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1178/2428] 10.222.0.67 () {60 vars in 1279 bytes} [Fri Sep 16 12:55:45 2022] POST /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e/action => generated 938 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 12:55:45.849478 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-65e0fe37-0503-4680-a2c1-cca4adeae7ca tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:45.849478 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-65e0fe37-0503-4680-a2c1-cca4adeae7ca tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] [instance: 5219baf4-bfde-4037-a511-88ff2690ea6a] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:45.856351 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-65e0fe37-0503-4680-a2c1-cca4adeae7ca tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:45.856851 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-65e0fe37-0503-4680-a2c1-cca4adeae7ca tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:45.857373 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-65e0fe37-0503-4680-a2c1-cca4adeae7ca tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:45.859163 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-65e0fe37-0503-4680-a2c1-cca4adeae7ca tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:45.859163 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-65e0fe37-0503-4680-a2c1-cca4adeae7ca tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:45.859451 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-65e0fe37-0503-4680-a2c1-cca4adeae7ca tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:45.897086 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7d0fa4db-961f-4009-ace2-8407a3f998a8 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.117236 Sep 16 12:55:45.898678 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1251/2429] 10.222.0.67 () {58 vars in 1275 bytes} [Fri Sep 16 12:55:45 2022] GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb/os-interface => generated 285 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:55:45.913157 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-33fa4cb6-2365-49e5-8fb7-c0822b4816dc tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:45.913775 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-33fa4cb6-2365-49e5-8fb7-c0822b4816dc tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:45.921722 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33fa4cb6-2365-49e5-8fb7-c0822b4816dc tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:45.922213 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33fa4cb6-2365-49e5-8fb7-c0822b4816dc tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:45.922648 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33fa4cb6-2365-49e5-8fb7-c0822b4816dc tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:45.923408 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33fa4cb6-2365-49e5-8fb7-c0822b4816dc tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:45.923894 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33fa4cb6-2365-49e5-8fb7-c0822b4816dc tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:45.924359 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33fa4cb6-2365-49e5-8fb7-c0822b4816dc tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:46.226923 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-65e0fe37-0503-4680-a2c1-cca4adeae7ca tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63998619bf654ebb8d74f91e42c8c780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e81fca8624d18b9415a46e158d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:46.240179 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-65e0fe37-0503-4680-a2c1-cca4adeae7ca tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/servers/5219baf4-bfde-4037-a511-88ff2690ea6a" status: 200 len: 1472 microversion: 2.1 time: 0.396590 Sep 16 12:55:46.241044 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1179/2430] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:45 2022] GET /compute/v2.1/servers/5219baf4-bfde-4037-a511-88ff2690ea6a => generated 1472 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:46.246967 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-402e7f78-bf89-495b-92f6-ba4969451ce3 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:46.248028 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-402e7f78-bf89-495b-92f6-ba4969451ce3 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:46.255393 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-402e7f78-bf89-495b-92f6-ba4969451ce3 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:46.256220 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-402e7f78-bf89-495b-92f6-ba4969451ce3 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:46.256869 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-402e7f78-bf89-495b-92f6-ba4969451ce3 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:46.258258 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-402e7f78-bf89-495b-92f6-ba4969451ce3 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:46.259217 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-402e7f78-bf89-495b-92f6-ba4969451ce3 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:46.261053 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-402e7f78-bf89-495b-92f6-ba4969451ce3 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:46.281802 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-33fa4cb6-2365-49e5-8fb7-c0822b4816dc tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:46.293580 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-33fa4cb6-2365-49e5-8fb7-c0822b4816dc tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e" status: 200 len: 1521 microversion: 2.1 time: 0.384666 Sep 16 12:55:46.297372 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1252/2431] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:45 2022] GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e => generated 1521 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:46.320436 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4f040fed-c1bc-4a99-ae49-b214d6a4c06c tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:46.321072 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4f040fed-c1bc-4a99-ae49-b214d6a4c06c tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:46.328118 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f040fed-c1bc-4a99-ae49-b214d6a4c06c tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:46.328638 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f040fed-c1bc-4a99-ae49-b214d6a4c06c tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:46.329081 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f040fed-c1bc-4a99-ae49-b214d6a4c06c tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:46.329964 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f040fed-c1bc-4a99-ae49-b214d6a4c06c tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:46.330430 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f040fed-c1bc-4a99-ae49-b214d6a4c06c tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:46.330860 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f040fed-c1bc-4a99-ae49-b214d6a4c06c tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:46.628399 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-402e7f78-bf89-495b-92f6-ba4969451ce3 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:46.637657 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4f040fed-c1bc-4a99-ae49-b214d6a4c06c tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:46.644271 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-402e7f78-bf89-495b-92f6-ba4969451ce3 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1312 microversion: 2.1 time: 0.401791 Sep 16 12:55:46.644969 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1180/2432] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:46 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1312 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:46.652861 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-bbd41718-4b29-4e73-86bf-cb266092a8fd tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:46.653772 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-bbd41718-4b29-4e73-86bf-cb266092a8fd tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] [instance: aa4ce353-1393-4c5a-a229-6aee69ce030c] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:46.661829 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bbd41718-4b29-4e73-86bf-cb266092a8fd tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:46.662470 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bbd41718-4b29-4e73-86bf-cb266092a8fd tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:46.663040 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bbd41718-4b29-4e73-86bf-cb266092a8fd tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:46.663511 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4f040fed-c1bc-4a99-ae49-b214d6a4c06c tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e" status: 200 len: 1521 microversion: 2.1 time: 0.348275 Sep 16 12:55:46.663954 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bbd41718-4b29-4e73-86bf-cb266092a8fd tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:46.664583 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1253/2433] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:46 2022] GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e => generated 1521 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:55:46.669543 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-3d171ad1-edce-4b16-8a08-812e6f1286ef req-a6936398-30fc-46de-93ef-259992e98b46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5219baf4-bfde-4037-a511-88ff2690ea6a", "name": "network-vif-deleted", "tag": "537bc282-546d-4a7e-b32f-2149067cc012"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:55:46.676063 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bbd41718-4b29-4e73-86bf-cb266092a8fd tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:46.678440 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bbd41718-4b29-4e73-86bf-cb266092a8fd tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:46.682790 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3d171ad1-edce-4b16-8a08-812e6f1286ef req-a6936398-30fc-46de-93ef-259992e98b46 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:46.689232 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3d171ad1-edce-4b16-8a08-812e6f1286ef req-a6936398-30fc-46de-93ef-259992e98b46 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:46.689823 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3d171ad1-edce-4b16-8a08-812e6f1286ef req-a6936398-30fc-46de-93ef-259992e98b46 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:46.705999 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-3d171ad1-edce-4b16-8a08-812e6f1286ef req-a6936398-30fc-46de-93ef-259992e98b46 service nova] Creating event network-vif-deleted:537bc282-546d-4a7e-b32f-2149067cc012 for instance 5219baf4-bfde-4037-a511-88ff2690ea6a on n-h2-858094-4 Sep 16 12:55:46.712016 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-3d171ad1-edce-4b16-8a08-812e6f1286ef req-a6936398-30fc-46de-93ef-259992e98b46 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045791 Sep 16 12:55:46.713133 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1254/2434] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:55:46.724214 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9cdaa768-20ee-414e-aa08-fe6cf4ff0a63 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:46.725227 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9cdaa768-20ee-414e-aa08-fe6cf4ff0a63 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 566f231d-345e-4665-bf9a-b61004b954ed] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:46.732432 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9cdaa768-20ee-414e-aa08-fe6cf4ff0a63 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:46.733160 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9cdaa768-20ee-414e-aa08-fe6cf4ff0a63 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:46.733765 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9cdaa768-20ee-414e-aa08-fe6cf4ff0a63 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:46.734800 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9cdaa768-20ee-414e-aa08-fe6cf4ff0a63 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:46.735393 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9cdaa768-20ee-414e-aa08-fe6cf4ff0a63 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:46.735916 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9cdaa768-20ee-414e-aa08-fe6cf4ff0a63 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:46.864851 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9cdaa768-20ee-414e-aa08-fe6cf4ff0a63 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:46.873333 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9cdaa768-20ee-414e-aa08-fe6cf4ff0a63 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed" status: 200 len: 1296 microversion: 2.1 time: 0.158518 Sep 16 12:55:46.874942 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1255/2435] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:46 2022] GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed => generated 1296 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:46.887861 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2fec62fc-b299-4073-8ce6-419db3d54328 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2fec62fc-b299-4073-8ce6-419db3d54328 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Request method failure captured: Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e/action HTTP/1.1 Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 285 Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHI8T7yGPRAc3c6MPrRyvBn0sjBikdgUA-hTw5OumPvmvZhNIoTMLBQsFbEvX79WgLzGGVd0Tyjqag2EpyljzbSAD20HzRS6IC0nQYJFElFV23Kk60KxHTZ6ulzDMTvWGrZByycegK-oPTtKgXmNPoQq1DgmwbeXyTMrKt2g_ITcKgg Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: c88ea8e8750c440e86d3c1eb4ab6110e Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c88ea8e8750c440e86d3c1eb4ab6110e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: c88ea8e8750c440e86d3c1eb4ab6110e Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ImagesOneServerNegativeTestJSON-682956668-project Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 973378f0eed8476eb41a29d5ce57ed65 Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-682956668-project Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise error Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:55:46.893036 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:55:46.896448 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:55:46.896448 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:55:46.896448 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:55:46.896448 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:55:46.896448 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:55:46.896448 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:55:46.896448 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:55:46.896448 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:55:46.896448 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 12:55:46.896448 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 12:55:46.896448 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 12:55:46.896448 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 12:55:46.896448 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 12:55:46.896448 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 12:55:46.896448 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 16 12:55:46.896448 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:55:46.896448 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:55:46.896448 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:55:46.896448 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:55:46.896448 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:55:46.896448 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:55:46.896448 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 12:55:46.896448 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 12:55:46.896448 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 16 12:55:46.896448 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:55:46.896448 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2fec62fc-b299-4073-8ce6-419db3d54328 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:55:46.896448 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2fec62fc-b299-4073-8ce6-419db3d54328 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "POST /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e/action" status: 400 len: 619 microversion: 2.1 time: 0.018211 Sep 16 12:55:46.899326 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1256/2436] 10.222.0.67 () {60 vars in 1279 bytes} [Fri Sep 16 12:55:46 2022] POST /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e/action => generated 619 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 12:55:46.904373 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-db174687-144f-456c-844a-0d60aa6cad40 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:46.905027 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-db174687-144f-456c-844a-0d60aa6cad40 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:46.912972 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db174687-144f-456c-844a-0d60aa6cad40 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:46.913382 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db174687-144f-456c-844a-0d60aa6cad40 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:46.913822 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db174687-144f-456c-844a-0d60aa6cad40 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:46.914521 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db174687-144f-456c-844a-0d60aa6cad40 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:46.914972 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db174687-144f-456c-844a-0d60aa6cad40 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:46.915403 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db174687-144f-456c-844a-0d60aa6cad40 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:47.054876 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-bbd41718-4b29-4e73-86bf-cb266092a8fd tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:47.065609 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-bbd41718-4b29-4e73-86bf-cb266092a8fd tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:47.067066 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-bbd41718-4b29-4e73-86bf-cb266092a8fd tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:47.068443 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-bbd41718-4b29-4e73-86bf-cb266092a8fd tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] 10.222.0.67 "GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c" status: 200 len: 1358 microversion: 2.21 time: 0.422154 Sep 16 12:55:47.080150 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1181/2437] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:46 2022] GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c => generated 1358 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:55:47.084370 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4c0712fc-a7cb-4c95-ba65-5294ea753ecd tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:47.084992 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-4c0712fc-a7cb-4c95-ba65-5294ea753ecd tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:47.091508 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4c0712fc-a7cb-4c95-ba65-5294ea753ecd tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:47.092099 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4c0712fc-a7cb-4c95-ba65-5294ea753ecd tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:47.092783 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4c0712fc-a7cb-4c95-ba65-5294ea753ecd tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:47.093505 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4c0712fc-a7cb-4c95-ba65-5294ea753ecd tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:47.093957 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4c0712fc-a7cb-4c95-ba65-5294ea753ecd tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:47.094385 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4c0712fc-a7cb-4c95-ba65-5294ea753ecd tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:47.206717 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-db174687-144f-456c-844a-0d60aa6cad40 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:47.215077 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-db174687-144f-456c-844a-0d60aa6cad40 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:47.216596 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-db174687-144f-456c-844a-0d60aa6cad40 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:47.218308 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-db174687-144f-456c-844a-0d60aa6cad40 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 1814 microversion: 2.25 time: 0.317777 Sep 16 12:55:47.219078 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1257/2438] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:46 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 1814 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:55:47.269448 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-14f88b1d-c409-41d3-9886-ae61830454dc tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:47.270078 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-14f88b1d-c409-41d3-9886-ae61830454dc tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] [instance: 5219baf4-bfde-4037-a511-88ff2690ea6a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:47.276735 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14f88b1d-c409-41d3-9886-ae61830454dc tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:47.277121 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14f88b1d-c409-41d3-9886-ae61830454dc tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:47.277564 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14f88b1d-c409-41d3-9886-ae61830454dc tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:47.278271 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14f88b1d-c409-41d3-9886-ae61830454dc tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:47.278893 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14f88b1d-c409-41d3-9886-ae61830454dc tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:47.279353 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14f88b1d-c409-41d3-9886-ae61830454dc tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:47.316356 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14f88b1d-c409-41d3-9886-ae61830454dc tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:47.316847 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14f88b1d-c409-41d3-9886-ae61830454dc tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:47.317898 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14f88b1d-c409-41d3-9886-ae61830454dc tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:47.318359 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-14f88b1d-c409-41d3-9886-ae61830454dc tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lazy-loading 'fault' on Instance uuid 5219baf4-bfde-4037-a511-88ff2690ea6a {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:55:47.361891 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4c0712fc-a7cb-4c95-ba65-5294ea753ecd tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:47.370583 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4c0712fc-a7cb-4c95-ba65-5294ea753ecd tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e" status: 200 len: 1521 microversion: 2.1 time: 0.291543 Sep 16 12:55:47.378751 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1182/2439] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:47 2022] GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:47.393948 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c6cae063-cd38-4f16-ab96-81cddab17d68 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:47.394573 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c6cae063-cd38-4f16-ab96-81cddab17d68 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:47.401992 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c6cae063-cd38-4f16-ab96-81cddab17d68 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:47.402487 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c6cae063-cd38-4f16-ab96-81cddab17d68 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:47.402926 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c6cae063-cd38-4f16-ab96-81cddab17d68 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:47.403638 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c6cae063-cd38-4f16-ab96-81cddab17d68 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:47.404090 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c6cae063-cd38-4f16-ab96-81cddab17d68 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:47.404537 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c6cae063-cd38-4f16-ab96-81cddab17d68 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:47.408363 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-14f88b1d-c409-41d3-9886-ae61830454dc tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63998619bf654ebb8d74f91e42c8c780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e81fca8624d18b9415a46e158d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:47.419557 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-14f88b1d-c409-41d3-9886-ae61830454dc tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/servers/5219baf4-bfde-4037-a511-88ff2690ea6a" status: 200 len: 1307 microversion: 2.1 time: 0.154241 Sep 16 12:55:47.420169 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1258/2440] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:47 2022] GET /compute/v2.1/servers/5219baf4-bfde-4037-a511-88ff2690ea6a => generated 1307 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:55:47.616032 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c6cae063-cd38-4f16-ab96-81cddab17d68 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:47.624016 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c6cae063-cd38-4f16-ab96-81cddab17d68 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e" status: 200 len: 1521 microversion: 2.1 time: 0.234084 Sep 16 12:55:47.624632 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1183/2441] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:47 2022] GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:55:47.646565 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b4a32176-dbad-446e-a510-f4c855d3a0a2 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1799691763"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:55:47.648931 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b4a32176-dbad-446e-a510-f4c855d3a0a2 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:47.654975 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4a32176-dbad-446e-a510-f4c855d3a0a2 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:47.655469 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4a32176-dbad-446e-a510-f4c855d3a0a2 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:47.655917 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4a32176-dbad-446e-a510-f4c855d3a0a2 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:47.656650 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4a32176-dbad-446e-a510-f4c855d3a0a2 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:47.657670 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4a32176-dbad-446e-a510-f4c855d3a0a2 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:47.658114 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4a32176-dbad-446e-a510-f4c855d3a0a2 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:47.668867 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4a2b4f79-15dc-423d-9bd0-650c60c8eb01 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:47.669379 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-4a2b4f79-15dc-423d-9bd0-650c60c8eb01 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:47.676026 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4a2b4f79-15dc-423d-9bd0-650c60c8eb01 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:47.676719 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4a2b4f79-15dc-423d-9bd0-650c60c8eb01 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:47.677312 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4a2b4f79-15dc-423d-9bd0-650c60c8eb01 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:47.678172 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4a2b4f79-15dc-423d-9bd0-650c60c8eb01 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:47.678815 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4a2b4f79-15dc-423d-9bd0-650c60c8eb01 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:47.679452 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4a2b4f79-15dc-423d-9bd0-650c60c8eb01 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:47.844551 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4a2b4f79-15dc-423d-9bd0-650c60c8eb01 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:47.862311 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4a2b4f79-15dc-423d-9bd0-650c60c8eb01 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1312 microversion: 2.1 time: 0.197171 Sep 16 12:55:47.866458 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1184/2442] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:47 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1312 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:47.877165 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-abc32323-2e4a-4036-8fab-d998fe4203a9 req-e85731a6-bfd0-411c-8c8d-a9760c657780 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d3df84c-ed0d-41a9-8632-63591274c2eb", "tag": "efcaf7d0-199c-4298-8d5d-68962f80ca3b"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:55:47.888188 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-abc32323-2e4a-4036-8fab-d998fe4203a9 req-e85731a6-bfd0-411c-8c8d-a9760c657780 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:47.889011 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-abc32323-2e4a-4036-8fab-d998fe4203a9 req-e85731a6-bfd0-411c-8c8d-a9760c657780 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:47.890160 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-abc32323-2e4a-4036-8fab-d998fe4203a9 req-e85731a6-bfd0-411c-8c8d-a9760c657780 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:47.904397 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-abc32323-2e4a-4036-8fab-d998fe4203a9 req-e85731a6-bfd0-411c-8c8d-a9760c657780 service nova] Creating event network-changed:efcaf7d0-199c-4298-8d5d-68962f80ca3b for instance 8d3df84c-ed0d-41a9-8632-63591274c2eb on n-h1-858094-4 Sep 16 12:55:47.909977 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-abc32323-2e4a-4036-8fab-d998fe4203a9 req-e85731a6-bfd0-411c-8c8d-a9760c657780 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041990 Sep 16 12:55:47.910859 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1185/2443] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:55:47.917223 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8af62b11-a946-4ae6-a89a-829e55f961ad tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:47.918269 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8af62b11-a946-4ae6-a89a-829e55f961ad tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 566f231d-345e-4665-bf9a-b61004b954ed] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:47.926862 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8af62b11-a946-4ae6-a89a-829e55f961ad tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:47.927703 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8af62b11-a946-4ae6-a89a-829e55f961ad tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:47.928417 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8af62b11-a946-4ae6-a89a-829e55f961ad tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:47.929521 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8af62b11-a946-4ae6-a89a-829e55f961ad tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:47.930189 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8af62b11-a946-4ae6-a89a-829e55f961ad tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:47.930820 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8af62b11-a946-4ae6-a89a-829e55f961ad tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:47.952850 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b4a32176-dbad-446e-a510-f4c855d3a0a2 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "POST /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e/action" status: 202 len: 0 microversion: 2.1 time: 0.309907 Sep 16 12:55:47.957975 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1259/2444] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:55:47 2022] POST /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 16 12:55:47.978823 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8af62b11-a946-4ae6-a89a-829e55f961ad tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:47.979557 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8af62b11-a946-4ae6-a89a-829e55f961ad tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:47.980270 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8af62b11-a946-4ae6-a89a-829e55f961ad tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:47.980907 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-8af62b11-a946-4ae6-a89a-829e55f961ad tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lazy-loading 'fault' on Instance uuid 566f231d-345e-4665-bf9a-b61004b954ed {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:55:47.994215 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-350a45f3-4dd5-4cf7-85a9-57fe4a3ced2a tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1415349713"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:55:48.003236 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-350a45f3-4dd5-4cf7-85a9-57fe4a3ced2a tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:48.026830 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-350a45f3-4dd5-4cf7-85a9-57fe4a3ced2a tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:48.029287 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-350a45f3-4dd5-4cf7-85a9-57fe4a3ced2a tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:48.030671 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-350a45f3-4dd5-4cf7-85a9-57fe4a3ced2a tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:48.031997 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-350a45f3-4dd5-4cf7-85a9-57fe4a3ced2a tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:48.032997 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-350a45f3-4dd5-4cf7-85a9-57fe4a3ced2a tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:48.033747 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-350a45f3-4dd5-4cf7-85a9-57fe4a3ced2a tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:48.072020 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8af62b11-a946-4ae6-a89a-829e55f961ad tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ef253e9844572a0f081955b3e9a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ec914bffb4743921e4116b0c399eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:48.084949 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:55:48.085646 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8af62b11-a946-4ae6-a89a-829e55f961ad tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed" status: 200 len: 1301 microversion: 2.1 time: 0.170960 Sep 16 12:55:48.088230 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1186/2445] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:47 2022] GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed => generated 1301 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:48.097973 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-350a45f3-4dd5-4cf7-85a9-57fe4a3ced2a tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] HTTP exception thrown: Cannot 'createImage' instance 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e while it is in task_state image_snapshot_pending Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-350a45f3-4dd5-4cf7-85a9-57fe4a3ced2a tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Request method failure captured: Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e/action HTTP/1.1 Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 85 Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHI8T7yGPRAc3c6MPrRyvBn0sjBikdgUA-hTw5OumPvmvZhNIoTMLBQsFbEvX79WgLzGGVd0Tyjqag2EpyljzbSAD20HzRS6IC0nQYJFElFV23Kk60KxHTZ6ulzDMTvWGrZByycegK-oPTtKgXmNPoQq1DgmwbeXyTMrKt2g_ITcKgg Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: c88ea8e8750c440e86d3c1eb4ab6110e Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c88ea8e8750c440e86d3c1eb4ab6110e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: c88ea8e8750c440e86d3c1eb4ab6110e Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ImagesOneServerNegativeTestJSON-682956668-project Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 973378f0eed8476eb41a29d5ce57ed65 Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-682956668-project Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1415349713"}} Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: exception: Cannot 'createImage' instance 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e while it is in task_state image_snapshot_pending Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1415349713'}}} Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 16 12:55:48.099681 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 16 12:55:48.103089 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e while it is in task_state image_snapshot_pending Sep 16 12:55:48.103089 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:55:48.103089 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:55:48.103089 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:55:48.103089 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:55:48.103089 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:55:48.103089 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:55:48.103089 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:55:48.103089 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:55:48.103089 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e while it is in task_state image_snapshot_pending Sep 16 12:55:48.103089 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:55:48.103089 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-350a45f3-4dd5-4cf7-85a9-57fe4a3ced2a tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Returning 409 to user: Cannot 'createImage' instance 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e while it is in task_state image_snapshot_pending {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:55:48.103089 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-350a45f3-4dd5-4cf7-85a9-57fe4a3ced2a tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "POST /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e/action" status: 409 len: 167 microversion: 2.1 time: 0.136844 Sep 16 12:55:48.103089 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1260/2446] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:55:47 2022] POST /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e/action => generated 167 bytes in 138 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 16 12:55:48.111153 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-24c8f64f-341d-4570-8518-a4928b4b3168 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:48.114231 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8dd42c44-4659-4470-b292-a4652e700a6c tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '.version_select at 0x7f103571eee0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:48.115136 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-24c8f64f-341d-4570-8518-a4928b4b3168 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] [instance: aa4ce353-1393-4c5a-a229-6aee69ce030c] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:48.144609 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-24c8f64f-341d-4570-8518-a4928b4b3168 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:48.147743 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-24c8f64f-341d-4570-8518-a4928b4b3168 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:48.149270 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-24c8f64f-341d-4570-8518-a4928b4b3168 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:48.152096 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-24c8f64f-341d-4570-8518-a4928b4b3168 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:48.153394 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-24c8f64f-341d-4570-8518-a4928b4b3168 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:48.153843 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-24c8f64f-341d-4570-8518-a4928b4b3168 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:48.332294 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8dd42c44-4659-4470-b292-a4652e700a6c tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "DELETE /compute/v2.1/images/45b82bad-accf-4167-8ee8-820da0c223f3" status: 204 len: 0 microversion: 2.1 time: 0.223098 Sep 16 12:55:48.334379 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1261/2447] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:48 2022] DELETE /compute/v2.1/images/45b82bad-accf-4167-8ee8-820da0c223f3 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:55:48.341615 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0a5c95b6-1fbd-4fae-b3c7-f20333c661be tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:48.342688 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0a5c95b6-1fbd-4fae-b3c7-f20333c661be tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:48.349485 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a5c95b6-1fbd-4fae-b3c7-f20333c661be tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:48.349983 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a5c95b6-1fbd-4fae-b3c7-f20333c661be tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:48.350533 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a5c95b6-1fbd-4fae-b3c7-f20333c661be tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:48.351249 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a5c95b6-1fbd-4fae-b3c7-f20333c661be tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:48.351824 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a5c95b6-1fbd-4fae-b3c7-f20333c661be tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:48.352319 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a5c95b6-1fbd-4fae-b3c7-f20333c661be tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:48.957129 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-24c8f64f-341d-4570-8518-a4928b4b3168 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:48.966661 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-24c8f64f-341d-4570-8518-a4928b4b3168 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:48.969103 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-24c8f64f-341d-4570-8518-a4928b4b3168 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:48.970280 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-24c8f64f-341d-4570-8518-a4928b4b3168 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] 10.222.0.67 "GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c" status: 200 len: 1358 microversion: 2.21 time: 0.879877 Sep 16 12:55:48.971058 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1187/2448] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:48 2022] GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c => generated 1358 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:55:48.975953 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6283abe5-c125-4128-a43f-987a4a332af8 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:48.976597 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6283abe5-c125-4128-a43f-987a4a332af8 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:48.983097 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6283abe5-c125-4128-a43f-987a4a332af8 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:48.984453 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6283abe5-c125-4128-a43f-987a4a332af8 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:48.985119 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6283abe5-c125-4128-a43f-987a4a332af8 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:48.986080 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6283abe5-c125-4128-a43f-987a4a332af8 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:48.986745 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6283abe5-c125-4128-a43f-987a4a332af8 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:48.987366 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6283abe5-c125-4128-a43f-987a4a332af8 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:49.193415 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0a5c95b6-1fbd-4fae-b3c7-f20333c661be tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:49.226776 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0a5c95b6-1fbd-4fae-b3c7-f20333c661be tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:49.228892 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0a5c95b6-1fbd-4fae-b3c7-f20333c661be tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:49.234747 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0a5c95b6-1fbd-4fae-b3c7-f20333c661be tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 1814 microversion: 2.25 time: 0.898095 Sep 16 12:55:49.249787 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1262/2449] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:48 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 1814 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:55:49.269830 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-adb653e2-d6c9-44aa-a427-1a5bcf6ed786 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:49.270734 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-adb653e2-d6c9-44aa-a427-1a5bcf6ed786 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] [instance: 5219baf4-bfde-4037-a511-88ff2690ea6a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:49.278978 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-adb653e2-d6c9-44aa-a427-1a5bcf6ed786 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:49.279721 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-adb653e2-d6c9-44aa-a427-1a5bcf6ed786 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:49.280906 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-adb653e2-d6c9-44aa-a427-1a5bcf6ed786 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:49.282577 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-adb653e2-d6c9-44aa-a427-1a5bcf6ed786 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:49.283242 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-adb653e2-d6c9-44aa-a427-1a5bcf6ed786 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:49.283838 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-adb653e2-d6c9-44aa-a427-1a5bcf6ed786 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:49.302335 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-adb653e2-d6c9-44aa-a427-1a5bcf6ed786 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] HTTP exception thrown: Instance 5219baf4-bfde-4037-a511-88ff2690ea6a could not be found. Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-adb653e2-d6c9-44aa-a427-1a5bcf6ed786 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Request method failure captured: Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/5219baf4-bfde-4037-a511-88ff2690ea6a HTTP/1.1 Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHGaIAOdxMYEkT64GzmtsRHk8boM-HkgMp2TcuzXhZ0Ysn4rv5N3dkw1hBTzHgesJhqdCQgZEWB31U9_8-GR28KKqRBru66x8owLMsnkeG63FRagXuw5WRkDgkjiuLErIxDDFUqU2EN7xsUM39H_2YSaR5IMCBpz7i110so2nWbVIq0 Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 051e81fca8624d18b9415a46e158d243 Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ListImageFiltersTestJSON-603980476 Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/051e81fca8624d18b9415a46e158d243"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/051e81fca8624d18b9415a46e158d243"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_051e81fca8624d18b9415a46e158d243", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/051e81fca8624d18b9415a46e158d243"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ListImageFiltersTestJSON-603980476 Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 051e81fca8624d18b9415a46e158d243 Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-603980476 Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ListImageFiltersTestJSON-603980476-project Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 63998619bf654ebb8d74f91e42c8c780 Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ListImageFiltersTestJSON-603980476-project Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 5219baf4-bfde-4037-a511-88ff2690ea6a could not be found. Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '5219baf4-bfde-4037-a511-88ff2690ea6a'} Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5219baf4-bfde-4037-a511-88ff2690ea6a could not be found. Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5219baf4-bfde-4037-a511-88ff2690ea6a could not be found. Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:55:49.304336 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:55:49.309445 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:55:49.309445 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:55:49.309445 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:55:49.309445 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:55:49.309445 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:55:49.309445 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5219baf4-bfde-4037-a511-88ff2690ea6a could not be found. Sep 16 12:55:49.309445 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:55:49.309445 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-adb653e2-d6c9-44aa-a427-1a5bcf6ed786 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Returning 404 to user: Instance 5219baf4-bfde-4037-a511-88ff2690ea6a could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:55:49.309445 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-adb653e2-d6c9-44aa-a427-1a5bcf6ed786 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "GET /compute/v2.1/servers/5219baf4-bfde-4037-a511-88ff2690ea6a" status: 404 len: 111 microversion: 2.1 time: 0.054870 Sep 16 12:55:49.310874 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1263/2450] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:49 2022] GET /compute/v2.1/servers/5219baf4-bfde-4037-a511-88ff2690ea6a => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:55:49.314774 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ee0828f1-77a0-42dc-86cf-f4db65eea0b1 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:49.315373 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ee0828f1-77a0-42dc-86cf-f4db65eea0b1 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:49.322040 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee0828f1-77a0-42dc-86cf-f4db65eea0b1 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:49.322645 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee0828f1-77a0-42dc-86cf-f4db65eea0b1 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:49.323098 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee0828f1-77a0-42dc-86cf-f4db65eea0b1 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:49.323806 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee0828f1-77a0-42dc-86cf-f4db65eea0b1 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:49.324309 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee0828f1-77a0-42dc-86cf-f4db65eea0b1 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:49.324738 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee0828f1-77a0-42dc-86cf-f4db65eea0b1 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:49.533129 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6283abe5-c125-4128-a43f-987a4a332af8 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:49.542439 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6283abe5-c125-4128-a43f-987a4a332af8 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e" status: 200 len: 1533 microversion: 2.1 time: 0.570023 Sep 16 12:55:49.543013 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1188/2451] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:48 2022] GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e => generated 1533 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:49.548951 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-41c3f38a-8420-43d8-b44e-8b730c3cb7c0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:49.549572 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-41c3f38a-8420-43d8-b44e-8b730c3cb7c0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] [instance: 566f231d-345e-4665-bf9a-b61004b954ed] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:49.556991 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-41c3f38a-8420-43d8-b44e-8b730c3cb7c0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:49.557480 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-41c3f38a-8420-43d8-b44e-8b730c3cb7c0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:49.558046 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-41c3f38a-8420-43d8-b44e-8b730c3cb7c0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:49.558630 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-41c3f38a-8420-43d8-b44e-8b730c3cb7c0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:49.559076 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-41c3f38a-8420-43d8-b44e-8b730c3cb7c0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:49.559492 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-41c3f38a-8420-43d8-b44e-8b730c3cb7c0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:49.574423 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-41c3f38a-8420-43d8-b44e-8b730c3cb7c0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] HTTP exception thrown: Instance 566f231d-345e-4665-bf9a-b61004b954ed could not be found. Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-41c3f38a-8420-43d8-b44e-8b730c3cb7c0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Request method failure captured: Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed HTTP/1.1 Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHA2k7I_Nlb7ALNJZ9Q994AgJQQSVayIRfXZwkHIKWObv5ojlKNex5wQePttzrHwxCfD_v8XkqrmNTqITWzqKUEvx7gP1nhAAJVgboAk9sHePDTro3y1EuuyPAxHLfA4fiYFESzV7eY_EcJ7TztpomOPr8eDk3XA9yTci_TiYj7fcpE Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: dd7ec914bffb4743921e4116b0c399eb Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-LiveMigrationTest-924693802 Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dd7ec914bffb4743921e4116b0c399eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/dd7ec914bffb4743921e4116b0c399eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_dd7ec914bffb4743921e4116b0c399eb", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dd7ec914bffb4743921e4116b0c399eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-LiveMigrationTest-924693802 Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: dd7ec914bffb4743921e4116b0c399eb Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-LiveMigrationTest-924693802 Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-LiveMigrationTest-924693802-project Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 745ef253e9844572a0f081955b3e9a90 Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-LiveMigrationTest-924693802-project Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance 566f231d-345e-4665-bf9a-b61004b954ed could not be found. Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '566f231d-345e-4665-bf9a-b61004b954ed'} Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 566f231d-345e-4665-bf9a-b61004b954ed could not be found. Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 566f231d-345e-4665-bf9a-b61004b954ed could not be found. Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:55:49.576078 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:55:49.581772 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:55:49.581772 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:55:49.581772 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:55:49.581772 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:55:49.581772 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:55:49.581772 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 566f231d-345e-4665-bf9a-b61004b954ed could not be found. Sep 16 12:55:49.581772 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:55:49.581772 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-41c3f38a-8420-43d8-b44e-8b730c3cb7c0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] Returning 404 to user: Instance 566f231d-345e-4665-bf9a-b61004b954ed could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:55:49.581772 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-41c3f38a-8420-43d8-b44e-8b730c3cb7c0 tempest-LiveMigrationTest-924693802 tempest-LiveMigrationTest-924693802-project] 10.222.0.67 "GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed" status: 404 len: 111 microversion: 2.1 time: 0.034260 Sep 16 12:55:49.581772 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1189/2452] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:49 2022] GET /compute/v2.1/servers/566f231d-345e-4665-bf9a-b61004b954ed => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:55:49.584249 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-04cd0d4e-3130-439c-80fa-35769931518e tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f1034b950d0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:49.763729 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ee0828f1-77a0-42dc-86cf-f4db65eea0b1 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:49.775939 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ee0828f1-77a0-42dc-86cf-f4db65eea0b1 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1312 microversion: 2.1 time: 0.464671 Sep 16 12:55:49.794027 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1264/2453] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:49 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1312 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:49.854446 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-04cd0d4e-3130-439c-80fa-35769931518e tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "DELETE /compute/v2.1/images/09c17acb-ad38-43c8-9325-ab54e2b69b5c" status: 204 len: 0 microversion: 2.1 time: 0.274314 Sep 16 12:55:49.855117 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1190/2454] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:49 2022] DELETE /compute/v2.1/images/09c17acb-ad38-43c8-9325-ab54e2b69b5c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:55:49.865631 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6bee8b68-fc3f-485e-980b-1f6ece647d84 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f1035a9a670>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:49.996967 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-81d3fc43-a1a5-4781-ba9c-bb2bfc9dc55d tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:49.997808 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-81d3fc43-a1a5-4781-ba9c-bb2bfc9dc55d tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] [instance: aa4ce353-1393-4c5a-a229-6aee69ce030c] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:50.011592 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-81d3fc43-a1a5-4781-ba9c-bb2bfc9dc55d tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:50.012440 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-81d3fc43-a1a5-4781-ba9c-bb2bfc9dc55d tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:50.013100 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-81d3fc43-a1a5-4781-ba9c-bb2bfc9dc55d tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:50.013811 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-81d3fc43-a1a5-4781-ba9c-bb2bfc9dc55d tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:50.014888 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-81d3fc43-a1a5-4781-ba9c-bb2bfc9dc55d tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:50.015485 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-81d3fc43-a1a5-4781-ba9c-bb2bfc9dc55d tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:50.168862 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6bee8b68-fc3f-485e-980b-1f6ece647d84 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "DELETE /compute/v2.1/images/fd848734-b5d1-45eb-856c-610b57bf8403" status: 204 len: 0 microversion: 2.1 time: 0.308412 Sep 16 12:55:50.169784 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1265/2455] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:49 2022] DELETE /compute/v2.1/images/fd848734-b5d1-45eb-856c-610b57bf8403 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 12:55:50.178726 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b8ae0597-6091-40d2-851d-5f48a9dc4cc2 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] Calling method '.version_select at 0x7f103566a5e0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:50.183767 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-81d3fc43-a1a5-4781-ba9c-bb2bfc9dc55d tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:50.194083 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-81d3fc43-a1a5-4781-ba9c-bb2bfc9dc55d tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:50.195535 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-81d3fc43-a1a5-4781-ba9c-bb2bfc9dc55d tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:50.197015 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-81d3fc43-a1a5-4781-ba9c-bb2bfc9dc55d tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] 10.222.0.67 "GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c" status: 200 len: 1358 microversion: 2.21 time: 0.204706 Sep 16 12:55:50.200512 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1191/2456] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:49 2022] GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:55:50.263787 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5a2c2bff-5c67-4532-973e-5d0626d0c7f3 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:50.265182 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5a2c2bff-5c67-4532-973e-5d0626d0c7f3 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:50.272349 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5a2c2bff-5c67-4532-973e-5d0626d0c7f3 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:50.273057 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5a2c2bff-5c67-4532-973e-5d0626d0c7f3 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:50.273799 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5a2c2bff-5c67-4532-973e-5d0626d0c7f3 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:50.275578 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5a2c2bff-5c67-4532-973e-5d0626d0c7f3 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:50.276303 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5a2c2bff-5c67-4532-973e-5d0626d0c7f3 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:50.276957 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5a2c2bff-5c67-4532-973e-5d0626d0c7f3 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:50.429736 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b8ae0597-6091-40d2-851d-5f48a9dc4cc2 tempest-ListImageFiltersTestJSON-603980476 tempest-ListImageFiltersTestJSON-603980476-project] 10.222.0.67 "DELETE /compute/v2.1/images/54daa0c5-9a5f-43d3-ad6f-11b5d75596b1" status: 204 len: 0 microversion: 2.1 time: 0.254764 Sep 16 12:55:50.430456 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1266/2457] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:50 2022] DELETE /compute/v2.1/images/54daa0c5-9a5f-43d3-ad6f-11b5d75596b1 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 12:55:50.435756 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5a2c2bff-5c67-4532-973e-5d0626d0c7f3 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:50.445899 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5a2c2bff-5c67-4532-973e-5d0626d0c7f3 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:50.447548 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5a2c2bff-5c67-4532-973e-5d0626d0c7f3 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:50.448917 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5a2c2bff-5c67-4532-973e-5d0626d0c7f3 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 1814 microversion: 2.25 time: 0.189630 Sep 16 12:55:50.449810 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1192/2458] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:50 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 1814 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:55:50.567535 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-01692349-cce2-47cf-9dc6-d146205bc8e8 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:50.568519 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-01692349-cce2-47cf-9dc6-d146205bc8e8 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:50.575189 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01692349-cce2-47cf-9dc6-d146205bc8e8 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:50.575688 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01692349-cce2-47cf-9dc6-d146205bc8e8 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:50.576152 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01692349-cce2-47cf-9dc6-d146205bc8e8 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:50.576976 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01692349-cce2-47cf-9dc6-d146205bc8e8 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:50.577375 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01692349-cce2-47cf-9dc6-d146205bc8e8 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:50.578358 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01692349-cce2-47cf-9dc6-d146205bc8e8 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:50.759461 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-01692349-cce2-47cf-9dc6-d146205bc8e8 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:50.772265 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-01692349-cce2-47cf-9dc6-d146205bc8e8 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e" status: 200 len: 1539 microversion: 2.1 time: 0.209532 Sep 16 12:55:50.773697 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1267/2459] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:50 2022] GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e => generated 1539 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:50.804155 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1eb88fbc-0b50-49f3-84a8-f521ed60e2dd tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:50.805297 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-1eb88fbc-0b50-49f3-84a8-f521ed60e2dd tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:50.820554 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1eb88fbc-0b50-49f3-84a8-f521ed60e2dd tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:50.822612 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1eb88fbc-0b50-49f3-84a8-f521ed60e2dd tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:50.823259 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1eb88fbc-0b50-49f3-84a8-f521ed60e2dd tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:50.824308 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1eb88fbc-0b50-49f3-84a8-f521ed60e2dd tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:50.827335 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1eb88fbc-0b50-49f3-84a8-f521ed60e2dd tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:50.827975 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1eb88fbc-0b50-49f3-84a8-f521ed60e2dd tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:51.006163 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1eb88fbc-0b50-49f3-84a8-f521ed60e2dd tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:51.009121 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=100 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:55:51.016754 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1eb88fbc-0b50-49f3-84a8-f521ed60e2dd tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1312 microversion: 2.1 time: 0.217543 Sep 16 12:55:51.017360 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1193/2460] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:50 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1312 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:51.222996 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f1f05d64-0265-4334-828b-cc7127ed6e17 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:51.223650 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f1f05d64-0265-4334-828b-cc7127ed6e17 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] [instance: aa4ce353-1393-4c5a-a229-6aee69ce030c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:51.229909 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1f05d64-0265-4334-828b-cc7127ed6e17 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:51.230807 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1f05d64-0265-4334-828b-cc7127ed6e17 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:51.231617 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1f05d64-0265-4334-828b-cc7127ed6e17 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:51.232659 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1f05d64-0265-4334-828b-cc7127ed6e17 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:51.233402 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1f05d64-0265-4334-828b-cc7127ed6e17 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:51.234578 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1f05d64-0265-4334-828b-cc7127ed6e17 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:51.418270 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f1f05d64-0265-4334-828b-cc7127ed6e17 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:51.434331 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f1f05d64-0265-4334-828b-cc7127ed6e17 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:51.438150 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f1f05d64-0265-4334-828b-cc7127ed6e17 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:51.441405 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f1f05d64-0265-4334-828b-cc7127ed6e17 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] 10.222.0.67 "GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c" status: 200 len: 1358 microversion: 2.21 time: 0.222366 Sep 16 12:55:51.442551 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1268/2461] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:51 2022] GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c => generated 1358 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:55:51.475552 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c22a1e1e-4729-4368-b426-229701126adb tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:51.477997 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c22a1e1e-4729-4368-b426-229701126adb tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:51.485751 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c22a1e1e-4729-4368-b426-229701126adb tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:51.486534 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c22a1e1e-4729-4368-b426-229701126adb tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:51.487215 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c22a1e1e-4729-4368-b426-229701126adb tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:51.488168 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c22a1e1e-4729-4368-b426-229701126adb tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:51.488793 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c22a1e1e-4729-4368-b426-229701126adb tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:51.489326 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c22a1e1e-4729-4368-b426-229701126adb tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:51.783782 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c22a1e1e-4729-4368-b426-229701126adb tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:51.799070 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c22a1e1e-4729-4368-b426-229701126adb tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:51.800557 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-e4eada46-1306-4329-810f-492c40044918 req-a1d0e7d7-6208-4b83-badb-b693a5631f64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa4ce353-1393-4c5a-a229-6aee69ce030c", "name": "network-vif-plugged", "status": "completed", "tag": "81dc42ba-a9cc-4752-9e18-84676c9fb431"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:55:51.802191 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c22a1e1e-4729-4368-b426-229701126adb tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:51.809685 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c22a1e1e-4729-4368-b426-229701126adb tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 1814 microversion: 2.25 time: 0.338094 Sep 16 12:55:51.811807 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1194/2462] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:51 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 1814 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:55:51.821205 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c32af4b2-e503-4c69-92c4-f63b37ec7dc3 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:51.822326 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c32af4b2-e503-4c69-92c4-f63b37ec7dc3 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:51.828661 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e4eada46-1306-4329-810f-492c40044918 req-a1d0e7d7-6208-4b83-badb-b693a5631f64 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:51.829192 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e4eada46-1306-4329-810f-492c40044918 req-a1d0e7d7-6208-4b83-badb-b693a5631f64 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:51.829639 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e4eada46-1306-4329-810f-492c40044918 req-a1d0e7d7-6208-4b83-badb-b693a5631f64 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:51.847232 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c32af4b2-e503-4c69-92c4-f63b37ec7dc3 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:51.847883 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c32af4b2-e503-4c69-92c4-f63b37ec7dc3 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:51.848454 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c32af4b2-e503-4c69-92c4-f63b37ec7dc3 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:51.849288 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c32af4b2-e503-4c69-92c4-f63b37ec7dc3 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:51.849837 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c32af4b2-e503-4c69-92c4-f63b37ec7dc3 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:51.850367 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c32af4b2-e503-4c69-92c4-f63b37ec7dc3 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:51.852030 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-e4eada46-1306-4329-810f-492c40044918 req-a1d0e7d7-6208-4b83-badb-b693a5631f64 service nova] Creating event network-vif-plugged:81dc42ba-a9cc-4752-9e18-84676c9fb431 for instance aa4ce353-1393-4c5a-a229-6aee69ce030c on n-h1-858094-4 Sep 16 12:55:51.857463 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-e4eada46-1306-4329-810f-492c40044918 req-a1d0e7d7-6208-4b83-badb-b693a5631f64 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.306598 Sep 16 12:55:51.859293 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1269/2463] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:55:52.041559 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7b0bce3c-ad23-41e1-885c-f1ce3ab5444d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:52.042280 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7b0bce3c-ad23-41e1-885c-f1ce3ab5444d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:52.060794 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b0bce3c-ad23-41e1-885c-f1ce3ab5444d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:52.062127 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b0bce3c-ad23-41e1-885c-f1ce3ab5444d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:52.063131 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b0bce3c-ad23-41e1-885c-f1ce3ab5444d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:52.064195 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b0bce3c-ad23-41e1-885c-f1ce3ab5444d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:52.064956 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b0bce3c-ad23-41e1-885c-f1ce3ab5444d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:52.065654 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b0bce3c-ad23-41e1-885c-f1ce3ab5444d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:52.081708 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c32af4b2-e503-4c69-92c4-f63b37ec7dc3 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:52.098669 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c32af4b2-e503-4c69-92c4-f63b37ec7dc3 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e" status: 200 len: 1534 microversion: 2.1 time: 0.285408 Sep 16 12:55:52.099307 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1195/2464] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:51 2022] GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e => generated 1534 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:52.467205 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9a714018-1a2a-47f1-88b6-209c4467834e tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:52.468512 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9a714018-1a2a-47f1-88b6-209c4467834e tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] [instance: aa4ce353-1393-4c5a-a229-6aee69ce030c] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:52.479116 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9a714018-1a2a-47f1-88b6-209c4467834e tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:52.479623 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9a714018-1a2a-47f1-88b6-209c4467834e tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:52.480068 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9a714018-1a2a-47f1-88b6-209c4467834e tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:52.480820 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9a714018-1a2a-47f1-88b6-209c4467834e tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:52.481281 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9a714018-1a2a-47f1-88b6-209c4467834e tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:52.481705 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9a714018-1a2a-47f1-88b6-209c4467834e tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:52.506418 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7b0bce3c-ad23-41e1-885c-f1ce3ab5444d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:52.514504 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7b0bce3c-ad23-41e1-885c-f1ce3ab5444d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1312 microversion: 2.1 time: 0.477762 Sep 16 12:55:52.525256 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1270/2465] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:52 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1312 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:55:52.710643 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4db04881-f3a7-481c-a6d7-6feacc8394d0 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Action: 'create', calling method: .version_select at 0x7f1035727700>, body: {"keypair": {"name": "tempest-keypair-825608468", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+KGt7RDw7eqce+gYZnW6tndE+3BFrpZJo2uVYeSrSm93VGIKjrBop/PtnBu9oUbZ90KbLLsunaAaO/BY7cPxIEm6m4xhcOSVCuytf6U5yHtIEVeTZzzbjkiMSQp6qcow=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:55:52.742825 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-4db04881-f3a7-481c-a6d7-6feacc8394d0 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Getting quotas for project d43cacdef3cc4b38bbbdae9a92b24c7e. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:55:52.750542 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-4db04881-f3a7-481c-a6d7-6feacc8394d0 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Getting quotas for user eebd07fc28cd46abb1b8f242e988e0a5 and project d43cacdef3cc4b38bbbdae9a92b24c7e. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:55:52.784987 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4db04881-f3a7-481c-a6d7-6feacc8394d0 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.258320 Sep 16 12:55:52.786584 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1271/2466] 10.222.0.67 () {62 vars in 1199 bytes} [Fri Sep 16 12:55:52 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 261 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 16 12:55:52.800489 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b86a11f6-f203-46af-9dfa-916abde63eb5 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Calling method '.version_select at 0x7f1035a9a040>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:52.822703 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b86a11f6-f203-46af-9dfa-916abde63eb5 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] 10.222.0.67 "GET /compute/v2.1/os-keypairs/tempest-keypair-825608468" status: 200 len: 512 microversion: 2.2 time: 0.027986 Sep 16 12:55:52.823876 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1272/2467] 10.222.0.67 () {60 vars in 1255 bytes} [Fri Sep 16 12:55:52 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-825608468 => generated 512 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:55:52.844616 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a7d53ee4-20c3-4ec3-aa35-29f2c12ae909 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Calling method '.version_select at 0x7f1035649430>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:52.885872 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9a714018-1a2a-47f1-88b6-209c4467834e tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:52.886904 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a7d53ee4-20c3-4ec3-aa35-29f2c12ae909 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-825608468" status: 204 len: 0 microversion: 2.2 time: 0.053602 Sep 16 12:55:52.888008 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1273/2468] 10.222.0.67 () {60 vars in 1258 bytes} [Fri Sep 16 12:55:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-825608468 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:55:52.897344 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6d61a7d5-5b4b-440b-8660-897c85d81354 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:52.898132 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6d61a7d5-5b4b-440b-8660-897c85d81354 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:52.903038 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9a714018-1a2a-47f1-88b6-209c4467834e tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:52.904352 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:55:52.907645 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d61a7d5-5b4b-440b-8660-897c85d81354 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:52.908255 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d61a7d5-5b4b-440b-8660-897c85d81354 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:52.908715 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d61a7d5-5b4b-440b-8660-897c85d81354 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:52.909436 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d61a7d5-5b4b-440b-8660-897c85d81354 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:52.909900 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d61a7d5-5b4b-440b-8660-897c85d81354 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:52.910394 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d61a7d5-5b4b-440b-8660-897c85d81354 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:52.933811 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9a714018-1a2a-47f1-88b6-209c4467834e tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:52.937617 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9a714018-1a2a-47f1-88b6-209c4467834e tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] 10.222.0.67 "GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c" status: 200 len: 1358 microversion: 2.21 time: 0.474412 Sep 16 12:55:52.947081 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1196/2469] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:52 2022] GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c => generated 1358 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:55:52.952012 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4d71404e-d9a4-45b7-a8cb-2990f952bf45 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Action: 'create', calling method: .version_select at 0x7f1034dc2040>, body: {"keypair": {"name": "tempest-keypair-174070773", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOndfplXkwIFGsUEks6vPwpkscWf6laGFywZG8wq0gQ+WQrupagajnOqp5ZYjErdzJidtUvly1UI8R2NfLHeJwuHPPaf7+jrLpOhqTX+zDtKrhwB7TQCYVEsm/ODDkn2dA=="}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:55:52.994764 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-4d71404e-d9a4-45b7-a8cb-2990f952bf45 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Getting quotas for project d43cacdef3cc4b38bbbdae9a92b24c7e. Resources: {'key_pairs'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:55:53.007496 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-4d71404e-d9a4-45b7-a8cb-2990f952bf45 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Getting quotas for user eebd07fc28cd46abb1b8f242e988e0a5 and project d43cacdef3cc4b38bbbdae9a92b24c7e. Resources: {'key_pairs'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:55:53.076593 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4d71404e-d9a4-45b7-a8cb-2990f952bf45 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.133173 Sep 16 12:55:53.084959 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1197/2470] 10.222.0.67 () {62 vars in 1199 bytes} [Fri Sep 16 12:55:52 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 145 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 16 12:55:53.098218 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-faa3a640-e14d-46f8-ab42-fbcb707b877e tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Calling method '.version_select at 0x7f1034b33dc0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:53.117454 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6d61a7d5-5b4b-440b-8660-897c85d81354 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:53.141806 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-faa3a640-e14d-46f8-ab42-fbcb707b877e tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-174070773" status: 204 len: 0 microversion: 2.2 time: 0.054787 Sep 16 12:55:53.144373 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6d61a7d5-5b4b-440b-8660-897c85d81354 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:53.146363 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6d61a7d5-5b4b-440b-8660-897c85d81354 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:53.149553 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6d61a7d5-5b4b-440b-8660-897c85d81354 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 1814 microversion: 2.25 time: 0.255267 Sep 16 12:55:53.157483 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1198/2471] 10.222.0.67 () {60 vars in 1258 bytes} [Fri Sep 16 12:55:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-174070773 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:55:53.163232 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-152c0a0d-1ba2-42ac-b321-da9b8a838801 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:53.164305 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-152c0a0d-1ba2-42ac-b321-da9b8a838801 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:53.164594 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1274/2472] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:52 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 1814 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:55:53.179070 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a76d7d1c-f346-489e-8a18-96301856b49a tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Action: 'create', calling method: .version_select at 0x7f103566a790>, body: {"keypair": {"name": "tempest-keypair-1447152488", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:55:53.181750 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-152c0a0d-1ba2-42ac-b321-da9b8a838801 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:53.184689 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-152c0a0d-1ba2-42ac-b321-da9b8a838801 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:53.187844 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-152c0a0d-1ba2-42ac-b321-da9b8a838801 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:53.188791 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-152c0a0d-1ba2-42ac-b321-da9b8a838801 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:53.191003 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-152c0a0d-1ba2-42ac-b321-da9b8a838801 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:53.191676 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-152c0a0d-1ba2-42ac-b321-da9b8a838801 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:53.201677 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-a76d7d1c-f346-489e-8a18-96301856b49a tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Getting quotas for project d43cacdef3cc4b38bbbdae9a92b24c7e. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:55:53.210054 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-a76d7d1c-f346-489e-8a18-96301856b49a tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Getting quotas for user eebd07fc28cd46abb1b8f242e988e0a5 and project d43cacdef3cc4b38bbbdae9a92b24c7e. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:55:53.246516 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a76d7d1c-f346-489e-8a18-96301856b49a tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.080634 Sep 16 12:55:53.247441 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1275/2473] 10.222.0.67 () {62 vars in 1199 bytes} [Fri Sep 16 12:55:53 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 82 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 16 12:55:53.264355 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a4ca3e2a-f8ed-4f02-842a-97e7674cfe4a tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Calling method '.version_select at 0x7f1035649430>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:53.295765 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a4ca3e2a-f8ed-4f02-842a-97e7674cfe4a tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1447152488" status: 204 len: 0 microversion: 2.2 time: 0.039918 Sep 16 12:55:53.297407 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1276/2474] 10.222.0.67 () {60 vars in 1261 bytes} [Fri Sep 16 12:55:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1447152488 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:55:53.309375 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-136c0591-e7cb-4e3a-8b2d-b0af4434ea91 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Action: 'create', calling method: .version_select at 0x7f103526ed30>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-510497145", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBKuFzJP6wKXT1I9wEXxjcPe6ijGXUe6M5Se9tgGtygrArmnnam6no7EEvzSETD1yaPQnzmQXt2qODFvS/ILBCearcQYiPIHPW5I/zEkvScWDnFxuzthKofXigahDLu4Q=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:55:53.338792 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-136c0591-e7cb-4e3a-8b2d-b0af4434ea91 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Getting quotas for project d43cacdef3cc4b38bbbdae9a92b24c7e. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:55:53.346936 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-136c0591-e7cb-4e3a-8b2d-b0af4434ea91 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Getting quotas for user eebd07fc28cd46abb1b8f242e988e0a5 and project d43cacdef3cc4b38bbbdae9a92b24c7e. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:55:53.379694 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-136c0591-e7cb-4e3a-8b2d-b0af4434ea91 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.074471 Sep 16 12:55:53.388751 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1277/2475] 10.222.0.67 () {62 vars in 1199 bytes} [Fri Sep 16 12:55:53 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 76 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 16 12:55:53.399673 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-78d26642-8996-45f7-be08-b2d23234be45 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Action: 'create', calling method: .version_select at 0x7f1035649ee0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2122957207", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMf7rsIFyFYv8KuZAvbJlzvXugfTl+F9wgcbhYc9NoK7Lsy5jAF0zHg190JaMHJUVUQ4dmm0zq02z3pQDQJUrFe064ezFmXutoQENU2770WK3oAOaD72zVevtEV/w5qeMg=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:55:53.451736 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-78d26642-8996-45f7-be08-b2d23234be45 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Getting quotas for project d43cacdef3cc4b38bbbdae9a92b24c7e. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:55:53.466674 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-78d26642-8996-45f7-be08-b2d23234be45 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Getting quotas for user eebd07fc28cd46abb1b8f242e988e0a5 and project d43cacdef3cc4b38bbbdae9a92b24c7e. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:55:53.473521 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-152c0a0d-1ba2-42ac-b321-da9b8a838801 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:53.482164 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-152c0a0d-1ba2-42ac-b321-da9b8a838801 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e" status: 200 len: 1521 microversion: 2.1 time: 0.323200 Sep 16 12:55:53.484630 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1199/2476] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:53 2022] GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:53.509815 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-78d26642-8996-45f7-be08-b2d23234be45 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.117438 Sep 16 12:55:53.511390 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1278/2477] 10.222.0.67 () {62 vars in 1199 bytes} [Fri Sep 16 12:55:53 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 120 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 16 12:55:53.521073 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-dc26c232-4639-4368-a15e-2d9eb5d5eff0 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:53.521820 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-dc26c232-4639-4368-a15e-2d9eb5d5eff0 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:53.526848 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d106c048-6e41-47c1-975e-dc613fae7280 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Action: 'create', calling method: .version_select at 0x7f103566a5e0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-524703848", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1Na6aKcLN+ADn/IixeNdc/gF2YNW09nPbOPl+uZkQomGQXDfgawkhvU2ob3DfIl4dnQjW//PsFXWyQaYnyQo/K8Gz2kUEp1wc29rftgniyqola5a64qkw1/JHB9a+I3g=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:55:53.531329 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dc26c232-4639-4368-a15e-2d9eb5d5eff0 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:53.531975 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dc26c232-4639-4368-a15e-2d9eb5d5eff0 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:53.532586 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dc26c232-4639-4368-a15e-2d9eb5d5eff0 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:53.533460 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dc26c232-4639-4368-a15e-2d9eb5d5eff0 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:53.534064 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dc26c232-4639-4368-a15e-2d9eb5d5eff0 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:53.534653 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dc26c232-4639-4368-a15e-2d9eb5d5eff0 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:53.562412 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-d106c048-6e41-47c1-975e-dc613fae7280 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Getting quotas for project d43cacdef3cc4b38bbbdae9a92b24c7e. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:55:53.572406 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-dc26c232-4639-4368-a15e-2d9eb5d5eff0 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:55:53.585405 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-d106c048-6e41-47c1-975e-dc613fae7280 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Getting quotas for user eebd07fc28cd46abb1b8f242e988e0a5 and project d43cacdef3cc4b38bbbdae9a92b24c7e. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:55:53.617741 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d106c048-6e41-47c1-975e-dc613fae7280 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.096676 Sep 16 12:55:53.618735 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1279/2478] 10.222.0.67 () {62 vars in 1199 bytes} [Fri Sep 16 12:55:53 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 98 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 16 12:55:53.625706 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-69faa32b-9ee5-43c7-8e40-4161cf31099a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:53.626762 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-69faa32b-9ee5-43c7-8e40-4161cf31099a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:53.645362 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-69faa32b-9ee5-43c7-8e40-4161cf31099a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:53.648711 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-69faa32b-9ee5-43c7-8e40-4161cf31099a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:53.649620 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-69faa32b-9ee5-43c7-8e40-4161cf31099a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:53.650911 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-69faa32b-9ee5-43c7-8e40-4161cf31099a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:53.651627 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-69faa32b-9ee5-43c7-8e40-4161cf31099a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:53.652333 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-69faa32b-9ee5-43c7-8e40-4161cf31099a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:53.719760 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-dc26c232-4639-4368-a15e-2d9eb5d5eff0 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e" status: 204 len: 0 microversion: 2.1 time: 0.212057 Sep 16 12:55:53.724249 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1200/2479] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:55:53 2022] DELETE /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 12:55:53.731893 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-546f90b3-1432-4b68-99bf-432fd5df1d99 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Calling method '.version_select at 0x7f1034b331f0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:53.737623 n-d-858094-4 devstack@n-api.service[128780]: WARNING oslo_db.sqlalchemy.utils [None req-546f90b3-1432-4b68-99bf-432fd5df1d99 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 16 12:55:53.745417 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-546f90b3-1432-4b68-99bf-432fd5df1d99 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] 10.222.0.67 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.019405 Sep 16 12:55:53.746503 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1201/2480] 10.222.0.67 () {60 vars in 1177 bytes} [Fri Sep 16 12:55:53 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:53.761063 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-dbe5ad7d-b5cb-448f-b0db-a005d21e74be tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:53.761748 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-dbe5ad7d-b5cb-448f-b0db-a005d21e74be tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:53.779864 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dbe5ad7d-b5cb-448f-b0db-a005d21e74be tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:53.783674 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dbe5ad7d-b5cb-448f-b0db-a005d21e74be tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:53.785269 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dbe5ad7d-b5cb-448f-b0db-a005d21e74be tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:53.786414 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dbe5ad7d-b5cb-448f-b0db-a005d21e74be tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:53.788776 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dbe5ad7d-b5cb-448f-b0db-a005d21e74be tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:53.801072 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dbe5ad7d-b5cb-448f-b0db-a005d21e74be tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:54.287102 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-69faa32b-9ee5-43c7-8e40-4161cf31099a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:54.312731 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-69faa32b-9ee5-43c7-8e40-4161cf31099a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1312 microversion: 2.1 time: 0.692367 Sep 16 12:55:54.313757 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1280/2481] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:53 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1312 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:54.319086 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-dbe5ad7d-b5cb-448f-b0db-a005d21e74be tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:54.332973 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-dbe5ad7d-b5cb-448f-b0db-a005d21e74be tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e" status: 200 len: 1527 microversion: 2.1 time: 0.584169 Sep 16 12:55:54.333819 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1202/2482] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:53 2022] GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e => generated 1527 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:54.336645 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c50c311f-2feb-40dc-96eb-df013951584a tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Calling method '.version_select at 0x7f1035a211f0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:54.352021 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-db222cf8-e0cb-4ee1-be1c-4deb8e6653dd req-bfa92147-06b4-496d-8d7e-f78934b1832e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e", "name": "network-vif-plugged", "status": "completed", "tag": "0ce5e362-3ed5-4bc9-a8bf-6141e6997ba5"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:55:54.374911 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-db222cf8-e0cb-4ee1-be1c-4deb8e6653dd req-bfa92147-06b4-496d-8d7e-f78934b1832e service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:54.375408 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-db222cf8-e0cb-4ee1-be1c-4deb8e6653dd req-bfa92147-06b4-496d-8d7e-f78934b1832e service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:54.375847 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-db222cf8-e0cb-4ee1-be1c-4deb8e6653dd req-bfa92147-06b4-496d-8d7e-f78934b1832e service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:54.379452 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c50c311f-2feb-40dc-96eb-df013951584a tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-524703848" status: 204 len: 0 microversion: 2.2 time: 0.063631 Sep 16 12:55:54.380315 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1281/2483] 10.222.0.67 () {60 vars in 1318 bytes} [Fri Sep 16 12:55:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-524703848 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:55:54.388668 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-66001c17-a00e-4ac3-a58b-460f545349f8 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:54.392379 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-66001c17-a00e-4ac3-a58b-460f545349f8 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] [instance: aa4ce353-1393-4c5a-a229-6aee69ce030c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:54.393868 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-db222cf8-e0cb-4ee1-be1c-4deb8e6653dd req-bfa92147-06b4-496d-8d7e-f78934b1832e service nova] Creating event network-vif-plugged:0ce5e362-3ed5-4bc9-a8bf-6141e6997ba5 for instance 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e on n-h2-858094-4 Sep 16 12:55:54.406887 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-db222cf8-e0cb-4ee1-be1c-4deb8e6653dd req-bfa92147-06b4-496d-8d7e-f78934b1832e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064511 Sep 16 12:55:54.407512 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1203/2484] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:55:54.412519 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66001c17-a00e-4ac3-a58b-460f545349f8 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:54.413027 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66001c17-a00e-4ac3-a58b-460f545349f8 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:54.413642 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66001c17-a00e-4ac3-a58b-460f545349f8 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:54.414791 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66001c17-a00e-4ac3-a58b-460f545349f8 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:54.415423 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66001c17-a00e-4ac3-a58b-460f545349f8 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:54.415912 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66001c17-a00e-4ac3-a58b-460f545349f8 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:54.422682 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4522e6bb-3d03-4ff1-bf0a-0abd88297097 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:54.423393 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-4522e6bb-3d03-4ff1-bf0a-0abd88297097 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:54.431765 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4522e6bb-3d03-4ff1-bf0a-0abd88297097 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:54.432317 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4522e6bb-3d03-4ff1-bf0a-0abd88297097 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:54.432761 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4522e6bb-3d03-4ff1-bf0a-0abd88297097 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:54.433483 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4522e6bb-3d03-4ff1-bf0a-0abd88297097 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:54.433936 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4522e6bb-3d03-4ff1-bf0a-0abd88297097 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:54.434359 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4522e6bb-3d03-4ff1-bf0a-0abd88297097 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:54.853472 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4522e6bb-3d03-4ff1-bf0a-0abd88297097 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:54.864028 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4522e6bb-3d03-4ff1-bf0a-0abd88297097 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:54.865488 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4522e6bb-3d03-4ff1-bf0a-0abd88297097 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:54.866712 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4522e6bb-3d03-4ff1-bf0a-0abd88297097 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 1814 microversion: 2.25 time: 0.450054 Sep 16 12:55:54.867246 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1204/2485] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:54 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 1814 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:55:54.875124 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-66001c17-a00e-4ac3-a58b-460f545349f8 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:54.883592 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-66001c17-a00e-4ac3-a58b-460f545349f8 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:54.885091 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-66001c17-a00e-4ac3-a58b-460f545349f8 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:54.886327 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-66001c17-a00e-4ac3-a58b-460f545349f8 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] 10.222.0.67 "GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c" status: 200 len: 1552 microversion: 2.21 time: 0.504074 Sep 16 12:55:54.887089 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1282/2486] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:54 2022] GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c => generated 1552 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:55:54.888977 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-25b52a53-af70-4217-b9de-1600fd6e64f5 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Calling method '.version_select at 0x7f1034b33a60>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:54.918120 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0154ee2e-ae84-4815-9066-b56c2964f298 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:54.918614 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0154ee2e-ae84-4815-9066-b56c2964f298 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] [instance: aa4ce353-1393-4c5a-a229-6aee69ce030c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:54.919246 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:55:54.928034 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0154ee2e-ae84-4815-9066-b56c2964f298 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:54.928586 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0154ee2e-ae84-4815-9066-b56c2964f298 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:54.929028 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0154ee2e-ae84-4815-9066-b56c2964f298 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:54.929145 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-25b52a53-af70-4217-b9de-1600fd6e64f5 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2122957207" status: 204 len: 0 microversion: 2.2 time: 0.043905 Sep 16 12:55:54.929927 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1205/2487] 10.222.0.67 () {60 vars in 1321 bytes} [Fri Sep 16 12:55:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2122957207 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:55:54.930034 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0154ee2e-ae84-4815-9066-b56c2964f298 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:54.930189 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0154ee2e-ae84-4815-9066-b56c2964f298 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:54.930599 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0154ee2e-ae84-4815-9066-b56c2964f298 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:54.940928 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c86abe6a-5991-4f89-b8f3-54c3382be2d7 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Calling method '.version_select at 0x7f1034b37e50>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:54.959915 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0154ee2e-ae84-4815-9066-b56c2964f298 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] [instance: aa4ce353-1393-4c5a-a229-6aee69ce030c] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:55:54.963764 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c86abe6a-5991-4f89-b8f3-54c3382be2d7 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-510497145" status: 204 len: 0 microversion: 2.2 time: 0.029407 Sep 16 12:55:54.964442 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1206/2488] 10.222.0.67 () {60 vars in 1318 bytes} [Fri Sep 16 12:55:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-510497145 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:55:54.980274 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a16edb47-bcec-4870-92d3-2579281aa32c tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Action: 'create', calling method: .version_select at 0x7f1034dc2670>, body: {"keypair": {"name": "tempest-keypair-1048655638", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDq5Gm0iSmqke7QHQ88GtIdz2Ao/rM1ohDyBorLYyfnlSfz+qBmrb+j2pjTdFGRpd/+XcwhhlxuEQCBktHPUfQsFCisS9SszhqVMmwwwGBwjj3p+tBHw4qImgmKDpa0RVw=="}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:55:54.999975 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-a16edb47-bcec-4870-92d3-2579281aa32c tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Getting quotas for project d43cacdef3cc4b38bbbdae9a92b24c7e. Resources: {'key_pairs'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:55:55.007124 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-a16edb47-bcec-4870-92d3-2579281aa32c tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Getting quotas for user eebd07fc28cd46abb1b8f242e988e0a5 and project d43cacdef3cc4b38bbbdae9a92b24c7e. Resources: {'key_pairs'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:55:55.034955 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a16edb47-bcec-4870-92d3-2579281aa32c tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.058705 Sep 16 12:55:55.036075 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1207/2489] 10.222.0.67 () {62 vars in 1199 bytes} [Fri Sep 16 12:55:54 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 61 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 16 12:55:55.049599 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-cfaf229a-d72e-4e60-90b6-b5f857b93025 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Calling method '.version_select at 0x7f1034b33550>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:55.054297 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0154ee2e-ae84-4815-9066-b56c2964f298 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] 10.222.0.67 "DELETE /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c" status: 204 len: 0 microversion: 2.21 time: 0.140550 Sep 16 12:55:55.055464 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1283/2490] 10.222.0.67 () {60 vars in 1280 bytes} [Fri Sep 16 12:55:54 2022] DELETE /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 12:55:55.063889 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-cfaf229a-d72e-4e60-90b6-b5f857b93025 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] 10.222.0.67 "GET /compute/v2.1/os-keypairs/tempest-keypair-1048655638" status: 200 len: 513 microversion: 2.2 time: 0.019895 Sep 16 12:55:55.067043 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ff860463-da79-4e82-9d21-02e9223479ea tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:55.067930 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ff860463-da79-4e82-9d21-02e9223479ea tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] [instance: aa4ce353-1393-4c5a-a229-6aee69ce030c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:55.069902 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1208/2491] 10.222.0.67 () {60 vars in 1258 bytes} [Fri Sep 16 12:55:55 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1048655638 => generated 513 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:55:55.075455 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff860463-da79-4e82-9d21-02e9223479ea tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:55.075849 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff860463-da79-4e82-9d21-02e9223479ea tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:55.076420 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff860463-da79-4e82-9d21-02e9223479ea tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:55.076825 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e2cafe16-ebb4-48d9-bba0-8226149c5b01 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Calling method '.version_select at 0x7f1034b95f70>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:55.077177 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff860463-da79-4e82-9d21-02e9223479ea tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:55.078373 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff860463-da79-4e82-9d21-02e9223479ea tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:55.078867 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff860463-da79-4e82-9d21-02e9223479ea tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:55.081741 n-d-858094-4 devstack@n-api.service[128780]: WARNING oslo_db.sqlalchemy.utils [None req-e2cafe16-ebb4-48d9-bba0-8226149c5b01 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 16 12:55:55.088843 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e2cafe16-ebb4-48d9-bba0-8226149c5b01 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] 10.222.0.67 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.016186 Sep 16 12:55:55.089425 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1209/2492] 10.222.0.67 () {60 vars in 1177 bytes} [Fri Sep 16 12:55:55 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:55:55.102345 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-96af6d6d-1bd4-4e89-9d00-056530601770 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Calling method '.version_select at 0x7f1034b5fee0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:55.123047 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-96af6d6d-1bd4-4e89-9d00-056530601770 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1048655638" status: 204 len: 0 microversion: 2.2 time: 0.025942 Sep 16 12:55:55.130909 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1210/2493] 10.222.0.67 () {60 vars in 1261 bytes} [Fri Sep 16 12:55:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1048655638 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 12:55:55.136500 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-346840ad-5294-48ce-8879-a229724564ab tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Action: 'create', calling method: .version_select at 0x7f1034b579d0>, body: {"keypair": {"name": "tempest-keypair-2129281412", "type": "x509"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:55:55.157442 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-346840ad-5294-48ce-8879-a229724564ab tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Getting quotas for project d43cacdef3cc4b38bbbdae9a92b24c7e. Resources: {'key_pairs'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:55:55.162932 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-346840ad-5294-48ce-8879-a229724564ab tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Getting quotas for user eebd07fc28cd46abb1b8f242e988e0a5 and project d43cacdef3cc4b38bbbdae9a92b24c7e. Resources: {'key_pairs'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:55:55.179340 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.processutils [None req-346840ad-5294-48ce-8879-a229724564ab tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp9ysii1mr/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp9ysii1mr/temp.key -subj /CN=eebd07fc28cd46abb1b8f242e988e0a5 -extensions v3_req_client {{(pid=128780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 16 12:55:55.299764 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ff860463-da79-4e82-9d21-02e9223479ea tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:55.308338 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ff860463-da79-4e82-9d21-02e9223479ea tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:55.309831 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ff860463-da79-4e82-9d21-02e9223479ea tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:55.311015 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ff860463-da79-4e82-9d21-02e9223479ea tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] 10.222.0.67 "GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c" status: 200 len: 1558 microversion: 2.21 time: 0.250775 Sep 16 12:55:55.311933 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1284/2494] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:55 2022] GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c => generated 1558 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:55:55.319201 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.processutils [None req-346840ad-5294-48ce-8879-a229724564ab tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp9ysii1mr/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp9ysii1mr/temp.key -subj /CN=eebd07fc28cd46abb1b8f242e988e0a5 -extensions v3_req_client" returned: 0 in 0.139s {{(pid=128780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 16 12:55:55.321037 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.processutils [None req-346840ad-5294-48ce-8879-a229724564ab tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp9ysii1mr/temp.key -password pass: {{(pid=128780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 16 12:55:55.337833 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cf4f5b6f-d717-43cd-a0d4-80026d113e67 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:55.338721 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cf4f5b6f-d717-43cd-a0d4-80026d113e67 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:55.346173 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf4f5b6f-d717-43cd-a0d4-80026d113e67 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:55.346669 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf4f5b6f-d717-43cd-a0d4-80026d113e67 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:55.347110 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf4f5b6f-d717-43cd-a0d4-80026d113e67 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:55.347852 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf4f5b6f-d717-43cd-a0d4-80026d113e67 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:55.348352 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf4f5b6f-d717-43cd-a0d4-80026d113e67 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:55.348784 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf4f5b6f-d717-43cd-a0d4-80026d113e67 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:55.357971 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.processutils [None req-346840ad-5294-48ce-8879-a229724564ab tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp9ysii1mr/temp.key -password pass:" returned: 0 in 0.036s {{(pid=128780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 16 12:55:55.400884 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-346840ad-5294-48ce-8879-a229724564ab tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Getting quotas for project d43cacdef3cc4b38bbbdae9a92b24c7e. Resources: {'key_pairs'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:55:55.407449 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-346840ad-5294-48ce-8879-a229724564ab tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Getting quotas for user eebd07fc28cd46abb1b8f242e988e0a5 and project d43cacdef3cc4b38bbbdae9a92b24c7e. Resources: {'key_pairs'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:55:55.427166 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-346840ad-5294-48ce-8879-a229724564ab tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.294884 Sep 16 12:55:55.434146 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1211/2495] 10.222.0.67 () {62 vars in 1198 bytes} [Fri Sep 16 12:55:55 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 303 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) Sep 16 12:55:55.442009 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-10cf50fa-e8a8-47a6-9d7d-3ff46b3b3a7a tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:55.443237 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-10cf50fa-e8a8-47a6-9d7d-3ff46b3b3a7a tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:55.449714 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-10cf50fa-e8a8-47a6-9d7d-3ff46b3b3a7a tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:55.450249 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-10cf50fa-e8a8-47a6-9d7d-3ff46b3b3a7a tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:55.450699 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-10cf50fa-e8a8-47a6-9d7d-3ff46b3b3a7a tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:55.451466 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-10cf50fa-e8a8-47a6-9d7d-3ff46b3b3a7a tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:55.451920 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-10cf50fa-e8a8-47a6-9d7d-3ff46b3b3a7a tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:55.452369 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-10cf50fa-e8a8-47a6-9d7d-3ff46b3b3a7a tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:55.496158 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cf4f5b6f-d717-43cd-a0d4-80026d113e67 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:55.508240 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cf4f5b6f-d717-43cd-a0d4-80026d113e67 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1312 microversion: 2.1 time: 0.174359 Sep 16 12:55:55.509893 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1285/2496] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:55 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1312 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:55:55.514922 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c888bd35-f7b5-4c3d-b599-709118ed4ca4 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Calling method '.version_select at 0x7f1035158700>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:55.525844 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c888bd35-f7b5-4c3d-b599-709118ed4ca4 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] 10.222.0.67 "GET /compute/v2.1/os-keypairs/tempest-keypair-2129281412" status: 200 len: 1534 microversion: 2.2 time: 0.014631 Sep 16 12:55:55.526575 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1286/2497] 10.222.0.67 () {60 vars in 1258 bytes} [Fri Sep 16 12:55:55 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2129281412 => generated 1534 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:55.540787 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5e9e91ca-9b7d-42b4-835c-6bb18794d28f tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Calling method '.version_select at 0x7f103571e1f0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:55.544814 n-d-858094-4 devstack@n-api.service[128779]: WARNING oslo_db.sqlalchemy.utils [None req-5e9e91ca-9b7d-42b4-835c-6bb18794d28f tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 16 12:55:55.552876 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5e9e91ca-9b7d-42b4-835c-6bb18794d28f tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] 10.222.0.67 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.017601 Sep 16 12:55:55.553834 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1287/2498] 10.222.0.67 () {60 vars in 1177 bytes} [Fri Sep 16 12:55:55 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:55:55.565924 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-112049b5-aaec-4cc6-998b-3ae208278f52 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] Calling method '.version_select at 0x7f103564b3a0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:55.589562 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-112049b5-aaec-4cc6-998b-3ae208278f52 tempest-KeyPairsV22TestJSON-1353300366 tempest-KeyPairsV22TestJSON-1353300366-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2129281412" status: 204 len: 0 microversion: 2.2 time: 0.028722 Sep 16 12:55:55.590890 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1288/2499] 10.222.0.67 () {60 vars in 1261 bytes} [Fri Sep 16 12:55:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2129281412 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 12:55:55.622627 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-10cf50fa-e8a8-47a6-9d7d-3ff46b3b3a7a tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:55.631607 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-10cf50fa-e8a8-47a6-9d7d-3ff46b3b3a7a tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e" status: 200 len: 1527 microversion: 2.1 time: 0.195898 Sep 16 12:55:55.632482 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1212/2500] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:55 2022] GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e => generated 1527 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:55.896837 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a08d38cf-8e21-46f2-b615-2d088094ac18 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:55.899474 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a08d38cf-8e21-46f2-b615-2d088094ac18 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:55.910389 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a08d38cf-8e21-46f2-b615-2d088094ac18 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:55.911800 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a08d38cf-8e21-46f2-b615-2d088094ac18 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:55.912553 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a08d38cf-8e21-46f2-b615-2d088094ac18 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:55.914922 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a08d38cf-8e21-46f2-b615-2d088094ac18 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:55.915767 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a08d38cf-8e21-46f2-b615-2d088094ac18 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:55.916502 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a08d38cf-8e21-46f2-b615-2d088094ac18 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:56.137095 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a08d38cf-8e21-46f2-b615-2d088094ac18 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:56.150038 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a08d38cf-8e21-46f2-b615-2d088094ac18 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:56.151414 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a08d38cf-8e21-46f2-b615-2d088094ac18 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:56.157278 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a08d38cf-8e21-46f2-b615-2d088094ac18 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 1814 microversion: 2.25 time: 0.265296 Sep 16 12:55:56.172886 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1289/2501] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:55 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 1814 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:55:56.339627 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ed68d7bc-1fbd-4c60-9afa-1201890fa86e tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:56.341001 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ed68d7bc-1fbd-4c60-9afa-1201890fa86e tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] [instance: aa4ce353-1393-4c5a-a229-6aee69ce030c] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:56.350620 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ed68d7bc-1fbd-4c60-9afa-1201890fa86e tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:56.351263 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ed68d7bc-1fbd-4c60-9afa-1201890fa86e tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:56.351808 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ed68d7bc-1fbd-4c60-9afa-1201890fa86e tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:56.352666 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ed68d7bc-1fbd-4c60-9afa-1201890fa86e tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:56.353269 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ed68d7bc-1fbd-4c60-9afa-1201890fa86e tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:56.353799 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ed68d7bc-1fbd-4c60-9afa-1201890fa86e tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:56.427681 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-43d99ada-114f-496f-8678-23b44a363cfd req-b068170a-f991-428e-be9a-728aef9a0a2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f648b7b7-38c9-4dff-8d24-039d1b9d9115", "name": "network-vif-plugged", "status": "completed", "tag": "71269ced-342c-468f-8025-bba5b93b85be"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:55:56.443451 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-43d99ada-114f-496f-8678-23b44a363cfd req-b068170a-f991-428e-be9a-728aef9a0a2f service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:56.443939 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-43d99ada-114f-496f-8678-23b44a363cfd req-b068170a-f991-428e-be9a-728aef9a0a2f service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:56.444772 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-43d99ada-114f-496f-8678-23b44a363cfd req-b068170a-f991-428e-be9a-728aef9a0a2f service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:56.472982 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-43d99ada-114f-496f-8678-23b44a363cfd req-b068170a-f991-428e-be9a-728aef9a0a2f service nova] Creating event network-vif-plugged:71269ced-342c-468f-8025-bba5b93b85be for instance f648b7b7-38c9-4dff-8d24-039d1b9d9115 on n-h1-858094-4 Sep 16 12:55:56.485353 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-43d99ada-114f-496f-8678-23b44a363cfd req-b068170a-f991-428e-be9a-728aef9a0a2f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062216 Sep 16 12:55:56.490397 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1290/2502] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:55:56.539555 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5912fced-b6c5-4d7d-a28e-533ecb796e71 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:56.542623 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ed68d7bc-1fbd-4c60-9afa-1201890fa86e tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:56.547627 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5912fced-b6c5-4d7d-a28e-533ecb796e71 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:56.556047 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ed68d7bc-1fbd-4c60-9afa-1201890fa86e tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:56.561506 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ed68d7bc-1fbd-4c60-9afa-1201890fa86e tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:56.563448 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ed68d7bc-1fbd-4c60-9afa-1201890fa86e tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] 10.222.0.67 "GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c" status: 200 len: 1558 microversion: 2.21 time: 0.229334 Sep 16 12:55:56.566649 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5912fced-b6c5-4d7d-a28e-533ecb796e71 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:56.567158 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5912fced-b6c5-4d7d-a28e-533ecb796e71 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:56.567806 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5912fced-b6c5-4d7d-a28e-533ecb796e71 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:56.569024 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1213/2503] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:56 2022] GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c => generated 1558 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:55:56.569587 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5912fced-b6c5-4d7d-a28e-533ecb796e71 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:56.570267 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5912fced-b6c5-4d7d-a28e-533ecb796e71 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:56.571094 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5912fced-b6c5-4d7d-a28e-533ecb796e71 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:56.657172 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b53e867f-8125-403f-8f6d-48faa50ef738 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:56.658461 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b53e867f-8125-403f-8f6d-48faa50ef738 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:56.671876 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b53e867f-8125-403f-8f6d-48faa50ef738 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:56.675560 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b53e867f-8125-403f-8f6d-48faa50ef738 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:56.676286 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b53e867f-8125-403f-8f6d-48faa50ef738 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:56.679964 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b53e867f-8125-403f-8f6d-48faa50ef738 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:56.681474 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b53e867f-8125-403f-8f6d-48faa50ef738 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:56.683775 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b53e867f-8125-403f-8f6d-48faa50ef738 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:56.809286 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-b53e867f-8125-403f-8f6d-48faa50ef738 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:56.826946 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b53e867f-8125-403f-8f6d-48faa50ef738 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e" status: 200 len: 1485 microversion: 2.1 time: 0.175658 Sep 16 12:55:56.829391 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1214/2504] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:56 2022] GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e => generated 1485 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:56.861915 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5912fced-b6c5-4d7d-a28e-533ecb796e71 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:56.870005 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5912fced-b6c5-4d7d-a28e-533ecb796e71 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1312 microversion: 2.1 time: 0.342165 Sep 16 12:55:56.870598 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1291/2505] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:56 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1312 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:56.985753 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-9d4d7835-5814-4a5d-a33d-d7aee0fffe5e req-ee29c289-bd42-48e3-a39e-b9d0dd175f06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e", "name": "network-vif-deleted", "tag": "0ce5e362-3ed5-4bc9-a8bf-6141e6997ba5"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:55:57.014346 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-9d4d7835-5814-4a5d-a33d-d7aee0fffe5e req-ee29c289-bd42-48e3-a39e-b9d0dd175f06 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:57.019066 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-9d4d7835-5814-4a5d-a33d-d7aee0fffe5e req-ee29c289-bd42-48e3-a39e-b9d0dd175f06 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:57.020232 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-9d4d7835-5814-4a5d-a33d-d7aee0fffe5e req-ee29c289-bd42-48e3-a39e-b9d0dd175f06 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:57.041137 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-9d4d7835-5814-4a5d-a33d-d7aee0fffe5e req-ee29c289-bd42-48e3-a39e-b9d0dd175f06 service nova] Creating event network-vif-deleted:0ce5e362-3ed5-4bc9-a8bf-6141e6997ba5 for instance 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e on n-h2-858094-4 Sep 16 12:55:57.055492 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-9d4d7835-5814-4a5d-a33d-d7aee0fffe5e req-ee29c289-bd42-48e3-a39e-b9d0dd175f06 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074289 Sep 16 12:55:57.056698 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1215/2506] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:55:57.191482 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-90badc03-c277-436c-84fd-fb3fd4eb5267 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:57.192828 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-90badc03-c277-436c-84fd-fb3fd4eb5267 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:57.202841 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90badc03-c277-436c-84fd-fb3fd4eb5267 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:57.204054 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90badc03-c277-436c-84fd-fb3fd4eb5267 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:57.205770 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90badc03-c277-436c-84fd-fb3fd4eb5267 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:57.206867 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90badc03-c277-436c-84fd-fb3fd4eb5267 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:57.208993 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90badc03-c277-436c-84fd-fb3fd4eb5267 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:57.210067 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90badc03-c277-436c-84fd-fb3fd4eb5267 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:57.594908 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5d56f798-82a6-4b74-a8f7-767487718ddf tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:57.597577 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5d56f798-82a6-4b74-a8f7-767487718ddf tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] [instance: aa4ce353-1393-4c5a-a229-6aee69ce030c] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:57.622018 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5d56f798-82a6-4b74-a8f7-767487718ddf tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:57.622804 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5d56f798-82a6-4b74-a8f7-767487718ddf tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:57.623739 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5d56f798-82a6-4b74-a8f7-767487718ddf tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:57.625140 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5d56f798-82a6-4b74-a8f7-767487718ddf tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:57.626199 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5d56f798-82a6-4b74-a8f7-767487718ddf tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:57.627134 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5d56f798-82a6-4b74-a8f7-767487718ddf tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:57.908394 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-90badc03-c277-436c-84fd-fb3fd4eb5267 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:57.912944 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:55:57.916748 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5d56f798-82a6-4b74-a8f7-767487718ddf tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:57.920229 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-90badc03-c277-436c-84fd-fb3fd4eb5267 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:57.922487 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-90badc03-c277-436c-84fd-fb3fd4eb5267 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:57.923845 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-90badc03-c277-436c-84fd-fb3fd4eb5267 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 1814 microversion: 2.25 time: 0.740279 Sep 16 12:55:57.928430 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5d56f798-82a6-4b74-a8f7-767487718ddf tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:57.930082 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5d56f798-82a6-4b74-a8f7-767487718ddf tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:57.931443 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5d56f798-82a6-4b74-a8f7-767487718ddf tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] 10.222.0.67 "GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c" status: 200 len: 1558 microversion: 2.21 time: 0.345274 Sep 16 12:55:57.932219 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1216/2507] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:57 2022] GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c => generated 1558 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:55:57.936605 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1292/2508] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:57 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 1814 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:55:57.947947 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bfa5e5b3-c992-4e08-a576-c4b09e57737e tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:57.948791 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bfa5e5b3-c992-4e08-a576-c4b09e57737e tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:57.956634 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bfa5e5b3-c992-4e08-a576-c4b09e57737e tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:57.963935 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bfa5e5b3-c992-4e08-a576-c4b09e57737e tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:57.964433 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bfa5e5b3-c992-4e08-a576-c4b09e57737e tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:57.965348 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bfa5e5b3-c992-4e08-a576-c4b09e57737e tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:57.965972 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bfa5e5b3-c992-4e08-a576-c4b09e57737e tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:57.966547 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bfa5e5b3-c992-4e08-a576-c4b09e57737e tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:58.009224 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-bfa5e5b3-c992-4e08-a576-c4b09e57737e tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] HTTP exception thrown: Instance 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e could not be found. Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bfa5e5b3-c992-4e08-a576-c4b09e57737e tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Request method failure captured: Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e HTTP/1.1 Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHI8T7yGPRAc3c6MPrRyvBn0sjBikdgUA-hTw5OumPvmvZhNIoTMLBQsFbEvX79WgLzGGVd0Tyjqag2EpyljzbSAD20HzRS6IC0nQYJFElFV23Kk60KxHTZ6ulzDMTvWGrZByycegK-oPTtKgXmNPoQq1DgmwbeXyTMrKt2g_ITcKgg Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: c88ea8e8750c440e86d3c1eb4ab6110e Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c88ea8e8750c440e86d3c1eb4ab6110e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: c88ea8e8750c440e86d3c1eb4ab6110e Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ImagesOneServerNegativeTestJSON-682956668-project Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 973378f0eed8476eb41a29d5ce57ed65 Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-682956668-project Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e could not be found. Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e'} Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e could not be found. Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e could not be found. Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:55:58.011348 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:55:58.015618 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:55:58.015618 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:55:58.015618 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:55:58.015618 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:55:58.015618 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:55:58.015618 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:55:58.015618 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e could not be found. Sep 16 12:55:58.015618 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:55:58.025081 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bfa5e5b3-c992-4e08-a576-c4b09e57737e tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Returning 404 to user: Instance 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:55:58.029237 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bfa5e5b3-c992-4e08-a576-c4b09e57737e tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e" status: 404 len: 111 microversion: 2.1 time: 0.089623 Sep 16 12:55:58.030033 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1293/2509] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:57 2022] GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:55:58.043069 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8c04d4a4-965d-4bdc-8d31-1cac6015bf9a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:58.044111 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8c04d4a4-965d-4bdc-8d31-1cac6015bf9a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:58.059592 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c04d4a4-965d-4bdc-8d31-1cac6015bf9a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:58.060091 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c04d4a4-965d-4bdc-8d31-1cac6015bf9a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:58.060549 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c04d4a4-965d-4bdc-8d31-1cac6015bf9a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:58.061266 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c04d4a4-965d-4bdc-8d31-1cac6015bf9a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:58.061720 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c04d4a4-965d-4bdc-8d31-1cac6015bf9a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:58.062239 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c04d4a4-965d-4bdc-8d31-1cac6015bf9a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:58.243127 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7c547db1-c1bf-4eaf-9ce7-f3b85bfe6126 tempest-AbsoluteLimitsTestJSON-1972005305 tempest-AbsoluteLimitsTestJSON-1972005305-project] Calling method '.version_select at 0x7f1034b57790>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:58.269186 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7c547db1-c1bf-4eaf-9ce7-f3b85bfe6126 tempest-AbsoluteLimitsTestJSON-1972005305 tempest-AbsoluteLimitsTestJSON-1972005305-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:58.271726 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7c547db1-c1bf-4eaf-9ce7-f3b85bfe6126 tempest-AbsoluteLimitsTestJSON-1972005305 tempest-AbsoluteLimitsTestJSON-1972005305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:58.272399 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7c547db1-c1bf-4eaf-9ce7-f3b85bfe6126 tempest-AbsoluteLimitsTestJSON-1972005305 tempest-AbsoluteLimitsTestJSON-1972005305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:58.273354 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7c547db1-c1bf-4eaf-9ce7-f3b85bfe6126 tempest-AbsoluteLimitsTestJSON-1972005305 tempest-AbsoluteLimitsTestJSON-1972005305-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:58.277095 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7c547db1-c1bf-4eaf-9ce7-f3b85bfe6126 tempest-AbsoluteLimitsTestJSON-1972005305 tempest-AbsoluteLimitsTestJSON-1972005305-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:58.278442 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7c547db1-c1bf-4eaf-9ce7-f3b85bfe6126 tempest-AbsoluteLimitsTestJSON-1972005305 tempest-AbsoluteLimitsTestJSON-1972005305-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:58.358670 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7c547db1-c1bf-4eaf-9ce7-f3b85bfe6126 tempest-AbsoluteLimitsTestJSON-1972005305 tempest-AbsoluteLimitsTestJSON-1972005305-project] 10.222.0.67 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.420017 Sep 16 12:55:58.359963 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1217/2510] 10.222.0.67 () {58 vars in 1122 bytes} [Fri Sep 16 12:55:57 2022] GET /compute/v2.1/limits => generated 511 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:55:58.366942 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0d642076-5806-4ca9-b5e3-0bb02f450812 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Action: 'create', calling method: .version_select at 0x7f1034b8bca0>, body: {"keypair": {"name": "tempest-keypair-709008714", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsYe+oqvBzAG4t70GhErp88iz+sNuIDEMySH7cnMt6ohwE+wiDEEQr8W9DRlTPOFOSV+V2ejYYZw2+qNKZwVMuYekT0CLh066nXmmo8CwN9qcL/G/dI/7OufM2g/5lxFQ=="}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:55:58.399898 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-0d642076-5806-4ca9-b5e3-0bb02f450812 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Getting quotas for project c88ea8e8750c440e86d3c1eb4ab6110e. Resources: {'key_pairs'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:55:58.407584 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-0d642076-5806-4ca9-b5e3-0bb02f450812 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Getting quotas for user 973378f0eed8476eb41a29d5ce57ed65 and project c88ea8e8750c440e86d3c1eb4ab6110e. Resources: {'key_pairs'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:55:58.461226 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0d642076-5806-4ca9-b5e3-0bb02f450812 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.099050 Sep 16 12:55:58.465363 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1218/2511] 10.222.0.67 () {60 vars in 1159 bytes} [Fri Sep 16 12:55:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:55:58.524928 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8c04d4a4-965d-4bdc-8d31-1cac6015bf9a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:58.538902 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8c04d4a4-965d-4bdc-8d31-1cac6015bf9a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1312 microversion: 2.1 time: 0.505466 Sep 16 12:55:58.543318 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1294/2512] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:58 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1312 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:55:58.593306 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-c685f5d1-3a6d-4580-90eb-149c9f701685 req-4c354fed-fdec-4348-bf66-febd86aa78d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa4ce353-1393-4c5a-a229-6aee69ce030c", "name": "network-vif-deleted", "tag": "81dc42ba-a9cc-4752-9e18-84676c9fb431"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:55:58.622627 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-c685f5d1-3a6d-4580-90eb-149c9f701685 req-4c354fed-fdec-4348-bf66-febd86aa78d1 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:58.623158 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-c685f5d1-3a6d-4580-90eb-149c9f701685 req-4c354fed-fdec-4348-bf66-febd86aa78d1 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:58.623537 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-c685f5d1-3a6d-4580-90eb-149c9f701685 req-4c354fed-fdec-4348-bf66-febd86aa78d1 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:58.657662 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-c685f5d1-3a6d-4580-90eb-149c9f701685 req-4c354fed-fdec-4348-bf66-febd86aa78d1 service nova] Creating event network-vif-deleted:81dc42ba-a9cc-4752-9e18-84676c9fb431 for instance aa4ce353-1393-4c5a-a229-6aee69ce030c on n-h1-858094-4 Sep 16 12:55:58.673700 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-c685f5d1-3a6d-4580-90eb-149c9f701685 req-4c354fed-fdec-4348-bf66-febd86aa78d1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206749 Sep 16 12:55:58.677882 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1219/2513] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:55:58.955291 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8580353f-1c35-4fcc-a01d-1289a20435ce tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:58.956279 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8580353f-1c35-4fcc-a01d-1289a20435ce tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:58.976577 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c3d54012-478a-4ee0-8332-9dc538c67a69 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:58.977078 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8580353f-1c35-4fcc-a01d-1289a20435ce tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:58.977802 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8580353f-1c35-4fcc-a01d-1289a20435ce tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:58.977942 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c3d54012-478a-4ee0-8332-9dc538c67a69 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] [instance: aa4ce353-1393-4c5a-a229-6aee69ce030c] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:58.978523 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8580353f-1c35-4fcc-a01d-1289a20435ce tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:58.980908 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8580353f-1c35-4fcc-a01d-1289a20435ce tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:58.981542 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8580353f-1c35-4fcc-a01d-1289a20435ce tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:58.984836 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8580353f-1c35-4fcc-a01d-1289a20435ce tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:58.987158 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c3d54012-478a-4ee0-8332-9dc538c67a69 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:58.987986 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c3d54012-478a-4ee0-8332-9dc538c67a69 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:58.988526 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c3d54012-478a-4ee0-8332-9dc538c67a69 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:58.990478 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c3d54012-478a-4ee0-8332-9dc538c67a69 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:58.991163 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c3d54012-478a-4ee0-8332-9dc538c67a69 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:58.992019 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c3d54012-478a-4ee0-8332-9dc538c67a69 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:59.042579 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c3d54012-478a-4ee0-8332-9dc538c67a69 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:59.043067 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c3d54012-478a-4ee0-8332-9dc538c67a69 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:59.043548 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c3d54012-478a-4ee0-8332-9dc538c67a69 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:59.044019 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-c3d54012-478a-4ee0-8332-9dc538c67a69 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lazy-loading 'fault' on Instance uuid aa4ce353-1393-4c5a-a229-6aee69ce030c {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:55:59.167476 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c3d54012-478a-4ee0-8332-9dc538c67a69 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:59.180794 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c3d54012-478a-4ee0-8332-9dc538c67a69 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:59.182515 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c3d54012-478a-4ee0-8332-9dc538c67a69 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550acfff5ad24023b78badaca2bc6909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66c708b229645a6afdae93e4b5b1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:59.184443 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c3d54012-478a-4ee0-8332-9dc538c67a69 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] 10.222.0.67 "GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c" status: 200 len: 1348 microversion: 2.21 time: 0.228204 Sep 16 12:55:59.185785 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1220/2514] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:58 2022] GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c => generated 1348 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:55:59.238426 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8580353f-1c35-4fcc-a01d-1289a20435ce tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:59.248738 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8580353f-1c35-4fcc-a01d-1289a20435ce tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:59.250759 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8580353f-1c35-4fcc-a01d-1289a20435ce tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:59.251944 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8580353f-1c35-4fcc-a01d-1289a20435ce tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 1814 microversion: 2.25 time: 0.301703 Sep 16 12:55:59.252693 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1295/2515] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:55:58 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 1814 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:55:59.563888 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9feb61cb-94b7-4466-ac38-a487d94a0bac tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:55:59.564840 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9feb61cb-94b7-4466-ac38-a487d94a0bac tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:55:59.571314 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9feb61cb-94b7-4466-ac38-a487d94a0bac tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:59.571954 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9feb61cb-94b7-4466-ac38-a487d94a0bac tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:59.572584 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9feb61cb-94b7-4466-ac38-a487d94a0bac tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:59.573729 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9feb61cb-94b7-4466-ac38-a487d94a0bac tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:55:59.574363 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9feb61cb-94b7-4466-ac38-a487d94a0bac tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:55:59.574935 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9feb61cb-94b7-4466-ac38-a487d94a0bac tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:55:59.956455 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9feb61cb-94b7-4466-ac38-a487d94a0bac tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:55:59.967855 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9feb61cb-94b7-4466-ac38-a487d94a0bac tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1497 microversion: 2.1 time: 0.407812 Sep 16 12:55:59.968914 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1221/2516] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:55:59 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1497 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:00.005910 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-20075228-fa63-4d70-a039-b265efbc0fda tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:00.009055 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-20075228-fa63-4d70-a039-b265efbc0fda tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:00.034253 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-20075228-fa63-4d70-a039-b265efbc0fda tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:00.036374 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-20075228-fa63-4d70-a039-b265efbc0fda tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:00.037362 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-20075228-fa63-4d70-a039-b265efbc0fda tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:00.038649 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-20075228-fa63-4d70-a039-b265efbc0fda tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:00.041628 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-20075228-fa63-4d70-a039-b265efbc0fda tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:00.042773 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-20075228-fa63-4d70-a039-b265efbc0fda tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:00.088111 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-20075228-fa63-4d70-a039-b265efbc0fda tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lazy-loading 'flavor' on Instance uuid f648b7b7-38c9-4dff-8d24-039d1b9d9115 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:56:00.222128 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8abd9e3b-ac7c-4c83-b38f-429ff9e4857d tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:00.223328 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8abd9e3b-ac7c-4c83-b38f-429ff9e4857d tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] [instance: aa4ce353-1393-4c5a-a229-6aee69ce030c] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:00.232028 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8abd9e3b-ac7c-4c83-b38f-429ff9e4857d tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:00.232638 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8abd9e3b-ac7c-4c83-b38f-429ff9e4857d tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:00.233306 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8abd9e3b-ac7c-4c83-b38f-429ff9e4857d tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:00.235226 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8abd9e3b-ac7c-4c83-b38f-429ff9e4857d tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:00.236098 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8abd9e3b-ac7c-4c83-b38f-429ff9e4857d tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:00.236771 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8abd9e3b-ac7c-4c83-b38f-429ff9e4857d tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:00.242307 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-20075228-fa63-4d70-a039-b265efbc0fda tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "POST /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115/action" status: 200 len: 32 microversion: 2.1 time: 0.249903 Sep 16 12:56:00.243574 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1296/2517] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:55:59 2022] POST /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115/action => generated 32 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 12:56:00.245648 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:56:00.261731 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-8abd9e3b-ac7c-4c83-b38f-429ff9e4857d tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] HTTP exception thrown: Instance aa4ce353-1393-4c5a-a229-6aee69ce030c could not be found. Sep 16 12:56:00.262772 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8694b295-8380-4ebf-b9a5-0619c398085e tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:00.263551 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8694b295-8380-4ebf-b9a5-0619c398085e tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8abd9e3b-ac7c-4c83-b38f-429ff9e4857d tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Request method failure captured: Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c HTTP/1.1 Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHI_QhlxoOeP8V9V_zjNLMgoxibGYhYsHYAe7ym56zVFc1nRtK-fydtcfHNrb9BBmrvUufPNkEWEDhnFAdUCHN2fiwi8SC1cp6DlUgxijp0Wb9mObU_SNBGduTRkrLd91rX2v28Mh_JlU4myYFxlj6eZk5CxIg2tnvugTYcJopwh4i4 Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: X-Openstack-Nova-Api-Version: 2.21 Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: a66c708b229645a6afdae93e4b5b1b0c Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1092193411 Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a66c708b229645a6afdae93e4b5b1b0c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a66c708b229645a6afdae93e4b5b1b0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a66c708b229645a6afdae93e4b5b1b0c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a66c708b229645a6afdae93e4b5b1b0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-InstanceActionsV221TestJSON-1092193411 Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: a66c708b229645a6afdae93e4b5b1b0c Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1092193411 Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-InstanceActionsV221TestJSON-1092193411-project Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 550acfff5ad24023b78badaca2bc6909 Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-InstanceActionsV221TestJSON-1092193411-project Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance aa4ce353-1393-4c5a-a229-6aee69ce030c could not be found. Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'aa4ce353-1393-4c5a-a229-6aee69ce030c'} Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa4ce353-1393-4c5a-a229-6aee69ce030c could not be found. Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa4ce353-1393-4c5a-a229-6aee69ce030c could not be found. Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:00.265577 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:00.270270 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:00.270270 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:00.270270 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:56:00.270270 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:56:00.270270 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:56:00.270270 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:56:00.270270 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa4ce353-1393-4c5a-a229-6aee69ce030c could not be found. Sep 16 12:56:00.270270 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:00.270270 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8abd9e3b-ac7c-4c83-b38f-429ff9e4857d tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Returning 404 to user: Instance aa4ce353-1393-4c5a-a229-6aee69ce030c could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:56:00.271753 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8abd9e3b-ac7c-4c83-b38f-429ff9e4857d tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] 10.222.0.67 "GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c" status: 404 len: 111 microversion: 2.21 time: 0.064717 Sep 16 12:56:00.276142 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1222/2518] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:00 2022] GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 12:56:00.287809 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d77842f1-43b5-4157-aa74-ba3cabd5983f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:00.288575 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d77842f1-43b5-4157-aa74-ba3cabd5983f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:00.295300 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d77842f1-43b5-4157-aa74-ba3cabd5983f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:00.296314 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d77842f1-43b5-4157-aa74-ba3cabd5983f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:00.297596 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d77842f1-43b5-4157-aa74-ba3cabd5983f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:00.298753 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d77842f1-43b5-4157-aa74-ba3cabd5983f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:00.299432 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d77842f1-43b5-4157-aa74-ba3cabd5983f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:00.300072 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d77842f1-43b5-4157-aa74-ba3cabd5983f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:00.301262 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8694b295-8380-4ebf-b9a5-0619c398085e tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:00.301776 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8694b295-8380-4ebf-b9a5-0619c398085e tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:00.302221 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8694b295-8380-4ebf-b9a5-0619c398085e tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:00.306015 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8694b295-8380-4ebf-b9a5-0619c398085e tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:00.306520 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8694b295-8380-4ebf-b9a5-0619c398085e tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:00.317607 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8694b295-8380-4ebf-b9a5-0619c398085e tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:00.915032 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d77842f1-43b5-4157-aa74-ba3cabd5983f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:00.929331 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d77842f1-43b5-4157-aa74-ba3cabd5983f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:00.931264 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d77842f1-43b5-4157-aa74-ba3cabd5983f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:00.932797 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d77842f1-43b5-4157-aa74-ba3cabd5983f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 1814 microversion: 2.25 time: 0.655490 Sep 16 12:56:00.933440 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1223/2519] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:00 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 1814 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:56:00.939012 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d594db91-c7c1-47ba-b99b-890604fa4223 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Calling method '.version_select at 0x7f1034b47a60>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:00.940099 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d594db91-c7c1-47ba-b99b-890604fa4223 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] [instance: aa4ce353-1393-4c5a-a229-6aee69ce030c] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:00.947553 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d594db91-c7c1-47ba-b99b-890604fa4223 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:00.948479 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d594db91-c7c1-47ba-b99b-890604fa4223 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:00.949187 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d594db91-c7c1-47ba-b99b-890604fa4223 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:00.950644 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d594db91-c7c1-47ba-b99b-890604fa4223 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:00.951394 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d594db91-c7c1-47ba-b99b-890604fa4223 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:00.951930 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d594db91-c7c1-47ba-b99b-890604fa4223 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:00.967010 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8694b295-8380-4ebf-b9a5-0619c398085e tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:00.979897 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8694b295-8380-4ebf-b9a5-0619c398085e tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1503 microversion: 2.1 time: 0.727174 Sep 16 12:56:00.981292 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1297/2520] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:00 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1503 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:01.040979 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d594db91-c7c1-47ba-b99b-890604fa4223 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] 10.222.0.67 "GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.105743 Sep 16 12:56:01.044256 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1224/2521] 10.222.0.67 () {60 vars in 1337 bytes} [Fri Sep 16 12:56:00 2022] GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c/os-instance-actions => generated 611 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:56:01.057204 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-afbd7e95-4ffb-452c-aaeb-1314e896d1e2 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:01.058377 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-afbd7e95-4ffb-452c-aaeb-1314e896d1e2 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] [instance: aa4ce353-1393-4c5a-a229-6aee69ce030c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:01.060970 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:56:01.066754 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afbd7e95-4ffb-452c-aaeb-1314e896d1e2 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:01.067513 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afbd7e95-4ffb-452c-aaeb-1314e896d1e2 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:01.068213 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afbd7e95-4ffb-452c-aaeb-1314e896d1e2 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:01.069498 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afbd7e95-4ffb-452c-aaeb-1314e896d1e2 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:01.070690 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afbd7e95-4ffb-452c-aaeb-1314e896d1e2 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:01.071332 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afbd7e95-4ffb-452c-aaeb-1314e896d1e2 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:01.092278 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-afbd7e95-4ffb-452c-aaeb-1314e896d1e2 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] HTTP exception thrown: Instance aa4ce353-1393-4c5a-a229-6aee69ce030c could not be found. Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-afbd7e95-4ffb-452c-aaeb-1314e896d1e2 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Request method failure captured: Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c HTTP/1.1 Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHI_QhlxoOeP8V9V_zjNLMgoxibGYhYsHYAe7ym56zVFc1nRtK-fydtcfHNrb9BBmrvUufPNkEWEDhnFAdUCHN2fiwi8SC1cp6DlUgxijp0Wb9mObU_SNBGduTRkrLd91rX2v28Mh_JlU4myYFxlj6eZk5CxIg2tnvugTYcJopwh4i4 Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: X-Openstack-Nova-Api-Version: 2.21 Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: a66c708b229645a6afdae93e4b5b1b0c Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1092193411 Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a66c708b229645a6afdae93e4b5b1b0c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a66c708b229645a6afdae93e4b5b1b0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a66c708b229645a6afdae93e4b5b1b0c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a66c708b229645a6afdae93e4b5b1b0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-InstanceActionsV221TestJSON-1092193411 Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: a66c708b229645a6afdae93e4b5b1b0c Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1092193411 Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-InstanceActionsV221TestJSON-1092193411-project Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 550acfff5ad24023b78badaca2bc6909 Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-InstanceActionsV221TestJSON-1092193411-project Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance aa4ce353-1393-4c5a-a229-6aee69ce030c could not be found. Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': 'aa4ce353-1393-4c5a-a229-6aee69ce030c'} Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa4ce353-1393-4c5a-a229-6aee69ce030c could not be found. Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:56:01.095125 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:56:01.101512 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa4ce353-1393-4c5a-a229-6aee69ce030c could not be found. Sep 16 12:56:01.101512 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:01.101512 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:01.101512 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:01.101512 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:01.101512 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:56:01.101512 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:56:01.101512 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:56:01.101512 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:56:01.101512 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa4ce353-1393-4c5a-a229-6aee69ce030c could not be found. Sep 16 12:56:01.101512 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:01.101512 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-afbd7e95-4ffb-452c-aaeb-1314e896d1e2 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Returning 404 to user: Instance aa4ce353-1393-4c5a-a229-6aee69ce030c could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:56:01.101512 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-afbd7e95-4ffb-452c-aaeb-1314e896d1e2 tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] 10.222.0.67 "DELETE /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c" status: 404 len: 111 microversion: 2.21 time: 0.044347 Sep 16 12:56:01.101512 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1298/2522] 10.222.0.67 () {60 vars in 1280 bytes} [Fri Sep 16 12:56:01 2022] DELETE /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 12:56:01.107662 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-07cfba18-694a-4e74-a35e-9cf80cc72fce tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:01.108440 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-07cfba18-694a-4e74-a35e-9cf80cc72fce tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] [instance: aa4ce353-1393-4c5a-a229-6aee69ce030c] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:01.115460 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-07cfba18-694a-4e74-a35e-9cf80cc72fce tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:01.116524 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-07cfba18-694a-4e74-a35e-9cf80cc72fce tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:01.117100 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-07cfba18-694a-4e74-a35e-9cf80cc72fce tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:01.118142 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-07cfba18-694a-4e74-a35e-9cf80cc72fce tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:01.118972 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-07cfba18-694a-4e74-a35e-9cf80cc72fce tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:01.119742 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-07cfba18-694a-4e74-a35e-9cf80cc72fce tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:01.143533 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-07cfba18-694a-4e74-a35e-9cf80cc72fce tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] HTTP exception thrown: Instance aa4ce353-1393-4c5a-a229-6aee69ce030c could not be found. Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-07cfba18-694a-4e74-a35e-9cf80cc72fce tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Request method failure captured: Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c HTTP/1.1 Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHI_QhlxoOeP8V9V_zjNLMgoxibGYhYsHYAe7ym56zVFc1nRtK-fydtcfHNrb9BBmrvUufPNkEWEDhnFAdUCHN2fiwi8SC1cp6DlUgxijp0Wb9mObU_SNBGduTRkrLd91rX2v28Mh_JlU4myYFxlj6eZk5CxIg2tnvugTYcJopwh4i4 Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: X-Openstack-Nova-Api-Version: 2.21 Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: a66c708b229645a6afdae93e4b5b1b0c Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1092193411 Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a66c708b229645a6afdae93e4b5b1b0c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a66c708b229645a6afdae93e4b5b1b0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a66c708b229645a6afdae93e4b5b1b0c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a66c708b229645a6afdae93e4b5b1b0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-InstanceActionsV221TestJSON-1092193411 Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: a66c708b229645a6afdae93e4b5b1b0c Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1092193411 Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-InstanceActionsV221TestJSON-1092193411-project Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 550acfff5ad24023b78badaca2bc6909 Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-InstanceActionsV221TestJSON-1092193411-project Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance aa4ce353-1393-4c5a-a229-6aee69ce030c could not be found. Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'aa4ce353-1393-4c5a-a229-6aee69ce030c'} Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa4ce353-1393-4c5a-a229-6aee69ce030c could not be found. Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa4ce353-1393-4c5a-a229-6aee69ce030c could not be found. Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:01.145751 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:01.149235 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:01.149235 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:01.149235 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:56:01.149235 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:56:01.149235 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:56:01.149235 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:56:01.149235 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa4ce353-1393-4c5a-a229-6aee69ce030c could not be found. Sep 16 12:56:01.149235 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:01.149235 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-07cfba18-694a-4e74-a35e-9cf80cc72fce tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] Returning 404 to user: Instance aa4ce353-1393-4c5a-a229-6aee69ce030c could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:56:01.149235 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-07cfba18-694a-4e74-a35e-9cf80cc72fce tempest-InstanceActionsV221TestJSON-1092193411 tempest-InstanceActionsV221TestJSON-1092193411-project] 10.222.0.67 "GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c" status: 404 len: 111 microversion: 2.21 time: 0.043483 Sep 16 12:56:01.149235 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1225/2523] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:01 2022] GET /compute/v2.1/servers/aa4ce353-1393-4c5a-a229-6aee69ce030c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 12:56:01.959846 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c3f67ccf-fde9-48e8-94c8-9164e4ae747d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:01.960517 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c3f67ccf-fde9-48e8-94c8-9164e4ae747d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:01.990024 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3f67ccf-fde9-48e8-94c8-9164e4ae747d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:01.993460 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3f67ccf-fde9-48e8-94c8-9164e4ae747d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:01.994111 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3f67ccf-fde9-48e8-94c8-9164e4ae747d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:01.995020 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3f67ccf-fde9-48e8-94c8-9164e4ae747d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:01.995491 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3f67ccf-fde9-48e8-94c8-9164e4ae747d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:01.996252 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3f67ccf-fde9-48e8-94c8-9164e4ae747d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:02.006568 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ef385429-0502-4e00-8836-cf15dcad0822 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:02.007189 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ef385429-0502-4e00-8836-cf15dcad0822 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:02.026356 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ef385429-0502-4e00-8836-cf15dcad0822 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:02.028087 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ef385429-0502-4e00-8836-cf15dcad0822 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:02.028995 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ef385429-0502-4e00-8836-cf15dcad0822 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:02.030164 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ef385429-0502-4e00-8836-cf15dcad0822 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:02.030832 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ef385429-0502-4e00-8836-cf15dcad0822 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:02.032231 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ef385429-0502-4e00-8836-cf15dcad0822 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:02.479461 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c3f67ccf-fde9-48e8-94c8-9164e4ae747d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:02.484904 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ef385429-0502-4e00-8836-cf15dcad0822 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:02.490426 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c3f67ccf-fde9-48e8-94c8-9164e4ae747d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:02.492407 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c3f67ccf-fde9-48e8-94c8-9164e4ae747d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:02.493898 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c3f67ccf-fde9-48e8-94c8-9164e4ae747d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 1804 microversion: 2.25 time: 0.538093 Sep 16 12:56:02.494737 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1299/2524] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:01 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 1804 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:56:02.501706 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ef385429-0502-4e00-8836-cf15dcad0822 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1503 microversion: 2.1 time: 0.500437 Sep 16 12:56:02.522434 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fb3cebb5-1054-4d5e-a935-8f4738e57a22 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Calling method '.version_select at 0x7f103526e310>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:02.525058 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb3cebb5-1054-4d5e-a935-8f4738e57a22 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:02.525605 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb3cebb5-1054-4d5e-a935-8f4738e57a22 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:02.525853 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1226/2525] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:02 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1503 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:56:02.526039 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb3cebb5-1054-4d5e-a935-8f4738e57a22 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:02.536178 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fb3cebb5-1054-4d5e-a935-8f4738e57a22 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] 10.222.0.67 "GET /compute/v2.1/os-migrations" status: 200 len: 1277 microversion: 2.25 time: 0.018494 Sep 16 12:56:02.544620 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1300/2526] 10.222.0.67 () {60 vars in 1184 bytes} [Fri Sep 16 12:56:02 2022] GET /compute/v2.1/os-migrations => generated 1277 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:56:02.554248 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c8d1fb84-1787-4069-b532-fb2038505b28 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:02.555103 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c8d1fb84-1787-4069-b532-fb2038505b28 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:02.577015 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c8d1fb84-1787-4069-b532-fb2038505b28 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:02.579858 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c8d1fb84-1787-4069-b532-fb2038505b28 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:02.580780 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c8d1fb84-1787-4069-b532-fb2038505b28 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:02.582102 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c8d1fb84-1787-4069-b532-fb2038505b28 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:02.583917 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c8d1fb84-1787-4069-b532-fb2038505b28 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:02.584618 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c8d1fb84-1787-4069-b532-fb2038505b28 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:02.683154 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-61ce1d6e-55e5-484f-8e84-9e53b1a5f216 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-258757061", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:02.793981 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-61ce1d6e-55e5-484f-8e84-9e53b1a5f216 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] validate_networks() for [('4f690fd7-a007-4db5-a7d2-6b0378c9fb20', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:56:03.286970 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-c8d1fb84-1787-4069-b532-fb2038505b28 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lazy-loading 'services' on Instance uuid d49156a2-d78c-4601-a431-e09716c76ce8 {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:56:03.314945 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c8d1fb84-1787-4069-b532-fb2038505b28 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 2422 microversion: 2.25 time: 0.765023 Sep 16 12:56:03.315887 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1227/2527] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:02 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 2422 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:56:03.337478 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-dd56187e-1b31-4561-8eed-350df9e9d78b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:03.338001 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-dd56187e-1b31-4561-8eed-350df9e9d78b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:03.345519 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dd56187e-1b31-4561-8eed-350df9e9d78b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:03.352479 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dd56187e-1b31-4561-8eed-350df9e9d78b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:03.353510 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dd56187e-1b31-4561-8eed-350df9e9d78b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:03.354522 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dd56187e-1b31-4561-8eed-350df9e9d78b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:03.355189 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dd56187e-1b31-4561-8eed-350df9e9d78b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:03.356250 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dd56187e-1b31-4561-8eed-350df9e9d78b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:03.497563 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-dd56187e-1b31-4561-8eed-350df9e9d78b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lazy-loading 'services' on Instance uuid 9ad8536a-46b8-4821-8fb0-2c743927bb88 {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:56:03.595069 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=20 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:56:03.647263 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-dd56187e-1b31-4561-8eed-350df9e9d78b tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "DELETE /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88/os-volume_attachments/cb60e29d-4ea1-43df-a4be-d22834c80ee8" status: 202 len: 0 microversion: 2.1 time: 0.329185 Sep 16 12:56:03.648437 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1228/2528] 10.222.0.67 () {58 vars in 1416 bytes} [Fri Sep 16 12:56:03 2022] DELETE /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88/os-volume_attachments/cb60e29d-4ea1-43df-a4be-d22834c80ee8 => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:56:03.676689 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-36bc2c3c-2f22-4201-8b35-e4c0512f290a tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:03.684217 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-36bc2c3c-2f22-4201-8b35-e4c0512f290a tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:03.717301 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-36bc2c3c-2f22-4201-8b35-e4c0512f290a tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:03.724332 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-36bc2c3c-2f22-4201-8b35-e4c0512f290a tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:03.726915 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-36bc2c3c-2f22-4201-8b35-e4c0512f290a tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:03.727934 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-36bc2c3c-2f22-4201-8b35-e4c0512f290a tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:03.730801 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-36bc2c3c-2f22-4201-8b35-e4c0512f290a tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:03.732104 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-36bc2c3c-2f22-4201-8b35-e4c0512f290a tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:04.388523 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-36bc2c3c-2f22-4201-8b35-e4c0512f290a tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lazy-loading 'services' on Instance uuid d49156a2-d78c-4601-a431-e09716c76ce8 {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:56:04.437196 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-36bc2c3c-2f22-4201-8b35-e4c0512f290a tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 2422 microversion: 2.25 time: 0.787037 Sep 16 12:56:04.444497 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1229/2529] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:03 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 2422 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:56:04.449342 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6f338d31-2931-42fd-bb07-b2b1aab019d0 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:04.449974 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6f338d31-2931-42fd-bb07-b2b1aab019d0 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:04.451917 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:DELETE=3,nova_api:SELECT=94,nova_api:INSERT=3 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:56:04.475439 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6f338d31-2931-42fd-bb07-b2b1aab019d0 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:04.476452 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6f338d31-2931-42fd-bb07-b2b1aab019d0 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:04.477137 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6f338d31-2931-42fd-bb07-b2b1aab019d0 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:04.478082 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6f338d31-2931-42fd-bb07-b2b1aab019d0 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:04.478785 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6f338d31-2931-42fd-bb07-b2b1aab019d0 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:04.479417 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6f338d31-2931-42fd-bb07-b2b1aab019d0 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:04.515649 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-61ce1d6e-55e5-484f-8e84-9e53b1a5f216 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:56:04.516658 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-61ce1d6e-55e5-484f-8e84-9e53b1a5f216 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:56:04.517589 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-61ce1d6e-55e5-484f-8e84-9e53b1a5f216 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:56:04.518208 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-61ce1d6e-55e5-484f-8e84-9e53b1a5f216 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:56:04.518846 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-61ce1d6e-55e5-484f-8e84-9e53b1a5f216 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:56:04.539989 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61ce1d6e-55e5-484f-8e84-9e53b1a5f216 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:04.542811 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61ce1d6e-55e5-484f-8e84-9e53b1a5f216 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:04.543568 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61ce1d6e-55e5-484f-8e84-9e53b1a5f216 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:04.545376 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61ce1d6e-55e5-484f-8e84-9e53b1a5f216 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:04.546267 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61ce1d6e-55e5-484f-8e84-9e53b1a5f216 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:04.555820 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61ce1d6e-55e5-484f-8e84-9e53b1a5f216 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:04.717353 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-61ce1d6e-55e5-484f-8e84-9e53b1a5f216 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Getting quotas for project c88ea8e8750c440e86d3c1eb4ab6110e. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:56:04.740538 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-61ce1d6e-55e5-484f-8e84-9e53b1a5f216 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Getting quotas for user 973378f0eed8476eb41a29d5ce57ed65 and project c88ea8e8750c440e86d3c1eb4ab6110e. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:56:04.815791 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-61ce1d6e-55e5-484f-8e84-9e53b1a5f216 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:56:04.828529 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-61ce1d6e-55e5-484f-8e84-9e53b1a5f216 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: e34e2be3-4e61-46dc-b4a4-5abcd3df9b85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:56:04.942938 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6f338d31-2931-42fd-bb07-b2b1aab019d0 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:04.950986 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6f338d31-2931-42fd-bb07-b2b1aab019d0 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1503 microversion: 2.1 time: 0.505357 Sep 16 12:56:04.958544 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1230/2530] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:04 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1503 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:04.977530 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ad3ed0b5-f3ec-4874-a3a2-c09c2befa772 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:05.011850 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ad3ed0b5-f3ec-4874-a3a2-c09c2befa772 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:05.015126 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-61ce1d6e-55e5-484f-8e84-9e53b1a5f216 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.336148 Sep 16 12:56:05.025605 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1301/2531] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:56:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 2347 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 12:56:05.032893 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ad3ed0b5-f3ec-4874-a3a2-c09c2befa772 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:05.034894 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ad3ed0b5-f3ec-4874-a3a2-c09c2befa772 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:05.035443 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ad3ed0b5-f3ec-4874-a3a2-c09c2befa772 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:05.037478 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ad3ed0b5-f3ec-4874-a3a2-c09c2befa772 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:05.038103 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ad3ed0b5-f3ec-4874-a3a2-c09c2befa772 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:05.038611 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ad3ed0b5-f3ec-4874-a3a2-c09c2befa772 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:05.047038 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4787324f-ed11-4467-95f8-a6528414e6fe tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:05.048441 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4787324f-ed11-4467-95f8-a6528414e6fe tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: e34e2be3-4e61-46dc-b4a4-5abcd3df9b85] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:05.190723 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4787324f-ed11-4467-95f8-a6528414e6fe tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:05.191547 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-ad3ed0b5-f3ec-4874-a3a2-c09c2befa772 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lazy-loading 'services' on Instance uuid d49156a2-d78c-4601-a431-e09716c76ce8 {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:56:05.210236 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4787324f-ed11-4467-95f8-a6528414e6fe tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85" status: 200 len: 1224 microversion: 2.1 time: 0.171485 Sep 16 12:56:05.214632 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1302/2532] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:05 2022] GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 => generated 1224 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:05.369588 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ad3ed0b5-f3ec-4874-a3a2-c09c2befa772 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8/os-volume_attachments/a716d145-bf0f-4ddc-91a3-122aa4ae12e7" status: 202 len: 0 microversion: 2.25 time: 0.408422 Sep 16 12:56:05.400584 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1231/2533] 10.222.0.67 () {60 vars in 1457 bytes} [Fri Sep 16 12:56:04 2022] DELETE /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8/os-volume_attachments/a716d145-bf0f-4ddc-91a3-122aa4ae12e7 => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:56:05.409337 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ecc29560-a4c7-4167-965b-10bb9a3cde6d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:05.411664 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ecc29560-a4c7-4167-965b-10bb9a3cde6d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:05.434391 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecc29560-a4c7-4167-965b-10bb9a3cde6d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:05.440808 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecc29560-a4c7-4167-965b-10bb9a3cde6d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:05.441602 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecc29560-a4c7-4167-965b-10bb9a3cde6d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:05.443959 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecc29560-a4c7-4167-965b-10bb9a3cde6d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:05.445466 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecc29560-a4c7-4167-965b-10bb9a3cde6d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:05.446374 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecc29560-a4c7-4167-965b-10bb9a3cde6d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:05.573911 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ecc29560-a4c7-4167-965b-10bb9a3cde6d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.169457 Sep 16 12:56:05.574720 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1303/2534] 10.222.0.67 () {60 vars in 1343 bytes} [Fri Sep 16 12:56:05 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:56:05.987081 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f89b8062-33ce-4ea0-9887-a01cd0b7123d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:05.987796 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f89b8062-33ce-4ea0-9887-a01cd0b7123d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:06.016646 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f89b8062-33ce-4ea0-9887-a01cd0b7123d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:06.026176 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f89b8062-33ce-4ea0-9887-a01cd0b7123d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:06.026679 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f89b8062-33ce-4ea0-9887-a01cd0b7123d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:06.027365 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f89b8062-33ce-4ea0-9887-a01cd0b7123d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:06.027824 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f89b8062-33ce-4ea0-9887-a01cd0b7123d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:06.028282 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f89b8062-33ce-4ea0-9887-a01cd0b7123d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:06.243892 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-196b8d50-2d62-42ab-b20b-d52659fe8c82 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:06.244765 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-196b8d50-2d62-42ab-b20b-d52659fe8c82 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: e34e2be3-4e61-46dc-b4a4-5abcd3df9b85] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:06.254664 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-196b8d50-2d62-42ab-b20b-d52659fe8c82 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:06.255234 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-196b8d50-2d62-42ab-b20b-d52659fe8c82 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:06.255796 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-196b8d50-2d62-42ab-b20b-d52659fe8c82 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:06.256633 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-196b8d50-2d62-42ab-b20b-d52659fe8c82 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:06.257290 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-196b8d50-2d62-42ab-b20b-d52659fe8c82 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:06.257499 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-196b8d50-2d62-42ab-b20b-d52659fe8c82 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:06.502753 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-196b8d50-2d62-42ab-b20b-d52659fe8c82 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:06.520988 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-196b8d50-2d62-42ab-b20b-d52659fe8c82 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85" status: 200 len: 1228 microversion: 2.1 time: 0.282187 Sep 16 12:56:06.524439 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1304/2535] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:06 2022] GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 => generated 1228 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:56:06.590178 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dc12d442-85cb-4227-bcc8-b4e593d32b47 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:06.593753 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dc12d442-85cb-4227-bcc8-b4e593d32b47 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:06.627446 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc12d442-85cb-4227-bcc8-b4e593d32b47 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:06.630596 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc12d442-85cb-4227-bcc8-b4e593d32b47 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:06.631787 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc12d442-85cb-4227-bcc8-b4e593d32b47 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:06.634179 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc12d442-85cb-4227-bcc8-b4e593d32b47 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:06.635307 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc12d442-85cb-4227-bcc8-b4e593d32b47 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:06.637496 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc12d442-85cb-4227-bcc8-b4e593d32b47 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:06.737260 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dc12d442-85cb-4227-bcc8-b4e593d32b47 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.153469 Sep 16 12:56:06.741069 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1305/2536] 10.222.0.67 () {60 vars in 1343 bytes} [Fri Sep 16 12:56:06 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:56:06.853879 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f89b8062-33ce-4ea0-9887-a01cd0b7123d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:06.883755 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f89b8062-33ce-4ea0-9887-a01cd0b7123d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1503 microversion: 2.1 time: 0.894644 Sep 16 12:56:06.916824 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1232/2537] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:05 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1503 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:07.529386 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e0146420-66f5-476a-8027-64802eab34a0 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-437076813", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": "none"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:07.555228 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8f1ade9f-8f33-4918-9f26-a423ed580fb3 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:07.556483 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8f1ade9f-8f33-4918-9f26-a423ed580fb3 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: e34e2be3-4e61-46dc-b4a4-5abcd3df9b85] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:07.570480 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8f1ade9f-8f33-4918-9f26-a423ed580fb3 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:07.570989 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8f1ade9f-8f33-4918-9f26-a423ed580fb3 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:07.573471 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8f1ade9f-8f33-4918-9f26-a423ed580fb3 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:07.574242 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8f1ade9f-8f33-4918-9f26-a423ed580fb3 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:07.574714 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8f1ade9f-8f33-4918-9f26-a423ed580fb3 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:07.577359 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8f1ade9f-8f33-4918-9f26-a423ed580fb3 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:07.638914 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-e0146420-66f5-476a-8027-64802eab34a0 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:56:07.639338 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-e0146420-66f5-476a-8027-64802eab34a0 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:56:07.639811 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-e0146420-66f5-476a-8027-64802eab34a0 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:56:07.640247 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-e0146420-66f5-476a-8027-64802eab34a0 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:56:07.640664 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-e0146420-66f5-476a-8027-64802eab34a0 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:56:07.670667 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0146420-66f5-476a-8027-64802eab34a0 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:07.671157 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0146420-66f5-476a-8027-64802eab34a0 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:07.671590 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0146420-66f5-476a-8027-64802eab34a0 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:07.672347 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0146420-66f5-476a-8027-64802eab34a0 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:07.673539 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0146420-66f5-476a-8027-64802eab34a0 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:07.674158 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0146420-66f5-476a-8027-64802eab34a0 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:07.719845 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-e0146420-66f5-476a-8027-64802eab34a0 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Getting quotas for project 20cd3ecbb8b84f8eb7b81a9b63721cda. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:56:07.725982 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-e0146420-66f5-476a-8027-64802eab34a0 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Getting quotas for user ea21d3fa8057445d9fc8800c0e9143cb and project 20cd3ecbb8b84f8eb7b81a9b63721cda. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:56:07.754608 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e0146420-66f5-476a-8027-64802eab34a0 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:56:07.767024 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8f1ade9f-8f33-4918-9f26-a423ed580fb3 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:07.768004 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e0146420-66f5-476a-8027-64802eab34a0 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:56:07.777619 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8f1ade9f-8f33-4918-9f26-a423ed580fb3 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85" status: 200 len: 1294 microversion: 2.1 time: 0.226654 Sep 16 12:56:07.805474 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1233/2538] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:07 2022] GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 => generated 1294 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:07.811288 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-bd039020-a797-40dc-90c4-f963641e1511 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:07.813894 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-bd039020-a797-40dc-90c4-f963641e1511 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:07.831590 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bd039020-a797-40dc-90c4-f963641e1511 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:07.834501 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bd039020-a797-40dc-90c4-f963641e1511 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:07.835321 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bd039020-a797-40dc-90c4-f963641e1511 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:07.837330 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bd039020-a797-40dc-90c4-f963641e1511 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:07.837958 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bd039020-a797-40dc-90c4-f963641e1511 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:07.840015 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bd039020-a797-40dc-90c4-f963641e1511 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:07.867436 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e0146420-66f5-476a-8027-64802eab34a0 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.562718 Sep 16 12:56:07.882382 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1306/2539] 10.222.0.67 () {62 vars in 1188 bytes} [Fri Sep 16 12:56:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 16 12:56:07.895315 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bf335942-fc72-429e-b6fe-e0505cfeff3d tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:07.897866 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bf335942-fc72-429e-b6fe-e0505cfeff3d tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:07.958601 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-bd039020-a797-40dc-90c4-f963641e1511 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.151730 Sep 16 12:56:07.959795 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1234/2540] 10.222.0.67 () {60 vars in 1343 bytes} [Fri Sep 16 12:56:07 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:56:07.989893 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-832aca4e-59b3-4923-8f1b-3110daf9b224 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:07.991999 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-832aca4e-59b3-4923-8f1b-3110daf9b224 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:08.009053 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-832aca4e-59b3-4923-8f1b-3110daf9b224 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:08.009912 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-832aca4e-59b3-4923-8f1b-3110daf9b224 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:08.010635 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-832aca4e-59b3-4923-8f1b-3110daf9b224 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:08.019422 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-832aca4e-59b3-4923-8f1b-3110daf9b224 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:08.020105 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-832aca4e-59b3-4923-8f1b-3110daf9b224 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:08.021182 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-832aca4e-59b3-4923-8f1b-3110daf9b224 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:08.305840 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bf335942-fc72-429e-b6fe-e0505cfeff3d tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:08.316911 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:56:08.325559 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bf335942-fc72-429e-b6fe-e0505cfeff3d tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:08.327583 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bf335942-fc72-429e-b6fe-e0505cfeff3d tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:08.339525 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bf335942-fc72-429e-b6fe-e0505cfeff3d tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] 10.222.0.67 "PUT /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1358 microversion: 2.75 time: 0.455508 Sep 16 12:56:08.340444 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1307/2541] 10.222.0.67 () {62 vars in 1297 bytes} [Fri Sep 16 12:56:07 2022] PUT /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1358 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:56:08.373436 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-818c7352-651d-49e2-9c3b-7492d07626bc tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:08.374484 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-818c7352-651d-49e2-9c3b-7492d07626bc tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:08.419171 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=22 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:56:08.493121 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-818c7352-651d-49e2-9c3b-7492d07626bc tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:08.507134 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-818c7352-651d-49e2-9c3b-7492d07626bc tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:08.515260 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-818c7352-651d-49e2-9c3b-7492d07626bc tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:08.529269 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-818c7352-651d-49e2-9c3b-7492d07626bc tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1358 microversion: 2.75 time: 0.160687 Sep 16 12:56:08.544151 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1308/2542] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:08 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:56:08.614435 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-832aca4e-59b3-4923-8f1b-3110daf9b224 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:08.627194 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-832aca4e-59b3-4923-8f1b-3110daf9b224 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1503 microversion: 2.1 time: 0.658340 Sep 16 12:56:08.630712 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1235/2543] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:07 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1503 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:08.814389 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-260be9ef-4837-4bac-b555-cd2908bd90e4 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:08.815260 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-260be9ef-4837-4bac-b555-cd2908bd90e4 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: e34e2be3-4e61-46dc-b4a4-5abcd3df9b85] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:08.825921 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-260be9ef-4837-4bac-b555-cd2908bd90e4 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:08.828026 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-260be9ef-4837-4bac-b555-cd2908bd90e4 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:08.830612 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-260be9ef-4837-4bac-b555-cd2908bd90e4 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:08.834704 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-260be9ef-4837-4bac-b555-cd2908bd90e4 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:08.835564 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-260be9ef-4837-4bac-b555-cd2908bd90e4 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:08.836332 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-260be9ef-4837-4bac-b555-cd2908bd90e4 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:08.976362 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a44d5625-12b3-4707-aa64-0f88fa2b4a4e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:08.979161 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a44d5625-12b3-4707-aa64-0f88fa2b4a4e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:08.996289 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a44d5625-12b3-4707-aa64-0f88fa2b4a4e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:08.998312 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a44d5625-12b3-4707-aa64-0f88fa2b4a4e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:08.999883 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a44d5625-12b3-4707-aa64-0f88fa2b4a4e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:09.006905 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a44d5625-12b3-4707-aa64-0f88fa2b4a4e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:09.007495 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a44d5625-12b3-4707-aa64-0f88fa2b4a4e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:09.007949 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a44d5625-12b3-4707-aa64-0f88fa2b4a4e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:09.046823 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-260be9ef-4837-4bac-b555-cd2908bd90e4 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:09.059234 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-260be9ef-4837-4bac-b555-cd2908bd90e4 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85" status: 200 len: 1282 microversion: 2.1 time: 0.247214 Sep 16 12:56:09.060422 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1309/2544] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:08 2022] GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 => generated 1282 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:09.078311 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a44d5625-12b3-4707-aa64-0f88fa2b4a4e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.109320 Sep 16 12:56:09.088742 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1236/2545] 10.222.0.67 () {60 vars in 1343 bytes} [Fri Sep 16 12:56:08 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:56:09.570033 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fde8b65f-d80a-42e3-843e-b1471adbe805 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:09.571840 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fde8b65f-d80a-42e3-843e-b1471adbe805 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:09.603489 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fde8b65f-d80a-42e3-843e-b1471adbe805 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:09.608474 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fde8b65f-d80a-42e3-843e-b1471adbe805 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:09.609080 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fde8b65f-d80a-42e3-843e-b1471adbe805 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:09.612874 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fde8b65f-d80a-42e3-843e-b1471adbe805 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:09.613973 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fde8b65f-d80a-42e3-843e-b1471adbe805 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:09.614633 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fde8b65f-d80a-42e3-843e-b1471adbe805 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:09.650830 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-dac00a27-0e63-459f-b67e-961cd495bdcb tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:09.651632 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-dac00a27-0e63-459f-b67e-961cd495bdcb tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:09.660820 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dac00a27-0e63-459f-b67e-961cd495bdcb tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:09.661303 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dac00a27-0e63-459f-b67e-961cd495bdcb tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:09.667570 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dac00a27-0e63-459f-b67e-961cd495bdcb tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:09.677553 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dac00a27-0e63-459f-b67e-961cd495bdcb tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:09.678326 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dac00a27-0e63-459f-b67e-961cd495bdcb tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:09.678915 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dac00a27-0e63-459f-b67e-961cd495bdcb tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:09.797062 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fde8b65f-d80a-42e3-843e-b1471adbe805 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:09.811273 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fde8b65f-d80a-42e3-843e-b1471adbe805 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:09.812795 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fde8b65f-d80a-42e3-843e-b1471adbe805 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:09.825568 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fde8b65f-d80a-42e3-843e-b1471adbe805 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1410 microversion: 2.75 time: 0.263921 Sep 16 12:56:09.826595 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1310/2546] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:09 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1410 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:56:10.083713 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-26e70dc9-b42b-446e-aad1-dd4d5418b4a4 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:10.084352 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-26e70dc9-b42b-446e-aad1-dd4d5418b4a4 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: e34e2be3-4e61-46dc-b4a4-5abcd3df9b85] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:10.103154 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26e70dc9-b42b-446e-aad1-dd4d5418b4a4 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:10.103671 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26e70dc9-b42b-446e-aad1-dd4d5418b4a4 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:10.104141 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26e70dc9-b42b-446e-aad1-dd4d5418b4a4 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:10.109820 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26e70dc9-b42b-446e-aad1-dd4d5418b4a4 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:10.110021 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26e70dc9-b42b-446e-aad1-dd4d5418b4a4 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:10.112684 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26e70dc9-b42b-446e-aad1-dd4d5418b4a4 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:10.199571 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-dac00a27-0e63-459f-b67e-961cd495bdcb tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:10.209545 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-dac00a27-0e63-459f-b67e-961cd495bdcb tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1503 microversion: 2.1 time: 0.562323 Sep 16 12:56:10.214364 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1237/2547] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:09 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1503 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:56:10.221680 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c4a410a0-6925-4779-8804-d8ab0ef93cfd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:10.238158 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c4a410a0-6925-4779-8804-d8ab0ef93cfd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:10.261441 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c4a410a0-6925-4779-8804-d8ab0ef93cfd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:10.267642 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c4a410a0-6925-4779-8804-d8ab0ef93cfd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:10.268225 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c4a410a0-6925-4779-8804-d8ab0ef93cfd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:10.270607 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c4a410a0-6925-4779-8804-d8ab0ef93cfd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:10.271174 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c4a410a0-6925-4779-8804-d8ab0ef93cfd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:10.273790 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c4a410a0-6925-4779-8804-d8ab0ef93cfd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:10.337885 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:56:10.368260 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c4a410a0-6925-4779-8804-d8ab0ef93cfd tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.150923 Sep 16 12:56:10.369934 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1238/2548] 10.222.0.67 () {60 vars in 1343 bytes} [Fri Sep 16 12:56:10 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:56:10.633492 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-f0fef41b-89ee-4727-92ac-cfb8815d1ed8 req-1e80a859-c512-4621-bc8a-86f1aef33aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e34e2be3-4e61-46dc-b4a4-5abcd3df9b85", "tag": "27d81681-82f2-4f23-8f72-9075e99f9ca1"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:10.654697 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-f0fef41b-89ee-4727-92ac-cfb8815d1ed8 req-1e80a859-c512-4621-bc8a-86f1aef33aa4 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:10.657308 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-f0fef41b-89ee-4727-92ac-cfb8815d1ed8 req-1e80a859-c512-4621-bc8a-86f1aef33aa4 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:10.658100 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-f0fef41b-89ee-4727-92ac-cfb8815d1ed8 req-1e80a859-c512-4621-bc8a-86f1aef33aa4 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:10.675582 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-f0fef41b-89ee-4727-92ac-cfb8815d1ed8 req-1e80a859-c512-4621-bc8a-86f1aef33aa4 service nova] Creating event network-changed:27d81681-82f2-4f23-8f72-9075e99f9ca1 for instance e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 on n-h2-858094-4 Sep 16 12:56:10.681545 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-f0fef41b-89ee-4727-92ac-cfb8815d1ed8 req-1e80a859-c512-4621-bc8a-86f1aef33aa4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053332 Sep 16 12:56:10.682847 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1239/2549] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:56:10.854879 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-62e56546-176b-4ba5-a2cd-49da9af1ff54 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:10.855600 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-62e56546-176b-4ba5-a2cd-49da9af1ff54 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:10.866070 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62e56546-176b-4ba5-a2cd-49da9af1ff54 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:10.866564 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62e56546-176b-4ba5-a2cd-49da9af1ff54 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:10.873269 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62e56546-176b-4ba5-a2cd-49da9af1ff54 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:10.874404 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62e56546-176b-4ba5-a2cd-49da9af1ff54 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:10.875118 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62e56546-176b-4ba5-a2cd-49da9af1ff54 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:10.875819 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62e56546-176b-4ba5-a2cd-49da9af1ff54 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:10.905802 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-26e70dc9-b42b-446e-aad1-dd4d5418b4a4 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:10.915909 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-26e70dc9-b42b-446e-aad1-dd4d5418b4a4 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85" status: 200 len: 1324 microversion: 2.1 time: 0.836822 Sep 16 12:56:10.916870 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1311/2550] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:10 2022] GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 => generated 1324 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:56:11.009770 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-62e56546-176b-4ba5-a2cd-49da9af1ff54 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:11.034537 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-62e56546-176b-4ba5-a2cd-49da9af1ff54 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:11.041662 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-62e56546-176b-4ba5-a2cd-49da9af1ff54 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:11.066943 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-62e56546-176b-4ba5-a2cd-49da9af1ff54 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1416 microversion: 2.75 time: 0.215823 Sep 16 12:56:11.068600 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1240/2551] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:10 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1416 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:56:11.245236 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ada7f1f4-0718-4bbb-bd88-fbf7b130241d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:11.246308 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ada7f1f4-0718-4bbb-bd88-fbf7b130241d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:11.258149 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ada7f1f4-0718-4bbb-bd88-fbf7b130241d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:11.258358 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ada7f1f4-0718-4bbb-bd88-fbf7b130241d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:11.258908 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ada7f1f4-0718-4bbb-bd88-fbf7b130241d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:11.259800 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ada7f1f4-0718-4bbb-bd88-fbf7b130241d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:11.260398 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ada7f1f4-0718-4bbb-bd88-fbf7b130241d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:11.260936 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ada7f1f4-0718-4bbb-bd88-fbf7b130241d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:11.381742 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4f5d89bf-5e18-4a4d-938c-33d230bcb752 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:11.384302 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-4f5d89bf-5e18-4a4d-938c-33d230bcb752 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:11.415597 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4f5d89bf-5e18-4a4d-938c-33d230bcb752 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:11.422396 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4f5d89bf-5e18-4a4d-938c-33d230bcb752 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:11.423615 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4f5d89bf-5e18-4a4d-938c-33d230bcb752 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:11.428213 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4f5d89bf-5e18-4a4d-938c-33d230bcb752 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:11.429168 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4f5d89bf-5e18-4a4d-938c-33d230bcb752 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:11.429841 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4f5d89bf-5e18-4a4d-938c-33d230bcb752 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:11.495057 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4f5d89bf-5e18-4a4d-938c-33d230bcb752 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.117403 Sep 16 12:56:11.496406 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1241/2552] 10.222.0.67 () {60 vars in 1343 bytes} [Fri Sep 16 12:56:11 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 12:56:11.814263 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ada7f1f4-0718-4bbb-bd88-fbf7b130241d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:11.828662 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ada7f1f4-0718-4bbb-bd88-fbf7b130241d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1503 microversion: 2.1 time: 0.589837 Sep 16 12:56:11.830613 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1312/2553] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:11 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1503 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:11.941778 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d07292ac-81a5-43f5-8406-5044f65fc162 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:11.943011 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d07292ac-81a5-43f5-8406-5044f65fc162 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: e34e2be3-4e61-46dc-b4a4-5abcd3df9b85] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:11.951560 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d07292ac-81a5-43f5-8406-5044f65fc162 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:11.952356 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d07292ac-81a5-43f5-8406-5044f65fc162 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:11.952948 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d07292ac-81a5-43f5-8406-5044f65fc162 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:11.953866 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d07292ac-81a5-43f5-8406-5044f65fc162 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:11.954903 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d07292ac-81a5-43f5-8406-5044f65fc162 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:11.956508 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d07292ac-81a5-43f5-8406-5044f65fc162 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:12.098244 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6441ba11-4e12-47c7-8fef-f6634e22839d tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:12.098959 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6441ba11-4e12-47c7-8fef-f6634e22839d tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:12.108216 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6441ba11-4e12-47c7-8fef-f6634e22839d tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:12.111564 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6441ba11-4e12-47c7-8fef-f6634e22839d tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:12.112172 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6441ba11-4e12-47c7-8fef-f6634e22839d tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:12.113762 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6441ba11-4e12-47c7-8fef-f6634e22839d tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:12.124981 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6441ba11-4e12-47c7-8fef-f6634e22839d tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:12.126432 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6441ba11-4e12-47c7-8fef-f6634e22839d tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:12.262627 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d07292ac-81a5-43f5-8406-5044f65fc162 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:12.277380 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d07292ac-81a5-43f5-8406-5044f65fc162 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85" status: 200 len: 1324 microversion: 2.1 time: 0.341847 Sep 16 12:56:12.297468 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6441ba11-4e12-47c7-8fef-f6634e22839d tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:12.301002 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1242/2554] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:11 2022] GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 => generated 1324 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:12.302078 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:56:12.316849 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6441ba11-4e12-47c7-8fef-f6634e22839d tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:12.318465 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6441ba11-4e12-47c7-8fef-f6634e22839d tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:12.327828 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6441ba11-4e12-47c7-8fef-f6634e22839d tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1416 microversion: 2.75 time: 0.233939 Sep 16 12:56:12.332855 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1313/2555] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:12 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1416 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:56:12.497804 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-20c96461-ea81-4277-8223-035190dda5bf tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] Action: 'create', calling method: .version_select at 0x7f1034abe3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-903333117", "description": "tempest-description-1135353457"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:12.509276 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2959e5f0-aa35-47da-8fc1-ab8e2926601f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:12.511675 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2959e5f0-aa35-47da-8fc1-ab8e2926601f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:12.519281 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2959e5f0-aa35-47da-8fc1-ab8e2926601f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:12.520233 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2959e5f0-aa35-47da-8fc1-ab8e2926601f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:12.520879 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2959e5f0-aa35-47da-8fc1-ab8e2926601f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:12.521842 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2959e5f0-aa35-47da-8fc1-ab8e2926601f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:12.522491 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2959e5f0-aa35-47da-8fc1-ab8e2926601f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:12.523111 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2959e5f0-aa35-47da-8fc1-ab8e2926601f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:12.593349 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2959e5f0-aa35-47da-8fc1-ab8e2926601f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.088891 Sep 16 12:56:12.593957 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1314/2556] 10.222.0.67 () {60 vars in 1343 bytes} [Fri Sep 16 12:56:12 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 12:56:12.854353 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-04ee6579-0f59-43c7-8ad6-a101c8c4a016 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:12.855293 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-04ee6579-0f59-43c7-8ad6-a101c8c4a016 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:12.867573 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04ee6579-0f59-43c7-8ad6-a101c8c4a016 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:12.868675 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04ee6579-0f59-43c7-8ad6-a101c8c4a016 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:12.869341 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04ee6579-0f59-43c7-8ad6-a101c8c4a016 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:12.870433 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04ee6579-0f59-43c7-8ad6-a101c8c4a016 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:12.872827 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04ee6579-0f59-43c7-8ad6-a101c8c4a016 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:12.874975 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04ee6579-0f59-43c7-8ad6-a101c8c4a016 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:13.259917 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-04ee6579-0f59-43c7-8ad6-a101c8c4a016 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:13.275115 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-04ee6579-0f59-43c7-8ad6-a101c8c4a016 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1503 microversion: 2.1 time: 0.425958 Sep 16 12:56:13.278310 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1315/2557] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:12 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1503 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:56:13.286147 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2647884b-3aed-4d56-8532-897f8d7bef25 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:13.296864 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2647884b-3aed-4d56-8532-897f8d7bef25 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:13.298604 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2647884b-3aed-4d56-8532-897f8d7bef25 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:13.299293 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2647884b-3aed-4d56-8532-897f8d7bef25 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:13.324075 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-20c96461-ea81-4277-8223-035190dda5bf tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.019138 Sep 16 12:56:13.324797 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1243/2558] 10.222.0.67 () {60 vars in 1180 bytes} [Fri Sep 16 12:56:12 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:56:13.349417 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7c807a81-cfd9-475f-a34c-61e4d8fbd3de tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:13.352655 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7c807a81-cfd9-475f-a34c-61e4d8fbd3de tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: e34e2be3-4e61-46dc-b4a4-5abcd3df9b85] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:13.372687 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7c807a81-cfd9-475f-a34c-61e4d8fbd3de tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:13.375741 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7c807a81-cfd9-475f-a34c-61e4d8fbd3de tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:13.377236 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2647884b-3aed-4d56-8532-897f8d7bef25 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Going to try to stop instance {{(pid=128779) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 16 12:56:13.388460 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7c807a81-cfd9-475f-a34c-61e4d8fbd3de tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:13.389373 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7c807a81-cfd9-475f-a34c-61e4d8fbd3de tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:13.389899 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7c807a81-cfd9-475f-a34c-61e4d8fbd3de tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:13.390330 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7c807a81-cfd9-475f-a34c-61e4d8fbd3de tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:13.494012 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2647884b-3aed-4d56-8532-897f8d7bef25 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "POST /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88/action" status: 202 len: 0 microversion: 2.1 time: 0.213968 Sep 16 12:56:13.501883 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1316/2559] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:56:13 2022] POST /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:56:13.515534 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d1742c71-b245-4cf7-a110-98fd01476bae tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] Action: 'create', calling method: .version_select at 0x7f1039a7b670>, body: {"security_group_rule": {"parent_group_id": "8ae030e2-e907-4e7f-a7a4-3261da137fc3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:13.753455 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7c807a81-cfd9-475f-a34c-61e4d8fbd3de tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:13.773290 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7c807a81-cfd9-475f-a34c-61e4d8fbd3de tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85" status: 200 len: 1324 microversion: 2.1 time: 0.444047 Sep 16 12:56:13.774815 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1244/2560] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:13 2022] GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 => generated 1324 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:13.782871 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-14c93675-2119-4923-8c62-ea2cba7b1752 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:13.783968 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-14c93675-2119-4923-8c62-ea2cba7b1752 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:13.819315 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14c93675-2119-4923-8c62-ea2cba7b1752 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:13.821146 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14c93675-2119-4923-8c62-ea2cba7b1752 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:13.822047 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14c93675-2119-4923-8c62-ea2cba7b1752 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:13.825444 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14c93675-2119-4923-8c62-ea2cba7b1752 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:13.827008 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14c93675-2119-4923-8c62-ea2cba7b1752 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:13.827762 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14c93675-2119-4923-8c62-ea2cba7b1752 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:14.031634 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-14c93675-2119-4923-8c62-ea2cba7b1752 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:14.050589 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-14c93675-2119-4923-8c62-ea2cba7b1752 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:14.065244 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-14c93675-2119-4923-8c62-ea2cba7b1752 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:14.081329 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-14c93675-2119-4923-8c62-ea2cba7b1752 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1437 microversion: 2.75 time: 0.303527 Sep 16 12:56:14.083092 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1245/2561] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:13 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1437 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:56:14.088818 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8d63c123-28d7-48af-b7b9-30005ff4b748 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:14.089820 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8d63c123-28d7-48af-b7b9-30005ff4b748 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:14.112650 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8d63c123-28d7-48af-b7b9-30005ff4b748 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:14.113839 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8d63c123-28d7-48af-b7b9-30005ff4b748 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:14.115491 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8d63c123-28d7-48af-b7b9-30005ff4b748 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:14.116848 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8d63c123-28d7-48af-b7b9-30005ff4b748 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:14.118455 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8d63c123-28d7-48af-b7b9-30005ff4b748 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:14.127845 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8d63c123-28d7-48af-b7b9-30005ff4b748 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:14.213852 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d1742c71-b245-4cf7-a110-98fd01476bae tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.714944 Sep 16 12:56:14.214632 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1317/2562] 10.222.0.67 () {60 vars in 1195 bytes} [Fri Sep 16 12:56:13 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:56:14.434527 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c0cd354c-547e-457e-a654-a733499228db tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:14.437593 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c0cd354c-547e-457e-a654-a733499228db tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:14.448865 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8d63c123-28d7-48af-b7b9-30005ff4b748 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:14.456619 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0cd354c-547e-457e-a654-a733499228db tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:14.457132 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0cd354c-547e-457e-a654-a733499228db tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:14.457577 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0cd354c-547e-457e-a654-a733499228db tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:14.458303 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0cd354c-547e-457e-a654-a733499228db tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:14.458763 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0cd354c-547e-457e-a654-a733499228db tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:14.461987 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8d63c123-28d7-48af-b7b9-30005ff4b748 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1678 microversion: 2.1 time: 0.377536 Sep 16 12:56:14.462239 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0cd354c-547e-457e-a654-a733499228db tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:14.465381 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1246/2563] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:14 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1678 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:14.478082 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9c4ad11b-3562-411d-9b6e-bf6005021799 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:14.481200 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9c4ad11b-3562-411d-9b6e-bf6005021799 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:14.500098 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9c4ad11b-3562-411d-9b6e-bf6005021799 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:14.500638 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9c4ad11b-3562-411d-9b6e-bf6005021799 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:14.501097 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9c4ad11b-3562-411d-9b6e-bf6005021799 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:14.501899 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9c4ad11b-3562-411d-9b6e-bf6005021799 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:14.502408 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9c4ad11b-3562-411d-9b6e-bf6005021799 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:14.502839 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9c4ad11b-3562-411d-9b6e-bf6005021799 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:14.558041 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c0cd354c-547e-457e-a654-a733499228db tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.342026 Sep 16 12:56:14.561711 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1318/2564] 10.222.0.67 () {60 vars in 1343 bytes} [Fri Sep 16 12:56:14 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8/os-volume_attachments => generated 197 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:56:14.570067 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c94edbda-3285-41a8-a2a0-9d71ac109590 tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] Action: 'create', calling method: .version_select at 0x7f10355b6dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-912256194", "description": "tempest-description-787611141"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:14.667435 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-9c4ad11b-3562-411d-9b6e-bf6005021799 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:56:14.667866 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-9c4ad11b-3562-411d-9b6e-bf6005021799 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:56:14.668379 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-9c4ad11b-3562-411d-9b6e-bf6005021799 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:56:14.668795 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-9c4ad11b-3562-411d-9b6e-bf6005021799 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:56:14.669218 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-9c4ad11b-3562-411d-9b6e-bf6005021799 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:56:14.755458 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9c4ad11b-3562-411d-9b6e-bf6005021799 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:14.772617 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9c4ad11b-3562-411d-9b6e-bf6005021799 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:14.773118 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9c4ad11b-3562-411d-9b6e-bf6005021799 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:14.775345 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9c4ad11b-3562-411d-9b6e-bf6005021799 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:14.777446 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9c4ad11b-3562-411d-9b6e-bf6005021799 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:14.779302 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9c4ad11b-3562-411d-9b6e-bf6005021799 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:14.779756 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9c4ad11b-3562-411d-9b6e-bf6005021799 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:14.974237 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9c4ad11b-3562-411d-9b6e-bf6005021799 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:14.995036 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9c4ad11b-3562-411d-9b6e-bf6005021799 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:15.008470 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9c4ad11b-3562-411d-9b6e-bf6005021799 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:15.038203 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9c4ad11b-3562-411d-9b6e-bf6005021799 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] 10.222.0.67 "POST /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b/action" status: 202 len: 1494 microversion: 2.75 time: 0.571368 Sep 16 12:56:15.042693 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1247/2565] 10.222.0.67 () {62 vars in 1319 bytes} [Fri Sep 16 12:56:14 2022] POST /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b/action => generated 1494 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 16 12:56:15.051926 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1b154a43-52c3-42d2-9c89-08985cfa0cd0 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:15.052817 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-1b154a43-52c3-42d2-9c89-08985cfa0cd0 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:15.059642 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1b154a43-52c3-42d2-9c89-08985cfa0cd0 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:15.060507 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1b154a43-52c3-42d2-9c89-08985cfa0cd0 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:15.068894 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1b154a43-52c3-42d2-9c89-08985cfa0cd0 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:15.070298 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1b154a43-52c3-42d2-9c89-08985cfa0cd0 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:15.071003 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1b154a43-52c3-42d2-9c89-08985cfa0cd0 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:15.071671 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1b154a43-52c3-42d2-9c89-08985cfa0cd0 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:15.289820 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c94edbda-3285-41a8-a2a0-9d71ac109590 tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.726881 Sep 16 12:56:15.291126 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1319/2566] 10.222.0.67 () {60 vars in 1180 bytes} [Fri Sep 16 12:56:14 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:56:15.296771 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-347dc422-8258-4617-bb1a-8608ebbbe0e1 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:15.298731 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-347dc422-8258-4617-bb1a-8608ebbbe0e1 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: e34e2be3-4e61-46dc-b4a4-5abcd3df9b85] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:15.313518 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-347dc422-8258-4617-bb1a-8608ebbbe0e1 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:15.314285 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-347dc422-8258-4617-bb1a-8608ebbbe0e1 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:15.315961 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-347dc422-8258-4617-bb1a-8608ebbbe0e1 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:15.318801 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-347dc422-8258-4617-bb1a-8608ebbbe0e1 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:15.319834 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-347dc422-8258-4617-bb1a-8608ebbbe0e1 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:15.320543 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-347dc422-8258-4617-bb1a-8608ebbbe0e1 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:15.511887 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1b154a43-52c3-42d2-9c89-08985cfa0cd0 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:15.524789 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1b154a43-52c3-42d2-9c89-08985cfa0cd0 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1503 microversion: 2.1 time: 0.480750 Sep 16 12:56:15.525396 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1248/2567] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:15 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1503 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:15.552700 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ab4c781e-5051-4f0c-be29-8db1a405f9af tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:15.553443 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ab4c781e-5051-4f0c-be29-8db1a405f9af tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:15.561187 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ab4c781e-5051-4f0c-be29-8db1a405f9af tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:15.561693 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ab4c781e-5051-4f0c-be29-8db1a405f9af tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:15.562111 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ab4c781e-5051-4f0c-be29-8db1a405f9af tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:15.562821 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ab4c781e-5051-4f0c-be29-8db1a405f9af tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:15.563266 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ab4c781e-5051-4f0c-be29-8db1a405f9af tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:15.563691 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ab4c781e-5051-4f0c-be29-8db1a405f9af tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:15.687829 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ab4c781e-5051-4f0c-be29-8db1a405f9af tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:15.711649 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ab4c781e-5051-4f0c-be29-8db1a405f9af tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:15.713379 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ab4c781e-5051-4f0c-be29-8db1a405f9af tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:15.723404 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ab4c781e-5051-4f0c-be29-8db1a405f9af tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1446 microversion: 2.75 time: 0.194921 Sep 16 12:56:15.727887 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1249/2568] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:15 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1446 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:56:15.741525 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-347dc422-8258-4617-bb1a-8608ebbbe0e1 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:15.754163 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-347dc422-8258-4617-bb1a-8608ebbbe0e1 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85" status: 200 len: 1324 microversion: 2.1 time: 0.461673 Sep 16 12:56:15.755985 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-229474b7-31e3-4c7b-8656-72b085c61162 tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] Action: 'create', calling method: .version_select at 0x7f1034aad0d0>, body: {"security_group_rule": {"parent_group_id": "6c09dd9f-65b8-4951-8cd1-48a2b97d9592", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:15.757276 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1320/2569] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:15 2022] GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 => generated 1324 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:15.768832 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2935ea65-cd29-45ce-a7ec-8cf8fa9c570c tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:15.770051 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2935ea65-cd29-45ce-a7ec-8cf8fa9c570c tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:15.789638 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2935ea65-cd29-45ce-a7ec-8cf8fa9c570c tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:15.791473 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2935ea65-cd29-45ce-a7ec-8cf8fa9c570c tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:15.792758 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2935ea65-cd29-45ce-a7ec-8cf8fa9c570c tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:15.796098 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2935ea65-cd29-45ce-a7ec-8cf8fa9c570c tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:15.796985 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2935ea65-cd29-45ce-a7ec-8cf8fa9c570c tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:15.799990 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2935ea65-cd29-45ce-a7ec-8cf8fa9c570c tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:16.244654 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2935ea65-cd29-45ce-a7ec-8cf8fa9c570c tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:16.254490 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2935ea65-cd29-45ce-a7ec-8cf8fa9c570c tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1678 microversion: 2.1 time: 0.494847 Sep 16 12:56:16.258149 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1321/2570] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:15 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1678 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:16.275841 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0a8c6def-1a58-44a5-a5ab-ce8039c1204f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:16.278142 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0a8c6def-1a58-44a5-a5ab-ce8039c1204f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:16.290391 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a8c6def-1a58-44a5-a5ab-ce8039c1204f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:16.290893 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a8c6def-1a58-44a5-a5ab-ce8039c1204f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:16.300624 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a8c6def-1a58-44a5-a5ab-ce8039c1204f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:16.303985 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a8c6def-1a58-44a5-a5ab-ce8039c1204f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:16.304810 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a8c6def-1a58-44a5-a5ab-ce8039c1204f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:16.305414 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a8c6def-1a58-44a5-a5ab-ce8039c1204f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:16.354552 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0a8c6def-1a58-44a5-a5ab-ce8039c1204f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.093830 Sep 16 12:56:16.355311 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1322/2571] 10.222.0.67 () {60 vars in 1343 bytes} [Fri Sep 16 12:56:16 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:56:16.477338 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-229474b7-31e3-4c7b-8656-72b085c61162 tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.725968 Sep 16 12:56:16.478627 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1250/2572] 10.222.0.67 () {60 vars in 1195 bytes} [Fri Sep 16 12:56:15 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:56:16.491858 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a5d6f1d1-9ccf-4c43-a584-ba234cb80a9a tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] Action: 'create', calling method: .version_select at 0x7f103571e0d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1284226551", "description": "tempest-description-284483881"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:16.551604 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-66476896-2dde-480a-8480-ff357376ce09 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:16.552856 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-66476896-2dde-480a-8480-ff357376ce09 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:16.559973 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-66476896-2dde-480a-8480-ff357376ce09 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:16.561444 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-66476896-2dde-480a-8480-ff357376ce09 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:16.562066 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-66476896-2dde-480a-8480-ff357376ce09 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:16.564529 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-66476896-2dde-480a-8480-ff357376ce09 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:16.565822 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-66476896-2dde-480a-8480-ff357376ce09 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:16.566274 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-66476896-2dde-480a-8480-ff357376ce09 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:17.228692 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-66476896-2dde-480a-8480-ff357376ce09 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:17.237973 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-66476896-2dde-480a-8480-ff357376ce09 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1503 microversion: 2.1 time: 0.693495 Sep 16 12:56:17.241387 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1251/2573] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:16 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1503 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:56:17.253442 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-39a8af4e-287c-42da-8039-a871e0277371 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:17.258612 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-39a8af4e-287c-42da-8039-a871e0277371 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:17.276594 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-39a8af4e-287c-42da-8039-a871e0277371 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:17.277506 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-39a8af4e-287c-42da-8039-a871e0277371 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:17.281339 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-39a8af4e-287c-42da-8039-a871e0277371 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:17.282539 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-39a8af4e-287c-42da-8039-a871e0277371 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:17.283781 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-39a8af4e-287c-42da-8039-a871e0277371 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:17.284498 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-39a8af4e-287c-42da-8039-a871e0277371 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:17.304146 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a5d6f1d1-9ccf-4c43-a584-ba234cb80a9a tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.816318 Sep 16 12:56:17.304882 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1323/2574] 10.222.0.67 () {60 vars in 1180 bytes} [Fri Sep 16 12:56:16 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:56:17.309860 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8cdece57-fe8b-4db4-9702-08ba6ffcc69b tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:17.310772 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8cdece57-fe8b-4db4-9702-08ba6ffcc69b tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: e34e2be3-4e61-46dc-b4a4-5abcd3df9b85] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:17.330075 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cdece57-fe8b-4db4-9702-08ba6ffcc69b tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:17.331423 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cdece57-fe8b-4db4-9702-08ba6ffcc69b tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:17.332412 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cdece57-fe8b-4db4-9702-08ba6ffcc69b tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:17.333521 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cdece57-fe8b-4db4-9702-08ba6ffcc69b tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:17.337462 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cdece57-fe8b-4db4-9702-08ba6ffcc69b tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:17.338733 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cdece57-fe8b-4db4-9702-08ba6ffcc69b tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:17.422331 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-39a8af4e-287c-42da-8039-a871e0277371 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:17.433496 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-39a8af4e-287c-42da-8039-a871e0277371 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:17.434990 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-39a8af4e-287c-42da-8039-a871e0277371 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:17.441822 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-39a8af4e-287c-42da-8039-a871e0277371 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1446 microversion: 2.75 time: 0.198542 Sep 16 12:56:17.443031 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1252/2575] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:17 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1446 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:56:17.448246 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-079bbd43-bcaf-4f2c-819f-2d78dae47e52 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:17.449401 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-079bbd43-bcaf-4f2c-819f-2d78dae47e52 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:17.456391 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-079bbd43-bcaf-4f2c-819f-2d78dae47e52 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:17.457144 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-079bbd43-bcaf-4f2c-819f-2d78dae47e52 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:17.457764 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-079bbd43-bcaf-4f2c-819f-2d78dae47e52 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:17.458897 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-079bbd43-bcaf-4f2c-819f-2d78dae47e52 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:17.459643 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-079bbd43-bcaf-4f2c-819f-2d78dae47e52 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:17.460294 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-079bbd43-bcaf-4f2c-819f-2d78dae47e52 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:17.680784 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8cdece57-fe8b-4db4-9702-08ba6ffcc69b tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:17.689041 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-079bbd43-bcaf-4f2c-819f-2d78dae47e52 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:17.690777 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8cdece57-fe8b-4db4-9702-08ba6ffcc69b tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85" status: 200 len: 1324 microversion: 2.1 time: 0.384192 Sep 16 12:56:17.698856 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-079bbd43-bcaf-4f2c-819f-2d78dae47e52 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1678 microversion: 2.1 time: 0.254546 Sep 16 12:56:17.704060 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1324/2576] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:17 2022] GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 => generated 1324 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:17.710215 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a894e454-c8b3-482d-8026-7028ac1acd2e tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] Action: 'create', calling method: .version_select at 0x7f103566a820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1196124169", "description": "tempest-description-1628995522"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:17.714442 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1253/2577] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:17 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1678 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:17.718241 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:56:17.724222 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-21da1bff-b8d6-4df9-8033-56166e6aa1c4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:17.726616 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-21da1bff-b8d6-4df9-8033-56166e6aa1c4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:17.754098 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-21da1bff-b8d6-4df9-8033-56166e6aa1c4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:17.754606 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-21da1bff-b8d6-4df9-8033-56166e6aa1c4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:17.756252 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-21da1bff-b8d6-4df9-8033-56166e6aa1c4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:17.757185 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-21da1bff-b8d6-4df9-8033-56166e6aa1c4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:17.759613 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-21da1bff-b8d6-4df9-8033-56166e6aa1c4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:17.760066 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-21da1bff-b8d6-4df9-8033-56166e6aa1c4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:17.832928 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-21da1bff-b8d6-4df9-8033-56166e6aa1c4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.116162 Sep 16 12:56:17.840442 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1254/2578] 10.222.0.67 () {60 vars in 1343 bytes} [Fri Sep 16 12:56:17 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:56:17.938870 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a894e454-c8b3-482d-8026-7028ac1acd2e tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.231966 Sep 16 12:56:17.941658 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1325/2579] 10.222.0.67 () {60 vars in 1180 bytes} [Fri Sep 16 12:56:17 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:56:17.955386 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-47ddde73-3e34-4abd-a627-e62921283535 tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] Action: 'create', calling method: .version_select at 0x7f1034ad20d0>, body: {"security_group_rule": {"parent_group_id": "5d5f9fcc-b4ac-4788-8041-256368431020", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "ba7477f8-b48a-4777-aba3-72412456636f"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:18.271267 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0c9e644b-c0ef-45c6-bd04-9a2fea86a3e1 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:18.272059 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0c9e644b-c0ef-45c6-bd04-9a2fea86a3e1 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:18.286408 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c9e644b-c0ef-45c6-bd04-9a2fea86a3e1 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:18.287023 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c9e644b-c0ef-45c6-bd04-9a2fea86a3e1 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:18.287575 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c9e644b-c0ef-45c6-bd04-9a2fea86a3e1 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:18.290259 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c9e644b-c0ef-45c6-bd04-9a2fea86a3e1 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:18.293366 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c9e644b-c0ef-45c6-bd04-9a2fea86a3e1 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:18.294419 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c9e644b-c0ef-45c6-bd04-9a2fea86a3e1 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:18.349236 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-47ddde73-3e34-4abd-a627-e62921283535 tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.398033 Sep 16 12:56:18.350333 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1255/2580] 10.222.0.67 () {60 vars in 1195 bytes} [Fri Sep 16 12:56:17 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:56:18.369879 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1275f142-894f-42d1-b55f-da590119ee4e tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] Action: 'create', calling method: .version_select at 0x7f1034b57550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1020473047", "description": "tempest-description-1188703096"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:18.497675 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=18 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:56:18.634309 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0c9e644b-c0ef-45c6-bd04-9a2fea86a3e1 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:18.654109 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0c9e644b-c0ef-45c6-bd04-9a2fea86a3e1 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1503 microversion: 2.1 time: 0.388867 Sep 16 12:56:18.655986 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1326/2581] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:18 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1503 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:56:18.675439 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2a03bba7-4d9c-40d8-a52a-095d26852c29 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:18.676099 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2a03bba7-4d9c-40d8-a52a-095d26852c29 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:18.697060 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a03bba7-4d9c-40d8-a52a-095d26852c29 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:18.697564 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a03bba7-4d9c-40d8-a52a-095d26852c29 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:18.700402 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a03bba7-4d9c-40d8-a52a-095d26852c29 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:18.701255 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a03bba7-4d9c-40d8-a52a-095d26852c29 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:18.701735 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a03bba7-4d9c-40d8-a52a-095d26852c29 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:18.702176 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a03bba7-4d9c-40d8-a52a-095d26852c29 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:18.765713 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1275f142-894f-42d1-b55f-da590119ee4e tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.402429 Sep 16 12:56:18.778618 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1256/2582] 10.222.0.67 () {60 vars in 1180 bytes} [Fri Sep 16 12:56:18 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:56:18.786462 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8d09f59f-5eb6-4e5f-b9f6-74fdf7facbec tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:18.787204 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8d09f59f-5eb6-4e5f-b9f6-74fdf7facbec tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:18.804319 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8d09f59f-5eb6-4e5f-b9f6-74fdf7facbec tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:18.808700 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8d09f59f-5eb6-4e5f-b9f6-74fdf7facbec tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:18.809440 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8d09f59f-5eb6-4e5f-b9f6-74fdf7facbec tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:18.810717 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8d09f59f-5eb6-4e5f-b9f6-74fdf7facbec tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:18.811407 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8d09f59f-5eb6-4e5f-b9f6-74fdf7facbec tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:18.812082 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8d09f59f-5eb6-4e5f-b9f6-74fdf7facbec tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:18.817949 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:56:18.855157 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2a03bba7-4d9c-40d8-a52a-095d26852c29 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:18.865321 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2a03bba7-4d9c-40d8-a52a-095d26852c29 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:18.866793 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2a03bba7-4d9c-40d8-a52a-095d26852c29 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:18.885807 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2a03bba7-4d9c-40d8-a52a-095d26852c29 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1446 microversion: 2.75 time: 0.225530 Sep 16 12:56:18.886638 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1327/2583] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:18 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1446 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:56:18.905608 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9f650ffe-ceff-4441-b81f-5c1a2b83dbfd tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:18.906244 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9f650ffe-ceff-4441-b81f-5c1a2b83dbfd tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: e34e2be3-4e61-46dc-b4a4-5abcd3df9b85] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:18.921019 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f650ffe-ceff-4441-b81f-5c1a2b83dbfd tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:18.922616 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f650ffe-ceff-4441-b81f-5c1a2b83dbfd tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:18.926516 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f650ffe-ceff-4441-b81f-5c1a2b83dbfd tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:18.927485 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f650ffe-ceff-4441-b81f-5c1a2b83dbfd tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:18.930260 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f650ffe-ceff-4441-b81f-5c1a2b83dbfd tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:18.930839 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f650ffe-ceff-4441-b81f-5c1a2b83dbfd tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:19.009739 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8d09f59f-5eb6-4e5f-b9f6-74fdf7facbec tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:19.019249 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8d09f59f-5eb6-4e5f-b9f6-74fdf7facbec tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1678 microversion: 2.1 time: 0.237355 Sep 16 12:56:19.019842 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1257/2584] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:18 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1678 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:19.025439 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7d384e7e-e6da-4eac-8565-960f5b9353a7 tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] Action: 'create', calling method: .version_select at 0x7f1034b47b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2129791894", "description": "tempest-description-715153541"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:19.210387 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9f650ffe-ceff-4441-b81f-5c1a2b83dbfd tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:19.226966 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9f650ffe-ceff-4441-b81f-5c1a2b83dbfd tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85" status: 200 len: 1324 microversion: 2.1 time: 0.337927 Sep 16 12:56:19.244039 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1328/2585] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:18 2022] GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 => generated 1324 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:19.250076 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e8cde717-f204-46e6-8765-d91d06ee271d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:19.252698 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e8cde717-f204-46e6-8765-d91d06ee271d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:19.260935 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:56:19.263903 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8cde717-f204-46e6-8765-d91d06ee271d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:19.264457 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8cde717-f204-46e6-8765-d91d06ee271d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:19.264903 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8cde717-f204-46e6-8765-d91d06ee271d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:19.266145 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8cde717-f204-46e6-8765-d91d06ee271d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:19.266631 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8cde717-f204-46e6-8765-d91d06ee271d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:19.267740 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8cde717-f204-46e6-8765-d91d06ee271d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:19.313906 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e8cde717-f204-46e6-8765-d91d06ee271d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.068555 Sep 16 12:56:19.315649 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1329/2586] 10.222.0.67 () {60 vars in 1343 bytes} [Fri Sep 16 12:56:19 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:56:19.366156 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7d384e7e-e6da-4eac-8565-960f5b9353a7 tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.344298 Sep 16 12:56:19.369020 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1258/2587] 10.222.0.67 () {60 vars in 1180 bytes} [Fri Sep 16 12:56:19 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:56:19.383131 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-827abfd4-1254-44a9-a14f-cc3b50b6b99d tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] Action: 'create', calling method: .version_select at 0x7f1035713ee0>, body: {"security_group_rule": {"parent_group_id": "1c5a6aa9-15ec-462c-abe3-422f9c49376a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "1dfaee71-99d9-4261-b172-f4328f5f4b27"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:19.703228 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-827abfd4-1254-44a9-a14f-cc3b50b6b99d tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.323884 Sep 16 12:56:19.704873 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1330/2588] 10.222.0.67 () {60 vars in 1195 bytes} [Fri Sep 16 12:56:19 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:56:19.705363 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c27426f4-c2e4-44a9-ad61-def0d9bd03ef tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:19.707359 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c27426f4-c2e4-44a9-ad61-def0d9bd03ef tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:19.720034 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f182e7c9-3cd1-4d19-b207-60bd2c6b6970 tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] Calling method '.version_select at 0x7f10351583a0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:19.736644 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c27426f4-c2e4-44a9-ad61-def0d9bd03ef tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:19.739284 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c27426f4-c2e4-44a9-ad61-def0d9bd03ef tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:19.741253 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c27426f4-c2e4-44a9-ad61-def0d9bd03ef tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:19.742213 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c27426f4-c2e4-44a9-ad61-def0d9bd03ef tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:19.742918 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c27426f4-c2e4-44a9-ad61-def0d9bd03ef tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:19.743438 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c27426f4-c2e4-44a9-ad61-def0d9bd03ef tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:19.963310 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c27426f4-c2e4-44a9-ad61-def0d9bd03ef tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:19.979513 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c27426f4-c2e4-44a9-ad61-def0d9bd03ef tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1503 microversion: 2.1 time: 0.299817 Sep 16 12:56:19.981668 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1259/2589] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:19 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1503 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:19.987954 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-7ec873d2-d61a-41de-969e-8204ee4647b6 req-8901561e-8835-4ac9-909e-513d22bb9700 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e34e2be3-4e61-46dc-b4a4-5abcd3df9b85", "name": "network-vif-plugged", "status": "completed", "tag": "27d81681-82f2-4f23-8f72-9075e99f9ca1"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:20.001158 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-7ec873d2-d61a-41de-969e-8204ee4647b6 req-8901561e-8835-4ac9-909e-513d22bb9700 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:20.002598 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-7ec873d2-d61a-41de-969e-8204ee4647b6 req-8901561e-8835-4ac9-909e-513d22bb9700 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:20.004160 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-7ec873d2-d61a-41de-969e-8204ee4647b6 req-8901561e-8835-4ac9-909e-513d22bb9700 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:20.021576 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-7ec873d2-d61a-41de-969e-8204ee4647b6 req-8901561e-8835-4ac9-909e-513d22bb9700 service nova] Creating event network-vif-plugged:27d81681-82f2-4f23-8f72-9075e99f9ca1 for instance e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 on n-h2-858094-4 Sep 16 12:56:20.028997 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-7ec873d2-d61a-41de-969e-8204ee4647b6 req-8901561e-8835-4ac9-909e-513d22bb9700 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045752 Sep 16 12:56:20.029924 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1260/2590] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:56:20.038705 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3d905e01-0087-4425-b996-e843876c6648 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:20.039808 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3d905e01-0087-4425-b996-e843876c6648 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:20.047546 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3d905e01-0087-4425-b996-e843876c6648 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:20.048221 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3d905e01-0087-4425-b996-e843876c6648 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:20.048942 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3d905e01-0087-4425-b996-e843876c6648 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:20.049647 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3d905e01-0087-4425-b996-e843876c6648 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:20.050096 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3d905e01-0087-4425-b996-e843876c6648 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:20.050522 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3d905e01-0087-4425-b996-e843876c6648 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:20.147536 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f182e7c9-3cd1-4d19-b207-60bd2c6b6970 tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/1dfaee71-99d9-4261-b172-f4328f5f4b27" status: 202 len: 0 microversion: 2.1 time: 0.433592 Sep 16 12:56:20.152194 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1331/2591] 10.222.0.67 () {58 vars in 1272 bytes} [Fri Sep 16 12:56:19 2022] DELETE /compute/v2.1/os-security-groups/1dfaee71-99d9-4261-b172-f4328f5f4b27 => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:56:20.160149 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-524a2681-8b08-488a-9485-1cb5f5febaf2 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:20.161262 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-524a2681-8b08-488a-9485-1cb5f5febaf2 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:20.169248 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-524a2681-8b08-488a-9485-1cb5f5febaf2 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:20.169974 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-524a2681-8b08-488a-9485-1cb5f5febaf2 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:20.170572 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-524a2681-8b08-488a-9485-1cb5f5febaf2 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:20.171476 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-524a2681-8b08-488a-9485-1cb5f5febaf2 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:20.172094 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-524a2681-8b08-488a-9485-1cb5f5febaf2 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:20.172775 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-524a2681-8b08-488a-9485-1cb5f5febaf2 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:20.218460 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3d905e01-0087-4425-b996-e843876c6648 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:20.228970 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3d905e01-0087-4425-b996-e843876c6648 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:20.237691 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3d905e01-0087-4425-b996-e843876c6648 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:20.246601 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3d905e01-0087-4425-b996-e843876c6648 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1446 microversion: 2.75 time: 0.215087 Sep 16 12:56:20.250380 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1261/2592] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:20 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1446 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:56:20.258073 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d807973b-d7c6-4945-b6a4-f5bc633cba46 tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] Calling method '.version_select at 0x7f1034a8bee0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:20.372889 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d807973b-d7c6-4945-b6a4-f5bc633cba46 tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] 10.222.0.67 "GET /compute/v2.1/os-security-groups/1c5a6aa9-15ec-462c-abe3-422f9c49376a" status: 200 len: 248 microversion: 2.1 time: 0.121424 Sep 16 12:56:20.373544 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1262/2593] 10.222.0.67 () {58 vars in 1269 bytes} [Fri Sep 16 12:56:20 2022] GET /compute/v2.1/os-security-groups/1c5a6aa9-15ec-462c-abe3-422f9c49376a => generated 248 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:56:20.379670 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f4ce4b74-bfdd-4e9a-aa44-0076170bee33 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:20.381268 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f4ce4b74-bfdd-4e9a-aa44-0076170bee33 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: e34e2be3-4e61-46dc-b4a4-5abcd3df9b85] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:20.389419 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f4ce4b74-bfdd-4e9a-aa44-0076170bee33 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:20.390017 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f4ce4b74-bfdd-4e9a-aa44-0076170bee33 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:20.390696 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f4ce4b74-bfdd-4e9a-aa44-0076170bee33 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:20.391481 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f4ce4b74-bfdd-4e9a-aa44-0076170bee33 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:20.392012 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f4ce4b74-bfdd-4e9a-aa44-0076170bee33 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:20.392912 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f4ce4b74-bfdd-4e9a-aa44-0076170bee33 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:20.400987 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-524a2681-8b08-488a-9485-1cb5f5febaf2 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:20.410367 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-524a2681-8b08-488a-9485-1cb5f5febaf2 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1678 microversion: 2.1 time: 0.256811 Sep 16 12:56:20.411337 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1332/2594] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:20 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1678 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:20.415962 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ab9f01bd-6f98-4893-8221-608f9a9993b7 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:20.418446 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ab9f01bd-6f98-4893-8221-608f9a9993b7 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:20.437887 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab9f01bd-6f98-4893-8221-608f9a9993b7 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:20.438880 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab9f01bd-6f98-4893-8221-608f9a9993b7 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:20.439465 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab9f01bd-6f98-4893-8221-608f9a9993b7 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:20.440447 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab9f01bd-6f98-4893-8221-608f9a9993b7 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:20.441228 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab9f01bd-6f98-4893-8221-608f9a9993b7 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:20.442175 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab9f01bd-6f98-4893-8221-608f9a9993b7 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:20.481181 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ab9f01bd-6f98-4893-8221-608f9a9993b7 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.068722 Sep 16 12:56:20.481662 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1333/2595] 10.222.0.67 () {60 vars in 1343 bytes} [Fri Sep 16 12:56:20 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:20.554360 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0778e340-4d38-4a16-b7d9-d95e5070c136 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1138476459", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": [{"uuid": "08c67a85-cfb4-48c8-9887-60108b3f59b5"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:20.622827 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f4ce4b74-bfdd-4e9a-aa44-0076170bee33 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:20.623017 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-0778e340-4d38-4a16-b7d9-d95e5070c136 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] validate_networks() for [('08c67a85-cfb4-48c8-9887-60108b3f59b5', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:56:20.631852 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f4ce4b74-bfdd-4e9a-aa44-0076170bee33 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85" status: 200 len: 1324 microversion: 2.1 time: 0.257020 Sep 16 12:56:20.632880 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1263/2596] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:20 2022] GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 => generated 1324 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:20.637849 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-36f1b28f-f137-4992-a144-2a6785fe0024 tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] Action: 'create', calling method: .version_select at 0x7f1034a88670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1945574747", "description": "tempest-description-1715146305"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:20.971724 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-36f1b28f-f137-4992-a144-2a6785fe0024 tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.337775 Sep 16 12:56:20.980875 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1264/2597] 10.222.0.67 () {60 vars in 1180 bytes} [Fri Sep 16 12:56:20 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:56:20.986964 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9275d998-40a9-4647-9bcd-47176102c6e4 tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] Action: 'create', calling method: .version_select at 0x7f103574e0d0>, body: {"security_group_rule": {"parent_group_id": "552886f2-48b3-487f-8e1f-559ddf4cc5a5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:21.384044 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-0778e340-4d38-4a16-b7d9-d95e5070c136 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:56:21.386464 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-0778e340-4d38-4a16-b7d9-d95e5070c136 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:56:21.387228 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-0778e340-4d38-4a16-b7d9-d95e5070c136 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:56:21.387826 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-0778e340-4d38-4a16-b7d9-d95e5070c136 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:56:21.388999 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-0778e340-4d38-4a16-b7d9-d95e5070c136 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:56:21.410061 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0778e340-4d38-4a16-b7d9-d95e5070c136 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:21.411067 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0778e340-4d38-4a16-b7d9-d95e5070c136 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:21.412247 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0778e340-4d38-4a16-b7d9-d95e5070c136 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:21.413866 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0778e340-4d38-4a16-b7d9-d95e5070c136 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:21.414437 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0778e340-4d38-4a16-b7d9-d95e5070c136 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:21.414971 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0778e340-4d38-4a16-b7d9-d95e5070c136 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:21.452499 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9275d998-40a9-4647-9bcd-47176102c6e4 tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.470013 Sep 16 12:56:21.453115 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1265/2598] 10.222.0.67 () {60 vars in 1195 bytes} [Fri Sep 16 12:56:20 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:56:21.459062 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9470ac20-c0dc-4c77-8ae2-a0d8f32e1c6b tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:21.461240 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9470ac20-c0dc-4c77-8ae2-a0d8f32e1c6b tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:21.464611 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-0778e340-4d38-4a16-b7d9-d95e5070c136 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Getting quotas for project 763b15912eb44f848a81f813e359e8aa. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:56:21.471483 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9470ac20-c0dc-4c77-8ae2-a0d8f32e1c6b tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:21.471702 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-0778e340-4d38-4a16-b7d9-d95e5070c136 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Getting quotas for user 02b1b8cac30242c0b4e2ea4188709ec7 and project 763b15912eb44f848a81f813e359e8aa. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:56:21.471992 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9470ac20-c0dc-4c77-8ae2-a0d8f32e1c6b tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:21.472481 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9470ac20-c0dc-4c77-8ae2-a0d8f32e1c6b tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:21.473184 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9470ac20-c0dc-4c77-8ae2-a0d8f32e1c6b tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:21.473643 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9470ac20-c0dc-4c77-8ae2-a0d8f32e1c6b tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:21.474062 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9470ac20-c0dc-4c77-8ae2-a0d8f32e1c6b tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:21.488333 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0778e340-4d38-4a16-b7d9-d95e5070c136 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:56:21.491173 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0778e340-4d38-4a16-b7d9-d95e5070c136 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] [instance: e57d695e-a816-47e1-9ee9-595425bb9b2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:56:21.574103 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0778e340-4d38-4a16-b7d9-d95e5070c136 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.085636 Sep 16 12:56:21.574673 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1334/2599] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:56:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:56:21.582301 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7dcb0389-9045-44ce-93e4-36d7582ca3f4 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:21.584862 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7dcb0389-9045-44ce-93e4-36d7582ca3f4 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:21.594486 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7dcb0389-9045-44ce-93e4-36d7582ca3f4 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:21.595177 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7dcb0389-9045-44ce-93e4-36d7582ca3f4 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:21.596582 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7dcb0389-9045-44ce-93e4-36d7582ca3f4 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:21.597514 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7dcb0389-9045-44ce-93e4-36d7582ca3f4 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:21.598318 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7dcb0389-9045-44ce-93e4-36d7582ca3f4 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:21.598885 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7dcb0389-9045-44ce-93e4-36d7582ca3f4 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:21.716018 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7dcb0389-9045-44ce-93e4-36d7582ca3f4 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:21.739612 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7dcb0389-9045-44ce-93e4-36d7582ca3f4 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:21.742927 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7dcb0389-9045-44ce-93e4-36d7582ca3f4 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:21.748664 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9470ac20-c0dc-4c77-8ae2-a0d8f32e1c6b tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:21.751705 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7dcb0389-9045-44ce-93e4-36d7582ca3f4 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1446 microversion: 2.75 time: 0.174403 Sep 16 12:56:21.765143 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1335/2600] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:21 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1446 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:56:21.765143 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4f6fbab1-bbbe-48ec-a4b0-ede85f5d5a79 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:21.765143 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4f6fbab1-bbbe-48ec-a4b0-ede85f5d5a79 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:21.765452 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9470ac20-c0dc-4c77-8ae2-a0d8f32e1c6b tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1503 microversion: 2.1 time: 0.306872 Sep 16 12:56:21.765452 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1266/2601] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:21 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1503 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:21.766570 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-58d09c46-94e9-4b0c-aca0-77055d4529c2 tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] Action: 'create', calling method: .version_select at 0x7f1034a885e0>, body: {"security_group_rule": {"parent_group_id": "552886f2-48b3-487f-8e1f-559ddf4cc5a5", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:21.772213 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f6fbab1-bbbe-48ec-a4b0-ede85f5d5a79 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:21.775687 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f6fbab1-bbbe-48ec-a4b0-ede85f5d5a79 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:21.781985 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f6fbab1-bbbe-48ec-a4b0-ede85f5d5a79 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:21.782803 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f6fbab1-bbbe-48ec-a4b0-ede85f5d5a79 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:21.783759 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f6fbab1-bbbe-48ec-a4b0-ede85f5d5a79 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:21.784244 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f6fbab1-bbbe-48ec-a4b0-ede85f5d5a79 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:21.797806 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:56:22.035780 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4f6fbab1-bbbe-48ec-a4b0-ede85f5d5a79 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:22.050811 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4f6fbab1-bbbe-48ec-a4b0-ede85f5d5a79 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1678 microversion: 2.1 time: 0.296401 Sep 16 12:56:22.051741 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1336/2602] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:21 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1678 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:22.076712 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7fd563ee-96a8-46a9-8b9d-8578da472a1e tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:22.077454 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7fd563ee-96a8-46a9-8b9d-8578da472a1e tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] [instance: e57d695e-a816-47e1-9ee9-595425bb9b2d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:22.178384 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7fd563ee-96a8-46a9-8b9d-8578da472a1e tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b1b8cac30242c0b4e2ea4188709ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763b15912eb44f848a81f813e359e8aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:22.197685 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7fd563ee-96a8-46a9-8b9d-8578da472a1e tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] 10.222.0.67 "GET /compute/v2.1/servers/e57d695e-a816-47e1-9ee9-595425bb9b2d" status: 200 len: 1225 microversion: 2.1 time: 0.137676 Sep 16 12:56:22.199424 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1337/2603] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:22 2022] GET /compute/v2.1/servers/e57d695e-a816-47e1-9ee9-595425bb9b2d => generated 1225 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:22.213262 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6ea04725-4058-4d16-bb72-8b9ceef8c08f tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:22.216283 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6ea04725-4058-4d16-bb72-8b9ceef8c08f tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: e34e2be3-4e61-46dc-b4a4-5abcd3df9b85] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:22.238878 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ea04725-4058-4d16-bb72-8b9ceef8c08f tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:22.239846 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ea04725-4058-4d16-bb72-8b9ceef8c08f tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:22.242408 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ea04725-4058-4d16-bb72-8b9ceef8c08f tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:22.243775 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ea04725-4058-4d16-bb72-8b9ceef8c08f tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:22.245313 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ea04725-4058-4d16-bb72-8b9ceef8c08f tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:22.246245 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ea04725-4058-4d16-bb72-8b9ceef8c08f tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:22.292763 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-58d09c46-94e9-4b0c-aca0-77055d4529c2 tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.529684 Sep 16 12:56:22.293379 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1267/2604] 10.222.0.67 () {60 vars in 1195 bytes} [Fri Sep 16 12:56:21 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:56:22.305602 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d76895cb-a029-4ab6-831b-8ea1368dd6f3 tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] Calling method '.version_select at 0x7f1034b571f0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:22.460044 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d76895cb-a029-4ab6-831b-8ea1368dd6f3 tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] 10.222.0.67 "GET /compute/v2.1/os-security-groups/552886f2-48b3-487f-8e1f-559ddf4cc5a5" status: 200 len: 665 microversion: 2.1 time: 0.158176 Sep 16 12:56:22.468195 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1268/2605] 10.222.0.67 () {58 vars in 1269 bytes} [Fri Sep 16 12:56:22 2022] GET /compute/v2.1/os-security-groups/552886f2-48b3-487f-8e1f-559ddf4cc5a5 => generated 665 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:56:22.487259 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-132a60a3-9529-47cd-bcc6-72fb968dc3d0 tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] Calling method '.version_select at 0x7f1034b47700>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:22.570199 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6ea04725-4058-4d16-bb72-8b9ceef8c08f tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:22.585403 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6ea04725-4058-4d16-bb72-8b9ceef8c08f tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85" status: 200 len: 1521 microversion: 2.1 time: 0.381091 Sep 16 12:56:22.586431 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1338/2606] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:22 2022] GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 => generated 1521 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:22.622614 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-80d85a67-fce9-40b5-a54c-a1c5e0ab7d52 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:22.623608 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-80d85a67-fce9-40b5-a54c-a1c5e0ab7d52 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: e34e2be3-4e61-46dc-b4a4-5abcd3df9b85] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:22.635839 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80d85a67-fce9-40b5-a54c-a1c5e0ab7d52 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:22.636834 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80d85a67-fce9-40b5-a54c-a1c5e0ab7d52 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:22.637597 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80d85a67-fce9-40b5-a54c-a1c5e0ab7d52 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:22.638718 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80d85a67-fce9-40b5-a54c-a1c5e0ab7d52 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:22.639375 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80d85a67-fce9-40b5-a54c-a1c5e0ab7d52 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:22.640000 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80d85a67-fce9-40b5-a54c-a1c5e0ab7d52 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:22.826692 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-132a60a3-9529-47cd-bcc6-72fb968dc3d0 tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-group-rules/f2bcd605-ec15-46e3-9649-0da078d6c1a7" status: 202 len: 0 microversion: 2.1 time: 0.354038 Sep 16 12:56:22.827900 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1269/2607] 10.222.0.67 () {58 vars in 1287 bytes} [Fri Sep 16 12:56:22 2022] DELETE /compute/v2.1/os-security-group-rules/f2bcd605-ec15-46e3-9649-0da078d6c1a7 => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:56:22.835624 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-bedcab57-4b3f-47da-9b67-e9acf6675333 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:22.836655 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-bedcab57-4b3f-47da-9b67-e9acf6675333 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:22.865575 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bedcab57-4b3f-47da-9b67-e9acf6675333 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:22.869455 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bedcab57-4b3f-47da-9b67-e9acf6675333 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:22.870821 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bedcab57-4b3f-47da-9b67-e9acf6675333 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:22.873286 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bedcab57-4b3f-47da-9b67-e9acf6675333 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:22.874026 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bedcab57-4b3f-47da-9b67-e9acf6675333 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:22.874643 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bedcab57-4b3f-47da-9b67-e9acf6675333 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:22.922120 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-80d85a67-fce9-40b5-a54c-a1c5e0ab7d52 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:22.935893 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-80d85a67-fce9-40b5-a54c-a1c5e0ab7d52 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85" status: 200 len: 1521 microversion: 2.1 time: 0.318642 Sep 16 12:56:22.936832 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1339/2608] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:22 2022] GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:22.943889 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c6361798-aa30-4345-a778-5fd85285fc7e tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:22.946773 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c6361798-aa30-4345-a778-5fd85285fc7e tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:22.953414 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6361798-aa30-4345-a778-5fd85285fc7e tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:22.953909 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6361798-aa30-4345-a778-5fd85285fc7e tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:22.954524 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6361798-aa30-4345-a778-5fd85285fc7e tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:22.955782 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6361798-aa30-4345-a778-5fd85285fc7e tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:22.957531 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6361798-aa30-4345-a778-5fd85285fc7e tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:22.958165 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6361798-aa30-4345-a778-5fd85285fc7e tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:23.052428 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-bedcab57-4b3f-47da-9b67-e9acf6675333 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:23.063593 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-bedcab57-4b3f-47da-9b67-e9acf6675333 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:23.065721 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-bedcab57-4b3f-47da-9b67-e9acf6675333 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:23.074782 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-bedcab57-4b3f-47da-9b67-e9acf6675333 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1446 microversion: 2.75 time: 0.243058 Sep 16 12:56:23.075604 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1270/2609] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:22 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1446 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:56:23.081578 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-97cd4290-fff5-44ac-9b3c-b86ca1bc79d6 tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] Calling method '.version_select at 0x7f1034aad670>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:23.219892 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c6361798-aa30-4345-a778-5fd85285fc7e tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:23.231637 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c6361798-aa30-4345-a778-5fd85285fc7e tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1503 microversion: 2.1 time: 0.293654 Sep 16 12:56:23.245690 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1340/2610] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:22 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1503 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:23.263147 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-762a8d98-9a9d-4f6d-8e33-25f2bdcc28f9 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1928292227"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:23.266516 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-762a8d98-9a9d-4f6d-8e33-25f2bdcc28f9 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: e34e2be3-4e61-46dc-b4a4-5abcd3df9b85] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:23.287070 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-762a8d98-9a9d-4f6d-8e33-25f2bdcc28f9 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:23.287589 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-762a8d98-9a9d-4f6d-8e33-25f2bdcc28f9 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:23.288028 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-762a8d98-9a9d-4f6d-8e33-25f2bdcc28f9 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:23.288816 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-762a8d98-9a9d-4f6d-8e33-25f2bdcc28f9 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:23.290042 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-762a8d98-9a9d-4f6d-8e33-25f2bdcc28f9 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:23.290820 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-762a8d98-9a9d-4f6d-8e33-25f2bdcc28f9 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:23.452929 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-97cd4290-fff5-44ac-9b3c-b86ca1bc79d6 tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/552886f2-48b3-487f-8e1f-559ddf4cc5a5" status: 202 len: 0 microversion: 2.1 time: 0.375795 Sep 16 12:56:23.453556 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1271/2611] 10.222.0.67 () {58 vars in 1272 bytes} [Fri Sep 16 12:56:23 2022] DELETE /compute/v2.1/os-security-groups/552886f2-48b3-487f-8e1f-559ddf4cc5a5 => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:56:23.460926 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d8c5d391-bf53-4e8c-83d8-c9c4b31a0117 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:23.461517 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d8c5d391-bf53-4e8c-83d8-c9c4b31a0117 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:23.486754 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d8c5d391-bf53-4e8c-83d8-c9c4b31a0117 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:23.489648 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d8c5d391-bf53-4e8c-83d8-c9c4b31a0117 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:23.490465 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d8c5d391-bf53-4e8c-83d8-c9c4b31a0117 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:23.491474 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d8c5d391-bf53-4e8c-83d8-c9c4b31a0117 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:23.492249 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d8c5d391-bf53-4e8c-83d8-c9c4b31a0117 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:23.493181 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d8c5d391-bf53-4e8c-83d8-c9c4b31a0117 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:23.707133 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-762a8d98-9a9d-4f6d-8e33-25f2bdcc28f9 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "POST /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85/action" status: 202 len: 0 microversion: 2.1 time: 0.458939 Sep 16 12:56:23.708933 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1341/2612] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:56:23 2022] POST /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 16 12:56:23.715438 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-aaf851b8-195d-4a89-89ed-a4d13da33961 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:23.717794 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-aaf851b8-195d-4a89-89ed-a4d13da33961 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] [instance: e57d695e-a816-47e1-9ee9-595425bb9b2d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:23.729964 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aaf851b8-195d-4a89-89ed-a4d13da33961 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:23.730728 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aaf851b8-195d-4a89-89ed-a4d13da33961 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:23.731378 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aaf851b8-195d-4a89-89ed-a4d13da33961 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:23.732499 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aaf851b8-195d-4a89-89ed-a4d13da33961 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:23.733204 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aaf851b8-195d-4a89-89ed-a4d13da33961 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:23.734268 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aaf851b8-195d-4a89-89ed-a4d13da33961 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:23.848745 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d8c5d391-bf53-4e8c-83d8-c9c4b31a0117 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:23.863466 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d8c5d391-bf53-4e8c-83d8-c9c4b31a0117 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1678 microversion: 2.1 time: 0.408081 Sep 16 12:56:23.877811 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1272/2613] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:23 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1678 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:23.891170 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-55e8b06a-8cb1-4704-88e7-bb3ba9a16c93 tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] Calling method '.version_select at 0x7f1034aad160>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:23.894130 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-aaf851b8-195d-4a89-89ed-a4d13da33961 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b1b8cac30242c0b4e2ea4188709ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763b15912eb44f848a81f813e359e8aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:23.902333 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-aaf851b8-195d-4a89-89ed-a4d13da33961 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] 10.222.0.67 "GET /compute/v2.1/servers/e57d695e-a816-47e1-9ee9-595425bb9b2d" status: 200 len: 1295 microversion: 2.1 time: 0.191351 Sep 16 12:56:23.903203 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1342/2614] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:23 2022] GET /compute/v2.1/servers/e57d695e-a816-47e1-9ee9-595425bb9b2d => generated 1295 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:23.908015 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-aedfac6d-ee4c-4dd7-b36c-fd2d40716b07 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '.version_select at 0x7f103526eca0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:23.942807 n-d-858094-4 devstack@n-api.service[128780]: DEBUG neutronclient.v2_0.client [None req-55e8b06a-8cb1-4704-88e7-bb3ba9a16c93 tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1dfaee71-99d9-4261-b172-f4328f5f4b27 does not exist", "detail": ""}} {{(pid=128780) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 12:56:23.943700 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.security_group_api [None req-55e8b06a-8cb1-4704-88e7-bb3ba9a16c93 tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] Neutron security group 1dfaee71-99d9-4261-b172-f4328f5f4b27 not found {{(pid=128780) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 16 12:56:23.944496 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-55e8b06a-8cb1-4704-88e7-bb3ba9a16c93 tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] HTTP exception thrown: Security group 1dfaee71-99d9-4261-b172-f4328f5f4b27 does not exist Sep 16 12:56:23.944496 n-d-858094-4 devstack@n-api.service[128780]: Neutron server returns request_ids: ['req-31790243-a501-4384-8d27-b3d4f06e0ed5'] Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-55e8b06a-8cb1-4704-88e7-bb3ba9a16c93 tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] Request method failure captured: Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: request: DELETE /compute/v2.1/os-security-groups/1dfaee71-99d9-4261-b172-f4328f5f4b27 HTTP/1.1 Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHJsUNQY3lS6i5z7RcWSGQqlZhL12fb3LYQyW4nFk70jqifQcm9dhZa4eJIcXk3FJZhHswHEdaH8KhwVrs-60dn76ofuXNfCBF8rnFLq19VYC1CVfMQK9-h2oZcXXRjBvq-BUq5_6OyxstWBkAUJedNLBkpe-AQpeQYGZpODfNJ_XLQ Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 1870b66518d34e78a00931ee65cb0c0c Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-475778795 Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1870b66518d34e78a00931ee65cb0c0c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1870b66518d34e78a00931ee65cb0c0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1870b66518d34e78a00931ee65cb0c0c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1870b66518d34e78a00931ee65cb0c0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-SecurityGroupRulesTestJSON-475778795 Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 1870b66518d34e78a00931ee65cb0c0c Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-475778795 Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-SecurityGroupRulesTestJSON-475778795-project Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 81ea840c8f614319a2d44bfceaa6cba5 Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-SecurityGroupRulesTestJSON-475778795-project Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: exception: Security group 1dfaee71-99d9-4261-b172-f4328f5f4b27 does not exist Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: Neutron server returns request_ids: ['req-31790243-a501-4384-8d27-b3d4f06e0ed5'] Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '1dfaee71-99d9-4261-b172-f4328f5f4b27'} Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 12:56:23.956228 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1dfaee71-99d9-4261-b172-f4328f5f4b27 does not exist Sep 16 12:56:23.959809 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-31790243-a501-4384-8d27-b3d4f06e0ed5'] Sep 16 12:56:23.959809 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:23.959809 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:23.959809 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:23.959809 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:23.959809 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 16 12:56:23.959809 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 16 12:56:23.959809 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 16 12:56:23.959809 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 16 12:56:23.959809 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1dfaee71-99d9-4261-b172-f4328f5f4b27 does not exist Sep 16 12:56:23.959809 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-31790243-a501-4384-8d27-b3d4f06e0ed5'] Sep 16 12:56:23.959809 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:23.959809 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:23.959809 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:23.959809 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:23.959809 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:56:23.959809 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:56:23.959809 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:56:23.959809 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:56:23.959809 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:56:23.959809 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:56:23.959809 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:56:23.959809 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:56:23.959809 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 16 12:56:23.959809 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 16 12:56:23.959809 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1dfaee71-99d9-4261-b172-f4328f5f4b27 does not exist Sep 16 12:56:23.959809 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-31790243-a501-4384-8d27-b3d4f06e0ed5'] Sep 16 12:56:23.959809 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:23.959809 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:23.959809 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:23.959809 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:23.959809 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:56:23.959809 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:56:23.959809 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:56:23.959809 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:56:23.959809 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1dfaee71-99d9-4261-b172-f4328f5f4b27 does not exist Sep 16 12:56:23.959809 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-31790243-a501-4384-8d27-b3d4f06e0ed5'] Sep 16 12:56:23.959809 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:23.965710 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-55e8b06a-8cb1-4704-88e7-bb3ba9a16c93 tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] Returning 404 to user: Security group 1dfaee71-99d9-4261-b172-f4328f5f4b27 does not exist Sep 16 12:56:23.965710 n-d-858094-4 devstack@n-api.service[128780]: Neutron server returns request_ids: ['req-31790243-a501-4384-8d27-b3d4f06e0ed5'] {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:56:23.969110 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-55e8b06a-8cb1-4704-88e7-bb3ba9a16c93 tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/1dfaee71-99d9-4261-b172-f4328f5f4b27" status: 404 len: 194 microversion: 2.1 time: 0.088859 Sep 16 12:56:23.970561 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1273/2615] 10.222.0.67 () {58 vars in 1272 bytes} [Fri Sep 16 12:56:23 2022] DELETE /compute/v2.1/os-security-groups/1dfaee71-99d9-4261-b172-f4328f5f4b27 => generated 194 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:56:23.987109 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8dbc74a9-640e-4ae8-81c0-206a4a27ff31 tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] Calling method '.version_select at 0x7f1034b338b0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:24.110265 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-aedfac6d-ee4c-4dd7-b36c-fd2d40716b07 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "DELETE /compute/v2.1/images/4115c64f-559a-45b5-b89c-8fc273c057b8" status: 204 len: 0 microversion: 2.1 time: 0.206006 Sep 16 12:56:24.111089 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1343/2616] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:23 2022] DELETE /compute/v2.1/images/4115c64f-559a-45b5-b89c-8fc273c057b8 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:56:24.116471 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9913af61-40d3-4b1e-b980-ffe749ee941c tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:24.117387 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9913af61-40d3-4b1e-b980-ffe749ee941c tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:24.156188 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9913af61-40d3-4b1e-b980-ffe749ee941c tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:24.157157 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9913af61-40d3-4b1e-b980-ffe749ee941c tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:24.158595 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9913af61-40d3-4b1e-b980-ffe749ee941c tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:24.162227 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9913af61-40d3-4b1e-b980-ffe749ee941c tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:24.163056 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9913af61-40d3-4b1e-b980-ffe749ee941c tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:24.163719 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9913af61-40d3-4b1e-b980-ffe749ee941c tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:24.295257 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9913af61-40d3-4b1e-b980-ffe749ee941c tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:24.305236 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9913af61-40d3-4b1e-b980-ffe749ee941c tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:24.317254 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9913af61-40d3-4b1e-b980-ffe749ee941c tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:24.320272 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8dbc74a9-640e-4ae8-81c0-206a4a27ff31 tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/1c5a6aa9-15ec-462c-abe3-422f9c49376a" status: 202 len: 0 microversion: 2.1 time: 0.344368 Sep 16 12:56:24.324443 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1274/2617] 10.222.0.67 () {58 vars in 1272 bytes} [Fri Sep 16 12:56:23 2022] DELETE /compute/v2.1/os-security-groups/1c5a6aa9-15ec-462c-abe3-422f9c49376a => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:56:24.334952 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0416a065-d7dd-42f1-ae36-a30f445285b7 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '.version_select at 0x7f1034aaddc0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:24.344324 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9913af61-40d3-4b1e-b980-ffe749ee941c tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1446 microversion: 2.75 time: 0.231634 Sep 16 12:56:24.345239 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1344/2618] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:24 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1446 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:56:24.351049 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-887e5aa1-d292-43d4-9dfc-da3f2e1b1bb6 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:24.352390 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-887e5aa1-d292-43d4-9dfc-da3f2e1b1bb6 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:24.360322 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-887e5aa1-d292-43d4-9dfc-da3f2e1b1bb6 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:24.360999 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-887e5aa1-d292-43d4-9dfc-da3f2e1b1bb6 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:24.362404 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-887e5aa1-d292-43d4-9dfc-da3f2e1b1bb6 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:24.366245 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-887e5aa1-d292-43d4-9dfc-da3f2e1b1bb6 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:24.367333 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-887e5aa1-d292-43d4-9dfc-da3f2e1b1bb6 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:24.369204 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-887e5aa1-d292-43d4-9dfc-da3f2e1b1bb6 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:24.402852 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-0416a065-d7dd-42f1-ae36-a30f445285b7 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] HTTP exception thrown: Image not found. Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0416a065-d7dd-42f1-ae36-a30f445285b7 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Request method failure captured: Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/images/4115c64f-559a-45b5-b89c-8fc273c057b8 HTTP/1.1 Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHI8T7yGPRAc3c6MPrRyvBn0sjBikdgUA-hTw5OumPvmvZhNIoTMLBQsFbEvX79WgLzGGVd0Tyjqag2EpyljzbSAD20HzRS6IC0nQYJFElFV23Kk60KxHTZ6ulzDMTvWGrZByycegK-oPTtKgXmNPoQq1DgmwbeXyTMrKt2g_ITcKgg Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: c88ea8e8750c440e86d3c1eb4ab6110e Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c88ea8e8750c440e86d3c1eb4ab6110e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: c88ea8e8750c440e86d3c1eb4ab6110e Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ImagesOneServerNegativeTestJSON-682956668-project Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 973378f0eed8476eb41a29d5ce57ed65 Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-682956668-project Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: exception: Image not found. Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '4115c64f-559a-45b5-b89c-8fc273c057b8'} Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4115c64f-559a-45b5-b89c-8fc273c057b8 Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 16 12:56:24.405821 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4115c64f-559a-45b5-b89c-8fc273c057b8 could not be found. Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 12:56:24.410204 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:24.418610 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0416a065-d7dd-42f1-ae36-a30f445285b7 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Returning 404 to user: Image not found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:56:24.427114 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0416a065-d7dd-42f1-ae36-a30f445285b7 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/images/4115c64f-559a-45b5-b89c-8fc273c057b8" status: 404 len: 62 microversion: 2.1 time: 0.101176 Sep 16 12:56:24.430602 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1275/2619] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:56:24 2022] GET /compute/v2.1/images/4115c64f-559a-45b5-b89c-8fc273c057b8 => generated 62 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 12:56:24.451479 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1c290432-2a45-4266-a99b-de02dd66c5a1 tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] Calling method '.version_select at 0x7f1034b33670>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:24.752984 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-887e5aa1-d292-43d4-9dfc-da3f2e1b1bb6 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:24.763850 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-887e5aa1-d292-43d4-9dfc-da3f2e1b1bb6 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1503 microversion: 2.1 time: 0.417211 Sep 16 12:56:24.765329 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1345/2620] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:24 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1503 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:24.787082 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-db6c9a42-60ad-4021-9b12-98ec271f027d tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:24.788324 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-db6c9a42-60ad-4021-9b12-98ec271f027d tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: e34e2be3-4e61-46dc-b4a4-5abcd3df9b85] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:24.794853 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db6c9a42-60ad-4021-9b12-98ec271f027d tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:24.795701 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db6c9a42-60ad-4021-9b12-98ec271f027d tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:24.796651 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db6c9a42-60ad-4021-9b12-98ec271f027d tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:24.797858 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db6c9a42-60ad-4021-9b12-98ec271f027d tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:24.798726 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db6c9a42-60ad-4021-9b12-98ec271f027d tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:24.800161 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db6c9a42-60ad-4021-9b12-98ec271f027d tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:25.169454 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1c290432-2a45-4266-a99b-de02dd66c5a1 tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/ba7477f8-b48a-4777-aba3-72412456636f" status: 202 len: 0 microversion: 2.1 time: 0.737298 Sep 16 12:56:25.170197 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1276/2621] 10.222.0.67 () {58 vars in 1272 bytes} [Fri Sep 16 12:56:24 2022] DELETE /compute/v2.1/os-security-groups/ba7477f8-b48a-4777-aba3-72412456636f => generated 0 bytes in 739 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:56:25.178689 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2cd3a4eb-a80f-4807-b384-19c367f7f835 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:25.181671 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-2cd3a4eb-a80f-4807-b384-19c367f7f835 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:25.196926 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2cd3a4eb-a80f-4807-b384-19c367f7f835 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:25.203321 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2cd3a4eb-a80f-4807-b384-19c367f7f835 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:25.203865 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2cd3a4eb-a80f-4807-b384-19c367f7f835 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:25.204595 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2cd3a4eb-a80f-4807-b384-19c367f7f835 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:25.205859 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2cd3a4eb-a80f-4807-b384-19c367f7f835 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:25.206299 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2cd3a4eb-a80f-4807-b384-19c367f7f835 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:25.223392 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-db6c9a42-60ad-4021-9b12-98ec271f027d tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:25.235627 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-db6c9a42-60ad-4021-9b12-98ec271f027d tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85" status: 200 len: 1533 microversion: 2.1 time: 0.468843 Sep 16 12:56:25.253561 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1346/2622] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:24 2022] GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 => generated 1533 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:25.258946 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bace6837-57b4-4fde-80fe-6a38474f7ba8 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:25.259792 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bace6837-57b4-4fde-80fe-6a38474f7ba8 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] [instance: e57d695e-a816-47e1-9ee9-595425bb9b2d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:25.267064 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bace6837-57b4-4fde-80fe-6a38474f7ba8 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:25.267635 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bace6837-57b4-4fde-80fe-6a38474f7ba8 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:25.268244 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bace6837-57b4-4fde-80fe-6a38474f7ba8 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:25.269155 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bace6837-57b4-4fde-80fe-6a38474f7ba8 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:25.270039 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bace6837-57b4-4fde-80fe-6a38474f7ba8 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:25.270722 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bace6837-57b4-4fde-80fe-6a38474f7ba8 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:25.470011 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-2cd3a4eb-a80f-4807-b384-19c367f7f835 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:25.495534 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2cd3a4eb-a80f-4807-b384-19c367f7f835 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1655 microversion: 2.1 time: 0.322247 Sep 16 12:56:25.511651 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1277/2623] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:25 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1655 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:25.531862 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-bbb7eabf-e91b-4253-b745-b53351db212e tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] Calling method '.version_select at 0x7f1034ace940>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:25.648743 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bace6837-57b4-4fde-80fe-6a38474f7ba8 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b1b8cac30242c0b4e2ea4188709ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763b15912eb44f848a81f813e359e8aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:25.663202 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bace6837-57b4-4fde-80fe-6a38474f7ba8 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] 10.222.0.67 "GET /compute/v2.1/servers/e57d695e-a816-47e1-9ee9-595425bb9b2d" status: 200 len: 1325 microversion: 2.1 time: 0.404917 Sep 16 12:56:25.665010 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1347/2624] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:25 2022] GET /compute/v2.1/servers/e57d695e-a816-47e1-9ee9-595425bb9b2d => generated 1325 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:25.670619 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2bcd93d8-5407-4a6d-bc2a-11d4c8d0366b tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:25.671441 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2bcd93d8-5407-4a6d-bc2a-11d4c8d0366b tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:25.678370 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2bcd93d8-5407-4a6d-bc2a-11d4c8d0366b tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:25.679115 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2bcd93d8-5407-4a6d-bc2a-11d4c8d0366b tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:25.680020 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2bcd93d8-5407-4a6d-bc2a-11d4c8d0366b tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:25.681253 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2bcd93d8-5407-4a6d-bc2a-11d4c8d0366b tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:25.681859 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2bcd93d8-5407-4a6d-bc2a-11d4c8d0366b tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:25.682428 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2bcd93d8-5407-4a6d-bc2a-11d4c8d0366b tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:25.805189 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2bcd93d8-5407-4a6d-bc2a-11d4c8d0366b tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:25.822140 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2bcd93d8-5407-4a6d-bc2a-11d4c8d0366b tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:25.824914 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2bcd93d8-5407-4a6d-bc2a-11d4c8d0366b tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:25.844664 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2bcd93d8-5407-4a6d-bc2a-11d4c8d0366b tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1446 microversion: 2.75 time: 0.174671 Sep 16 12:56:25.845624 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1348/2625] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:25 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1446 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:56:25.854933 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9e4b48dc-77e6-4b0f-a23a-50f0efabb8dd tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:25.868301 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e4b48dc-77e6-4b0f-a23a-50f0efabb8dd tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:25.868808 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e4b48dc-77e6-4b0f-a23a-50f0efabb8dd tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:25.869255 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e4b48dc-77e6-4b0f-a23a-50f0efabb8dd tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:25.917037 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9e4b48dc-77e6-4b0f-a23a-50f0efabb8dd tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Going to try to start instance {{(pid=128779) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 16 12:56:25.938792 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-bbb7eabf-e91b-4253-b745-b53351db212e tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/5d5f9fcc-b4ac-4788-8041-256368431020" status: 202 len: 0 microversion: 2.1 time: 0.424714 Sep 16 12:56:25.939588 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1278/2626] 10.222.0.67 () {58 vars in 1272 bytes} [Fri Sep 16 12:56:25 2022] DELETE /compute/v2.1/os-security-groups/5d5f9fcc-b4ac-4788-8041-256368431020 => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:56:25.945277 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-52e472d1-882e-4246-bfc5-0d066953d14c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:25.946166 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-52e472d1-882e-4246-bfc5-0d066953d14c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:25.960645 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-52e472d1-882e-4246-bfc5-0d066953d14c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:25.961141 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-52e472d1-882e-4246-bfc5-0d066953d14c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:25.961581 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-52e472d1-882e-4246-bfc5-0d066953d14c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:25.965053 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-52e472d1-882e-4246-bfc5-0d066953d14c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:25.974789 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-52e472d1-882e-4246-bfc5-0d066953d14c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:25.980943 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-52e472d1-882e-4246-bfc5-0d066953d14c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:26.019414 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9e4b48dc-77e6-4b0f-a23a-50f0efabb8dd tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "POST /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88/action" status: 202 len: 0 microversion: 2.1 time: 0.170319 Sep 16 12:56:26.023990 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1349/2627] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:56:25 2022] POST /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:56:26.036485 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dcce8c01-8bba-43d4-9cf5-d86833180fdd tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] Calling method '.version_select at 0x7f103566a5e0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:26.245182 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-52e472d1-882e-4246-bfc5-0d066953d14c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:26.265066 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-52e472d1-882e-4246-bfc5-0d066953d14c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1503 microversion: 2.1 time: 0.323946 Sep 16 12:56:26.272592 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1279/2628] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:25 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1503 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:26.292317 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a8559914-217b-4994-9380-1ade1d205a64 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:26.295805 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a8559914-217b-4994-9380-1ade1d205a64 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:26.318722 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8559914-217b-4994-9380-1ade1d205a64 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:26.319977 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8559914-217b-4994-9380-1ade1d205a64 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:26.321998 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8559914-217b-4994-9380-1ade1d205a64 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:26.323488 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8559914-217b-4994-9380-1ade1d205a64 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:26.325793 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8559914-217b-4994-9380-1ade1d205a64 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:26.326283 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8559914-217b-4994-9380-1ade1d205a64 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:26.529552 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dcce8c01-8bba-43d4-9cf5-d86833180fdd tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/6c09dd9f-65b8-4951-8cd1-48a2b97d9592" status: 202 len: 0 microversion: 2.1 time: 0.503843 Sep 16 12:56:26.534990 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1350/2629] 10.222.0.67 () {58 vars in 1272 bytes} [Fri Sep 16 12:56:26 2022] DELETE /compute/v2.1/os-security-groups/6c09dd9f-65b8-4951-8cd1-48a2b97d9592 => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:56:26.542038 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-46468a54-2bc5-4d16-a704-1f11c443a658 req-47ec6c3e-2330-4865-8553-b445c2d8e66d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e57d695e-a816-47e1-9ee9-595425bb9b2d", "tag": "cf81024f-1cc9-4e39-bc87-63f3220631ae"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:26.555486 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-46468a54-2bc5-4d16-a704-1f11c443a658 req-47ec6c3e-2330-4865-8553-b445c2d8e66d service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:26.556271 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-46468a54-2bc5-4d16-a704-1f11c443a658 req-47ec6c3e-2330-4865-8553-b445c2d8e66d service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:26.556934 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-46468a54-2bc5-4d16-a704-1f11c443a658 req-47ec6c3e-2330-4865-8553-b445c2d8e66d service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:26.573690 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-46468a54-2bc5-4d16-a704-1f11c443a658 req-47ec6c3e-2330-4865-8553-b445c2d8e66d service nova] Creating event network-changed:cf81024f-1cc9-4e39-bc87-63f3220631ae for instance e57d695e-a816-47e1-9ee9-595425bb9b2d on n-h2-858094-4 Sep 16 12:56:26.579745 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-46468a54-2bc5-4d16-a704-1f11c443a658 req-47ec6c3e-2330-4865-8553-b445c2d8e66d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043618 Sep 16 12:56:26.581541 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1351/2630] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:56:26.587514 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f0075d16-6a39-4f61-8ed1-84e4ce5661a8 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:26.588472 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f0075d16-6a39-4f61-8ed1-84e4ce5661a8 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: e34e2be3-4e61-46dc-b4a4-5abcd3df9b85] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:26.595484 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0075d16-6a39-4f61-8ed1-84e4ce5661a8 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:26.596843 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0075d16-6a39-4f61-8ed1-84e4ce5661a8 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:26.597655 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0075d16-6a39-4f61-8ed1-84e4ce5661a8 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:26.598734 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0075d16-6a39-4f61-8ed1-84e4ce5661a8 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:26.599372 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0075d16-6a39-4f61-8ed1-84e4ce5661a8 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:26.599962 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0075d16-6a39-4f61-8ed1-84e4ce5661a8 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:26.615652 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a8559914-217b-4994-9380-1ade1d205a64 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:26.625587 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a8559914-217b-4994-9380-1ade1d205a64 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1664 microversion: 2.1 time: 0.351470 Sep 16 12:56:26.626283 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1280/2631] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:26 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1664 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:26.631431 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e2ef2196-52df-45e4-9b80-1c38d048f8cb tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] Calling method '.version_select at 0x7f1034aa00d0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:26.881683 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f0075d16-6a39-4f61-8ed1-84e4ce5661a8 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:26.902199 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f0075d16-6a39-4f61-8ed1-84e4ce5661a8 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85" status: 200 len: 1539 microversion: 2.1 time: 0.314682 Sep 16 12:56:26.903838 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1352/2632] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:26 2022] GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 => generated 1539 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:26.919559 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1da419bf-81db-4160-8d66-2e3ccd0384ee tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:26.924693 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1da419bf-81db-4160-8d66-2e3ccd0384ee tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] [instance: e57d695e-a816-47e1-9ee9-595425bb9b2d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:26.954031 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1da419bf-81db-4160-8d66-2e3ccd0384ee tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:26.956855 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1da419bf-81db-4160-8d66-2e3ccd0384ee tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:26.958185 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1da419bf-81db-4160-8d66-2e3ccd0384ee tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:26.961262 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1da419bf-81db-4160-8d66-2e3ccd0384ee tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:26.963076 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1da419bf-81db-4160-8d66-2e3ccd0384ee tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:26.965500 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1da419bf-81db-4160-8d66-2e3ccd0384ee tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:27.047519 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e2ef2196-52df-45e4-9b80-1c38d048f8cb tempest-SecurityGroupRulesTestJSON-475778795 tempest-SecurityGroupRulesTestJSON-475778795-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/8ae030e2-e907-4e7f-a7a4-3261da137fc3" status: 202 len: 0 microversion: 2.1 time: 0.420010 Sep 16 12:56:27.048960 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1281/2633] 10.222.0.67 () {58 vars in 1272 bytes} [Fri Sep 16 12:56:26 2022] DELETE /compute/v2.1/os-security-groups/8ae030e2-e907-4e7f-a7a4-3261da137fc3 => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:56:27.054663 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2d95bcee-5253-4181-9250-6cb833c78c0b tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:27.055570 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-2d95bcee-5253-4181-9250-6cb833c78c0b tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:27.062860 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2d95bcee-5253-4181-9250-6cb833c78c0b tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:27.063582 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2d95bcee-5253-4181-9250-6cb833c78c0b tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:27.064212 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2d95bcee-5253-4181-9250-6cb833c78c0b tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:27.065783 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2d95bcee-5253-4181-9250-6cb833c78c0b tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:27.066648 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2d95bcee-5253-4181-9250-6cb833c78c0b tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:27.067433 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2d95bcee-5253-4181-9250-6cb833c78c0b tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:27.282611 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-2d95bcee-5253-4181-9250-6cb833c78c0b tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:27.301514 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-2d95bcee-5253-4181-9250-6cb833c78c0b tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:27.303238 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-2d95bcee-5253-4181-9250-6cb833c78c0b tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:27.311544 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2d95bcee-5253-4181-9250-6cb833c78c0b tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1446 microversion: 2.75 time: 0.261336 Sep 16 12:56:27.316444 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1282/2634] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:27 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1446 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:56:27.332429 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4019ebab-41d4-4f0d-91ca-8794f403453f tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:27.333426 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-4019ebab-41d4-4f0d-91ca-8794f403453f tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:27.341083 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4019ebab-41d4-4f0d-91ca-8794f403453f tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:27.341955 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4019ebab-41d4-4f0d-91ca-8794f403453f tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:27.343017 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4019ebab-41d4-4f0d-91ca-8794f403453f tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:27.343986 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4019ebab-41d4-4f0d-91ca-8794f403453f tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:27.344945 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4019ebab-41d4-4f0d-91ca-8794f403453f tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:27.345612 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4019ebab-41d4-4f0d-91ca-8794f403453f tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:27.396300 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1da419bf-81db-4160-8d66-2e3ccd0384ee tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b1b8cac30242c0b4e2ea4188709ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763b15912eb44f848a81f813e359e8aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:27.416311 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1da419bf-81db-4160-8d66-2e3ccd0384ee tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] 10.222.0.67 "GET /compute/v2.1/servers/e57d695e-a816-47e1-9ee9-595425bb9b2d" status: 200 len: 1325 microversion: 2.1 time: 0.506986 Sep 16 12:56:27.433448 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1353/2635] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:26 2022] GET /compute/v2.1/servers/e57d695e-a816-47e1-9ee9-595425bb9b2d => generated 1325 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:27.658636 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2a250ace-e5ad-4a5b-af3b-58ff2f4516a8 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:27.661279 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2a250ace-e5ad-4a5b-af3b-58ff2f4516a8 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:27.673733 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a250ace-e5ad-4a5b-af3b-58ff2f4516a8 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:27.674765 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a250ace-e5ad-4a5b-af3b-58ff2f4516a8 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:27.675358 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a250ace-e5ad-4a5b-af3b-58ff2f4516a8 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:27.678094 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a250ace-e5ad-4a5b-af3b-58ff2f4516a8 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:27.678541 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a250ace-e5ad-4a5b-af3b-58ff2f4516a8 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:27.678984 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a250ace-e5ad-4a5b-af3b-58ff2f4516a8 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:27.688472 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:56:27.691599 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4019ebab-41d4-4f0d-91ca-8794f403453f tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:27.704732 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4019ebab-41d4-4f0d-91ca-8794f403453f tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1503 microversion: 2.1 time: 0.383422 Sep 16 12:56:27.705499 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1283/2636] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:27 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1503 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:27.932783 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-301a7b2f-cb42-4ed2-9861-c97a96d04243 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:27.933465 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-301a7b2f-cb42-4ed2-9861-c97a96d04243 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: e34e2be3-4e61-46dc-b4a4-5abcd3df9b85] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:27.944851 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-301a7b2f-cb42-4ed2-9861-c97a96d04243 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:27.945566 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-301a7b2f-cb42-4ed2-9861-c97a96d04243 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:27.946011 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-301a7b2f-cb42-4ed2-9861-c97a96d04243 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:27.946757 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-301a7b2f-cb42-4ed2-9861-c97a96d04243 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:27.947212 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-301a7b2f-cb42-4ed2-9861-c97a96d04243 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:27.947641 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-301a7b2f-cb42-4ed2-9861-c97a96d04243 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:27.975019 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2a250ace-e5ad-4a5b-af3b-58ff2f4516a8 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:27.982975 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2a250ace-e5ad-4a5b-af3b-58ff2f4516a8 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1664 microversion: 2.1 time: 0.334183 Sep 16 12:56:27.983863 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1354/2637] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:27 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1664 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:28.182940 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-301a7b2f-cb42-4ed2-9861-c97a96d04243 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:28.193297 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-301a7b2f-cb42-4ed2-9861-c97a96d04243 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85" status: 200 len: 1534 microversion: 2.1 time: 0.266230 Sep 16 12:56:28.202848 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1284/2638] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:27 2022] GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 => generated 1534 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:56:28.343331 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-578eeb44-ee0c-46f4-88f1-a655d3e9fa8b tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:28.344278 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-578eeb44-ee0c-46f4-88f1-a655d3e9fa8b tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:28.366989 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-578eeb44-ee0c-46f4-88f1-a655d3e9fa8b tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:28.369770 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-578eeb44-ee0c-46f4-88f1-a655d3e9fa8b tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:28.370456 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-578eeb44-ee0c-46f4-88f1-a655d3e9fa8b tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:28.371381 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-578eeb44-ee0c-46f4-88f1-a655d3e9fa8b tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:28.374205 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-578eeb44-ee0c-46f4-88f1-a655d3e9fa8b tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:28.374718 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-578eeb44-ee0c-46f4-88f1-a655d3e9fa8b tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:28.445617 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a81df8c4-703e-40d2-9949-a0571be03e8d tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:28.447024 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a81df8c4-703e-40d2-9949-a0571be03e8d tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] [instance: e57d695e-a816-47e1-9ee9-595425bb9b2d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:28.456732 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a81df8c4-703e-40d2-9949-a0571be03e8d tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:28.457939 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a81df8c4-703e-40d2-9949-a0571be03e8d tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:28.458558 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a81df8c4-703e-40d2-9949-a0571be03e8d tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:28.460022 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a81df8c4-703e-40d2-9949-a0571be03e8d tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:28.460694 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a81df8c4-703e-40d2-9949-a0571be03e8d tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:28.461274 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a81df8c4-703e-40d2-9949-a0571be03e8d tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:28.484030 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-578eeb44-ee0c-46f4-88f1-a655d3e9fa8b tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:28.499542 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-578eeb44-ee0c-46f4-88f1-a655d3e9fa8b tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:28.503879 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-578eeb44-ee0c-46f4-88f1-a655d3e9fa8b tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:28.522106 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-578eeb44-ee0c-46f4-88f1-a655d3e9fa8b tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1446 microversion: 2.75 time: 0.182077 Sep 16 12:56:28.526465 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1355/2639] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:28 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1446 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:56:28.730713 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5ae3b595-9f44-4a70-b6fe-8f5d9e095a57 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:28.731338 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5ae3b595-9f44-4a70-b6fe-8f5d9e095a57 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:28.744052 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ae3b595-9f44-4a70-b6fe-8f5d9e095a57 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:28.745096 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ae3b595-9f44-4a70-b6fe-8f5d9e095a57 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:28.745811 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ae3b595-9f44-4a70-b6fe-8f5d9e095a57 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:28.747272 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ae3b595-9f44-4a70-b6fe-8f5d9e095a57 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:28.748088 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ae3b595-9f44-4a70-b6fe-8f5d9e095a57 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:28.748956 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ae3b595-9f44-4a70-b6fe-8f5d9e095a57 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:28.892164 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a81df8c4-703e-40d2-9949-a0571be03e8d tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b1b8cac30242c0b4e2ea4188709ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763b15912eb44f848a81f813e359e8aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:28.908650 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a81df8c4-703e-40d2-9949-a0571be03e8d tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] 10.222.0.67 "GET /compute/v2.1/servers/e57d695e-a816-47e1-9ee9-595425bb9b2d" status: 200 len: 1325 microversion: 2.1 time: 0.468779 Sep 16 12:56:28.911362 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1285/2640] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:28 2022] GET /compute/v2.1/servers/e57d695e-a816-47e1-9ee9-595425bb9b2d => generated 1325 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:56:29.012631 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-452bb76b-c21e-46a2-bfa6-e6038aa1d020 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:29.013796 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-452bb76b-c21e-46a2-bfa6-e6038aa1d020 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:29.023911 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-452bb76b-c21e-46a2-bfa6-e6038aa1d020 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:29.025145 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-452bb76b-c21e-46a2-bfa6-e6038aa1d020 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:29.028168 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-452bb76b-c21e-46a2-bfa6-e6038aa1d020 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:29.029302 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-452bb76b-c21e-46a2-bfa6-e6038aa1d020 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:29.029981 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-452bb76b-c21e-46a2-bfa6-e6038aa1d020 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:29.030697 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-452bb76b-c21e-46a2-bfa6-e6038aa1d020 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:29.327645 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5ae3b595-9f44-4a70-b6fe-8f5d9e095a57 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:29.343387 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5ae3b595-9f44-4a70-b6fe-8f5d9e095a57 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1503 microversion: 2.1 time: 0.615904 Sep 16 12:56:29.345280 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1356/2641] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:28 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1503 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:56:29.353024 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c5abfa14-df5c-401d-b77c-e2ee303cea44 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:29.357741 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c5abfa14-df5c-401d-b77c-e2ee303cea44 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: e34e2be3-4e61-46dc-b4a4-5abcd3df9b85] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:29.372967 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5abfa14-df5c-401d-b77c-e2ee303cea44 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:29.373772 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5abfa14-df5c-401d-b77c-e2ee303cea44 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:29.374222 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5abfa14-df5c-401d-b77c-e2ee303cea44 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:29.377953 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5abfa14-df5c-401d-b77c-e2ee303cea44 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:29.378735 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5abfa14-df5c-401d-b77c-e2ee303cea44 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:29.379741 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5abfa14-df5c-401d-b77c-e2ee303cea44 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:29.531570 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-452bb76b-c21e-46a2-bfa6-e6038aa1d020 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:29.541198 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-452bb76b-c21e-46a2-bfa6-e6038aa1d020 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1664 microversion: 2.1 time: 0.537498 Sep 16 12:56:29.542356 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1286/2642] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:29 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1664 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:29.548669 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-9b238ddb-d1e3-496c-880d-a43870453cdc req-ed81db6f-bbf6-4c17-a598-ff6af9b5b5d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e34e2be3-4e61-46dc-b4a4-5abcd3df9b85", "name": "network-vif-plugged", "status": "completed", "tag": "27d81681-82f2-4f23-8f72-9075e99f9ca1"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:29.561503 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-9b238ddb-d1e3-496c-880d-a43870453cdc req-ed81db6f-bbf6-4c17-a598-ff6af9b5b5d5 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:29.562109 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-9b238ddb-d1e3-496c-880d-a43870453cdc req-ed81db6f-bbf6-4c17-a598-ff6af9b5b5d5 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:29.562833 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-9b238ddb-d1e3-496c-880d-a43870453cdc req-ed81db6f-bbf6-4c17-a598-ff6af9b5b5d5 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:29.580339 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-9b238ddb-d1e3-496c-880d-a43870453cdc req-ed81db6f-bbf6-4c17-a598-ff6af9b5b5d5 service nova] Creating event network-vif-plugged:27d81681-82f2-4f23-8f72-9075e99f9ca1 for instance e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 on n-h2-858094-4 Sep 16 12:56:29.586596 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-9b238ddb-d1e3-496c-880d-a43870453cdc req-ed81db6f-bbf6-4c17-a598-ff6af9b5b5d5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042566 Sep 16 12:56:29.587509 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1287/2643] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:56:29.593494 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-602e1bda-c97b-4b0a-8057-57fd6bf62236 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:29.594223 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-602e1bda-c97b-4b0a-8057-57fd6bf62236 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:29.601134 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=100 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:56:29.604061 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-602e1bda-c97b-4b0a-8057-57fd6bf62236 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:29.604604 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-602e1bda-c97b-4b0a-8057-57fd6bf62236 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:29.605108 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-602e1bda-c97b-4b0a-8057-57fd6bf62236 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:29.606115 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-602e1bda-c97b-4b0a-8057-57fd6bf62236 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:29.606574 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-602e1bda-c97b-4b0a-8057-57fd6bf62236 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:29.607001 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-602e1bda-c97b-4b0a-8057-57fd6bf62236 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:29.977924 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-602e1bda-c97b-4b0a-8057-57fd6bf62236 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:29.989679 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-602e1bda-c97b-4b0a-8057-57fd6bf62236 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:29.991165 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-602e1bda-c97b-4b0a-8057-57fd6bf62236 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:29.999025 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-602e1bda-c97b-4b0a-8057-57fd6bf62236 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1446 microversion: 2.75 time: 0.410130 Sep 16 12:56:30.012511 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1288/2644] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:29 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1446 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:56:30.012511 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6716c16d-51dc-48c5-b461-b4ec974fedc4 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:30.012511 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6716c16d-51dc-48c5-b461-b4ec974fedc4 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] [instance: e57d695e-a816-47e1-9ee9-595425bb9b2d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:30.017160 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6716c16d-51dc-48c5-b461-b4ec974fedc4 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:30.017960 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6716c16d-51dc-48c5-b461-b4ec974fedc4 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:30.018761 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6716c16d-51dc-48c5-b461-b4ec974fedc4 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:30.019781 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6716c16d-51dc-48c5-b461-b4ec974fedc4 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:30.020792 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6716c16d-51dc-48c5-b461-b4ec974fedc4 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:30.021787 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6716c16d-51dc-48c5-b461-b4ec974fedc4 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:30.029856 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=100 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:56:30.034449 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c5abfa14-df5c-401d-b77c-e2ee303cea44 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:30.043515 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c5abfa14-df5c-401d-b77c-e2ee303cea44 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85" status: 200 len: 1521 microversion: 2.1 time: 0.694419 Sep 16 12:56:30.064596 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1357/2645] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:29 2022] GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 => generated 1521 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:30.072529 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b2b2cc17-2f3d-4e8f-866d-d24156afa81f tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:30.073134 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b2b2cc17-2f3d-4e8f-866d-d24156afa81f tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: e34e2be3-4e61-46dc-b4a4-5abcd3df9b85] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:30.080138 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2b2cc17-2f3d-4e8f-866d-d24156afa81f tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:30.080773 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2b2cc17-2f3d-4e8f-866d-d24156afa81f tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:30.081301 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2b2cc17-2f3d-4e8f-866d-d24156afa81f tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:30.082128 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2b2cc17-2f3d-4e8f-866d-d24156afa81f tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:30.082794 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2b2cc17-2f3d-4e8f-866d-d24156afa81f tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:30.083301 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2b2cc17-2f3d-4e8f-866d-d24156afa81f tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:30.115518 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b2b2cc17-2f3d-4e8f-866d-d24156afa81f tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: e34e2be3-4e61-46dc-b4a4-5abcd3df9b85] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:56:30.218430 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b2b2cc17-2f3d-4e8f-866d-d24156afa81f tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85" status: 204 len: 0 microversion: 2.1 time: 0.150990 Sep 16 12:56:30.219037 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1358/2646] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:56:30 2022] DELETE /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:56:30.228760 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-943ebef4-f363-41e4-930a-8d45e5c46c04 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:30.229679 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-943ebef4-f363-41e4-930a-8d45e5c46c04 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: e34e2be3-4e61-46dc-b4a4-5abcd3df9b85] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:30.240799 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-943ebef4-f363-41e4-930a-8d45e5c46c04 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:30.241952 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-943ebef4-f363-41e4-930a-8d45e5c46c04 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:30.242494 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-943ebef4-f363-41e4-930a-8d45e5c46c04 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:30.243793 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-943ebef4-f363-41e4-930a-8d45e5c46c04 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:30.244362 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-943ebef4-f363-41e4-930a-8d45e5c46c04 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:30.245109 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-943ebef4-f363-41e4-930a-8d45e5c46c04 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:30.329489 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6716c16d-51dc-48c5-b461-b4ec974fedc4 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b1b8cac30242c0b4e2ea4188709ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763b15912eb44f848a81f813e359e8aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:30.339953 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6716c16d-51dc-48c5-b461-b4ec974fedc4 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] 10.222.0.67 "GET /compute/v2.1/servers/e57d695e-a816-47e1-9ee9-595425bb9b2d" status: 200 len: 1325 microversion: 2.1 time: 0.337666 Sep 16 12:56:30.340867 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1289/2647] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:30 2022] GET /compute/v2.1/servers/e57d695e-a816-47e1-9ee9-595425bb9b2d => generated 1325 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:30.370163 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-92e8d8a1-76e1-42fc-a4c0-393319616c70 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:30.371123 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-92e8d8a1-76e1-42fc-a4c0-393319616c70 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:30.390279 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92e8d8a1-76e1-42fc-a4c0-393319616c70 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:30.391163 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92e8d8a1-76e1-42fc-a4c0-393319616c70 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:30.391829 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92e8d8a1-76e1-42fc-a4c0-393319616c70 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:30.392642 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92e8d8a1-76e1-42fc-a4c0-393319616c70 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:30.393802 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92e8d8a1-76e1-42fc-a4c0-393319616c70 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:30.394285 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92e8d8a1-76e1-42fc-a4c0-393319616c70 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:30.623711 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-943ebef4-f363-41e4-930a-8d45e5c46c04 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:30.654975 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-943ebef4-f363-41e4-930a-8d45e5c46c04 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85" status: 200 len: 1527 microversion: 2.1 time: 0.412143 Sep 16 12:56:30.654975 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1359/2648] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:30 2022] GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 => generated 1527 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:56:30.654975 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5556a1d2-9f5e-4fd7-aafe-9ef5518c9784 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:30.654975 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5556a1d2-9f5e-4fd7-aafe-9ef5518c9784 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:30.663076 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-92e8d8a1-76e1-42fc-a4c0-393319616c70 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:30.672426 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-92e8d8a1-76e1-42fc-a4c0-393319616c70 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1503 microversion: 2.1 time: 0.306369 Sep 16 12:56:30.673334 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1290/2649] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:30 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1503 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:56:30.694579 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5556a1d2-9f5e-4fd7-aafe-9ef5518c9784 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:30.700483 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5556a1d2-9f5e-4fd7-aafe-9ef5518c9784 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:30.701308 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5556a1d2-9f5e-4fd7-aafe-9ef5518c9784 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:30.702595 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5556a1d2-9f5e-4fd7-aafe-9ef5518c9784 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:30.703529 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5556a1d2-9f5e-4fd7-aafe-9ef5518c9784 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:30.704012 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5556a1d2-9f5e-4fd7-aafe-9ef5518c9784 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:30.974796 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5556a1d2-9f5e-4fd7-aafe-9ef5518c9784 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:30.988425 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5556a1d2-9f5e-4fd7-aafe-9ef5518c9784 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1668 microversion: 2.1 time: 0.347528 Sep 16 12:56:30.990021 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1360/2650] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:30 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1668 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:31.038329 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d880fc80-b242-41f2-8c02-49230e46569f tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:31.039540 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d880fc80-b242-41f2-8c02-49230e46569f tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:31.055567 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d880fc80-b242-41f2-8c02-49230e46569f tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:31.056080 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d880fc80-b242-41f2-8c02-49230e46569f tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:31.056560 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d880fc80-b242-41f2-8c02-49230e46569f tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:31.058577 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d880fc80-b242-41f2-8c02-49230e46569f tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:31.060852 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d880fc80-b242-41f2-8c02-49230e46569f tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:31.061330 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d880fc80-b242-41f2-8c02-49230e46569f tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:31.167805 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d880fc80-b242-41f2-8c02-49230e46569f tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:31.181419 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d880fc80-b242-41f2-8c02-49230e46569f tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:31.183708 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d880fc80-b242-41f2-8c02-49230e46569f tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:31.192035 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d880fc80-b242-41f2-8c02-49230e46569f tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1446 microversion: 2.75 time: 0.160103 Sep 16 12:56:31.192964 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1291/2651] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:31 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1446 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:56:31.364701 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e84fc8a0-881b-4f9b-a620-d6fa8c906a0c tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:31.365991 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e84fc8a0-881b-4f9b-a620-d6fa8c906a0c tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] [instance: e57d695e-a816-47e1-9ee9-595425bb9b2d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:31.373988 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e84fc8a0-881b-4f9b-a620-d6fa8c906a0c tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:31.375094 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e84fc8a0-881b-4f9b-a620-d6fa8c906a0c tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:31.375787 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e84fc8a0-881b-4f9b-a620-d6fa8c906a0c tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:31.378845 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e84fc8a0-881b-4f9b-a620-d6fa8c906a0c tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:31.379544 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e84fc8a0-881b-4f9b-a620-d6fa8c906a0c tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:31.380226 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e84fc8a0-881b-4f9b-a620-d6fa8c906a0c tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:31.431631 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:56:31.664045 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d2b08d95-8f11-4b61-9749-3416ac212ee1 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:31.665011 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d2b08d95-8f11-4b61-9749-3416ac212ee1 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: e34e2be3-4e61-46dc-b4a4-5abcd3df9b85] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:31.674099 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d2b08d95-8f11-4b61-9749-3416ac212ee1 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:31.680684 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d2b08d95-8f11-4b61-9749-3416ac212ee1 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:31.683376 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d2b08d95-8f11-4b61-9749-3416ac212ee1 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:31.684229 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d2b08d95-8f11-4b61-9749-3416ac212ee1 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:31.684690 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d2b08d95-8f11-4b61-9749-3416ac212ee1 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:31.685123 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d2b08d95-8f11-4b61-9749-3416ac212ee1 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:31.820486 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e84fc8a0-881b-4f9b-a620-d6fa8c906a0c tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b1b8cac30242c0b4e2ea4188709ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763b15912eb44f848a81f813e359e8aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:31.847016 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e84fc8a0-881b-4f9b-a620-d6fa8c906a0c tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] 10.222.0.67 "GET /compute/v2.1/servers/e57d695e-a816-47e1-9ee9-595425bb9b2d" status: 200 len: 1325 microversion: 2.1 time: 0.487123 Sep 16 12:56:31.849041 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1361/2652] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:31 2022] GET /compute/v2.1/servers/e57d695e-a816-47e1-9ee9-595425bb9b2d => generated 1325 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:31.858073 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-febe5443-ec72-4bf2-a2d6-78c8e234571f tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:31.858791 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-febe5443-ec72-4bf2-a2d6-78c8e234571f tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:31.869408 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-febe5443-ec72-4bf2-a2d6-78c8e234571f tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:31.869911 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-febe5443-ec72-4bf2-a2d6-78c8e234571f tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:31.870363 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-febe5443-ec72-4bf2-a2d6-78c8e234571f tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:31.871085 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-febe5443-ec72-4bf2-a2d6-78c8e234571f tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:31.871548 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-febe5443-ec72-4bf2-a2d6-78c8e234571f tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:31.871984 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-febe5443-ec72-4bf2-a2d6-78c8e234571f tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:32.089162 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d2b08d95-8f11-4b61-9749-3416ac212ee1 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:32.098024 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d2b08d95-8f11-4b61-9749-3416ac212ee1 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85" status: 200 len: 1527 microversion: 2.1 time: 0.437655 Sep 16 12:56:32.116340 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1292/2653] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:31 2022] GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 => generated 1527 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:56:32.187540 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=8 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:56:32.226605 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-232bfceb-03ab-4714-9db9-de11cde57d3d tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:32.227167 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-232bfceb-03ab-4714-9db9-de11cde57d3d tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:32.243319 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-232bfceb-03ab-4714-9db9-de11cde57d3d tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:32.243927 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-232bfceb-03ab-4714-9db9-de11cde57d3d tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:32.244426 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-232bfceb-03ab-4714-9db9-de11cde57d3d tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:32.245203 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-232bfceb-03ab-4714-9db9-de11cde57d3d tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:32.246157 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-232bfceb-03ab-4714-9db9-de11cde57d3d tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:32.247315 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-232bfceb-03ab-4714-9db9-de11cde57d3d tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:32.304900 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-febe5443-ec72-4bf2-a2d6-78c8e234571f tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:32.315432 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-febe5443-ec72-4bf2-a2d6-78c8e234571f tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1483 microversion: 2.1 time: 0.464496 Sep 16 12:56:32.321849 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1362/2654] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:31 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1483 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:32.346262 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dc9292e0-323a-4649-9e2a-e9dee3b898d9 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:32.347609 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dc9292e0-323a-4649-9e2a-e9dee3b898d9 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:32.367123 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc9292e0-323a-4649-9e2a-e9dee3b898d9 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:32.369867 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc9292e0-323a-4649-9e2a-e9dee3b898d9 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:32.370337 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc9292e0-323a-4649-9e2a-e9dee3b898d9 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:32.372848 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc9292e0-323a-4649-9e2a-e9dee3b898d9 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:32.374708 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc9292e0-323a-4649-9e2a-e9dee3b898d9 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:32.377330 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc9292e0-323a-4649-9e2a-e9dee3b898d9 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:32.483641 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dc9292e0-323a-4649-9e2a-e9dee3b898d9 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "POST /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115/action" status: 202 len: 0 microversion: 2.1 time: 0.142911 Sep 16 12:56:32.485260 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1363/2655] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:56:32 2022] POST /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 12:56:32.496598 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-232bfceb-03ab-4714-9db9-de11cde57d3d tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:32.506679 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-15bb4c34-a615-42fe-85b1-d0567b81ee5a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:32.510757 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-15bb4c34-a615-42fe-85b1-d0567b81ee5a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:32.520116 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15bb4c34-a615-42fe-85b1-d0567b81ee5a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:32.520902 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15bb4c34-a615-42fe-85b1-d0567b81ee5a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:32.521536 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15bb4c34-a615-42fe-85b1-d0567b81ee5a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:32.522550 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15bb4c34-a615-42fe-85b1-d0567b81ee5a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:32.523242 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15bb4c34-a615-42fe-85b1-d0567b81ee5a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:32.523833 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15bb4c34-a615-42fe-85b1-d0567b81ee5a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:32.527200 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-232bfceb-03ab-4714-9db9-de11cde57d3d tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:32.535377 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-232bfceb-03ab-4714-9db9-de11cde57d3d tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:32.562443 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-232bfceb-03ab-4714-9db9-de11cde57d3d tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1446 microversion: 2.75 time: 0.329216 Sep 16 12:56:32.567890 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1293/2656] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:32 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1446 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:56:32.810198 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-15bb4c34-a615-42fe-85b1-d0567b81ee5a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:32.822754 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-15bb4c34-a615-42fe-85b1-d0567b81ee5a tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1491 microversion: 2.1 time: 0.327991 Sep 16 12:56:32.823413 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1364/2657] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:32 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1491 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:32.876153 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e2321eb6-57e6-46ea-9044-49c6d0e25fa6 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:32.877425 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e2321eb6-57e6-46ea-9044-49c6d0e25fa6 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] [instance: e57d695e-a816-47e1-9ee9-595425bb9b2d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:32.887858 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e2321eb6-57e6-46ea-9044-49c6d0e25fa6 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:32.888633 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e2321eb6-57e6-46ea-9044-49c6d0e25fa6 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:32.889254 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e2321eb6-57e6-46ea-9044-49c6d0e25fa6 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:32.890467 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e2321eb6-57e6-46ea-9044-49c6d0e25fa6 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:32.891124 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e2321eb6-57e6-46ea-9044-49c6d0e25fa6 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:32.891715 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e2321eb6-57e6-46ea-9044-49c6d0e25fa6 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:33.150476 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-79ed924e-078e-4a40-bba0-329e4b616f72 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:33.151596 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-79ed924e-078e-4a40-bba0-329e4b616f72 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: e34e2be3-4e61-46dc-b4a4-5abcd3df9b85] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:33.171542 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79ed924e-078e-4a40-bba0-329e4b616f72 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:33.174232 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79ed924e-078e-4a40-bba0-329e4b616f72 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:33.174753 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79ed924e-078e-4a40-bba0-329e4b616f72 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:33.175502 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79ed924e-078e-4a40-bba0-329e4b616f72 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:33.181289 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79ed924e-078e-4a40-bba0-329e4b616f72 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:33.181966 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79ed924e-078e-4a40-bba0-329e4b616f72 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:33.211818 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e2321eb6-57e6-46ea-9044-49c6d0e25fa6 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b1b8cac30242c0b4e2ea4188709ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763b15912eb44f848a81f813e359e8aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:33.220906 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e2321eb6-57e6-46ea-9044-49c6d0e25fa6 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] 10.222.0.67 "GET /compute/v2.1/servers/e57d695e-a816-47e1-9ee9-595425bb9b2d" status: 200 len: 1325 microversion: 2.1 time: 0.349771 Sep 16 12:56:33.227917 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1294/2658] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:32 2022] GET /compute/v2.1/servers/e57d695e-a816-47e1-9ee9-595425bb9b2d => generated 1325 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:33.434853 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-79ed924e-078e-4a40-bba0-329e4b616f72 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:33.461213 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-79ed924e-078e-4a40-bba0-329e4b616f72 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85" status: 200 len: 1527 microversion: 2.1 time: 0.325474 Sep 16 12:56:33.462055 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1365/2659] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:33 2022] GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 => generated 1527 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:33.547401 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-86dcb45d-3ec5-481b-b80b-dd2dfc06f1f4 req-50d73eb4-d00c-4c14-81ef-c5f787dd4d28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e34e2be3-4e61-46dc-b4a4-5abcd3df9b85", "name": "network-vif-deleted", "tag": "27d81681-82f2-4f23-8f72-9075e99f9ca1"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:33.565065 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-86dcb45d-3ec5-481b-b80b-dd2dfc06f1f4 req-50d73eb4-d00c-4c14-81ef-c5f787dd4d28 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:33.565631 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-86dcb45d-3ec5-481b-b80b-dd2dfc06f1f4 req-50d73eb4-d00c-4c14-81ef-c5f787dd4d28 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:33.566071 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-86dcb45d-3ec5-481b-b80b-dd2dfc06f1f4 req-50d73eb4-d00c-4c14-81ef-c5f787dd4d28 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:33.602502 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-282e9488-658b-4a8e-b625-8d7cf3081b4f tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:33.603340 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-282e9488-658b-4a8e-b625-8d7cf3081b4f tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:33.614436 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-86dcb45d-3ec5-481b-b80b-dd2dfc06f1f4 req-50d73eb4-d00c-4c14-81ef-c5f787dd4d28 service nova] Creating event network-vif-deleted:27d81681-82f2-4f23-8f72-9075e99f9ca1 for instance e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 on n-h2-858094-4 Sep 16 12:56:33.620968 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-282e9488-658b-4a8e-b625-8d7cf3081b4f tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:33.621824 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-282e9488-658b-4a8e-b625-8d7cf3081b4f tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:33.622583 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-282e9488-658b-4a8e-b625-8d7cf3081b4f tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:33.624000 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-282e9488-658b-4a8e-b625-8d7cf3081b4f tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:33.624597 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-282e9488-658b-4a8e-b625-8d7cf3081b4f tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:33.625478 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-282e9488-658b-4a8e-b625-8d7cf3081b4f tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:33.629777 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-86dcb45d-3ec5-481b-b80b-dd2dfc06f1f4 req-50d73eb4-d00c-4c14-81ef-c5f787dd4d28 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083582 Sep 16 12:56:33.633549 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1295/2660] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:56:33.731669 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-282e9488-658b-4a8e-b625-8d7cf3081b4f tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:33.775112 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-282e9488-658b-4a8e-b625-8d7cf3081b4f tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:33.778749 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-282e9488-658b-4a8e-b625-8d7cf3081b4f tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:33.797728 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-282e9488-658b-4a8e-b625-8d7cf3081b4f tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1446 microversion: 2.75 time: 0.202222 Sep 16 12:56:33.822787 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1366/2661] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:33 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1446 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:56:33.849013 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e8cc244d-1cec-4a8d-ab55-8a90ab791e49 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:33.849566 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e8cc244d-1cec-4a8d-ab55-8a90ab791e49 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:33.865808 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e8cc244d-1cec-4a8d-ab55-8a90ab791e49 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:33.872445 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e8cc244d-1cec-4a8d-ab55-8a90ab791e49 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:33.872916 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e8cc244d-1cec-4a8d-ab55-8a90ab791e49 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:33.873670 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e8cc244d-1cec-4a8d-ab55-8a90ab791e49 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:33.880884 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e8cc244d-1cec-4a8d-ab55-8a90ab791e49 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:33.882059 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e8cc244d-1cec-4a8d-ab55-8a90ab791e49 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:33.932222 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-f31dcc8d-3e85-4ee5-8ff4-f5ae7a2b13d5 req-219a983b-4e4f-4b9a-b463-0146a913699a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e57d695e-a816-47e1-9ee9-595425bb9b2d", "name": "network-vif-plugged", "status": "completed", "tag": "cf81024f-1cc9-4e39-bc87-63f3220631ae"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:33.947483 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:56:33.952480 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f31dcc8d-3e85-4ee5-8ff4-f5ae7a2b13d5 req-219a983b-4e4f-4b9a-b463-0146a913699a service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:33.954865 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f31dcc8d-3e85-4ee5-8ff4-f5ae7a2b13d5 req-219a983b-4e4f-4b9a-b463-0146a913699a service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:33.959803 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f31dcc8d-3e85-4ee5-8ff4-f5ae7a2b13d5 req-219a983b-4e4f-4b9a-b463-0146a913699a service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:33.978645 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-f31dcc8d-3e85-4ee5-8ff4-f5ae7a2b13d5 req-219a983b-4e4f-4b9a-b463-0146a913699a service nova] Creating event network-vif-plugged:cf81024f-1cc9-4e39-bc87-63f3220631ae for instance e57d695e-a816-47e1-9ee9-595425bb9b2d on n-h2-858094-4 Sep 16 12:56:33.986048 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-f31dcc8d-3e85-4ee5-8ff4-f5ae7a2b13d5 req-219a983b-4e4f-4b9a-b463-0146a913699a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058020 Sep 16 12:56:33.987349 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1367/2662] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:56:34.114981 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e8cc244d-1cec-4a8d-ab55-8a90ab791e49 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:34.124681 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e8cc244d-1cec-4a8d-ab55-8a90ab791e49 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1491 microversion: 2.1 time: 0.280864 Sep 16 12:56:34.125388 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1296/2663] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:33 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1491 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:34.251879 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ac32c8da-8ea3-43c6-be86-f1cff17a8e85 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:34.252899 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ac32c8da-8ea3-43c6-be86-f1cff17a8e85 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] [instance: e57d695e-a816-47e1-9ee9-595425bb9b2d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:34.263192 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac32c8da-8ea3-43c6-be86-f1cff17a8e85 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:34.263684 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac32c8da-8ea3-43c6-be86-f1cff17a8e85 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:34.264178 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac32c8da-8ea3-43c6-be86-f1cff17a8e85 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:34.265776 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac32c8da-8ea3-43c6-be86-f1cff17a8e85 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:34.266235 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac32c8da-8ea3-43c6-be86-f1cff17a8e85 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:34.266687 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac32c8da-8ea3-43c6-be86-f1cff17a8e85 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:34.486186 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-694e069e-3e26-46eb-b25d-041cf8a88198 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:34.486797 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-694e069e-3e26-46eb-b25d-041cf8a88198 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: e34e2be3-4e61-46dc-b4a4-5abcd3df9b85] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:34.494409 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-694e069e-3e26-46eb-b25d-041cf8a88198 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:34.494896 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-694e069e-3e26-46eb-b25d-041cf8a88198 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:34.495519 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-694e069e-3e26-46eb-b25d-041cf8a88198 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:34.496240 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-694e069e-3e26-46eb-b25d-041cf8a88198 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:34.496693 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-694e069e-3e26-46eb-b25d-041cf8a88198 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:34.497105 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-694e069e-3e26-46eb-b25d-041cf8a88198 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:34.515417 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ac32c8da-8ea3-43c6-be86-f1cff17a8e85 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b1b8cac30242c0b4e2ea4188709ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763b15912eb44f848a81f813e359e8aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:34.519673 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:56:34.529561 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ac32c8da-8ea3-43c6-be86-f1cff17a8e85 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] 10.222.0.67 "GET /compute/v2.1/servers/e57d695e-a816-47e1-9ee9-595425bb9b2d" status: 200 len: 1325 microversion: 2.1 time: 0.281979 Sep 16 12:56:34.530314 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1368/2664] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:34 2022] GET /compute/v2.1/servers/e57d695e-a816-47e1-9ee9-595425bb9b2d => generated 1325 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:34.559431 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-694e069e-3e26-46eb-b25d-041cf8a88198 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:34.559908 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-694e069e-3e26-46eb-b25d-041cf8a88198 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:34.560367 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-694e069e-3e26-46eb-b25d-041cf8a88198 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:34.561318 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-694e069e-3e26-46eb-b25d-041cf8a88198 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lazy-loading 'fault' on Instance uuid e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:56:34.608907 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-694e069e-3e26-46eb-b25d-041cf8a88198 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:34.620851 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-694e069e-3e26-46eb-b25d-041cf8a88198 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85" status: 200 len: 1314 microversion: 2.1 time: 0.138283 Sep 16 12:56:34.623533 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1297/2665] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:34 2022] GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 => generated 1314 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:34.852640 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-98a97593-4e76-4bbd-8bf5-a75ed180c248 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:34.853342 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-98a97593-4e76-4bbd-8bf5-a75ed180c248 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:34.863734 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98a97593-4e76-4bbd-8bf5-a75ed180c248 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:34.864274 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98a97593-4e76-4bbd-8bf5-a75ed180c248 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:34.864726 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98a97593-4e76-4bbd-8bf5-a75ed180c248 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:34.865439 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98a97593-4e76-4bbd-8bf5-a75ed180c248 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:34.865902 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98a97593-4e76-4bbd-8bf5-a75ed180c248 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:34.866339 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98a97593-4e76-4bbd-8bf5-a75ed180c248 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:34.978045 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-98a97593-4e76-4bbd-8bf5-a75ed180c248 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:35.001770 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-98a97593-4e76-4bbd-8bf5-a75ed180c248 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:35.005661 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-98a97593-4e76-4bbd-8bf5-a75ed180c248 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:35.025663 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-98a97593-4e76-4bbd-8bf5-a75ed180c248 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1446 microversion: 2.75 time: 0.178960 Sep 16 12:56:35.026893 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1369/2666] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:34 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1446 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:56:35.152914 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-03f2acea-f290-4292-884e-9dd143eb798d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:35.153531 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-03f2acea-f290-4292-884e-9dd143eb798d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:35.162031 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-03f2acea-f290-4292-884e-9dd143eb798d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:35.162517 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-03f2acea-f290-4292-884e-9dd143eb798d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:35.163125 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-03f2acea-f290-4292-884e-9dd143eb798d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:35.163836 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-03f2acea-f290-4292-884e-9dd143eb798d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:35.164325 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-03f2acea-f290-4292-884e-9dd143eb798d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:35.164900 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-03f2acea-f290-4292-884e-9dd143eb798d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:35.319629 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-03f2acea-f290-4292-884e-9dd143eb798d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:35.328270 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-03f2acea-f290-4292-884e-9dd143eb798d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1491 microversion: 2.1 time: 0.179183 Sep 16 12:56:35.329446 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1298/2667] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:35 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1491 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:35.553596 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ce1e4a79-793f-490a-9ef8-835f5486516c tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:35.554876 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ce1e4a79-793f-490a-9ef8-835f5486516c tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] [instance: e57d695e-a816-47e1-9ee9-595425bb9b2d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:35.561712 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce1e4a79-793f-490a-9ef8-835f5486516c tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:35.562225 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce1e4a79-793f-490a-9ef8-835f5486516c tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:35.562659 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce1e4a79-793f-490a-9ef8-835f5486516c tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:35.563550 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce1e4a79-793f-490a-9ef8-835f5486516c tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:35.564181 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce1e4a79-793f-490a-9ef8-835f5486516c tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:35.564610 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce1e4a79-793f-490a-9ef8-835f5486516c tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:35.650843 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fea8b383-3588-416f-b46c-1e3eb77abf50 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:35.651478 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-fea8b383-3588-416f-b46c-1e3eb77abf50 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: e34e2be3-4e61-46dc-b4a4-5abcd3df9b85] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:35.662464 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fea8b383-3588-416f-b46c-1e3eb77abf50 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:35.662971 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fea8b383-3588-416f-b46c-1e3eb77abf50 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:35.663412 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fea8b383-3588-416f-b46c-1e3eb77abf50 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:35.669337 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fea8b383-3588-416f-b46c-1e3eb77abf50 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:35.669824 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fea8b383-3588-416f-b46c-1e3eb77abf50 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:35.670551 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fea8b383-3588-416f-b46c-1e3eb77abf50 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:35.699280 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-fea8b383-3588-416f-b46c-1e3eb77abf50 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] HTTP exception thrown: Instance e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 could not be found. Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fea8b383-3588-416f-b46c-1e3eb77abf50 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Request method failure captured: Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 HTTP/1.1 Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHI8T7yGPRAc3c6MPrRyvBn0sjBikdgUA-hTw5OumPvmvZhNIoTMLBQsFbEvX79WgLzGGVd0Tyjqag2EpyljzbSAD20HzRS6IC0nQYJFElFV23Kk60KxHTZ6ulzDMTvWGrZByycegK-oPTtKgXmNPoQq1DgmwbeXyTMrKt2g_ITcKgg Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: c88ea8e8750c440e86d3c1eb4ab6110e Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c88ea8e8750c440e86d3c1eb4ab6110e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: c88ea8e8750c440e86d3c1eb4ab6110e Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ImagesOneServerNegativeTestJSON-682956668-project Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 973378f0eed8476eb41a29d5ce57ed65 Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-682956668-project Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 could not be found. Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'e34e2be3-4e61-46dc-b4a4-5abcd3df9b85'} Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 could not be found. Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 could not be found. Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:35.701004 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:35.714553 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:35.714553 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:35.714553 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:56:35.714553 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:56:35.714553 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:56:35.714553 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:56:35.714553 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 could not be found. Sep 16 12:56:35.714553 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:35.714553 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fea8b383-3588-416f-b46c-1e3eb77abf50 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Returning 404 to user: Instance e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:56:35.714553 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-fea8b383-3588-416f-b46c-1e3eb77abf50 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85" status: 404 len: 111 microversion: 2.1 time: 0.057145 Sep 16 12:56:35.714553 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1299/2668] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:35 2022] GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:56:35.737216 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ce1e4a79-793f-490a-9ef8-835f5486516c tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b1b8cac30242c0b4e2ea4188709ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763b15912eb44f848a81f813e359e8aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:35.747372 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ce1e4a79-793f-490a-9ef8-835f5486516c tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] 10.222.0.67 "GET /compute/v2.1/servers/e57d695e-a816-47e1-9ee9-595425bb9b2d" status: 200 len: 1325 microversion: 2.1 time: 0.198241 Sep 16 12:56:35.748391 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1370/2669] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:35 2022] GET /compute/v2.1/servers/e57d695e-a816-47e1-9ee9-595425bb9b2d => generated 1325 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:35.836043 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-22c2e15e-fc7f-4e95-95c7-460a11d71fc7 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-2131841505", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:35.923697 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-22c2e15e-fc7f-4e95-95c7-460a11d71fc7 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] validate_networks() for [('4f690fd7-a007-4db5-a7d2-6b0378c9fb20', None, None, None, None, None)] {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:56:36.055835 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-842be69c-5ef8-4087-95be-64fa1f2ffc90 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:36.056461 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-842be69c-5ef8-4087-95be-64fa1f2ffc90 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:36.063956 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-842be69c-5ef8-4087-95be-64fa1f2ffc90 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:36.064947 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-842be69c-5ef8-4087-95be-64fa1f2ffc90 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:36.065843 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-842be69c-5ef8-4087-95be-64fa1f2ffc90 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:36.067811 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-842be69c-5ef8-4087-95be-64fa1f2ffc90 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:36.068843 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-842be69c-5ef8-4087-95be-64fa1f2ffc90 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:36.069667 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-842be69c-5ef8-4087-95be-64fa1f2ffc90 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:36.191796 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-842be69c-5ef8-4087-95be-64fa1f2ffc90 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:36.202544 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-842be69c-5ef8-4087-95be-64fa1f2ffc90 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:36.207460 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-842be69c-5ef8-4087-95be-64fa1f2ffc90 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:36.228349 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-842be69c-5ef8-4087-95be-64fa1f2ffc90 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1446 microversion: 2.75 time: 0.172956 Sep 16 12:56:36.229122 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1371/2670] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:36 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1446 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:56:36.355346 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-54478cc0-49c4-4971-ae37-23325b0ac800 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:36.357393 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-54478cc0-49c4-4971-ae37-23325b0ac800 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:36.393125 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54478cc0-49c4-4971-ae37-23325b0ac800 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:36.396554 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54478cc0-49c4-4971-ae37-23325b0ac800 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:36.396904 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54478cc0-49c4-4971-ae37-23325b0ac800 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:36.397672 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54478cc0-49c4-4971-ae37-23325b0ac800 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:36.398147 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54478cc0-49c4-4971-ae37-23325b0ac800 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:36.398576 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54478cc0-49c4-4971-ae37-23325b0ac800 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:36.582844 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-22c2e15e-fc7f-4e95-95c7-460a11d71fc7 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:56:36.583484 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-22c2e15e-fc7f-4e95-95c7-460a11d71fc7 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:56:36.585558 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-22c2e15e-fc7f-4e95-95c7-460a11d71fc7 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:56:36.586485 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-22c2e15e-fc7f-4e95-95c7-460a11d71fc7 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:56:36.586923 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-22c2e15e-fc7f-4e95-95c7-460a11d71fc7 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:56:36.602927 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-22c2e15e-fc7f-4e95-95c7-460a11d71fc7 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:36.605408 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-22c2e15e-fc7f-4e95-95c7-460a11d71fc7 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:36.606194 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-22c2e15e-fc7f-4e95-95c7-460a11d71fc7 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:36.607659 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-22c2e15e-fc7f-4e95-95c7-460a11d71fc7 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:36.609456 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-22c2e15e-fc7f-4e95-95c7-460a11d71fc7 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:36.610310 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-22c2e15e-fc7f-4e95-95c7-460a11d71fc7 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:36.640101 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-22c2e15e-fc7f-4e95-95c7-460a11d71fc7 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Getting quotas for project c88ea8e8750c440e86d3c1eb4ab6110e. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:56:36.650447 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-22c2e15e-fc7f-4e95-95c7-460a11d71fc7 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Getting quotas for user 973378f0eed8476eb41a29d5ce57ed65 and project c88ea8e8750c440e86d3c1eb4ab6110e. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:56:36.659104 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-54478cc0-49c4-4971-ae37-23325b0ac800 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:36.673306 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-22c2e15e-fc7f-4e95-95c7-460a11d71fc7 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:56:36.678898 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-54478cc0-49c4-4971-ae37-23325b0ac800 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1497 microversion: 2.1 time: 0.328474 Sep 16 12:56:36.693155 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-22c2e15e-fc7f-4e95-95c7-460a11d71fc7 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: ad6fc799-e1eb-4bac-8d47-7f4460ca629e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:56:36.697859 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1372/2671] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:36 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1497 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:56:36.734719 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-96046e7f-0755-4911-9d9f-27338397ade2 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:36.735862 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-96046e7f-0755-4911-9d9f-27338397ade2 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:36.752426 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96046e7f-0755-4911-9d9f-27338397ade2 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:36.754138 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96046e7f-0755-4911-9d9f-27338397ade2 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:36.755151 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96046e7f-0755-4911-9d9f-27338397ade2 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:36.756800 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96046e7f-0755-4911-9d9f-27338397ade2 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:36.757898 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96046e7f-0755-4911-9d9f-27338397ade2 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:36.759210 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96046e7f-0755-4911-9d9f-27338397ade2 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:36.764596 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-22c2e15e-fc7f-4e95-95c7-460a11d71fc7 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.933582 Sep 16 12:56:36.766011 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1300/2672] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:56:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:56:36.776173 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-db32181b-2445-464b-8fa8-c1c1986e3f15 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:36.777221 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-db32181b-2445-464b-8fa8-c1c1986e3f15 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] [instance: e57d695e-a816-47e1-9ee9-595425bb9b2d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:36.786776 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db32181b-2445-464b-8fa8-c1c1986e3f15 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:36.787646 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db32181b-2445-464b-8fa8-c1c1986e3f15 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:36.788717 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db32181b-2445-464b-8fa8-c1c1986e3f15 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:36.790259 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db32181b-2445-464b-8fa8-c1c1986e3f15 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:36.790871 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db32181b-2445-464b-8fa8-c1c1986e3f15 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:36.791503 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db32181b-2445-464b-8fa8-c1c1986e3f15 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:36.869722 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-96046e7f-0755-4911-9d9f-27338397ade2 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:56:37.023731 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-96046e7f-0755-4911-9d9f-27338397ade2 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 204 len: 0 microversion: 2.1 time: 0.299909 Sep 16 12:56:37.024368 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1373/2673] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:56:36 2022] DELETE /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 12:56:37.040554 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-eb69df00-7c2c-46d7-bae3-0a2b3dc095b0 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:37.041297 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-eb69df00-7c2c-46d7-bae3-0a2b3dc095b0 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: ad6fc799-e1eb-4bac-8d47-7f4460ca629e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:37.196690 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-eb69df00-7c2c-46d7-bae3-0a2b3dc095b0 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:37.209753 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-eb69df00-7c2c-46d7-bae3-0a2b3dc095b0 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/ad6fc799-e1eb-4bac-8d47-7f4460ca629e" status: 200 len: 1225 microversion: 2.1 time: 0.181243 Sep 16 12:56:37.210361 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1374/2674] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:37 2022] GET /compute/v2.1/servers/ad6fc799-e1eb-4bac-8d47-7f4460ca629e => generated 1225 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:37.224774 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2294d5c2-7979-4e74-83a7-a5b4b4c8fa2d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:37.226655 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2294d5c2-7979-4e74-83a7-a5b4b4c8fa2d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:37.256809 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2294d5c2-7979-4e74-83a7-a5b4b4c8fa2d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:37.258055 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2294d5c2-7979-4e74-83a7-a5b4b4c8fa2d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:37.258622 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2294d5c2-7979-4e74-83a7-a5b4b4c8fa2d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:37.259531 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2294d5c2-7979-4e74-83a7-a5b4b4c8fa2d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:37.267242 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2294d5c2-7979-4e74-83a7-a5b4b4c8fa2d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:37.269701 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2294d5c2-7979-4e74-83a7-a5b4b4c8fa2d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:37.355879 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-db32181b-2445-464b-8fa8-c1c1986e3f15 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b1b8cac30242c0b4e2ea4188709ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763b15912eb44f848a81f813e359e8aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:37.367068 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-db32181b-2445-464b-8fa8-c1c1986e3f15 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] 10.222.0.67 "GET /compute/v2.1/servers/e57d695e-a816-47e1-9ee9-595425bb9b2d" status: 200 len: 1522 microversion: 2.1 time: 0.598960 Sep 16 12:56:37.368743 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1301/2675] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:36 2022] GET /compute/v2.1/servers/e57d695e-a816-47e1-9ee9-595425bb9b2d => generated 1522 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:37.378988 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6e9838de-3206-46dc-a35d-a28312f1888f tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:37.379985 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6e9838de-3206-46dc-a35d-a28312f1888f tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:37.406532 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6e9838de-3206-46dc-a35d-a28312f1888f tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:37.408929 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6e9838de-3206-46dc-a35d-a28312f1888f tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:37.411870 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6e9838de-3206-46dc-a35d-a28312f1888f tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:37.413828 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6e9838de-3206-46dc-a35d-a28312f1888f tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:37.417166 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6e9838de-3206-46dc-a35d-a28312f1888f tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:37.417989 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6e9838de-3206-46dc-a35d-a28312f1888f tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:37.605452 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6e9838de-3206-46dc-a35d-a28312f1888f tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:37.626550 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6e9838de-3206-46dc-a35d-a28312f1888f tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:37.631241 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6e9838de-3206-46dc-a35d-a28312f1888f tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:37.667686 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6e9838de-3206-46dc-a35d-a28312f1888f tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1446 microversion: 2.75 time: 0.293508 Sep 16 12:56:37.668691 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1302/2676] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:37 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1446 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:56:37.680307 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b97fdc07-92aa-4ac5-ba9a-29a015d65208 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:37.680307 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b97fdc07-92aa-4ac5-ba9a-29a015d65208 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] [instance: e57d695e-a816-47e1-9ee9-595425bb9b2d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:37.687149 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b97fdc07-92aa-4ac5-ba9a-29a015d65208 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:37.688230 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b97fdc07-92aa-4ac5-ba9a-29a015d65208 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:37.689040 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b97fdc07-92aa-4ac5-ba9a-29a015d65208 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:37.689995 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b97fdc07-92aa-4ac5-ba9a-29a015d65208 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:37.691393 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b97fdc07-92aa-4ac5-ba9a-29a015d65208 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:37.692239 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b97fdc07-92aa-4ac5-ba9a-29a015d65208 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:37.726859 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2294d5c2-7979-4e74-83a7-a5b4b4c8fa2d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:37.739426 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2294d5c2-7979-4e74-83a7-a5b4b4c8fa2d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1503 microversion: 2.1 time: 0.526531 Sep 16 12:56:37.740033 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1375/2677] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:37 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1503 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:37.807447 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-b97fdc07-92aa-4ac5-ba9a-29a015d65208 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] HTTP exception thrown: Action 999 not found Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b97fdc07-92aa-4ac5-ba9a-29a015d65208 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Request method failure captured: Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/e57d695e-a816-47e1-9ee9-595425bb9b2d/os-instance-actions/999 HTTP/1.1 Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHJ05cQvMOMVuLX0fyA__SIReU1pZMrJLC5DCzC3gWE-WUpx8ei5AEj718Nw5cy2LGtjl9kUYzesvPDQv-r8FLzNaRpLy_6cH9vsaenbhAOSFT7vkcoqQvU7mKF7wvEP1y0AG9Nh5PHEJcdGWkq-4XV9os8pg9qOLdxOBN09uxOcAqs Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 763b15912eb44f848a81f813e359e8aa Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1847534424 Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/763b15912eb44f848a81f813e359e8aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/763b15912eb44f848a81f813e359e8aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_763b15912eb44f848a81f813e359e8aa", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/763b15912eb44f848a81f813e359e8aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1847534424 Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 763b15912eb44f848a81f813e359e8aa Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1847534424 Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-InstanceActionsNegativeTestJSON-1847534424-project Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 02b1b8cac30242c0b4e2ea4188709ec7 Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1847534424-project Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: exception: Action 999 not found Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'server_id': 'e57d695e-a816-47e1-9ee9-595425bb9b2d', 'id': '999'} Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Sep 16 12:56:37.813413 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:37.819023 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b97fdc07-92aa-4ac5-ba9a-29a015d65208 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Returning 404 to user: Action 999 not found {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:56:37.823658 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b97fdc07-92aa-4ac5-ba9a-29a015d65208 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] 10.222.0.67 "GET /compute/v2.1/servers/e57d695e-a816-47e1-9ee9-595425bb9b2d/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.151468 Sep 16 12:56:37.827031 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1303/2678] 10.222.0.67 () {58 vars in 1308 bytes} [Fri Sep 16 12:56:37 2022] GET /compute/v2.1/servers/e57d695e-a816-47e1-9ee9-595425bb9b2d/os-instance-actions/999 => generated 66 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 12:56:37.837559 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9526e4a8-bf74-44d3-90e0-302081c77f7b tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Calling method '.version_select at 0x7f1035a9a700>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:37.838934 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9526e4a8-bf74-44d3-90e0-302081c77f7b tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] [instance: fcbe7f61-8abe-4715-8dcb-f90fab07283c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:37.856887 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-9526e4a8-bf74-44d3-90e0-302081c77f7b tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] HTTP exception thrown: Instance fcbe7f61-8abe-4715-8dcb-f90fab07283c could not be found. Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9526e4a8-bf74-44d3-90e0-302081c77f7b tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Request method failure captured: Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/fcbe7f61-8abe-4715-8dcb-f90fab07283c/os-instance-actions HTTP/1.1 Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHJ05cQvMOMVuLX0fyA__SIReU1pZMrJLC5DCzC3gWE-WUpx8ei5AEj718Nw5cy2LGtjl9kUYzesvPDQv-r8FLzNaRpLy_6cH9vsaenbhAOSFT7vkcoqQvU7mKF7wvEP1y0AG9Nh5PHEJcdGWkq-4XV9os8pg9qOLdxOBN09uxOcAqs Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 763b15912eb44f848a81f813e359e8aa Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1847534424 Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/763b15912eb44f848a81f813e359e8aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/763b15912eb44f848a81f813e359e8aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_763b15912eb44f848a81f813e359e8aa", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/763b15912eb44f848a81f813e359e8aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1847534424 Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 763b15912eb44f848a81f813e359e8aa Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1847534424 Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-InstanceActionsNegativeTestJSON-1847534424-project Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 02b1b8cac30242c0b4e2ea4188709ec7 Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1847534424-project Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance fcbe7f61-8abe-4715-8dcb-f90fab07283c could not be found. Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'server_id': 'fcbe7f61-8abe-4715-8dcb-f90fab07283c'} Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcbe7f61-8abe-4715-8dcb-f90fab07283c could not be found. Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:56:37.877191 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:56:37.881149 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcbe7f61-8abe-4715-8dcb-f90fab07283c could not be found. Sep 16 12:56:37.881149 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:37.881149 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:37.881149 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:37.881149 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:37.881149 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:56:37.881149 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:56:37.881149 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:56:37.881149 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:56:37.881149 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcbe7f61-8abe-4715-8dcb-f90fab07283c could not be found. Sep 16 12:56:37.881149 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:37.887659 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9526e4a8-bf74-44d3-90e0-302081c77f7b tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Returning 404 to user: Instance fcbe7f61-8abe-4715-8dcb-f90fab07283c could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:56:37.889389 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9526e4a8-bf74-44d3-90e0-302081c77f7b tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] 10.222.0.67 "GET /compute/v2.1/servers/fcbe7f61-8abe-4715-8dcb-f90fab07283c/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.055770 Sep 16 12:56:37.890540 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1376/2679] 10.222.0.67 () {58 vars in 1296 bytes} [Fri Sep 16 12:56:37 2022] GET /compute/v2.1/servers/fcbe7f61-8abe-4715-8dcb-f90fab07283c/os-instance-actions => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 12:56:37.904014 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d9f07c05-be53-4648-bd7d-7685c316766c tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:37.905336 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d9f07c05-be53-4648-bd7d-7685c316766c tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] [instance: e57d695e-a816-47e1-9ee9-595425bb9b2d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:37.918271 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d9f07c05-be53-4648-bd7d-7685c316766c tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:37.921850 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d9f07c05-be53-4648-bd7d-7685c316766c tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:37.922789 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d9f07c05-be53-4648-bd7d-7685c316766c tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:37.923872 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d9f07c05-be53-4648-bd7d-7685c316766c tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:37.924452 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d9f07c05-be53-4648-bd7d-7685c316766c tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:37.925082 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d9f07c05-be53-4648-bd7d-7685c316766c tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:37.963810 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d9f07c05-be53-4648-bd7d-7685c316766c tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] [instance: e57d695e-a816-47e1-9ee9-595425bb9b2d] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:56:38.171613 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d9f07c05-be53-4648-bd7d-7685c316766c tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e57d695e-a816-47e1-9ee9-595425bb9b2d" status: 204 len: 0 microversion: 2.1 time: 0.272587 Sep 16 12:56:38.174551 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1304/2680] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:56:37 2022] DELETE /compute/v2.1/servers/e57d695e-a816-47e1-9ee9-595425bb9b2d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:56:38.185410 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1d688487-5c55-4955-8925-b94d9de8d0e2 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:38.186464 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1d688487-5c55-4955-8925-b94d9de8d0e2 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] [instance: e57d695e-a816-47e1-9ee9-595425bb9b2d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:38.199470 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d688487-5c55-4955-8925-b94d9de8d0e2 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:38.200567 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d688487-5c55-4955-8925-b94d9de8d0e2 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:38.201176 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d688487-5c55-4955-8925-b94d9de8d0e2 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:38.202063 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d688487-5c55-4955-8925-b94d9de8d0e2 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:38.202672 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d688487-5c55-4955-8925-b94d9de8d0e2 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:38.203310 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d688487-5c55-4955-8925-b94d9de8d0e2 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:38.238849 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c3c242a4-3565-4226-919a-d826fa44b5c7 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:38.240489 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c3c242a4-3565-4226-919a-d826fa44b5c7 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: ad6fc799-e1eb-4bac-8d47-7f4460ca629e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:38.253503 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c3c242a4-3565-4226-919a-d826fa44b5c7 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:38.266780 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c3c242a4-3565-4226-919a-d826fa44b5c7 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:38.267490 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c3c242a4-3565-4226-919a-d826fa44b5c7 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:38.268441 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c3c242a4-3565-4226-919a-d826fa44b5c7 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:38.269091 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c3c242a4-3565-4226-919a-d826fa44b5c7 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:38.269962 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c3c242a4-3565-4226-919a-d826fa44b5c7 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:38.427696 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c3c242a4-3565-4226-919a-d826fa44b5c7 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:38.446414 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:56:38.450000 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c3c242a4-3565-4226-919a-d826fa44b5c7 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/ad6fc799-e1eb-4bac-8d47-7f4460ca629e" status: 200 len: 1277 microversion: 2.1 time: 0.218401 Sep 16 12:56:38.451012 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1305/2681] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:38 2022] GET /compute/v2.1/servers/ad6fc799-e1eb-4bac-8d47-7f4460ca629e => generated 1277 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:56:38.570405 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1d688487-5c55-4955-8925-b94d9de8d0e2 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b1b8cac30242c0b4e2ea4188709ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763b15912eb44f848a81f813e359e8aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:38.606429 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1d688487-5c55-4955-8925-b94d9de8d0e2 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] 10.222.0.67 "GET /compute/v2.1/servers/e57d695e-a816-47e1-9ee9-595425bb9b2d" status: 200 len: 1528 microversion: 2.1 time: 0.412326 Sep 16 12:56:38.607879 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1377/2682] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:38 2022] GET /compute/v2.1/servers/e57d695e-a816-47e1-9ee9-595425bb9b2d => generated 1528 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:56:38.700238 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3c617188-5585-4f3f-a526-923861b2c05c tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:38.701512 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3c617188-5585-4f3f-a526-923861b2c05c tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:38.732392 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3c617188-5585-4f3f-a526-923861b2c05c tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:38.733567 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3c617188-5585-4f3f-a526-923861b2c05c tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:38.735054 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3c617188-5585-4f3f-a526-923861b2c05c tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:38.736641 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3c617188-5585-4f3f-a526-923861b2c05c tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:38.737970 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3c617188-5585-4f3f-a526-923861b2c05c tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:38.740471 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3c617188-5585-4f3f-a526-923861b2c05c tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:38.775093 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3bced8d8-f05e-4c4e-bc33-e22f082e5cf6 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:38.775723 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3bced8d8-f05e-4c4e-bc33-e22f082e5cf6 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:38.801271 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3bced8d8-f05e-4c4e-bc33-e22f082e5cf6 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:38.802121 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3bced8d8-f05e-4c4e-bc33-e22f082e5cf6 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:38.805697 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3bced8d8-f05e-4c4e-bc33-e22f082e5cf6 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:38.806750 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3bced8d8-f05e-4c4e-bc33-e22f082e5cf6 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:38.808965 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3bced8d8-f05e-4c4e-bc33-e22f082e5cf6 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:38.809603 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3bced8d8-f05e-4c4e-bc33-e22f082e5cf6 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:38.942831 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3c617188-5585-4f3f-a526-923861b2c05c tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:38.965434 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3c617188-5585-4f3f-a526-923861b2c05c tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:38.967141 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3c617188-5585-4f3f-a526-923861b2c05c tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:38.973144 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3c617188-5585-4f3f-a526-923861b2c05c tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1446 microversion: 2.75 time: 0.277022 Sep 16 12:56:38.985911 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1306/2683] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:38 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1446 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:56:39.218767 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3bced8d8-f05e-4c4e-bc33-e22f082e5cf6 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:39.229970 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3bced8d8-f05e-4c4e-bc33-e22f082e5cf6 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1503 microversion: 2.1 time: 0.459213 Sep 16 12:56:39.245848 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1378/2684] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:38 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1503 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:56:39.477127 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b70831bb-ade4-4fb3-9331-eb1d0c8c73be tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:39.478123 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b70831bb-ade4-4fb3-9331-eb1d0c8c73be tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: ad6fc799-e1eb-4bac-8d47-7f4460ca629e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:39.501505 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b70831bb-ade4-4fb3-9331-eb1d0c8c73be tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:39.506850 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b70831bb-ade4-4fb3-9331-eb1d0c8c73be tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:39.507743 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b70831bb-ade4-4fb3-9331-eb1d0c8c73be tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:39.509384 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b70831bb-ade4-4fb3-9331-eb1d0c8c73be tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:39.511335 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b70831bb-ade4-4fb3-9331-eb1d0c8c73be tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:39.512658 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b70831bb-ade4-4fb3-9331-eb1d0c8c73be tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:39.632738 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7de970da-974c-4147-9286-aa444f5f6178 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:39.633298 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7de970da-974c-4147-9286-aa444f5f6178 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] [instance: e57d695e-a816-47e1-9ee9-595425bb9b2d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:39.645704 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7de970da-974c-4147-9286-aa444f5f6178 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:39.646139 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7de970da-974c-4147-9286-aa444f5f6178 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:39.647315 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7de970da-974c-4147-9286-aa444f5f6178 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:39.648010 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7de970da-974c-4147-9286-aa444f5f6178 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:39.648510 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7de970da-974c-4147-9286-aa444f5f6178 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:39.648954 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7de970da-974c-4147-9286-aa444f5f6178 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:39.812330 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-b70831bb-ade4-4fb3-9331-eb1d0c8c73be tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:39.834852 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b70831bb-ade4-4fb3-9331-eb1d0c8c73be tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/ad6fc799-e1eb-4bac-8d47-7f4460ca629e" status: 200 len: 1277 microversion: 2.1 time: 0.363401 Sep 16 12:56:39.835827 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1307/2685] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:39 2022] GET /compute/v2.1/servers/ad6fc799-e1eb-4bac-8d47-7f4460ca629e => generated 1277 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:40.012089 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d3a31d1b-44df-416d-ab15-7fa0017c3f8a tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:40.018293 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d3a31d1b-44df-416d-ab15-7fa0017c3f8a tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:40.047339 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d3a31d1b-44df-416d-ab15-7fa0017c3f8a tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:40.048449 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d3a31d1b-44df-416d-ab15-7fa0017c3f8a tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:40.049455 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d3a31d1b-44df-416d-ab15-7fa0017c3f8a tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:40.054668 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d3a31d1b-44df-416d-ab15-7fa0017c3f8a tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:40.055452 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d3a31d1b-44df-416d-ab15-7fa0017c3f8a tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:40.056054 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d3a31d1b-44df-416d-ab15-7fa0017c3f8a tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:40.205429 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7de970da-974c-4147-9286-aa444f5f6178 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b1b8cac30242c0b4e2ea4188709ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763b15912eb44f848a81f813e359e8aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:40.234933 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7de970da-974c-4147-9286-aa444f5f6178 tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] 10.222.0.67 "GET /compute/v2.1/servers/e57d695e-a816-47e1-9ee9-595425bb9b2d" status: 200 len: 1528 microversion: 2.1 time: 0.603367 Sep 16 12:56:40.240083 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1379/2686] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:39 2022] GET /compute/v2.1/servers/e57d695e-a816-47e1-9ee9-595425bb9b2d => generated 1528 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:40.260145 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1c9b23ec-6e59-40be-aee1-9efe76372ec8 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:40.261228 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1c9b23ec-6e59-40be-aee1-9efe76372ec8 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:40.261805 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d3a31d1b-44df-416d-ab15-7fa0017c3f8a tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:40.276284 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d3a31d1b-44df-416d-ab15-7fa0017c3f8a tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:40.283333 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d3a31d1b-44df-416d-ab15-7fa0017c3f8a tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:40.285622 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c9b23ec-6e59-40be-aee1-9efe76372ec8 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:40.286433 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c9b23ec-6e59-40be-aee1-9efe76372ec8 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:40.287211 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c9b23ec-6e59-40be-aee1-9efe76372ec8 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:40.296955 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c9b23ec-6e59-40be-aee1-9efe76372ec8 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:40.297959 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d3a31d1b-44df-416d-ab15-7fa0017c3f8a tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1446 microversion: 2.75 time: 0.294502 Sep 16 12:56:40.298171 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c9b23ec-6e59-40be-aee1-9efe76372ec8 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:40.299297 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c9b23ec-6e59-40be-aee1-9efe76372ec8 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:40.317919 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1308/2687] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:40 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1446 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:56:40.835850 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1c9b23ec-6e59-40be-aee1-9efe76372ec8 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:40.860406 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-029308a7-b2af-4d27-894d-61eddb92944f tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:40.862299 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-029308a7-b2af-4d27-894d-61eddb92944f tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: ad6fc799-e1eb-4bac-8d47-7f4460ca629e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:40.863559 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1c9b23ec-6e59-40be-aee1-9efe76372ec8 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1503 microversion: 2.1 time: 0.611469 Sep 16 12:56:40.876873 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1380/2688] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:40 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1503 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:40.886522 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-029308a7-b2af-4d27-894d-61eddb92944f tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:40.887001 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-029308a7-b2af-4d27-894d-61eddb92944f tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:40.887602 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-029308a7-b2af-4d27-894d-61eddb92944f tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:40.888374 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-029308a7-b2af-4d27-894d-61eddb92944f tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:40.888833 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-029308a7-b2af-4d27-894d-61eddb92944f tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:40.889253 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-029308a7-b2af-4d27-894d-61eddb92944f tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:41.009650 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-32ce9a3e-a1f2-44fb-affb-c2a533f2946f req-f6299203-aa9d-4471-aa85-143d04f98dbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e57d695e-a816-47e1-9ee9-595425bb9b2d", "name": "network-vif-deleted", "tag": "cf81024f-1cc9-4e39-bc87-63f3220631ae"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:41.029880 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-32ce9a3e-a1f2-44fb-affb-c2a533f2946f req-f6299203-aa9d-4471-aa85-143d04f98dbc service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:41.030720 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-32ce9a3e-a1f2-44fb-affb-c2a533f2946f req-f6299203-aa9d-4471-aa85-143d04f98dbc service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:41.031727 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-32ce9a3e-a1f2-44fb-affb-c2a533f2946f req-f6299203-aa9d-4471-aa85-143d04f98dbc service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:41.058850 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-32ce9a3e-a1f2-44fb-affb-c2a533f2946f req-f6299203-aa9d-4471-aa85-143d04f98dbc service nova] Creating event network-vif-deleted:cf81024f-1cc9-4e39-bc87-63f3220631ae for instance e57d695e-a816-47e1-9ee9-595425bb9b2d on n-h2-858094-4 Sep 16 12:56:41.065210 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-32ce9a3e-a1f2-44fb-affb-c2a533f2946f req-f6299203-aa9d-4471-aa85-143d04f98dbc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059760 Sep 16 12:56:41.066971 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1381/2689] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:56:41.123127 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-029308a7-b2af-4d27-894d-61eddb92944f tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:41.139311 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-029308a7-b2af-4d27-894d-61eddb92944f tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/ad6fc799-e1eb-4bac-8d47-7f4460ca629e" status: 200 len: 1283 microversion: 2.1 time: 0.283044 Sep 16 12:56:41.139928 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1309/2690] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:40 2022] GET /compute/v2.1/servers/ad6fc799-e1eb-4bac-8d47-7f4460ca629e => generated 1283 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:56:41.265367 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fc9856a8-3336-4b5e-8de3-32e7b3eaee0f tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:41.267109 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fc9856a8-3336-4b5e-8de3-32e7b3eaee0f tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] [instance: e57d695e-a816-47e1-9ee9-595425bb9b2d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:41.279783 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc9856a8-3336-4b5e-8de3-32e7b3eaee0f tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:41.280530 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc9856a8-3336-4b5e-8de3-32e7b3eaee0f tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:41.281142 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc9856a8-3336-4b5e-8de3-32e7b3eaee0f tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:41.282056 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc9856a8-3336-4b5e-8de3-32e7b3eaee0f tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:41.282785 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc9856a8-3336-4b5e-8de3-32e7b3eaee0f tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:41.283729 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc9856a8-3336-4b5e-8de3-32e7b3eaee0f tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:41.338682 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-33b0da9d-eb55-44f0-8ff5-1dc650c23914 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:41.339612 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-33b0da9d-eb55-44f0-8ff5-1dc650c23914 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:41.353376 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-33b0da9d-eb55-44f0-8ff5-1dc650c23914 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:41.354228 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-33b0da9d-eb55-44f0-8ff5-1dc650c23914 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:41.354811 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-33b0da9d-eb55-44f0-8ff5-1dc650c23914 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:41.355764 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-33b0da9d-eb55-44f0-8ff5-1dc650c23914 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:41.356503 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-33b0da9d-eb55-44f0-8ff5-1dc650c23914 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:41.357081 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-33b0da9d-eb55-44f0-8ff5-1dc650c23914 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:41.529589 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fc9856a8-3336-4b5e-8de3-32e7b3eaee0f tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b1b8cac30242c0b4e2ea4188709ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763b15912eb44f848a81f813e359e8aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:41.532988 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-33b0da9d-eb55-44f0-8ff5-1dc650c23914 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:41.543205 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-33b0da9d-eb55-44f0-8ff5-1dc650c23914 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:41.553568 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-33b0da9d-eb55-44f0-8ff5-1dc650c23914 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:41.566871 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-33b0da9d-eb55-44f0-8ff5-1dc650c23914 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1446 microversion: 2.75 time: 0.234046 Sep 16 12:56:41.585483 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fc9856a8-3336-4b5e-8de3-32e7b3eaee0f tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] 10.222.0.67 "GET /compute/v2.1/servers/e57d695e-a816-47e1-9ee9-595425bb9b2d" status: 200 len: 1486 microversion: 2.1 time: 0.297032 Sep 16 12:56:41.587540 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1382/2691] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:41 2022] GET /compute/v2.1/servers/e57d695e-a816-47e1-9ee9-595425bb9b2d => generated 1486 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:41.589343 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1310/2692] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:41 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1446 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:56:41.889295 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2e9e9bdc-e677-4540-870c-89ebcc122600 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:41.890465 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2e9e9bdc-e677-4540-870c-89ebcc122600 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:41.904245 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e9e9bdc-e677-4540-870c-89ebcc122600 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:41.905093 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e9e9bdc-e677-4540-870c-89ebcc122600 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:41.910929 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e9e9bdc-e677-4540-870c-89ebcc122600 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:41.911971 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e9e9bdc-e677-4540-870c-89ebcc122600 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:41.912701 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e9e9bdc-e677-4540-870c-89ebcc122600 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:41.917271 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e9e9bdc-e677-4540-870c-89ebcc122600 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:42.125252 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-aefe44c2-d42c-4916-8ff8-814cf8968efd req-0757bf28-83d1-4e38-9802-24691770758e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f648b7b7-38c9-4dff-8d24-039d1b9d9115", "name": "network-vif-deleted", "tag": "71269ced-342c-468f-8025-bba5b93b85be"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:42.157604 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-aefe44c2-d42c-4916-8ff8-814cf8968efd req-0757bf28-83d1-4e38-9802-24691770758e service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:42.158183 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-aefe44c2-d42c-4916-8ff8-814cf8968efd req-0757bf28-83d1-4e38-9802-24691770758e service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:42.158720 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-aefe44c2-d42c-4916-8ff8-814cf8968efd req-0757bf28-83d1-4e38-9802-24691770758e service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:42.200303 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-aefe44c2-d42c-4916-8ff8-814cf8968efd req-0757bf28-83d1-4e38-9802-24691770758e service nova] Creating event network-vif-deleted:71269ced-342c-468f-8025-bba5b93b85be for instance f648b7b7-38c9-4dff-8d24-039d1b9d9115 on n-h1-858094-4 Sep 16 12:56:42.214890 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-aefe44c2-d42c-4916-8ff8-814cf8968efd req-0757bf28-83d1-4e38-9802-24691770758e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093765 Sep 16 12:56:42.219848 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1311/2693] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:56:42.231954 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8050e9d1-6543-4d89-adf1-adc889f25e91 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:42.237377 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8050e9d1-6543-4d89-adf1-adc889f25e91 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: ad6fc799-e1eb-4bac-8d47-7f4460ca629e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:42.255780 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8050e9d1-6543-4d89-adf1-adc889f25e91 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:42.259581 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8050e9d1-6543-4d89-adf1-adc889f25e91 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:42.260320 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8050e9d1-6543-4d89-adf1-adc889f25e91 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:42.261245 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8050e9d1-6543-4d89-adf1-adc889f25e91 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:42.265361 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8050e9d1-6543-4d89-adf1-adc889f25e91 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:42.265983 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8050e9d1-6543-4d89-adf1-adc889f25e91 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:42.414275 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2e9e9bdc-e677-4540-870c-89ebcc122600 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:42.433069 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2e9e9bdc-e677-4540-870c-89ebcc122600 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 200 len: 1461 microversion: 2.1 time: 0.546077 Sep 16 12:56:42.434051 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1383/2694] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:41 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 1461 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:42.478120 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8050e9d1-6543-4d89-adf1-adc889f25e91 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:42.486487 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8050e9d1-6543-4d89-adf1-adc889f25e91 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/ad6fc799-e1eb-4bac-8d47-7f4460ca629e" status: 200 len: 1283 microversion: 2.1 time: 0.261087 Sep 16 12:56:42.502316 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1312/2695] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:42 2022] GET /compute/v2.1/servers/ad6fc799-e1eb-4bac-8d47-7f4460ca629e => generated 1283 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:42.603736 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7e2b29fd-ff1c-4eca-b1a1-14971a6dabf6 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:42.611207 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-66a503c6-053c-441b-92cc-a6fac53fbe5e tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:42.611833 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-66a503c6-053c-441b-92cc-a6fac53fbe5e tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] [instance: e57d695e-a816-47e1-9ee9-595425bb9b2d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:42.614960 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7e2b29fd-ff1c-4eca-b1a1-14971a6dabf6 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:42.634774 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-66a503c6-053c-441b-92cc-a6fac53fbe5e tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:42.635289 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-66a503c6-053c-441b-92cc-a6fac53fbe5e tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:42.637853 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e2b29fd-ff1c-4eca-b1a1-14971a6dabf6 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:42.638358 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e2b29fd-ff1c-4eca-b1a1-14971a6dabf6 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:42.639027 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e2b29fd-ff1c-4eca-b1a1-14971a6dabf6 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:42.639744 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e2b29fd-ff1c-4eca-b1a1-14971a6dabf6 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:42.648761 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-66a503c6-053c-441b-92cc-a6fac53fbe5e tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:42.649502 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-66a503c6-053c-441b-92cc-a6fac53fbe5e tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:42.650002 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-66a503c6-053c-441b-92cc-a6fac53fbe5e tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:42.650438 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-66a503c6-053c-441b-92cc-a6fac53fbe5e tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:42.655061 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e2b29fd-ff1c-4eca-b1a1-14971a6dabf6 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:42.656371 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e2b29fd-ff1c-4eca-b1a1-14971a6dabf6 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:42.743125 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-66a503c6-053c-441b-92cc-a6fac53fbe5e tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:42.743610 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-66a503c6-053c-441b-92cc-a6fac53fbe5e tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:42.748312 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-66a503c6-053c-441b-92cc-a6fac53fbe5e tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:42.749392 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-66a503c6-053c-441b-92cc-a6fac53fbe5e tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lazy-loading 'fault' on Instance uuid e57d695e-a816-47e1-9ee9-595425bb9b2d {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:56:43.001909 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7e2b29fd-ff1c-4eca-b1a1-14971a6dabf6 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:43.015645 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7e2b29fd-ff1c-4eca-b1a1-14971a6dabf6 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:43.017599 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-66a503c6-053c-441b-92cc-a6fac53fbe5e tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b1b8cac30242c0b4e2ea4188709ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763b15912eb44f848a81f813e359e8aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:43.026232 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7e2b29fd-ff1c-4eca-b1a1-14971a6dabf6 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:43.031712 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-66a503c6-053c-441b-92cc-a6fac53fbe5e tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] 10.222.0.67 "GET /compute/v2.1/servers/e57d695e-a816-47e1-9ee9-595425bb9b2d" status: 200 len: 1315 microversion: 2.1 time: 0.424170 Sep 16 12:56:43.033051 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1313/2696] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:42 2022] GET /compute/v2.1/servers/e57d695e-a816-47e1-9ee9-595425bb9b2d => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:43.058553 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7e2b29fd-ff1c-4eca-b1a1-14971a6dabf6 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1452 microversion: 2.75 time: 0.455126 Sep 16 12:56:43.072080 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1384/2697] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:42 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1452 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:56:43.459711 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3da5fea5-3d8f-41bd-a0bc-e0d9d927d533 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:43.461283 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3da5fea5-3d8f-41bd-a0bc-e0d9d927d533 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: f648b7b7-38c9-4dff-8d24-039d1b9d9115] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:43.498315 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3da5fea5-3d8f-41bd-a0bc-e0d9d927d533 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:43.506559 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3da5fea5-3d8f-41bd-a0bc-e0d9d927d533 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:43.507438 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3da5fea5-3d8f-41bd-a0bc-e0d9d927d533 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:43.509664 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-66aae9b9-6bdf-4fad-8707-5920ae048035 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:43.510391 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-66aae9b9-6bdf-4fad-8707-5920ae048035 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: ad6fc799-e1eb-4bac-8d47-7f4460ca629e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:43.513021 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3da5fea5-3d8f-41bd-a0bc-e0d9d927d533 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:43.514879 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3da5fea5-3d8f-41bd-a0bc-e0d9d927d533 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:43.519596 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3da5fea5-3d8f-41bd-a0bc-e0d9d927d533 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:43.541671 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66aae9b9-6bdf-4fad-8707-5920ae048035 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:43.542177 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66aae9b9-6bdf-4fad-8707-5920ae048035 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:43.542615 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66aae9b9-6bdf-4fad-8707-5920ae048035 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:43.549712 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66aae9b9-6bdf-4fad-8707-5920ae048035 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:43.556433 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66aae9b9-6bdf-4fad-8707-5920ae048035 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:43.561446 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-3da5fea5-3d8f-41bd-a0bc-e0d9d927d533 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] HTTP exception thrown: Instance f648b7b7-38c9-4dff-8d24-039d1b9d9115 could not be found. Sep 16 12:56:43.563198 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66aae9b9-6bdf-4fad-8707-5920ae048035 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3da5fea5-3d8f-41bd-a0bc-e0d9d927d533 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Request method failure captured: Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 HTTP/1.1 Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHIK3azlPvAp1ptflWXilGGtuueI4cnNzc2KnI5oWefbTdJHI-I88Jow6aEYMXPu40zPDgeQWXN16rjaOiaKWI-HhdE0sQJ2xwJKqriSzZdCibwsxoi-dLdxp_nLkflI9e_Q6hKxJVTrdnjJXSGPB7w9QzoUPBGpmka8doITHJ720c0 Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: f2d50b9f6b084e40971269e8b882516c Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ServerRescueTestJSON-1678003677 Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f2d50b9f6b084e40971269e8b882516c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f2d50b9f6b084e40971269e8b882516c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f2d50b9f6b084e40971269e8b882516c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f2d50b9f6b084e40971269e8b882516c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ServerRescueTestJSON-1678003677 Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: f2d50b9f6b084e40971269e8b882516c Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ServerRescueTestJSON-1678003677 Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ServerRescueTestJSON-1678003677-project Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 1f32bbd973c449a9aeddcdfacc9a814b Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ServerRescueTestJSON-1678003677-project Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance f648b7b7-38c9-4dff-8d24-039d1b9d9115 could not be found. Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'f648b7b7-38c9-4dff-8d24-039d1b9d9115'} Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f648b7b7-38c9-4dff-8d24-039d1b9d9115 could not be found. Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f648b7b7-38c9-4dff-8d24-039d1b9d9115 could not be found. Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:43.581075 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:43.585817 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:43.585817 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:56:43.585817 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:56:43.585817 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:56:43.585817 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:56:43.585817 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f648b7b7-38c9-4dff-8d24-039d1b9d9115 could not be found. Sep 16 12:56:43.585817 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:43.591261 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3da5fea5-3d8f-41bd-a0bc-e0d9d927d533 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Returning 404 to user: Instance f648b7b7-38c9-4dff-8d24-039d1b9d9115 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:56:43.596431 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3da5fea5-3d8f-41bd-a0bc-e0d9d927d533 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115" status: 404 len: 111 microversion: 2.1 time: 0.136969 Sep 16 12:56:43.598342 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1314/2698] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:43 2022] GET /compute/v2.1/servers/f648b7b7-38c9-4dff-8d24-039d1b9d9115 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:56:43.614888 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-88cb05b0-1298-4b52-9831-86bdab02144c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:43.617805 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-88cb05b0-1298-4b52-9831-86bdab02144c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: dcadec98-4bc0-4ac3-9dfa-a17b52f40010] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:43.638217 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-88cb05b0-1298-4b52-9831-86bdab02144c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:43.639092 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-88cb05b0-1298-4b52-9831-86bdab02144c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:43.639695 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-88cb05b0-1298-4b52-9831-86bdab02144c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:43.640483 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-88cb05b0-1298-4b52-9831-86bdab02144c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:43.641658 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-88cb05b0-1298-4b52-9831-86bdab02144c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:43.646941 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-88cb05b0-1298-4b52-9831-86bdab02144c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:43.715121 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-88cb05b0-1298-4b52-9831-86bdab02144c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: dcadec98-4bc0-4ac3-9dfa-a17b52f40010] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:56:43.945135 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-88cb05b0-1298-4b52-9831-86bdab02144c tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "DELETE /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010" status: 204 len: 0 microversion: 2.1 time: 0.341343 Sep 16 12:56:43.946046 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1315/2699] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:56:43 2022] DELETE /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:56:43.955109 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f9cd7324-4ade-43b7-ba10-c2713bcbf5e9 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:43.956076 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f9cd7324-4ade-43b7-ba10-c2713bcbf5e9 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: dcadec98-4bc0-4ac3-9dfa-a17b52f40010] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:43.958948 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:56:43.981886 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f9cd7324-4ade-43b7-ba10-c2713bcbf5e9 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:43.982632 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f9cd7324-4ade-43b7-ba10-c2713bcbf5e9 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:43.983370 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f9cd7324-4ade-43b7-ba10-c2713bcbf5e9 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:43.985065 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f9cd7324-4ade-43b7-ba10-c2713bcbf5e9 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:43.985545 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f9cd7324-4ade-43b7-ba10-c2713bcbf5e9 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:43.985975 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f9cd7324-4ade-43b7-ba10-c2713bcbf5e9 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:44.056981 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-66aae9b9-6bdf-4fad-8707-5920ae048035 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:44.078940 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-66aae9b9-6bdf-4fad-8707-5920ae048035 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/ad6fc799-e1eb-4bac-8d47-7f4460ca629e" status: 200 len: 1325 microversion: 2.1 time: 0.573279 Sep 16 12:56:44.079908 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1385/2700] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:43 2022] GET /compute/v2.1/servers/ad6fc799-e1eb-4bac-8d47-7f4460ca629e => generated 1325 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:44.085907 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-35492242-a577-425e-af9e-67e7ec0daf2f tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:44.086847 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-35492242-a577-425e-af9e-67e7ec0daf2f tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] [instance: e57d695e-a816-47e1-9ee9-595425bb9b2d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:44.103902 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35492242-a577-425e-af9e-67e7ec0daf2f tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:44.104684 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35492242-a577-425e-af9e-67e7ec0daf2f tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:44.105525 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35492242-a577-425e-af9e-67e7ec0daf2f tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:44.106705 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35492242-a577-425e-af9e-67e7ec0daf2f tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:44.107324 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35492242-a577-425e-af9e-67e7ec0daf2f tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:44.107897 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35492242-a577-425e-af9e-67e7ec0daf2f tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:44.143887 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-35492242-a577-425e-af9e-67e7ec0daf2f tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] HTTP exception thrown: Instance e57d695e-a816-47e1-9ee9-595425bb9b2d could not be found. Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-35492242-a577-425e-af9e-67e7ec0daf2f tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Request method failure captured: Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/e57d695e-a816-47e1-9ee9-595425bb9b2d HTTP/1.1 Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHJ05cQvMOMVuLX0fyA__SIReU1pZMrJLC5DCzC3gWE-WUpx8ei5AEj718Nw5cy2LGtjl9kUYzesvPDQv-r8FLzNaRpLy_6cH9vsaenbhAOSFT7vkcoqQvU7mKF7wvEP1y0AG9Nh5PHEJcdGWkq-4XV9os8pg9qOLdxOBN09uxOcAqs Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 763b15912eb44f848a81f813e359e8aa Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1847534424 Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/763b15912eb44f848a81f813e359e8aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/763b15912eb44f848a81f813e359e8aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_763b15912eb44f848a81f813e359e8aa", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/763b15912eb44f848a81f813e359e8aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1847534424 Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 763b15912eb44f848a81f813e359e8aa Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1847534424 Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-InstanceActionsNegativeTestJSON-1847534424-project Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 02b1b8cac30242c0b4e2ea4188709ec7 Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1847534424-project Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance e57d695e-a816-47e1-9ee9-595425bb9b2d could not be found. Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': 'e57d695e-a816-47e1-9ee9-595425bb9b2d'} Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e57d695e-a816-47e1-9ee9-595425bb9b2d could not be found. Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e57d695e-a816-47e1-9ee9-595425bb9b2d could not be found. Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:44.146852 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:44.150644 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:44.150644 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:44.150644 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:56:44.150644 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:56:44.150644 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:56:44.150644 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:56:44.150644 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e57d695e-a816-47e1-9ee9-595425bb9b2d could not be found. Sep 16 12:56:44.150644 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:44.154733 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-35492242-a577-425e-af9e-67e7ec0daf2f tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] Returning 404 to user: Instance e57d695e-a816-47e1-9ee9-595425bb9b2d could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:56:44.156203 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-35492242-a577-425e-af9e-67e7ec0daf2f tempest-InstanceActionsNegativeTestJSON-1847534424 tempest-InstanceActionsNegativeTestJSON-1847534424-project] 10.222.0.67 "GET /compute/v2.1/servers/e57d695e-a816-47e1-9ee9-595425bb9b2d" status: 404 len: 111 microversion: 2.1 time: 0.074963 Sep 16 12:56:44.166236 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1386/2701] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:44 2022] GET /compute/v2.1/servers/e57d695e-a816-47e1-9ee9-595425bb9b2d => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:56:44.181508 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f680d5ec-3b55-46c2-ab16-99c81d6b2839 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:44.182543 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f680d5ec-3b55-46c2-ab16-99c81d6b2839 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:44.193101 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f680d5ec-3b55-46c2-ab16-99c81d6b2839 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:44.194013 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f680d5ec-3b55-46c2-ab16-99c81d6b2839 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:44.194995 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f680d5ec-3b55-46c2-ab16-99c81d6b2839 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:44.196461 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f680d5ec-3b55-46c2-ab16-99c81d6b2839 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:44.197431 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f680d5ec-3b55-46c2-ab16-99c81d6b2839 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:44.198081 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f680d5ec-3b55-46c2-ab16-99c81d6b2839 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:44.203411 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:56:44.481044 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f680d5ec-3b55-46c2-ab16-99c81d6b2839 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:44.502380 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f680d5ec-3b55-46c2-ab16-99c81d6b2839 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:44.519728 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f9cd7324-4ade-43b7-ba10-c2713bcbf5e9 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:44.529273 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f9cd7324-4ade-43b7-ba10-c2713bcbf5e9 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010" status: 200 len: 1490 microversion: 2.1 time: 0.578265 Sep 16 12:56:44.532049 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f680d5ec-3b55-46c2-ab16-99c81d6b2839 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:44.536762 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1316/2702] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:43 2022] GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010 => generated 1490 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:56:44.568168 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f680d5ec-3b55-46c2-ab16-99c81d6b2839 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1452 microversion: 2.75 time: 0.400399 Sep 16 12:56:44.568789 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1387/2703] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:44 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1452 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:56:44.886488 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-e151346c-e1cb-4cb4-9267-60100b39a623 req-f8895629-5c77-4b82-8dac-150c9646801d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad6fc799-e1eb-4bac-8d47-7f4460ca629e", "tag": "4149a920-b1bb-49b7-ae43-fff99a20a7f0"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:44.900959 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-e151346c-e1cb-4cb4-9267-60100b39a623 req-f8895629-5c77-4b82-8dac-150c9646801d service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:44.901439 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-e151346c-e1cb-4cb4-9267-60100b39a623 req-f8895629-5c77-4b82-8dac-150c9646801d service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:44.902068 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-e151346c-e1cb-4cb4-9267-60100b39a623 req-f8895629-5c77-4b82-8dac-150c9646801d service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:44.930022 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-e151346c-e1cb-4cb4-9267-60100b39a623 req-f8895629-5c77-4b82-8dac-150c9646801d service nova] Creating event network-changed:4149a920-b1bb-49b7-ae43-fff99a20a7f0 for instance ad6fc799-e1eb-4bac-8d47-7f4460ca629e on n-h2-858094-4 Sep 16 12:56:44.946687 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-e151346c-e1cb-4cb4-9267-60100b39a623 req-f8895629-5c77-4b82-8dac-150c9646801d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064106 Sep 16 12:56:44.947694 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1317/2704] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:56:45.126485 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d0eff21e-bcbf-4c1f-9bbc-742f30040156 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:45.128106 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d0eff21e-bcbf-4c1f-9bbc-742f30040156 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: ad6fc799-e1eb-4bac-8d47-7f4460ca629e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:45.143582 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0eff21e-bcbf-4c1f-9bbc-742f30040156 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:45.144460 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0eff21e-bcbf-4c1f-9bbc-742f30040156 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:45.168076 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0eff21e-bcbf-4c1f-9bbc-742f30040156 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:45.190173 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0eff21e-bcbf-4c1f-9bbc-742f30040156 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:45.201578 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0eff21e-bcbf-4c1f-9bbc-742f30040156 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:45.202035 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0eff21e-bcbf-4c1f-9bbc-742f30040156 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:45.565153 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c667ef55-2e44-4683-8cb2-4b8b6fb18df2 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:45.567752 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c667ef55-2e44-4683-8cb2-4b8b6fb18df2 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: dcadec98-4bc0-4ac3-9dfa-a17b52f40010] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:45.583481 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c667ef55-2e44-4683-8cb2-4b8b6fb18df2 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:45.584451 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c667ef55-2e44-4683-8cb2-4b8b6fb18df2 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:45.585459 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c667ef55-2e44-4683-8cb2-4b8b6fb18df2 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:45.586264 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c667ef55-2e44-4683-8cb2-4b8b6fb18df2 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:45.589107 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c667ef55-2e44-4683-8cb2-4b8b6fb18df2 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:45.589925 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c667ef55-2e44-4683-8cb2-4b8b6fb18df2 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:45.959964 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d0eff21e-bcbf-4c1f-9bbc-742f30040156 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:45.980216 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d0eff21e-bcbf-4c1f-9bbc-742f30040156 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/ad6fc799-e1eb-4bac-8d47-7f4460ca629e" status: 200 len: 1325 microversion: 2.1 time: 0.858325 Sep 16 12:56:45.981976 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1388/2705] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:45 2022] GET /compute/v2.1/servers/ad6fc799-e1eb-4bac-8d47-7f4460ca629e => generated 1325 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:45.989185 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-07a63cb2-e222-4d5a-a6db-1c7dba070834 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:45.990395 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-07a63cb2-e222-4d5a-a6db-1c7dba070834 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:45.999542 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07a63cb2-e222-4d5a-a6db-1c7dba070834 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:46.000878 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07a63cb2-e222-4d5a-a6db-1c7dba070834 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:46.010069 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07a63cb2-e222-4d5a-a6db-1c7dba070834 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:46.011319 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07a63cb2-e222-4d5a-a6db-1c7dba070834 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:46.013790 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07a63cb2-e222-4d5a-a6db-1c7dba070834 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:46.015557 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07a63cb2-e222-4d5a-a6db-1c7dba070834 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:46.068874 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c667ef55-2e44-4683-8cb2-4b8b6fb18df2 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:46.084891 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c667ef55-2e44-4683-8cb2-4b8b6fb18df2 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010" status: 200 len: 1490 microversion: 2.1 time: 0.525383 Sep 16 12:56:46.085759 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1318/2706] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:45 2022] GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010 => generated 1490 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:46.174896 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-07a63cb2-e222-4d5a-a6db-1c7dba070834 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:46.190749 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-07a63cb2-e222-4d5a-a6db-1c7dba070834 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:46.193591 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-07a63cb2-e222-4d5a-a6db-1c7dba070834 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:46.202091 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-07a63cb2-e222-4d5a-a6db-1c7dba070834 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1452 microversion: 2.75 time: 0.218503 Sep 16 12:56:46.217377 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1389/2707] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:45 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1452 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:56:47.007890 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-115a6c2b-b507-41fc-9464-3aeb9491dec5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:47.009575 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-115a6c2b-b507-41fc-9464-3aeb9491dec5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: ad6fc799-e1eb-4bac-8d47-7f4460ca629e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:47.017893 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:56:47.020591 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=6 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:56:47.032747 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-115a6c2b-b507-41fc-9464-3aeb9491dec5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:47.033387 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-115a6c2b-b507-41fc-9464-3aeb9491dec5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:47.034052 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-115a6c2b-b507-41fc-9464-3aeb9491dec5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:47.047499 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-115a6c2b-b507-41fc-9464-3aeb9491dec5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:47.048339 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-115a6c2b-b507-41fc-9464-3aeb9491dec5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:47.048980 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-115a6c2b-b507-41fc-9464-3aeb9491dec5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:47.137528 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b69db7ea-aafe-4e5d-a481-351d04f9e767 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:47.138473 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b69db7ea-aafe-4e5d-a481-351d04f9e767 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: dcadec98-4bc0-4ac3-9dfa-a17b52f40010] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:47.165164 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b69db7ea-aafe-4e5d-a481-351d04f9e767 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:47.167174 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b69db7ea-aafe-4e5d-a481-351d04f9e767 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:47.169364 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b69db7ea-aafe-4e5d-a481-351d04f9e767 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:47.174220 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b69db7ea-aafe-4e5d-a481-351d04f9e767 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:47.177702 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b69db7ea-aafe-4e5d-a481-351d04f9e767 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:47.181106 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b69db7ea-aafe-4e5d-a481-351d04f9e767 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:47.258367 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:56:47.905279 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-115a6c2b-b507-41fc-9464-3aeb9491dec5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:47.916402 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-115a6c2b-b507-41fc-9464-3aeb9491dec5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/ad6fc799-e1eb-4bac-8d47-7f4460ca629e" status: 200 len: 1325 microversion: 2.1 time: 0.915497 Sep 16 12:56:47.920764 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1319/2708] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:46 2022] GET /compute/v2.1/servers/ad6fc799-e1eb-4bac-8d47-7f4460ca629e => generated 1325 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:47.934188 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b69db7ea-aafe-4e5d-a481-351d04f9e767 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:47.938769 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b69db7ea-aafe-4e5d-a481-351d04f9e767 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010" status: 200 len: 1490 microversion: 2.1 time: 0.818197 Sep 16 12:56:47.940764 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1390/2709] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:47 2022] GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010 => generated 1490 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:47.954814 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8bd95f40-a01c-405f-b68d-cd14b9a82b59 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:47.955439 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8bd95f40-a01c-405f-b68d-cd14b9a82b59 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:47.977642 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bd95f40-a01c-405f-b68d-cd14b9a82b59 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:47.978457 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bd95f40-a01c-405f-b68d-cd14b9a82b59 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:47.979016 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bd95f40-a01c-405f-b68d-cd14b9a82b59 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:47.984510 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bd95f40-a01c-405f-b68d-cd14b9a82b59 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:47.986838 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bd95f40-a01c-405f-b68d-cd14b9a82b59 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:47.986978 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bd95f40-a01c-405f-b68d-cd14b9a82b59 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:48.225238 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6fc7528a-e370-43a5-b241-e9c5e57bfbb8 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] Action: 'create', calling method: .version_select at 0x7f1039a23b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-713930229", "description": "tempest-description-1938869998"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:48.311509 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8bd95f40-a01c-405f-b68d-cd14b9a82b59 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:48.346580 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8bd95f40-a01c-405f-b68d-cd14b9a82b59 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:48.350575 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8bd95f40-a01c-405f-b68d-cd14b9a82b59 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:48.364723 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8bd95f40-a01c-405f-b68d-cd14b9a82b59 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1437 microversion: 2.75 time: 0.422402 Sep 16 12:56:48.383720 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1320/2710] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:47 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1437 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:56:48.398964 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-30ae0040-99c8-4dd7-b652-a0b2dfd292c7 req-4660c211-296e-4bb1-be35-46334f7727dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcadec98-4bc0-4ac3-9dfa-a17b52f40010", "name": "network-vif-deleted", "tag": "60ac9746-6fd2-4524-bc83-9f6c7c18aa9f"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:48.421842 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-30ae0040-99c8-4dd7-b652-a0b2dfd292c7 req-4660c211-296e-4bb1-be35-46334f7727dd service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:48.422357 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-30ae0040-99c8-4dd7-b652-a0b2dfd292c7 req-4660c211-296e-4bb1-be35-46334f7727dd service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:48.422790 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-30ae0040-99c8-4dd7-b652-a0b2dfd292c7 req-4660c211-296e-4bb1-be35-46334f7727dd service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:48.445984 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-30ae0040-99c8-4dd7-b652-a0b2dfd292c7 req-4660c211-296e-4bb1-be35-46334f7727dd service nova] Creating event network-vif-deleted:60ac9746-6fd2-4524-bc83-9f6c7c18aa9f for instance dcadec98-4bc0-4ac3-9dfa-a17b52f40010 on n-h2-858094-4 Sep 16 12:56:48.452724 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-30ae0040-99c8-4dd7-b652-a0b2dfd292c7 req-4660c211-296e-4bb1-be35-46334f7727dd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067317 Sep 16 12:56:48.462631 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1321/2711] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:56:48.665616 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6fc7528a-e370-43a5-b241-e9c5e57bfbb8 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.680942 Sep 16 12:56:48.666931 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1391/2712] 10.222.0.67 () {60 vars in 1180 bytes} [Fri Sep 16 12:56:47 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:56:48.684969 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-164062ec-fbf9-4c2a-a7cb-c3075ea5ea4a tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] Action: 'create', calling method: .version_select at 0x7f1039a230d0>, body: {"security_group_rule": {"parent_group_id": "c2eacb66-6339-4733-a759-9c72c6e7c819", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:48.732513 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-eaf5785e-32f7-4ec9-9f21-6aec25282268 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:48.740771 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-eaf5785e-32f7-4ec9-9f21-6aec25282268 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:48.768666 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eaf5785e-32f7-4ec9-9f21-6aec25282268 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:48.774842 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eaf5785e-32f7-4ec9-9f21-6aec25282268 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:48.777768 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eaf5785e-32f7-4ec9-9f21-6aec25282268 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:48.778829 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eaf5785e-32f7-4ec9-9f21-6aec25282268 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:48.780383 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eaf5785e-32f7-4ec9-9f21-6aec25282268 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:48.782131 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eaf5785e-32f7-4ec9-9f21-6aec25282268 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:49.065941 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-eaf5785e-32f7-4ec9-9f21-6aec25282268 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:56:49.067514 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-eaf5785e-32f7-4ec9-9f21-6aec25282268 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:56:49.068967 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-eaf5785e-32f7-4ec9-9f21-6aec25282268 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:56:49.069400 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-eaf5785e-32f7-4ec9-9f21-6aec25282268 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:56:49.070513 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-eaf5785e-32f7-4ec9-9f21-6aec25282268 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:56:49.087705 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:56:49.210754 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-eaf5785e-32f7-4ec9-9f21-6aec25282268 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:49.246713 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eaf5785e-32f7-4ec9-9f21-6aec25282268 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:49.249166 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eaf5785e-32f7-4ec9-9f21-6aec25282268 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:49.249706 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eaf5785e-32f7-4ec9-9f21-6aec25282268 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:49.250368 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eaf5785e-32f7-4ec9-9f21-6aec25282268 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:49.250829 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eaf5785e-32f7-4ec9-9f21-6aec25282268 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:49.251256 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eaf5785e-32f7-4ec9-9f21-6aec25282268 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:49.288110 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-164062ec-fbf9-4c2a-a7cb-c3075ea5ea4a tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.610420 Sep 16 12:56:49.290371 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1392/2713] 10.222.0.67 () {60 vars in 1195 bytes} [Fri Sep 16 12:56:48 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:56:49.300965 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-13f39442-b477-4506-8532-23121f80816e tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:49.301618 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-13f39442-b477-4506-8532-23121f80816e tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: ad6fc799-e1eb-4bac-8d47-7f4460ca629e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:49.325732 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13f39442-b477-4506-8532-23121f80816e tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:49.327823 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13f39442-b477-4506-8532-23121f80816e tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:49.330740 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13f39442-b477-4506-8532-23121f80816e tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:49.331746 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13f39442-b477-4506-8532-23121f80816e tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:49.333797 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13f39442-b477-4506-8532-23121f80816e tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:49.334540 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13f39442-b477-4506-8532-23121f80816e tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:49.496507 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-eaf5785e-32f7-4ec9-9f21-6aec25282268 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lazy-loading 'services' on Instance uuid 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:56:49.534873 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-eaf5785e-32f7-4ec9-9f21-6aec25282268 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b/action" status: 202 len: 1940 microversion: 2.75 time: 1.069384 Sep 16 12:56:49.543792 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1322/2714] 10.222.0.67 () {62 vars in 1319 bytes} [Fri Sep 16 12:56:48 2022] POST /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b/action => generated 1940 bytes in 1072 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 16 12:56:49.550601 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1be65dc3-bf9a-486b-8a40-5c101bbfe621 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:49.551323 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-1be65dc3-bf9a-486b-8a40-5c101bbfe621 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: dcadec98-4bc0-4ac3-9dfa-a17b52f40010] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:49.562880 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1be65dc3-bf9a-486b-8a40-5c101bbfe621 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:49.563520 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1be65dc3-bf9a-486b-8a40-5c101bbfe621 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:49.563912 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1be65dc3-bf9a-486b-8a40-5c101bbfe621 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:49.564597 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1be65dc3-bf9a-486b-8a40-5c101bbfe621 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:49.575667 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1be65dc3-bf9a-486b-8a40-5c101bbfe621 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:49.576489 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1be65dc3-bf9a-486b-8a40-5c101bbfe621 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:49.624630 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-13f39442-b477-4506-8532-23121f80816e tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:49.638710 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-13f39442-b477-4506-8532-23121f80816e tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/ad6fc799-e1eb-4bac-8d47-7f4460ca629e" status: 200 len: 1325 microversion: 2.1 time: 0.346917 Sep 16 12:56:49.639760 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1393/2715] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:49 2022] GET /compute/v2.1/servers/ad6fc799-e1eb-4bac-8d47-7f4460ca629e => generated 1325 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:49.656676 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b9bc943c-1bb7-40fc-a625-2e266286505e tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] Action: 'create', calling method: .version_select at 0x7f103526e040>, body: {"security_group_rule": {"parent_group_id": "c2eacb66-6339-4733-a759-9c72c6e7c819", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:49.674610 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1be65dc3-bf9a-486b-8a40-5c101bbfe621 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:49.675197 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1be65dc3-bf9a-486b-8a40-5c101bbfe621 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:49.675779 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1be65dc3-bf9a-486b-8a40-5c101bbfe621 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:49.676413 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-1be65dc3-bf9a-486b-8a40-5c101bbfe621 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lazy-loading 'fault' on Instance uuid dcadec98-4bc0-4ac3-9dfa-a17b52f40010 {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:56:49.764763 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1be65dc3-bf9a-486b-8a40-5c101bbfe621 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32bbd973c449a9aeddcdfacc9a814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d50b9f6b084e40971269e8b882516c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:49.778728 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1be65dc3-bf9a-486b-8a40-5c101bbfe621 tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010" status: 200 len: 1303 microversion: 2.1 time: 0.238975 Sep 16 12:56:49.779790 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1323/2716] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:49 2022] GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010 => generated 1303 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:49.783788 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-b9bc943c-1bb7-40fc-a625-2e266286505e tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] HTTP exception thrown: This rule already exists in group c2eacb66-6339-4733-a759-9c72c6e7c819 Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b9bc943c-1bb7-40fc-a625-2e266286505e tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] Request method failure captured: Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 138 Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHKPct3Kt1ezolQcZv_MQjl5KVpRvi2u_8_pEjyuNDt7hSbcTUTZ8QLc_hbu9yy28Z-naN5a1y8Pmyzj8os2JaXq49G0QiD4LKdqz4Srg3UrwaTxz2T_MCQ4F29C2XpLxyMRE8K2FuYsk0O43YhIcww3scyRyR0WoEtnGJv8fRSOKnI Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: bf37eb99b7e245d4a3d02414a3af163f Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-665619390 Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bf37eb99b7e245d4a3d02414a3af163f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/bf37eb99b7e245d4a3d02414a3af163f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_bf37eb99b7e245d4a3d02414a3af163f", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bf37eb99b7e245d4a3d02414a3af163f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-665619390 Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: bf37eb99b7e245d4a3d02414a3af163f Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-665619390 Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-665619390-project Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: c8b7f2e5ef264ad9b96458ff51e748d2 Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-665619390-project Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: {"security_group_rule": {"parent_group_id": "c2eacb66-6339-4733-a759-9c72c6e7c819", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: exception: This rule already exists in group c2eacb66-6339-4733-a759-9c72c6e7c819 Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c2eacb66-6339-4733-a759-9c72c6e7c819', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group c2eacb66-6339-4733-a759-9c72c6e7c819 Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group c2eacb66-6339-4733-a759-9c72c6e7c819 Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:56:49.786499 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:56:49.790880 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:56:49.790880 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:56:49.790880 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group c2eacb66-6339-4733-a759-9c72c6e7c819 Sep 16 12:56:49.790880 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:49.790880 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b9bc943c-1bb7-40fc-a625-2e266286505e tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] Returning 400 to user: This rule already exists in group c2eacb66-6339-4733-a759-9c72c6e7c819 {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:56:49.790880 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b9bc943c-1bb7-40fc-a625-2e266286505e tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.146989 Sep 16 12:56:49.790880 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1394/2717] 10.222.0.67 () {60 vars in 1195 bytes} [Fri Sep 16 12:56:49 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 12:56:49.792801 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-bed64132-e019-4f1f-b725-28b2f1c64bd4 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:49.793532 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-bed64132-e019-4f1f-b725-28b2f1c64bd4 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:49.799438 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9cb06723-29ba-4bad-8efd-c9258068b4bf tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] Calling method '.version_select at 0x7f1039a23ca0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:49.832576 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bed64132-e019-4f1f-b725-28b2f1c64bd4 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:49.834786 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bed64132-e019-4f1f-b725-28b2f1c64bd4 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:49.835351 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bed64132-e019-4f1f-b725-28b2f1c64bd4 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:49.837204 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bed64132-e019-4f1f-b725-28b2f1c64bd4 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:49.837842 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bed64132-e019-4f1f-b725-28b2f1c64bd4 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:49.838284 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bed64132-e019-4f1f-b725-28b2f1c64bd4 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:50.000836 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-bed64132-e019-4f1f-b725-28b2f1c64bd4 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lazy-loading 'services' on Instance uuid 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:56:50.055080 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-bed64132-e019-4f1f-b725-28b2f1c64bd4 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1927 microversion: 2.75 time: 0.273899 Sep 16 12:56:50.057771 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1324/2718] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:49 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1927 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:56:50.138102 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d63cdfbb-e739-4bca-afd5-c452cdc19b4e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1388029442", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "1e927054-126f-4e94-8719-fa14f3244a7f"}], "block_device_mapping_v2": [{"uuid": "49bf00fb-eca3-40d9-b2cf-b56c571e0084", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:50.236033 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-d63cdfbb-e739-4bca-afd5-c452cdc19b4e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] validate_networks() for [('1e927054-126f-4e94-8719-fa14f3244a7f', None, None, None, None, None)] {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:56:50.241889 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9cb06723-29ba-4bad-8efd-c9258068b4bf tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-group-rules/3e4ada2c-5cea-4cfe-9bdb-0335689a3ae6" status: 202 len: 0 microversion: 2.1 time: 0.446841 Sep 16 12:56:50.242815 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1395/2719] 10.222.0.67 () {58 vars in 1287 bytes} [Fri Sep 16 12:56:49 2022] DELETE /compute/v2.1/os-security-group-rules/3e4ada2c-5cea-4cfe-9bdb-0335689a3ae6 => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 12:56:50.252402 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dbb91ab8-971a-4505-b671-dd56d6301f34 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] Action: 'create', calling method: .version_select at 0x7f1039a23790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1132533270", "description": "tempest-description-857971640"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:50.623144 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dbb91ab8-971a-4505-b671-dd56d6301f34 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.374688 Sep 16 12:56:50.623754 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1396/2720] 10.222.0.67 () {60 vars in 1180 bytes} [Fri Sep 16 12:56:50 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:56:50.638373 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9b77208d-1199-4a37-820b-b62928a6fd05 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] Action: 'create', calling method: .version_select at 0x7f1035a21c10>, body: {"security_group_rule": {"parent_group_id": "5a7d720e-dd46-4f34-af70-7464e4e8cd30", "ip_protocol": "tcp", "from_port": 694371016, "to_port": 22}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:50.934003 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-9b77208d-1199-4a37-820b-b62928a6fd05 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] HTTP exception thrown: Invalid port range 694371016:22. Former value cannot be greater than the later Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9b77208d-1199-4a37-820b-b62928a6fd05 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] Request method failure captured: Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 145 Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHKPct3Kt1ezolQcZv_MQjl5KVpRvi2u_8_pEjyuNDt7hSbcTUTZ8QLc_hbu9yy28Z-naN5a1y8Pmyzj8os2JaXq49G0QiD4LKdqz4Srg3UrwaTxz2T_MCQ4F29C2XpLxyMRE8K2FuYsk0O43YhIcww3scyRyR0WoEtnGJv8fRSOKnI Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: bf37eb99b7e245d4a3d02414a3af163f Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-665619390 Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bf37eb99b7e245d4a3d02414a3af163f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/bf37eb99b7e245d4a3d02414a3af163f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_bf37eb99b7e245d4a3d02414a3af163f", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bf37eb99b7e245d4a3d02414a3af163f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-665619390 Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: bf37eb99b7e245d4a3d02414a3af163f Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-665619390 Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-665619390-project Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: c8b7f2e5ef264ad9b96458ff51e748d2 Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-665619390-project Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: {"security_group_rule": {"parent_group_id": "5a7d720e-dd46-4f34-af70-7464e4e8cd30", "ip_protocol": "tcp", "from_port": 694371016, "to_port": 22}} Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: exception: Invalid port range 694371016:22. Former value cannot be greater than the later Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'body': {'security_group_rule': {'parent_group_id': '5a7d720e-dd46-4f34-af70-7464e4e8cd30', 'ip_protocol': 'tcp', 'from_port': 694371016, 'to_port': 22}}} Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 694371016:22. Former value cannot be greater than the later Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 694371016:22. Former value cannot be greater than the later Sep 16 12:56:50.935564 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:50.939842 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:50.939842 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:50.939842 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:50.939842 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:56:50.939842 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:56:50.939842 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:56:50.939842 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:56:50.939842 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 694371016:22. Former value cannot be greater than the later Sep 16 12:56:50.939842 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:50.941691 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9b77208d-1199-4a37-820b-b62928a6fd05 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] Returning 400 to user: Invalid port range 694371016:22. Former value cannot be greater than the later {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:56:50.943251 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9b77208d-1199-4a37-820b-b62928a6fd05 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.308685 Sep 16 12:56:50.944457 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1397/2721] 10.222.0.67 () {60 vars in 1195 bytes} [Fri Sep 16 12:56:50 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 311 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 12:56:50.952169 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-20127f88-06c5-49f8-88f4-1f03803e0da2 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:50.952804 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-20127f88-06c5-49f8-88f4-1f03803e0da2 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: ad6fc799-e1eb-4bac-8d47-7f4460ca629e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:50.969256 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-20127f88-06c5-49f8-88f4-1f03803e0da2 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:50.970294 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-20127f88-06c5-49f8-88f4-1f03803e0da2 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:50.970955 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-20127f88-06c5-49f8-88f4-1f03803e0da2 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:50.971839 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-20127f88-06c5-49f8-88f4-1f03803e0da2 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:50.972497 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-20127f88-06c5-49f8-88f4-1f03803e0da2 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:50.973630 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-20127f88-06c5-49f8-88f4-1f03803e0da2 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:51.055181 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-d63cdfbb-e739-4bca-afd5-c452cdc19b4e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:56:51.055642 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-d63cdfbb-e739-4bca-afd5-c452cdc19b4e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:56:51.056471 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-d63cdfbb-e739-4bca-afd5-c452cdc19b4e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:56:51.056916 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-d63cdfbb-e739-4bca-afd5-c452cdc19b4e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:56:51.057335 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-d63cdfbb-e739-4bca-afd5-c452cdc19b4e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:56:51.102145 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d63cdfbb-e739-4bca-afd5-c452cdc19b4e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:51.102655 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d63cdfbb-e739-4bca-afd5-c452cdc19b4e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:51.103084 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d63cdfbb-e739-4bca-afd5-c452cdc19b4e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:51.103829 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d63cdfbb-e739-4bca-afd5-c452cdc19b4e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:51.104732 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d63cdfbb-e739-4bca-afd5-c452cdc19b4e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:51.105177 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d63cdfbb-e739-4bca-afd5-c452cdc19b4e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:51.152765 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-d63cdfbb-e739-4bca-afd5-c452cdc19b4e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Getting quotas for project da915844493a4928ac8830897afa126f. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:56:51.169247 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-d63cdfbb-e739-4bca-afd5-c452cdc19b4e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Getting quotas for user ab6ca4cf98e14358bf8e0f625812fbb9 and project da915844493a4928ac8830897afa126f. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:56:51.255787 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d63cdfbb-e739-4bca-afd5-c452cdc19b4e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:56:51.257984 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d63cdfbb-e739-4bca-afd5-c452cdc19b4e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='49bf00fb-eca3-40d9-b2cf-b56c571e0084',volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:56:51.327136 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-20127f88-06c5-49f8-88f4-1f03803e0da2 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:51.349169 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-20127f88-06c5-49f8-88f4-1f03803e0da2 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/ad6fc799-e1eb-4bac-8d47-7f4460ca629e" status: 200 len: 1325 microversion: 2.1 time: 0.401104 Sep 16 12:56:51.367301 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1398/2722] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:50 2022] GET /compute/v2.1/servers/ad6fc799-e1eb-4bac-8d47-7f4460ca629e => generated 1325 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:51.374098 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-292c4023-045b-4e74-b631-c5c1f25b657d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:51.375378 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-292c4023-045b-4e74-b631-c5c1f25b657d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] [instance: dcadec98-4bc0-4ac3-9dfa-a17b52f40010] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:51.382962 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-292c4023-045b-4e74-b631-c5c1f25b657d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:51.383944 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-292c4023-045b-4e74-b631-c5c1f25b657d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:51.384836 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-292c4023-045b-4e74-b631-c5c1f25b657d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:51.385838 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-292c4023-045b-4e74-b631-c5c1f25b657d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:51.386758 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-292c4023-045b-4e74-b631-c5c1f25b657d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:51.388232 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-292c4023-045b-4e74-b631-c5c1f25b657d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:51.420685 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-292c4023-045b-4e74-b631-c5c1f25b657d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] HTTP exception thrown: Instance dcadec98-4bc0-4ac3-9dfa-a17b52f40010 could not be found. Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-292c4023-045b-4e74-b631-c5c1f25b657d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Request method failure captured: Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010 HTTP/1.1 Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHIK3azlPvAp1ptflWXilGGtuueI4cnNzc2KnI5oWefbTdJHI-I88Jow6aEYMXPu40zPDgeQWXN16rjaOiaKWI-HhdE0sQJ2xwJKqriSzZdCibwsxoi-dLdxp_nLkflI9e_Q6hKxJVTrdnjJXSGPB7w9QzoUPBGpmka8doITHJ720c0 Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: f2d50b9f6b084e40971269e8b882516c Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerRescueTestJSON-1678003677 Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f2d50b9f6b084e40971269e8b882516c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f2d50b9f6b084e40971269e8b882516c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f2d50b9f6b084e40971269e8b882516c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f2d50b9f6b084e40971269e8b882516c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ServerRescueTestJSON-1678003677 Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: f2d50b9f6b084e40971269e8b882516c Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerRescueTestJSON-1678003677 Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ServerRescueTestJSON-1678003677-project Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 1f32bbd973c449a9aeddcdfacc9a814b Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ServerRescueTestJSON-1678003677-project Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance dcadec98-4bc0-4ac3-9dfa-a17b52f40010 could not be found. Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': 'dcadec98-4bc0-4ac3-9dfa-a17b52f40010'} Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcadec98-4bc0-4ac3-9dfa-a17b52f40010 could not be found. Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcadec98-4bc0-4ac3-9dfa-a17b52f40010 could not be found. Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:51.424504 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:51.429419 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:51.429419 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:56:51.429419 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:56:51.429419 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:56:51.429419 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:56:51.429419 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcadec98-4bc0-4ac3-9dfa-a17b52f40010 could not be found. Sep 16 12:56:51.429419 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:51.429419 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-292c4023-045b-4e74-b631-c5c1f25b657d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] Returning 404 to user: Instance dcadec98-4bc0-4ac3-9dfa-a17b52f40010 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:56:51.429419 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-292c4023-045b-4e74-b631-c5c1f25b657d tempest-ServerRescueTestJSON-1678003677 tempest-ServerRescueTestJSON-1678003677-project] 10.222.0.67 "GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010" status: 404 len: 111 microversion: 2.1 time: 0.056584 Sep 16 12:56:51.430667 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1399/2723] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:51 2022] GET /compute/v2.1/servers/dcadec98-4bc0-4ac3-9dfa-a17b52f40010 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:56:51.441728 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f7b83361-75de-4bb0-b57e-cf0991e83660 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] Action: 'create', calling method: .version_select at 0x7f1039a335e0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-381781827", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:51.446694 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-f7b83361-75de-4bb0-b57e-cf0991e83660 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] HTTP exception thrown: Security group id should be uuid Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f7b83361-75de-4bb0-b57e-cf0991e83660 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] Request method failure captured: Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 130 Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHKPct3Kt1ezolQcZv_MQjl5KVpRvi2u_8_pEjyuNDt7hSbcTUTZ8QLc_hbu9yy28Z-naN5a1y8Pmyzj8os2JaXq49G0QiD4LKdqz4Srg3UrwaTxz2T_MCQ4F29C2XpLxyMRE8K2FuYsk0O43YhIcww3scyRyR0WoEtnGJv8fRSOKnI Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: bf37eb99b7e245d4a3d02414a3af163f Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-665619390 Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bf37eb99b7e245d4a3d02414a3af163f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/bf37eb99b7e245d4a3d02414a3af163f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_bf37eb99b7e245d4a3d02414a3af163f", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bf37eb99b7e245d4a3d02414a3af163f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-665619390 Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: bf37eb99b7e245d4a3d02414a3af163f Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-665619390 Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-665619390-project Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: c8b7f2e5ef264ad9b96458ff51e748d2 Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-665619390-project Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-381781827", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: exception: Security group id should be uuid Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-381781827', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:56:51.450145 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:56:51.454586 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Sep 16 12:56:51.454586 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:51.454586 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f7b83361-75de-4bb0-b57e-cf0991e83660 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] Returning 400 to user: Security group id should be uuid {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:56:51.454586 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f7b83361-75de-4bb0-b57e-cf0991e83660 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.021485 Sep 16 12:56:51.456088 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1400/2724] 10.222.0.67 () {60 vars in 1195 bytes} [Fri Sep 16 12:56:51 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 16 12:56:51.468645 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ed1435fc-3e33-4f6a-a7c3-74f5b28a0f84 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:51.469262 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ed1435fc-3e33-4f6a-a7c3-74f5b28a0f84 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:51.485619 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d63cdfbb-e739-4bca-afd5-c452cdc19b4e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.356903 Sep 16 12:56:51.491436 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed1435fc-3e33-4f6a-a7c3-74f5b28a0f84 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:51.492265 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed1435fc-3e33-4f6a-a7c3-74f5b28a0f84 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:51.492861 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed1435fc-3e33-4f6a-a7c3-74f5b28a0f84 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:51.493507 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1325/2725] 10.222.0.67 () {62 vars in 1188 bytes} [Fri Sep 16 12:56:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1366 msecs (HTTP/1.1 202) 10 headers in 453 bytes (3 switches on core 0) Sep 16 12:56:51.493756 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed1435fc-3e33-4f6a-a7c3-74f5b28a0f84 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:51.494223 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed1435fc-3e33-4f6a-a7c3-74f5b28a0f84 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:51.494646 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed1435fc-3e33-4f6a-a7c3-74f5b28a0f84 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:51.499557 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4447de41-028d-47fb-9032-a063cb8560cd tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] Action: 'create', calling method: .version_select at 0x7f1034a2ed30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1693775271", "description": "tempest-description-1124180113"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:51.689521 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-ed1435fc-3e33-4f6a-a7c3-74f5b28a0f84 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lazy-loading 'services' on Instance uuid 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:56:51.737159 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ed1435fc-3e33-4f6a-a7c3-74f5b28a0f84 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1927 microversion: 2.75 time: 0.276760 Sep 16 12:56:51.738236 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1401/2726] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:51 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1927 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:56:51.749443 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-775f9000-2cc1-4700-83b3-bca7655e2915 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:51.750068 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-775f9000-2cc1-4700-83b3-bca7655e2915 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:51.943597 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-775f9000-2cc1-4700-83b3-bca7655e2915 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:51.955755 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-775f9000-2cc1-4700-83b3-bca7655e2915 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:51.967373 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-775f9000-2cc1-4700-83b3-bca7655e2915 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:51.978510 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-775f9000-2cc1-4700-83b3-bca7655e2915 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1104 microversion: 2.25 time: 0.235124 Sep 16 12:56:51.979191 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1402/2727] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:51 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1104 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:56:52.223821 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4447de41-028d-47fb-9032-a063cb8560cd tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.726880 Sep 16 12:56:52.236236 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1326/2728] 10.222.0.67 () {60 vars in 1180 bytes} [Fri Sep 16 12:56:51 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:56:52.250586 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-640c073c-854b-4702-b5f9-1c6d2eb26f0e tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] Action: 'create', calling method: .version_select at 0x7f1039982c10>, body: {"security_group_rule": {"parent_group_id": "8496ed6f-c16e-45be-89f1-9ecd69f7b453", "ip_protocol": "tempest-999-926626454", "from_port": 22, "to_port": 22}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:52.379290 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-72bf9c3d-e5d5-419c-96c3-2dfde49687b5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:52.381336 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-72bf9c3d-e5d5-419c-96c3-2dfde49687b5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: ad6fc799-e1eb-4bac-8d47-7f4460ca629e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:52.397033 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-72bf9c3d-e5d5-419c-96c3-2dfde49687b5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:52.397827 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-72bf9c3d-e5d5-419c-96c3-2dfde49687b5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:52.398987 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-72bf9c3d-e5d5-419c-96c3-2dfde49687b5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:52.400987 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-72bf9c3d-e5d5-419c-96c3-2dfde49687b5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:52.404670 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-72bf9c3d-e5d5-419c-96c3-2dfde49687b5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:52.405144 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-72bf9c3d-e5d5-419c-96c3-2dfde49687b5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:52.535816 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-640c073c-854b-4702-b5f9-1c6d2eb26f0e tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] HTTP exception thrown: Invalid IP protocol tempest-999-926626454. Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-640c073c-854b-4702-b5f9-1c6d2eb26f0e tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] Request method failure captured: Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 156 Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHKPct3Kt1ezolQcZv_MQjl5KVpRvi2u_8_pEjyuNDt7hSbcTUTZ8QLc_hbu9yy28Z-naN5a1y8Pmyzj8os2JaXq49G0QiD4LKdqz4Srg3UrwaTxz2T_MCQ4F29C2XpLxyMRE8K2FuYsk0O43YhIcww3scyRyR0WoEtnGJv8fRSOKnI Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: bf37eb99b7e245d4a3d02414a3af163f Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-665619390 Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bf37eb99b7e245d4a3d02414a3af163f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/bf37eb99b7e245d4a3d02414a3af163f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_bf37eb99b7e245d4a3d02414a3af163f", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bf37eb99b7e245d4a3d02414a3af163f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-665619390 Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: bf37eb99b7e245d4a3d02414a3af163f Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-665619390 Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-665619390-project Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: c8b7f2e5ef264ad9b96458ff51e748d2 Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-665619390-project Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: {"security_group_rule": {"parent_group_id": "8496ed6f-c16e-45be-89f1-9ecd69f7b453", "ip_protocol": "tempest-999-926626454", "from_port": 22, "to_port": 22}} Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: exception: Invalid IP protocol tempest-999-926626454. Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'body': {'security_group_rule': {'parent_group_id': '8496ed6f-c16e-45be-89f1-9ecd69f7b453', 'ip_protocol': 'tempest-999-926626454', 'from_port': 22, 'to_port': 22}}} Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-926626454. Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-926626454. Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:52.537777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:52.541503 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:52.541503 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:52.541503 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:56:52.541503 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:56:52.541503 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:56:52.541503 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:56:52.541503 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-926626454. Sep 16 12:56:52.541503 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:52.541503 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-640c073c-854b-4702-b5f9-1c6d2eb26f0e tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] Returning 400 to user: Invalid IP protocol tempest-999-926626454. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:56:52.541503 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-640c073c-854b-4702-b5f9-1c6d2eb26f0e tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.298171 Sep 16 12:56:52.542052 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1403/2729] 10.222.0.67 () {60 vars in 1195 bytes} [Fri Sep 16 12:56:52 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 299 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 16 12:56:52.560744 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-09f00455-ddd1-48e9-aa94-2add5bb65ec3 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] Action: 'create', calling method: .version_select at 0x7f10399ce700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1315755061", "description": "tempest-description-1755856060"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:52.816156 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-72bf9c3d-e5d5-419c-96c3-2dfde49687b5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:52.830403 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-72bf9c3d-e5d5-419c-96c3-2dfde49687b5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/ad6fc799-e1eb-4bac-8d47-7f4460ca629e" status: 200 len: 1325 microversion: 2.1 time: 0.454994 Sep 16 12:56:52.849728 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1327/2730] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:52 2022] GET /compute/v2.1/servers/ad6fc799-e1eb-4bac-8d47-7f4460ca629e => generated 1325 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:52.851092 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-25b2c2cc-0578-488f-a9f1-2056e4f2ab36 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:52.851729 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-25b2c2cc-0578-488f-a9f1-2056e4f2ab36 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:52.866774 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-25b2c2cc-0578-488f-a9f1-2056e4f2ab36 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:52.867241 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-25b2c2cc-0578-488f-a9f1-2056e4f2ab36 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:52.867965 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-25b2c2cc-0578-488f-a9f1-2056e4f2ab36 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:52.888086 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-25b2c2cc-0578-488f-a9f1-2056e4f2ab36 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:52.888608 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-25b2c2cc-0578-488f-a9f1-2056e4f2ab36 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:52.889049 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-25b2c2cc-0578-488f-a9f1-2056e4f2ab36 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:53.104336 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-25b2c2cc-0578-488f-a9f1-2056e4f2ab36 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lazy-loading 'services' on Instance uuid 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:56:53.127171 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-25b2c2cc-0578-488f-a9f1-2056e4f2ab36 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1927 microversion: 2.75 time: 0.290875 Sep 16 12:56:53.127171 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1328/2731] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:52 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1927 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:56:53.150198 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c92fa6c9-b45d-4c02-b798-f162972a9ba8 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:53.150198 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c92fa6c9-b45d-4c02-b798-f162972a9ba8 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:53.158643 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c92fa6c9-b45d-4c02-b798-f162972a9ba8 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:53.159158 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c92fa6c9-b45d-4c02-b798-f162972a9ba8 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:53.161406 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c92fa6c9-b45d-4c02-b798-f162972a9ba8 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:53.163521 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c92fa6c9-b45d-4c02-b798-f162972a9ba8 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:53.165221 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c92fa6c9-b45d-4c02-b798-f162972a9ba8 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:53.165675 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c92fa6c9-b45d-4c02-b798-f162972a9ba8 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:53.224441 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-09f00455-ddd1-48e9-aa94-2add5bb65ec3 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.675049 Sep 16 12:56:53.234554 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1404/2732] 10.222.0.67 () {60 vars in 1180 bytes} [Fri Sep 16 12:56:52 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:56:53.245516 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d85dfa84-9d3a-480b-a3cb-5c6ff0701bd1 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] Action: 'create', calling method: .version_select at 0x7f1039982b80>, body: {"security_group_rule": {"parent_group_id": "accc8bac-c070-4c4f-98a5-ac5ad34c2ccd", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:53.283761 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c92fa6c9-b45d-4c02-b798-f162972a9ba8 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:53.299234 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c92fa6c9-b45d-4c02-b798-f162972a9ba8 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:53.300908 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c92fa6c9-b45d-4c02-b798-f162972a9ba8 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:53.305690 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c92fa6c9-b45d-4c02-b798-f162972a9ba8 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1233 microversion: 2.25 time: 0.174885 Sep 16 12:56:53.307011 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1329/2733] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:53 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1233 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:56:53.333393 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-d85dfa84-9d3a-480b-a3cb-5c6ff0701bd1 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d85dfa84-9d3a-480b-a3cb-5c6ff0701bd1 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] Request method failure captured: Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 138 Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHKPct3Kt1ezolQcZv_MQjl5KVpRvi2u_8_pEjyuNDt7hSbcTUTZ8QLc_hbu9yy28Z-naN5a1y8Pmyzj8os2JaXq49G0QiD4LKdqz4Srg3UrwaTxz2T_MCQ4F29C2XpLxyMRE8K2FuYsk0O43YhIcww3scyRyR0WoEtnGJv8fRSOKnI Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: bf37eb99b7e245d4a3d02414a3af163f Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-665619390 Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bf37eb99b7e245d4a3d02414a3af163f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/bf37eb99b7e245d4a3d02414a3af163f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_bf37eb99b7e245d4a3d02414a3af163f", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bf37eb99b7e245d4a3d02414a3af163f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-665619390 Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: bf37eb99b7e245d4a3d02414a3af163f Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-665619390 Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-665619390-project Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: c8b7f2e5ef264ad9b96458ff51e748d2 Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-665619390-project Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: {"security_group_rule": {"parent_group_id": "accc8bac-c070-4c4f-98a5-ac5ad34c2ccd", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: exception: Invalid port range 22:21. Former value cannot be greater than the later Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'accc8bac-c070-4c4f-98a5-ac5ad34c2ccd', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Sep 16 12:56:53.350865 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:53.359558 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:53.359558 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:53.359558 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:53.359558 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:56:53.359558 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:56:53.359558 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:56:53.359558 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:56:53.359558 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Sep 16 12:56:53.359558 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:53.359558 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d85dfa84-9d3a-480b-a3cb-5c6ff0701bd1 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:56:53.359558 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d85dfa84-9d3a-480b-a3cb-5c6ff0701bd1 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.112782 Sep 16 12:56:53.359558 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1405/2734] 10.222.0.67 () {60 vars in 1195 bytes} [Fri Sep 16 12:56:53 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 119 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 12:56:53.363638 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9b61d80f-8c06-428e-bb05-7a4be02738d9 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] Action: 'create', calling method: .version_select at 0x7f10349afdc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1479444625", "description": "tempest-description-1719799392"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:53.635076 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-2a847999-0aa9-49a2-a36f-789b92297052 req-0fb0ce6b-01ca-449b-a98d-0b94d2ad93cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad6fc799-e1eb-4bac-8d47-7f4460ca629e", "name": "network-vif-plugged", "status": "completed", "tag": "4149a920-b1bb-49b7-ae43-fff99a20a7f0"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:53.663597 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2a847999-0aa9-49a2-a36f-789b92297052 req-0fb0ce6b-01ca-449b-a98d-0b94d2ad93cc service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:53.667555 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2a847999-0aa9-49a2-a36f-789b92297052 req-0fb0ce6b-01ca-449b-a98d-0b94d2ad93cc service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:53.668300 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2a847999-0aa9-49a2-a36f-789b92297052 req-0fb0ce6b-01ca-449b-a98d-0b94d2ad93cc service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:53.710046 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-2a847999-0aa9-49a2-a36f-789b92297052 req-0fb0ce6b-01ca-449b-a98d-0b94d2ad93cc service nova] Creating event network-vif-plugged:4149a920-b1bb-49b7-ae43-fff99a20a7f0 for instance ad6fc799-e1eb-4bac-8d47-7f4460ca629e on n-h2-858094-4 Sep 16 12:56:53.723728 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-2a847999-0aa9-49a2-a36f-789b92297052 req-0fb0ce6b-01ca-449b-a98d-0b94d2ad93cc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093940 Sep 16 12:56:53.725740 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1406/2735] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:56:53.861209 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5b1794a6-4f18-4158-8293-18009e76ca9b tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:53.861941 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5b1794a6-4f18-4158-8293-18009e76ca9b tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: ad6fc799-e1eb-4bac-8d47-7f4460ca629e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:53.877967 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b1794a6-4f18-4158-8293-18009e76ca9b tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:53.878824 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b1794a6-4f18-4158-8293-18009e76ca9b tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:53.880532 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b1794a6-4f18-4158-8293-18009e76ca9b tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:53.881516 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b1794a6-4f18-4158-8293-18009e76ca9b tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:53.882272 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b1794a6-4f18-4158-8293-18009e76ca9b tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:53.882899 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b1794a6-4f18-4158-8293-18009e76ca9b tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:54.159678 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5b1794a6-4f18-4158-8293-18009e76ca9b tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:54.177857 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5b1794a6-4f18-4158-8293-18009e76ca9b tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/ad6fc799-e1eb-4bac-8d47-7f4460ca629e" status: 200 len: 1325 microversion: 2.1 time: 0.322647 Sep 16 12:56:54.182768 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1407/2736] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:53 2022] GET /compute/v2.1/servers/ad6fc799-e1eb-4bac-8d47-7f4460ca629e => generated 1325 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:54.207288 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7f27d118-5636-48f2-84e2-ec1989be37f7 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:54.208997 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7f27d118-5636-48f2-84e2-ec1989be37f7 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:54.216822 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f27d118-5636-48f2-84e2-ec1989be37f7 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:54.217617 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f27d118-5636-48f2-84e2-ec1989be37f7 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:54.218335 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f27d118-5636-48f2-84e2-ec1989be37f7 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:54.221538 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f27d118-5636-48f2-84e2-ec1989be37f7 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:54.222295 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f27d118-5636-48f2-84e2-ec1989be37f7 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:54.223002 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f27d118-5636-48f2-84e2-ec1989be37f7 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:54.470750 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-7f27d118-5636-48f2-84e2-ec1989be37f7 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lazy-loading 'services' on Instance uuid 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:56:54.484526 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9b61d80f-8c06-428e-bb05-7a4be02738d9 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.124665 Sep 16 12:56:54.486125 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1330/2737] 10.222.0.67 () {60 vars in 1180 bytes} [Fri Sep 16 12:56:53 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:56:54.493082 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7f27d118-5636-48f2-84e2-ec1989be37f7 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1927 microversion: 2.75 time: 0.292567 Sep 16 12:56:54.500828 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1408/2738] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:54 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1927 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:56:54.503184 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-62542355-b1d1-46c8-913e-71550646aa90 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:54.504380 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-62542355-b1d1-46c8-913e-71550646aa90 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:54.512413 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-55d88b66-b2fd-41a9-bb8e-23c8aff8748b tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] Action: 'create', calling method: .version_select at 0x7f10399ce700>, body: {"security_group_rule": {"parent_group_id": "f977340a-b365-4e1e-bd3a-a474356a0309", "ip_protocol": "tcp", "from_port": 22, "to_port": 1372423159}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:54.523077 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62542355-b1d1-46c8-913e-71550646aa90 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:54.523909 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62542355-b1d1-46c8-913e-71550646aa90 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:54.524659 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62542355-b1d1-46c8-913e-71550646aa90 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:54.525802 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62542355-b1d1-46c8-913e-71550646aa90 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:54.538313 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62542355-b1d1-46c8-913e-71550646aa90 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:54.539164 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62542355-b1d1-46c8-913e-71550646aa90 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:54.648007 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-62542355-b1d1-46c8-913e-71550646aa90 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:54.663904 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-62542355-b1d1-46c8-913e-71550646aa90 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:54.679436 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-62542355-b1d1-46c8-913e-71550646aa90 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:54.681123 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-62542355-b1d1-46c8-913e-71550646aa90 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1251 microversion: 2.25 time: 0.193551 Sep 16 12:56:54.682390 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1331/2739] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:54 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1251 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:56:54.728089 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-55d88b66-b2fd-41a9-bb8e-23c8aff8748b tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] HTTP exception thrown: Invalid port range 22:1372423159. Valid TCP ports should be between 1-65535 Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-55d88b66-b2fd-41a9-bb8e-23c8aff8748b tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] Request method failure captured: Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 146 Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHKPct3Kt1ezolQcZv_MQjl5KVpRvi2u_8_pEjyuNDt7hSbcTUTZ8QLc_hbu9yy28Z-naN5a1y8Pmyzj8os2JaXq49G0QiD4LKdqz4Srg3UrwaTxz2T_MCQ4F29C2XpLxyMRE8K2FuYsk0O43YhIcww3scyRyR0WoEtnGJv8fRSOKnI Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: bf37eb99b7e245d4a3d02414a3af163f Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-665619390 Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bf37eb99b7e245d4a3d02414a3af163f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/bf37eb99b7e245d4a3d02414a3af163f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_bf37eb99b7e245d4a3d02414a3af163f", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bf37eb99b7e245d4a3d02414a3af163f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-665619390 Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: bf37eb99b7e245d4a3d02414a3af163f Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-665619390 Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-665619390-project Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: c8b7f2e5ef264ad9b96458ff51e748d2 Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-665619390-project Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: {"security_group_rule": {"parent_group_id": "f977340a-b365-4e1e-bd3a-a474356a0309", "ip_protocol": "tcp", "from_port": 22, "to_port": 1372423159}} Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: exception: Invalid port range 22:1372423159. Valid TCP ports should be between 1-65535 Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f977340a-b365-4e1e-bd3a-a474356a0309', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1372423159}}} Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1372423159. Valid TCP ports should be between 1-65535 Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1372423159. Valid TCP ports should be between 1-65535 Sep 16 12:56:54.731138 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:54.735429 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:54.735429 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:54.735429 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:54.735429 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:56:54.735429 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:56:54.735429 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:56:54.735429 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:56:54.735429 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1372423159. Valid TCP ports should be between 1-65535 Sep 16 12:56:54.735429 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:54.739534 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-55d88b66-b2fd-41a9-bb8e-23c8aff8748b tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] Returning 400 to user: Invalid port range 22:1372423159. Valid TCP ports should be between 1-65535 {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:56:54.741274 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-55d88b66-b2fd-41a9-bb8e-23c8aff8748b tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.236388 Sep 16 12:56:54.742415 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1409/2740] 10.222.0.67 () {60 vars in 1195 bytes} [Fri Sep 16 12:56:54 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 238 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 12:56:54.760580 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a1a5c9ba-6583-475f-b062-5ddf3119faf4 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] Action: 'create', calling method: .version_select at 0x7f10349af1f0>, body: {"security_group_rule": {"parent_group_id": "e77a4b8e-69ae-49d2-a6b0-31eac8402a0a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:54.909251 n-d-858094-4 devstack@n-api.service[128780]: DEBUG neutronclient.v2_0.client [None req-a1a5c9ba-6583-475f-b062-5ddf3119faf4 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e77a4b8e-69ae-49d2-a6b0-31eac8402a0a does not exist", "detail": ""}} {{(pid=128780) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 12:56:54.910098 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.security_group_api [None req-a1a5c9ba-6583-475f-b062-5ddf3119faf4 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] Neutron security group e77a4b8e-69ae-49d2-a6b0-31eac8402a0a not found {{(pid=128780) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 16 12:56:54.911926 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-a1a5c9ba-6583-475f-b062-5ddf3119faf4 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] HTTP exception thrown: Security group e77a4b8e-69ae-49d2-a6b0-31eac8402a0a does not exist Sep 16 12:56:54.911926 n-d-858094-4 devstack@n-api.service[128780]: Neutron server returns request_ids: ['req-4cc5d1d0-1391-4dc0-837a-ff9bde25ad1c'] Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a1a5c9ba-6583-475f-b062-5ddf3119faf4 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] Request method failure captured: Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 138 Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHKPct3Kt1ezolQcZv_MQjl5KVpRvi2u_8_pEjyuNDt7hSbcTUTZ8QLc_hbu9yy28Z-naN5a1y8Pmyzj8os2JaXq49G0QiD4LKdqz4Srg3UrwaTxz2T_MCQ4F29C2XpLxyMRE8K2FuYsk0O43YhIcww3scyRyR0WoEtnGJv8fRSOKnI Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: bf37eb99b7e245d4a3d02414a3af163f Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-665619390 Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bf37eb99b7e245d4a3d02414a3af163f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/bf37eb99b7e245d4a3d02414a3af163f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_bf37eb99b7e245d4a3d02414a3af163f", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bf37eb99b7e245d4a3d02414a3af163f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-665619390 Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: bf37eb99b7e245d4a3d02414a3af163f Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-665619390 Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-665619390-project Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: c8b7f2e5ef264ad9b96458ff51e748d2 Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-665619390-project Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: {"security_group_rule": {"parent_group_id": "e77a4b8e-69ae-49d2-a6b0-31eac8402a0a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: exception: Security group e77a4b8e-69ae-49d2-a6b0-31eac8402a0a does not exist Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: Neutron server returns request_ids: ['req-4cc5d1d0-1391-4dc0-837a-ff9bde25ad1c'] Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'e77a4b8e-69ae-49d2-a6b0-31eac8402a0a', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 12:56:54.916275 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 12:56:54.919866 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 12:56:54.919866 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e77a4b8e-69ae-49d2-a6b0-31eac8402a0a does not exist Sep 16 12:56:54.919866 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4cc5d1d0-1391-4dc0-837a-ff9bde25ad1c'] Sep 16 12:56:54.919866 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:54.919866 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:54.919866 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:54.919866 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:54.919866 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Sep 16 12:56:54.919866 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Sep 16 12:56:54.919866 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 16 12:56:54.919866 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 16 12:56:54.919866 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e77a4b8e-69ae-49d2-a6b0-31eac8402a0a does not exist Sep 16 12:56:54.919866 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4cc5d1d0-1391-4dc0-837a-ff9bde25ad1c'] Sep 16 12:56:54.919866 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:54.919866 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:54.919866 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:54.919866 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:54.919866 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:56:54.919866 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:56:54.919866 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:56:54.919866 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:56:54.919866 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:56:54.919866 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:56:54.919866 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:56:54.919866 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:56:54.919866 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Sep 16 12:56:54.919866 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 16 12:56:54.919866 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e77a4b8e-69ae-49d2-a6b0-31eac8402a0a does not exist Sep 16 12:56:54.919866 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4cc5d1d0-1391-4dc0-837a-ff9bde25ad1c'] Sep 16 12:56:54.919866 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:54.919866 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:54.919866 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:54.919866 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:54.919866 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:56:54.919866 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:56:54.919866 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:56:54.919866 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:56:54.919866 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e77a4b8e-69ae-49d2-a6b0-31eac8402a0a does not exist Sep 16 12:56:54.919866 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4cc5d1d0-1391-4dc0-837a-ff9bde25ad1c'] Sep 16 12:56:54.919866 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:56:54.924417 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a1a5c9ba-6583-475f-b062-5ddf3119faf4 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] Returning 404 to user: Security group e77a4b8e-69ae-49d2-a6b0-31eac8402a0a does not exist Sep 16 12:56:54.924417 n-d-858094-4 devstack@n-api.service[128780]: Neutron server returns request_ids: ['req-4cc5d1d0-1391-4dc0-837a-ff9bde25ad1c'] {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:56:54.926019 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a1a5c9ba-6583-475f-b062-5ddf3119faf4 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.174293 Sep 16 12:56:54.926926 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1332/2741] 10.222.0.67 () {60 vars in 1195 bytes} [Fri Sep 16 12:56:54 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:56:54.940934 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-987ddaf6-9241-477f-9771-972dc3234735 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] Calling method '.version_select at 0x7f1039982040>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:55.041382 n-d-858094-4 devstack@n-api.service[128779]: DEBUG neutronclient.v2_0.client [None req-987ddaf6-9241-477f-9771-972dc3234735 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 7a7c9af1-cb41-41ae-a081-74146c3b06ed does not exist", "detail": ""}} {{(pid=128779) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 12:56:55.042573 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.security_group_api [None req-987ddaf6-9241-477f-9771-972dc3234735 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] Neutron security group rule 7a7c9af1-cb41-41ae-a081-74146c3b06ed not found {{(pid=128779) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Sep 16 12:56:55.043372 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-987ddaf6-9241-477f-9771-972dc3234735 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] HTTP exception thrown: Security group rule 7a7c9af1-cb41-41ae-a081-74146c3b06ed does not exist Sep 16 12:56:55.043372 n-d-858094-4 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-39c011b9-8007-47bc-b749-b039669654b4'] Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-987ddaf6-9241-477f-9771-972dc3234735 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] Request method failure captured: Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/os-security-group-rules/7a7c9af1-cb41-41ae-a081-74146c3b06ed HTTP/1.1 Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHKPct3Kt1ezolQcZv_MQjl5KVpRvi2u_8_pEjyuNDt7hSbcTUTZ8QLc_hbu9yy28Z-naN5a1y8Pmyzj8os2JaXq49G0QiD4LKdqz4Srg3UrwaTxz2T_MCQ4F29C2XpLxyMRE8K2FuYsk0O43YhIcww3scyRyR0WoEtnGJv8fRSOKnI Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: bf37eb99b7e245d4a3d02414a3af163f Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-665619390 Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bf37eb99b7e245d4a3d02414a3af163f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/bf37eb99b7e245d4a3d02414a3af163f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_bf37eb99b7e245d4a3d02414a3af163f", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bf37eb99b7e245d4a3d02414a3af163f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-665619390 Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: bf37eb99b7e245d4a3d02414a3af163f Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-665619390 Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-665619390-project Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: c8b7f2e5ef264ad9b96458ff51e748d2 Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-665619390-project Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: exception: Security group rule 7a7c9af1-cb41-41ae-a081-74146c3b06ed does not exist Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-39c011b9-8007-47bc-b749-b039669654b4'] Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '7a7c9af1-cb41-41ae-a081-74146c3b06ed'} Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 12:56:55.046334 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 12:56:55.050207 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 7a7c9af1-cb41-41ae-a081-74146c3b06ed does not exist Sep 16 12:56:55.050207 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-39c011b9-8007-47bc-b749-b039669654b4'] Sep 16 12:56:55.050207 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:55.050207 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:55.050207 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:55.050207 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:55.050207 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Sep 16 12:56:55.050207 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Sep 16 12:56:55.050207 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Sep 16 12:56:55.050207 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 16 12:56:55.050207 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 7a7c9af1-cb41-41ae-a081-74146c3b06ed does not exist Sep 16 12:56:55.050207 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-39c011b9-8007-47bc-b749-b039669654b4'] Sep 16 12:56:55.050207 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:55.050207 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:55.050207 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:55.050207 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:55.050207 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:56:55.050207 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:56:55.050207 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:56:55.050207 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:56:55.050207 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:56:55.050207 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:56:55.050207 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:56:55.050207 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:56:55.050207 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Sep 16 12:56:55.050207 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 16 12:56:55.050207 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 7a7c9af1-cb41-41ae-a081-74146c3b06ed does not exist Sep 16 12:56:55.050207 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-39c011b9-8007-47bc-b749-b039669654b4'] Sep 16 12:56:55.050207 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:55.050207 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:56:55.050207 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:55.050207 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:56:55.050207 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:56:55.050207 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:56:55.050207 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:56:55.050207 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:56:55.050207 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 7a7c9af1-cb41-41ae-a081-74146c3b06ed does not exist Sep 16 12:56:55.050207 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-39c011b9-8007-47bc-b749-b039669654b4'] Sep 16 12:56:55.050207 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:56:55.056904 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-987ddaf6-9241-477f-9771-972dc3234735 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] Returning 404 to user: Security group rule 7a7c9af1-cb41-41ae-a081-74146c3b06ed does not exist Sep 16 12:56:55.056904 n-d-858094-4 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-39c011b9-8007-47bc-b749-b039669654b4'] {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:56:55.058180 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-987ddaf6-9241-477f-9771-972dc3234735 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-group-rules/7a7c9af1-cb41-41ae-a081-74146c3b06ed" status: 404 len: 199 microversion: 2.1 time: 0.123493 Sep 16 12:56:55.059372 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1410/2742] 10.222.0.67 () {58 vars in 1287 bytes} [Fri Sep 16 12:56:54 2022] DELETE /compute/v2.1/os-security-group-rules/7a7c9af1-cb41-41ae-a081-74146c3b06ed => generated 199 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:56:55.073062 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-14e1de5e-30a4-4c0c-8cea-5f9152778410 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] Calling method '.version_select at 0x7f1034acedc0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:55.211148 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cf1f4b10-15be-4532-bcee-1df7d5c5c2ff tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:55.211887 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cf1f4b10-15be-4532-bcee-1df7d5c5c2ff tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: ad6fc799-e1eb-4bac-8d47-7f4460ca629e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:55.230349 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf1f4b10-15be-4532-bcee-1df7d5c5c2ff tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:55.233357 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf1f4b10-15be-4532-bcee-1df7d5c5c2ff tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:55.234070 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf1f4b10-15be-4532-bcee-1df7d5c5c2ff tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:55.237870 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf1f4b10-15be-4532-bcee-1df7d5c5c2ff tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:55.238579 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf1f4b10-15be-4532-bcee-1df7d5c5c2ff tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:55.242017 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf1f4b10-15be-4532-bcee-1df7d5c5c2ff tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:55.687333 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cf1f4b10-15be-4532-bcee-1df7d5c5c2ff tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:55.698281 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cf1f4b10-15be-4532-bcee-1df7d5c5c2ff tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/ad6fc799-e1eb-4bac-8d47-7f4460ca629e" status: 200 len: 1325 microversion: 2.1 time: 0.495594 Sep 16 12:56:55.703793 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1411/2743] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:55 2022] GET /compute/v2.1/servers/ad6fc799-e1eb-4bac-8d47-7f4460ca629e => generated 1325 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:55.724687 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5e982144-1041-45fe-91ac-4b7571ca21f1 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:55.725735 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5e982144-1041-45fe-91ac-4b7571ca21f1 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:55.736512 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e982144-1041-45fe-91ac-4b7571ca21f1 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:55.737254 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e982144-1041-45fe-91ac-4b7571ca21f1 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:55.737847 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e982144-1041-45fe-91ac-4b7571ca21f1 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:55.738743 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e982144-1041-45fe-91ac-4b7571ca21f1 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:55.739486 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e982144-1041-45fe-91ac-4b7571ca21f1 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:55.740218 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e982144-1041-45fe-91ac-4b7571ca21f1 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:55.812213 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-14e1de5e-30a4-4c0c-8cea-5f9152778410 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/f977340a-b365-4e1e-bd3a-a474356a0309" status: 202 len: 0 microversion: 2.1 time: 0.744772 Sep 16 12:56:55.814668 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1333/2744] 10.222.0.67 () {58 vars in 1272 bytes} [Fri Sep 16 12:56:55 2022] DELETE /compute/v2.1/os-security-groups/f977340a-b365-4e1e-bd3a-a474356a0309 => generated 0 bytes in 748 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:56:55.824450 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c7d70de8-1c3d-4627-ba78-0498cfe1675e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:55.828173 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c7d70de8-1c3d-4627-ba78-0498cfe1675e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:55.843334 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c7d70de8-1c3d-4627-ba78-0498cfe1675e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:55.844106 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c7d70de8-1c3d-4627-ba78-0498cfe1675e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:55.844835 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c7d70de8-1c3d-4627-ba78-0498cfe1675e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:55.845923 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c7d70de8-1c3d-4627-ba78-0498cfe1675e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:55.849692 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c7d70de8-1c3d-4627-ba78-0498cfe1675e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:55.850728 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c7d70de8-1c3d-4627-ba78-0498cfe1675e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:55.888605 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-5e982144-1041-45fe-91ac-4b7571ca21f1 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lazy-loading 'services' on Instance uuid 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:56:55.940472 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5e982144-1041-45fe-91ac-4b7571ca21f1 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1927 microversion: 2.75 time: 0.235111 Sep 16 12:56:55.941972 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1412/2745] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:55 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1927 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:56:55.949414 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-62efd351-2221-4319-a40a-8196ded978a4 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] Calling method '.version_select at 0x7f1039982ca0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:56.181985 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c7d70de8-1c3d-4627-ba78-0498cfe1675e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:56.195979 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c7d70de8-1c3d-4627-ba78-0498cfe1675e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:56.197547 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c7d70de8-1c3d-4627-ba78-0498cfe1675e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:56.198963 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c7d70de8-1c3d-4627-ba78-0498cfe1675e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1293 microversion: 2.25 time: 0.382555 Sep 16 12:56:56.208098 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1334/2746] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:55 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1293 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:56:56.677831 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-62efd351-2221-4319-a40a-8196ded978a4 tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/accc8bac-c070-4c4f-98a5-ac5ad34c2ccd" status: 202 len: 0 microversion: 2.1 time: 0.733875 Sep 16 12:56:56.678430 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1413/2747] 10.222.0.67 () {58 vars in 1272 bytes} [Fri Sep 16 12:56:55 2022] DELETE /compute/v2.1/os-security-groups/accc8bac-c070-4c4f-98a5-ac5ad34c2ccd => generated 0 bytes in 736 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:56:56.690922 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-df651552-ddf9-4723-82cb-b0477d96927c tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] Calling method '.version_select at 0x7f1034a025e0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:56.739816 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-10dfef6c-0f88-4c00-b0cc-72a19bc8a056 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:56.741151 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-10dfef6c-0f88-4c00-b0cc-72a19bc8a056 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: ad6fc799-e1eb-4bac-8d47-7f4460ca629e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:56.752675 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10dfef6c-0f88-4c00-b0cc-72a19bc8a056 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:56.753356 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10dfef6c-0f88-4c00-b0cc-72a19bc8a056 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:56.755035 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10dfef6c-0f88-4c00-b0cc-72a19bc8a056 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:56.757456 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10dfef6c-0f88-4c00-b0cc-72a19bc8a056 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:56.759607 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10dfef6c-0f88-4c00-b0cc-72a19bc8a056 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:56.761500 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10dfef6c-0f88-4c00-b0cc-72a19bc8a056 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:57.466112 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-10dfef6c-0f88-4c00-b0cc-72a19bc8a056 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:57.478236 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-10dfef6c-0f88-4c00-b0cc-72a19bc8a056 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/ad6fc799-e1eb-4bac-8d47-7f4460ca629e" status: 200 len: 1521 microversion: 2.1 time: 0.742886 Sep 16 12:56:57.482030 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1414/2748] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:56 2022] GET /compute/v2.1/servers/ad6fc799-e1eb-4bac-8d47-7f4460ca629e => generated 1521 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:56:57.497730 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0974955d-55c3-4a70-b795-59c13a149f41 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:57.498925 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0974955d-55c3-4a70-b795-59c13a149f41 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:57.516743 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0974955d-55c3-4a70-b795-59c13a149f41 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:57.517872 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0974955d-55c3-4a70-b795-59c13a149f41 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:57.521217 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0974955d-55c3-4a70-b795-59c13a149f41 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:57.524040 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0974955d-55c3-4a70-b795-59c13a149f41 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:57.526228 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0974955d-55c3-4a70-b795-59c13a149f41 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:57.526883 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0974955d-55c3-4a70-b795-59c13a149f41 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:57.531057 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-df651552-ddf9-4723-82cb-b0477d96927c tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/8496ed6f-c16e-45be-89f1-9ecd69f7b453" status: 202 len: 0 microversion: 2.1 time: 0.847054 Sep 16 12:56:57.531659 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1335/2749] 10.222.0.67 () {58 vars in 1272 bytes} [Fri Sep 16 12:56:56 2022] DELETE /compute/v2.1/os-security-groups/8496ed6f-c16e-45be-89f1-9ecd69f7b453 => generated 0 bytes in 849 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:56:57.541403 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-edb2b9a7-7b89-4392-96ef-d6e9c820fd05 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:57.542026 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-edb2b9a7-7b89-4392-96ef-d6e9c820fd05 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:57.557868 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-edb2b9a7-7b89-4392-96ef-d6e9c820fd05 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:57.558375 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-edb2b9a7-7b89-4392-96ef-d6e9c820fd05 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:57.558960 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-edb2b9a7-7b89-4392-96ef-d6e9c820fd05 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:57.559810 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-edb2b9a7-7b89-4392-96ef-d6e9c820fd05 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:57.565278 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-edb2b9a7-7b89-4392-96ef-d6e9c820fd05 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:57.565910 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-edb2b9a7-7b89-4392-96ef-d6e9c820fd05 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:57.670958 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-0974955d-55c3-4a70-b795-59c13a149f41 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lazy-loading 'services' on Instance uuid 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:56:57.711698 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0974955d-55c3-4a70-b795-59c13a149f41 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1927 microversion: 2.75 time: 0.228190 Sep 16 12:56:57.712708 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1415/2750] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:57 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1927 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:56:57.727980 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9a0e1cce-ecf6-4dc5-90fa-62d55fcfe6f3 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:57.728892 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9a0e1cce-ecf6-4dc5-90fa-62d55fcfe6f3 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: ad6fc799-e1eb-4bac-8d47-7f4460ca629e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:57.734932 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:56:57.749726 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a0e1cce-ecf6-4dc5-90fa-62d55fcfe6f3 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:57.751161 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a0e1cce-ecf6-4dc5-90fa-62d55fcfe6f3 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:57.751832 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a0e1cce-ecf6-4dc5-90fa-62d55fcfe6f3 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:57.752834 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a0e1cce-ecf6-4dc5-90fa-62d55fcfe6f3 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:57.753517 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a0e1cce-ecf6-4dc5-90fa-62d55fcfe6f3 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:57.754172 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a0e1cce-ecf6-4dc5-90fa-62d55fcfe6f3 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:57.807474 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9a0e1cce-ecf6-4dc5-90fa-62d55fcfe6f3 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: ad6fc799-e1eb-4bac-8d47-7f4460ca629e] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:56:57.879420 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-edb2b9a7-7b89-4392-96ef-d6e9c820fd05 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:57.890173 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:56:57.890542 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-edb2b9a7-7b89-4392-96ef-d6e9c820fd05 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:57.893628 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-edb2b9a7-7b89-4392-96ef-d6e9c820fd05 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:57.896893 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-edb2b9a7-7b89-4392-96ef-d6e9c820fd05 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1293 microversion: 2.25 time: 0.359736 Sep 16 12:56:57.900459 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1336/2751] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:57 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1293 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:56:57.913435 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-aa0778df-71c7-48a3-8930-a190e9a66acf tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] Calling method '.version_select at 0x7f1034a020d0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:57.969989 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9a0e1cce-ecf6-4dc5-90fa-62d55fcfe6f3 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ad6fc799-e1eb-4bac-8d47-7f4460ca629e" status: 204 len: 0 microversion: 2.1 time: 0.255763 Sep 16 12:56:57.973991 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1416/2752] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:56:57 2022] DELETE /compute/v2.1/servers/ad6fc799-e1eb-4bac-8d47-7f4460ca629e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:56:57.984468 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fd050e1a-e28d-48f7-a68e-7806d451fff3 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:57.986456 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fd050e1a-e28d-48f7-a68e-7806d451fff3 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: ad6fc799-e1eb-4bac-8d47-7f4460ca629e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:57.997559 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd050e1a-e28d-48f7-a68e-7806d451fff3 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:57.998171 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd050e1a-e28d-48f7-a68e-7806d451fff3 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:57.998898 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd050e1a-e28d-48f7-a68e-7806d451fff3 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:57.999903 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd050e1a-e28d-48f7-a68e-7806d451fff3 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:58.000506 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd050e1a-e28d-48f7-a68e-7806d451fff3 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:58.001034 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd050e1a-e28d-48f7-a68e-7806d451fff3 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:58.477328 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fd050e1a-e28d-48f7-a68e-7806d451fff3 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:58.494387 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fd050e1a-e28d-48f7-a68e-7806d451fff3 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/ad6fc799-e1eb-4bac-8d47-7f4460ca629e" status: 200 len: 1527 microversion: 2.1 time: 0.515856 Sep 16 12:56:58.498564 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1417/2753] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:57 2022] GET /compute/v2.1/servers/ad6fc799-e1eb-4bac-8d47-7f4460ca629e => generated 1527 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:56:58.503503 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-535bbe2e-4332-4c6b-a98a-184a4e39f218 req-31ef3fc5-f65d-41b6-817a-dc5f23a9b863 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b229371-5f66-466c-a96b-2f668a855aa0", "tag": "ad0051b5-79e3-4c40-9a1d-6ef2e5b301e7"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:56:58.525656 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-535bbe2e-4332-4c6b-a98a-184a4e39f218 req-31ef3fc5-f65d-41b6-817a-dc5f23a9b863 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:58.527345 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-535bbe2e-4332-4c6b-a98a-184a4e39f218 req-31ef3fc5-f65d-41b6-817a-dc5f23a9b863 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:58.528608 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-535bbe2e-4332-4c6b-a98a-184a4e39f218 req-31ef3fc5-f65d-41b6-817a-dc5f23a9b863 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:58.546776 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-535bbe2e-4332-4c6b-a98a-184a4e39f218 req-31ef3fc5-f65d-41b6-817a-dc5f23a9b863 service nova] Creating event network-changed:ad0051b5-79e3-4c40-9a1d-6ef2e5b301e7 for instance 3b229371-5f66-466c-a96b-2f668a855aa0 on n-h1-858094-4 Sep 16 12:56:58.555862 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-535bbe2e-4332-4c6b-a98a-184a4e39f218 req-31ef3fc5-f65d-41b6-817a-dc5f23a9b863 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055774 Sep 16 12:56:58.557116 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1418/2754] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:56:58.744768 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2d83b8ab-641a-433c-8181-87dd1a164eac tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:58.747160 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2d83b8ab-641a-433c-8181-87dd1a164eac tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:58.759252 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2d83b8ab-641a-433c-8181-87dd1a164eac tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:58.761863 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2d83b8ab-641a-433c-8181-87dd1a164eac tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:58.764820 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2d83b8ab-641a-433c-8181-87dd1a164eac tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:58.765914 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2d83b8ab-641a-433c-8181-87dd1a164eac tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:58.766748 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2d83b8ab-641a-433c-8181-87dd1a164eac tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:58.769098 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2d83b8ab-641a-433c-8181-87dd1a164eac tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:58.827245 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-aa0778df-71c7-48a3-8930-a190e9a66acf tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/5a7d720e-dd46-4f34-af70-7464e4e8cd30" status: 202 len: 0 microversion: 2.1 time: 0.925496 Sep 16 12:56:58.828488 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1337/2755] 10.222.0.67 () {58 vars in 1272 bytes} [Fri Sep 16 12:56:57 2022] DELETE /compute/v2.1/os-security-groups/5a7d720e-dd46-4f34-af70-7464e4e8cd30 => generated 0 bytes in 927 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:56:58.839522 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-80fe490f-53a8-4b32-939a-2da9e26dca9f tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] Calling method '.version_select at 0x7f10349eedc0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:59.007201 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-2d83b8ab-641a-433c-8181-87dd1a164eac tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lazy-loading 'services' on Instance uuid 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:56:59.034127 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2d83b8ab-641a-433c-8181-87dd1a164eac tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1927 microversion: 2.75 time: 0.295741 Sep 16 12:56:59.035748 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1419/2756] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:58 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1927 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:56:59.042454 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-64c31c06-0bfc-4c3a-a525-1ec3d749fee9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:59.043320 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-64c31c06-0bfc-4c3a-a525-1ec3d749fee9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:59.051195 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64c31c06-0bfc-4c3a-a525-1ec3d749fee9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:59.052361 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64c31c06-0bfc-4c3a-a525-1ec3d749fee9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:59.052970 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64c31c06-0bfc-4c3a-a525-1ec3d749fee9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:59.053967 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64c31c06-0bfc-4c3a-a525-1ec3d749fee9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:59.054592 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64c31c06-0bfc-4c3a-a525-1ec3d749fee9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:59.055426 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64c31c06-0bfc-4c3a-a525-1ec3d749fee9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:59.489166 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-64c31c06-0bfc-4c3a-a525-1ec3d749fee9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:59.500702 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-64c31c06-0bfc-4c3a-a525-1ec3d749fee9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:59.502284 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-64c31c06-0bfc-4c3a-a525-1ec3d749fee9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:59.503468 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-64c31c06-0bfc-4c3a-a525-1ec3d749fee9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1293 microversion: 2.25 time: 0.465751 Sep 16 12:56:59.507689 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1420/2757] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:56:59 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1293 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:56:59.524279 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9f4ece5d-ebf4-4d3e-abb2-27b8aa74e52f tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:56:59.525321 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9f4ece5d-ebf4-4d3e-abb2-27b8aa74e52f tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: ad6fc799-e1eb-4bac-8d47-7f4460ca629e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:56:59.554577 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f4ece5d-ebf4-4d3e-abb2-27b8aa74e52f tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:59.555349 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f4ece5d-ebf4-4d3e-abb2-27b8aa74e52f tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:59.555984 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f4ece5d-ebf4-4d3e-abb2-27b8aa74e52f tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:59.557613 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f4ece5d-ebf4-4d3e-abb2-27b8aa74e52f tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:56:59.561418 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f4ece5d-ebf4-4d3e-abb2-27b8aa74e52f tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:56:59.562056 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f4ece5d-ebf4-4d3e-abb2-27b8aa74e52f tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:56:59.847669 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-80fe490f-53a8-4b32-939a-2da9e26dca9f tempest-SecurityGroupRulesNegativeTestJSON-665619390 tempest-SecurityGroupRulesNegativeTestJSON-665619390-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/c2eacb66-6339-4733-a759-9c72c6e7c819" status: 202 len: 0 microversion: 2.1 time: 1.014873 Sep 16 12:56:59.849801 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1338/2758] 10.222.0.67 () {58 vars in 1272 bytes} [Fri Sep 16 12:56:58 2022] DELETE /compute/v2.1/os-security-groups/c2eacb66-6339-4733-a759-9c72c6e7c819 => generated 0 bytes in 1018 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 12:56:59.936368 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9f4ece5d-ebf4-4d3e-abb2-27b8aa74e52f tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:56:59.948434 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9f4ece5d-ebf4-4d3e-abb2-27b8aa74e52f tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/ad6fc799-e1eb-4bac-8d47-7f4460ca629e" status: 200 len: 1527 microversion: 2.1 time: 0.429250 Sep 16 12:56:59.966985 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1421/2759] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:56:59 2022] GET /compute/v2.1/servers/ad6fc799-e1eb-4bac-8d47-7f4460ca629e => generated 1527 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:57:00.065717 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-cdab5a7d-322c-40eb-bbdc-db9367c8366c tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:00.066414 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-cdab5a7d-322c-40eb-bbdc-db9367c8366c tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:00.091881 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cdab5a7d-322c-40eb-bbdc-db9367c8366c tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:00.092594 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cdab5a7d-322c-40eb-bbdc-db9367c8366c tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:00.093188 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cdab5a7d-322c-40eb-bbdc-db9367c8366c tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:00.094049 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cdab5a7d-322c-40eb-bbdc-db9367c8366c tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:00.094636 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cdab5a7d-322c-40eb-bbdc-db9367c8366c tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:00.095175 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cdab5a7d-322c-40eb-bbdc-db9367c8366c tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:00.255921 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-cdab5a7d-322c-40eb-bbdc-db9367c8366c tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lazy-loading 'services' on Instance uuid 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:57:00.294190 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-cdab5a7d-322c-40eb-bbdc-db9367c8366c tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1927 microversion: 2.75 time: 0.229796 Sep 16 12:57:00.295027 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1339/2760] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:00 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1927 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:57:00.537507 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b0e1c5cf-90be-43b9-9253-e81bb671072b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:00.539268 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b0e1c5cf-90be-43b9-9253-e81bb671072b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:00.550428 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0e1c5cf-90be-43b9-9253-e81bb671072b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:00.552524 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0e1c5cf-90be-43b9-9253-e81bb671072b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:00.553150 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0e1c5cf-90be-43b9-9253-e81bb671072b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:00.554065 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0e1c5cf-90be-43b9-9253-e81bb671072b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:00.554913 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0e1c5cf-90be-43b9-9253-e81bb671072b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:00.555658 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0e1c5cf-90be-43b9-9253-e81bb671072b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:00.978015 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-13ec2247-efe9-4e46-b12a-8ba49466f7db tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:00.979476 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b0e1c5cf-90be-43b9-9253-e81bb671072b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:00.985646 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-13ec2247-efe9-4e46-b12a-8ba49466f7db tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: ad6fc799-e1eb-4bac-8d47-7f4460ca629e] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:00.995674 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b0e1c5cf-90be-43b9-9253-e81bb671072b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:00.997221 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b0e1c5cf-90be-43b9-9253-e81bb671072b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:01.002035 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-13ec2247-efe9-4e46-b12a-8ba49466f7db tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:01.003295 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-13ec2247-efe9-4e46-b12a-8ba49466f7db tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:01.004014 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-13ec2247-efe9-4e46-b12a-8ba49466f7db tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:01.005745 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-13ec2247-efe9-4e46-b12a-8ba49466f7db tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:01.005924 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b0e1c5cf-90be-43b9-9253-e81bb671072b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1293 microversion: 2.25 time: 0.474996 Sep 16 12:57:01.006490 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1422/2761] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:00 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1293 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:57:01.006945 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-13ec2247-efe9-4e46-b12a-8ba49466f7db tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:01.007711 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-13ec2247-efe9-4e46-b12a-8ba49466f7db tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:01.129147 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:57:01.181286 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=6 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:57:01.330860 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8c1f34ce-7b26-485a-a87f-15281e26dd24 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:01.331962 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8c1f34ce-7b26-485a-a87f-15281e26dd24 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:01.363760 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c1f34ce-7b26-485a-a87f-15281e26dd24 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:01.364956 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c1f34ce-7b26-485a-a87f-15281e26dd24 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:01.365413 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c1f34ce-7b26-485a-a87f-15281e26dd24 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:01.369424 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c1f34ce-7b26-485a-a87f-15281e26dd24 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:01.369947 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c1f34ce-7b26-485a-a87f-15281e26dd24 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:01.371100 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c1f34ce-7b26-485a-a87f-15281e26dd24 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:01.666133 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-8c1f34ce-7b26-485a-a87f-15281e26dd24 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lazy-loading 'services' on Instance uuid 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:57:01.698866 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8c1f34ce-7b26-485a-a87f-15281e26dd24 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1927 microversion: 2.75 time: 0.374524 Sep 16 12:57:01.700415 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1423/2762] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:01 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1927 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:57:01.705721 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-4af12438-691c-4087-909c-5365444a57c8 req-b16a7678-c347-41cd-b1b6-6ab0d8af72f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad6fc799-e1eb-4bac-8d47-7f4460ca629e", "name": "network-vif-deleted", "tag": "4149a920-b1bb-49b7-ae43-fff99a20a7f0"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:57:01.725285 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4af12438-691c-4087-909c-5365444a57c8 req-b16a7678-c347-41cd-b1b6-6ab0d8af72f5 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:01.726112 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4af12438-691c-4087-909c-5365444a57c8 req-b16a7678-c347-41cd-b1b6-6ab0d8af72f5 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:01.726715 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4af12438-691c-4087-909c-5365444a57c8 req-b16a7678-c347-41cd-b1b6-6ab0d8af72f5 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:01.757931 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-4af12438-691c-4087-909c-5365444a57c8 req-b16a7678-c347-41cd-b1b6-6ab0d8af72f5 service nova] Creating event network-vif-deleted:4149a920-b1bb-49b7-ae43-fff99a20a7f0 for instance ad6fc799-e1eb-4bac-8d47-7f4460ca629e on n-h2-858094-4 Sep 16 12:57:01.775762 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-4af12438-691c-4087-909c-5365444a57c8 req-b16a7678-c347-41cd-b1b6-6ab0d8af72f5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073642 Sep 16 12:57:01.777090 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1424/2763] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:57:01.845846 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-13ec2247-efe9-4e46-b12a-8ba49466f7db tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973378f0eed8476eb41a29d5ce57ed65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88ea8e8750c440e86d3c1eb4ab6110e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:01.879271 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-13ec2247-efe9-4e46-b12a-8ba49466f7db tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/ad6fc799-e1eb-4bac-8d47-7f4460ca629e" status: 200 len: 1527 microversion: 2.1 time: 0.909467 Sep 16 12:57:01.882284 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1340/2764] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:00 2022] GET /compute/v2.1/servers/ad6fc799-e1eb-4bac-8d47-7f4460ca629e => generated 1527 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:02.032891 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1d9c043e-d0b6-418d-ada4-cf1f4e4fc95e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:02.034520 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1d9c043e-d0b6-418d-ada4-cf1f4e4fc95e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:02.040287 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:57:02.050293 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d9c043e-d0b6-418d-ada4-cf1f4e4fc95e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:02.050800 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d9c043e-d0b6-418d-ada4-cf1f4e4fc95e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:02.055131 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d9c043e-d0b6-418d-ada4-cf1f4e4fc95e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:02.058644 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d9c043e-d0b6-418d-ada4-cf1f4e4fc95e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:02.062206 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d9c043e-d0b6-418d-ada4-cf1f4e4fc95e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:02.063444 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d9c043e-d0b6-418d-ada4-cf1f4e4fc95e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:02.153822 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-13ec2247-efe9-4e46-b12a-8ba49466f7db tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:02.155030 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-13ec2247-efe9-4e46-b12a-8ba49466f7db tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002228 Sep 16 12:57:02.155866 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1341/2765] 10.222.0.67 () {56 vars in 886 bytes} [Fri Sep 16 12:57:02 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 16 12:57:02.165186 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-13ec2247-efe9-4e46-b12a-8ba49466f7db tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:02.166332 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-13ec2247-efe9-4e46-b12a-8ba49466f7db tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002676 Sep 16 12:57:02.166940 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1342/2766] 10.222.0.67 () {54 vars in 1035 bytes} [Fri Sep 16 12:57:02 2022] GET /compute/v2/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Sep 16 12:57:02.174865 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-13ec2247-efe9-4e46-b12a-8ba49466f7db tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:02.175968 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-13ec2247-efe9-4e46-b12a-8ba49466f7db tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001754 Sep 16 12:57:02.197669 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1343/2767] 10.222.0.67 () {54 vars in 1041 bytes} [Fri Sep 16 12:57:02 2022] GET /compute/v2.1/ => generated 388 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:57:02.199663 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-13ec2247-efe9-4e46-b12a-8ba49466f7db tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:02.200902 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-13ec2247-efe9-4e46-b12a-8ba49466f7db tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001611 Sep 16 12:57:02.220498 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1344/2768] 10.222.0.67 () {56 vars in 886 bytes} [Fri Sep 16 12:57:02 2022] GET /compute/ => generated 377 bytes in 22 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 16 12:57:02.539716 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1d9c043e-d0b6-418d-ada4-cf1f4e4fc95e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:02.554844 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1d9c043e-d0b6-418d-ada4-cf1f4e4fc95e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:02.562592 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1d9c043e-d0b6-418d-ada4-cf1f4e4fc95e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:02.566470 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1d9c043e-d0b6-418d-ada4-cf1f4e4fc95e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1281 microversion: 2.25 time: 0.538812 Sep 16 12:57:02.584668 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1425/2769] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:02 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1281 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:57:02.769882 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9e400411-77f7-49b1-bdba-ee6596d1c7b4 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:02.770872 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9e400411-77f7-49b1-bdba-ee6596d1c7b4 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:02.793459 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9e400411-77f7-49b1-bdba-ee6596d1c7b4 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:02.793989 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9e400411-77f7-49b1-bdba-ee6596d1c7b4 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:02.794437 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9e400411-77f7-49b1-bdba-ee6596d1c7b4 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:02.796890 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9e400411-77f7-49b1-bdba-ee6596d1c7b4 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:02.797472 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9e400411-77f7-49b1-bdba-ee6596d1c7b4 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:02.797927 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9e400411-77f7-49b1-bdba-ee6596d1c7b4 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:02.911903 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2b48a6d1-4b74-4a8d-bd36-0323c513f180 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:02.913224 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2b48a6d1-4b74-4a8d-bd36-0323c513f180 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: ad6fc799-e1eb-4bac-8d47-7f4460ca629e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:02.922419 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b48a6d1-4b74-4a8d-bd36-0323c513f180 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:02.924823 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b48a6d1-4b74-4a8d-bd36-0323c513f180 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:02.925703 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b48a6d1-4b74-4a8d-bd36-0323c513f180 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:02.927344 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b48a6d1-4b74-4a8d-bd36-0323c513f180 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:02.928188 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b48a6d1-4b74-4a8d-bd36-0323c513f180 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:02.929197 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b48a6d1-4b74-4a8d-bd36-0323c513f180 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:02.953206 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-2b48a6d1-4b74-4a8d-bd36-0323c513f180 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] HTTP exception thrown: Instance ad6fc799-e1eb-4bac-8d47-7f4460ca629e could not be found. Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2b48a6d1-4b74-4a8d-bd36-0323c513f180 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Request method failure captured: Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/ad6fc799-e1eb-4bac-8d47-7f4460ca629e HTTP/1.1 Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHI8T7yGPRAc3c6MPrRyvBn0sjBikdgUA-hTw5OumPvmvZhNIoTMLBQsFbEvX79WgLzGGVd0Tyjqag2EpyljzbSAD20HzRS6IC0nQYJFElFV23Kk60KxHTZ6ulzDMTvWGrZByycegK-oPTtKgXmNPoQq1DgmwbeXyTMrKt2g_ITcKgg Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: c88ea8e8750c440e86d3c1eb4ab6110e Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c88ea8e8750c440e86d3c1eb4ab6110e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: c88ea8e8750c440e86d3c1eb4ab6110e Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ImagesOneServerNegativeTestJSON-682956668-project Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 973378f0eed8476eb41a29d5ce57ed65 Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-682956668-project Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance ad6fc799-e1eb-4bac-8d47-7f4460ca629e could not be found. Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': 'ad6fc799-e1eb-4bac-8d47-7f4460ca629e'} Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad6fc799-e1eb-4bac-8d47-7f4460ca629e could not be found. Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad6fc799-e1eb-4bac-8d47-7f4460ca629e could not be found. Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:02.955942 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:57:02.962911 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:02.962911 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:57:02.962911 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:57:02.962911 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:57:02.962911 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:57:02.962911 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:57:02.962911 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad6fc799-e1eb-4bac-8d47-7f4460ca629e could not be found. Sep 16 12:57:02.962911 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:02.967981 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2b48a6d1-4b74-4a8d-bd36-0323c513f180 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Returning 404 to user: Instance ad6fc799-e1eb-4bac-8d47-7f4460ca629e could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:57:02.969393 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2b48a6d1-4b74-4a8d-bd36-0323c513f180 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/ad6fc799-e1eb-4bac-8d47-7f4460ca629e" status: 404 len: 111 microversion: 2.1 time: 0.064061 Sep 16 12:57:02.971867 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1426/2770] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:02 2022] GET /compute/v2.1/servers/ad6fc799-e1eb-4bac-8d47-7f4460ca629e => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:57:02.981523 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a8438de9-dd1f-44b9-8c84-e24672951630 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '.version_select at 0x7f10351cd5e0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:03.014538 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-a8438de9-dd1f-44b9-8c84-e24672951630 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] HTTP exception thrown: Image not found. Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a8438de9-dd1f-44b9-8c84-e24672951630 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Request method failure captured: Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/images/4115c64f-559a-45b5-b89c-8fc273c057b8 HTTP/1.1 Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHI8T7yGPRAc3c6MPrRyvBn0sjBikdgUA-hTw5OumPvmvZhNIoTMLBQsFbEvX79WgLzGGVd0Tyjqag2EpyljzbSAD20HzRS6IC0nQYJFElFV23Kk60KxHTZ6ulzDMTvWGrZByycegK-oPTtKgXmNPoQq1DgmwbeXyTMrKt2g_ITcKgg Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: c88ea8e8750c440e86d3c1eb4ab6110e Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c88ea8e8750c440e86d3c1eb4ab6110e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: c88ea8e8750c440e86d3c1eb4ab6110e Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ImagesOneServerNegativeTestJSON-682956668-project Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 973378f0eed8476eb41a29d5ce57ed65 Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-682956668-project Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: exception: Image not found. Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '4115c64f-559a-45b5-b89c-8fc273c057b8'} Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4115c64f-559a-45b5-b89c-8fc273c057b8 to delete Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4115c64f-559a-45b5-b89c-8fc273c057b8 could not be found. Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:57:03.018738 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:03.022937 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:57:03.022937 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:57:03.022937 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:57:03.022937 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:57:03.022937 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:57:03.022937 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:57:03.022937 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:57:03.022937 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:57:03.022937 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:57:03.022937 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 16 12:57:03.022937 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 16 12:57:03.022937 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 12:57:03.022937 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:03.022937 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:57:03.022937 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:03.022937 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:57:03.022937 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:57:03.022937 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:57:03.022937 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:57:03.022937 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:57:03.022937 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 12:57:03.022937 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:03.029297 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a8438de9-dd1f-44b9-8c84-e24672951630 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Returning 404 to user: Image not found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:57:03.032350 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a8438de9-dd1f-44b9-8c84-e24672951630 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "DELETE /compute/v2.1/images/4115c64f-559a-45b5-b89c-8fc273c057b8" status: 404 len: 62 microversion: 2.1 time: 0.054608 Sep 16 12:57:03.035442 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1427/2771] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:02 2022] DELETE /compute/v2.1/images/4115c64f-559a-45b5-b89c-8fc273c057b8 => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 16 12:57:03.053309 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d5af8ee9-aaa6-452a-8643-147e9ff856b5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:03.053817 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d5af8ee9-aaa6-452a-8643-147e9ff856b5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: e34e2be3-4e61-46dc-b4a4-5abcd3df9b85] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:03.065461 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5af8ee9-aaa6-452a-8643-147e9ff856b5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:03.065971 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5af8ee9-aaa6-452a-8643-147e9ff856b5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:03.066413 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5af8ee9-aaa6-452a-8643-147e9ff856b5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:03.067211 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5af8ee9-aaa6-452a-8643-147e9ff856b5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:03.067715 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5af8ee9-aaa6-452a-8643-147e9ff856b5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:03.068657 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5af8ee9-aaa6-452a-8643-147e9ff856b5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:03.095583 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-d5af8ee9-aaa6-452a-8643-147e9ff856b5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] HTTP exception thrown: Instance e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 could not be found. Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d5af8ee9-aaa6-452a-8643-147e9ff856b5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Request method failure captured: Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 HTTP/1.1 Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHI8T7yGPRAc3c6MPrRyvBn0sjBikdgUA-hTw5OumPvmvZhNIoTMLBQsFbEvX79WgLzGGVd0Tyjqag2EpyljzbSAD20HzRS6IC0nQYJFElFV23Kk60KxHTZ6ulzDMTvWGrZByycegK-oPTtKgXmNPoQq1DgmwbeXyTMrKt2g_ITcKgg Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: c88ea8e8750c440e86d3c1eb4ab6110e Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c88ea8e8750c440e86d3c1eb4ab6110e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: c88ea8e8750c440e86d3c1eb4ab6110e Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ImagesOneServerNegativeTestJSON-682956668-project Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 973378f0eed8476eb41a29d5ce57ed65 Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-682956668-project Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 could not be found. Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': 'e34e2be3-4e61-46dc-b4a4-5abcd3df9b85'} Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 could not be found. Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:57:03.097836 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:57:03.102370 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 could not be found. Sep 16 12:57:03.102370 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:03.102370 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:57:03.102370 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:03.102370 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:57:03.102370 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:57:03.102370 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:57:03.102370 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:57:03.102370 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:57:03.102370 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 could not be found. Sep 16 12:57:03.102370 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:03.102370 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d5af8ee9-aaa6-452a-8643-147e9ff856b5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Returning 404 to user: Instance e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:57:03.102370 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d5af8ee9-aaa6-452a-8643-147e9ff856b5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85" status: 404 len: 111 microversion: 2.1 time: 0.056998 Sep 16 12:57:03.105978 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1428/2772] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:57:03 2022] DELETE /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:57:03.112716 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b1e6ad49-161f-4f00-89b3-d2e7ae1059c5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:03.113467 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b1e6ad49-161f-4f00-89b3-d2e7ae1059c5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: e34e2be3-4e61-46dc-b4a4-5abcd3df9b85] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:03.121695 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1e6ad49-161f-4f00-89b3-d2e7ae1059c5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:03.122207 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1e6ad49-161f-4f00-89b3-d2e7ae1059c5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:03.122652 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1e6ad49-161f-4f00-89b3-d2e7ae1059c5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:03.123379 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1e6ad49-161f-4f00-89b3-d2e7ae1059c5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:03.123837 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1e6ad49-161f-4f00-89b3-d2e7ae1059c5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:03.124305 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1e6ad49-161f-4f00-89b3-d2e7ae1059c5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:03.140274 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-b1e6ad49-161f-4f00-89b3-d2e7ae1059c5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] HTTP exception thrown: Instance e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 could not be found. Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b1e6ad49-161f-4f00-89b3-d2e7ae1059c5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Request method failure captured: Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 HTTP/1.1 Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHI8T7yGPRAc3c6MPrRyvBn0sjBikdgUA-hTw5OumPvmvZhNIoTMLBQsFbEvX79WgLzGGVd0Tyjqag2EpyljzbSAD20HzRS6IC0nQYJFElFV23Kk60KxHTZ6ulzDMTvWGrZByycegK-oPTtKgXmNPoQq1DgmwbeXyTMrKt2g_ITcKgg Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: c88ea8e8750c440e86d3c1eb4ab6110e Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c88ea8e8750c440e86d3c1eb4ab6110e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: c88ea8e8750c440e86d3c1eb4ab6110e Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ImagesOneServerNegativeTestJSON-682956668-project Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 973378f0eed8476eb41a29d5ce57ed65 Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-682956668-project Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 could not be found. Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': 'e34e2be3-4e61-46dc-b4a4-5abcd3df9b85'} Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 could not be found. Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 could not be found. Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:03.142130 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:57:03.147046 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:03.147046 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:57:03.147046 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:57:03.147046 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:57:03.147046 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:57:03.147046 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:57:03.147046 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 could not be found. Sep 16 12:57:03.147046 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:03.147046 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b1e6ad49-161f-4f00-89b3-d2e7ae1059c5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Returning 404 to user: Instance e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:57:03.147046 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b1e6ad49-161f-4f00-89b3-d2e7ae1059c5 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85" status: 404 len: 111 microversion: 2.1 time: 0.037207 Sep 16 12:57:03.148741 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1429/2773] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:03 2022] GET /compute/v2.1/servers/e34e2be3-4e61-46dc-b4a4-5abcd3df9b85 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:57:03.156305 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ef1914db-a2d0-4027-a030-0e605c628f87 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '.version_select at 0x7f1039a33ca0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:03.189384 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ef1914db-a2d0-4027-a030-0e605c628f87 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-709008714" status: 202 len: 0 microversion: 2.1 time: 0.038811 Sep 16 12:57:03.191247 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1430/2774] 10.222.0.67 () {58 vars in 1218 bytes} [Fri Sep 16 12:57:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-709008714 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:57:03.381033 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-9e400411-77f7-49b1-bdba-ee6596d1c7b4 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lazy-loading 'services' on Instance uuid 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:57:03.402596 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9e400411-77f7-49b1-bdba-ee6596d1c7b4 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1927 microversion: 2.75 time: 0.637835 Sep 16 12:57:03.403876 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1345/2775] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:02 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1927 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:57:03.594991 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8c769698-1a15-416f-b0b3-5d770878ded2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:03.598400 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8c769698-1a15-416f-b0b3-5d770878ded2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:03.605159 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c769698-1a15-416f-b0b3-5d770878ded2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:03.605945 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c769698-1a15-416f-b0b3-5d770878ded2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:03.606560 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c769698-1a15-416f-b0b3-5d770878ded2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:03.607449 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c769698-1a15-416f-b0b3-5d770878ded2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:03.608880 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c769698-1a15-416f-b0b3-5d770878ded2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:03.609540 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c769698-1a15-416f-b0b3-5d770878ded2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:04.246192 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8c769698-1a15-416f-b0b3-5d770878ded2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:04.264665 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8c769698-1a15-416f-b0b3-5d770878ded2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:04.269563 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8c769698-1a15-416f-b0b3-5d770878ded2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:04.271366 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8c769698-1a15-416f-b0b3-5d770878ded2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1281 microversion: 2.25 time: 0.680363 Sep 16 12:57:04.274406 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1431/2776] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:03 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1281 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:57:04.432462 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-78c52ac6-f676-49a7-8f10-39fa5301d12a tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:04.434879 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-78c52ac6-f676-49a7-8f10-39fa5301d12a tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:04.452421 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-78c52ac6-f676-49a7-8f10-39fa5301d12a tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:04.456658 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-78c52ac6-f676-49a7-8f10-39fa5301d12a tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:04.457901 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-78c52ac6-f676-49a7-8f10-39fa5301d12a tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:04.462834 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-78c52ac6-f676-49a7-8f10-39fa5301d12a tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:04.465198 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-78c52ac6-f676-49a7-8f10-39fa5301d12a tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:04.469544 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-78c52ac6-f676-49a7-8f10-39fa5301d12a tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:04.653405 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-51482e72-74da-441e-a12d-0a40a2c8011b tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '.version_select at 0x7f10399e1160>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:04.711303 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-51482e72-74da-441e-a12d-0a40a2c8011b tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] HTTP exception thrown: Image not found. Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-51482e72-74da-441e-a12d-0a40a2c8011b tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Request method failure captured: Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/images/45b82bad-accf-4167-8ee8-820da0c223f3 HTTP/1.1 Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHI8T7yGPRAc3c6MPrRyvBn0sjBikdgUA-hTw5OumPvmvZhNIoTMLBQsFbEvX79WgLzGGVd0Tyjqag2EpyljzbSAD20HzRS6IC0nQYJFElFV23Kk60KxHTZ6ulzDMTvWGrZByycegK-oPTtKgXmNPoQq1DgmwbeXyTMrKt2g_ITcKgg Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: c88ea8e8750c440e86d3c1eb4ab6110e Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c88ea8e8750c440e86d3c1eb4ab6110e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: c88ea8e8750c440e86d3c1eb4ab6110e Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ImagesOneServerNegativeTestJSON-682956668-project Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 973378f0eed8476eb41a29d5ce57ed65 Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-682956668-project Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: exception: Image not found. Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '45b82bad-accf-4167-8ee8-820da0c223f3'} Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 45b82bad-accf-4167-8ee8-820da0c223f3 to delete Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 45b82bad-accf-4167-8ee8-820da0c223f3 could not be found. Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:57:04.714497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:04.718301 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:57:04.718301 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:57:04.718301 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:57:04.718301 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:57:04.718301 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:57:04.718301 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:57:04.718301 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:57:04.718301 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:57:04.718301 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:57:04.718301 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 16 12:57:04.718301 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 16 12:57:04.718301 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 12:57:04.718301 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:04.718301 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:57:04.718301 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:04.718301 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:57:04.718301 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:57:04.718301 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:57:04.718301 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:57:04.718301 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:57:04.718301 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 12:57:04.718301 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:04.723935 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-51482e72-74da-441e-a12d-0a40a2c8011b tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Returning 404 to user: Image not found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:57:04.725819 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-51482e72-74da-441e-a12d-0a40a2c8011b tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "DELETE /compute/v2.1/images/45b82bad-accf-4167-8ee8-820da0c223f3" status: 404 len: 62 microversion: 2.1 time: 0.078819 Sep 16 12:57:04.727304 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1432/2777] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:04 2022] DELETE /compute/v2.1/images/45b82bad-accf-4167-8ee8-820da0c223f3 => generated 62 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 16 12:57:04.733731 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-07b09bc4-a6c1-4ea8-a8f7-b0f01264c261 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:04.736581 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-07b09bc4-a6c1-4ea8-a8f7-b0f01264c261 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:04.746275 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07b09bc4-a6c1-4ea8-a8f7-b0f01264c261 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:04.747167 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07b09bc4-a6c1-4ea8-a8f7-b0f01264c261 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:04.747892 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07b09bc4-a6c1-4ea8-a8f7-b0f01264c261 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:04.748988 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07b09bc4-a6c1-4ea8-a8f7-b0f01264c261 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:04.749728 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07b09bc4-a6c1-4ea8-a8f7-b0f01264c261 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:04.750382 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07b09bc4-a6c1-4ea8-a8f7-b0f01264c261 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:04.895162 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-07b09bc4-a6c1-4ea8-a8f7-b0f01264c261 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.157021 Sep 16 12:57:04.913452 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1433/2778] 10.222.0.67 () {58 vars in 1302 bytes} [Fri Sep 16 12:57:04 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88/os-volume_attachments => generated 25 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 12:57:04.938620 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8521e363-abfb-4d3a-b8c4-534096c28a52 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:04.939424 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8521e363-abfb-4d3a-b8c4-534096c28a52 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:04.976341 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8521e363-abfb-4d3a-b8c4-534096c28a52 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:04.986285 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8521e363-abfb-4d3a-b8c4-534096c28a52 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:04.986922 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8521e363-abfb-4d3a-b8c4-534096c28a52 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:04.988905 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8521e363-abfb-4d3a-b8c4-534096c28a52 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:04.991489 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8521e363-abfb-4d3a-b8c4-534096c28a52 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:04.992820 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8521e363-abfb-4d3a-b8c4-534096c28a52 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:05.098785 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-8521e363-abfb-4d3a-b8c4-534096c28a52 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] HTTP exception thrown: Instance 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e could not be found. Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8521e363-abfb-4d3a-b8c4-534096c28a52 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Request method failure captured: Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e HTTP/1.1 Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHI8T7yGPRAc3c6MPrRyvBn0sjBikdgUA-hTw5OumPvmvZhNIoTMLBQsFbEvX79WgLzGGVd0Tyjqag2EpyljzbSAD20HzRS6IC0nQYJFElFV23Kk60KxHTZ6ulzDMTvWGrZByycegK-oPTtKgXmNPoQq1DgmwbeXyTMrKt2g_ITcKgg Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: c88ea8e8750c440e86d3c1eb4ab6110e Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c88ea8e8750c440e86d3c1eb4ab6110e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: c88ea8e8750c440e86d3c1eb4ab6110e Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ImagesOneServerNegativeTestJSON-682956668-project Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 973378f0eed8476eb41a29d5ce57ed65 Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-682956668-project Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e could not be found. Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e'} Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e could not be found. Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:57:05.101166 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:57:05.107266 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e could not be found. Sep 16 12:57:05.107266 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:05.107266 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:57:05.107266 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:05.107266 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:57:05.107266 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:57:05.107266 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:57:05.107266 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:57:05.107266 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:57:05.107266 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e could not be found. Sep 16 12:57:05.107266 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:05.107266 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8521e363-abfb-4d3a-b8c4-534096c28a52 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Returning 404 to user: Instance 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:57:05.110285 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8521e363-abfb-4d3a-b8c4-534096c28a52 tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e" status: 404 len: 111 microversion: 2.1 time: 0.190829 Sep 16 12:57:05.116402 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1434/2779] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:57:04 2022] DELETE /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e => generated 111 bytes in 202 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:57:05.132321 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c1714831-604a-4ac6-8fe8-f2ee58d43adf tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:05.143708 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c1714831-604a-4ac6-8fe8-f2ee58d43adf tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] [instance: 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:05.164537 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c1714831-604a-4ac6-8fe8-f2ee58d43adf tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:05.165405 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c1714831-604a-4ac6-8fe8-f2ee58d43adf tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:05.166360 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c1714831-604a-4ac6-8fe8-f2ee58d43adf tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:05.171989 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c1714831-604a-4ac6-8fe8-f2ee58d43adf tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:05.173377 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c1714831-604a-4ac6-8fe8-f2ee58d43adf tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:05.185807 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c1714831-604a-4ac6-8fe8-f2ee58d43adf tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:05.225396 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-c1714831-604a-4ac6-8fe8-f2ee58d43adf tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] HTTP exception thrown: Instance 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e could not be found. Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c1714831-604a-4ac6-8fe8-f2ee58d43adf tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Request method failure captured: Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e HTTP/1.1 Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHI8T7yGPRAc3c6MPrRyvBn0sjBikdgUA-hTw5OumPvmvZhNIoTMLBQsFbEvX79WgLzGGVd0Tyjqag2EpyljzbSAD20HzRS6IC0nQYJFElFV23Kk60KxHTZ6ulzDMTvWGrZByycegK-oPTtKgXmNPoQq1DgmwbeXyTMrKt2g_ITcKgg Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: c88ea8e8750c440e86d3c1eb4ab6110e Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c88ea8e8750c440e86d3c1eb4ab6110e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c88ea8e8750c440e86d3c1eb4ab6110e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: c88ea8e8750c440e86d3c1eb4ab6110e Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-682956668 Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ImagesOneServerNegativeTestJSON-682956668-project Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 973378f0eed8476eb41a29d5ce57ed65 Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-682956668-project Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e could not be found. Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e'} Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e could not be found. Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e could not be found. Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:05.236588 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:57:05.242144 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:05.242144 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:57:05.242144 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:57:05.242144 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:57:05.242144 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:57:05.242144 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:57:05.242144 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e could not be found. Sep 16 12:57:05.242144 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:05.244178 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c1714831-604a-4ac6-8fe8-f2ee58d43adf tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] Returning 404 to user: Instance 3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:57:05.245300 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c1714831-604a-4ac6-8fe8-f2ee58d43adf tempest-ImagesOneServerNegativeTestJSON-682956668 tempest-ImagesOneServerNegativeTestJSON-682956668-project] 10.222.0.67 "GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e" status: 404 len: 111 microversion: 2.1 time: 0.127690 Sep 16 12:57:05.252174 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1435/2780] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:05 2022] GET /compute/v2.1/servers/3b4c1fa3-fd00-41c5-bfc7-94638d03cb3e => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:57:05.258537 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f9adf64d-5697-4851-8fb5-f608bd8fa8f3 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:05.269771 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f9adf64d-5697-4851-8fb5-f608bd8fa8f3 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:05.277614 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9adf64d-5697-4851-8fb5-f608bd8fa8f3 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:05.282633 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9adf64d-5697-4851-8fb5-f608bd8fa8f3 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:05.284263 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9adf64d-5697-4851-8fb5-f608bd8fa8f3 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:05.285282 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9adf64d-5697-4851-8fb5-f608bd8fa8f3 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:05.285933 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9adf64d-5697-4851-8fb5-f608bd8fa8f3 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:05.288706 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9adf64d-5697-4851-8fb5-f608bd8fa8f3 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:05.368472 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f9adf64d-5697-4851-8fb5-f608bd8fa8f3 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:57:05.544705 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f9adf64d-5697-4851-8fb5-f608bd8fa8f3 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "DELETE /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 204 len: 0 microversion: 2.1 time: 0.289696 Sep 16 12:57:05.545596 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1436/2781] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:57:05 2022] DELETE /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:57:05.551427 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-12fd53c3-bb3f-4040-9f1f-e2cc5ebc5a60 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:05.555917 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-12fd53c3-bb3f-4040-9f1f-e2cc5ebc5a60 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:05.577084 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12fd53c3-bb3f-4040-9f1f-e2cc5ebc5a60 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:05.577798 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12fd53c3-bb3f-4040-9f1f-e2cc5ebc5a60 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:05.578551 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12fd53c3-bb3f-4040-9f1f-e2cc5ebc5a60 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:05.579546 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12fd53c3-bb3f-4040-9f1f-e2cc5ebc5a60 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:05.580313 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12fd53c3-bb3f-4040-9f1f-e2cc5ebc5a60 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:05.580904 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12fd53c3-bb3f-4040-9f1f-e2cc5ebc5a60 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:05.595555 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-78c52ac6-f676-49a7-8f10-39fa5301d12a tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lazy-loading 'services' on Instance uuid 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:57:05.606018 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:57:05.666509 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-78c52ac6-f676-49a7-8f10-39fa5301d12a tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1927 microversion: 2.75 time: 1.238813 Sep 16 12:57:05.669256 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1346/2782] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:04 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1927 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:57:05.682501 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0a576ad2-24e4-4f07-8a81-a3237d336104 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:05.684235 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0a576ad2-24e4-4f07-8a81-a3237d336104 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:05.699921 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0a576ad2-24e4-4f07-8a81-a3237d336104 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:05.702881 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0a576ad2-24e4-4f07-8a81-a3237d336104 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:05.704787 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0a576ad2-24e4-4f07-8a81-a3237d336104 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:05.710610 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0a576ad2-24e4-4f07-8a81-a3237d336104 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:05.711749 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0a576ad2-24e4-4f07-8a81-a3237d336104 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:05.712869 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0a576ad2-24e4-4f07-8a81-a3237d336104 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:06.277494 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0a576ad2-24e4-4f07-8a81-a3237d336104 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:06.290594 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0a576ad2-24e4-4f07-8a81-a3237d336104 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1674 microversion: 2.1 time: 0.617322 Sep 16 12:57:06.294062 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1347/2783] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:05 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1674 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:06.700819 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c265101b-bd7f-43ef-ad81-a0496611db26 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:06.701438 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c265101b-bd7f-43ef-ad81-a0496611db26 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:06.727260 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c265101b-bd7f-43ef-ad81-a0496611db26 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:06.733603 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c265101b-bd7f-43ef-ad81-a0496611db26 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:06.734320 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c265101b-bd7f-43ef-ad81-a0496611db26 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:06.738624 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c265101b-bd7f-43ef-ad81-a0496611db26 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:06.739223 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c265101b-bd7f-43ef-ad81-a0496611db26 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:06.740275 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c265101b-bd7f-43ef-ad81-a0496611db26 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:06.869310 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-12fd53c3-bb3f-4040-9f1f-e2cc5ebc5a60 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:06.887061 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-12fd53c3-bb3f-4040-9f1f-e2cc5ebc5a60 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:06.888946 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-12fd53c3-bb3f-4040-9f1f-e2cc5ebc5a60 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:06.890793 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-12fd53c3-bb3f-4040-9f1f-e2cc5ebc5a60 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1281 microversion: 2.25 time: 1.343639 Sep 16 12:57:06.892040 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1437/2784] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:05 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1281 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:57:06.971963 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-c265101b-bd7f-43ef-ad81-a0496611db26 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lazy-loading 'services' on Instance uuid 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:57:07.013556 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c265101b-bd7f-43ef-ad81-a0496611db26 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1927 microversion: 2.75 time: 0.317132 Sep 16 12:57:07.034038 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1348/2785] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:06 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1927 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:57:07.326080 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a7f6c3eb-fc3f-460a-98e0-0fa225903e7e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:07.326702 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a7f6c3eb-fc3f-460a-98e0-0fa225903e7e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:07.353713 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7f6c3eb-fc3f-460a-98e0-0fa225903e7e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:07.354027 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7f6c3eb-fc3f-460a-98e0-0fa225903e7e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:07.354536 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7f6c3eb-fc3f-460a-98e0-0fa225903e7e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:07.355214 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7f6c3eb-fc3f-460a-98e0-0fa225903e7e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:07.356175 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7f6c3eb-fc3f-460a-98e0-0fa225903e7e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:07.356589 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7f6c3eb-fc3f-460a-98e0-0fa225903e7e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:07.365927 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:57:07.458728 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-71942141-1516-4e7f-b0fc-aa281211792c tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d871ed67-2ce1-4084-97a4-4788c4c51c09"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:57:07.461674 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-71942141-1516-4e7f-b0fc-aa281211792c tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 8d3df84c-ed0d-41a9-8632-63591274c2eb] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:07.478670 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-71942141-1516-4e7f-b0fc-aa281211792c tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:07.485818 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-71942141-1516-4e7f-b0fc-aa281211792c tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:07.487864 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-71942141-1516-4e7f-b0fc-aa281211792c tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:07.489086 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-71942141-1516-4e7f-b0fc-aa281211792c tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:07.493201 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-71942141-1516-4e7f-b0fc-aa281211792c tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:07.493869 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-71942141-1516-4e7f-b0fc-aa281211792c tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:07.718534 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a7f6c3eb-fc3f-460a-98e0-0fa225903e7e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:07.757093 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a7f6c3eb-fc3f-460a-98e0-0fa225903e7e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1674 microversion: 2.1 time: 0.435509 Sep 16 12:57:07.759059 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1438/2786] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:07 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1674 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:57:08.132326 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-85861727-6444-4674-8ef4-b531e62e4b51 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1556174639", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "2a13e2e0-76af-4011-86c3-ccf3c7f1953b"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:57:08.245215 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-85861727-6444-4674-8ef4-b531e62e4b51 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] validate_networks() for [('2a13e2e0-76af-4011-86c3-ccf3c7f1953b', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:57:08.860693 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-71942141-1516-4e7f-b0fc-aa281211792c tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "POST /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.409311 Sep 16 12:57:08.864885 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1349/2787] 10.222.0.67 () {60 vars in 1323 bytes} [Fri Sep 16 12:57:07 2022] POST /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb/os-volume_attachments => generated 194 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:57:08.884280 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b4c72e82-6645-4bd2-a6bf-fd42b2483e32 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:08.888564 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b4c72e82-6645-4bd2-a6bf-fd42b2483e32 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:08.912899 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b4c72e82-6645-4bd2-a6bf-fd42b2483e32 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:08.914211 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b4c72e82-6645-4bd2-a6bf-fd42b2483e32 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:08.915681 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b4c72e82-6645-4bd2-a6bf-fd42b2483e32 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:08.918960 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b4c72e82-6645-4bd2-a6bf-fd42b2483e32 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:08.922608 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b4c72e82-6645-4bd2-a6bf-fd42b2483e32 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:08.924362 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b4c72e82-6645-4bd2-a6bf-fd42b2483e32 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:09.320814 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-b4c72e82-6645-4bd2-a6bf-fd42b2483e32 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:09.339125 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-b4c72e82-6645-4bd2-a6bf-fd42b2483e32 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:09.340839 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-b4c72e82-6645-4bd2-a6bf-fd42b2483e32 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:09.342692 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b4c72e82-6645-4bd2-a6bf-fd42b2483e32 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1281 microversion: 2.25 time: 0.475008 Sep 16 12:57:09.351591 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1350/2788] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:08 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1281 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:57:09.363657 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5237c7d1-3a6c-4309-9cc3-b62e94428c90 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:09.364325 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5237c7d1-3a6c-4309-9cc3-b62e94428c90 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:09.385283 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5237c7d1-3a6c-4309-9cc3-b62e94428c90 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:09.385739 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5237c7d1-3a6c-4309-9cc3-b62e94428c90 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:09.386185 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5237c7d1-3a6c-4309-9cc3-b62e94428c90 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:09.386959 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5237c7d1-3a6c-4309-9cc3-b62e94428c90 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:09.387424 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5237c7d1-3a6c-4309-9cc3-b62e94428c90 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:09.387855 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5237c7d1-3a6c-4309-9cc3-b62e94428c90 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:09.525647 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-5237c7d1-3a6c-4309-9cc3-b62e94428c90 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lazy-loading 'services' on Instance uuid 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:57:09.567430 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5237c7d1-3a6c-4309-9cc3-b62e94428c90 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1927 microversion: 2.75 time: 0.214319 Sep 16 12:57:09.571911 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1351/2789] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:09 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1927 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:57:09.581852 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-48fb93d6-5266-4227-9efe-18ac3389b0e0 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:09.583883 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-48fb93d6-5266-4227-9efe-18ac3389b0e0 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:09.599734 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-48fb93d6-5266-4227-9efe-18ac3389b0e0 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:09.604365 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-48fb93d6-5266-4227-9efe-18ac3389b0e0 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:09.605181 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-48fb93d6-5266-4227-9efe-18ac3389b0e0 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:09.606624 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-48fb93d6-5266-4227-9efe-18ac3389b0e0 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:09.607340 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-48fb93d6-5266-4227-9efe-18ac3389b0e0 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:09.608817 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-48fb93d6-5266-4227-9efe-18ac3389b0e0 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:09.689705 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-85861727-6444-4674-8ef4-b531e62e4b51 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:57:09.690241 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-85861727-6444-4674-8ef4-b531e62e4b51 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:57:09.690599 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-85861727-6444-4674-8ef4-b531e62e4b51 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:57:09.691015 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-85861727-6444-4674-8ef4-b531e62e4b51 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:57:09.691433 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-85861727-6444-4674-8ef4-b531e62e4b51 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:57:09.727259 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-85861727-6444-4674-8ef4-b531e62e4b51 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:09.732592 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-85861727-6444-4674-8ef4-b531e62e4b51 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:09.733466 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-85861727-6444-4674-8ef4-b531e62e4b51 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:09.739420 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-85861727-6444-4674-8ef4-b531e62e4b51 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:09.743486 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-85861727-6444-4674-8ef4-b531e62e4b51 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:09.744533 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-85861727-6444-4674-8ef4-b531e62e4b51 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:09.800722 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-85861727-6444-4674-8ef4-b531e62e4b51 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Getting quotas for project bd30c33cb19d47278478aa2340859920. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:57:09.827584 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-85861727-6444-4674-8ef4-b531e62e4b51 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Getting quotas for user 0e9ec543501c49daaa37af078622626e and project bd30c33cb19d47278478aa2340859920. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:57:09.878154 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-85861727-6444-4674-8ef4-b531e62e4b51 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Going to run 2 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:57:09.881024 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-85861727-6444-4674-8ef4-b531e62e4b51 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: cc7e9284-2d49-41b2-ad73-0073b2e8bcc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:57:09.952919 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-85861727-6444-4674-8ef4-b531e62e4b51 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: c31cfc02-e506-4e4f-b06d-a0d38e56c5b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=cc7e9284-2d49-41b2-ad73-0073b2e8bcc6,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:57:10.109854 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-85861727-6444-4674-8ef4-b531e62e4b51 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.252464 Sep 16 12:57:10.119163 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1439/2790] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:57:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2264 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:57:10.126271 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-29eb40e2-c5f6-43ee-9020-bd5781d3677d tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:10.134932 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-48fb93d6-5266-4227-9efe-18ac3389b0e0 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:10.155401 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-29eb40e2-c5f6-43ee-9020-bd5781d3677d tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0e9ec543501c49daaa37af078622626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd30c33cb19d47278478aa2340859920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:10.156152 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-29eb40e2-c5f6-43ee-9020-bd5781d3677d tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Searching by: {'deleted': False, 'project_id': 'bd30c33cb19d47278478aa2340859920'} {{(pid=128779) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 12:57:10.159127 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-48fb93d6-5266-4227-9efe-18ac3389b0e0 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1607 microversion: 2.1 time: 0.585789 Sep 16 12:57:10.168526 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1352/2791] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:09 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1607 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:10.203685 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29eb40e2-c5f6-43ee-9020-bd5781d3677d tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:10.212220 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29eb40e2-c5f6-43ee-9020-bd5781d3677d tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:10.214498 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29eb40e2-c5f6-43ee-9020-bd5781d3677d tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:10.215370 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29eb40e2-c5f6-43ee-9020-bd5781d3677d tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:10.215857 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29eb40e2-c5f6-43ee-9020-bd5781d3677d tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:10.223978 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29eb40e2-c5f6-43ee-9020-bd5781d3677d tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:10.299922 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-29eb40e2-c5f6-43ee-9020-bd5781d3677d tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.179143 Sep 16 12:57:10.300673 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1440/2792] 10.222.0.67 () {58 vars in 1125 bytes} [Fri Sep 16 12:57:10 2022] GET /compute/v2.1/servers => generated 677 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:57:10.313153 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-650313c0-ebe8-46a5-8a66-6135b8a6efb4 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:10.313784 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-650313c0-ebe8-46a5-8a66-6135b8a6efb4 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: c31cfc02-e506-4e4f-b06d-a0d38e56c5b6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:10.375250 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3ce0edf0-dc43-4c5b-bd4a-1afbbe9c214e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:10.376014 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3ce0edf0-dc43-4c5b-bd4a-1afbbe9c214e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:10.391047 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ce0edf0-dc43-4c5b-bd4a-1afbbe9c214e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:10.391516 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ce0edf0-dc43-4c5b-bd4a-1afbbe9c214e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:10.391935 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ce0edf0-dc43-4c5b-bd4a-1afbbe9c214e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:10.395025 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ce0edf0-dc43-4c5b-bd4a-1afbbe9c214e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:10.395504 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ce0edf0-dc43-4c5b-bd4a-1afbbe9c214e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:10.395942 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ce0edf0-dc43-4c5b-bd4a-1afbbe9c214e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:10.565937 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-650313c0-ebe8-46a5-8a66-6135b8a6efb4 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ec543501c49daaa37af078622626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd30c33cb19d47278478aa2340859920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:10.586099 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-650313c0-ebe8-46a5-8a66-6135b8a6efb4 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "GET /compute/v2.1/servers/c31cfc02-e506-4e4f-b06d-a0d38e56c5b6" status: 200 len: 1220 microversion: 2.1 time: 0.275686 Sep 16 12:57:10.606433 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1353/2793] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:10 2022] GET /compute/v2.1/servers/c31cfc02-e506-4e4f-b06d-a0d38e56c5b6 => generated 1220 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:10.617332 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e24137a1-b543-4a09-b3f7-bf916cdc4843 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:10.620207 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e24137a1-b543-4a09-b3f7-bf916cdc4843 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:10.634169 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e24137a1-b543-4a09-b3f7-bf916cdc4843 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:10.637541 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e24137a1-b543-4a09-b3f7-bf916cdc4843 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:10.641885 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e24137a1-b543-4a09-b3f7-bf916cdc4843 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:10.644797 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e24137a1-b543-4a09-b3f7-bf916cdc4843 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:10.649231 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e24137a1-b543-4a09-b3f7-bf916cdc4843 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:10.651205 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e24137a1-b543-4a09-b3f7-bf916cdc4843 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:10.976736 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-e24137a1-b543-4a09-b3f7-bf916cdc4843 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lazy-loading 'services' on Instance uuid 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:57:11.043082 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e24137a1-b543-4a09-b3f7-bf916cdc4843 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1927 microversion: 2.75 time: 0.433900 Sep 16 12:57:11.045552 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1354/2794] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:10 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1927 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:57:11.175236 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3ce0edf0-dc43-4c5b-bd4a-1afbbe9c214e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:11.196337 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9afa3707-2ccd-4759-8b23-21646ec5603d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:11.197696 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9afa3707-2ccd-4759-8b23-21646ec5603d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:11.206078 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9afa3707-2ccd-4759-8b23-21646ec5603d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:11.206587 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9afa3707-2ccd-4759-8b23-21646ec5603d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:11.207104 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9afa3707-2ccd-4759-8b23-21646ec5603d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:11.220171 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3ce0edf0-dc43-4c5b-bd4a-1afbbe9c214e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:11.227426 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3ce0edf0-dc43-4c5b-bd4a-1afbbe9c214e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:11.228819 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3ce0edf0-dc43-4c5b-bd4a-1afbbe9c214e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1281 microversion: 2.25 time: 0.857527 Sep 16 12:57:11.234682 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9afa3707-2ccd-4759-8b23-21646ec5603d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:11.235453 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9afa3707-2ccd-4759-8b23-21646ec5603d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:11.236003 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9afa3707-2ccd-4759-8b23-21646ec5603d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:11.240847 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1441/2795] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:10 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1281 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:57:11.465511 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9afa3707-2ccd-4759-8b23-21646ec5603d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:11.481671 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9afa3707-2ccd-4759-8b23-21646ec5603d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 200 len: 1607 microversion: 2.1 time: 0.287090 Sep 16 12:57:11.482328 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1355/2796] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:11 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 1607 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:11.612102 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d77143d7-9285-4755-a331-21ce9d421385 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:11.612751 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d77143d7-9285-4755-a331-21ce9d421385 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: c31cfc02-e506-4e4f-b06d-a0d38e56c5b6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:11.775826 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-0f3960ff-65a5-4160-b467-f34759bef4e3 req-44dc8f03-e3c2-4287-8a9d-c1da765ea549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ad8536a-46b8-4821-8fb0-2c743927bb88", "name": "network-vif-deleted", "tag": "c0c1968f-d991-4e36-8062-6ff62eb7adfb"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:57:11.795351 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:57:11.839603 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-0f3960ff-65a5-4160-b467-f34759bef4e3 req-44dc8f03-e3c2-4287-8a9d-c1da765ea549 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:11.840400 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-0f3960ff-65a5-4160-b467-f34759bef4e3 req-44dc8f03-e3c2-4287-8a9d-c1da765ea549 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:11.843550 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-0f3960ff-65a5-4160-b467-f34759bef4e3 req-44dc8f03-e3c2-4287-8a9d-c1da765ea549 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:11.911133 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-0f3960ff-65a5-4160-b467-f34759bef4e3 req-44dc8f03-e3c2-4287-8a9d-c1da765ea549 service nova] Creating event network-vif-deleted:c0c1968f-d991-4e36-8062-6ff62eb7adfb for instance 9ad8536a-46b8-4821-8fb0-2c743927bb88 on n-h2-858094-4 Sep 16 12:57:11.944573 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-0f3960ff-65a5-4160-b467-f34759bef4e3 req-44dc8f03-e3c2-4287-8a9d-c1da765ea549 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173889 Sep 16 12:57:11.949079 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1356/2797] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:57:12.077621 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-db6f4d7a-cf2b-466a-b359-e28b2cd0e9a0 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:12.078474 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-db6f4d7a-cf2b-466a-b359-e28b2cd0e9a0 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:12.098038 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db6f4d7a-cf2b-466a-b359-e28b2cd0e9a0 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:12.098734 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db6f4d7a-cf2b-466a-b359-e28b2cd0e9a0 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:12.099875 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db6f4d7a-cf2b-466a-b359-e28b2cd0e9a0 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:12.101090 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db6f4d7a-cf2b-466a-b359-e28b2cd0e9a0 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:12.103221 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db6f4d7a-cf2b-466a-b359-e28b2cd0e9a0 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:12.103882 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db6f4d7a-cf2b-466a-b359-e28b2cd0e9a0 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:13.015781 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-db6f4d7a-cf2b-466a-b359-e28b2cd0e9a0 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lazy-loading 'services' on Instance uuid 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:57:13.077452 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-db6f4d7a-cf2b-466a-b359-e28b2cd0e9a0 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1927 microversion: 2.75 time: 1.005941 Sep 16 12:57:13.078048 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1357/2798] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:12 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1927 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:57:13.079819 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d77143d7-9285-4755-a331-21ce9d421385 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ec543501c49daaa37af078622626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd30c33cb19d47278478aa2340859920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:13.101853 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d8042ad2-c505-48a2-85ff-fc8bd69f4a67 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:13.102485 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d8042ad2-c505-48a2-85ff-fc8bd69f4a67 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:13.107284 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d77143d7-9285-4755-a331-21ce9d421385 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "GET /compute/v2.1/servers/c31cfc02-e506-4e4f-b06d-a0d38e56c5b6" status: 200 len: 1220 microversion: 2.1 time: 1.499574 Sep 16 12:57:13.108862 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1442/2799] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:11 2022] GET /compute/v2.1/servers/c31cfc02-e506-4e4f-b06d-a0d38e56c5b6 => generated 1220 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:13.131203 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d8042ad2-c505-48a2-85ff-fc8bd69f4a67 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:13.142604 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d8042ad2-c505-48a2-85ff-fc8bd69f4a67 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:13.143336 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d8042ad2-c505-48a2-85ff-fc8bd69f4a67 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:13.147875 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d8042ad2-c505-48a2-85ff-fc8bd69f4a67 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:13.148647 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d8042ad2-c505-48a2-85ff-fc8bd69f4a67 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:13.149300 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d8042ad2-c505-48a2-85ff-fc8bd69f4a67 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:13.150885 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-65e0b4da-8b8f-4383-b448-c476bcbfdcd5 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:13.155577 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-65e0b4da-8b8f-4383-b448-c476bcbfdcd5 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:13.187753 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65e0b4da-8b8f-4383-b448-c476bcbfdcd5 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:13.191156 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65e0b4da-8b8f-4383-b448-c476bcbfdcd5 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:13.191662 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65e0b4da-8b8f-4383-b448-c476bcbfdcd5 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:13.195568 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65e0b4da-8b8f-4383-b448-c476bcbfdcd5 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:13.198649 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65e0b4da-8b8f-4383-b448-c476bcbfdcd5 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:13.201544 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65e0b4da-8b8f-4383-b448-c476bcbfdcd5 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:13.270649 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-65e0b4da-8b8f-4383-b448-c476bcbfdcd5 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] HTTP exception thrown: Instance 9ad8536a-46b8-4821-8fb0-2c743927bb88 could not be found. Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-65e0b4da-8b8f-4383-b448-c476bcbfdcd5 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Request method failure captured: Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 HTTP/1.1 Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHG3SwHS-l0WitPOzDSYA44CeJXLIzVxgr-MHeRUPHLkCmQshOXungF3JmTqRR5iusdVZCtU5BHnBL7LOCSV4K_6utRyxrplivDCcD85IiEW1gN4Yw9gJp7Mrm5YkkjyT9tJc58fqahkRyPfD_CsC349BMa6OwVpDa780GBoFo4Gi0E Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 7a67136b9d8041fd8e62a81be2d6b48d Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-AttachVolumeTestJSON-2140946303 Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7a67136b9d8041fd8e62a81be2d6b48d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7a67136b9d8041fd8e62a81be2d6b48d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7a67136b9d8041fd8e62a81be2d6b48d", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7a67136b9d8041fd8e62a81be2d6b48d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-AttachVolumeTestJSON-2140946303 Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 7a67136b9d8041fd8e62a81be2d6b48d Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2140946303 Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-AttachVolumeTestJSON-2140946303-project Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 65566509bf544a398cbb9c29ace613c5 Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-AttachVolumeTestJSON-2140946303-project Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 9ad8536a-46b8-4821-8fb0-2c743927bb88 could not be found. Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '9ad8536a-46b8-4821-8fb0-2c743927bb88'} Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ad8536a-46b8-4821-8fb0-2c743927bb88 could not be found. Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ad8536a-46b8-4821-8fb0-2c743927bb88 could not be found. Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:57:13.276503 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:13.280529 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:57:13.280529 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:57:13.280529 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:57:13.280529 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:57:13.280529 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:57:13.280529 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ad8536a-46b8-4821-8fb0-2c743927bb88 could not be found. Sep 16 12:57:13.280529 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:13.280529 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-65e0b4da-8b8f-4383-b448-c476bcbfdcd5 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Returning 404 to user: Instance 9ad8536a-46b8-4821-8fb0-2c743927bb88 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:57:13.284597 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-65e0b4da-8b8f-4383-b448-c476bcbfdcd5 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 404 len: 111 microversion: 2.1 time: 0.174228 Sep 16 12:57:13.285201 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1443/2800] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:13 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:57:13.305484 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7854097f-68d5-4112-b4f2-fee214f2c25d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '.version_select at 0x7f10399e1700>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:13.371693 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7854097f-68d5-4112-b4f2-fee214f2c25d tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1009663872" status: 202 len: 0 microversion: 2.1 time: 0.079844 Sep 16 12:57:13.378056 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1444/2801] 10.222.0.67 () {58 vars in 1221 bytes} [Fri Sep 16 12:57:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1009663872 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:57:13.924021 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d8042ad2-c505-48a2-85ff-fc8bd69f4a67 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:13.934813 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d8042ad2-c505-48a2-85ff-fc8bd69f4a67 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:13.944193 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d8042ad2-c505-48a2-85ff-fc8bd69f4a67 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:13.948375 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d8042ad2-c505-48a2-85ff-fc8bd69f4a67 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1281 microversion: 2.25 time: 0.854976 Sep 16 12:57:13.951575 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1358/2802] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:13 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1281 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:57:14.111302 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0c5d3061-d6c2-4cda-9832-3ba9f09143ce tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:14.112566 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0c5d3061-d6c2-4cda-9832-3ba9f09143ce tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:14.138928 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c5d3061-d6c2-4cda-9832-3ba9f09143ce tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:14.139442 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c5d3061-d6c2-4cda-9832-3ba9f09143ce tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:14.139862 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c5d3061-d6c2-4cda-9832-3ba9f09143ce tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:14.140625 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c5d3061-d6c2-4cda-9832-3ba9f09143ce tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:14.141084 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c5d3061-d6c2-4cda-9832-3ba9f09143ce tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:14.141516 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c5d3061-d6c2-4cda-9832-3ba9f09143ce tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:14.143342 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-73227706-8143-4042-b403-5c86e8fa146f tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:14.144550 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-73227706-8143-4042-b403-5c86e8fa146f tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: c31cfc02-e506-4e4f-b06d-a0d38e56c5b6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:14.158800 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-73227706-8143-4042-b403-5c86e8fa146f tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:14.159891 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-73227706-8143-4042-b403-5c86e8fa146f tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:14.160524 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-73227706-8143-4042-b403-5c86e8fa146f tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:14.165012 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-73227706-8143-4042-b403-5c86e8fa146f tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:14.165854 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-73227706-8143-4042-b403-5c86e8fa146f tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:14.166445 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-73227706-8143-4042-b403-5c86e8fa146f tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:14.386051 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-0c5d3061-d6c2-4cda-9832-3ba9f09143ce tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lazy-loading 'services' on Instance uuid 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:57:14.392476 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-73227706-8143-4042-b403-5c86e8fa146f tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ec543501c49daaa37af078622626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd30c33cb19d47278478aa2340859920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:14.412973 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-73227706-8143-4042-b403-5c86e8fa146f tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "GET /compute/v2.1/servers/c31cfc02-e506-4e4f-b06d-a0d38e56c5b6" status: 200 len: 1278 microversion: 2.1 time: 0.282059 Sep 16 12:57:14.414228 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1359/2803] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:14 2022] GET /compute/v2.1/servers/c31cfc02-e506-4e4f-b06d-a0d38e56c5b6 => generated 1278 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:14.429122 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0c5d3061-d6c2-4cda-9832-3ba9f09143ce tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1927 microversion: 2.75 time: 0.321682 Sep 16 12:57:14.448593 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1445/2804] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:14 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1927 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:57:14.983421 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e015b5a4-3b9d-4ffa-abc7-d06606509630 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:14.984690 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e015b5a4-3b9d-4ffa-abc7-d06606509630 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:14.995493 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e015b5a4-3b9d-4ffa-abc7-d06606509630 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:14.999815 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e015b5a4-3b9d-4ffa-abc7-d06606509630 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:15.000601 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e015b5a4-3b9d-4ffa-abc7-d06606509630 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:15.002559 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e015b5a4-3b9d-4ffa-abc7-d06606509630 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:15.004355 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e015b5a4-3b9d-4ffa-abc7-d06606509630 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:15.008297 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e015b5a4-3b9d-4ffa-abc7-d06606509630 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:15.293691 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-446ad676-60d6-4787-9dee-8ee75b0cebc3 req-70205050-5f1f-4e1f-a195-c17b9a94fdd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b229371-5f66-466c-a96b-2f668a855aa0", "name": "network-vif-plugged", "status": "completed", "tag": "ad0051b5-79e3-4c40-9a1d-6ef2e5b301e7"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:57:15.311339 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-446ad676-60d6-4787-9dee-8ee75b0cebc3 req-70205050-5f1f-4e1f-a195-c17b9a94fdd4 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:15.317995 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-446ad676-60d6-4787-9dee-8ee75b0cebc3 req-70205050-5f1f-4e1f-a195-c17b9a94fdd4 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:15.318732 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-446ad676-60d6-4787-9dee-8ee75b0cebc3 req-70205050-5f1f-4e1f-a195-c17b9a94fdd4 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:15.348280 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-446ad676-60d6-4787-9dee-8ee75b0cebc3 req-70205050-5f1f-4e1f-a195-c17b9a94fdd4 service nova] Creating event network-vif-plugged:ad0051b5-79e3-4c40-9a1d-6ef2e5b301e7 for instance 3b229371-5f66-466c-a96b-2f668a855aa0 on n-h1-858094-4 Sep 16 12:57:15.357826 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-446ad676-60d6-4787-9dee-8ee75b0cebc3 req-70205050-5f1f-4e1f-a195-c17b9a94fdd4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068126 Sep 16 12:57:15.367581 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1446/2805] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:57:15.442653 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b8a95f74-02f0-4bb0-849a-0ba0274665a4 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:15.443857 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b8a95f74-02f0-4bb0-849a-0ba0274665a4 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: c31cfc02-e506-4e4f-b06d-a0d38e56c5b6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:15.446166 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:57:15.468032 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8a95f74-02f0-4bb0-849a-0ba0274665a4 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:15.468833 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8a95f74-02f0-4bb0-849a-0ba0274665a4 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:15.469635 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8a95f74-02f0-4bb0-849a-0ba0274665a4 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:15.470785 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8a95f74-02f0-4bb0-849a-0ba0274665a4 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:15.494529 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8a95f74-02f0-4bb0-849a-0ba0274665a4 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:15.495033 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8a95f74-02f0-4bb0-849a-0ba0274665a4 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:15.988828 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e015b5a4-3b9d-4ffa-abc7-d06606509630 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:16.002964 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e015b5a4-3b9d-4ffa-abc7-d06606509630 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:16.007078 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e015b5a4-3b9d-4ffa-abc7-d06606509630 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:16.009023 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e015b5a4-3b9d-4ffa-abc7-d06606509630 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1281 microversion: 2.25 time: 1.029662 Sep 16 12:57:16.010902 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1360/2806] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:14 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1281 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:57:16.021613 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-177d44cb-f6ad-4b80-a779-46f6a37a4839 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:16.023916 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-177d44cb-f6ad-4b80-a779-46f6a37a4839 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:16.079434 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-177d44cb-f6ad-4b80-a779-46f6a37a4839 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:16.080428 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-177d44cb-f6ad-4b80-a779-46f6a37a4839 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:16.083240 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-177d44cb-f6ad-4b80-a779-46f6a37a4839 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:16.084419 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-177d44cb-f6ad-4b80-a779-46f6a37a4839 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:16.085032 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-177d44cb-f6ad-4b80-a779-46f6a37a4839 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:16.085525 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-177d44cb-f6ad-4b80-a779-46f6a37a4839 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:16.296976 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b8a95f74-02f0-4bb0-849a-0ba0274665a4 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ec543501c49daaa37af078622626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd30c33cb19d47278478aa2340859920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:16.325321 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b8a95f74-02f0-4bb0-849a-0ba0274665a4 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "GET /compute/v2.1/servers/c31cfc02-e506-4e4f-b06d-a0d38e56c5b6" status: 200 len: 1320 microversion: 2.1 time: 0.885086 Sep 16 12:57:16.327897 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-177d44cb-f6ad-4b80-a779-46f6a37a4839 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lazy-loading 'services' on Instance uuid 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:57:16.328635 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1447/2807] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:15 2022] GET /compute/v2.1/servers/c31cfc02-e506-4e4f-b06d-a0d38e56c5b6 => generated 1320 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:57:16.348658 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-535cf011-e951-48e2-91de-97d93bff1c8f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Action: 'create', calling method: .version_select at 0x7f103526ee50>, body: {"keypair": {"name": "tempest-keypair-1378354979", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4DgcjKVCHXmZccK2eRwOrxM65+D3Njd9VtWIm9Vv8e+kWBpyeuvab3+5D28U+TBeex+GnCNA2sk/lZUU7pCvQaau+CI7G1VOLPpY6DoKk2pOHXiHuuwrylgJ7KPIPTvw=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:57:16.379894 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-177d44cb-f6ad-4b80-a779-46f6a37a4839 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1927 microversion: 2.75 time: 0.367016 Sep 16 12:57:16.381939 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1361/2808] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:16 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1927 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:57:16.391031 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-535cf011-e951-48e2-91de-97d93bff1c8f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Getting quotas for project 7a67136b9d8041fd8e62a81be2d6b48d. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:57:16.399846 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-535cf011-e951-48e2-91de-97d93bff1c8f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Getting quotas for user 65566509bf544a398cbb9c29ace613c5 and project 7a67136b9d8041fd8e62a81be2d6b48d. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:57:16.454603 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-535cf011-e951-48e2-91de-97d93bff1c8f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.122875 Sep 16 12:57:16.455505 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1448/2809] 10.222.0.67 () {60 vars in 1159 bytes} [Fri Sep 16 12:57:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:57:17.045368 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-076ecb12-9907-42cf-964a-c3a9e3c039f7 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:17.046751 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-076ecb12-9907-42cf-964a-c3a9e3c039f7 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:17.058000 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-076ecb12-9907-42cf-964a-c3a9e3c039f7 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:17.059411 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-076ecb12-9907-42cf-964a-c3a9e3c039f7 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:17.060614 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-076ecb12-9907-42cf-964a-c3a9e3c039f7 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:17.061457 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-076ecb12-9907-42cf-964a-c3a9e3c039f7 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:17.063741 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-076ecb12-9907-42cf-964a-c3a9e3c039f7 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:17.065601 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-076ecb12-9907-42cf-964a-c3a9e3c039f7 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:17.083192 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:57:17.355639 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8aa3b00a-63f0-4861-91c1-19d79f707141 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:17.359981 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8aa3b00a-63f0-4861-91c1-19d79f707141 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: c31cfc02-e506-4e4f-b06d-a0d38e56c5b6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:17.404415 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8aa3b00a-63f0-4861-91c1-19d79f707141 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:17.406585 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8aa3b00a-63f0-4861-91c1-19d79f707141 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:17.408651 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8aa3b00a-63f0-4861-91c1-19d79f707141 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:17.414787 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8aa3b00a-63f0-4861-91c1-19d79f707141 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:17.416344 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8aa3b00a-63f0-4861-91c1-19d79f707141 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:17.417046 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8aa3b00a-63f0-4861-91c1-19d79f707141 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:17.881843 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-076ecb12-9907-42cf-964a-c3a9e3c039f7 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:17.899019 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-076ecb12-9907-42cf-964a-c3a9e3c039f7 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:17.900559 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-076ecb12-9907-42cf-964a-c3a9e3c039f7 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:17.901730 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-076ecb12-9907-42cf-964a-c3a9e3c039f7 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1281 microversion: 2.25 time: 0.860969 Sep 16 12:57:17.905028 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1362/2810] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:17 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1281 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:57:17.931248 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f05946da-3106-400a-ac7f-ef6060231fba tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:17.931981 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f05946da-3106-400a-ac7f-ef6060231fba tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:17.948732 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f05946da-3106-400a-ac7f-ef6060231fba tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:17.949681 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f05946da-3106-400a-ac7f-ef6060231fba tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:17.950167 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f05946da-3106-400a-ac7f-ef6060231fba tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:17.951005 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f05946da-3106-400a-ac7f-ef6060231fba tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:17.951817 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f05946da-3106-400a-ac7f-ef6060231fba tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:17.952496 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f05946da-3106-400a-ac7f-ef6060231fba tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:18.027446 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8aa3b00a-63f0-4861-91c1-19d79f707141 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ec543501c49daaa37af078622626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd30c33cb19d47278478aa2340859920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:18.040581 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8aa3b00a-63f0-4861-91c1-19d79f707141 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "GET /compute/v2.1/servers/c31cfc02-e506-4e4f-b06d-a0d38e56c5b6" status: 200 len: 1320 microversion: 2.1 time: 0.688811 Sep 16 12:57:18.047715 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1449/2811] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:17 2022] GET /compute/v2.1/servers/c31cfc02-e506-4e4f-b06d-a0d38e56c5b6 => generated 1320 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:18.153390 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-f05946da-3106-400a-ac7f-ef6060231fba tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lazy-loading 'services' on Instance uuid 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:57:18.198842 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f05946da-3106-400a-ac7f-ef6060231fba tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1933 microversion: 2.75 time: 0.291070 Sep 16 12:57:18.200975 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1363/2812] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:17 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1933 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:57:18.388829 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-6c3f9884-ffd9-4d85-bd10-3922abaffa4c req-df95c04f-3790-486e-aeb6-758c24e26ab8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c31cfc02-e506-4e4f-b06d-a0d38e56c5b6", "tag": "6a98d6d9-ecee-467f-84c8-ff25d39449e6"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:57:18.405156 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-6c3f9884-ffd9-4d85-bd10-3922abaffa4c req-df95c04f-3790-486e-aeb6-758c24e26ab8 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:18.406000 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-6c3f9884-ffd9-4d85-bd10-3922abaffa4c req-df95c04f-3790-486e-aeb6-758c24e26ab8 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:18.406868 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-6c3f9884-ffd9-4d85-bd10-3922abaffa4c req-df95c04f-3790-486e-aeb6-758c24e26ab8 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:18.422791 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-6c3f9884-ffd9-4d85-bd10-3922abaffa4c req-df95c04f-3790-486e-aeb6-758c24e26ab8 service nova] Creating event network-changed:6a98d6d9-ecee-467f-84c8-ff25d39449e6 for instance c31cfc02-e506-4e4f-b06d-a0d38e56c5b6 on n-h1-858094-4 Sep 16 12:57:18.430866 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-6c3f9884-ffd9-4d85-bd10-3922abaffa4c req-df95c04f-3790-486e-aeb6-758c24e26ab8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050030 Sep 16 12:57:18.432180 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1450/2813] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:57:18.928666 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-30d2daa6-ded2-48ca-9e39-6800894f4b8e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:18.929782 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-30d2daa6-ded2-48ca-9e39-6800894f4b8e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:18.947176 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-30d2daa6-ded2-48ca-9e39-6800894f4b8e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:18.947904 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-30d2daa6-ded2-48ca-9e39-6800894f4b8e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:18.950024 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-30d2daa6-ded2-48ca-9e39-6800894f4b8e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:18.950366 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-30d2daa6-ded2-48ca-9e39-6800894f4b8e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:18.953139 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-30d2daa6-ded2-48ca-9e39-6800894f4b8e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:18.962530 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-30d2daa6-ded2-48ca-9e39-6800894f4b8e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:19.078594 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d0703f9c-c2ee-44ec-9434-b1379ab1920e tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:19.079333 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d0703f9c-c2ee-44ec-9434-b1379ab1920e tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: c31cfc02-e506-4e4f-b06d-a0d38e56c5b6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:19.093814 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0703f9c-c2ee-44ec-9434-b1379ab1920e tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:19.094288 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0703f9c-c2ee-44ec-9434-b1379ab1920e tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:19.094732 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0703f9c-c2ee-44ec-9434-b1379ab1920e tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:19.095449 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0703f9c-c2ee-44ec-9434-b1379ab1920e tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:19.095914 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0703f9c-c2ee-44ec-9434-b1379ab1920e tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:19.096387 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0703f9c-c2ee-44ec-9434-b1379ab1920e tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:19.908040 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-30d2daa6-ded2-48ca-9e39-6800894f4b8e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:19.921562 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-30d2daa6-ded2-48ca-9e39-6800894f4b8e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:19.924413 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-30d2daa6-ded2-48ca-9e39-6800894f4b8e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:19.927706 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-30d2daa6-ded2-48ca-9e39-6800894f4b8e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1477 microversion: 2.25 time: 1.002774 Sep 16 12:57:19.930811 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1364/2814] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:18 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1477 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:57:19.941745 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a0acd895-5778-46a4-9915-2677a07ca076 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:19.943428 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a0acd895-5778-46a4-9915-2677a07ca076 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:19.964376 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a0acd895-5778-46a4-9915-2677a07ca076 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:19.964870 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a0acd895-5778-46a4-9915-2677a07ca076 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:19.965536 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a0acd895-5778-46a4-9915-2677a07ca076 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:19.968705 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a0acd895-5778-46a4-9915-2677a07ca076 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:19.969533 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a0acd895-5778-46a4-9915-2677a07ca076 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:19.970448 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a0acd895-5778-46a4-9915-2677a07ca076 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:19.973455 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d0703f9c-c2ee-44ec-9434-b1379ab1920e tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ec543501c49daaa37af078622626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd30c33cb19d47278478aa2340859920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:20.009625 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d0703f9c-c2ee-44ec-9434-b1379ab1920e tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "GET /compute/v2.1/servers/c31cfc02-e506-4e4f-b06d-a0d38e56c5b6" status: 200 len: 1320 microversion: 2.1 time: 0.947108 Sep 16 12:57:20.013586 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1451/2815] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:19 2022] GET /compute/v2.1/servers/c31cfc02-e506-4e4f-b06d-a0d38e56c5b6 => generated 1320 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:20.079742 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-a0acd895-5778-46a4-9915-2677a07ca076 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] Lazy-loading 'services' on Instance uuid 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:57:20.103704 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a0acd895-5778-46a4-9915-2677a07ca076 tempest-ServersAdmin275Test-615773775 tempest-ServersAdmin275Test-615773775-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1918 microversion: 2.75 time: 0.171545 Sep 16 12:57:20.105549 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1365/2816] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:19 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1918 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:57:20.153556 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-47ce8ce4-685a-4c20-9794-293a5f7d7998 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:20.154203 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-47ce8ce4-685a-4c20-9794-293a5f7d7998 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:20.161660 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-47ce8ce4-685a-4c20-9794-293a5f7d7998 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:20.162604 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-47ce8ce4-685a-4c20-9794-293a5f7d7998 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:20.163404 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-47ce8ce4-685a-4c20-9794-293a5f7d7998 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:20.164430 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-47ce8ce4-685a-4c20-9794-293a5f7d7998 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:20.165129 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-47ce8ce4-685a-4c20-9794-293a5f7d7998 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:20.165792 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-47ce8ce4-685a-4c20-9794-293a5f7d7998 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:20.200956 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-47ce8ce4-685a-4c20-9794-293a5f7d7998 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:57:20.238735 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:57:20.347780 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-47ce8ce4-685a-4c20-9794-293a5f7d7998 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] 10.222.0.67 "DELETE /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 204 len: 0 microversion: 2.75 time: 0.196964 Sep 16 12:57:20.354537 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1366/2817] 10.222.0.67 () {60 vars in 1280 bytes} [Fri Sep 16 12:57:20 2022] DELETE /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 12:57:20.365757 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-75a2a5c6-951a-49e9-91bc-1cff1ea295f4 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:20.367479 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-75a2a5c6-951a-49e9-91bc-1cff1ea295f4 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:20.376438 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-75a2a5c6-951a-49e9-91bc-1cff1ea295f4 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:20.377045 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-75a2a5c6-951a-49e9-91bc-1cff1ea295f4 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:20.377991 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-75a2a5c6-951a-49e9-91bc-1cff1ea295f4 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:20.389799 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-75a2a5c6-951a-49e9-91bc-1cff1ea295f4 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:20.390777 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-75a2a5c6-951a-49e9-91bc-1cff1ea295f4 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:20.403600 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-75a2a5c6-951a-49e9-91bc-1cff1ea295f4 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:20.580520 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:57:20.616460 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cf6f8c3e-549e-4cd5-a600-d18587780bd5 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:20.617145 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cf6f8c3e-549e-4cd5-a600-d18587780bd5 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:20.630614 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf6f8c3e-549e-4cd5-a600-d18587780bd5 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:20.631206 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf6f8c3e-549e-4cd5-a600-d18587780bd5 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:20.631864 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf6f8c3e-549e-4cd5-a600-d18587780bd5 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:20.632627 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf6f8c3e-549e-4cd5-a600-d18587780bd5 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:20.634413 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf6f8c3e-549e-4cd5-a600-d18587780bd5 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:20.635594 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf6f8c3e-549e-4cd5-a600-d18587780bd5 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:21.011319 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-75a2a5c6-951a-49e9-91bc-1cff1ea295f4 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:21.025399 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-75a2a5c6-951a-49e9-91bc-1cff1ea295f4 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:21.030351 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-75a2a5c6-951a-49e9-91bc-1cff1ea295f4 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:21.046816 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-75a2a5c6-951a-49e9-91bc-1cff1ea295f4 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1443 microversion: 2.75 time: 0.689900 Sep 16 12:57:21.052009 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1367/2818] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:20 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1443 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:57:21.059039 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-8df51a98-4e86-424b-a9cb-b22f86b8cfe6 req-112ed8a8-968f-427b-bf09-9b63a895d8bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc7e9284-2d49-41b2-ad73-0073b2e8bcc6", "tag": "756b6c88-8a28-4069-a46d-126915a24fb8"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:57:21.087350 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-8df51a98-4e86-424b-a9cb-b22f86b8cfe6 req-112ed8a8-968f-427b-bf09-9b63a895d8bd service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:21.092535 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-8df51a98-4e86-424b-a9cb-b22f86b8cfe6 req-112ed8a8-968f-427b-bf09-9b63a895d8bd service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:21.093153 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-8df51a98-4e86-424b-a9cb-b22f86b8cfe6 req-112ed8a8-968f-427b-bf09-9b63a895d8bd service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:21.120757 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-8df51a98-4e86-424b-a9cb-b22f86b8cfe6 req-112ed8a8-968f-427b-bf09-9b63a895d8bd service nova] Creating event network-changed:756b6c88-8a28-4069-a46d-126915a24fb8 for instance cc7e9284-2d49-41b2-ad73-0073b2e8bcc6 on n-h2-858094-4 Sep 16 12:57:21.134283 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-8df51a98-4e86-424b-a9cb-b22f86b8cfe6 req-112ed8a8-968f-427b-bf09-9b63a895d8bd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080670 Sep 16 12:57:21.138055 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1368/2819] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:57:21.149928 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fa238828-bf50-4908-9514-94360b8f55ac tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:21.150741 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-fa238828-bf50-4908-9514-94360b8f55ac tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: c31cfc02-e506-4e4f-b06d-a0d38e56c5b6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:21.169068 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fa238828-bf50-4908-9514-94360b8f55ac tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:21.169799 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fa238828-bf50-4908-9514-94360b8f55ac tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:21.170539 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fa238828-bf50-4908-9514-94360b8f55ac tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:21.171412 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fa238828-bf50-4908-9514-94360b8f55ac tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:21.172064 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fa238828-bf50-4908-9514-94360b8f55ac tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:21.172707 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fa238828-bf50-4908-9514-94360b8f55ac tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:21.646708 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-cf6f8c3e-549e-4cd5-a600-d18587780bd5 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lazy-loading 'services' on Instance uuid 3b229371-5f66-466c-a96b-2f668a855aa0 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:57:21.667357 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cf6f8c3e-549e-4cd5-a600-d18587780bd5 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1970 microversion: 2.25 time: 1.652458 Sep 16 12:57:21.681873 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1452/2820] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:20 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1970 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:57:21.697377 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-387d3d20-54f3-4699-8650-23c91e021a43 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:21.698467 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-387d3d20-54f3-4699-8650-23c91e021a43 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:21.706677 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-387d3d20-54f3-4699-8650-23c91e021a43 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:21.707569 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-387d3d20-54f3-4699-8650-23c91e021a43 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:21.708326 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-387d3d20-54f3-4699-8650-23c91e021a43 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:21.709332 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-387d3d20-54f3-4699-8650-23c91e021a43 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:21.710231 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-387d3d20-54f3-4699-8650-23c91e021a43 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:21.711001 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-387d3d20-54f3-4699-8650-23c91e021a43 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:21.785898 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-fa238828-bf50-4908-9514-94360b8f55ac tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ec543501c49daaa37af078622626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd30c33cb19d47278478aa2340859920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:21.800287 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-fa238828-bf50-4908-9514-94360b8f55ac tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "GET /compute/v2.1/servers/c31cfc02-e506-4e4f-b06d-a0d38e56c5b6" status: 200 len: 1320 microversion: 2.1 time: 0.660748 Sep 16 12:57:21.804910 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1369/2821] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:21 2022] GET /compute/v2.1/servers/c31cfc02-e506-4e4f-b06d-a0d38e56c5b6 => generated 1320 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:22.086952 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e806cb58-5d24-4f29-80f0-5722519e74d1 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:22.088015 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e806cb58-5d24-4f29-80f0-5722519e74d1 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:22.111404 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e806cb58-5d24-4f29-80f0-5722519e74d1 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:22.113341 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e806cb58-5d24-4f29-80f0-5722519e74d1 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:22.116813 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e806cb58-5d24-4f29-80f0-5722519e74d1 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:22.117846 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e806cb58-5d24-4f29-80f0-5722519e74d1 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:22.118513 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e806cb58-5d24-4f29-80f0-5722519e74d1 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:22.121318 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e806cb58-5d24-4f29-80f0-5722519e74d1 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:22.359070 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e806cb58-5d24-4f29-80f0-5722519e74d1 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:22.368472 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-387d3d20-54f3-4699-8650-23c91e021a43 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lazy-loading 'services' on Instance uuid 3b229371-5f66-466c-a96b-2f668a855aa0 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:57:22.372940 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e806cb58-5d24-4f29-80f0-5722519e74d1 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:22.374754 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e806cb58-5d24-4f29-80f0-5722519e74d1 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea21d3fa8057445d9fc8800c0e9143cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd3ecbb8b84f8eb7b81a9b63721cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:22.390889 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e806cb58-5d24-4f29-80f0-5722519e74d1 tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 200 len: 1443 microversion: 2.75 time: 0.310646 Sep 16 12:57:22.392088 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1370/2822] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:22 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 1443 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:57:22.413559 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-387d3d20-54f3-4699-8650-23c91e021a43 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1970 microversion: 2.25 time: 0.720121 Sep 16 12:57:22.421878 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1453/2823] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:21 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1970 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:57:22.449070 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4fbc66a8-6c17-42d5-bb0d-120aa243930f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:22.455969 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4fbc66a8-6c17-42d5-bb0d-120aa243930f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:22.456885 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4fbc66a8-6c17-42d5-bb0d-120aa243930f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:22.458613 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4fbc66a8-6c17-42d5-bb0d-120aa243930f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:22.460227 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4fbc66a8-6c17-42d5-bb0d-120aa243930f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:22.465137 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4fbc66a8-6c17-42d5-bb0d-120aa243930f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:22.467998 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4fbc66a8-6c17-42d5-bb0d-120aa243930f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:22.527178 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4fbc66a8-6c17-42d5-bb0d-120aa243930f tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.083292 Sep 16 12:57:22.528490 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1371/2824] 10.222.0.67 () {60 vars in 1217 bytes} [Fri Sep 16 12:57:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 12:57:22.543344 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-41201ce5-d836-4e54-a867-81ddcc38135d tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858094-4", "block_migration": "auto"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:57:22.546647 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-41201ce5-d836-4e54-a867-81ddcc38135d tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:22.562052 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41201ce5-d836-4e54-a867-81ddcc38135d tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:22.567275 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41201ce5-d836-4e54-a867-81ddcc38135d tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:22.567752 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41201ce5-d836-4e54-a867-81ddcc38135d tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:22.568521 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41201ce5-d836-4e54-a867-81ddcc38135d tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:22.569542 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41201ce5-d836-4e54-a867-81ddcc38135d tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:22.570454 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41201ce5-d836-4e54-a867-81ddcc38135d tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:22.634075 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-41201ce5-d836-4e54-a867-81ddcc38135d tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lazy-loading 'flavor' on Instance uuid 3b229371-5f66-466c-a96b-2f668a855aa0 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:57:22.653158 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-41201ce5-d836-4e54-a867-81ddcc38135d tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Going to try to live migrate instance to n-h2-858094-4 {{(pid=128779) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 16 12:57:22.830048 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1e9c6031-99ba-4ff3-a91d-02cd20029319 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:22.831158 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-1e9c6031-99ba-4ff3-a91d-02cd20029319 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: c31cfc02-e506-4e4f-b06d-a0d38e56c5b6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:22.839463 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1e9c6031-99ba-4ff3-a91d-02cd20029319 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:22.840309 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1e9c6031-99ba-4ff3-a91d-02cd20029319 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:22.841717 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1e9c6031-99ba-4ff3-a91d-02cd20029319 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:22.843674 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1e9c6031-99ba-4ff3-a91d-02cd20029319 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:22.844993 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1e9c6031-99ba-4ff3-a91d-02cd20029319 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:22.846210 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1e9c6031-99ba-4ff3-a91d-02cd20029319 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:23.646696 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1e9c6031-99ba-4ff3-a91d-02cd20029319 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ec543501c49daaa37af078622626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd30c33cb19d47278478aa2340859920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:23.658166 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1e9c6031-99ba-4ff3-a91d-02cd20029319 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "GET /compute/v2.1/servers/c31cfc02-e506-4e4f-b06d-a0d38e56c5b6" status: 200 len: 1320 microversion: 2.1 time: 0.835372 Sep 16 12:57:23.666499 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1372/2825] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:22 2022] GET /compute/v2.1/servers/c31cfc02-e506-4e4f-b06d-a0d38e56c5b6 => generated 1320 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:23.677020 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5047aa15-127a-437b-b7e3-dd3710260fff tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2091950973", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3f814bae-963f-4f23-965e-dabc87858a1e"}], "security_groups": [{"name": "tempest-securitygroup--2143500835"}], "key_name": "tempest-keypair-1378354979", "user_data": "}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:57:23.917231 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-5047aa15-127a-437b-b7e3-dd3710260fff tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] validate_networks() for [('3f814bae-963f-4f23-965e-dabc87858a1e', None, None, None, None, None)] {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:57:26.330485 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-41201ce5-d836-4e54-a867-81ddcc38135d tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0/action" status: 202 len: 0 microversion: 2.25 time: 3.792087 Sep 16 12:57:26.332004 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1454/2826] 10.222.0.67 () {62 vars in 1319 bytes} [Fri Sep 16 12:57:22 2022] POST /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0/action => generated 0 bytes in 3794 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:57:26.344413 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-87aee8f6-c329-4e02-afe9-d49b8e5f21ba tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:26.346592 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-87aee8f6-c329-4e02-afe9-d49b8e5f21ba tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] [instance: 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:26.377102 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87aee8f6-c329-4e02-afe9-d49b8e5f21ba tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:26.378111 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87aee8f6-c329-4e02-afe9-d49b8e5f21ba tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:26.379453 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87aee8f6-c329-4e02-afe9-d49b8e5f21ba tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:26.382409 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87aee8f6-c329-4e02-afe9-d49b8e5f21ba tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:26.383422 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87aee8f6-c329-4e02-afe9-d49b8e5f21ba tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:26.384685 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87aee8f6-c329-4e02-afe9-d49b8e5f21ba tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:26.441315 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=12 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:57:26.442309 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-87aee8f6-c329-4e02-afe9-d49b8e5f21ba tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] HTTP exception thrown: Instance 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b could not be found. Sep 16 12:57:26.443130 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-5047aa15-127a-437b-b7e3-dd3710260fff tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:57:26.444982 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-5047aa15-127a-437b-b7e3-dd3710260fff tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-87aee8f6-c329-4e02-afe9-d49b8e5f21ba tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Request method failure captured: Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b HTTP/1.1 Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHJlhUOhpmopbeSwfwNBuv-y_3-ATsgCwBiM4H4nR4G8grlWeL31lwc-gQppzl-i65rG7BfxnBioPaitIQ4r8e6QtPa8tRKVyEsybxBWDft68ZLeg3ew6VyW8qWomVAwXdVX5HjMnxwXhwRN2JX0svSMjfjegwEiWBJyJHdShOCwNQs Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: X-Openstack-Nova-Api-Version: 2.75 Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 20cd3ecbb8b84f8eb7b81a9b63721cda Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersAdmin275Test-595283692 Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/20cd3ecbb8b84f8eb7b81a9b63721cda"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/20cd3ecbb8b84f8eb7b81a9b63721cda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_20cd3ecbb8b84f8eb7b81a9b63721cda", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/20cd3ecbb8b84f8eb7b81a9b63721cda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ServersAdmin275Test-595283692 Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 20cd3ecbb8b84f8eb7b81a9b63721cda Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersAdmin275Test-595283692 Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ServersAdmin275Test-595283692-project Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: ea21d3fa8057445d9fc8800c0e9143cb Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ServersAdmin275Test-595283692-project Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b could not be found. Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '82cb6908-86e4-45e3-9cb3-9d069bc7dc2b'} Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b could not be found. Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b could not be found. Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:57:26.445432 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:26.450801 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:57:26.450801 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:57:26.450801 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:57:26.450801 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:57:26.450801 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:57:26.450801 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b could not be found. Sep 16 12:57:26.450801 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:26.450801 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-87aee8f6-c329-4e02-afe9-d49b8e5f21ba tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] Returning 404 to user: Instance 82cb6908-86e4-45e3-9cb3-9d069bc7dc2b could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:57:26.453671 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-5047aa15-127a-437b-b7e3-dd3710260fff tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:57:26.454856 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-5047aa15-127a-437b-b7e3-dd3710260fff tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:57:26.455121 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-87aee8f6-c329-4e02-afe9-d49b8e5f21ba tempest-ServersAdmin275Test-595283692 tempest-ServersAdmin275Test-595283692-project] 10.222.0.67 "GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b" status: 404 len: 111 microversion: 2.75 time: 0.109396 Sep 16 12:57:26.455719 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-5047aa15-127a-437b-b7e3-dd3710260fff tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:57:26.459004 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1455/2827] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:26 2022] GET /compute/v2.1/servers/82cb6908-86e4-45e3-9cb3-9d069bc7dc2b => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 12:57:26.465877 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c3d188ab-66e0-4dba-a811-f3799057ccf8 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:26.466509 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c3d188ab-66e0-4dba-a811-f3799057ccf8 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: c31cfc02-e506-4e4f-b06d-a0d38e56c5b6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:26.488846 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3d188ab-66e0-4dba-a811-f3799057ccf8 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:26.489626 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3d188ab-66e0-4dba-a811-f3799057ccf8 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:26.490215 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3d188ab-66e0-4dba-a811-f3799057ccf8 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:26.491132 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3d188ab-66e0-4dba-a811-f3799057ccf8 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:26.494918 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3d188ab-66e0-4dba-a811-f3799057ccf8 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:26.495582 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3d188ab-66e0-4dba-a811-f3799057ccf8 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:26.503130 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5047aa15-127a-437b-b7e3-dd3710260fff tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:26.505427 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5047aa15-127a-437b-b7e3-dd3710260fff tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:26.507466 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5047aa15-127a-437b-b7e3-dd3710260fff tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:26.509556 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5047aa15-127a-437b-b7e3-dd3710260fff tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:26.511990 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5047aa15-127a-437b-b7e3-dd3710260fff tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:26.513843 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5047aa15-127a-437b-b7e3-dd3710260fff tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:26.575730 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-5047aa15-127a-437b-b7e3-dd3710260fff tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Getting quotas for project 7a67136b9d8041fd8e62a81be2d6b48d. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:57:26.585693 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-5047aa15-127a-437b-b7e3-dd3710260fff tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Getting quotas for user 65566509bf544a398cbb9c29ace613c5 and project 7a67136b9d8041fd8e62a81be2d6b48d. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:57:26.621845 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5047aa15-127a-437b-b7e3-dd3710260fff tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:57:26.627278 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5047aa15-127a-437b-b7e3-dd3710260fff tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 272fddb0-eba2-4559-b76d-460bd65246ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:57:26.731926 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5047aa15-127a-437b-b7e3-dd3710260fff tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.063804 Sep 16 12:57:26.740581 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1373/2828] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:57:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 3073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:57:26.745663 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-dd9ce5dc-3b1a-4257-90cf-28e1c0927dba tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:26.746285 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-dd9ce5dc-3b1a-4257-90cf-28e1c0927dba tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:26.761776 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dd9ce5dc-3b1a-4257-90cf-28e1c0927dba tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:26.762466 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dd9ce5dc-3b1a-4257-90cf-28e1c0927dba tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:26.763173 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dd9ce5dc-3b1a-4257-90cf-28e1c0927dba tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:26.764072 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dd9ce5dc-3b1a-4257-90cf-28e1c0927dba tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:26.764865 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dd9ce5dc-3b1a-4257-90cf-28e1c0927dba tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:26.765432 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dd9ce5dc-3b1a-4257-90cf-28e1c0927dba tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:27.511567 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c3d188ab-66e0-4dba-a811-f3799057ccf8 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ec543501c49daaa37af078622626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd30c33cb19d47278478aa2340859920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:27.528926 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c3d188ab-66e0-4dba-a811-f3799057ccf8 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "GET /compute/v2.1/servers/c31cfc02-e506-4e4f-b06d-a0d38e56c5b6" status: 200 len: 1320 microversion: 2.1 time: 1.067737 Sep 16 12:57:27.531858 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1456/2829] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:26 2022] GET /compute/v2.1/servers/c31cfc02-e506-4e4f-b06d-a0d38e56c5b6 => generated 1320 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:27.548915 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1e81c207-fd0b-4a9c-b2c8-eae14b92b616 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:27.549778 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1e81c207-fd0b-4a9c-b2c8-eae14b92b616 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 272fddb0-eba2-4559-b76d-460bd65246ec] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:27.574848 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-dd9ce5dc-3b1a-4257-90cf-28e1c0927dba tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:27.586090 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-dd9ce5dc-3b1a-4257-90cf-28e1c0927dba tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:27.587579 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-dd9ce5dc-3b1a-4257-90cf-28e1c0927dba tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:27.602654 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-dd9ce5dc-3b1a-4257-90cf-28e1c0927dba tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1487 microversion: 2.25 time: 0.857474 Sep 16 12:57:27.619728 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1374/2830] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:26 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1487 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:57:27.751729 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1e81c207-fd0b-4a9c-b2c8-eae14b92b616 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:27.768428 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1e81c207-fd0b-4a9c-b2c8-eae14b92b616 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec" status: 200 len: 1238 microversion: 2.1 time: 0.231075 Sep 16 12:57:27.769143 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1457/2831] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:27 2022] GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec => generated 1238 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:28.419078 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-bbd64b86-f91c-4fb6-bd87-b7070f98b4a1 req-df92b60f-0b65-4b1c-b334-2af8f5e3434e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c31cfc02-e506-4e4f-b06d-a0d38e56c5b6", "name": "network-vif-plugged", "status": "completed", "tag": "6a98d6d9-ecee-467f-84c8-ff25d39449e6"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:57:28.447132 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-bbd64b86-f91c-4fb6-bd87-b7070f98b4a1 req-df92b60f-0b65-4b1c-b334-2af8f5e3434e service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:28.447629 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-bbd64b86-f91c-4fb6-bd87-b7070f98b4a1 req-df92b60f-0b65-4b1c-b334-2af8f5e3434e service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:28.450611 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-bbd64b86-f91c-4fb6-bd87-b7070f98b4a1 req-df92b60f-0b65-4b1c-b334-2af8f5e3434e service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:28.508501 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-bbd64b86-f91c-4fb6-bd87-b7070f98b4a1 req-df92b60f-0b65-4b1c-b334-2af8f5e3434e service nova] Creating event network-vif-plugged:6a98d6d9-ecee-467f-84c8-ff25d39449e6 for instance c31cfc02-e506-4e4f-b06d-a0d38e56c5b6 on n-h1-858094-4 Sep 16 12:57:28.544346 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-bbd64b86-f91c-4fb6-bd87-b7070f98b4a1 req-df92b60f-0b65-4b1c-b334-2af8f5e3434e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125350 Sep 16 12:57:28.550308 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1375/2832] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:57:28.573736 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6503a207-22e8-4c59-a943-b9e832900339 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:28.574482 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6503a207-22e8-4c59-a943-b9e832900339 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: c31cfc02-e506-4e4f-b06d-a0d38e56c5b6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:28.617941 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6503a207-22e8-4c59-a943-b9e832900339 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:28.618656 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6503a207-22e8-4c59-a943-b9e832900339 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:28.626793 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6503a207-22e8-4c59-a943-b9e832900339 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:28.629520 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6503a207-22e8-4c59-a943-b9e832900339 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:28.637777 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6503a207-22e8-4c59-a943-b9e832900339 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:28.643642 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6503a207-22e8-4c59-a943-b9e832900339 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:29.261698 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-40ccd980-2d8a-48a2-9fc7-ee854a71aa96 tempest-VolumesAdminNegativeTest-1225824925 tempest-VolumesAdminNegativeTest-1225824925-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "86415e1b-69d5-4ab1-a81c-83fedccc50ef"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:57:29.264957 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-40ccd980-2d8a-48a2-9fc7-ee854a71aa96 tempest-VolumesAdminNegativeTest-1225824925 tempest-VolumesAdminNegativeTest-1225824925-project-admin] [instance: 8d3df84c-ed0d-41a9-8632-63591274c2eb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:29.291767 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40ccd980-2d8a-48a2-9fc7-ee854a71aa96 tempest-VolumesAdminNegativeTest-1225824925 tempest-VolumesAdminNegativeTest-1225824925-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:29.293210 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40ccd980-2d8a-48a2-9fc7-ee854a71aa96 tempest-VolumesAdminNegativeTest-1225824925 tempest-VolumesAdminNegativeTest-1225824925-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:29.294855 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40ccd980-2d8a-48a2-9fc7-ee854a71aa96 tempest-VolumesAdminNegativeTest-1225824925 tempest-VolumesAdminNegativeTest-1225824925-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:29.297420 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40ccd980-2d8a-48a2-9fc7-ee854a71aa96 tempest-VolumesAdminNegativeTest-1225824925 tempest-VolumesAdminNegativeTest-1225824925-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:29.299730 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40ccd980-2d8a-48a2-9fc7-ee854a71aa96 tempest-VolumesAdminNegativeTest-1225824925 tempest-VolumesAdminNegativeTest-1225824925-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:29.300616 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40ccd980-2d8a-48a2-9fc7-ee854a71aa96 tempest-VolumesAdminNegativeTest-1225824925 tempest-VolumesAdminNegativeTest-1225824925-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:29.421922 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6503a207-22e8-4c59-a943-b9e832900339 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ec543501c49daaa37af078622626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd30c33cb19d47278478aa2340859920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:29.456394 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6503a207-22e8-4c59-a943-b9e832900339 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "GET /compute/v2.1/servers/c31cfc02-e506-4e4f-b06d-a0d38e56c5b6" status: 200 len: 1320 microversion: 2.1 time: 0.901842 Sep 16 12:57:29.466943 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1376/2833] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:28 2022] GET /compute/v2.1/servers/c31cfc02-e506-4e4f-b06d-a0d38e56c5b6 => generated 1320 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:29.480480 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-adee58a7-f0de-4e71-82e2-46318113242c tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:29.483434 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-adee58a7-f0de-4e71-82e2-46318113242c tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:29.502684 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-adee58a7-f0de-4e71-82e2-46318113242c tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:29.503520 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-adee58a7-f0de-4e71-82e2-46318113242c tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:29.504147 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-adee58a7-f0de-4e71-82e2-46318113242c tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:29.505126 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-adee58a7-f0de-4e71-82e2-46318113242c tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:29.505952 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-adee58a7-f0de-4e71-82e2-46318113242c tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:29.507128 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-adee58a7-f0de-4e71-82e2-46318113242c tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:29.662086 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-40ccd980-2d8a-48a2-9fc7-ee854a71aa96 tempest-VolumesAdminNegativeTest-1225824925 tempest-VolumesAdminNegativeTest-1225824925-project-admin] HTTP exception thrown: Volume 86415e1b-69d5-4ab1-a81c-83fedccc50ef could not be found. Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-40ccd980-2d8a-48a2-9fc7-ee854a71aa96 tempest-VolumesAdminNegativeTest-1225824925 tempest-VolumesAdminNegativeTest-1225824925-project-admin] Request method failure captured: Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: request: PUT /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb/os-volume_attachments/d871ed67-2ce1-4084-97a4-4788c4c51c09 HTTP/1.1 Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 74 Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHIr6VKlsdREpAKSbIHWkXJZQUxzBXJotlqET7Ih2-URR6wcmyhMQ4im-Qp6Fs4eVoSUWpF-HepwYVt-dg9c3_2koraEY3ugWX3Z_mQoIcPRYenkRKjK09fOElj_-9asYRQxAYVCW5_-WUdbzfKwkb1o9z9plioiNd4-9O2ZPDmcgQQ Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 9390133145c14261b4cb69996a8cbada Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-VolumesAdminNegativeTest-1225824925 Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,admin,reader Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,admin,reader Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9390133145c14261b4cb69996a8cbada"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9390133145c14261b4cb69996a8cbada"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9390133145c14261b4cb69996a8cbada", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9390133145c14261b4cb69996a8cbada"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-VolumesAdminNegativeTest-1225824925 Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 9390133145c14261b4cb69996a8cbada Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1225824925 Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-VolumesAdminNegativeTest-1225824925-project-admin Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: d4043ea015fc4c7fbb95335939d8a567 Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-VolumesAdminNegativeTest-1225824925-project-admin Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: {"volumeAttachment": {"volumeId": "86415e1b-69d5-4ab1-a81c-83fedccc50ef"}} Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: exception: Volume 86415e1b-69d5-4ab1-a81c-83fedccc50ef could not be found. Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'server_id': '8d3df84c-ed0d-41a9-8632-63591274c2eb', 'id': 'd871ed67-2ce1-4084-97a4-4788c4c51c09', 'body': {'volumeAttachment': {'volumeId': '86415e1b-69d5-4ab1-a81c-83fedccc50ef'}}} Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 86415e1b-69d5-4ab1-a81c-83fedccc50ef could not be found. (HTTP 404) (Request-ID: req-0ececacf-4daa-4c3c-b771-8999694a2d54) Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 12:57:29.715741 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 86415e1b-69d5-4ab1-a81c-83fedccc50ef could not be found. Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 86415e1b-69d5-4ab1-a81c-83fedccc50ef could not be found. Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 86415e1b-69d5-4ab1-a81c-83fedccc50ef could not be found. Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:57:29.719993 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-40ccd980-2d8a-48a2-9fc7-ee854a71aa96 tempest-VolumesAdminNegativeTest-1225824925 tempest-VolumesAdminNegativeTest-1225824925-project-admin] Returning 400 to user: Volume 86415e1b-69d5-4ab1-a81c-83fedccc50ef could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:57:29.723337 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-40ccd980-2d8a-48a2-9fc7-ee854a71aa96 tempest-VolumesAdminNegativeTest-1225824925 tempest-VolumesAdminNegativeTest-1225824925-project-admin] 10.222.0.67 "PUT /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb/os-volume_attachments/d871ed67-2ce1-4084-97a4-4788c4c51c09" status: 400 len: 107 microversion: 2.1 time: 1.225047 Sep 16 12:57:29.730385 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1458/2834] 10.222.0.67 () {60 vars in 1433 bytes} [Fri Sep 16 12:57:28 2022] PUT /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb/os-volume_attachments/d871ed67-2ce1-4084-97a4-4788c4c51c09 => generated 107 bytes in 1237 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 12:57:29.762774 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f570a1d4-ec8f-4146-9a73-cf787a287c0f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:29.787965 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f570a1d4-ec8f-4146-9a73-cf787a287c0f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 272fddb0-eba2-4559-b76d-460bd65246ec] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:29.859911 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f570a1d4-ec8f-4146-9a73-cf787a287c0f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:29.880658 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f570a1d4-ec8f-4146-9a73-cf787a287c0f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:29.886813 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f570a1d4-ec8f-4146-9a73-cf787a287c0f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:29.889181 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f570a1d4-ec8f-4146-9a73-cf787a287c0f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:29.891933 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f570a1d4-ec8f-4146-9a73-cf787a287c0f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:29.904555 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f570a1d4-ec8f-4146-9a73-cf787a287c0f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:30.079976 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f570a1d4-ec8f-4146-9a73-cf787a287c0f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:30.095957 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-adee58a7-f0de-4e71-82e2-46318113242c tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:30.114174 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f570a1d4-ec8f-4146-9a73-cf787a287c0f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec" status: 200 len: 1296 microversion: 2.1 time: 0.382536 Sep 16 12:57:30.121924 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1459/2835] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:29 2022] GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec => generated 1296 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:30.124551 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-adee58a7-f0de-4e71-82e2-46318113242c tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:30.135298 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-adee58a7-f0de-4e71-82e2-46318113242c tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:30.141369 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-adee58a7-f0de-4e71-82e2-46318113242c tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1487 microversion: 2.25 time: 0.667873 Sep 16 12:57:30.144637 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-115b5932-6b50-416d-8461-0fcd0b7084c4 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:30.145461 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-115b5932-6b50-416d-8461-0fcd0b7084c4 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 8d3df84c-ed0d-41a9-8632-63591274c2eb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:30.158413 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1377/2836] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:29 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1487 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:57:30.181982 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-115b5932-6b50-416d-8461-0fcd0b7084c4 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:30.182930 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-115b5932-6b50-416d-8461-0fcd0b7084c4 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:30.183922 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-115b5932-6b50-416d-8461-0fcd0b7084c4 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:30.184991 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-115b5932-6b50-416d-8461-0fcd0b7084c4 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:30.187965 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-115b5932-6b50-416d-8461-0fcd0b7084c4 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:30.189801 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-115b5932-6b50-416d-8461-0fcd0b7084c4 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:30.211668 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:57:30.441433 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-115b5932-6b50-416d-8461-0fcd0b7084c4 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lazy-loading 'services' on Instance uuid 8d3df84c-ed0d-41a9-8632-63591274c2eb {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:57:30.493095 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-68a55f18-a293-41aa-9a84-c14072a0d0bc tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:30.498124 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-68a55f18-a293-41aa-9a84-c14072a0d0bc tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: c31cfc02-e506-4e4f-b06d-a0d38e56c5b6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:30.511560 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-68a55f18-a293-41aa-9a84-c14072a0d0bc tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:30.512341 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-68a55f18-a293-41aa-9a84-c14072a0d0bc tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:30.513098 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-68a55f18-a293-41aa-9a84-c14072a0d0bc tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:30.515776 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-68a55f18-a293-41aa-9a84-c14072a0d0bc tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:30.516471 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-68a55f18-a293-41aa-9a84-c14072a0d0bc tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:30.517208 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-68a55f18-a293-41aa-9a84-c14072a0d0bc tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:30.620214 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-115b5932-6b50-416d-8461-0fcd0b7084c4 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "DELETE /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb/os-volume_attachments/d871ed67-2ce1-4084-97a4-4788c4c51c09" status: 202 len: 0 microversion: 2.1 time: 0.496165 Sep 16 12:57:30.621168 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1460/2837] 10.222.0.67 () {58 vars in 1416 bytes} [Fri Sep 16 12:57:30 2022] DELETE /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb/os-volume_attachments/d871ed67-2ce1-4084-97a4-4788c4c51c09 => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:57:30.635482 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d199546d-4269-4cea-be32-1675800accc0 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:30.654035 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d199546d-4269-4cea-be32-1675800accc0 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 8d3df84c-ed0d-41a9-8632-63591274c2eb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:30.669474 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d199546d-4269-4cea-be32-1675800accc0 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:30.670458 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d199546d-4269-4cea-be32-1675800accc0 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:30.671120 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d199546d-4269-4cea-be32-1675800accc0 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:30.673607 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d199546d-4269-4cea-be32-1675800accc0 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:30.674316 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d199546d-4269-4cea-be32-1675800accc0 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:30.680552 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d199546d-4269-4cea-be32-1675800accc0 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:30.748081 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d199546d-4269-4cea-be32-1675800accc0 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117013 Sep 16 12:57:30.753646 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1461/2838] 10.222.0.67 () {58 vars in 1302 bytes} [Fri Sep 16 12:57:30 2022] GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:57:30.775381 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-7303e540-a959-4f51-bb88-a4aaebab26d4 req-128741f4-0817-4385-b617-d80ad7fac798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc7e9284-2d49-41b2-ad73-0073b2e8bcc6", "name": "network-vif-plugged", "status": "completed", "tag": "756b6c88-8a28-4069-a46d-126915a24fb8"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:57:30.798063 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7303e540-a959-4f51-bb88-a4aaebab26d4 req-128741f4-0817-4385-b617-d80ad7fac798 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:30.802737 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7303e540-a959-4f51-bb88-a4aaebab26d4 req-128741f4-0817-4385-b617-d80ad7fac798 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:30.803801 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7303e540-a959-4f51-bb88-a4aaebab26d4 req-128741f4-0817-4385-b617-d80ad7fac798 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:30.845498 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-7303e540-a959-4f51-bb88-a4aaebab26d4 req-128741f4-0817-4385-b617-d80ad7fac798 service nova] Creating event network-vif-plugged:756b6c88-8a28-4069-a46d-126915a24fb8 for instance cc7e9284-2d49-41b2-ad73-0073b2e8bcc6 on n-h2-858094-4 Sep 16 12:57:30.874838 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-7303e540-a959-4f51-bb88-a4aaebab26d4 req-128741f4-0817-4385-b617-d80ad7fac798 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106122 Sep 16 12:57:30.880185 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1462/2839] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:57:31.152537 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-47554186-62a7-4ac0-a1d1-c7a117be0cc1 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:31.154826 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-47554186-62a7-4ac0-a1d1-c7a117be0cc1 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 272fddb0-eba2-4559-b76d-460bd65246ec] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:31.172062 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47554186-62a7-4ac0-a1d1-c7a117be0cc1 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:31.172748 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47554186-62a7-4ac0-a1d1-c7a117be0cc1 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:31.173215 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47554186-62a7-4ac0-a1d1-c7a117be0cc1 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:31.173971 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47554186-62a7-4ac0-a1d1-c7a117be0cc1 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:31.174613 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47554186-62a7-4ac0-a1d1-c7a117be0cc1 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:31.175060 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47554186-62a7-4ac0-a1d1-c7a117be0cc1 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:31.199524 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-68a55f18-a293-41aa-9a84-c14072a0d0bc tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ec543501c49daaa37af078622626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd30c33cb19d47278478aa2340859920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:31.213354 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-68a55f18-a293-41aa-9a84-c14072a0d0bc tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "GET /compute/v2.1/servers/c31cfc02-e506-4e4f-b06d-a0d38e56c5b6" status: 200 len: 1320 microversion: 2.1 time: 0.724684 Sep 16 12:57:31.215971 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1378/2840] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:30 2022] GET /compute/v2.1/servers/c31cfc02-e506-4e4f-b06d-a0d38e56c5b6 => generated 1320 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:31.234489 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-cf0a3ab8-1344-424a-af0e-8e728963c346 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:31.236187 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-cf0a3ab8-1344-424a-af0e-8e728963c346 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:31.254617 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cf0a3ab8-1344-424a-af0e-8e728963c346 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:31.255116 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cf0a3ab8-1344-424a-af0e-8e728963c346 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:31.257857 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cf0a3ab8-1344-424a-af0e-8e728963c346 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:31.258635 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cf0a3ab8-1344-424a-af0e-8e728963c346 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:31.260541 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cf0a3ab8-1344-424a-af0e-8e728963c346 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:31.261004 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cf0a3ab8-1344-424a-af0e-8e728963c346 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:31.272690 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:57:31.387532 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-47554186-62a7-4ac0-a1d1-c7a117be0cc1 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:31.407306 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-47554186-62a7-4ac0-a1d1-c7a117be0cc1 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec" status: 200 len: 1296 microversion: 2.1 time: 0.263867 Sep 16 12:57:31.425889 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1463/2841] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:31 2022] GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec => generated 1296 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:31.766654 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ccf3d471-fd22-42bd-ac39-7c2acb4a068a tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:31.770050 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ccf3d471-fd22-42bd-ac39-7c2acb4a068a tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 8d3df84c-ed0d-41a9-8632-63591274c2eb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:31.779086 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-cf0a3ab8-1344-424a-af0e-8e728963c346 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:31.793086 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-cf0a3ab8-1344-424a-af0e-8e728963c346 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:31.797012 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ccf3d471-fd22-42bd-ac39-7c2acb4a068a tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:31.799161 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-cf0a3ab8-1344-424a-af0e-8e728963c346 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:31.805977 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ccf3d471-fd22-42bd-ac39-7c2acb4a068a tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:31.808024 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ccf3d471-fd22-42bd-ac39-7c2acb4a068a tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:31.809467 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ccf3d471-fd22-42bd-ac39-7c2acb4a068a tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:31.810150 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-cf0a3ab8-1344-424a-af0e-8e728963c346 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1487 microversion: 2.25 time: 0.590010 Sep 16 12:57:31.811023 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ccf3d471-fd22-42bd-ac39-7c2acb4a068a tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:31.812627 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ccf3d471-fd22-42bd-ac39-7c2acb4a068a tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:31.813098 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1379/2842] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:31 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1487 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:57:31.889181 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ccf3d471-fd22-42bd-ac39-7c2acb4a068a tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125988 Sep 16 12:57:31.898321 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1464/2843] 10.222.0.67 () {58 vars in 1302 bytes} [Fri Sep 16 12:57:31 2022] GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:57:32.247455 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5af6ccfb-eba4-4b3b-8536-b474f9bcbe27 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:32.253152 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5af6ccfb-eba4-4b3b-8536-b474f9bcbe27 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: c31cfc02-e506-4e4f-b06d-a0d38e56c5b6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:32.267272 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5af6ccfb-eba4-4b3b-8536-b474f9bcbe27 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:32.276296 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5af6ccfb-eba4-4b3b-8536-b474f9bcbe27 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:32.277206 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5af6ccfb-eba4-4b3b-8536-b474f9bcbe27 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:32.278808 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5af6ccfb-eba4-4b3b-8536-b474f9bcbe27 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:32.279870 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5af6ccfb-eba4-4b3b-8536-b474f9bcbe27 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:32.280953 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5af6ccfb-eba4-4b3b-8536-b474f9bcbe27 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:32.432818 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-38add7a0-e1a4-4023-9800-1a6bc408fe19 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:32.433196 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-38add7a0-e1a4-4023-9800-1a6bc408fe19 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 272fddb0-eba2-4559-b76d-460bd65246ec] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:32.455015 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38add7a0-e1a4-4023-9800-1a6bc408fe19 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:32.455526 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38add7a0-e1a4-4023-9800-1a6bc408fe19 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:32.467424 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38add7a0-e1a4-4023-9800-1a6bc408fe19 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:32.470077 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38add7a0-e1a4-4023-9800-1a6bc408fe19 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:32.471244 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38add7a0-e1a4-4023-9800-1a6bc408fe19 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:32.479595 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38add7a0-e1a4-4023-9800-1a6bc408fe19 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:32.808645 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-38add7a0-e1a4-4023-9800-1a6bc408fe19 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:32.824500 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-38add7a0-e1a4-4023-9800-1a6bc408fe19 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec" status: 200 len: 1296 microversion: 2.1 time: 0.397097 Sep 16 12:57:32.838947 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1465/2844] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:32 2022] GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec => generated 1296 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:32.862370 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6600d139-76a2-462a-b705-a3b4da7aff12 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:32.878711 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6600d139-76a2-462a-b705-a3b4da7aff12 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:32.906456 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6600d139-76a2-462a-b705-a3b4da7aff12 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:32.911299 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6600d139-76a2-462a-b705-a3b4da7aff12 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:32.911884 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6600d139-76a2-462a-b705-a3b4da7aff12 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:32.912698 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6600d139-76a2-462a-b705-a3b4da7aff12 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:32.913315 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6600d139-76a2-462a-b705-a3b4da7aff12 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:32.913764 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6600d139-76a2-462a-b705-a3b4da7aff12 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:33.851948 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5af6ccfb-eba4-4b3b-8536-b474f9bcbe27 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ec543501c49daaa37af078622626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd30c33cb19d47278478aa2340859920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:33.864784 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5af6ccfb-eba4-4b3b-8536-b474f9bcbe27 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "GET /compute/v2.1/servers/c31cfc02-e506-4e4f-b06d-a0d38e56c5b6" status: 200 len: 1509 microversion: 2.1 time: 1.618362 Sep 16 12:57:33.876535 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1380/2845] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:32 2022] GET /compute/v2.1/servers/c31cfc02-e506-4e4f-b06d-a0d38e56c5b6 => generated 1509 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:33.894367 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b79fe0a1-6a03-452c-b0d6-cc6abb6a1dc2 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:33.914287 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b79fe0a1-6a03-452c-b0d6-cc6abb6a1dc2 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 8d3df84c-ed0d-41a9-8632-63591274c2eb] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:33.925142 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b79fe0a1-6a03-452c-b0d6-cc6abb6a1dc2 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:33.929622 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b79fe0a1-6a03-452c-b0d6-cc6abb6a1dc2 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:33.930427 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b79fe0a1-6a03-452c-b0d6-cc6abb6a1dc2 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:33.931930 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b79fe0a1-6a03-452c-b0d6-cc6abb6a1dc2 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:33.933268 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b79fe0a1-6a03-452c-b0d6-cc6abb6a1dc2 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:33.935939 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b79fe0a1-6a03-452c-b0d6-cc6abb6a1dc2 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:33.939590 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6600d139-76a2-462a-b705-a3b4da7aff12 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:33.951235 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6600d139-76a2-462a-b705-a3b4da7aff12 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:33.952726 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6600d139-76a2-462a-b705-a3b4da7aff12 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:33.953917 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6600d139-76a2-462a-b705-a3b4da7aff12 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1487 microversion: 2.25 time: 1.103793 Sep 16 12:57:33.956934 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1466/2846] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:32 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1487 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:57:33.968711 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4ca6a250-1226-4254-a5fa-c9e890a77c6a tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:33.971806 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4ca6a250-1226-4254-a5fa-c9e890a77c6a tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 272fddb0-eba2-4559-b76d-460bd65246ec] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:33.986898 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ca6a250-1226-4254-a5fa-c9e890a77c6a tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:33.987586 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ca6a250-1226-4254-a5fa-c9e890a77c6a tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:33.997683 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ca6a250-1226-4254-a5fa-c9e890a77c6a tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:34.000882 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ca6a250-1226-4254-a5fa-c9e890a77c6a tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:34.001720 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ca6a250-1226-4254-a5fa-c9e890a77c6a tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:34.002316 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ca6a250-1226-4254-a5fa-c9e890a77c6a tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:34.013027 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b79fe0a1-6a03-452c-b0d6-cc6abb6a1dc2 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135286 Sep 16 12:57:34.022043 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1381/2847] 10.222.0.67 () {58 vars in 1302 bytes} [Fri Sep 16 12:57:33 2022] GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:57:34.030242 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0c082451-a459-4659-b1a5-78349477d556 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:34.030871 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0c082451-a459-4659-b1a5-78349477d556 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: cc7e9284-2d49-41b2-ad73-0073b2e8bcc6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:34.076538 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0c082451-a459-4659-b1a5-78349477d556 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:34.078026 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0c082451-a459-4659-b1a5-78349477d556 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:34.081786 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0c082451-a459-4659-b1a5-78349477d556 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:34.084020 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0c082451-a459-4659-b1a5-78349477d556 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:34.084857 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0c082451-a459-4659-b1a5-78349477d556 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:34.087048 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0c082451-a459-4659-b1a5-78349477d556 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:34.467344 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4ca6a250-1226-4254-a5fa-c9e890a77c6a tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:34.470294 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0c082451-a459-4659-b1a5-78349477d556 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ec543501c49daaa37af078622626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd30c33cb19d47278478aa2340859920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:34.480883 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4ca6a250-1226-4254-a5fa-c9e890a77c6a tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec" status: 200 len: 1364 microversion: 2.1 time: 0.518476 Sep 16 12:57:34.482357 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0c082451-a459-4659-b1a5-78349477d556 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "GET /compute/v2.1/servers/cc7e9284-2d49-41b2-ad73-0073b2e8bcc6" status: 200 len: 1509 microversion: 2.1 time: 0.457669 Sep 16 12:57:34.483527 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1382/2848] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:34 2022] GET /compute/v2.1/servers/cc7e9284-2d49-41b2-ad73-0073b2e8bcc6 => generated 1509 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:34.509110 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1467/2849] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:33 2022] GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec => generated 1364 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:34.517921 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2870bbc6-54d5-4da7-96ca-27ee5c7d8203 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:34.520431 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-2870bbc6-54d5-4da7-96ca-27ee5c7d8203 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: cc7e9284-2d49-41b2-ad73-0073b2e8bcc6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:34.545857 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2870bbc6-54d5-4da7-96ca-27ee5c7d8203 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:34.553370 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2870bbc6-54d5-4da7-96ca-27ee5c7d8203 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:34.554756 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2870bbc6-54d5-4da7-96ca-27ee5c7d8203 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:34.558966 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2870bbc6-54d5-4da7-96ca-27ee5c7d8203 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:34.560507 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2870bbc6-54d5-4da7-96ca-27ee5c7d8203 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:34.564185 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2870bbc6-54d5-4da7-96ca-27ee5c7d8203 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:34.647686 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-2870bbc6-54d5-4da7-96ca-27ee5c7d8203 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: cc7e9284-2d49-41b2-ad73-0073b2e8bcc6] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:57:34.848255 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2870bbc6-54d5-4da7-96ca-27ee5c7d8203 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "DELETE /compute/v2.1/servers/cc7e9284-2d49-41b2-ad73-0073b2e8bcc6" status: 204 len: 0 microversion: 2.1 time: 0.342616 Sep 16 12:57:34.866418 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1383/2850] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:57:34 2022] DELETE /compute/v2.1/servers/cc7e9284-2d49-41b2-ad73-0073b2e8bcc6 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:57:34.883941 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4cda66a2-0883-43da-b3a9-ceb69b408c0f tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:34.884596 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-4cda66a2-0883-43da-b3a9-ceb69b408c0f tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: c31cfc02-e506-4e4f-b06d-a0d38e56c5b6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:34.917400 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4cda66a2-0883-43da-b3a9-ceb69b408c0f tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:34.917975 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4cda66a2-0883-43da-b3a9-ceb69b408c0f tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:34.918431 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4cda66a2-0883-43da-b3a9-ceb69b408c0f tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:34.919175 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4cda66a2-0883-43da-b3a9-ceb69b408c0f tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:34.919637 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4cda66a2-0883-43da-b3a9-ceb69b408c0f tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:34.920061 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4cda66a2-0883-43da-b3a9-ceb69b408c0f tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:35.050611 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-4cda66a2-0883-43da-b3a9-ceb69b408c0f tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: c31cfc02-e506-4e4f-b06d-a0d38e56c5b6] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:57:35.249224 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:57:35.284577 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4cda66a2-0883-43da-b3a9-ceb69b408c0f tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c31cfc02-e506-4e4f-b06d-a0d38e56c5b6" status: 204 len: 0 microversion: 2.1 time: 0.412323 Sep 16 12:57:35.285592 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1384/2851] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:57:34 2022] DELETE /compute/v2.1/servers/c31cfc02-e506-4e4f-b06d-a0d38e56c5b6 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:57:35.297077 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ec69804d-c571-4f57-aed2-3d4e674341bf tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-14199180", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": [{"uuid": "4c6a423f-0493-4448-999c-84f17e899760"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:57:35.298054 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6fa6957c-78d6-4fbc-995e-1490dece2ab0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:35.298791 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6fa6957c-78d6-4fbc-995e-1490dece2ab0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:35.310080 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6fa6957c-78d6-4fbc-995e-1490dece2ab0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:35.310609 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6fa6957c-78d6-4fbc-995e-1490dece2ab0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:35.311022 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6fa6957c-78d6-4fbc-995e-1490dece2ab0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:35.312075 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6fa6957c-78d6-4fbc-995e-1490dece2ab0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:35.312822 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6fa6957c-78d6-4fbc-995e-1490dece2ab0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:35.313607 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6fa6957c-78d6-4fbc-995e-1490dece2ab0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:35.510927 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-ec69804d-c571-4f57-aed2-3d4e674341bf tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] validate_networks() for [('4c6a423f-0493-4448-999c-84f17e899760', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:57:35.828028 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6fa6957c-78d6-4fbc-995e-1490dece2ab0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:35.838511 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6fa6957c-78d6-4fbc-995e-1490dece2ab0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:35.850578 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6fa6957c-78d6-4fbc-995e-1490dece2ab0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:35.865874 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6fa6957c-78d6-4fbc-995e-1490dece2ab0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1487 microversion: 2.25 time: 0.572546 Sep 16 12:57:35.867235 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1385/2852] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:35 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1487 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:57:35.896100 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-056741cf-0895-4486-a7bf-bff944a676c8 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:35.908569 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-056741cf-0895-4486-a7bf-bff944a676c8 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 8d3df84c-ed0d-41a9-8632-63591274c2eb] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:35.949337 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-056741cf-0895-4486-a7bf-bff944a676c8 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:35.951023 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-056741cf-0895-4486-a7bf-bff944a676c8 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:35.951989 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-056741cf-0895-4486-a7bf-bff944a676c8 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:35.954717 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-056741cf-0895-4486-a7bf-bff944a676c8 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:35.956827 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-056741cf-0895-4486-a7bf-bff944a676c8 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:35.965275 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-056741cf-0895-4486-a7bf-bff944a676c8 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:36.021207 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-056741cf-0895-4486-a7bf-bff944a676c8 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145503 Sep 16 12:57:36.023361 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1386/2853] 10.222.0.67 () {58 vars in 1302 bytes} [Fri Sep 16 12:57:35 2022] GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:57:36.032076 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-85bc52b4-77ae-45cd-8065-cea664178af7 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:36.033889 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-85bc52b4-77ae-45cd-8065-cea664178af7 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 272fddb0-eba2-4559-b76d-460bd65246ec] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:36.046883 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-85bc52b4-77ae-45cd-8065-cea664178af7 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:36.050122 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-85bc52b4-77ae-45cd-8065-cea664178af7 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:36.051978 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-85bc52b4-77ae-45cd-8065-cea664178af7 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:36.053715 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-85bc52b4-77ae-45cd-8065-cea664178af7 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:36.057475 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-85bc52b4-77ae-45cd-8065-cea664178af7 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:36.058756 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-85bc52b4-77ae-45cd-8065-cea664178af7 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:36.547295 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=4 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:57:36.607771 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=6 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:57:36.764707 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-ec69804d-c571-4f57-aed2-3d4e674341bf tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:57:36.765285 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-ec69804d-c571-4f57-aed2-3d4e674341bf tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:57:36.765592 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-ec69804d-c571-4f57-aed2-3d4e674341bf tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:57:36.766006 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-ec69804d-c571-4f57-aed2-3d4e674341bf tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:57:36.766421 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-ec69804d-c571-4f57-aed2-3d4e674341bf tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:57:36.781422 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec69804d-c571-4f57-aed2-3d4e674341bf tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:36.781912 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec69804d-c571-4f57-aed2-3d4e674341bf tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:36.782348 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec69804d-c571-4f57-aed2-3d4e674341bf tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:36.783081 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec69804d-c571-4f57-aed2-3d4e674341bf tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:36.783534 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec69804d-c571-4f57-aed2-3d4e674341bf tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:36.783958 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec69804d-c571-4f57-aed2-3d4e674341bf tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:36.794766 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-85bc52b4-77ae-45cd-8065-cea664178af7 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:36.803081 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-85bc52b4-77ae-45cd-8065-cea664178af7 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec" status: 200 len: 1364 microversion: 2.1 time: 0.778356 Sep 16 12:57:36.806259 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1387/2854] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:36 2022] GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec => generated 1364 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:36.815447 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-975c2f6b-9e7a-44ec-99d8-c2bd0924cb32 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1799508978", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "2a13e2e0-76af-4011-86c3-ccf3c7f1953b"}]}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:57:36.855008 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-ec69804d-c571-4f57-aed2-3d4e674341bf tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Getting quotas for project cfe82d8dd4fb42cbb054a6f069424c57. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:57:36.876346 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-ec69804d-c571-4f57-aed2-3d4e674341bf tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Getting quotas for user 2e531a7026054c34b2a78a1c484cbe02 and project cfe82d8dd4fb42cbb054a6f069424c57. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:57:36.923550 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-975c2f6b-9e7a-44ec-99d8-c2bd0924cb32 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] validate_networks() for [('2a13e2e0-76af-4011-86c3-ccf3c7f1953b', None, None, None, None, None)] {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:57:36.932477 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ec69804d-c571-4f57-aed2-3d4e674341bf tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:57:36.942404 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ec69804d-c571-4f57-aed2-3d4e674341bf tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: cc79a200-5972-4bec-9322-503d99b7d85a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:57:37.094892 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ec69804d-c571-4f57-aed2-3d4e674341bf tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.425442 Sep 16 12:57:37.101099 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1468/2855] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:57:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2432 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:57:37.536864 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-82a80d09-b207-4334-bf5f-844a6592a2fc tempest-ServicesAdminTestJSON-333671576 tempest-ServicesAdminTestJSON-333671576-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:37.546048 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82a80d09-b207-4334-bf5f-844a6592a2fc tempest-ServicesAdminTestJSON-333671576 tempest-ServicesAdminTestJSON-333671576-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:37.546615 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82a80d09-b207-4334-bf5f-844a6592a2fc tempest-ServicesAdminTestJSON-333671576 tempest-ServicesAdminTestJSON-333671576-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:37.549716 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82a80d09-b207-4334-bf5f-844a6592a2fc tempest-ServicesAdminTestJSON-333671576 tempest-ServicesAdminTestJSON-333671576-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:37.551603 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82a80d09-b207-4334-bf5f-844a6592a2fc tempest-ServicesAdminTestJSON-333671576 tempest-ServicesAdminTestJSON-333671576-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:37.552530 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82a80d09-b207-4334-bf5f-844a6592a2fc tempest-ServicesAdminTestJSON-333671576 tempest-ServicesAdminTestJSON-333671576-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:37.556009 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82a80d09-b207-4334-bf5f-844a6592a2fc tempest-ServicesAdminTestJSON-333671576 tempest-ServicesAdminTestJSON-333671576-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:37.613730 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-82a80d09-b207-4334-bf5f-844a6592a2fc tempest-ServicesAdminTestJSON-333671576 tempest-ServicesAdminTestJSON-333671576-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.511250 Sep 16 12:57:37.615126 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1469/2856] 10.222.0.67 () {58 vars in 1137 bytes} [Fri Sep 16 12:57:37 2022] GET /compute/v2.1/os-services => generated 944 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:57:37.622049 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f0c16b36-5a3c-4681-a3df-57ec111afa00 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:37.623709 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f0c16b36-5a3c-4681-a3df-57ec111afa00 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:37.632307 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0c16b36-5a3c-4681-a3df-57ec111afa00 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:37.633305 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0c16b36-5a3c-4681-a3df-57ec111afa00 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:37.633976 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0c16b36-5a3c-4681-a3df-57ec111afa00 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:37.635191 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0c16b36-5a3c-4681-a3df-57ec111afa00 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:37.635947 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0c16b36-5a3c-4681-a3df-57ec111afa00 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:37.636866 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0c16b36-5a3c-4681-a3df-57ec111afa00 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:39.343861 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f0c16b36-5a3c-4681-a3df-57ec111afa00 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:39.357783 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f0c16b36-5a3c-4681-a3df-57ec111afa00 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:39.359931 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f0c16b36-5a3c-4681-a3df-57ec111afa00 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:39.361516 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f0c16b36-5a3c-4681-a3df-57ec111afa00 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1487 microversion: 2.25 time: 1.744680 Sep 16 12:57:39.377027 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1470/2857] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:37 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1487 bytes in 1760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:57:39.393160 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7279a17f-bef1-4056-98cc-56c8b9aaada1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:39.411300 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7279a17f-bef1-4056-98cc-56c8b9aaada1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 8d3df84c-ed0d-41a9-8632-63591274c2eb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:39.431013 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7279a17f-bef1-4056-98cc-56c8b9aaada1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:39.431452 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7279a17f-bef1-4056-98cc-56c8b9aaada1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:39.433301 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7279a17f-bef1-4056-98cc-56c8b9aaada1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:39.434079 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7279a17f-bef1-4056-98cc-56c8b9aaada1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:39.436550 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7279a17f-bef1-4056-98cc-56c8b9aaada1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:39.437047 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7279a17f-bef1-4056-98cc-56c8b9aaada1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:39.577359 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7279a17f-bef1-4056-98cc-56c8b9aaada1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.198837 Sep 16 12:57:39.581169 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1471/2858] 10.222.0.67 () {58 vars in 1302 bytes} [Fri Sep 16 12:57:39 2022] GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb/os-volume_attachments => generated 197 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:57:39.603899 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-114fdd10-9f11-49e7-9356-66e964f951dc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:39.604655 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-114fdd10-9f11-49e7-9356-66e964f951dc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: cc79a200-5972-4bec-9322-503d99b7d85a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:39.633909 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-114fdd10-9f11-49e7-9356-66e964f951dc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:39.646948 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-114fdd10-9f11-49e7-9356-66e964f951dc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:39.647511 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-114fdd10-9f11-49e7-9356-66e964f951dc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:39.653868 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-114fdd10-9f11-49e7-9356-66e964f951dc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:39.660516 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-114fdd10-9f11-49e7-9356-66e964f951dc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:39.661452 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-114fdd10-9f11-49e7-9356-66e964f951dc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:40.169433 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-114fdd10-9f11-49e7-9356-66e964f951dc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:40.186348 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-975c2f6b-9e7a-44ec-99d8-c2bd0924cb32 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:57:40.186836 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-975c2f6b-9e7a-44ec-99d8-c2bd0924cb32 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:57:40.188109 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-975c2f6b-9e7a-44ec-99d8-c2bd0924cb32 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:57:40.188650 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-975c2f6b-9e7a-44ec-99d8-c2bd0924cb32 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:57:40.189082 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-975c2f6b-9e7a-44ec-99d8-c2bd0924cb32 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:57:40.195691 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-114fdd10-9f11-49e7-9356-66e964f951dc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/cc79a200-5972-4bec-9322-503d99b7d85a" status: 200 len: 1273 microversion: 2.1 time: 0.610234 Sep 16 12:57:40.208361 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1472/2859] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:39 2022] GET /compute/v2.1/servers/cc79a200-5972-4bec-9322-503d99b7d85a => generated 1273 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:40.227377 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-975c2f6b-9e7a-44ec-99d8-c2bd0924cb32 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:40.227880 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-975c2f6b-9e7a-44ec-99d8-c2bd0924cb32 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:40.228389 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ec932fc5-2283-4dbc-8324-5c93f81e02e7 tempest-ServicesAdminTestJSON-333671576 tempest-ServicesAdminTestJSON-333671576-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:40.232407 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec932fc5-2283-4dbc-8324-5c93f81e02e7 tempest-ServicesAdminTestJSON-333671576 tempest-ServicesAdminTestJSON-333671576-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:40.232914 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec932fc5-2283-4dbc-8324-5c93f81e02e7 tempest-ServicesAdminTestJSON-333671576 tempest-ServicesAdminTestJSON-333671576-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:40.233434 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec932fc5-2283-4dbc-8324-5c93f81e02e7 tempest-ServicesAdminTestJSON-333671576 tempest-ServicesAdminTestJSON-333671576-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:40.234092 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec932fc5-2283-4dbc-8324-5c93f81e02e7 tempest-ServicesAdminTestJSON-333671576 tempest-ServicesAdminTestJSON-333671576-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:40.234546 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec932fc5-2283-4dbc-8324-5c93f81e02e7 tempest-ServicesAdminTestJSON-333671576 tempest-ServicesAdminTestJSON-333671576-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:40.238802 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-975c2f6b-9e7a-44ec-99d8-c2bd0924cb32 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:40.239640 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-975c2f6b-9e7a-44ec-99d8-c2bd0924cb32 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:40.241807 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-975c2f6b-9e7a-44ec-99d8-c2bd0924cb32 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:40.242254 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-975c2f6b-9e7a-44ec-99d8-c2bd0924cb32 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:40.250653 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec932fc5-2283-4dbc-8324-5c93f81e02e7 tempest-ServicesAdminTestJSON-333671576 tempest-ServicesAdminTestJSON-333671576-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:40.340549 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-975c2f6b-9e7a-44ec-99d8-c2bd0924cb32 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Getting quotas for project bd30c33cb19d47278478aa2340859920. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:57:40.365977 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-975c2f6b-9e7a-44ec-99d8-c2bd0924cb32 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Getting quotas for user 0e9ec543501c49daaa37af078622626e and project bd30c33cb19d47278478aa2340859920. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:57:40.370131 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ec932fc5-2283-4dbc-8324-5c93f81e02e7 tempest-ServicesAdminTestJSON-333671576 tempest-ServicesAdminTestJSON-333671576-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?host=n-d-858094-4" status: 200 len: 578 microversion: 2.1 time: 0.170690 Sep 16 12:57:40.379132 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1473/2860] 10.222.0.67 () {58 vars in 1172 bytes} [Fri Sep 16 12:57:40 2022] GET /compute/v2.1/os-services?host=n-d-858094-4 => generated 578 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:57:40.384838 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-130a1dd6-a296-46e3-b636-cedb2daf34e5 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:40.385405 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-130a1dd6-a296-46e3-b636-cedb2daf34e5 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 272fddb0-eba2-4559-b76d-460bd65246ec] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:40.432772 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-130a1dd6-a296-46e3-b636-cedb2daf34e5 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:40.433418 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-130a1dd6-a296-46e3-b636-cedb2daf34e5 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:40.433747 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-130a1dd6-a296-46e3-b636-cedb2daf34e5 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:40.434521 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-130a1dd6-a296-46e3-b636-cedb2daf34e5 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:40.435127 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-130a1dd6-a296-46e3-b636-cedb2daf34e5 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:40.439453 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-975c2f6b-9e7a-44ec-99d8-c2bd0924cb32 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Going to run 2 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:57:40.449099 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-130a1dd6-a296-46e3-b636-cedb2daf34e5 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:40.457200 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-975c2f6b-9e7a-44ec-99d8-c2bd0924cb32 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: 5f30c650-f49a-419b-acfe-165d9886e897] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:57:40.592718 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-975c2f6b-9e7a-44ec-99d8-c2bd0924cb32 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: 4f9dac6d-1e24-4618-b802-96fdd6306c30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=5f30c650-f49a-419b-acfe-165d9886e897,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:57:40.758754 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-975c2f6b-9e7a-44ec-99d8-c2bd0924cb32 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 3.948541 Sep 16 12:57:40.759445 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1388/2861] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:57:36 2022] POST /compute/v2.1/servers => generated 32 bytes in 3950 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 16 12:57:40.768078 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-44d234c1-4ac7-4843-8a56-501c0fbb77dd req-314f7937-5bea-4921-8720-229bc8b41f35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc7e9284-2d49-41b2-ad73-0073b2e8bcc6", "name": "network-vif-deleted", "tag": "756b6c88-8a28-4069-a46d-126915a24fb8"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:57:40.810883 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-44d234c1-4ac7-4843-8a56-501c0fbb77dd req-314f7937-5bea-4921-8720-229bc8b41f35 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:40.811339 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-44d234c1-4ac7-4843-8a56-501c0fbb77dd req-314f7937-5bea-4921-8720-229bc8b41f35 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:40.812794 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-44d234c1-4ac7-4843-8a56-501c0fbb77dd req-314f7937-5bea-4921-8720-229bc8b41f35 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:40.869164 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-44d234c1-4ac7-4843-8a56-501c0fbb77dd req-314f7937-5bea-4921-8720-229bc8b41f35 service nova] Creating event network-vif-deleted:756b6c88-8a28-4069-a46d-126915a24fb8 for instance cc7e9284-2d49-41b2-ad73-0073b2e8bcc6 on n-h2-858094-4 Sep 16 12:57:40.887121 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-44d234c1-4ac7-4843-8a56-501c0fbb77dd req-314f7937-5bea-4921-8720-229bc8b41f35 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121623 Sep 16 12:57:40.899405 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1389/2862] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:57:40.921567 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-26242e24-2cca-48e2-8fe0-1765a5feb287 req-99129509-0383-4ab7-9b71-4ec217aa1e1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c31cfc02-e506-4e4f-b06d-a0d38e56c5b6", "name": "network-vif-deleted", "tag": "6a98d6d9-ecee-467f-84c8-ff25d39449e6"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:57:40.955267 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-26242e24-2cca-48e2-8fe0-1765a5feb287 req-99129509-0383-4ab7-9b71-4ec217aa1e1f service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:40.959518 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-26242e24-2cca-48e2-8fe0-1765a5feb287 req-99129509-0383-4ab7-9b71-4ec217aa1e1f service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:40.961305 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-26242e24-2cca-48e2-8fe0-1765a5feb287 req-99129509-0383-4ab7-9b71-4ec217aa1e1f service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:40.998221 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-26242e24-2cca-48e2-8fe0-1765a5feb287 req-99129509-0383-4ab7-9b71-4ec217aa1e1f service nova] Creating event network-vif-deleted:6a98d6d9-ecee-467f-84c8-ff25d39449e6 for instance c31cfc02-e506-4e4f-b06d-a0d38e56c5b6 on n-h1-858094-4 Sep 16 12:57:41.013707 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-26242e24-2cca-48e2-8fe0-1765a5feb287 req-99129509-0383-4ab7-9b71-4ec217aa1e1f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109144 Sep 16 12:57:41.014877 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1390/2863] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:57:41.028982 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9f6c5c05-c056-4f7d-8da3-545d0a773d16 tempest-ServicesAdminTestJSON-333671576 tempest-ServicesAdminTestJSON-333671576-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:41.060478 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9f6c5c05-c056-4f7d-8da3-545d0a773d16 tempest-ServicesAdminTestJSON-333671576 tempest-ServicesAdminTestJSON-333671576-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:41.061007 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9f6c5c05-c056-4f7d-8da3-545d0a773d16 tempest-ServicesAdminTestJSON-333671576 tempest-ServicesAdminTestJSON-333671576-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:41.061557 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9f6c5c05-c056-4f7d-8da3-545d0a773d16 tempest-ServicesAdminTestJSON-333671576 tempest-ServicesAdminTestJSON-333671576-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:41.062500 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9f6c5c05-c056-4f7d-8da3-545d0a773d16 tempest-ServicesAdminTestJSON-333671576 tempest-ServicesAdminTestJSON-333671576-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:41.062920 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9f6c5c05-c056-4f7d-8da3-545d0a773d16 tempest-ServicesAdminTestJSON-333671576 tempest-ServicesAdminTestJSON-333671576-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:41.068837 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9f6c5c05-c056-4f7d-8da3-545d0a773d16 tempest-ServicesAdminTestJSON-333671576 tempest-ServicesAdminTestJSON-333671576-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:41.180544 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9f6c5c05-c056-4f7d-8da3-545d0a773d16 tempest-ServicesAdminTestJSON-333671576 tempest-ServicesAdminTestJSON-333671576-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.164128 Sep 16 12:57:41.190078 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1391/2864] 10.222.0.67 () {58 vars in 1176 bytes} [Fri Sep 16 12:57:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:57:41.210697 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-98e423dc-3846-4de4-b289-9acb1966dcb4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:41.212886 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-98e423dc-3846-4de4-b289-9acb1966dcb4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:41.224635 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-98e423dc-3846-4de4-b289-9acb1966dcb4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:41.232079 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-98e423dc-3846-4de4-b289-9acb1966dcb4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:41.233359 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-98e423dc-3846-4de4-b289-9acb1966dcb4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:41.235148 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-98e423dc-3846-4de4-b289-9acb1966dcb4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:41.235645 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-98e423dc-3846-4de4-b289-9acb1966dcb4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:41.240361 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-98e423dc-3846-4de4-b289-9acb1966dcb4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:41.345045 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-130a1dd6-a296-46e3-b636-cedb2daf34e5 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:41.364350 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-130a1dd6-a296-46e3-b636-cedb2daf34e5 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec" status: 200 len: 1364 microversion: 2.1 time: 0.983113 Sep 16 12:57:41.365423 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1474/2865] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:40 2022] GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec => generated 1364 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:41.397162 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a3dd6805-292e-45ac-ac55-f63a10038340 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:41.402325 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a3dd6805-292e-45ac-ac55-f63a10038340 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 8d3df84c-ed0d-41a9-8632-63591274c2eb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:41.410648 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3dd6805-292e-45ac-ac55-f63a10038340 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:41.411529 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3dd6805-292e-45ac-ac55-f63a10038340 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:41.412656 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3dd6805-292e-45ac-ac55-f63a10038340 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:41.415322 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3dd6805-292e-45ac-ac55-f63a10038340 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:41.415987 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3dd6805-292e-45ac-ac55-f63a10038340 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:41.416996 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3dd6805-292e-45ac-ac55-f63a10038340 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:41.508518 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a3dd6805-292e-45ac-ac55-f63a10038340 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117532 Sep 16 12:57:41.516642 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1475/2866] 10.222.0.67 () {58 vars in 1302 bytes} [Fri Sep 16 12:57:41 2022] GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:57:41.531452 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b567fcab-18c9-40f2-bcea-5ab11cabe180 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:41.537377 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b567fcab-18c9-40f2-bcea-5ab11cabe180 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0e9ec543501c49daaa37af078622626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd30c33cb19d47278478aa2340859920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:41.538435 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b567fcab-18c9-40f2-bcea-5ab11cabe180 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Searching by: {'deleted': False, 'project_id': 'bd30c33cb19d47278478aa2340859920'} {{(pid=128779) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 12:57:41.565109 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b567fcab-18c9-40f2-bcea-5ab11cabe180 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:41.566009 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b567fcab-18c9-40f2-bcea-5ab11cabe180 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:41.567019 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b567fcab-18c9-40f2-bcea-5ab11cabe180 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:41.569253 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b567fcab-18c9-40f2-bcea-5ab11cabe180 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:41.572004 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b567fcab-18c9-40f2-bcea-5ab11cabe180 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:41.574006 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b567fcab-18c9-40f2-bcea-5ab11cabe180 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:41.672223 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b567fcab-18c9-40f2-bcea-5ab11cabe180 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 673 microversion: 2.1 time: 0.153488 Sep 16 12:57:41.675478 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1476/2867] 10.222.0.67 () {58 vars in 1125 bytes} [Fri Sep 16 12:57:41 2022] GET /compute/v2.1/servers => generated 673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:57:41.688762 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-507f62c9-9f66-4f44-a516-009de41f91e2 tempest-ServicesAdminTestJSON-333671576 tempest-ServicesAdminTestJSON-333671576-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:41.698398 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-507f62c9-9f66-4f44-a516-009de41f91e2 tempest-ServicesAdminTestJSON-333671576 tempest-ServicesAdminTestJSON-333671576-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:41.698910 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-507f62c9-9f66-4f44-a516-009de41f91e2 tempest-ServicesAdminTestJSON-333671576 tempest-ServicesAdminTestJSON-333671576-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:41.699489 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-507f62c9-9f66-4f44-a516-009de41f91e2 tempest-ServicesAdminTestJSON-333671576 tempest-ServicesAdminTestJSON-333671576-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:41.703982 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-507f62c9-9f66-4f44-a516-009de41f91e2 tempest-ServicesAdminTestJSON-333671576 tempest-ServicesAdminTestJSON-333671576-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:41.705675 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-507f62c9-9f66-4f44-a516-009de41f91e2 tempest-ServicesAdminTestJSON-333671576 tempest-ServicesAdminTestJSON-333671576-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:41.706141 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-507f62c9-9f66-4f44-a516-009de41f91e2 tempest-ServicesAdminTestJSON-333671576 tempest-ServicesAdminTestJSON-333671576-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:41.846479 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-507f62c9-9f66-4f44-a516-009de41f91e2 tempest-ServicesAdminTestJSON-333671576 tempest-ServicesAdminTestJSON-333671576-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.169108 Sep 16 12:57:41.861706 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1477/2868] 10.222.0.67 () {58 vars in 1137 bytes} [Fri Sep 16 12:57:41 2022] GET /compute/v2.1/os-services => generated 944 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:57:41.874968 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f31a8f37-d27d-4010-bd2b-ccfb474d6d8a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:41.876049 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f31a8f37-d27d-4010-bd2b-ccfb474d6d8a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: cc79a200-5972-4bec-9322-503d99b7d85a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:41.889831 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f31a8f37-d27d-4010-bd2b-ccfb474d6d8a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:41.899630 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f31a8f37-d27d-4010-bd2b-ccfb474d6d8a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:41.900371 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f31a8f37-d27d-4010-bd2b-ccfb474d6d8a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:41.901731 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f31a8f37-d27d-4010-bd2b-ccfb474d6d8a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:41.902319 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f31a8f37-d27d-4010-bd2b-ccfb474d6d8a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:41.902884 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f31a8f37-d27d-4010-bd2b-ccfb474d6d8a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:41.942669 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-98e423dc-3846-4de4-b289-9acb1966dcb4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:41.962479 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-98e423dc-3846-4de4-b289-9acb1966dcb4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:41.974108 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-98e423dc-3846-4de4-b289-9acb1966dcb4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:41.976577 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-98e423dc-3846-4de4-b289-9acb1966dcb4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1487 microversion: 2.25 time: 0.774887 Sep 16 12:57:42.004761 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1392/2869] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:41 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1487 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:57:42.046672 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d82fe6c8-1032-4d22-86c4-20dc74564aa6 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:42.052400 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d82fe6c8-1032-4d22-86c4-20dc74564aa6 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: 4f9dac6d-1e24-4618-b802-96fdd6306c30] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:42.518433 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d82fe6c8-1032-4d22-86c4-20dc74564aa6 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ec543501c49daaa37af078622626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd30c33cb19d47278478aa2340859920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:42.531859 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d82fe6c8-1032-4d22-86c4-20dc74564aa6 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "GET /compute/v2.1/servers/4f9dac6d-1e24-4618-b802-96fdd6306c30" status: 200 len: 1218 microversion: 2.1 time: 0.522766 Sep 16 12:57:42.542305 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1393/2870] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:42 2022] GET /compute/v2.1/servers/4f9dac6d-1e24-4618-b802-96fdd6306c30 => generated 1218 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:42.575052 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ec1df794-e95c-4752-8ded-34f9aa639e5f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:42.575946 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ec1df794-e95c-4752-8ded-34f9aa639e5f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 272fddb0-eba2-4559-b76d-460bd65246ec] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:42.621277 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ec1df794-e95c-4752-8ded-34f9aa639e5f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:42.621865 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ec1df794-e95c-4752-8ded-34f9aa639e5f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:42.622336 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ec1df794-e95c-4752-8ded-34f9aa639e5f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:42.623115 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ec1df794-e95c-4752-8ded-34f9aa639e5f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:42.623583 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ec1df794-e95c-4752-8ded-34f9aa639e5f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:42.624001 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ec1df794-e95c-4752-8ded-34f9aa639e5f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:42.732071 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f31a8f37-d27d-4010-bd2b-ccfb474d6d8a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:42.747439 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f31a8f37-d27d-4010-bd2b-ccfb474d6d8a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/cc79a200-5972-4bec-9322-503d99b7d85a" status: 200 len: 1313 microversion: 2.1 time: 0.880821 Sep 16 12:57:42.768572 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1478/2871] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:41 2022] GET /compute/v2.1/servers/cc79a200-5972-4bec-9322-503d99b7d85a => generated 1313 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:42.782456 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4479b77b-8e04-48b9-aece-0c243cc3733d tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:42.785111 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4479b77b-8e04-48b9-aece-0c243cc3733d tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 8d3df84c-ed0d-41a9-8632-63591274c2eb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:42.806602 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4479b77b-8e04-48b9-aece-0c243cc3733d tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:42.807448 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4479b77b-8e04-48b9-aece-0c243cc3733d tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:42.808858 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4479b77b-8e04-48b9-aece-0c243cc3733d tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:42.809825 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4479b77b-8e04-48b9-aece-0c243cc3733d tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:42.812759 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4479b77b-8e04-48b9-aece-0c243cc3733d tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:42.813457 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4479b77b-8e04-48b9-aece-0c243cc3733d tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:42.854183 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4479b77b-8e04-48b9-aece-0c243cc3733d tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084157 Sep 16 12:57:42.859449 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1479/2872] 10.222.0.67 () {58 vars in 1302 bytes} [Fri Sep 16 12:57:42 2022] GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:57:43.009350 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-a65da616-29b9-4bf3-bae6-a27c808f93bc req-f241cc80-a9b6-4040-816c-6030c0ee2c1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "272fddb0-eba2-4559-b76d-460bd65246ec", "tag": "137f7ed1-df61-44ac-b25d-fb1d5a0609d4"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:57:43.023098 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:57:43.055529 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a65da616-29b9-4bf3-bae6-a27c808f93bc req-f241cc80-a9b6-4040-816c-6030c0ee2c1e service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:43.056851 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a65da616-29b9-4bf3-bae6-a27c808f93bc req-f241cc80-a9b6-4040-816c-6030c0ee2c1e service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:43.064888 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a65da616-29b9-4bf3-bae6-a27c808f93bc req-f241cc80-a9b6-4040-816c-6030c0ee2c1e service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:43.121983 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:57:43.134414 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-a65da616-29b9-4bf3-bae6-a27c808f93bc req-f241cc80-a9b6-4040-816c-6030c0ee2c1e service nova] Creating event network-changed:137f7ed1-df61-44ac-b25d-fb1d5a0609d4 for instance 272fddb0-eba2-4559-b76d-460bd65246ec on n-h2-858094-4 Sep 16 12:57:43.165391 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-a65da616-29b9-4bf3-bae6-a27c808f93bc req-f241cc80-a9b6-4040-816c-6030c0ee2c1e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157699 Sep 16 12:57:43.168038 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1480/2873] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:57:43.195975 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d75e93a8-5ae9-40d3-a395-1b5d762382f0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:43.196963 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d75e93a8-5ae9-40d3-a395-1b5d762382f0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:43.230109 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d75e93a8-5ae9-40d3-a395-1b5d762382f0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:43.232962 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d75e93a8-5ae9-40d3-a395-1b5d762382f0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:43.235539 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d75e93a8-5ae9-40d3-a395-1b5d762382f0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:43.241242 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d75e93a8-5ae9-40d3-a395-1b5d762382f0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:43.244654 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d75e93a8-5ae9-40d3-a395-1b5d762382f0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:43.248971 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d75e93a8-5ae9-40d3-a395-1b5d762382f0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:43.431429 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ec1df794-e95c-4752-8ded-34f9aa639e5f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:43.442310 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ec1df794-e95c-4752-8ded-34f9aa639e5f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec" status: 200 len: 1364 microversion: 2.1 time: 0.898727 Sep 16 12:57:43.444144 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1394/2874] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:42 2022] GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec => generated 1364 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:43.561705 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-eee07fc9-043d-423b-aa37-69512cc396f6 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:43.563510 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-eee07fc9-043d-423b-aa37-69512cc396f6 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: 4f9dac6d-1e24-4618-b802-96fdd6306c30] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:43.573199 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eee07fc9-043d-423b-aa37-69512cc396f6 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:43.574143 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eee07fc9-043d-423b-aa37-69512cc396f6 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:43.574782 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eee07fc9-043d-423b-aa37-69512cc396f6 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:43.575780 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eee07fc9-043d-423b-aa37-69512cc396f6 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:43.576496 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eee07fc9-043d-423b-aa37-69512cc396f6 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:43.577360 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eee07fc9-043d-423b-aa37-69512cc396f6 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:43.867582 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-eee07fc9-043d-423b-aa37-69512cc396f6 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ec543501c49daaa37af078622626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd30c33cb19d47278478aa2340859920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:43.878678 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-eee07fc9-043d-423b-aa37-69512cc396f6 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "GET /compute/v2.1/servers/4f9dac6d-1e24-4618-b802-96fdd6306c30" status: 200 len: 1214 microversion: 2.1 time: 0.322729 Sep 16 12:57:43.880841 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1395/2875] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:43 2022] GET /compute/v2.1/servers/4f9dac6d-1e24-4618-b802-96fdd6306c30 => generated 1214 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:57:43.891530 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-dfc424ae-35b0-4544-a7b3-739d173ee5df tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:43.892833 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-dfc424ae-35b0-4544-a7b3-739d173ee5df tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: cc79a200-5972-4bec-9322-503d99b7d85a] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:43.907770 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dfc424ae-35b0-4544-a7b3-739d173ee5df tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:43.908756 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dfc424ae-35b0-4544-a7b3-739d173ee5df tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:43.921537 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dfc424ae-35b0-4544-a7b3-739d173ee5df tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:43.922582 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dfc424ae-35b0-4544-a7b3-739d173ee5df tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:43.923701 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dfc424ae-35b0-4544-a7b3-739d173ee5df tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:43.924357 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dfc424ae-35b0-4544-a7b3-739d173ee5df tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:43.928294 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:57:43.944805 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d75e93a8-5ae9-40d3-a395-1b5d762382f0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:43.959114 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d75e93a8-5ae9-40d3-a395-1b5d762382f0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:43.967158 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d75e93a8-5ae9-40d3-a395-1b5d762382f0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:43.970388 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d75e93a8-5ae9-40d3-a395-1b5d762382f0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1487 microversion: 2.25 time: 0.798985 Sep 16 12:57:43.976943 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1481/2876] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:43 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1487 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:57:43.982237 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-aef65267-87df-4c4c-8543-79e8a26edbcd tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:44.003995 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-aef65267-87df-4c4c-8543-79e8a26edbcd tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 8d3df84c-ed0d-41a9-8632-63591274c2eb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:44.034336 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aef65267-87df-4c4c-8543-79e8a26edbcd tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:44.036055 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aef65267-87df-4c4c-8543-79e8a26edbcd tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:44.041029 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aef65267-87df-4c4c-8543-79e8a26edbcd tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:44.045379 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aef65267-87df-4c4c-8543-79e8a26edbcd tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:44.046547 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aef65267-87df-4c4c-8543-79e8a26edbcd tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:44.049418 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aef65267-87df-4c4c-8543-79e8a26edbcd tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:44.121863 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-aef65267-87df-4c4c-8543-79e8a26edbcd tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.143383 Sep 16 12:57:44.132679 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1482/2877] 10.222.0.67 () {58 vars in 1302 bytes} [Fri Sep 16 12:57:43 2022] GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb/os-volume_attachments => generated 25 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 12:57:44.472047 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-41a82a38-c82d-46b9-aa16-82de01a949d7 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:44.473302 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-41a82a38-c82d-46b9-aa16-82de01a949d7 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 272fddb0-eba2-4559-b76d-460bd65246ec] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:44.526903 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41a82a38-c82d-46b9-aa16-82de01a949d7 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:44.527853 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41a82a38-c82d-46b9-aa16-82de01a949d7 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:44.535851 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41a82a38-c82d-46b9-aa16-82de01a949d7 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:44.538411 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41a82a38-c82d-46b9-aa16-82de01a949d7 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:44.539278 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41a82a38-c82d-46b9-aa16-82de01a949d7 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:44.545375 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41a82a38-c82d-46b9-aa16-82de01a949d7 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:44.985416 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-dfc424ae-35b0-4544-a7b3-739d173ee5df tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:44.998803 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-dfc424ae-35b0-4544-a7b3-739d173ee5df tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/cc79a200-5972-4bec-9322-503d99b7d85a" status: 200 len: 1313 microversion: 2.1 time: 1.116554 Sep 16 12:57:45.001361 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1396/2878] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:43 2022] GET /compute/v2.1/servers/cc79a200-5972-4bec-9322-503d99b7d85a => generated 1313 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:45.020342 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b5b8994d-a4c4-48a3-9e34-2ec7030af4e3 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1573973993", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": [{"uuid": "d07f81e7-3dc4-4b39-ad5d-bffdea9cea45"}]}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:57:45.137403 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-b5b8994d-a4c4-48a3-9e34-2ec7030af4e3 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] validate_networks() for [('d07f81e7-3dc4-4b39-ad5d-bffdea9cea45', None, None, None, None, None)] {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:57:45.317780 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-41a82a38-c82d-46b9-aa16-82de01a949d7 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:45.361891 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-41a82a38-c82d-46b9-aa16-82de01a949d7 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec" status: 200 len: 1364 microversion: 2.1 time: 0.893577 Sep 16 12:57:45.365402 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1483/2879] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:44 2022] GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec => generated 1364 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:57:45.371246 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d8c08681-1511-4552-b0dd-9f7c8bf5941e tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:45.372219 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d8c08681-1511-4552-b0dd-9f7c8bf5941e tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: 4f9dac6d-1e24-4618-b802-96fdd6306c30] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:45.392387 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8c08681-1511-4552-b0dd-9f7c8bf5941e tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:45.393577 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8c08681-1511-4552-b0dd-9f7c8bf5941e tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:45.394186 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8c08681-1511-4552-b0dd-9f7c8bf5941e tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:45.395084 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8c08681-1511-4552-b0dd-9f7c8bf5941e tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:45.395949 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8c08681-1511-4552-b0dd-9f7c8bf5941e tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:45.396572 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8c08681-1511-4552-b0dd-9f7c8bf5941e tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:45.632550 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d8c08681-1511-4552-b0dd-9f7c8bf5941e tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ec543501c49daaa37af078622626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd30c33cb19d47278478aa2340859920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:45.659958 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d8c08681-1511-4552-b0dd-9f7c8bf5941e tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "GET /compute/v2.1/servers/4f9dac6d-1e24-4618-b802-96fdd6306c30" status: 200 len: 1278 microversion: 2.1 time: 0.291618 Sep 16 12:57:45.665229 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1484/2880] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:45 2022] GET /compute/v2.1/servers/4f9dac6d-1e24-4618-b802-96fdd6306c30 => generated 1278 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:45.676751 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0c01c9c1-4aac-4a4a-b794-df7a9a592481 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:45.678108 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0c01c9c1-4aac-4a4a-b794-df7a9a592481 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:45.703005 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c01c9c1-4aac-4a4a-b794-df7a9a592481 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:45.703787 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c01c9c1-4aac-4a4a-b794-df7a9a592481 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:45.713162 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c01c9c1-4aac-4a4a-b794-df7a9a592481 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:45.716510 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c01c9c1-4aac-4a4a-b794-df7a9a592481 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:45.717440 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c01c9c1-4aac-4a4a-b794-df7a9a592481 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:45.719928 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c01c9c1-4aac-4a4a-b794-df7a9a592481 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:46.902632 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=8 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:57:47.588684 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0c01c9c1-4aac-4a4a-b794-df7a9a592481 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:47.606178 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0c01c9c1-4aac-4a4a-b794-df7a9a592481 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:47.607906 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0c01c9c1-4aac-4a4a-b794-df7a9a592481 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:47.609313 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0c01c9c1-4aac-4a4a-b794-df7a9a592481 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1487 microversion: 2.25 time: 1.942508 Sep 16 12:57:47.609904 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1485/2881] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:45 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1487 bytes in 1944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:57:47.626714 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4240b6e6-8a23-4261-948d-dee22bd82bbd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:47.627621 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4240b6e6-8a23-4261-948d-dee22bd82bbd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: cc79a200-5972-4bec-9322-503d99b7d85a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:47.639892 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4240b6e6-8a23-4261-948d-dee22bd82bbd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:47.640826 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4240b6e6-8a23-4261-948d-dee22bd82bbd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:47.641728 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4240b6e6-8a23-4261-948d-dee22bd82bbd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:47.642691 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4240b6e6-8a23-4261-948d-dee22bd82bbd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:47.643385 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4240b6e6-8a23-4261-948d-dee22bd82bbd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:47.645302 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4240b6e6-8a23-4261-948d-dee22bd82bbd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:47.841087 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-b5b8994d-a4c4-48a3-9e34-2ec7030af4e3 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:57:47.842147 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-b5b8994d-a4c4-48a3-9e34-2ec7030af4e3 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:57:47.843203 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-b5b8994d-a4c4-48a3-9e34-2ec7030af4e3 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:57:47.843798 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-b5b8994d-a4c4-48a3-9e34-2ec7030af4e3 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:57:47.844711 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-b5b8994d-a4c4-48a3-9e34-2ec7030af4e3 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:57:47.867335 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b5b8994d-a4c4-48a3-9e34-2ec7030af4e3 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:47.868214 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b5b8994d-a4c4-48a3-9e34-2ec7030af4e3 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:47.868945 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b5b8994d-a4c4-48a3-9e34-2ec7030af4e3 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:47.870260 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b5b8994d-a4c4-48a3-9e34-2ec7030af4e3 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:47.874165 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b5b8994d-a4c4-48a3-9e34-2ec7030af4e3 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:47.874780 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b5b8994d-a4c4-48a3-9e34-2ec7030af4e3 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:47.921597 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-b5b8994d-a4c4-48a3-9e34-2ec7030af4e3 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Getting quotas for project 6e940a963f7740dea44034d06e8c2a77. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:57:47.948635 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-b5b8994d-a4c4-48a3-9e34-2ec7030af4e3 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Getting quotas for user 37316c1f04764255a2a9466676502c35 and project 6e940a963f7740dea44034d06e8c2a77. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:57:47.980941 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b5b8994d-a4c4-48a3-9e34-2ec7030af4e3 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:57:47.986257 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b5b8994d-a4c4-48a3-9e34-2ec7030af4e3 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 2998767f-d217-40ea-a487-60c0c4ade426] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:57:48.106855 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b5b8994d-a4c4-48a3-9e34-2ec7030af4e3 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.102519 Sep 16 12:57:48.112208 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1397/2882] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:57:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 3110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:57:48.127672 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-992c1043-cd45-4510-900f-83eb28d39075 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:48.130222 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-992c1043-cd45-4510-900f-83eb28d39075 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 272fddb0-eba2-4559-b76d-460bd65246ec] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:48.146442 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-992c1043-cd45-4510-900f-83eb28d39075 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:48.148767 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-992c1043-cd45-4510-900f-83eb28d39075 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:48.152085 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-992c1043-cd45-4510-900f-83eb28d39075 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:48.154167 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-992c1043-cd45-4510-900f-83eb28d39075 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:48.156213 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-992c1043-cd45-4510-900f-83eb28d39075 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:48.157819 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-992c1043-cd45-4510-900f-83eb28d39075 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:48.239261 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4240b6e6-8a23-4261-948d-dee22bd82bbd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:48.251053 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4240b6e6-8a23-4261-948d-dee22bd82bbd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/cc79a200-5972-4bec-9322-503d99b7d85a" status: 200 len: 1313 microversion: 2.1 time: 0.629006 Sep 16 12:57:48.254160 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1486/2883] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:47 2022] GET /compute/v2.1/servers/cc79a200-5972-4bec-9322-503d99b7d85a => generated 1313 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:48.269031 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-41987e14-ec0a-4eea-9db6-c50904443769 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:48.270382 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-41987e14-ec0a-4eea-9db6-c50904443769 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: 4f9dac6d-1e24-4618-b802-96fdd6306c30] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:48.287337 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41987e14-ec0a-4eea-9db6-c50904443769 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:48.289107 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41987e14-ec0a-4eea-9db6-c50904443769 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:48.289989 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41987e14-ec0a-4eea-9db6-c50904443769 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:48.291549 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41987e14-ec0a-4eea-9db6-c50904443769 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:48.293109 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41987e14-ec0a-4eea-9db6-c50904443769 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:48.294265 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41987e14-ec0a-4eea-9db6-c50904443769 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:48.546746 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-41987e14-ec0a-4eea-9db6-c50904443769 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ec543501c49daaa37af078622626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd30c33cb19d47278478aa2340859920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:48.562094 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-41987e14-ec0a-4eea-9db6-c50904443769 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "GET /compute/v2.1/servers/4f9dac6d-1e24-4618-b802-96fdd6306c30" status: 200 len: 1276 microversion: 2.1 time: 0.299803 Sep 16 12:57:48.571831 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1487/2884] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:48 2022] GET /compute/v2.1/servers/4f9dac6d-1e24-4618-b802-96fdd6306c30 => generated 1276 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:48.578909 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-17c91350-ba47-411c-a7be-ea7feebafa01 req-45df6591-248a-4505-a2c4-fd18783d7d21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc79a200-5972-4bec-9322-503d99b7d85a", "tag": "c9811505-9290-4353-ad69-62b405cd0ded"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:57:48.625770 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-17c91350-ba47-411c-a7be-ea7feebafa01 req-45df6591-248a-4505-a2c4-fd18783d7d21 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:48.627238 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-17c91350-ba47-411c-a7be-ea7feebafa01 req-45df6591-248a-4505-a2c4-fd18783d7d21 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:48.630504 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-17c91350-ba47-411c-a7be-ea7feebafa01 req-45df6591-248a-4505-a2c4-fd18783d7d21 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:48.676234 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-17c91350-ba47-411c-a7be-ea7feebafa01 req-45df6591-248a-4505-a2c4-fd18783d7d21 service nova] Creating event network-changed:c9811505-9290-4353-ad69-62b405cd0ded for instance cc79a200-5972-4bec-9322-503d99b7d85a on n-h2-858094-4 Sep 16 12:57:48.685968 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-17c91350-ba47-411c-a7be-ea7feebafa01 req-45df6591-248a-4505-a2c4-fd18783d7d21 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120317 Sep 16 12:57:48.687516 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1488/2885] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:57:48.705785 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cd57b073-6f3a-40c7-b033-15d81eccc4b2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1427957498", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": [{"uuid": "d73f9ac4-e3fa-4fbb-92bf-6c462d38b039"}, {"uuid": "609f556d-5ff4-4778-acbd-e74414e27820"}, {"uuid": "d73f9ac4-e3fa-4fbb-92bf-6c462d38b039"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:57:48.790521 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-cd57b073-6f3a-40c7-b033-15d81eccc4b2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] validate_networks() for [('d73f9ac4-e3fa-4fbb-92bf-6c462d38b039', None, None, None, None, None), ('609f556d-5ff4-4778-acbd-e74414e27820', None, None, None, None, None), ('d73f9ac4-e3fa-4fbb-92bf-6c462d38b039', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:57:49.864226 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-992c1043-cd45-4510-900f-83eb28d39075 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:49.880038 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-992c1043-cd45-4510-900f-83eb28d39075 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec" status: 200 len: 1364 microversion: 2.1 time: 1.764022 Sep 16 12:57:49.881870 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1398/2886] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:48 2022] GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec => generated 1364 bytes in 1769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:49.913704 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4d624bea-31d4-4086-97da-5590cc101ada tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:49.915394 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-4d624bea-31d4-4086-97da-5590cc101ada tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 2998767f-d217-40ea-a487-60c0c4ade426] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:49.940627 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4d624bea-31d4-4086-97da-5590cc101ada tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:49.942346 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4d624bea-31d4-4086-97da-5590cc101ada tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:49.945819 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4d624bea-31d4-4086-97da-5590cc101ada tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:49.947240 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4d624bea-31d4-4086-97da-5590cc101ada tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:49.949378 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4d624bea-31d4-4086-97da-5590cc101ada tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:49.950835 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4d624bea-31d4-4086-97da-5590cc101ada tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:50.262470 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4d624bea-31d4-4086-97da-5590cc101ada tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37316c1f04764255a2a9466676502c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e940a963f7740dea44034d06e8c2a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:50.277851 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4d624bea-31d4-4086-97da-5590cc101ada tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "GET /compute/v2.1/servers/2998767f-d217-40ea-a487-60c0c4ade426" status: 200 len: 1270 microversion: 2.1 time: 0.373485 Sep 16 12:57:50.280563 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1399/2887] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:49 2022] GET /compute/v2.1/servers/2998767f-d217-40ea-a487-60c0c4ade426 => generated 1270 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:50.290605 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-38ada316-9b9a-457c-942c-2efd3dae5c8d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:50.296771 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-38ada316-9b9a-457c-942c-2efd3dae5c8d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:50.319842 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-38ada316-9b9a-457c-942c-2efd3dae5c8d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:50.324158 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-38ada316-9b9a-457c-942c-2efd3dae5c8d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:50.326635 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-38ada316-9b9a-457c-942c-2efd3dae5c8d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:50.331017 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-38ada316-9b9a-457c-942c-2efd3dae5c8d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:50.332586 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-38ada316-9b9a-457c-942c-2efd3dae5c8d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:50.334790 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-38ada316-9b9a-457c-942c-2efd3dae5c8d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:51.397163 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-38ada316-9b9a-457c-942c-2efd3dae5c8d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:51.408097 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-38ada316-9b9a-457c-942c-2efd3dae5c8d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:51.418143 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-38ada316-9b9a-457c-942c-2efd3dae5c8d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:51.419726 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-38ada316-9b9a-457c-942c-2efd3dae5c8d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1487 microversion: 2.25 time: 1.137778 Sep 16 12:57:51.423366 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1400/2888] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:50 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1487 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:57:51.439029 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e199b715-4be5-49dd-b680-eb8808410ad6 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:51.439914 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e199b715-4be5-49dd-b680-eb8808410ad6 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: cc79a200-5972-4bec-9322-503d99b7d85a] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:51.455937 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e199b715-4be5-49dd-b680-eb8808410ad6 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:51.456955 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e199b715-4be5-49dd-b680-eb8808410ad6 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:51.457519 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e199b715-4be5-49dd-b680-eb8808410ad6 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:51.459955 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e199b715-4be5-49dd-b680-eb8808410ad6 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:51.460724 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e199b715-4be5-49dd-b680-eb8808410ad6 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:51.462789 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e199b715-4be5-49dd-b680-eb8808410ad6 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:51.733577 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=10 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:57:52.204083 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e199b715-4be5-49dd-b680-eb8808410ad6 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:52.221390 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e199b715-4be5-49dd-b680-eb8808410ad6 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/cc79a200-5972-4bec-9322-503d99b7d85a" status: 200 len: 1313 microversion: 2.1 time: 0.796452 Sep 16 12:57:52.221835 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1401/2889] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:51 2022] GET /compute/v2.1/servers/cc79a200-5972-4bec-9322-503d99b7d85a => generated 1313 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:52.227039 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8b6370d9-8876-4107-ab03-74858b387432 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:52.227899 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8b6370d9-8876-4107-ab03-74858b387432 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: 4f9dac6d-1e24-4618-b802-96fdd6306c30] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:52.242008 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8b6370d9-8876-4107-ab03-74858b387432 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:52.247577 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8b6370d9-8876-4107-ab03-74858b387432 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:52.248038 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8b6370d9-8876-4107-ab03-74858b387432 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:52.248812 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8b6370d9-8876-4107-ab03-74858b387432 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:52.249275 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8b6370d9-8876-4107-ab03-74858b387432 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:52.257667 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8b6370d9-8876-4107-ab03-74858b387432 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:52.543444 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8b6370d9-8876-4107-ab03-74858b387432 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ec543501c49daaa37af078622626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd30c33cb19d47278478aa2340859920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:52.552904 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8b6370d9-8876-4107-ab03-74858b387432 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "GET /compute/v2.1/servers/4f9dac6d-1e24-4618-b802-96fdd6306c30" status: 200 len: 1318 microversion: 2.1 time: 0.330003 Sep 16 12:57:52.564971 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1402/2890] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:52 2022] GET /compute/v2.1/servers/4f9dac6d-1e24-4618-b802-96fdd6306c30 => generated 1318 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:52.570226 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-88baa857-d600-4143-a31b-319942cc219b req-6cdba538-b71e-4aef-85f6-2a874d096df7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "272fddb0-eba2-4559-b76d-460bd65246ec", "name": "network-vif-plugged", "status": "completed", "tag": "137f7ed1-df61-44ac-b25d-fb1d5a0609d4"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:57:52.592607 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-88baa857-d600-4143-a31b-319942cc219b req-6cdba538-b71e-4aef-85f6-2a874d096df7 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:52.593450 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-88baa857-d600-4143-a31b-319942cc219b req-6cdba538-b71e-4aef-85f6-2a874d096df7 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:52.594151 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-88baa857-d600-4143-a31b-319942cc219b req-6cdba538-b71e-4aef-85f6-2a874d096df7 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:52.615607 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-88baa857-d600-4143-a31b-319942cc219b req-6cdba538-b71e-4aef-85f6-2a874d096df7 service nova] Creating event network-vif-plugged:137f7ed1-df61-44ac-b25d-fb1d5a0609d4 for instance 272fddb0-eba2-4559-b76d-460bd65246ec on n-h2-858094-4 Sep 16 12:57:52.633723 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-88baa857-d600-4143-a31b-319942cc219b req-6cdba538-b71e-4aef-85f6-2a874d096df7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066581 Sep 16 12:57:52.634700 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1403/2891] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:57:52.640234 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0385d0d4-f7c7-4959-91f0-bc70c48d0943 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:52.653299 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0385d0d4-f7c7-4959-91f0-bc70c48d0943 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 272fddb0-eba2-4559-b76d-460bd65246ec] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:52.660862 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0385d0d4-f7c7-4959-91f0-bc70c48d0943 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:52.673200 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0385d0d4-f7c7-4959-91f0-bc70c48d0943 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:52.674018 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0385d0d4-f7c7-4959-91f0-bc70c48d0943 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:52.675011 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0385d0d4-f7c7-4959-91f0-bc70c48d0943 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:52.675694 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0385d0d4-f7c7-4959-91f0-bc70c48d0943 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:52.676407 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0385d0d4-f7c7-4959-91f0-bc70c48d0943 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:53.178429 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0385d0d4-f7c7-4959-91f0-bc70c48d0943 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:53.206029 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0385d0d4-f7c7-4959-91f0-bc70c48d0943 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec" status: 200 len: 1364 microversion: 2.1 time: 0.559411 Sep 16 12:57:53.207035 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1404/2892] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:52 2022] GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec => generated 1364 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:53.482488 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-cd57b073-6f3a-40c7-b033-15d81eccc4b2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:57:53.483860 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-cd57b073-6f3a-40c7-b033-15d81eccc4b2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:57:53.485164 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-cd57b073-6f3a-40c7-b033-15d81eccc4b2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:57:53.485783 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-cd57b073-6f3a-40c7-b033-15d81eccc4b2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:57:53.486888 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-cd57b073-6f3a-40c7-b033-15d81eccc4b2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:57:53.499464 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd57b073-6f3a-40c7-b033-15d81eccc4b2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:53.500150 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd57b073-6f3a-40c7-b033-15d81eccc4b2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:53.500810 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd57b073-6f3a-40c7-b033-15d81eccc4b2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:53.502007 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd57b073-6f3a-40c7-b033-15d81eccc4b2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:53.502519 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd57b073-6f3a-40c7-b033-15d81eccc4b2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:53.503020 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd57b073-6f3a-40c7-b033-15d81eccc4b2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:53.526302 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-cd57b073-6f3a-40c7-b033-15d81eccc4b2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Getting quotas for project 18ad456d126a4c25accb04f76a159733. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:57:53.538100 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-cd57b073-6f3a-40c7-b033-15d81eccc4b2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Getting quotas for user 24cf3952918747349e71c4ac1e7b00c6 and project 18ad456d126a4c25accb04f76a159733. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:57:53.558595 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cd57b073-6f3a-40c7-b033-15d81eccc4b2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:57:53.561683 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cd57b073-6f3a-40c7-b033-15d81eccc4b2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 536f2ffa-d5a1-4060-9ef1-f305cf164fd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:57:53.591165 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d00c532b-8b2e-41f1-a821-463cb50ccbcd tempest-ListImageFiltersNegativeTestJSON-1645514847 tempest-ListImageFiltersNegativeTestJSON-1645514847-project] Calling method '.version_select at 0x7f1034dc1f70>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:53.625082 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-d00c532b-8b2e-41f1-a821-463cb50ccbcd tempest-ListImageFiltersNegativeTestJSON-1645514847 tempest-ListImageFiltersNegativeTestJSON-1645514847-project] HTTP exception thrown: Image not found. Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d00c532b-8b2e-41f1-a821-463cb50ccbcd tempest-ListImageFiltersNegativeTestJSON-1645514847 tempest-ListImageFiltersNegativeTestJSON-1645514847-project] Request method failure captured: Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/images/9b2a77f1-c425-4cf8-b274-6a4c0f236a73 HTTP/1.1 Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHLO2q2ylGCF6dcn7fDLd2_jRBzrdvsZNFyeH2rWEATpf5PPLz-7bnE1XV9UFBnJUaiijaEZCijbbTGSep7K7uaIMHWBIoPgWASjIdOB45jHH-F_hw65KMWw2oJYrT4r2xq1FxRhKOYxEzCU5irTrdqnOFsbAppV8BdUolMT6N2NG4Q Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 8a29c86523434c41b5078cb1dad129c5 Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1645514847 Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8a29c86523434c41b5078cb1dad129c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8a29c86523434c41b5078cb1dad129c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8a29c86523434c41b5078cb1dad129c5", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8a29c86523434c41b5078cb1dad129c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1645514847 Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 8a29c86523434c41b5078cb1dad129c5 Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1645514847 Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ListImageFiltersNegativeTestJSON-1645514847-project Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 4f118933f727423c9c23c30be9639d32 Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1645514847-project Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: exception: Image not found. Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '9b2a77f1-c425-4cf8-b274-6a4c0f236a73'} Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9b2a77f1-c425-4cf8-b274-6a4c0f236a73 Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 16 12:57:53.628443 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9b2a77f1-c425-4cf8-b274-6a4c0f236a73 could not be found. Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 12:57:53.632904 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:57:53.644356 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d00c532b-8b2e-41f1-a821-463cb50ccbcd tempest-ListImageFiltersNegativeTestJSON-1645514847 tempest-ListImageFiltersNegativeTestJSON-1645514847-project] Returning 404 to user: Image not found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:57:53.645169 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d00c532b-8b2e-41f1-a821-463cb50ccbcd tempest-ListImageFiltersNegativeTestJSON-1645514847 tempest-ListImageFiltersNegativeTestJSON-1645514847-project] 10.222.0.67 "GET /compute/v2.1/images/9b2a77f1-c425-4cf8-b274-6a4c0f236a73" status: 404 len: 62 microversion: 2.1 time: 0.435553 Sep 16 12:57:53.646264 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1405/2893] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:57:53 2022] GET /compute/v2.1/images/9b2a77f1-c425-4cf8-b274-6a4c0f236a73 => generated 62 bytes in 438 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 12:57:53.668671 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-744b75f6-89a5-4571-b70f-f2d522ac21f9 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:53.670067 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-744b75f6-89a5-4571-b70f-f2d522ac21f9 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 2998767f-d217-40ea-a487-60c0c4ade426] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:53.672913 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cd57b073-6f3a-40c7-b033-15d81eccc4b2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.981838 Sep 16 12:57:53.677673 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1489/2894] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:57:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 4989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:57:53.691677 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8dcfe683-a04a-49f7-8312-b95c6a9177b1 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:53.695136 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8dcfe683-a04a-49f7-8312-b95c6a9177b1 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:53.697616 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-744b75f6-89a5-4571-b70f-f2d522ac21f9 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:53.698760 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-744b75f6-89a5-4571-b70f-f2d522ac21f9 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:53.700283 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-744b75f6-89a5-4571-b70f-f2d522ac21f9 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:53.702232 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-744b75f6-89a5-4571-b70f-f2d522ac21f9 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:53.706467 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-744b75f6-89a5-4571-b70f-f2d522ac21f9 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:53.707828 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-744b75f6-89a5-4571-b70f-f2d522ac21f9 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:53.716452 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8dcfe683-a04a-49f7-8312-b95c6a9177b1 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:53.720671 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8dcfe683-a04a-49f7-8312-b95c6a9177b1 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:53.721534 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8dcfe683-a04a-49f7-8312-b95c6a9177b1 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:53.723276 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8dcfe683-a04a-49f7-8312-b95c6a9177b1 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:53.724775 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8dcfe683-a04a-49f7-8312-b95c6a9177b1 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:53.728859 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8dcfe683-a04a-49f7-8312-b95c6a9177b1 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:54.554893 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8dcfe683-a04a-49f7-8312-b95c6a9177b1 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:54.563948 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8dcfe683-a04a-49f7-8312-b95c6a9177b1 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:54.565400 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8dcfe683-a04a-49f7-8312-b95c6a9177b1 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:54.566671 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8dcfe683-a04a-49f7-8312-b95c6a9177b1 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1487 microversion: 2.25 time: 0.887565 Sep 16 12:57:54.580521 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1490/2895] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:53 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1487 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:57:54.585982 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3ddb00c8-b44c-42f0-a86f-d26ee8235fee tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:54.587601 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3ddb00c8-b44c-42f0-a86f-d26ee8235fee tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: cc79a200-5972-4bec-9322-503d99b7d85a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:54.604649 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ddb00c8-b44c-42f0-a86f-d26ee8235fee tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:54.605149 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ddb00c8-b44c-42f0-a86f-d26ee8235fee tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:54.605596 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ddb00c8-b44c-42f0-a86f-d26ee8235fee tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:54.606339 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ddb00c8-b44c-42f0-a86f-d26ee8235fee tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:54.607213 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ddb00c8-b44c-42f0-a86f-d26ee8235fee tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:54.607831 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ddb00c8-b44c-42f0-a86f-d26ee8235fee tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:54.635907 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-744b75f6-89a5-4571-b70f-f2d522ac21f9 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37316c1f04764255a2a9466676502c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e940a963f7740dea44034d06e8c2a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:54.649149 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-744b75f6-89a5-4571-b70f-f2d522ac21f9 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "GET /compute/v2.1/servers/2998767f-d217-40ea-a487-60c0c4ade426" status: 200 len: 1318 microversion: 2.1 time: 0.999095 Sep 16 12:57:54.652175 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1406/2896] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:53 2022] GET /compute/v2.1/servers/2998767f-d217-40ea-a487-60c0c4ade426 => generated 1318 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:54.658086 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-89429c82-1ebd-4a4e-90d3-fcfda3190988 req-4d59eaf1-aefc-45d7-88b1-74e7e0495314 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2998767f-d217-40ea-a487-60c0c4ade426", "tag": "5cef43f7-b56b-46c5-a6b2-06877f434cd6"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:57:54.673874 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-89429c82-1ebd-4a4e-90d3-fcfda3190988 req-4d59eaf1-aefc-45d7-88b1-74e7e0495314 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:54.674544 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-89429c82-1ebd-4a4e-90d3-fcfda3190988 req-4d59eaf1-aefc-45d7-88b1-74e7e0495314 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:54.675142 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-89429c82-1ebd-4a4e-90d3-fcfda3190988 req-4d59eaf1-aefc-45d7-88b1-74e7e0495314 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:54.694381 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-89429c82-1ebd-4a4e-90d3-fcfda3190988 req-4d59eaf1-aefc-45d7-88b1-74e7e0495314 service nova] Creating event network-changed:5cef43f7-b56b-46c5-a6b2-06877f434cd6 for instance 2998767f-d217-40ea-a487-60c0c4ade426 on n-h2-858094-4 Sep 16 12:57:54.702717 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-89429c82-1ebd-4a4e-90d3-fcfda3190988 req-4d59eaf1-aefc-45d7-88b1-74e7e0495314 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048573 Sep 16 12:57:54.703600 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1407/2897] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:57:54.713259 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9fb446f5-6eaf-49f4-ad86-331e4943ddbe tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:54.714977 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9fb446f5-6eaf-49f4-ad86-331e4943ddbe tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: 4f9dac6d-1e24-4618-b802-96fdd6306c30] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:54.724949 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9fb446f5-6eaf-49f4-ad86-331e4943ddbe tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:54.727186 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9fb446f5-6eaf-49f4-ad86-331e4943ddbe tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:54.727922 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9fb446f5-6eaf-49f4-ad86-331e4943ddbe tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:54.729270 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9fb446f5-6eaf-49f4-ad86-331e4943ddbe tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:54.729922 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9fb446f5-6eaf-49f4-ad86-331e4943ddbe tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:54.730522 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9fb446f5-6eaf-49f4-ad86-331e4943ddbe tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:55.269716 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3ddb00c8-b44c-42f0-a86f-d26ee8235fee tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:55.276646 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9fb446f5-6eaf-49f4-ad86-331e4943ddbe tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ec543501c49daaa37af078622626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd30c33cb19d47278478aa2340859920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:55.279427 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3ddb00c8-b44c-42f0-a86f-d26ee8235fee tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/cc79a200-5972-4bec-9322-503d99b7d85a" status: 200 len: 1313 microversion: 2.1 time: 0.697405 Sep 16 12:57:55.280414 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1491/2898] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:54 2022] GET /compute/v2.1/servers/cc79a200-5972-4bec-9322-503d99b7d85a => generated 1313 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:55.286209 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-09f7160c-11d7-4f41-8669-26342aff46b1 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:55.287735 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-09f7160c-11d7-4f41-8669-26342aff46b1 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 536f2ffa-d5a1-4060-9ef1-f305cf164fd3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:55.289133 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9fb446f5-6eaf-49f4-ad86-331e4943ddbe tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "GET /compute/v2.1/servers/4f9dac6d-1e24-4618-b802-96fdd6306c30" status: 200 len: 1318 microversion: 2.1 time: 0.582894 Sep 16 12:57:55.289133 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1408/2899] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:54 2022] GET /compute/v2.1/servers/4f9dac6d-1e24-4618-b802-96fdd6306c30 => generated 1318 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:55.300954 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09f7160c-11d7-4f41-8669-26342aff46b1 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:55.302125 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09f7160c-11d7-4f41-8669-26342aff46b1 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:55.302791 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-240b2661-0a7c-4b19-bf8d-b942a96e746f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:55.303415 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-240b2661-0a7c-4b19-bf8d-b942a96e746f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 272fddb0-eba2-4559-b76d-460bd65246ec] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:55.304980 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09f7160c-11d7-4f41-8669-26342aff46b1 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:55.307432 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09f7160c-11d7-4f41-8669-26342aff46b1 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:55.308610 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09f7160c-11d7-4f41-8669-26342aff46b1 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:55.309175 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09f7160c-11d7-4f41-8669-26342aff46b1 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:55.315106 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-240b2661-0a7c-4b19-bf8d-b942a96e746f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:55.315827 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-240b2661-0a7c-4b19-bf8d-b942a96e746f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:55.316293 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-240b2661-0a7c-4b19-bf8d-b942a96e746f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:55.317242 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-240b2661-0a7c-4b19-bf8d-b942a96e746f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:55.317701 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-240b2661-0a7c-4b19-bf8d-b942a96e746f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:55.318127 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-240b2661-0a7c-4b19-bf8d-b942a96e746f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:55.501090 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-09f7160c-11d7-4f41-8669-26342aff46b1 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:55.512017 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-09f7160c-11d7-4f41-8669-26342aff46b1 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3" status: 200 len: 1209 microversion: 2.1 time: 0.230030 Sep 16 12:57:55.512672 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1492/2900] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:55 2022] GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3 => generated 1209 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:55.523033 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-fbe1b742-1613-4ee0-8f33-32094aee7703 req-dac27917-97ce-4475-9c15-be5c006cb728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc79a200-5972-4bec-9322-503d99b7d85a", "name": "network-vif-plugged", "status": "completed", "tag": "c9811505-9290-4353-ad69-62b405cd0ded"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:57:55.568805 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-fbe1b742-1613-4ee0-8f33-32094aee7703 req-dac27917-97ce-4475-9c15-be5c006cb728 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:55.569799 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-fbe1b742-1613-4ee0-8f33-32094aee7703 req-dac27917-97ce-4475-9c15-be5c006cb728 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:55.574842 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-fbe1b742-1613-4ee0-8f33-32094aee7703 req-dac27917-97ce-4475-9c15-be5c006cb728 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:55.612793 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-fbe1b742-1613-4ee0-8f33-32094aee7703 req-dac27917-97ce-4475-9c15-be5c006cb728 service nova] Creating event network-vif-plugged:c9811505-9290-4353-ad69-62b405cd0ded for instance cc79a200-5972-4bec-9322-503d99b7d85a on n-h2-858094-4 Sep 16 12:57:55.627087 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-fbe1b742-1613-4ee0-8f33-32094aee7703 req-dac27917-97ce-4475-9c15-be5c006cb728 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110966 Sep 16 12:57:55.630664 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1493/2901] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:57:55.643143 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-307d86b5-67e2-4b5e-9f45-17416314c7ba req-f3fa5d66-ce6c-461a-a67f-955c7ca7002b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f30c650-f49a-419b-acfe-165d9886e897", "tag": "c26f96da-286f-479c-9e95-6d00e8c892e4"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:57:55.656181 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-307d86b5-67e2-4b5e-9f45-17416314c7ba req-f3fa5d66-ce6c-461a-a67f-955c7ca7002b service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:55.657476 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-307d86b5-67e2-4b5e-9f45-17416314c7ba req-f3fa5d66-ce6c-461a-a67f-955c7ca7002b service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:55.658220 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-307d86b5-67e2-4b5e-9f45-17416314c7ba req-f3fa5d66-ce6c-461a-a67f-955c7ca7002b service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:55.674420 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-307d86b5-67e2-4b5e-9f45-17416314c7ba req-f3fa5d66-ce6c-461a-a67f-955c7ca7002b service nova] Creating event network-changed:c26f96da-286f-479c-9e95-6d00e8c892e4 for instance 5f30c650-f49a-419b-acfe-165d9886e897 on n-h1-858094-4 Sep 16 12:57:55.685816 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-307d86b5-67e2-4b5e-9f45-17416314c7ba req-f3fa5d66-ce6c-461a-a67f-955c7ca7002b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051867 Sep 16 12:57:55.687095 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1494/2902] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:57:55.709744 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-82cdde0b-e862-4200-a4d8-93753e8c7268 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:55.712167 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-82cdde0b-e862-4200-a4d8-93753e8c7268 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:55.739808 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82cdde0b-e862-4200-a4d8-93753e8c7268 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:55.741447 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82cdde0b-e862-4200-a4d8-93753e8c7268 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:55.747082 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82cdde0b-e862-4200-a4d8-93753e8c7268 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:55.748199 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82cdde0b-e862-4200-a4d8-93753e8c7268 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:55.748841 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82cdde0b-e862-4200-a4d8-93753e8c7268 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:55.750143 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82cdde0b-e862-4200-a4d8-93753e8c7268 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:55.953478 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-240b2661-0a7c-4b19-bf8d-b942a96e746f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:55.963724 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-240b2661-0a7c-4b19-bf8d-b942a96e746f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec" status: 200 len: 1551 microversion: 2.1 time: 0.672829 Sep 16 12:57:55.980579 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1409/2903] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:55 2022] GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec => generated 1551 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:55.988392 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-67a92bc8-72ce-4d3c-a088-b726d9bbe4a9 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:55.989234 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-67a92bc8-72ce-4d3c-a088-b726d9bbe4a9 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 2998767f-d217-40ea-a487-60c0c4ade426] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:56.003099 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-67a92bc8-72ce-4d3c-a088-b726d9bbe4a9 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:56.003596 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-67a92bc8-72ce-4d3c-a088-b726d9bbe4a9 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:56.004036 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-67a92bc8-72ce-4d3c-a088-b726d9bbe4a9 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:56.004768 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-67a92bc8-72ce-4d3c-a088-b726d9bbe4a9 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:56.005401 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-67a92bc8-72ce-4d3c-a088-b726d9bbe4a9 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:56.005987 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-67a92bc8-72ce-4d3c-a088-b726d9bbe4a9 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:56.327227 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-82cdde0b-e862-4200-a4d8-93753e8c7268 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:56.337355 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-82cdde0b-e862-4200-a4d8-93753e8c7268 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:56.339133 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-82cdde0b-e862-4200-a4d8-93753e8c7268 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:56.340435 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-82cdde0b-e862-4200-a4d8-93753e8c7268 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1487 microversion: 2.25 time: 0.650689 Sep 16 12:57:56.341080 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1495/2904] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:55 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1487 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:57:56.347289 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-803821d5-c51d-4c9e-85a4-0efaddff642f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:56.347926 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-803821d5-c51d-4c9e-85a4-0efaddff642f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 272fddb0-eba2-4559-b76d-460bd65246ec] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:56.356394 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-803821d5-c51d-4c9e-85a4-0efaddff642f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:56.357332 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-803821d5-c51d-4c9e-85a4-0efaddff642f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:56.357968 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-803821d5-c51d-4c9e-85a4-0efaddff642f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:56.359432 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-803821d5-c51d-4c9e-85a4-0efaddff642f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:56.361041 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-803821d5-c51d-4c9e-85a4-0efaddff642f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:56.361520 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-803821d5-c51d-4c9e-85a4-0efaddff642f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:56.514237 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-67a92bc8-72ce-4d3c-a088-b726d9bbe4a9 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37316c1f04764255a2a9466676502c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e940a963f7740dea44034d06e8c2a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:56.522541 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-67a92bc8-72ce-4d3c-a088-b726d9bbe4a9 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "GET /compute/v2.1/servers/2998767f-d217-40ea-a487-60c0c4ade426" status: 200 len: 1318 microversion: 2.1 time: 0.540563 Sep 16 12:57:56.523132 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1410/2905] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:55 2022] GET /compute/v2.1/servers/2998767f-d217-40ea-a487-60c0c4ade426 => generated 1318 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:56.541219 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ad8c7f92-509f-46b5-b1e0-ffd29c13f8a2 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:56.542464 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ad8c7f92-509f-46b5-b1e0-ffd29c13f8a2 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: cc79a200-5972-4bec-9322-503d99b7d85a] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:56.546021 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-803821d5-c51d-4c9e-85a4-0efaddff642f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.203512 Sep 16 12:57:56.546958 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1496/2906] 10.222.0.67 () {58 vars in 1275 bytes} [Fri Sep 16 12:57:56 2022] GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec/os-interface => generated 285 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:57:56.550013 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ad8c7f92-509f-46b5-b1e0-ffd29c13f8a2 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:56.550883 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ad8c7f92-509f-46b5-b1e0-ffd29c13f8a2 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:56.551549 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ad8c7f92-509f-46b5-b1e0-ffd29c13f8a2 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:56.552377 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ad8c7f92-509f-46b5-b1e0-ffd29c13f8a2 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:56.552909 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ad8c7f92-509f-46b5-b1e0-ffd29c13f8a2 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:56.553423 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ad8c7f92-509f-46b5-b1e0-ffd29c13f8a2 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:56.558466 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-eea30950-5e62-42a5-a20f-6fd9baa5f9c6 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:56.559088 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-eea30950-5e62-42a5-a20f-6fd9baa5f9c6 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: 4f9dac6d-1e24-4618-b802-96fdd6306c30] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:56.570184 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eea30950-5e62-42a5-a20f-6fd9baa5f9c6 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:56.570799 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eea30950-5e62-42a5-a20f-6fd9baa5f9c6 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:56.571731 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eea30950-5e62-42a5-a20f-6fd9baa5f9c6 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:56.572545 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eea30950-5e62-42a5-a20f-6fd9baa5f9c6 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:56.572932 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eea30950-5e62-42a5-a20f-6fd9baa5f9c6 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:56.573356 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eea30950-5e62-42a5-a20f-6fd9baa5f9c6 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:57.071289 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ad8c7f92-509f-46b5-b1e0-ffd29c13f8a2 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:57.082038 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ad8c7f92-509f-46b5-b1e0-ffd29c13f8a2 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/cc79a200-5972-4bec-9322-503d99b7d85a" status: 200 len: 1313 microversion: 2.1 time: 0.556383 Sep 16 12:57:57.091611 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1411/2907] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:56 2022] GET /compute/v2.1/servers/cc79a200-5972-4bec-9322-503d99b7d85a => generated 1313 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:57.102861 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fee268af-da67-4413-8ffa-b3485d6afce2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:57.105809 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-fee268af-da67-4413-8ffa-b3485d6afce2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 536f2ffa-d5a1-4060-9ef1-f305cf164fd3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:57.120936 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fee268af-da67-4413-8ffa-b3485d6afce2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:57.123175 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fee268af-da67-4413-8ffa-b3485d6afce2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:57.126493 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fee268af-da67-4413-8ffa-b3485d6afce2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:57.127486 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fee268af-da67-4413-8ffa-b3485d6afce2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:57.128142 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fee268af-da67-4413-8ffa-b3485d6afce2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:57.132817 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fee268af-da67-4413-8ffa-b3485d6afce2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:57.336409 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-fee268af-da67-4413-8ffa-b3485d6afce2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:57.345001 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-eea30950-5e62-42a5-a20f-6fd9baa5f9c6 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ec543501c49daaa37af078622626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd30c33cb19d47278478aa2340859920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:57.355577 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-eea30950-5e62-42a5-a20f-6fd9baa5f9c6 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "GET /compute/v2.1/servers/4f9dac6d-1e24-4618-b802-96fdd6306c30" status: 200 len: 1318 microversion: 2.1 time: 0.807473 Sep 16 12:57:57.358482 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1497/2908] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:56 2022] GET /compute/v2.1/servers/4f9dac6d-1e24-4618-b802-96fdd6306c30 => generated 1318 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:57.370601 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-39186ff7-bb3d-435f-92c5-1359a89f7262 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:57.371478 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-39186ff7-bb3d-435f-92c5-1359a89f7262 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:57.377650 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-fee268af-da67-4413-8ffa-b3485d6afce2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3" status: 200 len: 1271 microversion: 2.1 time: 0.284532 Sep 16 12:57:57.385546 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1412/2909] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:57 2022] GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3 => generated 1271 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:57.404366 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39186ff7-bb3d-435f-92c5-1359a89f7262 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:57.409740 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39186ff7-bb3d-435f-92c5-1359a89f7262 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:57.411966 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39186ff7-bb3d-435f-92c5-1359a89f7262 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:57.415325 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39186ff7-bb3d-435f-92c5-1359a89f7262 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:57.417964 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39186ff7-bb3d-435f-92c5-1359a89f7262 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:57.420969 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39186ff7-bb3d-435f-92c5-1359a89f7262 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:57.554583 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-128a9ca4-3f97-4239-88db-bbbe73e1cfe4 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:57.558936 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-128a9ca4-3f97-4239-88db-bbbe73e1cfe4 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 2998767f-d217-40ea-a487-60c0c4ade426] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:57.578998 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-128a9ca4-3f97-4239-88db-bbbe73e1cfe4 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:57.579635 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-128a9ca4-3f97-4239-88db-bbbe73e1cfe4 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:57.586733 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-128a9ca4-3f97-4239-88db-bbbe73e1cfe4 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:57.587856 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-128a9ca4-3f97-4239-88db-bbbe73e1cfe4 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:57.593045 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-128a9ca4-3f97-4239-88db-bbbe73e1cfe4 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:57.595124 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-128a9ca4-3f97-4239-88db-bbbe73e1cfe4 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:57.888679 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=6 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:57:57.970217 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=14 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:57:58.074156 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-39186ff7-bb3d-435f-92c5-1359a89f7262 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:58.086875 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-39186ff7-bb3d-435f-92c5-1359a89f7262 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:58.109463 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-39186ff7-bb3d-435f-92c5-1359a89f7262 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:58.112707 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-128a9ca4-3f97-4239-88db-bbbe73e1cfe4 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37316c1f04764255a2a9466676502c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e940a963f7740dea44034d06e8c2a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:58.113558 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-39186ff7-bb3d-435f-92c5-1359a89f7262 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1487 microversion: 2.25 time: 0.749223 Sep 16 12:57:58.128386 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-128a9ca4-3f97-4239-88db-bbbe73e1cfe4 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "GET /compute/v2.1/servers/2998767f-d217-40ea-a487-60c0c4ade426" status: 200 len: 1318 microversion: 2.1 time: 0.577866 Sep 16 12:57:58.128386 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1413/2910] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:57 2022] GET /compute/v2.1/servers/2998767f-d217-40ea-a487-60c0c4ade426 => generated 1318 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:58.138374 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1498/2911] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:57 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1487 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:57:58.144875 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-5e043a7f-46e3-4bf4-a264-cf689a73200b req-b3c22f64-d45b-4e21-b7c7-d9de0c1f93df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f9dac6d-1e24-4618-b802-96fdd6306c30", "tag": "31028850-a929-4e17-a925-e55dedb937e0"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:57:58.177955 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-5e043a7f-46e3-4bf4-a264-cf689a73200b req-b3c22f64-d45b-4e21-b7c7-d9de0c1f93df service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:58.178584 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-5e043a7f-46e3-4bf4-a264-cf689a73200b req-b3c22f64-d45b-4e21-b7c7-d9de0c1f93df service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:58.179138 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-5e043a7f-46e3-4bf4-a264-cf689a73200b req-b3c22f64-d45b-4e21-b7c7-d9de0c1f93df service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:58.210417 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-5e043a7f-46e3-4bf4-a264-cf689a73200b req-b3c22f64-d45b-4e21-b7c7-d9de0c1f93df service nova] Creating event network-changed:31028850-a929-4e17-a925-e55dedb937e0 for instance 4f9dac6d-1e24-4618-b802-96fdd6306c30 on n-h1-858094-4 Sep 16 12:57:58.233110 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-5e043a7f-46e3-4bf4-a264-cf689a73200b req-b3c22f64-d45b-4e21-b7c7-d9de0c1f93df service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102065 Sep 16 12:57:58.235059 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1414/2912] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:57:58.250106 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-86aa6102-e3ae-405f-b14e-1e47321d10bd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:58.251195 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-86aa6102-e3ae-405f-b14e-1e47321d10bd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: cc79a200-5972-4bec-9322-503d99b7d85a] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:58.258840 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:57:58.261500 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-86aa6102-e3ae-405f-b14e-1e47321d10bd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:58.262751 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-86aa6102-e3ae-405f-b14e-1e47321d10bd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:58.264377 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-86aa6102-e3ae-405f-b14e-1e47321d10bd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:58.266297 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-86aa6102-e3ae-405f-b14e-1e47321d10bd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:58.267175 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-86aa6102-e3ae-405f-b14e-1e47321d10bd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:58.267765 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-86aa6102-e3ae-405f-b14e-1e47321d10bd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:58.572250 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-33c5f60a-6b03-4a58-9f98-2ed9a3561a19 tempest-ListImagesTestJSON-532700099 tempest-ListImagesTestJSON-532700099-project] Calling method '.version_select at 0x7f1034bacdc0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:58.629836 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-33c5f60a-6b03-4a58-9f98-2ed9a3561a19 tempest-ListImagesTestJSON-532700099 tempest-ListImagesTestJSON-532700099-project] 10.222.0.67 "GET /compute/v2.1/images/7df4548b-8809-4742-80bd-4e4e6dcafc91" status: 200 len: 784 microversion: 2.1 time: 0.488338 Sep 16 12:57:58.630638 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1499/2913] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 12:57:58 2022] GET /compute/v2.1/images/7df4548b-8809-4742-80bd-4e4e6dcafc91 => generated 784 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:57:58.635618 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c7368fa6-43a1-4466-bb98-9e13a4eb75b7 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:58.640852 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c7368fa6-43a1-4466-bb98-9e13a4eb75b7 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: 4f9dac6d-1e24-4618-b802-96fdd6306c30] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:58.648915 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c7368fa6-43a1-4466-bb98-9e13a4eb75b7 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:58.649600 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c7368fa6-43a1-4466-bb98-9e13a4eb75b7 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:58.650238 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c7368fa6-43a1-4466-bb98-9e13a4eb75b7 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:58.651191 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c7368fa6-43a1-4466-bb98-9e13a4eb75b7 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:58.651820 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c7368fa6-43a1-4466-bb98-9e13a4eb75b7 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:58.652285 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c7368fa6-43a1-4466-bb98-9e13a4eb75b7 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:59.207927 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-86aa6102-e3ae-405f-b14e-1e47321d10bd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:59.217455 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-86aa6102-e3ae-405f-b14e-1e47321d10bd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/cc79a200-5972-4bec-9322-503d99b7d85a" status: 200 len: 1500 microversion: 2.1 time: 0.980078 Sep 16 12:57:59.229058 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1415/2914] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:58 2022] GET /compute/v2.1/servers/cc79a200-5972-4bec-9322-503d99b7d85a => generated 1500 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:59.238870 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fc361050-af4b-4000-adec-fa855d0a78cc tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:59.239730 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-fc361050-af4b-4000-adec-fa855d0a78cc tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 536f2ffa-d5a1-4060-9ef1-f305cf164fd3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:59.267332 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fc361050-af4b-4000-adec-fa855d0a78cc tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:59.268283 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fc361050-af4b-4000-adec-fa855d0a78cc tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:59.269175 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fc361050-af4b-4000-adec-fa855d0a78cc tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:59.270088 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fc361050-af4b-4000-adec-fa855d0a78cc tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:59.270706 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fc361050-af4b-4000-adec-fa855d0a78cc tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:59.272463 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fc361050-af4b-4000-adec-fa855d0a78cc tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:59.324948 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=100 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:57:59.435247 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c7368fa6-43a1-4466-bb98-9e13a4eb75b7 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ec543501c49daaa37af078622626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd30c33cb19d47278478aa2340859920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:59.454143 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c7368fa6-43a1-4466-bb98-9e13a4eb75b7 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "GET /compute/v2.1/servers/4f9dac6d-1e24-4618-b802-96fdd6306c30" status: 200 len: 1318 microversion: 2.1 time: 0.820662 Sep 16 12:57:59.469715 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1500/2915] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:58 2022] GET /compute/v2.1/servers/4f9dac6d-1e24-4618-b802-96fdd6306c30 => generated 1318 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:59.475352 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-53d99923-0cae-45c2-a926-296e67e1090b tempest-ListImagesTestJSON-532700099 tempest-ListImagesTestJSON-532700099-project] Calling method '.version_select at 0x7f1034ba4550>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:59.535043 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-53d99923-0cae-45c2-a926-296e67e1090b tempest-ListImagesTestJSON-532700099 tempest-ListImagesTestJSON-532700099-project] 10.222.0.67 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.063279 Sep 16 12:57:59.535655 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1501/2916] 10.222.0.67 () {58 vars in 1122 bytes} [Fri Sep 16 12:57:59 2022] GET /compute/v2.1/images => generated 445 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:57:59.552236 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4654d5e3-610a-4f8b-866b-2b6098304f1c tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:59.553789 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4654d5e3-610a-4f8b-866b-2b6098304f1c tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:59.573384 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4654d5e3-610a-4f8b-866b-2b6098304f1c tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:59.574344 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4654d5e3-610a-4f8b-866b-2b6098304f1c tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:59.575036 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4654d5e3-610a-4f8b-866b-2b6098304f1c tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:59.575853 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4654d5e3-610a-4f8b-866b-2b6098304f1c tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:59.576409 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4654d5e3-610a-4f8b-866b-2b6098304f1c tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:59.576969 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4654d5e3-610a-4f8b-866b-2b6098304f1c tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:59.606788 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:57:59.720795 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-fc361050-af4b-4000-adec-fa855d0a78cc tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:59.734971 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-fc361050-af4b-4000-adec-fa855d0a78cc tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3" status: 200 len: 1334 microversion: 2.1 time: 0.504450 Sep 16 12:57:59.736425 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1416/2917] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:59 2022] GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3 => generated 1334 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:57:59.742756 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-23308de9-e9d9-4031-9094-d27e4712a1a0 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:59.743704 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-23308de9-e9d9-4031-9094-d27e4712a1a0 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 2998767f-d217-40ea-a487-60c0c4ade426] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:59.753786 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-23308de9-e9d9-4031-9094-d27e4712a1a0 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:59.756332 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-23308de9-e9d9-4031-9094-d27e4712a1a0 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:59.757094 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-23308de9-e9d9-4031-9094-d27e4712a1a0 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:59.758507 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-23308de9-e9d9-4031-9094-d27e4712a1a0 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:59.759965 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-23308de9-e9d9-4031-9094-d27e4712a1a0 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:59.761545 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-23308de9-e9d9-4031-9094-d27e4712a1a0 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:59.889667 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4654d5e3-610a-4f8b-866b-2b6098304f1c tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:59.900898 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4654d5e3-610a-4f8b-866b-2b6098304f1c tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:59.902786 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4654d5e3-610a-4f8b-866b-2b6098304f1c tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:57:59.904338 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4654d5e3-610a-4f8b-866b-2b6098304f1c tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1487 microversion: 2.25 time: 0.367330 Sep 16 12:57:59.916931 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1502/2918] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:57:59 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1487 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:57:59.929619 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7d8f8acb-ee24-46e0-867d-52ca137f6c1b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:57:59.930379 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7d8f8acb-ee24-46e0-867d-52ca137f6c1b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: cc79a200-5972-4bec-9322-503d99b7d85a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:57:59.937194 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d8f8acb-ee24-46e0-867d-52ca137f6c1b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:59.937992 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d8f8acb-ee24-46e0-867d-52ca137f6c1b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:59.938590 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d8f8acb-ee24-46e0-867d-52ca137f6c1b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:59.939480 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d8f8acb-ee24-46e0-867d-52ca137f6c1b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:57:59.940100 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d8f8acb-ee24-46e0-867d-52ca137f6c1b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:57:59.940713 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d8f8acb-ee24-46e0-867d-52ca137f6c1b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:57:59.980325 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7d8f8acb-ee24-46e0-867d-52ca137f6c1b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: cc79a200-5972-4bec-9322-503d99b7d85a] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:58:00.081617 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7d8f8acb-ee24-46e0-867d-52ca137f6c1b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "DELETE /compute/v2.1/servers/cc79a200-5972-4bec-9322-503d99b7d85a" status: 204 len: 0 microversion: 2.1 time: 0.162421 Sep 16 12:58:00.084999 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1503/2919] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:57:59 2022] DELETE /compute/v2.1/servers/cc79a200-5972-4bec-9322-503d99b7d85a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:58:00.093084 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6912f0a8-9d1f-4950-a513-0f7f8a42dd18 tempest-ListImagesTestJSON-532700099 tempest-ListImagesTestJSON-532700099-project] Calling method '.version_select at 0x7f1036072a60>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:00.098399 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-23308de9-e9d9-4031-9094-d27e4712a1a0 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37316c1f04764255a2a9466676502c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e940a963f7740dea44034d06e8c2a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:00.108298 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-23308de9-e9d9-4031-9094-d27e4712a1a0 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "GET /compute/v2.1/servers/2998767f-d217-40ea-a487-60c0c4ade426" status: 200 len: 1318 microversion: 2.1 time: 0.370521 Sep 16 12:58:00.108910 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1417/2920] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:57:59 2022] GET /compute/v2.1/servers/2998767f-d217-40ea-a487-60c0c4ade426 => generated 1318 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:00.132168 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-956ff4ed-4842-4af4-b5ae-90cf5dea5f7c req-ae644142-51cd-4ec7-9824-89dcd7a83ea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2998767f-d217-40ea-a487-60c0c4ade426", "name": "network-vif-plugged", "status": "completed", "tag": "5cef43f7-b56b-46c5-a6b2-06877f434cd6"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:58:00.185379 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6912f0a8-9d1f-4950-a513-0f7f8a42dd18 tempest-ListImagesTestJSON-532700099 tempest-ListImagesTestJSON-532700099-project] 10.222.0.67 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.098081 Sep 16 12:58:00.187535 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1504/2921] 10.222.0.67 () {58 vars in 1143 bytes} [Fri Sep 16 12:58:00 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:58:00.194294 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-956ff4ed-4842-4af4-b5ae-90cf5dea5f7c req-ae644142-51cd-4ec7-9824-89dcd7a83ea3 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:00.196639 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-956ff4ed-4842-4af4-b5ae-90cf5dea5f7c req-ae644142-51cd-4ec7-9824-89dcd7a83ea3 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:00.198001 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-956ff4ed-4842-4af4-b5ae-90cf5dea5f7c req-ae644142-51cd-4ec7-9824-89dcd7a83ea3 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:00.211908 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b13c1f38-7504-4c94-96fe-6c3929373c81 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:00.217125 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b13c1f38-7504-4c94-96fe-6c3929373c81 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: cc79a200-5972-4bec-9322-503d99b7d85a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:00.235384 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-956ff4ed-4842-4af4-b5ae-90cf5dea5f7c req-ae644142-51cd-4ec7-9824-89dcd7a83ea3 service nova] Creating event network-vif-plugged:5cef43f7-b56b-46c5-a6b2-06877f434cd6 for instance 2998767f-d217-40ea-a487-60c0c4ade426 on n-h2-858094-4 Sep 16 12:58:00.239664 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b13c1f38-7504-4c94-96fe-6c3929373c81 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:00.244199 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b13c1f38-7504-4c94-96fe-6c3929373c81 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:00.244703 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b13c1f38-7504-4c94-96fe-6c3929373c81 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:00.245460 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b13c1f38-7504-4c94-96fe-6c3929373c81 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:00.245933 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b13c1f38-7504-4c94-96fe-6c3929373c81 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:00.246361 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b13c1f38-7504-4c94-96fe-6c3929373c81 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:00.254312 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-956ff4ed-4842-4af4-b5ae-90cf5dea5f7c req-ae644142-51cd-4ec7-9824-89dcd7a83ea3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144146 Sep 16 12:58:00.257518 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1418/2922] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:58:00.318779 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-d62022cf-1854-4927-9133-c176cf7e7466 req-497cc984-eb66-4b74-883c-9687ad88243b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "272fddb0-eba2-4559-b76d-460bd65246ec", "tag": "137f7ed1-df61-44ac-b25d-fb1d5a0609d4"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:58:00.330164 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-d62022cf-1854-4927-9133-c176cf7e7466 req-497cc984-eb66-4b74-883c-9687ad88243b service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:00.330936 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-d62022cf-1854-4927-9133-c176cf7e7466 req-497cc984-eb66-4b74-883c-9687ad88243b service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:00.331535 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-d62022cf-1854-4927-9133-c176cf7e7466 req-497cc984-eb66-4b74-883c-9687ad88243b service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:00.346715 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-d62022cf-1854-4927-9133-c176cf7e7466 req-497cc984-eb66-4b74-883c-9687ad88243b service nova] Creating event network-changed:137f7ed1-df61-44ac-b25d-fb1d5a0609d4 for instance 272fddb0-eba2-4559-b76d-460bd65246ec on n-h2-858094-4 Sep 16 12:58:00.354489 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-d62022cf-1854-4927-9133-c176cf7e7466 req-497cc984-eb66-4b74-883c-9687ad88243b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040502 Sep 16 12:58:00.355946 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1419/2923] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:58:00.484835 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b13c1f38-7504-4c94-96fe-6c3929373c81 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:00.494332 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b13c1f38-7504-4c94-96fe-6c3929373c81 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/cc79a200-5972-4bec-9322-503d99b7d85a" status: 200 len: 1506 microversion: 2.1 time: 0.304770 Sep 16 12:58:00.495200 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1505/2924] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:00 2022] GET /compute/v2.1/servers/cc79a200-5972-4bec-9322-503d99b7d85a => generated 1506 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:00.511889 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-82ebfde5-44a5-4c3e-83ec-84aa7259f517 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:00.511889 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-82ebfde5-44a5-4c3e-83ec-84aa7259f517 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: 4f9dac6d-1e24-4618-b802-96fdd6306c30] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:00.511889 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-82ebfde5-44a5-4c3e-83ec-84aa7259f517 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:00.511889 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-82ebfde5-44a5-4c3e-83ec-84aa7259f517 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:00.511889 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-82ebfde5-44a5-4c3e-83ec-84aa7259f517 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:00.528452 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-82ebfde5-44a5-4c3e-83ec-84aa7259f517 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:00.531166 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-82ebfde5-44a5-4c3e-83ec-84aa7259f517 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:00.532355 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-82ebfde5-44a5-4c3e-83ec-84aa7259f517 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:00.736979 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-82ebfde5-44a5-4c3e-83ec-84aa7259f517 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ec543501c49daaa37af078622626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd30c33cb19d47278478aa2340859920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:00.759056 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-852840b7-8101-4e6e-bac8-f04c2c533e34 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:00.760861 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-852840b7-8101-4e6e-bac8-f04c2c533e34 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 536f2ffa-d5a1-4060-9ef1-f305cf164fd3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:00.761419 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-82ebfde5-44a5-4c3e-83ec-84aa7259f517 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "GET /compute/v2.1/servers/4f9dac6d-1e24-4618-b802-96fdd6306c30" status: 200 len: 1318 microversion: 2.1 time: 0.270380 Sep 16 12:58:00.762295 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1420/2925] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:00 2022] GET /compute/v2.1/servers/4f9dac6d-1e24-4618-b802-96fdd6306c30 => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:00.772216 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-852840b7-8101-4e6e-bac8-f04c2c533e34 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:00.772941 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-852840b7-8101-4e6e-bac8-f04c2c533e34 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:00.777206 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-852840b7-8101-4e6e-bac8-f04c2c533e34 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:00.778359 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-852840b7-8101-4e6e-bac8-f04c2c533e34 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:00.778995 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-852840b7-8101-4e6e-bac8-f04c2c533e34 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:00.781172 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-852840b7-8101-4e6e-bac8-f04c2c533e34 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:00.934605 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b735f921-cfc4-4b39-bbc3-1424a67ece62 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:00.935443 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b735f921-cfc4-4b39-bbc3-1424a67ece62 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:00.946942 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b735f921-cfc4-4b39-bbc3-1424a67ece62 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:00.949454 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b735f921-cfc4-4b39-bbc3-1424a67ece62 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:00.951226 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b735f921-cfc4-4b39-bbc3-1424a67ece62 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:00.953893 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b735f921-cfc4-4b39-bbc3-1424a67ece62 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:00.955790 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b735f921-cfc4-4b39-bbc3-1424a67ece62 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:00.956469 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b735f921-cfc4-4b39-bbc3-1424a67ece62 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:01.177382 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-852840b7-8101-4e6e-bac8-f04c2c533e34 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:01.185723 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-852840b7-8101-4e6e-bac8-f04c2c533e34 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3" status: 200 len: 1355 microversion: 2.1 time: 0.430840 Sep 16 12:58:01.190129 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1506/2926] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:00 2022] GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3 => generated 1355 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:01.199056 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cb579946-0372-49d9-a049-aec66f4d4199 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:01.210953 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cb579946-0372-49d9-a049-aec66f4d4199 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 2998767f-d217-40ea-a487-60c0c4ade426] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:01.219395 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb579946-0372-49d9-a049-aec66f4d4199 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:01.220443 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb579946-0372-49d9-a049-aec66f4d4199 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:01.221086 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb579946-0372-49d9-a049-aec66f4d4199 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:01.222138 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb579946-0372-49d9-a049-aec66f4d4199 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:01.222959 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb579946-0372-49d9-a049-aec66f4d4199 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:01.223650 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb579946-0372-49d9-a049-aec66f4d4199 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:01.366429 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-b735f921-cfc4-4b39-bbc3-1424a67ece62 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:01.385907 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-b735f921-cfc4-4b39-bbc3-1424a67ece62 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:01.387247 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-b735f921-cfc4-4b39-bbc3-1424a67ece62 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:01.396085 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b735f921-cfc4-4b39-bbc3-1424a67ece62 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1487 microversion: 2.25 time: 0.466538 Sep 16 12:58:01.397524 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1421/2927] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:00 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1487 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:58:01.535439 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-23a7b1f4-d375-4258-afc7-4e34e7fd2000 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:01.536529 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-23a7b1f4-d375-4258-afc7-4e34e7fd2000 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: cc79a200-5972-4bec-9322-503d99b7d85a] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:01.555659 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-23a7b1f4-d375-4258-afc7-4e34e7fd2000 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:01.557844 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-23a7b1f4-d375-4258-afc7-4e34e7fd2000 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:01.562775 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-23a7b1f4-d375-4258-afc7-4e34e7fd2000 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:01.563849 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-23a7b1f4-d375-4258-afc7-4e34e7fd2000 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:01.567689 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-23a7b1f4-d375-4258-afc7-4e34e7fd2000 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:01.573125 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-23a7b1f4-d375-4258-afc7-4e34e7fd2000 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:01.614037 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cb579946-0372-49d9-a049-aec66f4d4199 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37316c1f04764255a2a9466676502c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e940a963f7740dea44034d06e8c2a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:01.627184 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cb579946-0372-49d9-a049-aec66f4d4199 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "GET /compute/v2.1/servers/2998767f-d217-40ea-a487-60c0c4ade426" status: 200 len: 1318 microversion: 2.1 time: 0.435515 Sep 16 12:58:01.628058 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1507/2928] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:01 2022] GET /compute/v2.1/servers/2998767f-d217-40ea-a487-60c0c4ade426 => generated 1318 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:01.790909 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ca8291f2-f150-47e3-b9b1-1ed8ffbc538a tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:01.791537 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ca8291f2-f150-47e3-b9b1-1ed8ffbc538a tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: 4f9dac6d-1e24-4618-b802-96fdd6306c30] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:01.799728 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca8291f2-f150-47e3-b9b1-1ed8ffbc538a tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:01.800348 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca8291f2-f150-47e3-b9b1-1ed8ffbc538a tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:01.800791 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca8291f2-f150-47e3-b9b1-1ed8ffbc538a tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:01.801510 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca8291f2-f150-47e3-b9b1-1ed8ffbc538a tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:01.801987 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca8291f2-f150-47e3-b9b1-1ed8ffbc538a tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:01.802401 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca8291f2-f150-47e3-b9b1-1ed8ffbc538a tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:02.376233 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-23a7b1f4-d375-4258-afc7-4e34e7fd2000 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:02.387650 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-23a7b1f4-d375-4258-afc7-4e34e7fd2000 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/cc79a200-5972-4bec-9322-503d99b7d85a" status: 200 len: 1506 microversion: 2.1 time: 0.867831 Sep 16 12:58:02.388984 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1422/2929] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:01 2022] GET /compute/v2.1/servers/cc79a200-5972-4bec-9322-503d99b7d85a => generated 1506 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:02.409518 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0f3128d0-434c-4e65-be59-9b2f0a731882 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:02.410537 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0f3128d0-434c-4e65-be59-9b2f0a731882 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 536f2ffa-d5a1-4060-9ef1-f305cf164fd3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:02.418024 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0f3128d0-434c-4e65-be59-9b2f0a731882 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:02.418759 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0f3128d0-434c-4e65-be59-9b2f0a731882 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:02.419411 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0f3128d0-434c-4e65-be59-9b2f0a731882 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:02.420134 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0f3128d0-434c-4e65-be59-9b2f0a731882 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:02.420775 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0f3128d0-434c-4e65-be59-9b2f0a731882 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:02.421205 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0f3128d0-434c-4e65-be59-9b2f0a731882 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:02.449997 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ca8291f2-f150-47e3-b9b1-1ed8ffbc538a tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ec543501c49daaa37af078622626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd30c33cb19d47278478aa2340859920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:02.459828 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ca8291f2-f150-47e3-b9b1-1ed8ffbc538a tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "GET /compute/v2.1/servers/4f9dac6d-1e24-4618-b802-96fdd6306c30" status: 200 len: 1318 microversion: 2.1 time: 0.674612 Sep 16 12:58:02.462554 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1508/2930] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:01 2022] GET /compute/v2.1/servers/4f9dac6d-1e24-4618-b802-96fdd6306c30 => generated 1318 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:58:02.469650 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-8acb1f10-1067-4949-af22-f29afcf2b015 req-1c2af336-bba5-4ff1-9539-b29bee3fe826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f30c650-f49a-419b-acfe-165d9886e897", "name": "network-vif-plugged", "status": "completed", "tag": "c26f96da-286f-479c-9e95-6d00e8c892e4"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:58:02.488380 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8acb1f10-1067-4949-af22-f29afcf2b015 req-1c2af336-bba5-4ff1-9539-b29bee3fe826 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:02.488380 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8acb1f10-1067-4949-af22-f29afcf2b015 req-1c2af336-bba5-4ff1-9539-b29bee3fe826 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:02.488380 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8acb1f10-1067-4949-af22-f29afcf2b015 req-1c2af336-bba5-4ff1-9539-b29bee3fe826 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:02.510263 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-8acb1f10-1067-4949-af22-f29afcf2b015 req-1c2af336-bba5-4ff1-9539-b29bee3fe826 service nova] Creating event network-vif-plugged:c26f96da-286f-479c-9e95-6d00e8c892e4 for instance 5f30c650-f49a-419b-acfe-165d9886e897 on n-h1-858094-4 Sep 16 12:58:02.516862 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-8acb1f10-1067-4949-af22-f29afcf2b015 req-1c2af336-bba5-4ff1-9539-b29bee3fe826 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052391 Sep 16 12:58:02.518306 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1509/2931] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:58:02.528230 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-a20bcf37-5df8-4e5f-862a-39f70de14ad1 req-7aca74fc-d31c-48bb-9d09-15c8dba7b1de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b229371-5f66-466c-a96b-2f668a855aa0", "name": "network-vif-unplugged", "status": "completed", "tag": "ad0051b5-79e3-4c40-9a1d-6ef2e5b301e7"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:58:02.540753 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a20bcf37-5df8-4e5f-862a-39f70de14ad1 req-7aca74fc-d31c-48bb-9d09-15c8dba7b1de service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:02.541522 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a20bcf37-5df8-4e5f-862a-39f70de14ad1 req-7aca74fc-d31c-48bb-9d09-15c8dba7b1de service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:02.542117 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a20bcf37-5df8-4e5f-862a-39f70de14ad1 req-7aca74fc-d31c-48bb-9d09-15c8dba7b1de service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:02.558306 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-a20bcf37-5df8-4e5f-862a-39f70de14ad1 req-7aca74fc-d31c-48bb-9d09-15c8dba7b1de service nova] Creating event network-vif-unplugged:ad0051b5-79e3-4c40-9a1d-6ef2e5b301e7 for instance 3b229371-5f66-466c-a96b-2f668a855aa0 on n-h1-858094-4 Sep 16 12:58:02.566763 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-a20bcf37-5df8-4e5f-862a-39f70de14ad1 req-7aca74fc-d31c-48bb-9d09-15c8dba7b1de service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045131 Sep 16 12:58:02.570194 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1510/2932] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:58:02.576545 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2b464a3e-5120-401c-94da-c6ed8704125d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:02.577626 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2b464a3e-5120-401c-94da-c6ed8704125d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:02.589358 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b464a3e-5120-401c-94da-c6ed8704125d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:02.590436 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b464a3e-5120-401c-94da-c6ed8704125d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:02.591711 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b464a3e-5120-401c-94da-c6ed8704125d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:02.593337 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b464a3e-5120-401c-94da-c6ed8704125d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:02.594468 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b464a3e-5120-401c-94da-c6ed8704125d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:02.595356 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b464a3e-5120-401c-94da-c6ed8704125d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:03.374722 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0f3128d0-434c-4e65-be59-9b2f0a731882 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:03.397873 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0f3128d0-434c-4e65-be59-9b2f0a731882 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3" status: 200 len: 1355 microversion: 2.1 time: 0.992422 Sep 16 12:58:03.398864 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1423/2933] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:02 2022] GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3 => generated 1355 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:03.416791 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f2e00b49-055c-4147-90cb-d492426413f1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:03.417732 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f2e00b49-055c-4147-90cb-d492426413f1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 2998767f-d217-40ea-a487-60c0c4ade426] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:03.433450 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f2e00b49-055c-4147-90cb-d492426413f1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:03.433972 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f2e00b49-055c-4147-90cb-d492426413f1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:03.434419 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f2e00b49-055c-4147-90cb-d492426413f1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:03.435271 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f2e00b49-055c-4147-90cb-d492426413f1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:03.435901 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f2e00b49-055c-4147-90cb-d492426413f1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:03.436612 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f2e00b49-055c-4147-90cb-d492426413f1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:03.512420 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:58:03.551070 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:58:04.056562 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2b464a3e-5120-401c-94da-c6ed8704125d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:04.088490 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2b464a3e-5120-401c-94da-c6ed8704125d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:04.089964 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2b464a3e-5120-401c-94da-c6ed8704125d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:04.101065 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2b464a3e-5120-401c-94da-c6ed8704125d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1487 microversion: 2.25 time: 1.525984 Sep 16 12:58:04.102661 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1511/2934] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:02 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1487 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:58:04.115494 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ef5322b2-d77f-4ef1-a6fa-c52f33e96621 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:04.119918 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ef5322b2-d77f-4ef1-a6fa-c52f33e96621 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: cc79a200-5972-4bec-9322-503d99b7d85a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:04.136025 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef5322b2-d77f-4ef1-a6fa-c52f33e96621 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:04.136567 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef5322b2-d77f-4ef1-a6fa-c52f33e96621 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:04.137017 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef5322b2-d77f-4ef1-a6fa-c52f33e96621 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:04.144502 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef5322b2-d77f-4ef1-a6fa-c52f33e96621 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:04.145257 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef5322b2-d77f-4ef1-a6fa-c52f33e96621 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:04.145720 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef5322b2-d77f-4ef1-a6fa-c52f33e96621 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:04.553894 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ef5322b2-d77f-4ef1-a6fa-c52f33e96621 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:04.575589 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ef5322b2-d77f-4ef1-a6fa-c52f33e96621 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/cc79a200-5972-4bec-9322-503d99b7d85a" status: 200 len: 1464 microversion: 2.1 time: 0.470851 Sep 16 12:58:04.593365 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f2e00b49-055c-4147-90cb-d492426413f1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37316c1f04764255a2a9466676502c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e940a963f7740dea44034d06e8c2a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:04.601008 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f2e00b49-055c-4147-90cb-d492426413f1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "GET /compute/v2.1/servers/2998767f-d217-40ea-a487-60c0c4ade426" status: 200 len: 1507 microversion: 2.1 time: 1.199740 Sep 16 12:58:04.601222 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1512/2935] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:04 2022] GET /compute/v2.1/servers/cc79a200-5972-4bec-9322-503d99b7d85a => generated 1464 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:04.602210 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1424/2936] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:03 2022] GET /compute/v2.1/servers/2998767f-d217-40ea-a487-60c0c4ade426 => generated 1507 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:04.610410 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-010cd3e3-f4d3-4cd4-9909-c0282bf95076 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:04.611040 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-010cd3e3-f4d3-4cd4-9909-c0282bf95076 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 536f2ffa-d5a1-4060-9ef1-f305cf164fd3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:04.614846 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4a125acd-af4c-4240-8e79-a2ad4082b569 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:04.616372 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4a125acd-af4c-4240-8e79-a2ad4082b569 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: 4f9dac6d-1e24-4618-b802-96fdd6306c30] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:04.636532 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-010cd3e3-f4d3-4cd4-9909-c0282bf95076 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:04.637271 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-010cd3e3-f4d3-4cd4-9909-c0282bf95076 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:04.638201 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a125acd-af4c-4240-8e79-a2ad4082b569 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:04.638469 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-010cd3e3-f4d3-4cd4-9909-c0282bf95076 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:04.638714 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a125acd-af4c-4240-8e79-a2ad4082b569 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:04.639420 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a125acd-af4c-4240-8e79-a2ad4082b569 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:04.640362 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-010cd3e3-f4d3-4cd4-9909-c0282bf95076 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:04.640745 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a125acd-af4c-4240-8e79-a2ad4082b569 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:04.641224 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a125acd-af4c-4240-8e79-a2ad4082b569 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:04.641706 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a125acd-af4c-4240-8e79-a2ad4082b569 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:04.641856 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-010cd3e3-f4d3-4cd4-9909-c0282bf95076 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:04.642259 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-010cd3e3-f4d3-4cd4-9909-c0282bf95076 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:04.969144 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-010cd3e3-f4d3-4cd4-9909-c0282bf95076 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:04.978724 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-010cd3e3-f4d3-4cd4-9909-c0282bf95076 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3" status: 200 len: 1355 microversion: 2.1 time: 0.375170 Sep 16 12:58:04.985127 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1425/2937] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:04 2022] GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3 => generated 1355 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:04.993369 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-98f86df2-2caa-44f4-88a5-a18aeba5760e req-b20cd1cb-3a3c-4282-a8af-a8b584b207c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc79a200-5972-4bec-9322-503d99b7d85a", "name": "network-vif-deleted", "tag": "c9811505-9290-4353-ad69-62b405cd0ded"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:58:05.014432 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-98f86df2-2caa-44f4-88a5-a18aeba5760e req-b20cd1cb-3a3c-4282-a8af-a8b584b207c9 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:05.033187 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-98f86df2-2caa-44f4-88a5-a18aeba5760e req-b20cd1cb-3a3c-4282-a8af-a8b584b207c9 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:05.035842 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-98f86df2-2caa-44f4-88a5-a18aeba5760e req-b20cd1cb-3a3c-4282-a8af-a8b584b207c9 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:05.087327 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4a125acd-af4c-4240-8e79-a2ad4082b569 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ec543501c49daaa37af078622626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd30c33cb19d47278478aa2340859920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:05.090104 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-98f86df2-2caa-44f4-88a5-a18aeba5760e req-b20cd1cb-3a3c-4282-a8af-a8b584b207c9 service nova] Creating event network-vif-deleted:c9811505-9290-4353-ad69-62b405cd0ded for instance cc79a200-5972-4bec-9322-503d99b7d85a on n-h2-858094-4 Sep 16 12:58:05.096144 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4a125acd-af4c-4240-8e79-a2ad4082b569 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "GET /compute/v2.1/servers/4f9dac6d-1e24-4618-b802-96fdd6306c30" status: 200 len: 1318 microversion: 2.1 time: 0.489806 Sep 16 12:58:05.102895 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1513/2938] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:04 2022] GET /compute/v2.1/servers/4f9dac6d-1e24-4618-b802-96fdd6306c30 => generated 1318 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:05.124460 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-98f86df2-2caa-44f4-88a5-a18aeba5760e req-b20cd1cb-3a3c-4282-a8af-a8b584b207c9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137169 Sep 16 12:58:05.127054 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1426/2939] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:58:05.166392 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-3f1f10a3-b702-4a18-8602-7d50b732a7c0 req-56dc0caf-36b4-44dc-83b7-5238af69a534 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b229371-5f66-466c-a96b-2f668a855aa0", "tag": "ad0051b5-79e3-4c40-9a1d-6ef2e5b301e7"}, {"name": "network-changed", "server_uuid": "536f2ffa-d5a1-4060-9ef1-f305cf164fd3", "tag": "7d29c55a-fbb0-4e50-9719-1dcce2aaef81"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:58:05.201678 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-3f1f10a3-b702-4a18-8602-7d50b732a7c0 req-56dc0caf-36b4-44dc-83b7-5238af69a534 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:05.203447 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-3f1f10a3-b702-4a18-8602-7d50b732a7c0 req-56dc0caf-36b4-44dc-83b7-5238af69a534 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:05.205004 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-3f1f10a3-b702-4a18-8602-7d50b732a7c0 req-56dc0caf-36b4-44dc-83b7-5238af69a534 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:05.247488 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-3f1f10a3-b702-4a18-8602-7d50b732a7c0 req-56dc0caf-36b4-44dc-83b7-5238af69a534 service nova] Creating event network-changed:ad0051b5-79e3-4c40-9a1d-6ef2e5b301e7 for instance 3b229371-5f66-466c-a96b-2f668a855aa0 on n-h1-858094-4 Sep 16 12:58:05.248023 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-3f1f10a3-b702-4a18-8602-7d50b732a7c0 req-56dc0caf-36b4-44dc-83b7-5238af69a534 service nova] Creating event network-changed:7d29c55a-fbb0-4e50-9719-1dcce2aaef81 for instance 536f2ffa-d5a1-4060-9ef1-f305cf164fd3 on n-h2-858094-4 Sep 16 12:58:05.280638 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-3f1f10a3-b702-4a18-8602-7d50b732a7c0 req-56dc0caf-36b4-44dc-83b7-5238af69a534 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.149754 Sep 16 12:58:05.292426 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1427/2940] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:58:05.303393 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5b2d9440-29c9-4ab1-800f-b877293c4184 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:05.310982 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5b2d9440-29c9-4ab1-800f-b877293c4184 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:05.334018 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5b2d9440-29c9-4ab1-800f-b877293c4184 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:05.334570 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5b2d9440-29c9-4ab1-800f-b877293c4184 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:05.335676 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5b2d9440-29c9-4ab1-800f-b877293c4184 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:05.338771 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5b2d9440-29c9-4ab1-800f-b877293c4184 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:05.339353 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5b2d9440-29c9-4ab1-800f-b877293c4184 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:05.339874 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5b2d9440-29c9-4ab1-800f-b877293c4184 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:05.583269 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-022d1e20-8ec6-4b77-86c3-8cf9dc510310 tempest-AbsoluteLimitsNegativeTestJSON-86386264 tempest-AbsoluteLimitsNegativeTestJSON-86386264-project] Calling method '.version_select at 0x7f1034c12430>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:05.623447 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-022d1e20-8ec6-4b77-86c3-8cf9dc510310 tempest-AbsoluteLimitsNegativeTestJSON-86386264 tempest-AbsoluteLimitsNegativeTestJSON-86386264-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:05.623986 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-022d1e20-8ec6-4b77-86c3-8cf9dc510310 tempest-AbsoluteLimitsNegativeTestJSON-86386264 tempest-AbsoluteLimitsNegativeTestJSON-86386264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:05.624465 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-022d1e20-8ec6-4b77-86c3-8cf9dc510310 tempest-AbsoluteLimitsNegativeTestJSON-86386264 tempest-AbsoluteLimitsNegativeTestJSON-86386264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:05.625208 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-022d1e20-8ec6-4b77-86c3-8cf9dc510310 tempest-AbsoluteLimitsNegativeTestJSON-86386264 tempest-AbsoluteLimitsNegativeTestJSON-86386264-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:05.625672 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-022d1e20-8ec6-4b77-86c3-8cf9dc510310 tempest-AbsoluteLimitsNegativeTestJSON-86386264 tempest-AbsoluteLimitsNegativeTestJSON-86386264-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:05.626102 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-022d1e20-8ec6-4b77-86c3-8cf9dc510310 tempest-AbsoluteLimitsNegativeTestJSON-86386264 tempest-AbsoluteLimitsNegativeTestJSON-86386264-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:05.675773 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-022d1e20-8ec6-4b77-86c3-8cf9dc510310 tempest-AbsoluteLimitsNegativeTestJSON-86386264 tempest-AbsoluteLimitsNegativeTestJSON-86386264-project] 10.222.0.67 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.569483 Sep 16 12:58:05.680992 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1514/2941] 10.222.0.67 () {58 vars in 1122 bytes} [Fri Sep 16 12:58:05 2022] GET /compute/v2.1/limits => generated 511 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:58:05.686346 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9db670b3-c8a6-4f96-9972-64015ec937b0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:05.687219 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9db670b3-c8a6-4f96-9972-64015ec937b0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: cc79a200-5972-4bec-9322-503d99b7d85a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:05.694248 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9db670b3-c8a6-4f96-9972-64015ec937b0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:05.695033 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9db670b3-c8a6-4f96-9972-64015ec937b0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:05.695656 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9db670b3-c8a6-4f96-9972-64015ec937b0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:05.696819 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9db670b3-c8a6-4f96-9972-64015ec937b0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:05.697737 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9db670b3-c8a6-4f96-9972-64015ec937b0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:05.698329 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9db670b3-c8a6-4f96-9972-64015ec937b0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:05.726017 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-9db670b3-c8a6-4f96-9972-64015ec937b0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] HTTP exception thrown: Instance cc79a200-5972-4bec-9322-503d99b7d85a could not be found. Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9db670b3-c8a6-4f96-9972-64015ec937b0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Request method failure captured: Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/cc79a200-5972-4bec-9322-503d99b7d85a HTTP/1.1 Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHK-ai74OxrHHqL5ZA97hOvy32Q6xIReVrKhZIj6PEPyQ_UB4rFs-7hdJCkozKZ5clo_9DaVkBFgsUmiSN_gmVaPdL8FT-f5QYKPk-CE61XDTK1RMhpnQkeVMlba4E4KaPfDCDA8WSNup3uH3mzkxsd2kp-OesctbTYQkqWqHnAvC3I Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_cfe82d8dd4fb42cbb054a6f069424c57", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-DeleteServersTestJSON-1385458479 Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-DeleteServersTestJSON-1385458479-project Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 2e531a7026054c34b2a78a1c484cbe02 Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-DeleteServersTestJSON-1385458479-project Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance cc79a200-5972-4bec-9322-503d99b7d85a could not be found. Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': 'cc79a200-5972-4bec-9322-503d99b7d85a'} Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc79a200-5972-4bec-9322-503d99b7d85a could not be found. Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc79a200-5972-4bec-9322-503d99b7d85a could not be found. Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:58:05.733425 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:05.739135 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:05.739135 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:58:05.739135 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:58:05.739135 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:58:05.739135 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:58:05.739135 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc79a200-5972-4bec-9322-503d99b7d85a could not be found. Sep 16 12:58:05.739135 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:05.740862 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9db670b3-c8a6-4f96-9972-64015ec937b0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Returning 404 to user: Instance cc79a200-5972-4bec-9322-503d99b7d85a could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:58:05.742118 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9db670b3-c8a6-4f96-9972-64015ec937b0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/cc79a200-5972-4bec-9322-503d99b7d85a" status: 404 len: 111 microversion: 2.1 time: 0.059777 Sep 16 12:58:05.742991 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1515/2942] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:05 2022] GET /compute/v2.1/servers/cc79a200-5972-4bec-9322-503d99b7d85a => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:58:05.790155 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ec6d9f7b-84a2-4f57-977a-7b37db671912 tempest-AbsoluteLimitsNegativeTestJSON-86386264 tempest-AbsoluteLimitsNegativeTestJSON-86386264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-313052257", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:58:05.909251 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-ec6d9f7b-84a2-4f57-977a-7b37db671912 tempest-AbsoluteLimitsNegativeTestJSON-86386264 tempest-AbsoluteLimitsNegativeTestJSON-86386264-project] validate_networks() for None {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:58:06.041851 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5b2d9440-29c9-4ab1-800f-b877293c4184 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:06.051243 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5b2d9440-29c9-4ab1-800f-b877293c4184 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:06.055223 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5b2d9440-29c9-4ab1-800f-b877293c4184 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:06.058175 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5b2d9440-29c9-4ab1-800f-b877293c4184 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1487 microversion: 2.25 time: 0.764480 Sep 16 12:58:06.086738 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1428/2943] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:05 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1487 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:58:06.101266 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fe5eef3b-c7d0-40c4-b413-2ab0566a87ed tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:06.106902 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-fe5eef3b-c7d0-40c4-b413-2ab0566a87ed tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 536f2ffa-d5a1-4060-9ef1-f305cf164fd3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:06.131617 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe5eef3b-c7d0-40c4-b413-2ab0566a87ed tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:06.132186 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe5eef3b-c7d0-40c4-b413-2ab0566a87ed tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:06.137469 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe5eef3b-c7d0-40c4-b413-2ab0566a87ed tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:06.138744 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe5eef3b-c7d0-40c4-b413-2ab0566a87ed tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:06.139897 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe5eef3b-c7d0-40c4-b413-2ab0566a87ed tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:06.144040 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe5eef3b-c7d0-40c4-b413-2ab0566a87ed tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:06.545416 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-ec6d9f7b-84a2-4f57-977a-7b37db671912 tempest-AbsoluteLimitsNegativeTestJSON-86386264 tempest-AbsoluteLimitsNegativeTestJSON-86386264-project] Getting quotas for project b1b3933dfa664eb48e3498489e3b2942. Resources: dict_keys(['metadata_items']) {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:58:06.552970 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-ec6d9f7b-84a2-4f57-977a-7b37db671912 tempest-AbsoluteLimitsNegativeTestJSON-86386264 tempest-AbsoluteLimitsNegativeTestJSON-86386264-project] Getting quotas for user 3910929e7c90461586207a9ec1759437 and project b1b3933dfa664eb48e3498489e3b2942. Resources: dict_keys(['metadata_items']) {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:58:06.572774 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-ec6d9f7b-84a2-4f57-977a-7b37db671912 tempest-AbsoluteLimitsNegativeTestJSON-86386264 tempest-AbsoluteLimitsNegativeTestJSON-86386264-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Sep 16 12:58:06.575199 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ec6d9f7b-84a2-4f57-977a-7b37db671912 tempest-AbsoluteLimitsNegativeTestJSON-86386264 tempest-AbsoluteLimitsNegativeTestJSON-86386264-project] Request method failure captured: Sep 16 12:58:06.575199 n-d-858094-4 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 16 12:58:06.575199 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:58:06.575199 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:58:06.575199 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:58:06.575199 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 1751 Sep 16 12:58:06.575199 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:58:06.575199 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:58:06.575199 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:58:06.575199 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:58:06.575199 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHLcLTHeS9OKykNB7acGQwJGMTs1bMom_rv8vocWGeZccN8QdpgeV-iNjQ_51wrGEpVy0bEtVI4vbYhaLx9dXVV0DP4aXuA-HsbpiuS308HZIXb43YkeA9F1BGvIFMEB1BMfkd8X-6RIjjI7PYP6e6mjQBwCJ6f9BJWwvQKj6PBAHxA Sep 16 12:58:06.575199 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:58:06.575199 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:58:06.575199 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:58:06.575199 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:58:06.575199 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:58:06.575199 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:58:06.575199 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: b1b3933dfa664eb48e3498489e3b2942 Sep 16 12:58:06.575199 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-86386264 Sep 16 12:58:06.575199 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:58:06.575199 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:58:06.575199 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b1b3933dfa664eb48e3498489e3b2942"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b1b3933dfa664eb48e3498489e3b2942"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b1b3933dfa664eb48e3498489e3b2942", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b1b3933dfa664eb48e3498489e3b2942"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:58:06.575199 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-86386264 Sep 16 12:58:06.575199 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: b1b3933dfa664eb48e3498489e3b2942 Sep 16 12:58:06.575199 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-86386264 Sep 16 12:58:06.575199 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-86386264-project Sep 16 12:58:06.575199 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:58:06.575199 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:58:06.575199 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 3910929e7c90461586207a9ec1759437 Sep 16 12:58:06.575199 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-86386264-project Sep 16 12:58:06.575199 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 12:58:06.575199 n-d-858094-4 devstack@n-api.service[128779]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-313052257", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Sep 16 12:58:06.575199 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:58:06.575199 n-d-858094-4 devstack@n-api.service[128779]: exception: Maximum number of metadata items exceeds 128 Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-313052257', 'imageRef': '7df4548b-8809-4742-80bd-4e4e6dcafc91', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:58:06.577520 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:58:06.580304 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:58:06.580304 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 16 12:58:06.580304 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 16 12:58:06.580304 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 16 12:58:06.580304 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Sep 16 12:58:06.580304 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:06.580304 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:58:06.580304 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:06.580304 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:06.580304 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:58:06.580304 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:58:06.580304 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:58:06.580304 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:58:06.580304 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Sep 16 12:58:06.580304 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:06.582562 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ec6d9f7b-84a2-4f57-977a-7b37db671912 tempest-AbsoluteLimitsNegativeTestJSON-86386264 tempest-AbsoluteLimitsNegativeTestJSON-86386264-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:58:06.583601 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ec6d9f7b-84a2-4f57-977a-7b37db671912 tempest-AbsoluteLimitsNegativeTestJSON-86386264 tempest-AbsoluteLimitsNegativeTestJSON-86386264-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.798467 Sep 16 12:58:06.584841 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1516/2944] 10.222.0.67 () {60 vars in 1148 bytes} [Fri Sep 16 12:58:05 2022] POST /compute/v2.1/servers => generated 87 bytes in 801 msecs (HTTP/1.1 403) 9 headers in 378 bytes (2 switches on core 0) Sep 16 12:58:06.604868 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-44a746f1-682b-4481-a1b9-7e7bceb04a7f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-96631268", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": [{"uuid": "4c6a423f-0493-4448-999c-84f17e899760"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:58:06.622395 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-fe5eef3b-c7d0-40c4-b413-2ab0566a87ed tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:06.632413 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-fe5eef3b-c7d0-40c4-b413-2ab0566a87ed tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3" status: 200 len: 1355 microversion: 2.1 time: 0.544405 Sep 16 12:58:06.642965 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1429/2945] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:06 2022] GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3 => generated 1355 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:06.657700 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3d723f01-60fc-4188-ab7d-20e4b295f49d tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:06.660416 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3d723f01-60fc-4188-ab7d-20e4b295f49d tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: 4f9dac6d-1e24-4618-b802-96fdd6306c30] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:06.667701 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:58:06.675483 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3d723f01-60fc-4188-ab7d-20e4b295f49d tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:06.677808 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3d723f01-60fc-4188-ab7d-20e4b295f49d tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:06.684385 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3d723f01-60fc-4188-ab7d-20e4b295f49d tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:06.685179 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3d723f01-60fc-4188-ab7d-20e4b295f49d tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:06.694606 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3d723f01-60fc-4188-ab7d-20e4b295f49d tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:06.697059 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3d723f01-60fc-4188-ab7d-20e4b295f49d tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:06.744443 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-44a746f1-682b-4481-a1b9-7e7bceb04a7f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] validate_networks() for [('4c6a423f-0493-4448-999c-84f17e899760', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:58:07.226673 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3d723f01-60fc-4188-ab7d-20e4b295f49d tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ec543501c49daaa37af078622626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd30c33cb19d47278478aa2340859920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:07.236884 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3d723f01-60fc-4188-ab7d-20e4b295f49d tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "GET /compute/v2.1/servers/4f9dac6d-1e24-4618-b802-96fdd6306c30" status: 200 len: 1318 microversion: 2.1 time: 0.589098 Sep 16 12:58:07.237684 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1430/2946] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:06 2022] GET /compute/v2.1/servers/4f9dac6d-1e24-4618-b802-96fdd6306c30 => generated 1318 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:07.242689 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-d99f2110-1eca-4454-b1ee-4399c4558e64 req-684d26aa-7d6f-423e-9a01-5eeb0b17ca33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f9dac6d-1e24-4618-b802-96fdd6306c30", "name": "network-vif-plugged", "status": "completed", "tag": "31028850-a929-4e17-a925-e55dedb937e0"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:58:07.268221 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-d99f2110-1eca-4454-b1ee-4399c4558e64 req-684d26aa-7d6f-423e-9a01-5eeb0b17ca33 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:07.269009 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-d99f2110-1eca-4454-b1ee-4399c4558e64 req-684d26aa-7d6f-423e-9a01-5eeb0b17ca33 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:07.269691 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-d99f2110-1eca-4454-b1ee-4399c4558e64 req-684d26aa-7d6f-423e-9a01-5eeb0b17ca33 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:07.289331 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-d99f2110-1eca-4454-b1ee-4399c4558e64 req-684d26aa-7d6f-423e-9a01-5eeb0b17ca33 service nova] Creating event network-vif-plugged:31028850-a929-4e17-a925-e55dedb937e0 for instance 4f9dac6d-1e24-4618-b802-96fdd6306c30 on n-h1-858094-4 Sep 16 12:58:07.295508 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-d99f2110-1eca-4454-b1ee-4399c4558e64 req-684d26aa-7d6f-423e-9a01-5eeb0b17ca33 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056275 Sep 16 12:58:07.296307 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1431/2947] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:58:07.307016 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-89941eff-a9f9-4308-8491-f59e39b71076 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:07.308163 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-89941eff-a9f9-4308-8491-f59e39b71076 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:07.315552 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-89941eff-a9f9-4308-8491-f59e39b71076 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:07.316432 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-89941eff-a9f9-4308-8491-f59e39b71076 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:07.317165 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-89941eff-a9f9-4308-8491-f59e39b71076 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:07.318719 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-89941eff-a9f9-4308-8491-f59e39b71076 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:07.319500 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-89941eff-a9f9-4308-8491-f59e39b71076 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:07.320177 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-89941eff-a9f9-4308-8491-f59e39b71076 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:07.803752 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-89941eff-a9f9-4308-8491-f59e39b71076 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:07.818357 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-89941eff-a9f9-4308-8491-f59e39b71076 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:07.821672 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-89941eff-a9f9-4308-8491-f59e39b71076 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:07.828086 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-89941eff-a9f9-4308-8491-f59e39b71076 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1487 microversion: 2.25 time: 0.525667 Sep 16 12:58:07.829997 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1432/2948] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:07 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1487 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:58:07.836517 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-8600d150-8825-4f82-b926-bc05b45e2618 req-e5862987-4234-4307-8dca-0dba35c66351 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "536f2ffa-d5a1-4060-9ef1-f305cf164fd3", "tag": "e389c52d-c333-408c-a4a5-dd1fb810bd22"}, {"name": "network-changed", "server_uuid": "536f2ffa-d5a1-4060-9ef1-f305cf164fd3", "tag": "0f8de272-9fd7-474d-85d6-e69716710172"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:58:07.865916 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-8600d150-8825-4f82-b926-bc05b45e2618 req-e5862987-4234-4307-8dca-0dba35c66351 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:07.870106 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-8600d150-8825-4f82-b926-bc05b45e2618 req-e5862987-4234-4307-8dca-0dba35c66351 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:07.872081 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-8600d150-8825-4f82-b926-bc05b45e2618 req-e5862987-4234-4307-8dca-0dba35c66351 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:07.924591 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-8600d150-8825-4f82-b926-bc05b45e2618 req-e5862987-4234-4307-8dca-0dba35c66351 service nova] Creating event network-changed:e389c52d-c333-408c-a4a5-dd1fb810bd22 for instance 536f2ffa-d5a1-4060-9ef1-f305cf164fd3 on n-h2-858094-4 Sep 16 12:58:07.925059 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-8600d150-8825-4f82-b926-bc05b45e2618 req-e5862987-4234-4307-8dca-0dba35c66351 service nova] Creating event network-changed:0f8de272-9fd7-474d-85d6-e69716710172 for instance 536f2ffa-d5a1-4060-9ef1-f305cf164fd3 on n-h2-858094-4 Sep 16 12:58:07.936031 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-8600d150-8825-4f82-b926-bc05b45e2618 req-e5862987-4234-4307-8dca-0dba35c66351 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.104570 Sep 16 12:58:07.940897 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1433/2949] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:58:07.954333 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b904a392-7591-413f-9e12-9de2fbb71849 tempest-VolumesAdminNegativeTest-1225824925 tempest-VolumesAdminNegativeTest-1225824925-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "e0663783-388c-48c7-8edb-f4cd2661d781"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:58:07.957080 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b904a392-7591-413f-9e12-9de2fbb71849 tempest-VolumesAdminNegativeTest-1225824925 tempest-VolumesAdminNegativeTest-1225824925-project-admin] [instance: 2998767f-d217-40ea-a487-60c0c4ade426] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:07.965433 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b904a392-7591-413f-9e12-9de2fbb71849 tempest-VolumesAdminNegativeTest-1225824925 tempest-VolumesAdminNegativeTest-1225824925-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:07.966181 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b904a392-7591-413f-9e12-9de2fbb71849 tempest-VolumesAdminNegativeTest-1225824925 tempest-VolumesAdminNegativeTest-1225824925-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:07.966780 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b904a392-7591-413f-9e12-9de2fbb71849 tempest-VolumesAdminNegativeTest-1225824925 tempest-VolumesAdminNegativeTest-1225824925-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:07.967645 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b904a392-7591-413f-9e12-9de2fbb71849 tempest-VolumesAdminNegativeTest-1225824925 tempest-VolumesAdminNegativeTest-1225824925-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:07.968278 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b904a392-7591-413f-9e12-9de2fbb71849 tempest-VolumesAdminNegativeTest-1225824925 tempest-VolumesAdminNegativeTest-1225824925-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:07.968859 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b904a392-7591-413f-9e12-9de2fbb71849 tempest-VolumesAdminNegativeTest-1225824925 tempest-VolumesAdminNegativeTest-1225824925-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:07.983652 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-44a746f1-682b-4481-a1b9-7e7bceb04a7f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:58:07.984362 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-44a746f1-682b-4481-a1b9-7e7bceb04a7f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:58:07.984601 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-44a746f1-682b-4481-a1b9-7e7bceb04a7f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:58:07.985040 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-44a746f1-682b-4481-a1b9-7e7bceb04a7f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:58:07.985476 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-44a746f1-682b-4481-a1b9-7e7bceb04a7f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:58:07.998847 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44a746f1-682b-4481-a1b9-7e7bceb04a7f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:07.999333 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44a746f1-682b-4481-a1b9-7e7bceb04a7f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:08.002341 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44a746f1-682b-4481-a1b9-7e7bceb04a7f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:08.004637 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44a746f1-682b-4481-a1b9-7e7bceb04a7f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:08.005930 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44a746f1-682b-4481-a1b9-7e7bceb04a7f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:08.007472 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44a746f1-682b-4481-a1b9-7e7bceb04a7f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:08.060316 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-44a746f1-682b-4481-a1b9-7e7bceb04a7f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Getting quotas for project cfe82d8dd4fb42cbb054a6f069424c57. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:58:08.061699 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-b904a392-7591-413f-9e12-9de2fbb71849 tempest-VolumesAdminNegativeTest-1225824925 tempest-VolumesAdminNegativeTest-1225824925-project-admin] HTTP exception thrown: Volume 2ba3b51c-a88e-4a0b-b5dd-36668ae610b0 could not be found. Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b904a392-7591-413f-9e12-9de2fbb71849 tempest-VolumesAdminNegativeTest-1225824925 tempest-VolumesAdminNegativeTest-1225824925-project-admin] Request method failure captured: Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: request: PUT /compute/v2.1/servers/2998767f-d217-40ea-a487-60c0c4ade426/os-volume_attachments/2ba3b51c-a88e-4a0b-b5dd-36668ae610b0 HTTP/1.1 Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 74 Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHIr6VKlsdREpAKSbIHWkXJZQUxzBXJotlqET7Ih2-URR6wcmyhMQ4im-Qp6Fs4eVoSUWpF-HepwYVt-dg9c3_2koraEY3ugWX3Z_mQoIcPRYenkRKjK09fOElj_-9asYRQxAYVCW5_-WUdbzfKwkb1o9z9plioiNd4-9O2ZPDmcgQQ Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 9390133145c14261b4cb69996a8cbada Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-VolumesAdminNegativeTest-1225824925 Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,admin,reader Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,admin,reader Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9390133145c14261b4cb69996a8cbada"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9390133145c14261b4cb69996a8cbada"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9390133145c14261b4cb69996a8cbada", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9390133145c14261b4cb69996a8cbada"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-VolumesAdminNegativeTest-1225824925 Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 9390133145c14261b4cb69996a8cbada Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1225824925 Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-VolumesAdminNegativeTest-1225824925-project-admin Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: d4043ea015fc4c7fbb95335939d8a567 Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-VolumesAdminNegativeTest-1225824925-project-admin Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: {"volumeAttachment": {"volumeId": "e0663783-388c-48c7-8edb-f4cd2661d781"}} Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: exception: Volume 2ba3b51c-a88e-4a0b-b5dd-36668ae610b0 could not be found. Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'server_id': '2998767f-d217-40ea-a487-60c0c4ade426', 'id': '2ba3b51c-a88e-4a0b-b5dd-36668ae610b0', 'body': {'volumeAttachment': {'volumeId': 'e0663783-388c-48c7-8edb-f4cd2661d781'}}} Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2ba3b51c-a88e-4a0b-b5dd-36668ae610b0 could not be found. (HTTP 404) (Request-ID: req-3e3d49c8-b554-4197-89f9-23e832524ab3) Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 12:58:08.065718 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2ba3b51c-a88e-4a0b-b5dd-36668ae610b0 could not be found. Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2ba3b51c-a88e-4a0b-b5dd-36668ae610b0 could not be found. Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2ba3b51c-a88e-4a0b-b5dd-36668ae610b0 could not be found. Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b904a392-7591-413f-9e12-9de2fbb71849 tempest-VolumesAdminNegativeTest-1225824925 tempest-VolumesAdminNegativeTest-1225824925-project-admin] Returning 404 to user: Volume 2ba3b51c-a88e-4a0b-b5dd-36668ae610b0 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b904a392-7591-413f-9e12-9de2fbb71849 tempest-VolumesAdminNegativeTest-1225824925 tempest-VolumesAdminNegativeTest-1225824925-project-admin] 10.222.0.67 "PUT /compute/v2.1/servers/2998767f-d217-40ea-a487-60c0c4ade426/os-volume_attachments/2ba3b51c-a88e-4a0b-b5dd-36668ae610b0" status: 404 len: 109 microversion: 2.1 time: 0.125045 Sep 16 12:58:08.070803 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1434/2950] 10.222.0.67 () {60 vars in 1433 bytes} [Fri Sep 16 12:58:07 2022] PUT /compute/v2.1/servers/2998767f-d217-40ea-a487-60c0c4ade426/os-volume_attachments/2ba3b51c-a88e-4a0b-b5dd-36668ae610b0 => generated 109 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:58:08.079051 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-44a746f1-682b-4481-a1b9-7e7bceb04a7f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Getting quotas for user 2e531a7026054c34b2a78a1c484cbe02 and project cfe82d8dd4fb42cbb054a6f069424c57. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:58:08.079772 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d70af04c-b6f9-4c20-be93-92e4543d5516 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:08.079772 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d70af04c-b6f9-4c20-be93-92e4543d5516 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 536f2ffa-d5a1-4060-9ef1-f305cf164fd3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:08.093649 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d70af04c-b6f9-4c20-be93-92e4543d5516 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:08.094524 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d70af04c-b6f9-4c20-be93-92e4543d5516 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:08.095691 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d70af04c-b6f9-4c20-be93-92e4543d5516 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:08.097379 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d70af04c-b6f9-4c20-be93-92e4543d5516 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:08.098117 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d70af04c-b6f9-4c20-be93-92e4543d5516 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:08.098756 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d70af04c-b6f9-4c20-be93-92e4543d5516 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:08.107276 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-44a746f1-682b-4481-a1b9-7e7bceb04a7f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:58:08.109915 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-44a746f1-682b-4481-a1b9-7e7bceb04a7f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: e8b6a81c-dbec-452e-bd82-a4c86b9c44fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:58:08.210837 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-44a746f1-682b-4481-a1b9-7e7bceb04a7f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.609535 Sep 16 12:58:08.210837 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1517/2951] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:58:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:58:08.219657 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c260c431-ae1a-490c-bc36-9e211cf7c7fb tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:08.220632 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c260c431-ae1a-490c-bc36-9e211cf7c7fb tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: e8b6a81c-dbec-452e-bd82-a4c86b9c44fd] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:08.337476 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c260c431-ae1a-490c-bc36-9e211cf7c7fb tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:08.353397 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c260c431-ae1a-490c-bc36-9e211cf7c7fb tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd" status: 200 len: 1213 microversion: 2.1 time: 0.136675 Sep 16 12:58:08.354072 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1518/2952] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:08 2022] GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd => generated 1213 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:58:08.368160 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-882742f4-e7e7-4d66-9929-c0b44358f126 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:08.369080 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-882742f4-e7e7-4d66-9929-c0b44358f126 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: 4f9dac6d-1e24-4618-b802-96fdd6306c30] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:08.381152 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-882742f4-e7e7-4d66-9929-c0b44358f126 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:08.381663 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-882742f4-e7e7-4d66-9929-c0b44358f126 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:08.382098 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-882742f4-e7e7-4d66-9929-c0b44358f126 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:08.382980 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-882742f4-e7e7-4d66-9929-c0b44358f126 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:08.383657 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-882742f4-e7e7-4d66-9929-c0b44358f126 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:08.384312 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-882742f4-e7e7-4d66-9929-c0b44358f126 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:08.625046 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d70af04c-b6f9-4c20-be93-92e4543d5516 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:08.639279 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d70af04c-b6f9-4c20-be93-92e4543d5516 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3" status: 200 len: 1355 microversion: 2.1 time: 0.564973 Sep 16 12:58:08.641694 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1435/2953] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:08 2022] GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3 => generated 1355 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:08.856370 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3b9d79c4-382f-4043-8c3d-26d7d236c46f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:08.857029 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3b9d79c4-382f-4043-8c3d-26d7d236c46f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:08.867691 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3b9d79c4-382f-4043-8c3d-26d7d236c46f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:08.870450 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3b9d79c4-382f-4043-8c3d-26d7d236c46f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:08.871508 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3b9d79c4-382f-4043-8c3d-26d7d236c46f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:08.873847 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3b9d79c4-382f-4043-8c3d-26d7d236c46f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:08.874530 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3b9d79c4-382f-4043-8c3d-26d7d236c46f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:08.876392 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3b9d79c4-382f-4043-8c3d-26d7d236c46f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:09.624817 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-882742f4-e7e7-4d66-9929-c0b44358f126 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ec543501c49daaa37af078622626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd30c33cb19d47278478aa2340859920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:09.637152 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-882742f4-e7e7-4d66-9929-c0b44358f126 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "GET /compute/v2.1/servers/4f9dac6d-1e24-4618-b802-96fdd6306c30" status: 200 len: 1318 microversion: 2.1 time: 1.281693 Sep 16 12:58:09.648236 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1519/2954] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:08 2022] GET /compute/v2.1/servers/4f9dac6d-1e24-4618-b802-96fdd6306c30 => generated 1318 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:09.648236 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0a2672a7-5f9d-4f43-b3e4-9f773e9bf92e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:09.648236 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0a2672a7-5f9d-4f43-b3e4-9f773e9bf92e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: e8b6a81c-dbec-452e-bd82-a4c86b9c44fd] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:09.669568 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a2672a7-5f9d-4f43-b3e4-9f773e9bf92e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:09.672041 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a2672a7-5f9d-4f43-b3e4-9f773e9bf92e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:09.672762 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a2672a7-5f9d-4f43-b3e4-9f773e9bf92e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:09.674934 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a2672a7-5f9d-4f43-b3e4-9f773e9bf92e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:09.675682 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a2672a7-5f9d-4f43-b3e4-9f773e9bf92e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:09.676372 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a2672a7-5f9d-4f43-b3e4-9f773e9bf92e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:09.699982 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3b9d79c4-382f-4043-8c3d-26d7d236c46f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:09.716190 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3b9d79c4-382f-4043-8c3d-26d7d236c46f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:09.717842 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3b9d79c4-382f-4043-8c3d-26d7d236c46f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:09.719406 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3b9d79c4-382f-4043-8c3d-26d7d236c46f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1487 microversion: 2.25 time: 0.868526 Sep 16 12:58:09.744633 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1436/2955] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:08 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1487 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:58:09.754433 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-319f8047-dbe8-49b6-ba37-6beb0437fe69 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:09.755533 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-319f8047-dbe8-49b6-ba37-6beb0437fe69 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 536f2ffa-d5a1-4060-9ef1-f305cf164fd3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:09.763820 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-319f8047-dbe8-49b6-ba37-6beb0437fe69 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:09.764581 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-319f8047-dbe8-49b6-ba37-6beb0437fe69 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:09.765245 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-319f8047-dbe8-49b6-ba37-6beb0437fe69 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:09.766189 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-319f8047-dbe8-49b6-ba37-6beb0437fe69 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:09.766865 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-319f8047-dbe8-49b6-ba37-6beb0437fe69 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:09.767597 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-319f8047-dbe8-49b6-ba37-6beb0437fe69 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:09.809321 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=100 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:58:09.853861 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0a2672a7-5f9d-4f43-b3e4-9f773e9bf92e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:09.870568 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0a2672a7-5f9d-4f43-b3e4-9f773e9bf92e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd" status: 200 len: 1265 microversion: 2.1 time: 0.231352 Sep 16 12:58:09.871530 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1520/2956] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:09 2022] GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:10.150876 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-319f8047-dbe8-49b6-ba37-6beb0437fe69 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:10.163660 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-319f8047-dbe8-49b6-ba37-6beb0437fe69 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3" status: 200 len: 1355 microversion: 2.1 time: 0.417503 Sep 16 12:58:10.182027 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1437/2957] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:09 2022] GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3 => generated 1355 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:10.664343 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c5032648-3154-44a3-af48-1143d2e6f6f7 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:10.665010 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c5032648-3154-44a3-af48-1143d2e6f6f7 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: 4f9dac6d-1e24-4618-b802-96fdd6306c30] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:10.677663 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5032648-3154-44a3-af48-1143d2e6f6f7 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:10.678172 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5032648-3154-44a3-af48-1143d2e6f6f7 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:10.678625 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5032648-3154-44a3-af48-1143d2e6f6f7 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:10.686258 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5032648-3154-44a3-af48-1143d2e6f6f7 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:10.686894 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5032648-3154-44a3-af48-1143d2e6f6f7 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:10.687353 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5032648-3154-44a3-af48-1143d2e6f6f7 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:10.758490 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c2ccf50e-ac3d-4e5d-8584-571ad05e30ff tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:10.759544 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c2ccf50e-ac3d-4e5d-8584-571ad05e30ff tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:10.779784 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c2ccf50e-ac3d-4e5d-8584-571ad05e30ff tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:10.780504 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c2ccf50e-ac3d-4e5d-8584-571ad05e30ff tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:10.780989 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c2ccf50e-ac3d-4e5d-8584-571ad05e30ff tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:10.781739 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c2ccf50e-ac3d-4e5d-8584-571ad05e30ff tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:10.782207 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c2ccf50e-ac3d-4e5d-8584-571ad05e30ff tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:10.782640 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c2ccf50e-ac3d-4e5d-8584-571ad05e30ff tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:11.334463 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c2ccf50e-ac3d-4e5d-8584-571ad05e30ff tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:11.367843 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c2ccf50e-ac3d-4e5d-8584-571ad05e30ff tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:11.377544 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c2ccf50e-ac3d-4e5d-8584-571ad05e30ff tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:11.379187 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c2ccf50e-ac3d-4e5d-8584-571ad05e30ff tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1487 microversion: 2.25 time: 0.624665 Sep 16 12:58:11.379588 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c5032648-3154-44a3-af48-1143d2e6f6f7 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ec543501c49daaa37af078622626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd30c33cb19d47278478aa2340859920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:11.381469 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1438/2958] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:10 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1487 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:58:11.387804 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-77f04dd3-0b1a-450e-90c3-54501ae6ae5d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:11.389688 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c5032648-3154-44a3-af48-1143d2e6f6f7 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "GET /compute/v2.1/servers/4f9dac6d-1e24-4618-b802-96fdd6306c30" status: 200 len: 1506 microversion: 2.1 time: 0.729245 Sep 16 12:58:11.393979 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-77f04dd3-0b1a-450e-90c3-54501ae6ae5d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: e8b6a81c-dbec-452e-bd82-a4c86b9c44fd] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:11.396592 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1521/2959] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:10 2022] GET /compute/v2.1/servers/4f9dac6d-1e24-4618-b802-96fdd6306c30 => generated 1506 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:11.405104 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1761dca6-5b48-48b6-8d43-eb24349c3add tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:11.405742 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1761dca6-5b48-48b6-8d43-eb24349c3add tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 536f2ffa-d5a1-4060-9ef1-f305cf164fd3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:11.410141 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-77f04dd3-0b1a-450e-90c3-54501ae6ae5d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:11.410944 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-77f04dd3-0b1a-450e-90c3-54501ae6ae5d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:11.412054 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-77f04dd3-0b1a-450e-90c3-54501ae6ae5d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:11.417298 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-77f04dd3-0b1a-450e-90c3-54501ae6ae5d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:11.417927 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-77f04dd3-0b1a-450e-90c3-54501ae6ae5d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:11.418273 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-77f04dd3-0b1a-450e-90c3-54501ae6ae5d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:11.421257 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1761dca6-5b48-48b6-8d43-eb24349c3add tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:11.421991 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1761dca6-5b48-48b6-8d43-eb24349c3add tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:11.422925 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1761dca6-5b48-48b6-8d43-eb24349c3add tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:11.424027 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1761dca6-5b48-48b6-8d43-eb24349c3add tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:11.426118 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1761dca6-5b48-48b6-8d43-eb24349c3add tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:11.426835 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1761dca6-5b48-48b6-8d43-eb24349c3add tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:11.552402 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-77f04dd3-0b1a-450e-90c3-54501ae6ae5d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:11.567751 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-77f04dd3-0b1a-450e-90c3-54501ae6ae5d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd" status: 200 len: 1271 microversion: 2.1 time: 0.184637 Sep 16 12:58:11.568581 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1439/2960] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:11 2022] GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd => generated 1271 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:11.581848 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-20b698f6-e5fb-4592-8b6e-f713e054664c tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:11.583132 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-20b698f6-e5fb-4592-8b6e-f713e054664c tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: 5f30c650-f49a-419b-acfe-165d9886e897] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:11.599878 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-20b698f6-e5fb-4592-8b6e-f713e054664c tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:11.600900 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-20b698f6-e5fb-4592-8b6e-f713e054664c tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:11.601442 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-20b698f6-e5fb-4592-8b6e-f713e054664c tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:11.604938 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-20b698f6-e5fb-4592-8b6e-f713e054664c tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:11.605517 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-20b698f6-e5fb-4592-8b6e-f713e054664c tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:11.606490 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-20b698f6-e5fb-4592-8b6e-f713e054664c tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:12.112221 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1761dca6-5b48-48b6-8d43-eb24349c3add tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:12.121823 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1761dca6-5b48-48b6-8d43-eb24349c3add tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3" status: 200 len: 1355 microversion: 2.1 time: 0.724101 Sep 16 12:58:12.142227 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1522/2961] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:11 2022] GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3 => generated 1355 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:12.148527 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f8a29c4f-4867-44c2-9c0b-f896ee30cf3a tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:12.149408 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f8a29c4f-4867-44c2-9c0b-f896ee30cf3a tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 2998767f-d217-40ea-a487-60c0c4ade426] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:12.162584 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8a29c4f-4867-44c2-9c0b-f896ee30cf3a tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:12.163339 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8a29c4f-4867-44c2-9c0b-f896ee30cf3a tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:12.164037 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8a29c4f-4867-44c2-9c0b-f896ee30cf3a tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:12.165058 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8a29c4f-4867-44c2-9c0b-f896ee30cf3a tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:12.166348 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8a29c4f-4867-44c2-9c0b-f896ee30cf3a tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:12.167098 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8a29c4f-4867-44c2-9c0b-f896ee30cf3a tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:12.200058 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-20b698f6-e5fb-4592-8b6e-f713e054664c tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ec543501c49daaa37af078622626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd30c33cb19d47278478aa2340859920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:12.217667 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-20b698f6-e5fb-4592-8b6e-f713e054664c tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "GET /compute/v2.1/servers/5f30c650-f49a-419b-acfe-165d9886e897" status: 200 len: 1507 microversion: 2.1 time: 0.645795 Sep 16 12:58:12.218064 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1440/2962] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:11 2022] GET /compute/v2.1/servers/5f30c650-f49a-419b-acfe-165d9886e897 => generated 1507 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:12.237762 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f8a29c4f-4867-44c2-9c0b-f896ee30cf3a tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 2998767f-d217-40ea-a487-60c0c4ade426] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:58:12.245659 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-02121acb-3ed2-4b6b-a6ba-593f02b2a9be tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:12.246170 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-02121acb-3ed2-4b6b-a6ba-593f02b2a9be tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: 5f30c650-f49a-419b-acfe-165d9886e897] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:12.250221 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:58:12.267968 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-02121acb-3ed2-4b6b-a6ba-593f02b2a9be tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:12.268513 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-02121acb-3ed2-4b6b-a6ba-593f02b2a9be tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:12.268955 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-02121acb-3ed2-4b6b-a6ba-593f02b2a9be tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:12.269670 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-02121acb-3ed2-4b6b-a6ba-593f02b2a9be tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:12.270134 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-02121acb-3ed2-4b6b-a6ba-593f02b2a9be tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:12.270563 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-02121acb-3ed2-4b6b-a6ba-593f02b2a9be tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:12.345564 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-02121acb-3ed2-4b6b-a6ba-593f02b2a9be tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: 5f30c650-f49a-419b-acfe-165d9886e897] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:58:12.429627 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f8a29c4f-4867-44c2-9c0b-f896ee30cf3a tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "DELETE /compute/v2.1/servers/2998767f-d217-40ea-a487-60c0c4ade426" status: 204 len: 0 microversion: 2.1 time: 0.285200 Sep 16 12:58:12.430231 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1523/2963] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:58:12 2022] DELETE /compute/v2.1/servers/2998767f-d217-40ea-a487-60c0c4ade426 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:58:12.441682 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7d7d1114-e819-4c57-b8e0-af40a4f06ba2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:12.445053 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7d7d1114-e819-4c57-b8e0-af40a4f06ba2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:12.458221 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d7d1114-e819-4c57-b8e0-af40a4f06ba2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:12.458726 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d7d1114-e819-4c57-b8e0-af40a4f06ba2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:12.459164 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d7d1114-e819-4c57-b8e0-af40a4f06ba2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:12.459878 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d7d1114-e819-4c57-b8e0-af40a4f06ba2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:12.460369 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d7d1114-e819-4c57-b8e0-af40a4f06ba2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:12.460795 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d7d1114-e819-4c57-b8e0-af40a4f06ba2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:12.519061 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-02121acb-3ed2-4b6b-a6ba-593f02b2a9be tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "DELETE /compute/v2.1/servers/5f30c650-f49a-419b-acfe-165d9886e897" status: 204 len: 0 microversion: 2.1 time: 0.278332 Sep 16 12:58:12.523588 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1441/2964] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:58:12 2022] DELETE /compute/v2.1/servers/5f30c650-f49a-419b-acfe-165d9886e897 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 12:58:12.543065 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3e3949f0-8647-4947-951c-def19a28bafe tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:12.543808 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3e3949f0-8647-4947-951c-def19a28bafe tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 2998767f-d217-40ea-a487-60c0c4ade426] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:12.556734 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3e3949f0-8647-4947-951c-def19a28bafe tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:12.557237 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3e3949f0-8647-4947-951c-def19a28bafe tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:12.557694 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3e3949f0-8647-4947-951c-def19a28bafe tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:12.558397 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3e3949f0-8647-4947-951c-def19a28bafe tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:12.558848 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3e3949f0-8647-4947-951c-def19a28bafe tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:12.559271 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3e3949f0-8647-4947-951c-def19a28bafe tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:12.973229 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3e3949f0-8647-4947-951c-def19a28bafe tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37316c1f04764255a2a9466676502c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e940a963f7740dea44034d06e8c2a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:12.986805 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3e3949f0-8647-4947-951c-def19a28bafe tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "GET /compute/v2.1/servers/2998767f-d217-40ea-a487-60c0c4ade426" status: 200 len: 1513 microversion: 2.1 time: 0.461469 Sep 16 12:58:12.987415 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1442/2965] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:12 2022] GET /compute/v2.1/servers/2998767f-d217-40ea-a487-60c0c4ade426 => generated 1513 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:13.004275 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-799e4135-b4bb-44cd-99a0-1a19fbe8b184 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:13.004790 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-799e4135-b4bb-44cd-99a0-1a19fbe8b184 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: 4f9dac6d-1e24-4618-b802-96fdd6306c30] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:13.011761 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-799e4135-b4bb-44cd-99a0-1a19fbe8b184 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:13.012303 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-799e4135-b4bb-44cd-99a0-1a19fbe8b184 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:13.012745 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-799e4135-b4bb-44cd-99a0-1a19fbe8b184 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:13.013461 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-799e4135-b4bb-44cd-99a0-1a19fbe8b184 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:13.013918 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-799e4135-b4bb-44cd-99a0-1a19fbe8b184 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:13.014346 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-799e4135-b4bb-44cd-99a0-1a19fbe8b184 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:13.041795 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7d7d1114-e819-4c57-b8e0-af40a4f06ba2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:13.058021 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7d7d1114-e819-4c57-b8e0-af40a4f06ba2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:13.059767 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7d7d1114-e819-4c57-b8e0-af40a4f06ba2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:13.061277 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7d7d1114-e819-4c57-b8e0-af40a4f06ba2 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1487 microversion: 2.25 time: 0.628849 Sep 16 12:58:13.064855 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1524/2966] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:12 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1487 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:58:13.075536 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-268ac4f1-77fe-4ca3-994d-60adb855fa29 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:13.080210 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-268ac4f1-77fe-4ca3-994d-60adb855fa29 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: e8b6a81c-dbec-452e-bd82-a4c86b9c44fd] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:13.091245 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-268ac4f1-77fe-4ca3-994d-60adb855fa29 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:13.092330 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-268ac4f1-77fe-4ca3-994d-60adb855fa29 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:13.092783 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-268ac4f1-77fe-4ca3-994d-60adb855fa29 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:13.097189 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-268ac4f1-77fe-4ca3-994d-60adb855fa29 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:13.097909 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-268ac4f1-77fe-4ca3-994d-60adb855fa29 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:13.098566 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-268ac4f1-77fe-4ca3-994d-60adb855fa29 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:13.108909 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-799e4135-b4bb-44cd-99a0-1a19fbe8b184 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: 4f9dac6d-1e24-4618-b802-96fdd6306c30] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:58:13.259863 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-799e4135-b4bb-44cd-99a0-1a19fbe8b184 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4f9dac6d-1e24-4618-b802-96fdd6306c30" status: 204 len: 0 microversion: 2.1 time: 0.271092 Sep 16 12:58:13.265718 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1443/2967] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:58:12 2022] DELETE /compute/v2.1/servers/4f9dac6d-1e24-4618-b802-96fdd6306c30 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:58:13.271723 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4d373938-aec7-46c2-8d38-44c6e1cb9797 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:13.272486 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-4d373938-aec7-46c2-8d38-44c6e1cb9797 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 536f2ffa-d5a1-4060-9ef1-f305cf164fd3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:13.282435 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4d373938-aec7-46c2-8d38-44c6e1cb9797 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:13.283229 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4d373938-aec7-46c2-8d38-44c6e1cb9797 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:13.283841 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4d373938-aec7-46c2-8d38-44c6e1cb9797 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:13.285117 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4d373938-aec7-46c2-8d38-44c6e1cb9797 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:13.285587 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4d373938-aec7-46c2-8d38-44c6e1cb9797 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:13.286022 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4d373938-aec7-46c2-8d38-44c6e1cb9797 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:13.321782 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-268ac4f1-77fe-4ca3-994d-60adb855fa29 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:13.333664 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-268ac4f1-77fe-4ca3-994d-60adb855fa29 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd" status: 200 len: 1313 microversion: 2.1 time: 0.267170 Sep 16 12:58:13.334470 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1525/2968] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:13 2022] GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:13.353157 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e2d273d5-eaa9-45c5-9294-1f8cb888fd0a tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:13.353797 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e2d273d5-eaa9-45c5-9294-1f8cb888fd0a tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: 5f30c650-f49a-419b-acfe-165d9886e897] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:13.361293 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2d273d5-eaa9-45c5-9294-1f8cb888fd0a tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:13.361711 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2d273d5-eaa9-45c5-9294-1f8cb888fd0a tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:13.362329 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2d273d5-eaa9-45c5-9294-1f8cb888fd0a tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:13.363335 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2d273d5-eaa9-45c5-9294-1f8cb888fd0a tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:13.364011 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2d273d5-eaa9-45c5-9294-1f8cb888fd0a tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:13.364622 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2d273d5-eaa9-45c5-9294-1f8cb888fd0a tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:13.782411 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4d373938-aec7-46c2-8d38-44c6e1cb9797 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:13.801421 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4d373938-aec7-46c2-8d38-44c6e1cb9797 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3" status: 200 len: 1355 microversion: 2.1 time: 0.533143 Sep 16 12:58:13.818204 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e2d273d5-eaa9-45c5-9294-1f8cb888fd0a tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ec543501c49daaa37af078622626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd30c33cb19d47278478aa2340859920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:13.823807 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1444/2969] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:13 2022] GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3 => generated 1355 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:13.830921 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e2d273d5-eaa9-45c5-9294-1f8cb888fd0a tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "GET /compute/v2.1/servers/5f30c650-f49a-419b-acfe-165d9886e897" status: 200 len: 1513 microversion: 2.1 time: 0.495084 Sep 16 12:58:13.837867 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1526/2970] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:13 2022] GET /compute/v2.1/servers/5f30c650-f49a-419b-acfe-165d9886e897 => generated 1513 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:14.012431 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ddd824c9-21ac-4ab7-ac3c-8da9be12a658 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:14.013503 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ddd824c9-21ac-4ab7-ac3c-8da9be12a658 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 2998767f-d217-40ea-a487-60c0c4ade426] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:14.024831 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ddd824c9-21ac-4ab7-ac3c-8da9be12a658 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:14.025934 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ddd824c9-21ac-4ab7-ac3c-8da9be12a658 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:14.027092 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ddd824c9-21ac-4ab7-ac3c-8da9be12a658 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:14.028914 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ddd824c9-21ac-4ab7-ac3c-8da9be12a658 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:14.029540 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ddd824c9-21ac-4ab7-ac3c-8da9be12a658 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:14.045644 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ddd824c9-21ac-4ab7-ac3c-8da9be12a658 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:14.094094 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-73c714ad-63dd-4c6c-ade3-5599c65c6852 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:14.094955 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-73c714ad-63dd-4c6c-ade3-5599c65c6852 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:14.108246 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73c714ad-63dd-4c6c-ade3-5599c65c6852 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:14.108981 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73c714ad-63dd-4c6c-ade3-5599c65c6852 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:14.109599 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73c714ad-63dd-4c6c-ade3-5599c65c6852 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:14.110472 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73c714ad-63dd-4c6c-ade3-5599c65c6852 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:14.111073 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73c714ad-63dd-4c6c-ade3-5599c65c6852 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:14.116831 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73c714ad-63dd-4c6c-ade3-5599c65c6852 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:14.568575 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-73c714ad-63dd-4c6c-ade3-5599c65c6852 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:14.586060 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-73c714ad-63dd-4c6c-ade3-5599c65c6852 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:14.591277 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-73c714ad-63dd-4c6c-ade3-5599c65c6852 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:14.597992 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-73c714ad-63dd-4c6c-ade3-5599c65c6852 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1487 microversion: 2.25 time: 0.508055 Sep 16 12:58:14.599273 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1527/2971] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:14 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1487 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:58:14.614048 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5f3501c3-2d61-4ca4-bc6e-32203ff27b06 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:14.618320 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5f3501c3-2d61-4ca4-bc6e-32203ff27b06 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: e8b6a81c-dbec-452e-bd82-a4c86b9c44fd] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:14.647517 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f3501c3-2d61-4ca4-bc6e-32203ff27b06 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:14.653421 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ddd824c9-21ac-4ab7-ac3c-8da9be12a658 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37316c1f04764255a2a9466676502c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e940a963f7740dea44034d06e8c2a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:14.653883 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f3501c3-2d61-4ca4-bc6e-32203ff27b06 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:14.655884 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f3501c3-2d61-4ca4-bc6e-32203ff27b06 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:14.656688 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f3501c3-2d61-4ca4-bc6e-32203ff27b06 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:14.657154 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f3501c3-2d61-4ca4-bc6e-32203ff27b06 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:14.661200 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f3501c3-2d61-4ca4-bc6e-32203ff27b06 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:14.661634 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ddd824c9-21ac-4ab7-ac3c-8da9be12a658 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "GET /compute/v2.1/servers/2998767f-d217-40ea-a487-60c0c4ade426" status: 200 len: 1513 microversion: 2.1 time: 0.654097 Sep 16 12:58:14.671627 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1445/2972] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:14 2022] GET /compute/v2.1/servers/2998767f-d217-40ea-a487-60c0c4ade426 => generated 1513 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:14.778899 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-a4ac1387-972e-484d-9f72-e02c81c20f5c req-e5593c10-e7ef-4e41-b16e-f42265bc4ede service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8b6a81c-dbec-452e-bd82-a4c86b9c44fd", "tag": "2467419c-0246-4695-9b97-df325e585a17"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:58:14.791351 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-a4ac1387-972e-484d-9f72-e02c81c20f5c req-e5593c10-e7ef-4e41-b16e-f42265bc4ede service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:14.792411 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-a4ac1387-972e-484d-9f72-e02c81c20f5c req-e5593c10-e7ef-4e41-b16e-f42265bc4ede service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:14.793084 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-a4ac1387-972e-484d-9f72-e02c81c20f5c req-e5593c10-e7ef-4e41-b16e-f42265bc4ede service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:14.808435 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-a4ac1387-972e-484d-9f72-e02c81c20f5c req-e5593c10-e7ef-4e41-b16e-f42265bc4ede service nova] Creating event network-changed:2467419c-0246-4695-9b97-df325e585a17 for instance e8b6a81c-dbec-452e-bd82-a4c86b9c44fd on n-h2-858094-4 Sep 16 12:58:14.814217 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-a4ac1387-972e-484d-9f72-e02c81c20f5c req-e5593c10-e7ef-4e41-b16e-f42265bc4ede service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039800 Sep 16 12:58:14.815656 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1446/2973] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:58:14.834347 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7f75c162-9407-47eb-b1a3-e91e23058bdc tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:14.836384 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7f75c162-9407-47eb-b1a3-e91e23058bdc tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 536f2ffa-d5a1-4060-9ef1-f305cf164fd3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:14.852159 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7f75c162-9407-47eb-b1a3-e91e23058bdc tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:14.854889 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7f75c162-9407-47eb-b1a3-e91e23058bdc tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:14.856422 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7f75c162-9407-47eb-b1a3-e91e23058bdc tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:14.857358 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7f75c162-9407-47eb-b1a3-e91e23058bdc tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:14.859765 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7f75c162-9407-47eb-b1a3-e91e23058bdc tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:14.860409 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7f75c162-9407-47eb-b1a3-e91e23058bdc tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:15.269661 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5f3501c3-2d61-4ca4-bc6e-32203ff27b06 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:15.287166 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5f3501c3-2d61-4ca4-bc6e-32203ff27b06 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd" status: 200 len: 1313 microversion: 2.1 time: 0.684384 Sep 16 12:58:15.287793 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1528/2974] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:14 2022] GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd => generated 1313 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:15.302588 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3420ac4a-09c5-456f-95b8-fd4e9b997951 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:15.305632 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3420ac4a-09c5-456f-95b8-fd4e9b997951 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: 5f30c650-f49a-419b-acfe-165d9886e897] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:15.321914 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3420ac4a-09c5-456f-95b8-fd4e9b997951 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:15.322438 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3420ac4a-09c5-456f-95b8-fd4e9b997951 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:15.322887 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3420ac4a-09c5-456f-95b8-fd4e9b997951 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:15.323736 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3420ac4a-09c5-456f-95b8-fd4e9b997951 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:15.324239 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3420ac4a-09c5-456f-95b8-fd4e9b997951 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:15.324659 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3420ac4a-09c5-456f-95b8-fd4e9b997951 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:15.535185 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7f75c162-9407-47eb-b1a3-e91e23058bdc tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:15.548225 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7f75c162-9407-47eb-b1a3-e91e23058bdc tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3" status: 200 len: 1355 microversion: 2.1 time: 0.724372 Sep 16 12:58:15.548832 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1447/2975] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:14 2022] GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3 => generated 1355 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:15.623367 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d41379fb-30ec-4889-9965-fd814cf169ca tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:15.623987 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d41379fb-30ec-4889-9965-fd814cf169ca tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:15.631994 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d41379fb-30ec-4889-9965-fd814cf169ca tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:15.632513 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d41379fb-30ec-4889-9965-fd814cf169ca tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:15.633149 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d41379fb-30ec-4889-9965-fd814cf169ca tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:15.634698 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d41379fb-30ec-4889-9965-fd814cf169ca tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:15.636546 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d41379fb-30ec-4889-9965-fd814cf169ca tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:15.637185 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d41379fb-30ec-4889-9965-fd814cf169ca tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:16.592664 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3420ac4a-09c5-456f-95b8-fd4e9b997951 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ec543501c49daaa37af078622626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd30c33cb19d47278478aa2340859920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:16.610473 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3420ac4a-09c5-456f-95b8-fd4e9b997951 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "GET /compute/v2.1/servers/5f30c650-f49a-419b-acfe-165d9886e897" status: 200 len: 1513 microversion: 2.1 time: 1.321561 Sep 16 12:58:16.612840 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1529/2976] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:15 2022] GET /compute/v2.1/servers/5f30c650-f49a-419b-acfe-165d9886e897 => generated 1513 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:16.620305 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9119b633-c831-4fd3-ad48-6570e643b455 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:16.621157 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9119b633-c831-4fd3-ad48-6570e643b455 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 2998767f-d217-40ea-a487-60c0c4ade426] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:16.630860 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9119b633-c831-4fd3-ad48-6570e643b455 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:16.632101 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9119b633-c831-4fd3-ad48-6570e643b455 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:16.632936 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9119b633-c831-4fd3-ad48-6570e643b455 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:16.634973 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9119b633-c831-4fd3-ad48-6570e643b455 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:16.636478 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9119b633-c831-4fd3-ad48-6570e643b455 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:16.637374 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9119b633-c831-4fd3-ad48-6570e643b455 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:16.737847 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9119b633-c831-4fd3-ad48-6570e643b455 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:16.738760 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9119b633-c831-4fd3-ad48-6570e643b455 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:16.739436 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9119b633-c831-4fd3-ad48-6570e643b455 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:16.740056 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-9119b633-c831-4fd3-ad48-6570e643b455 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lazy-loading 'fault' on Instance uuid 2998767f-d217-40ea-a487-60c0c4ade426 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:58:16.886894 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d41379fb-30ec-4889-9965-fd814cf169ca tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:16.899910 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d41379fb-30ec-4889-9965-fd814cf169ca tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:16.900973 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9119b633-c831-4fd3-ad48-6570e643b455 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37316c1f04764255a2a9466676502c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e940a963f7740dea44034d06e8c2a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:16.902979 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d41379fb-30ec-4889-9965-fd814cf169ca tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:16.905517 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d41379fb-30ec-4889-9965-fd814cf169ca tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1487 microversion: 2.25 time: 1.285665 Sep 16 12:58:16.906704 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1448/2977] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:15 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1487 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:58:16.909815 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9119b633-c831-4fd3-ad48-6570e643b455 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "GET /compute/v2.1/servers/2998767f-d217-40ea-a487-60c0c4ade426" status: 200 len: 1308 microversion: 2.1 time: 0.295667 Sep 16 12:58:16.925877 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1530/2978] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:16 2022] GET /compute/v2.1/servers/2998767f-d217-40ea-a487-60c0c4ade426 => generated 1308 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:16.930244 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-26d314f5-e020-4e51-949d-3be1c03d3efa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:16.932943 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a4b9c07d-61ee-4db3-872a-d78cb044fe18 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:16.933241 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-26d314f5-e020-4e51-949d-3be1c03d3efa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: e8b6a81c-dbec-452e-bd82-a4c86b9c44fd] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:16.933640 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a4b9c07d-61ee-4db3-872a-d78cb044fe18 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 536f2ffa-d5a1-4060-9ef1-f305cf164fd3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:16.941220 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4b9c07d-61ee-4db3-872a-d78cb044fe18 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:16.941722 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4b9c07d-61ee-4db3-872a-d78cb044fe18 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:16.941929 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-26d314f5-e020-4e51-949d-3be1c03d3efa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:16.942157 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4b9c07d-61ee-4db3-872a-d78cb044fe18 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:16.942747 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-26d314f5-e020-4e51-949d-3be1c03d3efa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:16.943355 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-26d314f5-e020-4e51-949d-3be1c03d3efa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:16.943645 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4b9c07d-61ee-4db3-872a-d78cb044fe18 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:16.944151 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4b9c07d-61ee-4db3-872a-d78cb044fe18 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:16.944592 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4b9c07d-61ee-4db3-872a-d78cb044fe18 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:16.944775 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-26d314f5-e020-4e51-949d-3be1c03d3efa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:16.946417 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-26d314f5-e020-4e51-949d-3be1c03d3efa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:16.948291 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-26d314f5-e020-4e51-949d-3be1c03d3efa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:17.426410 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-26d314f5-e020-4e51-949d-3be1c03d3efa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:17.434675 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-26d314f5-e020-4e51-949d-3be1c03d3efa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd" status: 200 len: 1313 microversion: 2.1 time: 0.526475 Sep 16 12:58:17.435261 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1449/2979] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:16 2022] GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd => generated 1313 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:17.456474 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-4351c2cc-552e-4ec3-81f4-edb8e1d1e214 req-ae33c232-dd29-4fb2-aa74-7c17a3fd8819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2998767f-d217-40ea-a487-60c0c4ade426", "name": "network-vif-deleted", "tag": "5cef43f7-b56b-46c5-a6b2-06877f434cd6"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:58:17.467375 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a4b9c07d-61ee-4db3-872a-d78cb044fe18 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:17.484485 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-4351c2cc-552e-4ec3-81f4-edb8e1d1e214 req-ae33c232-dd29-4fb2-aa74-7c17a3fd8819 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:17.485199 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-4351c2cc-552e-4ec3-81f4-edb8e1d1e214 req-ae33c232-dd29-4fb2-aa74-7c17a3fd8819 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:17.485784 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-4351c2cc-552e-4ec3-81f4-edb8e1d1e214 req-ae33c232-dd29-4fb2-aa74-7c17a3fd8819 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:17.491754 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a4b9c07d-61ee-4db3-872a-d78cb044fe18 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3" status: 200 len: 1355 microversion: 2.1 time: 0.579976 Sep 16 12:58:17.501133 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1531/2980] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:16 2022] GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3 => generated 1355 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:17.523541 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-4351c2cc-552e-4ec3-81f4-edb8e1d1e214 req-ae33c232-dd29-4fb2-aa74-7c17a3fd8819 service nova] Creating event network-vif-deleted:5cef43f7-b56b-46c5-a6b2-06877f434cd6 for instance 2998767f-d217-40ea-a487-60c0c4ade426 on n-h2-858094-4 Sep 16 12:58:17.530408 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-4351c2cc-552e-4ec3-81f4-edb8e1d1e214 req-ae33c232-dd29-4fb2-aa74-7c17a3fd8819 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089999 Sep 16 12:58:17.531202 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1450/2981] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:58:17.636519 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-59705078-fdcf-4ce6-9a28-a07796ef4d89 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:17.638520 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-59705078-fdcf-4ce6-9a28-a07796ef4d89 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: 5f30c650-f49a-419b-acfe-165d9886e897] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:17.646679 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59705078-fdcf-4ce6-9a28-a07796ef4d89 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:17.647167 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59705078-fdcf-4ce6-9a28-a07796ef4d89 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:17.647602 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59705078-fdcf-4ce6-9a28-a07796ef4d89 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:17.652696 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59705078-fdcf-4ce6-9a28-a07796ef4d89 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:17.655229 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59705078-fdcf-4ce6-9a28-a07796ef4d89 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:17.655682 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59705078-fdcf-4ce6-9a28-a07796ef4d89 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:17.933823 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-70a7998b-ff77-4438-bac9-dc4379432e4d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:17.934538 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-70a7998b-ff77-4438-bac9-dc4379432e4d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:17.955637 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-70a7998b-ff77-4438-bac9-dc4379432e4d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:17.956160 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-70a7998b-ff77-4438-bac9-dc4379432e4d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:17.963058 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-70a7998b-ff77-4438-bac9-dc4379432e4d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:17.967824 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-70a7998b-ff77-4438-bac9-dc4379432e4d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:17.968513 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-70a7998b-ff77-4438-bac9-dc4379432e4d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:17.971102 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-70a7998b-ff77-4438-bac9-dc4379432e4d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:18.022838 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:58:18.110492 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-59705078-fdcf-4ce6-9a28-a07796ef4d89 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ec543501c49daaa37af078622626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd30c33cb19d47278478aa2340859920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:18.124337 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-59705078-fdcf-4ce6-9a28-a07796ef4d89 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "GET /compute/v2.1/servers/5f30c650-f49a-419b-acfe-165d9886e897" status: 200 len: 1471 microversion: 2.1 time: 0.491876 Sep 16 12:58:18.142893 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1532/2982] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:17 2022] GET /compute/v2.1/servers/5f30c650-f49a-419b-acfe-165d9886e897 => generated 1471 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:18.150738 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8c9ef3f9-c8d8-4e8c-9253-3b40df5a6151 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:18.151768 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8c9ef3f9-c8d8-4e8c-9253-3b40df5a6151 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 2998767f-d217-40ea-a487-60c0c4ade426] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:18.158714 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c9ef3f9-c8d8-4e8c-9253-3b40df5a6151 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:18.159447 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c9ef3f9-c8d8-4e8c-9253-3b40df5a6151 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:18.160249 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c9ef3f9-c8d8-4e8c-9253-3b40df5a6151 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:18.161225 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c9ef3f9-c8d8-4e8c-9253-3b40df5a6151 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:18.162090 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c9ef3f9-c8d8-4e8c-9253-3b40df5a6151 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:18.162810 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c9ef3f9-c8d8-4e8c-9253-3b40df5a6151 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:18.221602 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-8c9ef3f9-c8d8-4e8c-9253-3b40df5a6151 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] HTTP exception thrown: Instance 2998767f-d217-40ea-a487-60c0c4ade426 could not be found. Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8c9ef3f9-c8d8-4e8c-9253-3b40df5a6151 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Request method failure captured: Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/2998767f-d217-40ea-a487-60c0c4ade426 HTTP/1.1 Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHIalnINBY1-zqWQofBE2D3H64AaHfodQGtDd1bSGwTGIhuxJS-MWKqcTwNx2hUW0ZcE_WJr2Lb-R7wBCt6e6GC5LIGI5spYg_UklUbUDRHAOwUe2LOKZmRVlZUrNnbv7UuwbVyzzrO6HlnpUWebF2MJ7b7YLf90XqCY1Ng8rb6k9ko Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 6e940a963f7740dea44034d06e8c2a77 Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-VolumesAdminNegativeTest-1119818426 Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6e940a963f7740dea44034d06e8c2a77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6e940a963f7740dea44034d06e8c2a77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6e940a963f7740dea44034d06e8c2a77", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6e940a963f7740dea44034d06e8c2a77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-VolumesAdminNegativeTest-1119818426 Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 6e940a963f7740dea44034d06e8c2a77 Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1119818426 Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-VolumesAdminNegativeTest-1119818426-project Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 37316c1f04764255a2a9466676502c35 Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-VolumesAdminNegativeTest-1119818426-project Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 2998767f-d217-40ea-a487-60c0c4ade426 could not be found. Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '2998767f-d217-40ea-a487-60c0c4ade426'} Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2998767f-d217-40ea-a487-60c0c4ade426 could not be found. Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2998767f-d217-40ea-a487-60c0c4ade426 could not be found. Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:58:18.226113 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:18.232230 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:18.232230 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:58:18.232230 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:58:18.232230 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:58:18.232230 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:58:18.232230 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2998767f-d217-40ea-a487-60c0c4ade426 could not be found. Sep 16 12:58:18.232230 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:18.232230 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8c9ef3f9-c8d8-4e8c-9253-3b40df5a6151 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Returning 404 to user: Instance 2998767f-d217-40ea-a487-60c0c4ade426 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:58:18.232230 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8c9ef3f9-c8d8-4e8c-9253-3b40df5a6151 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "GET /compute/v2.1/servers/2998767f-d217-40ea-a487-60c0c4ade426" status: 404 len: 111 microversion: 2.1 time: 0.083344 Sep 16 12:58:18.232230 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1533/2983] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:18 2022] GET /compute/v2.1/servers/2998767f-d217-40ea-a487-60c0c4ade426 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:58:18.243177 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-4848f6fc-eeb5-484a-871d-4919908a7621 req-92106117-f379-4f12-8d0b-bf86ef4f592c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f9dac6d-1e24-4618-b802-96fdd6306c30", "name": "network-vif-deleted", "tag": "31028850-a929-4e17-a925-e55dedb937e0"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:58:18.290133 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4848f6fc-eeb5-484a-871d-4919908a7621 req-92106117-f379-4f12-8d0b-bf86ef4f592c service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:18.290969 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4848f6fc-eeb5-484a-871d-4919908a7621 req-92106117-f379-4f12-8d0b-bf86ef4f592c service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:18.292774 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4848f6fc-eeb5-484a-871d-4919908a7621 req-92106117-f379-4f12-8d0b-bf86ef4f592c service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:18.334803 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-4848f6fc-eeb5-484a-871d-4919908a7621 req-92106117-f379-4f12-8d0b-bf86ef4f592c service nova] Creating event network-vif-deleted:31028850-a929-4e17-a925-e55dedb937e0 for instance 4f9dac6d-1e24-4618-b802-96fdd6306c30 on n-h1-858094-4 Sep 16 12:58:18.345865 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-4848f6fc-eeb5-484a-871d-4919908a7621 req-92106117-f379-4f12-8d0b-bf86ef4f592c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114368 Sep 16 12:58:18.349058 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1534/2984] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:58:18.458430 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-958c9915-ff51-42b3-a13c-1e37f8b01a19 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:18.459127 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-958c9915-ff51-42b3-a13c-1e37f8b01a19 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: e8b6a81c-dbec-452e-bd82-a4c86b9c44fd] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:18.469180 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=14 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:58:18.492515 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-958c9915-ff51-42b3-a13c-1e37f8b01a19 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:18.492515 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-958c9915-ff51-42b3-a13c-1e37f8b01a19 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:18.492515 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-958c9915-ff51-42b3-a13c-1e37f8b01a19 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:18.492515 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-958c9915-ff51-42b3-a13c-1e37f8b01a19 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:18.492515 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-958c9915-ff51-42b3-a13c-1e37f8b01a19 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:18.492515 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-958c9915-ff51-42b3-a13c-1e37f8b01a19 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:18.709365 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-70a7998b-ff77-4438-bac9-dc4379432e4d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:18.725513 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-70a7998b-ff77-4438-bac9-dc4379432e4d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:18.727798 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-70a7998b-ff77-4438-bac9-dc4379432e4d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:18.732601 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-70a7998b-ff77-4438-bac9-dc4379432e4d tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1487 microversion: 2.25 time: 0.804578 Sep 16 12:58:18.733798 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1451/2985] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:17 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1487 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:58:18.762243 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-61d1a23c-9c36-47b2-8baa-40b0e39f92bf tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:18.763380 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-61d1a23c-9c36-47b2-8baa-40b0e39f92bf tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 536f2ffa-d5a1-4060-9ef1-f305cf164fd3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:18.779709 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-61d1a23c-9c36-47b2-8baa-40b0e39f92bf tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:18.784897 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-61d1a23c-9c36-47b2-8baa-40b0e39f92bf tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:18.786907 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-61d1a23c-9c36-47b2-8baa-40b0e39f92bf tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:18.787960 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-61d1a23c-9c36-47b2-8baa-40b0e39f92bf tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:18.793693 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-61d1a23c-9c36-47b2-8baa-40b0e39f92bf tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:18.794537 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-61d1a23c-9c36-47b2-8baa-40b0e39f92bf tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:18.798042 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:58:19.378262 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-958c9915-ff51-42b3-a13c-1e37f8b01a19 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:19.411385 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-958c9915-ff51-42b3-a13c-1e37f8b01a19 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd" status: 200 len: 1313 microversion: 2.1 time: 0.957056 Sep 16 12:58:19.415430 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1535/2986] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:18 2022] GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd => generated 1313 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:19.421526 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-f177c1da-3dea-440e-8cab-a3a7c78b3586 req-cdc0ec18-d3d2-48f8-91a3-bf77416f95e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "536f2ffa-d5a1-4060-9ef1-f305cf164fd3", "name": "network-vif-plugged", "status": "completed", "tag": "7d29c55a-fbb0-4e50-9719-1dcce2aaef81"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:58:19.440329 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f177c1da-3dea-440e-8cab-a3a7c78b3586 req-cdc0ec18-d3d2-48f8-91a3-bf77416f95e3 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:19.441133 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f177c1da-3dea-440e-8cab-a3a7c78b3586 req-cdc0ec18-d3d2-48f8-91a3-bf77416f95e3 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:19.441728 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f177c1da-3dea-440e-8cab-a3a7c78b3586 req-cdc0ec18-d3d2-48f8-91a3-bf77416f95e3 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:19.457965 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-f177c1da-3dea-440e-8cab-a3a7c78b3586 req-cdc0ec18-d3d2-48f8-91a3-bf77416f95e3 service nova] Creating event network-vif-plugged:7d29c55a-fbb0-4e50-9719-1dcce2aaef81 for instance 536f2ffa-d5a1-4060-9ef1-f305cf164fd3 on n-h2-858094-4 Sep 16 12:58:19.466804 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-f177c1da-3dea-440e-8cab-a3a7c78b3586 req-cdc0ec18-d3d2-48f8-91a3-bf77416f95e3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049615 Sep 16 12:58:19.473676 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1536/2987] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:58:19.491483 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a841bc97-ca39-48c2-85a5-2e569c63fbc5 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:19.492732 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a841bc97-ca39-48c2-85a5-2e569c63fbc5 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: 5f30c650-f49a-419b-acfe-165d9886e897] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:19.510826 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-61d1a23c-9c36-47b2-8baa-40b0e39f92bf tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:19.514181 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a841bc97-ca39-48c2-85a5-2e569c63fbc5 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:19.514913 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a841bc97-ca39-48c2-85a5-2e569c63fbc5 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:19.515627 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a841bc97-ca39-48c2-85a5-2e569c63fbc5 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:19.521320 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a841bc97-ca39-48c2-85a5-2e569c63fbc5 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:19.522931 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a841bc97-ca39-48c2-85a5-2e569c63fbc5 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:19.524312 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a841bc97-ca39-48c2-85a5-2e569c63fbc5 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:19.532719 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-61d1a23c-9c36-47b2-8baa-40b0e39f92bf tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3" status: 200 len: 1355 microversion: 2.1 time: 0.788785 Sep 16 12:58:19.535032 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1452/2988] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:18 2022] GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3 => generated 1355 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:19.604219 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a841bc97-ca39-48c2-85a5-2e569c63fbc5 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:19.604972 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a841bc97-ca39-48c2-85a5-2e569c63fbc5 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:19.605658 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a841bc97-ca39-48c2-85a5-2e569c63fbc5 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:19.606341 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-a841bc97-ca39-48c2-85a5-2e569c63fbc5 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lazy-loading 'fault' on Instance uuid 5f30c650-f49a-419b-acfe-165d9886e897 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:58:19.755870 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a841bc97-ca39-48c2-85a5-2e569c63fbc5 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ec543501c49daaa37af078622626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd30c33cb19d47278478aa2340859920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:19.763913 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f358395b-cff0-4dad-9c52-9560ac185ac0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:19.764820 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f358395b-cff0-4dad-9c52-9560ac185ac0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:19.782120 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f358395b-cff0-4dad-9c52-9560ac185ac0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:19.783103 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a841bc97-ca39-48c2-85a5-2e569c63fbc5 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "GET /compute/v2.1/servers/5f30c650-f49a-419b-acfe-165d9886e897" status: 200 len: 1308 microversion: 2.1 time: 0.303177 Sep 16 12:58:19.783387 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f358395b-cff0-4dad-9c52-9560ac185ac0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:19.784049 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f358395b-cff0-4dad-9c52-9560ac185ac0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:19.785024 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f358395b-cff0-4dad-9c52-9560ac185ac0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:19.785702 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f358395b-cff0-4dad-9c52-9560ac185ac0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:19.786366 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f358395b-cff0-4dad-9c52-9560ac185ac0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:19.787029 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1537/2989] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:19 2022] GET /compute/v2.1/servers/5f30c650-f49a-419b-acfe-165d9886e897 => generated 1308 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:20.046738 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f358395b-cff0-4dad-9c52-9560ac185ac0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:20.057397 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f358395b-cff0-4dad-9c52-9560ac185ac0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:20.072276 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f358395b-cff0-4dad-9c52-9560ac185ac0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:20.084997 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f358395b-cff0-4dad-9c52-9560ac185ac0 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1477 microversion: 2.25 time: 0.316249 Sep 16 12:58:20.087734 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1453/2990] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:19 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1477 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:58:20.117745 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-81d43e33-7987-47b3-abbd-1b1644696616 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Calling method '.version_select at 0x7f1039a331f0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:20.147145 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81d43e33-7987-47b3-abbd-1b1644696616 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:20.150463 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81d43e33-7987-47b3-abbd-1b1644696616 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:20.152078 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81d43e33-7987-47b3-abbd-1b1644696616 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:20.170537 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-81d43e33-7987-47b3-abbd-1b1644696616 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] 10.222.0.67 "GET /compute/v2.1/os-migrations" status: 200 len: 1944 microversion: 2.25 time: 0.062038 Sep 16 12:58:20.182198 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1538/2991] 10.222.0.67 () {60 vars in 1184 bytes} [Fri Sep 16 12:58:20 2022] GET /compute/v2.1/os-migrations => generated 1944 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:58:20.189565 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3c7e6904-85c2-4e95-9506-5e0b6dc0eb65 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:20.190747 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3c7e6904-85c2-4e95-9506-5e0b6dc0eb65 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:20.218658 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3c7e6904-85c2-4e95-9506-5e0b6dc0eb65 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:20.222518 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3c7e6904-85c2-4e95-9506-5e0b6dc0eb65 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:20.225579 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3c7e6904-85c2-4e95-9506-5e0b6dc0eb65 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:20.227465 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3c7e6904-85c2-4e95-9506-5e0b6dc0eb65 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:20.251166 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3c7e6904-85c2-4e95-9506-5e0b6dc0eb65 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:20.253982 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3c7e6904-85c2-4e95-9506-5e0b6dc0eb65 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:20.393785 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-fd95d8cc-6c16-4133-80a6-94c2fae62eeb req-de455efe-031c-4162-a197-3256b2ca82ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f30c650-f49a-419b-acfe-165d9886e897", "name": "network-vif-deleted", "tag": "c26f96da-286f-479c-9e95-6d00e8c892e4"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:58:20.428634 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-fd95d8cc-6c16-4133-80a6-94c2fae62eeb req-de455efe-031c-4162-a197-3256b2ca82ac service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:20.429322 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-fd95d8cc-6c16-4133-80a6-94c2fae62eeb req-de455efe-031c-4162-a197-3256b2ca82ac service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:20.429855 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-fd95d8cc-6c16-4133-80a6-94c2fae62eeb req-de455efe-031c-4162-a197-3256b2ca82ac service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:20.486018 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-fd95d8cc-6c16-4133-80a6-94c2fae62eeb req-de455efe-031c-4162-a197-3256b2ca82ac service nova] Creating event network-vif-deleted:c26f96da-286f-479c-9e95-6d00e8c892e4 for instance 5f30c650-f49a-419b-acfe-165d9886e897 on n-h1-858094-4 Sep 16 12:58:20.501270 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-fd95d8cc-6c16-4133-80a6-94c2fae62eeb req-de455efe-031c-4162-a197-3256b2ca82ac service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116996 Sep 16 12:58:20.501904 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1539/2992] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 16 12:58:20.539879 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a4047234-3a49-4a2c-8b23-72f10ae79227 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:20.543954 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a4047234-3a49-4a2c-8b23-72f10ae79227 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: e8b6a81c-dbec-452e-bd82-a4c86b9c44fd] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:20.579181 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4047234-3a49-4a2c-8b23-72f10ae79227 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:20.583270 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4047234-3a49-4a2c-8b23-72f10ae79227 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:20.584874 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4047234-3a49-4a2c-8b23-72f10ae79227 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:20.588510 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4047234-3a49-4a2c-8b23-72f10ae79227 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:20.588986 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4047234-3a49-4a2c-8b23-72f10ae79227 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:20.589436 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4047234-3a49-4a2c-8b23-72f10ae79227 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:20.691687 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-3c7e6904-85c2-4e95-9506-5e0b6dc0eb65 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] Lazy-loading 'services' on Instance uuid 3b229371-5f66-466c-a96b-2f668a855aa0 {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:58:20.734817 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3c7e6904-85c2-4e95-9506-5e0b6dc0eb65 tempest-LiveAutoBlockMigrationV225Test-510613049 tempest-LiveAutoBlockMigrationV225Test-510613049-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1970 microversion: 2.25 time: 0.546618 Sep 16 12:58:20.745079 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1454/2993] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:20 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1970 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:58:20.771008 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c1b91274-26ef-482b-91cb-bf1f6935bea7 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:20.771888 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c1b91274-26ef-482b-91cb-bf1f6935bea7 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 536f2ffa-d5a1-4060-9ef1-f305cf164fd3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:20.779296 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c1b91274-26ef-482b-91cb-bf1f6935bea7 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:20.780011 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c1b91274-26ef-482b-91cb-bf1f6935bea7 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:20.780653 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c1b91274-26ef-482b-91cb-bf1f6935bea7 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:20.782825 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c1b91274-26ef-482b-91cb-bf1f6935bea7 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:20.783504 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c1b91274-26ef-482b-91cb-bf1f6935bea7 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:20.784096 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c1b91274-26ef-482b-91cb-bf1f6935bea7 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:21.172234 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a4047234-3a49-4a2c-8b23-72f10ae79227 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:21.188838 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a4047234-3a49-4a2c-8b23-72f10ae79227 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd" status: 200 len: 1313 microversion: 2.1 time: 0.682556 Sep 16 12:58:21.193676 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1540/2994] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:20 2022] GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd => generated 1313 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:21.205040 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-955f83dc-8c46-4dbd-bcde-86f892348196 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:21.205541 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-955f83dc-8c46-4dbd-bcde-86f892348196 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:21.217603 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-955f83dc-8c46-4dbd-bcde-86f892348196 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:21.218094 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-955f83dc-8c46-4dbd-bcde-86f892348196 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:21.218533 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-955f83dc-8c46-4dbd-bcde-86f892348196 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:21.219239 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-955f83dc-8c46-4dbd-bcde-86f892348196 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:21.219692 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-955f83dc-8c46-4dbd-bcde-86f892348196 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:21.224153 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-955f83dc-8c46-4dbd-bcde-86f892348196 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:21.272225 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:58:21.303444 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-955f83dc-8c46-4dbd-bcde-86f892348196 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:58:21.496526 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-955f83dc-8c46-4dbd-bcde-86f892348196 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 204 len: 0 microversion: 2.25 time: 0.299098 Sep 16 12:58:21.497273 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1541/2995] 10.222.0.67 () {60 vars in 1280 bytes} [Fri Sep 16 12:58:21 2022] DELETE /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 12:58:21.510474 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-678fe9d9-ea59-4307-9ab4-6d4e02f93705 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:21.519228 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-678fe9d9-ea59-4307-9ab4-6d4e02f93705 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: 5f30c650-f49a-419b-acfe-165d9886e897] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:21.531007 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-678fe9d9-ea59-4307-9ab4-6d4e02f93705 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:21.535336 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-678fe9d9-ea59-4307-9ab4-6d4e02f93705 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:21.536002 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-678fe9d9-ea59-4307-9ab4-6d4e02f93705 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:21.537106 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-678fe9d9-ea59-4307-9ab4-6d4e02f93705 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:21.537716 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-678fe9d9-ea59-4307-9ab4-6d4e02f93705 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:21.538453 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-678fe9d9-ea59-4307-9ab4-6d4e02f93705 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:21.555504 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-678fe9d9-ea59-4307-9ab4-6d4e02f93705 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] HTTP exception thrown: Instance 5f30c650-f49a-419b-acfe-165d9886e897 could not be found. Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-678fe9d9-ea59-4307-9ab4-6d4e02f93705 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Request method failure captured: Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/5f30c650-f49a-419b-acfe-165d9886e897 HTTP/1.1 Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHKjqySuVOQ5jD2QoK5mYesR3eA6gljjY0mul8zHL1_1C4wA_VPuog71SUEX1FJ7Ns-fqsfuk9SikN5wua3SqlZ2XDQgJZDqPvNqyjDG4R8GjLrAb6GOP4LBYP2vusJquCdMApCjLv56nBlUvTYCyFkrKs1m1h7lKrdSeVjIhVdjn6Q Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: bd30c33cb19d47278478aa2340859920 Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-MultipleCreateTestJSON-1059183008 Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bd30c33cb19d47278478aa2340859920"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/bd30c33cb19d47278478aa2340859920"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_bd30c33cb19d47278478aa2340859920", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bd30c33cb19d47278478aa2340859920"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-MultipleCreateTestJSON-1059183008 Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: bd30c33cb19d47278478aa2340859920 Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1059183008 Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-MultipleCreateTestJSON-1059183008-project Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 0e9ec543501c49daaa37af078622626e Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-MultipleCreateTestJSON-1059183008-project Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 5f30c650-f49a-419b-acfe-165d9886e897 could not be found. Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '5f30c650-f49a-419b-acfe-165d9886e897'} Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f30c650-f49a-419b-acfe-165d9886e897 could not be found. Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f30c650-f49a-419b-acfe-165d9886e897 could not be found. Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:58:21.557626 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:21.562143 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:21.562143 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:58:21.562143 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:58:21.562143 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:58:21.562143 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:58:21.562143 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f30c650-f49a-419b-acfe-165d9886e897 could not be found. Sep 16 12:58:21.562143 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:21.563965 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-678fe9d9-ea59-4307-9ab4-6d4e02f93705 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Returning 404 to user: Instance 5f30c650-f49a-419b-acfe-165d9886e897 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:58:21.565088 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-678fe9d9-ea59-4307-9ab4-6d4e02f93705 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "GET /compute/v2.1/servers/5f30c650-f49a-419b-acfe-165d9886e897" status: 404 len: 111 microversion: 2.1 time: 0.066768 Sep 16 12:58:21.569537 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1542/2996] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:21 2022] GET /compute/v2.1/servers/5f30c650-f49a-419b-acfe-165d9886e897 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:58:21.577441 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-db39b1cd-ae22-4d86-b67e-49a286767968 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:21.578500 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-db39b1cd-ae22-4d86-b67e-49a286767968 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:21.586407 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db39b1cd-ae22-4d86-b67e-49a286767968 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:21.587898 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db39b1cd-ae22-4d86-b67e-49a286767968 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:21.588795 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db39b1cd-ae22-4d86-b67e-49a286767968 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:21.589745 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db39b1cd-ae22-4d86-b67e-49a286767968 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:21.590573 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db39b1cd-ae22-4d86-b67e-49a286767968 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:21.591649 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db39b1cd-ae22-4d86-b67e-49a286767968 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:21.885692 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c1b91274-26ef-482b-91cb-bf1f6935bea7 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:21.906851 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c1b91274-26ef-482b-91cb-bf1f6935bea7 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3" status: 200 len: 1355 microversion: 2.1 time: 1.160532 Sep 16 12:58:21.907452 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1455/2997] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:20 2022] GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3 => generated 1355 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:21.923069 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0bb36f54-dbad-449a-b456-f9d2501a87f0 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:21.927061 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0bb36f54-dbad-449a-b456-f9d2501a87f0 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] [instance: 4f9dac6d-1e24-4618-b802-96fdd6306c30] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:21.940742 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0bb36f54-dbad-449a-b456-f9d2501a87f0 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:21.941244 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0bb36f54-dbad-449a-b456-f9d2501a87f0 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:21.941697 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0bb36f54-dbad-449a-b456-f9d2501a87f0 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:21.942403 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0bb36f54-dbad-449a-b456-f9d2501a87f0 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:21.942857 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0bb36f54-dbad-449a-b456-f9d2501a87f0 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:21.943280 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0bb36f54-dbad-449a-b456-f9d2501a87f0 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:21.980561 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-0bb36f54-dbad-449a-b456-f9d2501a87f0 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] HTTP exception thrown: Instance 4f9dac6d-1e24-4618-b802-96fdd6306c30 could not be found. Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0bb36f54-dbad-449a-b456-f9d2501a87f0 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Request method failure captured: Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/4f9dac6d-1e24-4618-b802-96fdd6306c30 HTTP/1.1 Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHKjqySuVOQ5jD2QoK5mYesR3eA6gljjY0mul8zHL1_1C4wA_VPuog71SUEX1FJ7Ns-fqsfuk9SikN5wua3SqlZ2XDQgJZDqPvNqyjDG4R8GjLrAb6GOP4LBYP2vusJquCdMApCjLv56nBlUvTYCyFkrKs1m1h7lKrdSeVjIhVdjn6Q Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: bd30c33cb19d47278478aa2340859920 Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-MultipleCreateTestJSON-1059183008 Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bd30c33cb19d47278478aa2340859920"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/bd30c33cb19d47278478aa2340859920"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_bd30c33cb19d47278478aa2340859920", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bd30c33cb19d47278478aa2340859920"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-MultipleCreateTestJSON-1059183008 Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: bd30c33cb19d47278478aa2340859920 Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1059183008 Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-MultipleCreateTestJSON-1059183008-project Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 0e9ec543501c49daaa37af078622626e Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-MultipleCreateTestJSON-1059183008-project Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance 4f9dac6d-1e24-4618-b802-96fdd6306c30 could not be found. Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '4f9dac6d-1e24-4618-b802-96fdd6306c30'} Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f9dac6d-1e24-4618-b802-96fdd6306c30 could not be found. Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f9dac6d-1e24-4618-b802-96fdd6306c30 could not be found. Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:58:21.982281 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:58:21.986828 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:21.986828 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:58:21.986828 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:58:21.986828 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:58:21.986828 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:58:21.986828 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f9dac6d-1e24-4618-b802-96fdd6306c30 could not be found. Sep 16 12:58:21.986828 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:58:21.986828 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0bb36f54-dbad-449a-b456-f9d2501a87f0 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] Returning 404 to user: Instance 4f9dac6d-1e24-4618-b802-96fdd6306c30 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:58:21.986828 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0bb36f54-dbad-449a-b456-f9d2501a87f0 tempest-MultipleCreateTestJSON-1059183008 tempest-MultipleCreateTestJSON-1059183008-project] 10.222.0.67 "GET /compute/v2.1/servers/4f9dac6d-1e24-4618-b802-96fdd6306c30" status: 404 len: 111 microversion: 2.1 time: 0.075085 Sep 16 12:58:22.000048 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1456/2998] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:21 2022] GET /compute/v2.1/servers/4f9dac6d-1e24-4618-b802-96fdd6306c30 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:58:22.004989 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-013bbd95-afdd-45f7-9cfe-884a08e292d9 req-20050cf5-e10a-4701-a261-7a45ee6ff2d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "536f2ffa-d5a1-4060-9ef1-f305cf164fd3", "name": "network-vif-plugged", "status": "completed", "tag": "e389c52d-c333-408c-a4a5-dd1fb810bd22"}, {"server_uuid": "536f2ffa-d5a1-4060-9ef1-f305cf164fd3", "name": "network-vif-plugged", "status": "completed", "tag": "0f8de272-9fd7-474d-85d6-e69716710172"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:58:22.030996 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-013bbd95-afdd-45f7-9cfe-884a08e292d9 req-20050cf5-e10a-4701-a261-7a45ee6ff2d2 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:22.031477 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-013bbd95-afdd-45f7-9cfe-884a08e292d9 req-20050cf5-e10a-4701-a261-7a45ee6ff2d2 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:22.031905 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-013bbd95-afdd-45f7-9cfe-884a08e292d9 req-20050cf5-e10a-4701-a261-7a45ee6ff2d2 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:22.067351 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-013bbd95-afdd-45f7-9cfe-884a08e292d9 req-20050cf5-e10a-4701-a261-7a45ee6ff2d2 service nova] Creating event network-vif-plugged:e389c52d-c333-408c-a4a5-dd1fb810bd22 for instance 536f2ffa-d5a1-4060-9ef1-f305cf164fd3 on n-h2-858094-4 Sep 16 12:58:22.067859 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-013bbd95-afdd-45f7-9cfe-884a08e292d9 req-20050cf5-e10a-4701-a261-7a45ee6ff2d2 service nova] Creating event network-vif-plugged:0f8de272-9fd7-474d-85d6-e69716710172 for instance 536f2ffa-d5a1-4060-9ef1-f305cf164fd3 on n-h2-858094-4 Sep 16 12:58:22.083442 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-013bbd95-afdd-45f7-9cfe-884a08e292d9 req-20050cf5-e10a-4701-a261-7a45ee6ff2d2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.082187 Sep 16 12:58:22.084070 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1457/2999] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:58:22.093253 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-db39b1cd-ae22-4d86-b67e-49a286767968 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:22.111310 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-db39b1cd-ae22-4d86-b67e-49a286767968 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:22.113751 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-db39b1cd-ae22-4d86-b67e-49a286767968 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:22.116220 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-db39b1cd-ae22-4d86-b67e-49a286767968 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1483 microversion: 2.25 time: 0.544615 Sep 16 12:58:22.120681 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1543/3000] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:21 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1483 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:58:22.212829 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2e3139a5-74ad-4dcd-86f1-e146d23b6d2c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:22.213738 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-2e3139a5-74ad-4dcd-86f1-e146d23b6d2c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: e8b6a81c-dbec-452e-bd82-a4c86b9c44fd] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:22.229358 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2e3139a5-74ad-4dcd-86f1-e146d23b6d2c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:22.230042 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2e3139a5-74ad-4dcd-86f1-e146d23b6d2c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:22.231668 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2e3139a5-74ad-4dcd-86f1-e146d23b6d2c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:22.232473 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2e3139a5-74ad-4dcd-86f1-e146d23b6d2c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:22.232940 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2e3139a5-74ad-4dcd-86f1-e146d23b6d2c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:22.233370 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2e3139a5-74ad-4dcd-86f1-e146d23b6d2c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:22.856938 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-2e3139a5-74ad-4dcd-86f1-e146d23b6d2c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:22.871962 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2e3139a5-74ad-4dcd-86f1-e146d23b6d2c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd" status: 200 len: 1313 microversion: 2.1 time: 0.664442 Sep 16 12:58:22.873345 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1458/3001] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:22 2022] GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd => generated 1313 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:22.936602 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-43df609b-e733-43ed-9193-afeeb2670130 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:22.938094 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-43df609b-e733-43ed-9193-afeeb2670130 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 536f2ffa-d5a1-4060-9ef1-f305cf164fd3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:22.940287 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:58:22.956485 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-43df609b-e733-43ed-9193-afeeb2670130 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:22.958288 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-43df609b-e733-43ed-9193-afeeb2670130 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:22.958927 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-43df609b-e733-43ed-9193-afeeb2670130 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:22.959800 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-43df609b-e733-43ed-9193-afeeb2670130 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:22.961455 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-43df609b-e733-43ed-9193-afeeb2670130 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:22.964548 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-43df609b-e733-43ed-9193-afeeb2670130 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:23.080430 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5e64e4a2-f4b2-4d17-a3fd-af55cfee215d tempest-SecurityGroupsNegativeTestJSON-601781712 tempest-SecurityGroupsNegativeTestJSON-601781712-project] Calling method '.version_select at 0x7f1034bb1160>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:23.245935 n-d-858094-4 devstack@n-api.service[128779]: DEBUG neutronclient.v2_0.client [None req-5e64e4a2-f4b2-4d17-a3fd-af55cfee215d tempest-SecurityGroupsNegativeTestJSON-601781712 tempest-SecurityGroupsNegativeTestJSON-601781712-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6fd12fd7-8917-4d08-b729-365e5ba396a1 does not exist", "detail": ""}} {{(pid=128779) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 12:58:23.246829 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.security_group_api [None req-5e64e4a2-f4b2-4d17-a3fd-af55cfee215d tempest-SecurityGroupsNegativeTestJSON-601781712 tempest-SecurityGroupsNegativeTestJSON-601781712-project] Neutron security group 6fd12fd7-8917-4d08-b729-365e5ba396a1 not found {{(pid=128779) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 16 12:58:23.247573 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-5e64e4a2-f4b2-4d17-a3fd-af55cfee215d tempest-SecurityGroupsNegativeTestJSON-601781712 tempest-SecurityGroupsNegativeTestJSON-601781712-project] HTTP exception thrown: Security group 6fd12fd7-8917-4d08-b729-365e5ba396a1 does not exist Sep 16 12:58:23.247573 n-d-858094-4 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-d28044b9-0cb1-46c1-b1a2-e7f562d5a160'] Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5e64e4a2-f4b2-4d17-a3fd-af55cfee215d tempest-SecurityGroupsNegativeTestJSON-601781712 tempest-SecurityGroupsNegativeTestJSON-601781712-project] Request method failure captured: Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/os-security-groups/6fd12fd7-8917-4d08-b729-365e5ba396a1 HTTP/1.1 Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHLuE_12ScBvQlDRGyHSo91T84P0HdQnALg_nY2m4oZXRMVSYOXIukJdZpzSiX6BXX-ZSF2IqSv_wMrN9mGABZCAXjGWChuJriTt_hFIA7Nn9VdGU1DTPcIKapEK4uIanujknDDIlo6FQ7AkQlonOFt9g_LfcOsbXzeddgfu6N_u6I0 Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: d202923816ec48d6b8e8f54bd3255dc5 Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-601781712 Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d202923816ec48d6b8e8f54bd3255dc5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d202923816ec48d6b8e8f54bd3255dc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d202923816ec48d6b8e8f54bd3255dc5", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d202923816ec48d6b8e8f54bd3255dc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-601781712 Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: d202923816ec48d6b8e8f54bd3255dc5 Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-601781712 Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-SecurityGroupsNegativeTestJSON-601781712-project Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: ce1afcd4d3d141778415aae8e2d752ad Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-601781712-project Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: exception: Security group 6fd12fd7-8917-4d08-b729-365e5ba396a1 does not exist Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-d28044b9-0cb1-46c1-b1a2-e7f562d5a160'] Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '6fd12fd7-8917-4d08-b729-365e5ba396a1'} Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 12:58:23.249777 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6fd12fd7-8917-4d08-b729-365e5ba396a1 does not exist Sep 16 12:58:23.253539 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d28044b9-0cb1-46c1-b1a2-e7f562d5a160'] Sep 16 12:58:23.253539 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:23.253539 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:58:23.253539 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:23.253539 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:23.253539 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 16 12:58:23.253539 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 16 12:58:23.253539 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 16 12:58:23.253539 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 16 12:58:23.253539 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6fd12fd7-8917-4d08-b729-365e5ba396a1 does not exist Sep 16 12:58:23.253539 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d28044b9-0cb1-46c1-b1a2-e7f562d5a160'] Sep 16 12:58:23.253539 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:23.253539 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:58:23.253539 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:23.253539 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:23.253539 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:58:23.253539 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:58:23.253539 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:58:23.253539 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:58:23.253539 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:58:23.253539 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:58:23.253539 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:58:23.253539 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:58:23.253539 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 16 12:58:23.253539 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 16 12:58:23.253539 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6fd12fd7-8917-4d08-b729-365e5ba396a1 does not exist Sep 16 12:58:23.253539 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d28044b9-0cb1-46c1-b1a2-e7f562d5a160'] Sep 16 12:58:23.253539 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:23.253539 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:58:23.253539 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:23.253539 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:23.253539 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:58:23.253539 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:58:23.253539 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:58:23.253539 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:58:23.253539 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6fd12fd7-8917-4d08-b729-365e5ba396a1 does not exist Sep 16 12:58:23.253539 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d28044b9-0cb1-46c1-b1a2-e7f562d5a160'] Sep 16 12:58:23.253539 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:23.257934 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5e64e4a2-f4b2-4d17-a3fd-af55cfee215d tempest-SecurityGroupsNegativeTestJSON-601781712 tempest-SecurityGroupsNegativeTestJSON-601781712-project] Returning 404 to user: Security group 6fd12fd7-8917-4d08-b729-365e5ba396a1 does not exist Sep 16 12:58:23.257934 n-d-858094-4 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-d28044b9-0cb1-46c1-b1a2-e7f562d5a160'] {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:58:23.259966 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5e64e4a2-f4b2-4d17-a3fd-af55cfee215d tempest-SecurityGroupsNegativeTestJSON-601781712 tempest-SecurityGroupsNegativeTestJSON-601781712-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/6fd12fd7-8917-4d08-b729-365e5ba396a1" status: 404 len: 194 microversion: 2.1 time: 0.525547 Sep 16 12:58:23.261625 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1544/3002] 10.222.0.67 () {58 vars in 1272 bytes} [Fri Sep 16 12:58:22 2022] DELETE /compute/v2.1/os-security-groups/6fd12fd7-8917-4d08-b729-365e5ba396a1 => generated 194 bytes in 529 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 12:58:23.278879 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4f7b8d08-5358-48f6-941d-67866b43ec0f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:23.282123 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4f7b8d08-5358-48f6-941d-67866b43ec0f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:23.293581 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f7b8d08-5358-48f6-941d-67866b43ec0f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:23.294083 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f7b8d08-5358-48f6-941d-67866b43ec0f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:23.294525 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f7b8d08-5358-48f6-941d-67866b43ec0f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:23.295239 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f7b8d08-5358-48f6-941d-67866b43ec0f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:23.295694 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f7b8d08-5358-48f6-941d-67866b43ec0f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:23.296138 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f7b8d08-5358-48f6-941d-67866b43ec0f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:23.477397 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-43df609b-e733-43ed-9193-afeeb2670130 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:23.490430 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-43df609b-e733-43ed-9193-afeeb2670130 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3" status: 200 len: 1355 microversion: 2.1 time: 0.558547 Sep 16 12:58:23.504690 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1459/3003] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:22 2022] GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3 => generated 1355 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:23.505097 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a9f505ec-6aa0-4eaa-a729-61bca4decc57 tempest-SecurityGroupsNegativeTestJSON-601781712 tempest-SecurityGroupsNegativeTestJSON-601781712-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.007420 Sep 16 12:58:23.509753 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1460/3004] 10.222.0.67 () {58 vars in 1164 bytes} [Fri Sep 16 12:58:23 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 16 12:58:23.522245 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-869fedf7-7c50-4cda-8a73-9b4db735ebc0 tempest-SecurityGroupsNegativeTestJSON-601781712 tempest-SecurityGroupsNegativeTestJSON-601781712-project] Calling method '.version_select at 0x7f10349eeca0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:23.862459 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4f7b8d08-5358-48f6-941d-67866b43ec0f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:23.919567 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4f7b8d08-5358-48f6-941d-67866b43ec0f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:23.922152 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4f7b8d08-5358-48f6-941d-67866b43ec0f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:23.923811 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4f7b8d08-5358-48f6-941d-67866b43ec0f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1483 microversion: 2.25 time: 0.660807 Sep 16 12:58:23.940146 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1545/3005] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:23 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1483 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:58:23.947881 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-12aaac47-4df1-46a8-8291-b2bab9d261a8 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:23.951025 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-12aaac47-4df1-46a8-8291-b2bab9d261a8 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: e8b6a81c-dbec-452e-bd82-a4c86b9c44fd] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:23.973475 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12aaac47-4df1-46a8-8291-b2bab9d261a8 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:23.974002 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12aaac47-4df1-46a8-8291-b2bab9d261a8 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:23.974449 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12aaac47-4df1-46a8-8291-b2bab9d261a8 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:23.975187 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12aaac47-4df1-46a8-8291-b2bab9d261a8 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:23.975640 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12aaac47-4df1-46a8-8291-b2bab9d261a8 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:23.976063 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12aaac47-4df1-46a8-8291-b2bab9d261a8 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:24.118577 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-869fedf7-7c50-4cda-8a73-9b4db735ebc0 tempest-SecurityGroupsNegativeTestJSON-601781712 tempest-SecurityGroupsNegativeTestJSON-601781712-project] 10.222.0.67 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.605190 Sep 16 12:58:24.121286 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1461/3006] 10.222.0.67 () {58 vars in 1158 bytes} [Fri Sep 16 12:58:23 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:58:24.138808 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-1d026f05-ac6f-4fcb-8f74-cf5ea74212ca req-2d9f0c1f-cd82-46bf-af55-fda5c2f191f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b229371-5f66-466c-a96b-2f668a855aa0", "name": "network-vif-deleted", "tag": "ad0051b5-79e3-4c40-9a1d-6ef2e5b301e7"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:58:24.160570 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-1d026f05-ac6f-4fcb-8f74-cf5ea74212ca req-2d9f0c1f-cd82-46bf-af55-fda5c2f191f9 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:24.161057 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-1d026f05-ac6f-4fcb-8f74-cf5ea74212ca req-2d9f0c1f-cd82-46bf-af55-fda5c2f191f9 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:24.162741 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-1d026f05-ac6f-4fcb-8f74-cf5ea74212ca req-2d9f0c1f-cd82-46bf-af55-fda5c2f191f9 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:24.195709 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-1d026f05-ac6f-4fcb-8f74-cf5ea74212ca req-2d9f0c1f-cd82-46bf-af55-fda5c2f191f9 service nova] Creating event network-vif-deleted:ad0051b5-79e3-4c40-9a1d-6ef2e5b301e7 for instance 3b229371-5f66-466c-a96b-2f668a855aa0 on n-h2-858094-4 Sep 16 12:58:24.206523 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-1d026f05-ac6f-4fcb-8f74-cf5ea74212ca req-2d9f0c1f-cd82-46bf-af55-fda5c2f191f9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083350 Sep 16 12:58:24.210309 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1462/3007] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:58:24.220512 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c1093507-bab9-4272-816d-a96bf836c940 tempest-SecurityGroupsNegativeTestJSON-601781712 tempest-SecurityGroupsNegativeTestJSON-601781712-project] Calling method '.version_select at 0x7f1035825f70>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:25.044010 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-12aaac47-4df1-46a8-8291-b2bab9d261a8 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:25.057498 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-12aaac47-4df1-46a8-8291-b2bab9d261a8 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd" status: 200 len: 1313 microversion: 2.1 time: 1.126397 Sep 16 12:58:25.063092 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1546/3008] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:23 2022] GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd => generated 1313 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:25.068000 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-eeb1515e-4f66-44b7-af9d-f8e41a8f8526 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:25.073297 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-eeb1515e-4f66-44b7-af9d-f8e41a8f8526 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 536f2ffa-d5a1-4060-9ef1-f305cf164fd3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:25.093629 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eeb1515e-4f66-44b7-af9d-f8e41a8f8526 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:25.094719 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eeb1515e-4f66-44b7-af9d-f8e41a8f8526 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:25.095373 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eeb1515e-4f66-44b7-af9d-f8e41a8f8526 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:25.096345 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eeb1515e-4f66-44b7-af9d-f8e41a8f8526 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:25.097042 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eeb1515e-4f66-44b7-af9d-f8e41a8f8526 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:25.098389 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eeb1515e-4f66-44b7-af9d-f8e41a8f8526 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:25.212384 n-d-858094-4 devstack@n-api.service[128780]: DEBUG neutronclient.v2_0.client [None req-c1093507-bab9-4272-816d-a96bf836c940 tempest-SecurityGroupsNegativeTestJSON-601781712 tempest-SecurityGroupsNegativeTestJSON-601781712-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=128780) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 12:58:25.213114 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-c1093507-bab9-4272-816d-a96bf836c940 tempest-SecurityGroupsNegativeTestJSON-601781712 tempest-SecurityGroupsNegativeTestJSON-601781712-project] HTTP exception thrown: Insufficient rights for removing default security group. Sep 16 12:58:25.213114 n-d-858094-4 devstack@n-api.service[128780]: Neutron server returns request_ids: ['req-e561e198-8556-48c3-b9d3-0419b97c7e28'] Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c1093507-bab9-4272-816d-a96bf836c940 tempest-SecurityGroupsNegativeTestJSON-601781712 tempest-SecurityGroupsNegativeTestJSON-601781712-project] Request method failure captured: Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: request: DELETE /compute/v2.1/os-security-groups/b6f466c7-4f4d-4782-85ea-953869a74987 HTTP/1.1 Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHLuE_12ScBvQlDRGyHSo91T84P0HdQnALg_nY2m4oZXRMVSYOXIukJdZpzSiX6BXX-ZSF2IqSv_wMrN9mGABZCAXjGWChuJriTt_hFIA7Nn9VdGU1DTPcIKapEK4uIanujknDDIlo6FQ7AkQlonOFt9g_LfcOsbXzeddgfu6N_u6I0 Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: d202923816ec48d6b8e8f54bd3255dc5 Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-601781712 Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d202923816ec48d6b8e8f54bd3255dc5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d202923816ec48d6b8e8f54bd3255dc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d202923816ec48d6b8e8f54bd3255dc5", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d202923816ec48d6b8e8f54bd3255dc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-601781712 Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: d202923816ec48d6b8e8f54bd3255dc5 Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-601781712 Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-SecurityGroupsNegativeTestJSON-601781712-project Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: ce1afcd4d3d141778415aae8e2d752ad Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-601781712-project Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: exception: Insufficient rights for removing default security group. Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: Neutron server returns request_ids: ['req-e561e198-8556-48c3-b9d3-0419b97c7e28'] Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'b6f466c7-4f4d-4782-85ea-953869a74987'} Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 12:58:25.216357 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e561e198-8556-48c3-b9d3-0419b97c7e28'] Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e561e198-8556-48c3-b9d3-0419b97c7e28'] Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e561e198-8556-48c3-b9d3-0419b97c7e28'] Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e561e198-8556-48c3-b9d3-0419b97c7e28'] Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c1093507-bab9-4272-816d-a96bf836c940 tempest-SecurityGroupsNegativeTestJSON-601781712 tempest-SecurityGroupsNegativeTestJSON-601781712-project] Returning 400 to user: Insufficient rights for removing default security group. Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: Neutron server returns request_ids: ['req-e561e198-8556-48c3-b9d3-0419b97c7e28'] {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c1093507-bab9-4272-816d-a96bf836c940 tempest-SecurityGroupsNegativeTestJSON-601781712 tempest-SecurityGroupsNegativeTestJSON-601781712-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/b6f466c7-4f4d-4782-85ea-953869a74987" status: 400 len: 182 microversion: 2.1 time: 1.006636 Sep 16 12:58:25.220059 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1463/3009] 10.222.0.67 () {58 vars in 1272 bytes} [Fri Sep 16 12:58:24 2022] DELETE /compute/v2.1/os-security-groups/b6f466c7-4f4d-4782-85ea-953869a74987 => generated 182 bytes in 1008 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 12:58:25.233157 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4e2faaf2-21b1-4cf4-b691-8e37766a4fda tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:25.233907 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-4e2faaf2-21b1-4cf4-b691-8e37766a4fda tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:25.259840 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4e2faaf2-21b1-4cf4-b691-8e37766a4fda tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:25.262711 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4e2faaf2-21b1-4cf4-b691-8e37766a4fda tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:25.263177 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4e2faaf2-21b1-4cf4-b691-8e37766a4fda tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:25.264351 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4e2faaf2-21b1-4cf4-b691-8e37766a4fda tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:25.265169 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4e2faaf2-21b1-4cf4-b691-8e37766a4fda tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:25.267252 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4e2faaf2-21b1-4cf4-b691-8e37766a4fda tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:25.503400 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4e2faaf2-21b1-4cf4-b691-8e37766a4fda tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:25.522609 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4e2faaf2-21b1-4cf4-b691-8e37766a4fda tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:25.532446 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4e2faaf2-21b1-4cf4-b691-8e37766a4fda tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:25.535001 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4e2faaf2-21b1-4cf4-b691-8e37766a4fda tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1266 microversion: 2.25 time: 0.313649 Sep 16 12:58:25.535889 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-eeb1515e-4f66-44b7-af9d-f8e41a8f8526 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:25.550069 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1464/3010] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:25 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1266 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:58:25.553143 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-eeb1515e-4f66-44b7-af9d-f8e41a8f8526 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3" status: 200 len: 1806 microversion: 2.1 time: 0.488575 Sep 16 12:58:25.565685 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1547/3011] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:25 2022] GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3 => generated 1806 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:25.576997 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-aeb60152-bb8e-440d-af0b-98915fb30b44 tempest-SecurityGroupsNegativeTestJSON-601781712 tempest-SecurityGroupsNegativeTestJSON-601781712-project] Calling method '.version_select at 0x7f10399575e0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:25.593989 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c1cee045-05f4-450c-9ed9-14297796e6e1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:25.594780 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c1cee045-05f4-450c-9ed9-14297796e6e1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 8d3df84c-ed0d-41a9-8632-63591274c2eb] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:25.604387 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c1cee045-05f4-450c-9ed9-14297796e6e1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:25.606119 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c1cee045-05f4-450c-9ed9-14297796e6e1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:25.606885 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c1cee045-05f4-450c-9ed9-14297796e6e1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:25.607781 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c1cee045-05f4-450c-9ed9-14297796e6e1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:25.608440 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c1cee045-05f4-450c-9ed9-14297796e6e1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:25.609052 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c1cee045-05f4-450c-9ed9-14297796e6e1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:25.645888 n-d-858094-4 devstack@n-api.service[128779]: DEBUG neutronclient.v2_0.client [None req-aeb60152-bb8e-440d-af0b-98915fb30b44 tempest-SecurityGroupsNegativeTestJSON-601781712 tempest-SecurityGroupsNegativeTestJSON-601781712-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c2996b2c-7957-444e-bf3a-0318469e50b7 does not exist", "detail": ""}} {{(pid=128779) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 12:58:25.646545 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.security_group_api [None req-aeb60152-bb8e-440d-af0b-98915fb30b44 tempest-SecurityGroupsNegativeTestJSON-601781712 tempest-SecurityGroupsNegativeTestJSON-601781712-project] Neutron security group c2996b2c-7957-444e-bf3a-0318469e50b7 not found {{(pid=128779) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 16 12:58:25.647028 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-aeb60152-bb8e-440d-af0b-98915fb30b44 tempest-SecurityGroupsNegativeTestJSON-601781712 tempest-SecurityGroupsNegativeTestJSON-601781712-project] HTTP exception thrown: Security group c2996b2c-7957-444e-bf3a-0318469e50b7 does not exist Sep 16 12:58:25.647028 n-d-858094-4 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-d54c2e9e-3989-49dd-a5e3-047f77b0b8d8'] Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-aeb60152-bb8e-440d-af0b-98915fb30b44 tempest-SecurityGroupsNegativeTestJSON-601781712 tempest-SecurityGroupsNegativeTestJSON-601781712-project] Request method failure captured: Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/os-security-groups/c2996b2c-7957-444e-bf3a-0318469e50b7 HTTP/1.1 Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHLuE_12ScBvQlDRGyHSo91T84P0HdQnALg_nY2m4oZXRMVSYOXIukJdZpzSiX6BXX-ZSF2IqSv_wMrN9mGABZCAXjGWChuJriTt_hFIA7Nn9VdGU1DTPcIKapEK4uIanujknDDIlo6FQ7AkQlonOFt9g_LfcOsbXzeddgfu6N_u6I0 Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: d202923816ec48d6b8e8f54bd3255dc5 Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-601781712 Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d202923816ec48d6b8e8f54bd3255dc5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d202923816ec48d6b8e8f54bd3255dc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d202923816ec48d6b8e8f54bd3255dc5", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d202923816ec48d6b8e8f54bd3255dc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-601781712 Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: d202923816ec48d6b8e8f54bd3255dc5 Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-601781712 Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-SecurityGroupsNegativeTestJSON-601781712-project Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: ce1afcd4d3d141778415aae8e2d752ad Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-601781712-project Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: exception: Security group c2996b2c-7957-444e-bf3a-0318469e50b7 does not exist Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-d54c2e9e-3989-49dd-a5e3-047f77b0b8d8'] Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': 'c2996b2c-7957-444e-bf3a-0318469e50b7'} Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 12:58:25.648904 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c2996b2c-7957-444e-bf3a-0318469e50b7 does not exist Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d54c2e9e-3989-49dd-a5e3-047f77b0b8d8'] Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c2996b2c-7957-444e-bf3a-0318469e50b7 does not exist Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d54c2e9e-3989-49dd-a5e3-047f77b0b8d8'] Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c2996b2c-7957-444e-bf3a-0318469e50b7 does not exist Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d54c2e9e-3989-49dd-a5e3-047f77b0b8d8'] Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c2996b2c-7957-444e-bf3a-0318469e50b7 does not exist Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d54c2e9e-3989-49dd-a5e3-047f77b0b8d8'] Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-aeb60152-bb8e-440d-af0b-98915fb30b44 tempest-SecurityGroupsNegativeTestJSON-601781712 tempest-SecurityGroupsNegativeTestJSON-601781712-project] Returning 404 to user: Security group c2996b2c-7957-444e-bf3a-0318469e50b7 does not exist Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-d54c2e9e-3989-49dd-a5e3-047f77b0b8d8'] {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-aeb60152-bb8e-440d-af0b-98915fb30b44 tempest-SecurityGroupsNegativeTestJSON-601781712 tempest-SecurityGroupsNegativeTestJSON-601781712-project] 10.222.0.67 "GET /compute/v2.1/os-security-groups/c2996b2c-7957-444e-bf3a-0318469e50b7" status: 404 len: 194 microversion: 2.1 time: 0.083554 Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1548/3012] 10.222.0.67 () {58 vars in 1269 bytes} [Fri Sep 16 12:58:25 2022] GET /compute/v2.1/os-security-groups/c2996b2c-7957-444e-bf3a-0318469e50b7 => generated 194 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d705e1c6-f394-4c83-850c-1b424e367d41 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:25.659723 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d705e1c6-f394-4c83-850c-1b424e367d41 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 536f2ffa-d5a1-4060-9ef1-f305cf164fd3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:25.682620 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c1cee045-05f4-450c-9ed9-14297796e6e1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 8d3df84c-ed0d-41a9-8632-63591274c2eb] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:58:25.697450 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d705e1c6-f394-4c83-850c-1b424e367d41 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:25.697977 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d705e1c6-f394-4c83-850c-1b424e367d41 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:25.698835 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d705e1c6-f394-4c83-850c-1b424e367d41 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:25.699731 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d705e1c6-f394-4c83-850c-1b424e367d41 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:25.700377 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d705e1c6-f394-4c83-850c-1b424e367d41 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:25.700955 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d705e1c6-f394-4c83-850c-1b424e367d41 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:25.740044 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d705e1c6-f394-4c83-850c-1b424e367d41 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3/ips" status: 200 len: 219 microversion: 2.1 time: 0.087191 Sep 16 12:58:25.741191 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1549/3013] 10.222.0.67 () {58 vars in 1248 bytes} [Fri Sep 16 12:58:25 2022] GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3/ips => generated 219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:58:25.753188 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-04a7d7cd-93e4-45bc-82cd-5441b2519134 tempest-SecurityGroupsNegativeTestJSON-601781712 tempest-SecurityGroupsNegativeTestJSON-601781712-project] Action: 'update', calling method: .version_select at 0x7f1034bc7b80>, body: {"security_group": {"name": "tempest-sg-1384015447", "description": "tempest-description-913047408"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:58:25.831623 n-d-858094-4 devstack@n-api.service[128779]: DEBUG neutronclient.v2_0.client [None req-04a7d7cd-93e4-45bc-82cd-5441b2519134 tempest-SecurityGroupsNegativeTestJSON-601781712 tempest-SecurityGroupsNegativeTestJSON-601781712-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e19ffb96-6e16-41d2-9bce-614ba2924c1b does not exist", "detail": ""}} {{(pid=128779) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 12:58:25.832266 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.security_group_api [None req-04a7d7cd-93e4-45bc-82cd-5441b2519134 tempest-SecurityGroupsNegativeTestJSON-601781712 tempest-SecurityGroupsNegativeTestJSON-601781712-project] Neutron security group e19ffb96-6e16-41d2-9bce-614ba2924c1b not found {{(pid=128779) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 16 12:58:25.833829 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-04a7d7cd-93e4-45bc-82cd-5441b2519134 tempest-SecurityGroupsNegativeTestJSON-601781712 tempest-SecurityGroupsNegativeTestJSON-601781712-project] HTTP exception thrown: Security group e19ffb96-6e16-41d2-9bce-614ba2924c1b does not exist Sep 16 12:58:25.833829 n-d-858094-4 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-c19674aa-26e8-4ea8-813e-21dc9741db9f'] Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-04a7d7cd-93e4-45bc-82cd-5441b2519134 tempest-SecurityGroupsNegativeTestJSON-601781712 tempest-SecurityGroupsNegativeTestJSON-601781712-project] Request method failure captured: Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: request: PUT /compute/v2.1/os-security-groups/e19ffb96-6e16-41d2-9bce-614ba2924c1b HTTP/1.1 Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 101 Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHLuE_12ScBvQlDRGyHSo91T84P0HdQnALg_nY2m4oZXRMVSYOXIukJdZpzSiX6BXX-ZSF2IqSv_wMrN9mGABZCAXjGWChuJriTt_hFIA7Nn9VdGU1DTPcIKapEK4uIanujknDDIlo6FQ7AkQlonOFt9g_LfcOsbXzeddgfu6N_u6I0 Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: d202923816ec48d6b8e8f54bd3255dc5 Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-601781712 Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d202923816ec48d6b8e8f54bd3255dc5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d202923816ec48d6b8e8f54bd3255dc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d202923816ec48d6b8e8f54bd3255dc5", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d202923816ec48d6b8e8f54bd3255dc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-601781712 Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: d202923816ec48d6b8e8f54bd3255dc5 Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-601781712 Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-SecurityGroupsNegativeTestJSON-601781712-project Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: ce1afcd4d3d141778415aae8e2d752ad Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-601781712-project Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: {"security_group": {"name": "tempest-sg-1384015447", "description": "tempest-description-913047408"}} Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: exception: Security group e19ffb96-6e16-41d2-9bce-614ba2924c1b does not exist Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-c19674aa-26e8-4ea8-813e-21dc9741db9f'] Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': 'e19ffb96-6e16-41d2-9bce-614ba2924c1b', 'body': {'security_group': {'name': 'tempest-sg-1384015447', 'description': 'tempest-description-913047408'}}} Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 12:58:25.836098 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e19ffb96-6e16-41d2-9bce-614ba2924c1b does not exist Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c19674aa-26e8-4ea8-813e-21dc9741db9f'] Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e19ffb96-6e16-41d2-9bce-614ba2924c1b does not exist Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c19674aa-26e8-4ea8-813e-21dc9741db9f'] Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e19ffb96-6e16-41d2-9bce-614ba2924c1b does not exist Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c19674aa-26e8-4ea8-813e-21dc9741db9f'] Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e19ffb96-6e16-41d2-9bce-614ba2924c1b does not exist Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c19674aa-26e8-4ea8-813e-21dc9741db9f'] Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-04a7d7cd-93e4-45bc-82cd-5441b2519134 tempest-SecurityGroupsNegativeTestJSON-601781712 tempest-SecurityGroupsNegativeTestJSON-601781712-project] Returning 404 to user: Security group e19ffb96-6e16-41d2-9bce-614ba2924c1b does not exist Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-c19674aa-26e8-4ea8-813e-21dc9741db9f'] {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:58:25.840051 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-04a7d7cd-93e4-45bc-82cd-5441b2519134 tempest-SecurityGroupsNegativeTestJSON-601781712 tempest-SecurityGroupsNegativeTestJSON-601781712-project] 10.222.0.67 "PUT /compute/v2.1/os-security-groups/e19ffb96-6e16-41d2-9bce-614ba2924c1b" status: 404 len: 194 microversion: 2.1 time: 0.095242 Sep 16 12:58:25.846052 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1550/3014] 10.222.0.67 () {60 vars in 1290 bytes} [Fri Sep 16 12:58:25 2022] PUT /compute/v2.1/os-security-groups/e19ffb96-6e16-41d2-9bce-614ba2924c1b => generated 194 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:58:25.848946 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b7eb21a1-b598-44e9-9087-664d1c1c98f9 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:25.849444 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b7eb21a1-b598-44e9-9087-664d1c1c98f9 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 536f2ffa-d5a1-4060-9ef1-f305cf164fd3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:25.891248 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c1cee045-05f4-450c-9ed9-14297796e6e1 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "DELETE /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb" status: 204 len: 0 microversion: 2.1 time: 0.339890 Sep 16 12:58:25.893013 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1465/3015] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:58:25 2022] DELETE /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:58:25.897962 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7eb21a1-b598-44e9-9087-664d1c1c98f9 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:25.898469 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7eb21a1-b598-44e9-9087-664d1c1c98f9 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:25.903718 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-14f193ae-bde2-479e-82fd-f833872ecfee tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:25.904614 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7eb21a1-b598-44e9-9087-664d1c1c98f9 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:25.904742 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-14f193ae-bde2-479e-82fd-f833872ecfee tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 8d3df84c-ed0d-41a9-8632-63591274c2eb] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:25.908033 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7eb21a1-b598-44e9-9087-664d1c1c98f9 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:25.908751 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7eb21a1-b598-44e9-9087-664d1c1c98f9 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:25.913461 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7eb21a1-b598-44e9-9087-664d1c1c98f9 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:25.915401 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14f193ae-bde2-479e-82fd-f833872ecfee tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:25.926062 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14f193ae-bde2-479e-82fd-f833872ecfee tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:25.926689 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14f193ae-bde2-479e-82fd-f833872ecfee tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:25.927557 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14f193ae-bde2-479e-82fd-f833872ecfee tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:25.928156 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14f193ae-bde2-479e-82fd-f833872ecfee tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:25.928723 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14f193ae-bde2-479e-82fd-f833872ecfee tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:26.016269 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b7eb21a1-b598-44e9-9087-664d1c1c98f9 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 536f2ffa-d5a1-4060-9ef1-f305cf164fd3] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:58:26.245685 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b7eb21a1-b598-44e9-9087-664d1c1c98f9 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "DELETE /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3" status: 204 len: 0 microversion: 2.1 time: 0.398969 Sep 16 12:58:26.249581 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1551/3016] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:58:25 2022] DELETE /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:58:26.267399 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2e6ebaa1-38a1-41cc-9b7c-3035551f8a1c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:26.270657 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2e6ebaa1-38a1-41cc-9b7c-3035551f8a1c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: e8b6a81c-dbec-452e-bd82-a4c86b9c44fd] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:26.289759 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:58:26.292421 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e6ebaa1-38a1-41cc-9b7c-3035551f8a1c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:26.293118 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e6ebaa1-38a1-41cc-9b7c-3035551f8a1c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:26.293714 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e6ebaa1-38a1-41cc-9b7c-3035551f8a1c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:26.295332 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e6ebaa1-38a1-41cc-9b7c-3035551f8a1c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:26.296010 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e6ebaa1-38a1-41cc-9b7c-3035551f8a1c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:26.296659 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e6ebaa1-38a1-41cc-9b7c-3035551f8a1c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:27.109097 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-14f193ae-bde2-479e-82fd-f833872ecfee tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37316c1f04764255a2a9466676502c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e940a963f7740dea44034d06e8c2a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:27.132558 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2e6ebaa1-38a1-41cc-9b7c-3035551f8a1c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:27.133225 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-14f193ae-bde2-479e-82fd-f833872ecfee tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb" status: 200 len: 1681 microversion: 2.1 time: 1.235026 Sep 16 12:58:27.149163 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2e6ebaa1-38a1-41cc-9b7c-3035551f8a1c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd" status: 200 len: 1313 microversion: 2.1 time: 0.895529 Sep 16 12:58:27.165076 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1466/3017] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:25 2022] GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb => generated 1681 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:27.169820 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1552/3018] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:26 2022] GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd => generated 1313 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:27.171680 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-890a5866-2c94-41de-b24e-f228c0c9e624 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:27.180707 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-5b29a1de-a61f-4b7d-a3a4-693692b07827 req-ee8d17d2-056a-4d38-b126-3c38aa449959 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8b6a81c-dbec-452e-bd82-a4c86b9c44fd", "name": "network-vif-plugged", "status": "completed", "tag": "2467419c-0246-4695-9b97-df325e585a17"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:58:27.181530 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-890a5866-2c94-41de-b24e-f228c0c9e624 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 536f2ffa-d5a1-4060-9ef1-f305cf164fd3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:27.191480 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-890a5866-2c94-41de-b24e-f228c0c9e624 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:27.192330 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-890a5866-2c94-41de-b24e-f228c0c9e624 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:27.193023 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-890a5866-2c94-41de-b24e-f228c0c9e624 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:27.194724 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-890a5866-2c94-41de-b24e-f228c0c9e624 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:27.195420 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-890a5866-2c94-41de-b24e-f228c0c9e624 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:27.198142 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-890a5866-2c94-41de-b24e-f228c0c9e624 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:27.209430 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-5b29a1de-a61f-4b7d-a3a4-693692b07827 req-ee8d17d2-056a-4d38-b126-3c38aa449959 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:27.210098 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-5b29a1de-a61f-4b7d-a3a4-693692b07827 req-ee8d17d2-056a-4d38-b126-3c38aa449959 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:27.210683 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-5b29a1de-a61f-4b7d-a3a4-693692b07827 req-ee8d17d2-056a-4d38-b126-3c38aa449959 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:27.244116 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-5b29a1de-a61f-4b7d-a3a4-693692b07827 req-ee8d17d2-056a-4d38-b126-3c38aa449959 service nova] Creating event network-vif-plugged:2467419c-0246-4695-9b97-df325e585a17 for instance e8b6a81c-dbec-452e-bd82-a4c86b9c44fd on n-h2-858094-4 Sep 16 12:58:27.255410 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-5b29a1de-a61f-4b7d-a3a4-693692b07827 req-ee8d17d2-056a-4d38-b126-3c38aa449959 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082741 Sep 16 12:58:27.261313 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1553/3019] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:58:27.270013 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9ff3a4d5-d991-497d-b173-2042cce3a76e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:27.279167 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9ff3a4d5-d991-497d-b173-2042cce3a76e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:27.292420 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ff3a4d5-d991-497d-b173-2042cce3a76e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:27.293034 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ff3a4d5-d991-497d-b173-2042cce3a76e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:27.293582 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ff3a4d5-d991-497d-b173-2042cce3a76e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:27.294395 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ff3a4d5-d991-497d-b173-2042cce3a76e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:27.297990 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ff3a4d5-d991-497d-b173-2042cce3a76e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:27.300469 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ff3a4d5-d991-497d-b173-2042cce3a76e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:27.444548 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9ff3a4d5-d991-497d-b173-2042cce3a76e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:27.458154 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9ff3a4d5-d991-497d-b173-2042cce3a76e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:27.464207 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9ff3a4d5-d991-497d-b173-2042cce3a76e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:27.473312 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9ff3a4d5-d991-497d-b173-2042cce3a76e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1266 microversion: 2.25 time: 0.210347 Sep 16 12:58:27.474299 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1554/3020] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:27 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:58:27.668152 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-890a5866-2c94-41de-b24e-f228c0c9e624 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:27.688998 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-890a5866-2c94-41de-b24e-f228c0c9e624 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3" status: 200 len: 1812 microversion: 2.1 time: 0.510111 Sep 16 12:58:27.689975 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1467/3021] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:27 2022] GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3 => generated 1812 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:28.189069 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bfa17e99-8a87-46d5-afa7-5879e9302e92 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:28.189711 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bfa17e99-8a87-46d5-afa7-5879e9302e92 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 8d3df84c-ed0d-41a9-8632-63591274c2eb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:28.191850 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-44f354f7-dee4-4fc9-8103-bddc9e74be68 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:28.194979 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-44f354f7-dee4-4fc9-8103-bddc9e74be68 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: e8b6a81c-dbec-452e-bd82-a4c86b9c44fd] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:28.233682 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bfa17e99-8a87-46d5-afa7-5879e9302e92 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:28.235153 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bfa17e99-8a87-46d5-afa7-5879e9302e92 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:28.235423 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-44f354f7-dee4-4fc9-8103-bddc9e74be68 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:28.236109 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-44f354f7-dee4-4fc9-8103-bddc9e74be68 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:28.236945 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bfa17e99-8a87-46d5-afa7-5879e9302e92 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:28.238994 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-44f354f7-dee4-4fc9-8103-bddc9e74be68 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:28.239963 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bfa17e99-8a87-46d5-afa7-5879e9302e92 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:28.240915 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-44f354f7-dee4-4fc9-8103-bddc9e74be68 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:28.242277 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bfa17e99-8a87-46d5-afa7-5879e9302e92 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:28.242940 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-44f354f7-dee4-4fc9-8103-bddc9e74be68 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:28.247158 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bfa17e99-8a87-46d5-afa7-5879e9302e92 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:28.248031 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-44f354f7-dee4-4fc9-8103-bddc9e74be68 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:29.793132 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-44f354f7-dee4-4fc9-8103-bddc9e74be68 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:29.806971 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-44f354f7-dee4-4fc9-8103-bddc9e74be68 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd" status: 200 len: 1313 microversion: 2.1 time: 1.633165 Sep 16 12:58:29.813276 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1468/3022] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:28 2022] GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd => generated 1313 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:29.820376 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e30a100e-b266-4794-b403-63912eecfef9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:29.821639 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e30a100e-b266-4794-b403-63912eecfef9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:29.845926 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e30a100e-b266-4794-b403-63912eecfef9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:29.846589 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e30a100e-b266-4794-b403-63912eecfef9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:29.847961 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e30a100e-b266-4794-b403-63912eecfef9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:29.849429 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e30a100e-b266-4794-b403-63912eecfef9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:29.850046 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e30a100e-b266-4794-b403-63912eecfef9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:29.850628 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e30a100e-b266-4794-b403-63912eecfef9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:30.073885 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bfa17e99-8a87-46d5-afa7-5879e9302e92 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37316c1f04764255a2a9466676502c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e940a963f7740dea44034d06e8c2a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:30.091788 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bfa17e99-8a87-46d5-afa7-5879e9302e92 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb" status: 200 len: 1681 microversion: 2.1 time: 1.922406 Sep 16 12:58:30.093689 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1555/3023] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:28 2022] GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb => generated 1681 bytes in 1925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:30.112487 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6eac9fd5-3bcf-42a6-8cc6-d5d6f630e18e tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:30.120425 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6eac9fd5-3bcf-42a6-8cc6-d5d6f630e18e tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 536f2ffa-d5a1-4060-9ef1-f305cf164fd3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:30.146526 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e30a100e-b266-4794-b403-63912eecfef9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:30.173558 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e30a100e-b266-4794-b403-63912eecfef9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:30.201191 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e30a100e-b266-4794-b403-63912eecfef9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:30.203789 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6eac9fd5-3bcf-42a6-8cc6-d5d6f630e18e tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:30.204968 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e30a100e-b266-4794-b403-63912eecfef9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1266 microversion: 2.25 time: 0.390310 Sep 16 12:58:30.205733 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1469/3024] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:29 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1266 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:58:30.206822 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6eac9fd5-3bcf-42a6-8cc6-d5d6f630e18e tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:30.209719 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6eac9fd5-3bcf-42a6-8cc6-d5d6f630e18e tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:30.210679 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6eac9fd5-3bcf-42a6-8cc6-d5d6f630e18e tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:30.214169 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6eac9fd5-3bcf-42a6-8cc6-d5d6f630e18e tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:30.215039 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6eac9fd5-3bcf-42a6-8cc6-d5d6f630e18e tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:30.841214 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-bf111add-9e90-4f68-aff9-fad813dc2250 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:30.841844 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-bf111add-9e90-4f68-aff9-fad813dc2250 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: e8b6a81c-dbec-452e-bd82-a4c86b9c44fd] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:30.852336 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bf111add-9e90-4f68-aff9-fad813dc2250 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:30.852837 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bf111add-9e90-4f68-aff9-fad813dc2250 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:30.853795 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bf111add-9e90-4f68-aff9-fad813dc2250 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:30.858215 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bf111add-9e90-4f68-aff9-fad813dc2250 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:30.858988 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bf111add-9e90-4f68-aff9-fad813dc2250 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:30.859689 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bf111add-9e90-4f68-aff9-fad813dc2250 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:31.438108 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6eac9fd5-3bcf-42a6-8cc6-d5d6f630e18e tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:31.452405 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6eac9fd5-3bcf-42a6-8cc6-d5d6f630e18e tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3" status: 200 len: 1812 microversion: 2.1 time: 1.354029 Sep 16 12:58:31.454222 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1556/3025] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:30 2022] GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3 => generated 1812 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:31.461033 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9c6b2884-e88a-45af-af27-ee409ac53acd tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:31.461901 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9c6b2884-e88a-45af-af27-ee409ac53acd tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 8d3df84c-ed0d-41a9-8632-63591274c2eb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:31.471542 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c6b2884-e88a-45af-af27-ee409ac53acd tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:31.485154 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c6b2884-e88a-45af-af27-ee409ac53acd tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:31.485976 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c6b2884-e88a-45af-af27-ee409ac53acd tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:31.486954 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c6b2884-e88a-45af-af27-ee409ac53acd tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:31.488178 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c6b2884-e88a-45af-af27-ee409ac53acd tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:31.489286 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c6b2884-e88a-45af-af27-ee409ac53acd tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:31.672349 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-bf111add-9e90-4f68-aff9-fad813dc2250 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:31.690687 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-bf111add-9e90-4f68-aff9-fad813dc2250 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd" status: 200 len: 1500 microversion: 2.1 time: 0.853470 Sep 16 12:58:31.691302 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1470/3026] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:30 2022] GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd => generated 1500 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:58:31.698331 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7f4f5807-c261-4cec-9143-b91e28b71517 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:31.699130 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7f4f5807-c261-4cec-9143-b91e28b71517 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:31.737090 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7f4f5807-c261-4cec-9143-b91e28b71517 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:31.740847 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7f4f5807-c261-4cec-9143-b91e28b71517 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:31.741298 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7f4f5807-c261-4cec-9143-b91e28b71517 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:31.742039 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7f4f5807-c261-4cec-9143-b91e28b71517 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:31.742492 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7f4f5807-c261-4cec-9143-b91e28b71517 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:31.742910 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7f4f5807-c261-4cec-9143-b91e28b71517 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:32.270802 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7f4f5807-c261-4cec-9143-b91e28b71517 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:32.273897 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:58:32.287606 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7f4f5807-c261-4cec-9143-b91e28b71517 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:32.296216 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7f4f5807-c261-4cec-9143-b91e28b71517 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:32.299164 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7f4f5807-c261-4cec-9143-b91e28b71517 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1266 microversion: 2.25 time: 0.605523 Sep 16 12:58:32.300725 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1471/3027] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:31 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1266 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:58:32.334120 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9c6b2884-e88a-45af-af27-ee409ac53acd tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37316c1f04764255a2a9466676502c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e940a963f7740dea44034d06e8c2a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:32.360920 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9c6b2884-e88a-45af-af27-ee409ac53acd tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb" status: 200 len: 1681 microversion: 2.1 time: 0.905225 Sep 16 12:58:32.363888 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1557/3028] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:31 2022] GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb => generated 1681 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:32.395862 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-0539d88c-64cd-428e-b597-9931b3373b8e req-f58f2beb-cf30-4f04-856a-8cd5c8917abd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "536f2ffa-d5a1-4060-9ef1-f305cf164fd3", "name": "network-vif-deleted", "tag": "7d29c55a-fbb0-4e50-9719-1dcce2aaef81"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:58:32.419861 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-0539d88c-64cd-428e-b597-9931b3373b8e req-f58f2beb-cf30-4f04-856a-8cd5c8917abd service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:32.420373 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-0539d88c-64cd-428e-b597-9931b3373b8e req-f58f2beb-cf30-4f04-856a-8cd5c8917abd service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:32.420799 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-0539d88c-64cd-428e-b597-9931b3373b8e req-f58f2beb-cf30-4f04-856a-8cd5c8917abd service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:32.471299 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-0539d88c-64cd-428e-b597-9931b3373b8e req-f58f2beb-cf30-4f04-856a-8cd5c8917abd service nova] Creating event network-vif-deleted:7d29c55a-fbb0-4e50-9719-1dcce2aaef81 for instance 536f2ffa-d5a1-4060-9ef1-f305cf164fd3 on n-h2-858094-4 Sep 16 12:58:32.480013 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-90e7d213-1748-4654-8169-5995cc937673 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:32.480767 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-90e7d213-1748-4654-8169-5995cc937673 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 536f2ffa-d5a1-4060-9ef1-f305cf164fd3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:32.494603 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90e7d213-1748-4654-8169-5995cc937673 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:32.495101 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90e7d213-1748-4654-8169-5995cc937673 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:32.495570 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90e7d213-1748-4654-8169-5995cc937673 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:32.496385 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90e7d213-1748-4654-8169-5995cc937673 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:32.496837 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90e7d213-1748-4654-8169-5995cc937673 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:32.497257 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90e7d213-1748-4654-8169-5995cc937673 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:32.503547 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-0539d88c-64cd-428e-b597-9931b3373b8e req-f58f2beb-cf30-4f04-856a-8cd5c8917abd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120926 Sep 16 12:58:32.511227 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1472/3029] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:58:32.794979 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-a8a639a7-da2f-4197-ab75-fa9c5991f152 req-9d6026b8-42a5-4638-995f-74993facca8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "536f2ffa-d5a1-4060-9ef1-f305cf164fd3", "name": "network-vif-unplugged", "status": "completed", "tag": "e389c52d-c333-408c-a4a5-dd1fb810bd22"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:58:32.823007 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-a8a639a7-da2f-4197-ab75-fa9c5991f152 req-9d6026b8-42a5-4638-995f-74993facca8e service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:32.823596 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-a8a639a7-da2f-4197-ab75-fa9c5991f152 req-9d6026b8-42a5-4638-995f-74993facca8e service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:32.824040 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-a8a639a7-da2f-4197-ab75-fa9c5991f152 req-9d6026b8-42a5-4638-995f-74993facca8e service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:32.877123 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-a8a639a7-da2f-4197-ab75-fa9c5991f152 req-9d6026b8-42a5-4638-995f-74993facca8e service nova] Creating event network-vif-unplugged:e389c52d-c333-408c-a4a5-dd1fb810bd22 for instance 536f2ffa-d5a1-4060-9ef1-f305cf164fd3 on n-h2-858094-4 Sep 16 12:58:32.895408 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-a8a639a7-da2f-4197-ab75-fa9c5991f152 req-9d6026b8-42a5-4638-995f-74993facca8e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107581 Sep 16 12:58:32.896838 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1473/3030] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:58:33.334582 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e1597bbd-edac-43b9-b27e-97fc53fb7bf6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:33.337204 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e1597bbd-edac-43b9-b27e-97fc53fb7bf6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:33.358150 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1597bbd-edac-43b9-b27e-97fc53fb7bf6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:33.363871 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1597bbd-edac-43b9-b27e-97fc53fb7bf6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:33.366847 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1597bbd-edac-43b9-b27e-97fc53fb7bf6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:33.372347 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1597bbd-edac-43b9-b27e-97fc53fb7bf6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:33.373734 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1597bbd-edac-43b9-b27e-97fc53fb7bf6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:33.375445 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1597bbd-edac-43b9-b27e-97fc53fb7bf6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:33.382972 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-90e7d213-1748-4654-8169-5995cc937673 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:33.406718 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-90e7d213-1748-4654-8169-5995cc937673 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3" status: 200 len: 1791 microversion: 2.1 time: 0.925816 Sep 16 12:58:33.411267 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1558/3031] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:32 2022] GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3 => generated 1791 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:58:33.426072 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6f5c2b91-d5b3-48b5-8c51-1ef4e7fefe4f tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:33.458172 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6f5c2b91-d5b3-48b5-8c51-1ef4e7fefe4f tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 8d3df84c-ed0d-41a9-8632-63591274c2eb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:33.520070 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f5c2b91-d5b3-48b5-8c51-1ef4e7fefe4f tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:33.528706 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f5c2b91-d5b3-48b5-8c51-1ef4e7fefe4f tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:33.529496 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f5c2b91-d5b3-48b5-8c51-1ef4e7fefe4f tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:33.538995 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f5c2b91-d5b3-48b5-8c51-1ef4e7fefe4f tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:33.540089 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f5c2b91-d5b3-48b5-8c51-1ef4e7fefe4f tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:33.544958 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f5c2b91-d5b3-48b5-8c51-1ef4e7fefe4f tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:33.592862 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1597bbd-edac-43b9-b27e-97fc53fb7bf6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:33.595771 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1597bbd-edac-43b9-b27e-97fc53fb7bf6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:33.598020 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1597bbd-edac-43b9-b27e-97fc53fb7bf6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:33.598168 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:58:33.603174 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-e1597bbd-edac-43b9-b27e-97fc53fb7bf6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lazy-loading 'fault' on Instance uuid 3b229371-5f66-466c-a96b-2f668a855aa0 {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:58:34.178879 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6f5c2b91-d5b3-48b5-8c51-1ef4e7fefe4f tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37316c1f04764255a2a9466676502c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e940a963f7740dea44034d06e8c2a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:34.203894 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6f5c2b91-d5b3-48b5-8c51-1ef4e7fefe4f tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb" status: 200 len: 1614 microversion: 2.1 time: 0.789327 Sep 16 12:58:34.205462 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1559/3032] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:33 2022] GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb => generated 1614 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:34.521468 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e1597bbd-edac-43b9-b27e-97fc53fb7bf6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:34.551663 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e1597bbd-edac-43b9-b27e-97fc53fb7bf6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:34.558949 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e1597bbd-edac-43b9-b27e-97fc53fb7bf6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:34.573037 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e1597bbd-edac-43b9-b27e-97fc53fb7bf6 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 200 len: 1271 microversion: 2.25 time: 1.244067 Sep 16 12:58:34.576396 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1474/3033] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:33 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 1271 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:58:34.602627 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fe273afe-d4b5-4a77-a2f2-c54226ebdda9 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:34.608260 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-fe273afe-d4b5-4a77-a2f2-c54226ebdda9 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 536f2ffa-d5a1-4060-9ef1-f305cf164fd3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:34.686139 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe273afe-d4b5-4a77-a2f2-c54226ebdda9 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:34.697944 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe273afe-d4b5-4a77-a2f2-c54226ebdda9 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:34.699273 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe273afe-d4b5-4a77-a2f2-c54226ebdda9 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:34.704418 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe273afe-d4b5-4a77-a2f2-c54226ebdda9 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:34.709532 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe273afe-d4b5-4a77-a2f2-c54226ebdda9 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:34.711800 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe273afe-d4b5-4a77-a2f2-c54226ebdda9 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:34.821599 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-58583165-f6fd-4517-8e45-c9933ea272cf tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:34.823057 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-58583165-f6fd-4517-8e45-c9933ea272cf tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 272fddb0-eba2-4559-b76d-460bd65246ec] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:34.844509 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58583165-f6fd-4517-8e45-c9933ea272cf tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:34.845034 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58583165-f6fd-4517-8e45-c9933ea272cf tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:34.845476 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58583165-f6fd-4517-8e45-c9933ea272cf tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:34.846207 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58583165-f6fd-4517-8e45-c9933ea272cf tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:34.846660 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58583165-f6fd-4517-8e45-c9933ea272cf tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:34.847082 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58583165-f6fd-4517-8e45-c9933ea272cf tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:35.022775 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-58583165-f6fd-4517-8e45-c9933ea272cf tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec/ips" status: 200 len: 147 microversion: 2.1 time: 0.812396 Sep 16 12:58:35.059820 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1560/3034] 10.222.0.67 () {58 vars in 1248 bytes} [Fri Sep 16 12:58:34 2022] GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec/ips => generated 147 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:58:35.087412 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-d9389f2e-78c6-4a70-be48-a73dc29b648d req-7977cc3b-2d78-4beb-9203-0018fe29c8fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d3df84c-ed0d-41a9-8632-63591274c2eb", "name": "network-vif-deleted", "tag": "efcaf7d0-199c-4298-8d5d-68962f80ca3b"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:58:35.125140 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d9389f2e-78c6-4a70-be48-a73dc29b648d req-7977cc3b-2d78-4beb-9203-0018fe29c8fe service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:35.130934 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d9389f2e-78c6-4a70-be48-a73dc29b648d req-7977cc3b-2d78-4beb-9203-0018fe29c8fe service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:35.131629 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d9389f2e-78c6-4a70-be48-a73dc29b648d req-7977cc3b-2d78-4beb-9203-0018fe29c8fe service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:35.173155 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-d9389f2e-78c6-4a70-be48-a73dc29b648d req-7977cc3b-2d78-4beb-9203-0018fe29c8fe service nova] Creating event network-vif-deleted:efcaf7d0-199c-4298-8d5d-68962f80ca3b for instance 8d3df84c-ed0d-41a9-8632-63591274c2eb on n-h1-858094-4 Sep 16 12:58:35.188932 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-d9389f2e-78c6-4a70-be48-a73dc29b648d req-7977cc3b-2d78-4beb-9203-0018fe29c8fe service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125361 Sep 16 12:58:35.189566 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1561/3035] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:58:35.207260 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-e8838a8d-c6ef-41e3-8a76-2a29185098c5 req-e75b0379-1d18-43b4-9019-7c36c72a2f7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "536f2ffa-d5a1-4060-9ef1-f305cf164fd3", "name": "network-vif-unplugged", "status": "completed", "tag": "0f8de272-9fd7-474d-85d6-e69716710172"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:58:35.269503 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e8838a8d-c6ef-41e3-8a76-2a29185098c5 req-e75b0379-1d18-43b4-9019-7c36c72a2f7a service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:35.269919 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e8838a8d-c6ef-41e3-8a76-2a29185098c5 req-e75b0379-1d18-43b4-9019-7c36c72a2f7a service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:35.270360 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e8838a8d-c6ef-41e3-8a76-2a29185098c5 req-e75b0379-1d18-43b4-9019-7c36c72a2f7a service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:35.318200 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-e8838a8d-c6ef-41e3-8a76-2a29185098c5 req-e75b0379-1d18-43b4-9019-7c36c72a2f7a service nova] Creating event network-vif-unplugged:0f8de272-9fd7-474d-85d6-e69716710172 for instance 536f2ffa-d5a1-4060-9ef1-f305cf164fd3 on n-h2-858094-4 Sep 16 12:58:35.330691 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-e8838a8d-c6ef-41e3-8a76-2a29185098c5 req-e75b0379-1d18-43b4-9019-7c36c72a2f7a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.139388 Sep 16 12:58:35.332036 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1562/3036] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:58:35.340183 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-67d9338d-d59a-4060-b1e3-36b75e7d7d94 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:35.341586 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-67d9338d-d59a-4060-b1e3-36b75e7d7d94 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 8d3df84c-ed0d-41a9-8632-63591274c2eb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:35.352316 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67d9338d-d59a-4060-b1e3-36b75e7d7d94 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:35.356186 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67d9338d-d59a-4060-b1e3-36b75e7d7d94 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:35.356993 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67d9338d-d59a-4060-b1e3-36b75e7d7d94 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:35.357912 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67d9338d-d59a-4060-b1e3-36b75e7d7d94 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:35.358901 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67d9338d-d59a-4060-b1e3-36b75e7d7d94 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:35.359662 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67d9338d-d59a-4060-b1e3-36b75e7d7d94 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:35.545872 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67d9338d-d59a-4060-b1e3-36b75e7d7d94 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:35.550086 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67d9338d-d59a-4060-b1e3-36b75e7d7d94 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:35.550603 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67d9338d-d59a-4060-b1e3-36b75e7d7d94 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:35.554218 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-67d9338d-d59a-4060-b1e3-36b75e7d7d94 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lazy-loading 'fault' on Instance uuid 8d3df84c-ed0d-41a9-8632-63591274c2eb {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:58:35.840707 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-fe273afe-d4b5-4a77-a2f2-c54226ebdda9 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:35.858762 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-fe273afe-d4b5-4a77-a2f2-c54226ebdda9 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3" status: 200 len: 1655 microversion: 2.1 time: 1.278438 Sep 16 12:58:35.862462 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1475/3037] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:34 2022] GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3 => generated 1655 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:35.976629 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-67d9338d-d59a-4060-b1e3-36b75e7d7d94 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37316c1f04764255a2a9466676502c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e940a963f7740dea44034d06e8c2a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:36.003106 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-67d9338d-d59a-4060-b1e3-36b75e7d7d94 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb" status: 200 len: 1332 microversion: 2.1 time: 0.652713 Sep 16 12:58:36.008068 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1563/3038] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:35 2022] GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb => generated 1332 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:36.016383 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-378b4beb-9143-4126-80da-75496c89942e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:36.016383 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-378b4beb-9143-4126-80da-75496c89942e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 3b229371-5f66-466c-a96b-2f668a855aa0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:36.047751 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-378b4beb-9143-4126-80da-75496c89942e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:36.048368 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-378b4beb-9143-4126-80da-75496c89942e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:36.050290 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-378b4beb-9143-4126-80da-75496c89942e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:36.051151 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-378b4beb-9143-4126-80da-75496c89942e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:36.056179 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-378b4beb-9143-4126-80da-75496c89942e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:36.056811 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-378b4beb-9143-4126-80da-75496c89942e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:36.088691 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-378b4beb-9143-4126-80da-75496c89942e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] HTTP exception thrown: Instance 3b229371-5f66-466c-a96b-2f668a855aa0 could not be found. Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-378b4beb-9143-4126-80da-75496c89942e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Request method failure captured: Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 HTTP/1.1 Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHE297bgLwu6A_IDcOSJSdu6eRNIiYzXjFD_trhQ5Zrp-ooRgkPARidIZIqqeJe2Kdku_XuXoM_SolPfWGD0o3QxZ3wv79x5WFDUj7ADR64ChdpxVvvmkrz9v_xYZxdcsZLTCMHNC36-c1pMZgicMh57Lg46Lm4e3CjZ0UGOU8qLK0o Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: X-Openstack-Nova-Api-Version: 2.25 Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: da915844493a4928ac8830897afa126f Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1786781270 Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/da915844493a4928ac8830897afa126f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/da915844493a4928ac8830897afa126f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_da915844493a4928ac8830897afa126f", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/da915844493a4928ac8830897afa126f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1786781270 Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: da915844493a4928ac8830897afa126f Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1786781270 Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-LiveAutoBlockMigrationV225Test-1786781270-project Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: ab6ca4cf98e14358bf8e0f625812fbb9 Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1786781270-project Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 3b229371-5f66-466c-a96b-2f668a855aa0 could not be found. Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '3b229371-5f66-466c-a96b-2f668a855aa0'} Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b229371-5f66-466c-a96b-2f668a855aa0 could not be found. Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b229371-5f66-466c-a96b-2f668a855aa0 could not be found. Sep 16 12:58:36.090764 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:36.099423 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:58:36.099423 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:36.099423 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:36.099423 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:58:36.099423 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:58:36.099423 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:58:36.099423 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:58:36.099423 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b229371-5f66-466c-a96b-2f668a855aa0 could not be found. Sep 16 12:58:36.099423 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:36.102454 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-378b4beb-9143-4126-80da-75496c89942e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Returning 404 to user: Instance 3b229371-5f66-466c-a96b-2f668a855aa0 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:58:36.107128 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-378b4beb-9143-4126-80da-75496c89942e tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0" status: 404 len: 111 microversion: 2.25 time: 0.097681 Sep 16 12:58:36.107985 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1564/3039] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:36 2022] GET /compute/v2.1/servers/3b229371-5f66-466c-a96b-2f668a855aa0 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 12:58:36.147921 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dde7dee1-2810-4dae-aebc-419f12f06d1e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63ad3b01-44d1-42c9-afa9-a5fe4ec276e9"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:58:36.150656 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dde7dee1-2810-4dae-aebc-419f12f06d1e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: e8b6a81c-dbec-452e-bd82-a4c86b9c44fd] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:36.159991 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dde7dee1-2810-4dae-aebc-419f12f06d1e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:36.175583 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dde7dee1-2810-4dae-aebc-419f12f06d1e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:36.176226 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dde7dee1-2810-4dae-aebc-419f12f06d1e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:36.177068 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dde7dee1-2810-4dae-aebc-419f12f06d1e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:36.180002 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dde7dee1-2810-4dae-aebc-419f12f06d1e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:36.180739 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dde7dee1-2810-4dae-aebc-419f12f06d1e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:36.509490 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-56bf9963-9f50-4084-b352-e350c7be379b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-588863481", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": "none"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:58:36.621244 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-56bf9963-9f50-4084-b352-e350c7be379b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:58:36.622983 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-56bf9963-9f50-4084-b352-e350c7be379b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:58:36.624010 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-56bf9963-9f50-4084-b352-e350c7be379b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:58:36.625945 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-56bf9963-9f50-4084-b352-e350c7be379b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:58:36.630493 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-56bf9963-9f50-4084-b352-e350c7be379b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:58:36.648772 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-56bf9963-9f50-4084-b352-e350c7be379b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:36.651297 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-56bf9963-9f50-4084-b352-e350c7be379b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:36.652499 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-56bf9963-9f50-4084-b352-e350c7be379b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:36.654552 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-56bf9963-9f50-4084-b352-e350c7be379b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:36.655140 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-56bf9963-9f50-4084-b352-e350c7be379b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:36.655712 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-56bf9963-9f50-4084-b352-e350c7be379b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:36.708033 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-56bf9963-9f50-4084-b352-e350c7be379b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Getting quotas for project e2a6db3fbe124de2af50db325deea520. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:58:36.730088 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-56bf9963-9f50-4084-b352-e350c7be379b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Getting quotas for user d5b0416153144ec5973d671bdd22ba33 and project e2a6db3fbe124de2af50db325deea520. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:58:36.771733 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-56bf9963-9f50-4084-b352-e350c7be379b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:58:36.790366 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-56bf9963-9f50-4084-b352-e350c7be379b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] [instance: 68271bbe-e34a-4c63-93fe-e595e5b3da05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:58:36.919647 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-56bf9963-9f50-4084-b352-e350c7be379b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 1.053574 Sep 16 12:58:36.922773 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1476/3040] 10.222.0.67 () {62 vars in 1188 bytes} [Fri Sep 16 12:58:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 16 12:58:36.936461 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f5b79f2d-47bd-450c-9c0c-0c694c0902e8 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:36.937413 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f5b79f2d-47bd-450c-9c0c-0c694c0902e8 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 536f2ffa-d5a1-4060-9ef1-f305cf164fd3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:37.008684 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f5b79f2d-47bd-450c-9c0c-0c694c0902e8 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:37.019105 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f5b79f2d-47bd-450c-9c0c-0c694c0902e8 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:37.022654 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f5b79f2d-47bd-450c-9c0c-0c694c0902e8 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:37.042470 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f5b79f2d-47bd-450c-9c0c-0c694c0902e8 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:37.047342 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f5b79f2d-47bd-450c-9c0c-0c694c0902e8 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:37.053049 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f5b79f2d-47bd-450c-9c0c-0c694c0902e8 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:37.082183 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dde7dee1-2810-4dae-aebc-419f12f06d1e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "POST /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.912686 Sep 16 12:58:37.085636 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1565/3041] 10.222.0.67 () {60 vars in 1323 bytes} [Fri Sep 16 12:58:36 2022] POST /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd/os-volume_attachments => generated 194 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:58:37.131926 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-235fc0b2-ffd6-4d23-8db1-35474ff0b887 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:37.138831 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-235fc0b2-ffd6-4d23-8db1-35474ff0b887 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] [instance: 68271bbe-e34a-4c63-93fe-e595e5b3da05] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:37.764851 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-235fc0b2-ffd6-4d23-8db1-35474ff0b887 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:37.778998 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-235fc0b2-ffd6-4d23-8db1-35474ff0b887 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:37.780954 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-235fc0b2-ffd6-4d23-8db1-35474ff0b887 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:37.785472 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-235fc0b2-ffd6-4d23-8db1-35474ff0b887 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] 10.222.0.67 "GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05" status: 200 len: 1277 microversion: 2.54 time: 0.697210 Sep 16 12:58:37.786519 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1566/3042] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:37 2022] GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05 => generated 1277 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:58:37.792593 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a259f5d8-2d1c-497e-b6dd-89306a2e2e29 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:37.796791 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a259f5d8-2d1c-497e-b6dd-89306a2e2e29 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] [instance: 8d3df84c-ed0d-41a9-8632-63591274c2eb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:37.814371 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a259f5d8-2d1c-497e-b6dd-89306a2e2e29 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:37.815113 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a259f5d8-2d1c-497e-b6dd-89306a2e2e29 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:37.815615 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a259f5d8-2d1c-497e-b6dd-89306a2e2e29 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:37.816506 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a259f5d8-2d1c-497e-b6dd-89306a2e2e29 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:37.817073 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a259f5d8-2d1c-497e-b6dd-89306a2e2e29 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:37.827582 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a259f5d8-2d1c-497e-b6dd-89306a2e2e29 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:37.847943 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-a259f5d8-2d1c-497e-b6dd-89306a2e2e29 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] HTTP exception thrown: Instance 8d3df84c-ed0d-41a9-8632-63591274c2eb could not be found. Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a259f5d8-2d1c-497e-b6dd-89306a2e2e29 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Request method failure captured: Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb HTTP/1.1 Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHIalnINBY1-zqWQofBE2D3H64AaHfodQGtDd1bSGwTGIhuxJS-MWKqcTwNx2hUW0ZcE_WJr2Lb-R7wBCt6e6GC5LIGI5spYg_UklUbUDRHAOwUe2LOKZmRVlZUrNnbv7UuwbVyzzrO6HlnpUWebF2MJ7b7YLf90XqCY1Ng8rb6k9ko Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 6e940a963f7740dea44034d06e8c2a77 Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-VolumesAdminNegativeTest-1119818426 Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6e940a963f7740dea44034d06e8c2a77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6e940a963f7740dea44034d06e8c2a77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6e940a963f7740dea44034d06e8c2a77", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6e940a963f7740dea44034d06e8c2a77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-VolumesAdminNegativeTest-1119818426 Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 6e940a963f7740dea44034d06e8c2a77 Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1119818426 Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-VolumesAdminNegativeTest-1119818426-project Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 37316c1f04764255a2a9466676502c35 Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-VolumesAdminNegativeTest-1119818426-project Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 8d3df84c-ed0d-41a9-8632-63591274c2eb could not be found. Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '8d3df84c-ed0d-41a9-8632-63591274c2eb'} Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d3df84c-ed0d-41a9-8632-63591274c2eb could not be found. Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d3df84c-ed0d-41a9-8632-63591274c2eb could not be found. Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:58:37.854808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:37.858947 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:37.858947 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:58:37.858947 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:58:37.858947 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:58:37.858947 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:58:37.858947 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d3df84c-ed0d-41a9-8632-63591274c2eb could not be found. Sep 16 12:58:37.858947 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:37.868260 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a259f5d8-2d1c-497e-b6dd-89306a2e2e29 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Returning 404 to user: Instance 8d3df84c-ed0d-41a9-8632-63591274c2eb could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:58:37.872898 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a259f5d8-2d1c-497e-b6dd-89306a2e2e29 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb" status: 404 len: 111 microversion: 2.1 time: 0.083951 Sep 16 12:58:37.880075 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1567/3043] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:37 2022] GET /compute/v2.1/servers/8d3df84c-ed0d-41a9-8632-63591274c2eb => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:58:37.888940 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-b8febdf7-d251-4ffa-86f8-8204b449d9fd req-9c6542da-d52c-45ca-bcfd-dee75cb54fed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "536f2ffa-d5a1-4060-9ef1-f305cf164fd3", "name": "network-vif-deleted", "tag": "0f8de272-9fd7-474d-85d6-e69716710172"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:58:37.927867 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b8febdf7-d251-4ffa-86f8-8204b449d9fd req-9c6542da-d52c-45ca-bcfd-dee75cb54fed service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:37.940598 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b8febdf7-d251-4ffa-86f8-8204b449d9fd req-9c6542da-d52c-45ca-bcfd-dee75cb54fed service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:37.941315 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b8febdf7-d251-4ffa-86f8-8204b449d9fd req-9c6542da-d52c-45ca-bcfd-dee75cb54fed service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:37.974647 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-b8febdf7-d251-4ffa-86f8-8204b449d9fd req-9c6542da-d52c-45ca-bcfd-dee75cb54fed service nova] Creating event network-vif-deleted:0f8de272-9fd7-474d-85d6-e69716710172 for instance 536f2ffa-d5a1-4060-9ef1-f305cf164fd3 on n-h2-858094-4 Sep 16 12:58:38.002205 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-b8febdf7-d251-4ffa-86f8-8204b449d9fd req-9c6542da-d52c-45ca-bcfd-dee75cb54fed service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115700 Sep 16 12:58:38.003195 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1568/3044] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:58:38.015253 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b6437578-0692-4305-8474-c7c7423202c7 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] Calling method '.version_select at 0x7f1034b9f1f0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:38.051890 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b6437578-0692-4305-8474-c7c7423202c7 tempest-VolumesAdminNegativeTest-1119818426 tempest-VolumesAdminNegativeTest-1119818426-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1064043531" status: 202 len: 0 microversion: 2.1 time: 0.041682 Sep 16 12:58:38.052574 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1569/3045] 10.222.0.67 () {58 vars in 1221 bytes} [Fri Sep 16 12:58:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1064043531 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:58:38.543767 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f5b79f2d-47bd-450c-9c0c-0c694c0902e8 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:38.573196 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f5b79f2d-47bd-450c-9c0c-0c694c0902e8 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3" status: 200 len: 1655 microversion: 2.1 time: 1.639017 Sep 16 12:58:38.574247 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1477/3046] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:36 2022] GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3 => generated 1655 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:38.817732 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-04f62fa3-2172-4eb7-8417-519a4f578ca3 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:38.819183 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-04f62fa3-2172-4eb7-8417-519a4f578ca3 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] [instance: 68271bbe-e34a-4c63-93fe-e595e5b3da05] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:38.840751 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04f62fa3-2172-4eb7-8417-519a4f578ca3 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:38.848986 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04f62fa3-2172-4eb7-8417-519a4f578ca3 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:38.857687 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04f62fa3-2172-4eb7-8417-519a4f578ca3 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:38.858844 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04f62fa3-2172-4eb7-8417-519a4f578ca3 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:38.862852 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04f62fa3-2172-4eb7-8417-519a4f578ca3 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:38.867990 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04f62fa3-2172-4eb7-8417-519a4f578ca3 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:39.242157 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-04f62fa3-2172-4eb7-8417-519a4f578ca3 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:39.252843 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-04f62fa3-2172-4eb7-8417-519a4f578ca3 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:39.265742 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-04f62fa3-2172-4eb7-8417-519a4f578ca3 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:39.269274 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-04f62fa3-2172-4eb7-8417-519a4f578ca3 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] 10.222.0.67 "GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05" status: 200 len: 1273 microversion: 2.54 time: 0.456915 Sep 16 12:58:39.273982 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1570/3047] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:38 2022] GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05 => generated 1273 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:58:39.505772 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1d91e73d-4a35-4cbc-b53a-31bbdc3d49f9 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b381151-4633-43ce-900d-79c33282a557"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:58:39.508250 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-1d91e73d-4a35-4cbc-b53a-31bbdc3d49f9 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 272fddb0-eba2-4559-b76d-460bd65246ec] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:39.525674 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1d91e73d-4a35-4cbc-b53a-31bbdc3d49f9 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:39.526327 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1d91e73d-4a35-4cbc-b53a-31bbdc3d49f9 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:39.526766 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1d91e73d-4a35-4cbc-b53a-31bbdc3d49f9 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:39.527492 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1d91e73d-4a35-4cbc-b53a-31bbdc3d49f9 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:39.527954 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1d91e73d-4a35-4cbc-b53a-31bbdc3d49f9 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:39.528411 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1d91e73d-4a35-4cbc-b53a-31bbdc3d49f9 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:39.601144 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b191d707-7e81-4500-9ea6-aa2f089e1f27 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:39.603111 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b191d707-7e81-4500-9ea6-aa2f089e1f27 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 536f2ffa-d5a1-4060-9ef1-f305cf164fd3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:39.618020 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b191d707-7e81-4500-9ea6-aa2f089e1f27 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:39.620721 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b191d707-7e81-4500-9ea6-aa2f089e1f27 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:39.624566 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b191d707-7e81-4500-9ea6-aa2f089e1f27 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:39.625574 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b191d707-7e81-4500-9ea6-aa2f089e1f27 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:39.630845 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b191d707-7e81-4500-9ea6-aa2f089e1f27 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:39.631510 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b191d707-7e81-4500-9ea6-aa2f089e1f27 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:39.725126 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b191d707-7e81-4500-9ea6-aa2f089e1f27 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:39.725620 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b191d707-7e81-4500-9ea6-aa2f089e1f27 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:39.726066 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b191d707-7e81-4500-9ea6-aa2f089e1f27 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:39.726521 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-b191d707-7e81-4500-9ea6-aa2f089e1f27 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lazy-loading 'fault' on Instance uuid 536f2ffa-d5a1-4060-9ef1-f305cf164fd3 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:58:39.980648 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b191d707-7e81-4500-9ea6-aa2f089e1f27 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:39.997864 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b191d707-7e81-4500-9ea6-aa2f089e1f27 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3" status: 200 len: 1303 microversion: 2.1 time: 0.400507 Sep 16 12:58:40.034859 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1571/3048] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:39 2022] GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3 => generated 1303 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:58:40.155530 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1d91e73d-4a35-4cbc-b53a-31bbdc3d49f9 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "POST /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.653715 Sep 16 12:58:40.157346 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1478/3049] 10.222.0.67 () {60 vars in 1323 bytes} [Fri Sep 16 12:58:39 2022] POST /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec/os-volume_attachments => generated 194 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:58:40.192825 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-55b3fbd9-c15a-45d5-8f4b-ac90d199905d req-5e614962-9502-44a1-855f-14d0e482e3fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "536f2ffa-d5a1-4060-9ef1-f305cf164fd3", "name": "network-vif-deleted", "tag": "e389c52d-c333-408c-a4a5-dd1fb810bd22"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:58:40.217062 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-55b3fbd9-c15a-45d5-8f4b-ac90d199905d req-5e614962-9502-44a1-855f-14d0e482e3fd service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:40.217723 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-55b3fbd9-c15a-45d5-8f4b-ac90d199905d req-5e614962-9502-44a1-855f-14d0e482e3fd service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:40.218247 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-55b3fbd9-c15a-45d5-8f4b-ac90d199905d req-5e614962-9502-44a1-855f-14d0e482e3fd service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:40.254643 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-55b3fbd9-c15a-45d5-8f4b-ac90d199905d req-5e614962-9502-44a1-855f-14d0e482e3fd service nova] Creating event network-vif-deleted:e389c52d-c333-408c-a4a5-dd1fb810bd22 for instance 536f2ffa-d5a1-4060-9ef1-f305cf164fd3 on n-h2-858094-4 Sep 16 12:58:40.261247 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-55b3fbd9-c15a-45d5-8f4b-ac90d199905d req-5e614962-9502-44a1-855f-14d0e482e3fd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073226 Sep 16 12:58:40.262576 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1572/3050] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:58:40.299844 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-db6e60f6-4858-4ddb-baa7-84fd922b0dd2 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:40.300639 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-db6e60f6-4858-4ddb-baa7-84fd922b0dd2 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] [instance: 68271bbe-e34a-4c63-93fe-e595e5b3da05] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:40.310128 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db6e60f6-4858-4ddb-baa7-84fd922b0dd2 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:40.310865 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db6e60f6-4858-4ddb-baa7-84fd922b0dd2 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:40.311598 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db6e60f6-4858-4ddb-baa7-84fd922b0dd2 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:40.316017 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db6e60f6-4858-4ddb-baa7-84fd922b0dd2 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:40.321129 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db6e60f6-4858-4ddb-baa7-84fd922b0dd2 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:40.323043 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db6e60f6-4858-4ddb-baa7-84fd922b0dd2 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:41.011122 n-d-858094-4 devstack@n-api.service[128780]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 12:58:41.011596 n-d-858094-4 devstack@n-api.service[128780]: Fri Sep 16 12:58:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05 (ip 10.222.0.67) !!! Sep 16 12:58:41.047437 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c83b2b7c-85bd-45bf-9c3e-be09d8f9c931 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:41.048784 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c83b2b7c-85bd-45bf-9c3e-be09d8f9c931 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 536f2ffa-d5a1-4060-9ef1-f305cf164fd3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:41.072950 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c83b2b7c-85bd-45bf-9c3e-be09d8f9c931 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:41.073712 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c83b2b7c-85bd-45bf-9c3e-be09d8f9c931 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:41.075105 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c83b2b7c-85bd-45bf-9c3e-be09d8f9c931 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:41.079283 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c83b2b7c-85bd-45bf-9c3e-be09d8f9c931 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:41.079976 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c83b2b7c-85bd-45bf-9c3e-be09d8f9c931 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:41.080817 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c83b2b7c-85bd-45bf-9c3e-be09d8f9c931 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:41.129274 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-c83b2b7c-85bd-45bf-9c3e-be09d8f9c931 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] HTTP exception thrown: Instance 536f2ffa-d5a1-4060-9ef1-f305cf164fd3 could not be found. Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c83b2b7c-85bd-45bf-9c3e-be09d8f9c931 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Request method failure captured: Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3 HTTP/1.1 Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHK_YnSmFNONV0iWyfIemnYEfvNBytCPZbi7N25amGQ6cWDZ6HV_kECLyT-_Jd3sLrSclC_OwD8SedcsAYzrJLpYoE4A8Tx1VzT0n1URdkSaC0srJQEQsJRhfXlPAxlq-FovgwQN4kGwZgDUiY-Toc-xdH52Xyev6VrEkHr8elxAtSE Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 18ad456d126a4c25accb04f76a159733 Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersTestMultiNic-131966873 Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/18ad456d126a4c25accb04f76a159733"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/18ad456d126a4c25accb04f76a159733"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_18ad456d126a4c25accb04f76a159733", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/18ad456d126a4c25accb04f76a159733"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ServersTestMultiNic-131966873 Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 18ad456d126a4c25accb04f76a159733 Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersTestMultiNic-131966873 Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ServersTestMultiNic-131966873-project Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 24cf3952918747349e71c4ac1e7b00c6 Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ServersTestMultiNic-131966873-project Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 536f2ffa-d5a1-4060-9ef1-f305cf164fd3 could not be found. Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '536f2ffa-d5a1-4060-9ef1-f305cf164fd3'} Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 536f2ffa-d5a1-4060-9ef1-f305cf164fd3 could not be found. Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 536f2ffa-d5a1-4060-9ef1-f305cf164fd3 could not be found. Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:58:41.133075 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:41.138843 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:41.138843 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:58:41.138843 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:58:41.138843 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:58:41.138843 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:58:41.138843 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 536f2ffa-d5a1-4060-9ef1-f305cf164fd3 could not be found. Sep 16 12:58:41.138843 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:58:41.148872 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c83b2b7c-85bd-45bf-9c3e-be09d8f9c931 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Returning 404 to user: Instance 536f2ffa-d5a1-4060-9ef1-f305cf164fd3 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:58:41.151272 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c83b2b7c-85bd-45bf-9c3e-be09d8f9c931 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3" status: 404 len: 111 microversion: 2.1 time: 0.108038 Sep 16 12:58:41.152639 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1573/3051] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:41 2022] GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:58:41.381882 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-db6e60f6-4858-4ddb-baa7-84fd922b0dd2 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:41.392112 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-db6e60f6-4858-4ddb-baa7-84fd922b0dd2 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:41.400423 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-db6e60f6-4858-4ddb-baa7-84fd922b0dd2 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:41.402396 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-db6e60f6-4858-4ddb-baa7-84fd922b0dd2 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] 10.222.0.67 "GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05" status: 200 len: 1335 microversion: 2.54 time: 1.107000 Sep 16 12:58:41.412510 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1479/3052] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:40 2022] GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05 => generated 1335 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:58:42.446424 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-22610ed6-44b9-41e4-a4a1-c2470d82e8c3 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:42.447030 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-22610ed6-44b9-41e4-a4a1-c2470d82e8c3 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] [instance: 68271bbe-e34a-4c63-93fe-e595e5b3da05] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:42.469499 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22610ed6-44b9-41e4-a4a1-c2470d82e8c3 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:42.470404 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22610ed6-44b9-41e4-a4a1-c2470d82e8c3 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:42.472018 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22610ed6-44b9-41e4-a4a1-c2470d82e8c3 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:42.477106 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22610ed6-44b9-41e4-a4a1-c2470d82e8c3 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:42.477814 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22610ed6-44b9-41e4-a4a1-c2470d82e8c3 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:42.482101 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22610ed6-44b9-41e4-a4a1-c2470d82e8c3 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:42.782980 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-22610ed6-44b9-41e4-a4a1-c2470d82e8c3 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:42.824075 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-22610ed6-44b9-41e4-a4a1-c2470d82e8c3 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:42.829804 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-22610ed6-44b9-41e4-a4a1-c2470d82e8c3 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:42.835262 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-22610ed6-44b9-41e4-a4a1-c2470d82e8c3 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] 10.222.0.67 "GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05" status: 200 len: 1335 microversion: 2.54 time: 0.393134 Sep 16 12:58:42.835870 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1574/3053] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:42 2022] GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05 => generated 1335 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:58:43.862502 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-13387117-3a8e-4024-9c88-36eb7f9d999b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:43.863461 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-13387117-3a8e-4024-9c88-36eb7f9d999b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] [instance: 68271bbe-e34a-4c63-93fe-e595e5b3da05] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:43.880008 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-13387117-3a8e-4024-9c88-36eb7f9d999b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:43.880008 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-13387117-3a8e-4024-9c88-36eb7f9d999b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:43.882836 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-13387117-3a8e-4024-9c88-36eb7f9d999b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:43.887621 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-13387117-3a8e-4024-9c88-36eb7f9d999b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:43.892827 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-13387117-3a8e-4024-9c88-36eb7f9d999b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:43.893468 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-13387117-3a8e-4024-9c88-36eb7f9d999b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:44.062764 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-13387117-3a8e-4024-9c88-36eb7f9d999b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:44.074406 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-13387117-3a8e-4024-9c88-36eb7f9d999b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:44.078258 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-13387117-3a8e-4024-9c88-36eb7f9d999b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:44.080987 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-13387117-3a8e-4024-9c88-36eb7f9d999b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] 10.222.0.67 "GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05" status: 200 len: 1335 microversion: 2.54 time: 0.222877 Sep 16 12:58:44.085348 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1480/3054] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:43 2022] GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05 => generated 1335 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:58:45.115311 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dc2217ae-0ece-485b-a85f-3ecc804020c1 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:45.117366 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dc2217ae-0ece-485b-a85f-3ecc804020c1 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] [instance: 68271bbe-e34a-4c63-93fe-e595e5b3da05] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:45.143674 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc2217ae-0ece-485b-a85f-3ecc804020c1 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:45.146817 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc2217ae-0ece-485b-a85f-3ecc804020c1 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:45.147507 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc2217ae-0ece-485b-a85f-3ecc804020c1 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:45.148507 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc2217ae-0ece-485b-a85f-3ecc804020c1 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:45.153474 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc2217ae-0ece-485b-a85f-3ecc804020c1 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:45.154396 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc2217ae-0ece-485b-a85f-3ecc804020c1 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:45.317419 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dc2217ae-0ece-485b-a85f-3ecc804020c1 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:45.331470 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dc2217ae-0ece-485b-a85f-3ecc804020c1 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:45.336340 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dc2217ae-0ece-485b-a85f-3ecc804020c1 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:45.340936 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dc2217ae-0ece-485b-a85f-3ecc804020c1 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] 10.222.0.67 "GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05" status: 200 len: 1356 microversion: 2.54 time: 0.230082 Sep 16 12:58:45.343614 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1575/3055] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:45 2022] GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05 => generated 1356 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:58:45.383229 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-21429cad-98aa-4274-94fb-d9b3d7d738bd tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Action: 'create', calling method: .version_select at 0x7f10358b6ee0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1618922604", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWgV7kah6/BynH6FAU08d8ei61BYkJbRv7j1v7ndCPvTEJYxSS5TPnGLzwcDWeclvPUvimVn7Kxfrk8BzjBvAvn25zd8e+kUcppr+8PfEbb/VkDNR7Ei6u09P2bfg8fdg=="}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:58:45.417972 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-21429cad-98aa-4274-94fb-d9b3d7d738bd tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Getting quotas for project e2a6db3fbe124de2af50db325deea520. Resources: {'key_pairs'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:58:45.437060 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-21429cad-98aa-4274-94fb-d9b3d7d738bd tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Getting quotas for user d5b0416153144ec5973d671bdd22ba33 and project e2a6db3fbe124de2af50db325deea520. Resources: {'key_pairs'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:58:45.521972 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-21429cad-98aa-4274-94fb-d9b3d7d738bd tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.143312 Sep 16 12:58:45.522735 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1481/3056] 10.222.0.67 () {62 vars in 1200 bytes} [Fri Sep 16 12:58:45 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 145 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 16 12:58:45.535267 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ec0e6be2-3534-4673-9947-536742da027a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1618922604", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:58:45.538454 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ec0e6be2-3534-4673-9947-536742da027a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] [instance: 68271bbe-e34a-4c63-93fe-e595e5b3da05] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:45.545713 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec0e6be2-3534-4673-9947-536742da027a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:45.552793 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec0e6be2-3534-4673-9947-536742da027a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:45.553505 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec0e6be2-3534-4673-9947-536742da027a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:45.554431 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec0e6be2-3534-4673-9947-536742da027a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:45.555053 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec0e6be2-3534-4673-9947-536742da027a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:45.555637 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec0e6be2-3534-4673-9947-536742da027a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:45.710127 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-ec0e6be2-3534-4673-9947-536742da027a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:58:45.710763 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-ec0e6be2-3534-4673-9947-536742da027a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:58:45.711401 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-ec0e6be2-3534-4673-9947-536742da027a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:58:45.711987 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-ec0e6be2-3534-4673-9947-536742da027a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:58:45.712606 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-ec0e6be2-3534-4673-9947-536742da027a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:58:46.007412 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ec0e6be2-3534-4673-9947-536742da027a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] [instance: 68271bbe-e34a-4c63-93fe-e595e5b3da05] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:46.036915 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec0e6be2-3534-4673-9947-536742da027a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:46.037739 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec0e6be2-3534-4673-9947-536742da027a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:46.038492 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec0e6be2-3534-4673-9947-536742da027a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:46.053197 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec0e6be2-3534-4673-9947-536742da027a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:46.054242 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec0e6be2-3534-4673-9947-536742da027a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:46.055033 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec0e6be2-3534-4673-9947-536742da027a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:46.198622 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ec0e6be2-3534-4673-9947-536742da027a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] 10.222.0.67 "POST /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05/action" status: 202 len: 1139 microversion: 2.54 time: 0.667829 Sep 16 12:58:46.201760 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1576/3057] 10.222.0.67 () {62 vars in 1320 bytes} [Fri Sep 16 12:58:45 2022] POST /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05/action => generated 1139 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 16 12:58:46.246096 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c595f6c2-13e1-464d-a052-bb570fd01c79 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:46.250247 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c595f6c2-13e1-464d-a052-bb570fd01c79 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] [instance: 68271bbe-e34a-4c63-93fe-e595e5b3da05] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:46.262415 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c595f6c2-13e1-464d-a052-bb570fd01c79 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:46.263633 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c595f6c2-13e1-464d-a052-bb570fd01c79 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:46.264737 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c595f6c2-13e1-464d-a052-bb570fd01c79 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:46.266287 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c595f6c2-13e1-464d-a052-bb570fd01c79 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:46.267327 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c595f6c2-13e1-464d-a052-bb570fd01c79 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:46.268708 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c595f6c2-13e1-464d-a052-bb570fd01c79 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:46.522995 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c595f6c2-13e1-464d-a052-bb570fd01c79 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:46.544211 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c595f6c2-13e1-464d-a052-bb570fd01c79 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:46.549235 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c595f6c2-13e1-464d-a052-bb570fd01c79 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:46.552461 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c595f6c2-13e1-464d-a052-bb570fd01c79 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] 10.222.0.67 "GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05" status: 200 len: 1408 microversion: 2.54 time: 0.312958 Sep 16 12:58:46.558819 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1482/3058] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:46 2022] GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05 => generated 1408 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:58:47.594882 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c9210f85-9a7b-4251-b896-f22fe86698fb tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:47.596065 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c9210f85-9a7b-4251-b896-f22fe86698fb tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] [instance: 68271bbe-e34a-4c63-93fe-e595e5b3da05] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:47.609531 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9210f85-9a7b-4251-b896-f22fe86698fb tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:47.610343 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9210f85-9a7b-4251-b896-f22fe86698fb tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:47.611027 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9210f85-9a7b-4251-b896-f22fe86698fb tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:47.612443 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9210f85-9a7b-4251-b896-f22fe86698fb tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:47.614503 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9210f85-9a7b-4251-b896-f22fe86698fb tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:47.615870 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9210f85-9a7b-4251-b896-f22fe86698fb tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:47.778309 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:58:47.827220 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c9210f85-9a7b-4251-b896-f22fe86698fb tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:47.838913 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c9210f85-9a7b-4251-b896-f22fe86698fb tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:47.841513 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c9210f85-9a7b-4251-b896-f22fe86698fb tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:47.842985 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c9210f85-9a7b-4251-b896-f22fe86698fb tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] 10.222.0.67 "GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05" status: 200 len: 1408 microversion: 2.54 time: 0.252016 Sep 16 12:58:47.844608 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1577/3059] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:47 2022] GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05 => generated 1408 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:58:48.872487 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-62fbf06b-a573-4abb-bff5-01aaf522ff67 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:48.873708 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-62fbf06b-a573-4abb-bff5-01aaf522ff67 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] [instance: 68271bbe-e34a-4c63-93fe-e595e5b3da05] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:48.881678 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:58:48.908389 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62fbf06b-a573-4abb-bff5-01aaf522ff67 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:48.908932 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62fbf06b-a573-4abb-bff5-01aaf522ff67 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:48.909382 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62fbf06b-a573-4abb-bff5-01aaf522ff67 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:48.914039 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62fbf06b-a573-4abb-bff5-01aaf522ff67 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:48.914039 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62fbf06b-a573-4abb-bff5-01aaf522ff67 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:48.915191 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62fbf06b-a573-4abb-bff5-01aaf522ff67 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:49.081967 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-62fbf06b-a573-4abb-bff5-01aaf522ff67 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:49.095657 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-62fbf06b-a573-4abb-bff5-01aaf522ff67 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:49.097592 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-62fbf06b-a573-4abb-bff5-01aaf522ff67 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:49.098882 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-62fbf06b-a573-4abb-bff5-01aaf522ff67 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] 10.222.0.67 "GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05" status: 200 len: 1408 microversion: 2.54 time: 0.231408 Sep 16 12:58:49.099504 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1483/3060] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:48 2022] GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05 => generated 1408 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:58:50.131322 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-03fa628a-901d-4187-a8fc-62f1f3220bad tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:50.132742 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-03fa628a-901d-4187-a8fc-62f1f3220bad tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] [instance: 68271bbe-e34a-4c63-93fe-e595e5b3da05] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:50.146684 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-03fa628a-901d-4187-a8fc-62f1f3220bad tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:50.148306 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-03fa628a-901d-4187-a8fc-62f1f3220bad tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:50.148760 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-03fa628a-901d-4187-a8fc-62f1f3220bad tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:50.154293 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-03fa628a-901d-4187-a8fc-62f1f3220bad tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:50.155290 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-03fa628a-901d-4187-a8fc-62f1f3220bad tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:50.156060 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-03fa628a-901d-4187-a8fc-62f1f3220bad tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:50.256240 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-03fa628a-901d-4187-a8fc-62f1f3220bad tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:50.270796 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:58:50.283351 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-03fa628a-901d-4187-a8fc-62f1f3220bad tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:50.286011 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-03fa628a-901d-4187-a8fc-62f1f3220bad tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:50.294636 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-03fa628a-901d-4187-a8fc-62f1f3220bad tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] 10.222.0.67 "GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05" status: 200 len: 1408 microversion: 2.54 time: 0.169104 Sep 16 12:58:50.295986 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1578/3061] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:50 2022] GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05 => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:58:51.329673 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4978292f-cf2a-4409-9a38-cb80a2d05480 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:51.331114 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-4978292f-cf2a-4409-9a38-cb80a2d05480 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] [instance: 68271bbe-e34a-4c63-93fe-e595e5b3da05] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:51.340573 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4978292f-cf2a-4409-9a38-cb80a2d05480 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:51.341489 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4978292f-cf2a-4409-9a38-cb80a2d05480 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:51.342086 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4978292f-cf2a-4409-9a38-cb80a2d05480 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:51.343004 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4978292f-cf2a-4409-9a38-cb80a2d05480 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:51.343986 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4978292f-cf2a-4409-9a38-cb80a2d05480 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:51.344618 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4978292f-cf2a-4409-9a38-cb80a2d05480 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:51.453669 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4978292f-cf2a-4409-9a38-cb80a2d05480 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:51.466170 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4978292f-cf2a-4409-9a38-cb80a2d05480 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:51.468167 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4978292f-cf2a-4409-9a38-cb80a2d05480 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:51.469781 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4978292f-cf2a-4409-9a38-cb80a2d05480 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] 10.222.0.67 "GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05" status: 200 len: 1408 microversion: 2.54 time: 0.151303 Sep 16 12:58:51.470547 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1484/3062] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:51 2022] GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05 => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:58:52.266642 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-97f63c97-8ecf-44dc-9914-7bf6cd988ca8 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-446900863", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": [{"uuid": "ce933327-2e92-43ef-840e-49b5f9ee9385"}, {"uuid": "cac6fded-e5ed-439c-b2d5-e9a2b24c45b9"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:58:52.360944 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-97f63c97-8ecf-44dc-9914-7bf6cd988ca8 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] validate_networks() for [('ce933327-2e92-43ef-840e-49b5f9ee9385', None, None, None, None, None), ('cac6fded-e5ed-439c-b2d5-e9a2b24c45b9', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:58:52.496236 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7173cf94-62c4-4c4c-a46e-b035684767c9 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:52.497792 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7173cf94-62c4-4c4c-a46e-b035684767c9 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] [instance: 68271bbe-e34a-4c63-93fe-e595e5b3da05] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:52.517177 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7173cf94-62c4-4c4c-a46e-b035684767c9 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:52.524739 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7173cf94-62c4-4c4c-a46e-b035684767c9 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:52.525610 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7173cf94-62c4-4c4c-a46e-b035684767c9 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:52.527375 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7173cf94-62c4-4c4c-a46e-b035684767c9 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:52.528000 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7173cf94-62c4-4c4c-a46e-b035684767c9 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:52.528331 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7173cf94-62c4-4c4c-a46e-b035684767c9 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:52.737511 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7173cf94-62c4-4c4c-a46e-b035684767c9 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:52.753363 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7173cf94-62c4-4c4c-a46e-b035684767c9 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:52.755206 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7173cf94-62c4-4c4c-a46e-b035684767c9 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:52.761063 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7173cf94-62c4-4c4c-a46e-b035684767c9 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] 10.222.0.67 "GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05" status: 200 len: 1408 microversion: 2.54 time: 0.268858 Sep 16 12:58:52.765495 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1485/3063] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:52 2022] GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05 => generated 1408 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:58:52.956222 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fe043bd7-4988-4a41-a15f-00b708c0d828 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:52.957454 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-fe043bd7-4988-4a41-a15f-00b708c0d828 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:52.970280 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe043bd7-4988-4a41-a15f-00b708c0d828 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:52.976472 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe043bd7-4988-4a41-a15f-00b708c0d828 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:52.977143 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe043bd7-4988-4a41-a15f-00b708c0d828 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:52.978104 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe043bd7-4988-4a41-a15f-00b708c0d828 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:52.984945 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe043bd7-4988-4a41-a15f-00b708c0d828 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:52.985374 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe043bd7-4988-4a41-a15f-00b708c0d828 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:53.057799 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-fe043bd7-4988-4a41-a15f-00b708c0d828 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:58:53.197440 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:58:53.237571 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-fe043bd7-4988-4a41-a15f-00b708c0d828 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 204 len: 0 microversion: 2.25 time: 0.286190 Sep 16 12:58:53.238189 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1486/3064] 10.222.0.67 () {60 vars in 1280 bytes} [Fri Sep 16 12:58:52 2022] DELETE /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 12:58:53.255562 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4c6bdd11-cad9-444c-8738-2982059c2f59 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:53.256345 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-4c6bdd11-cad9-444c-8738-2982059c2f59 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:53.277093 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4c6bdd11-cad9-444c-8738-2982059c2f59 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:53.277677 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4c6bdd11-cad9-444c-8738-2982059c2f59 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:53.278126 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4c6bdd11-cad9-444c-8738-2982059c2f59 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:53.278853 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4c6bdd11-cad9-444c-8738-2982059c2f59 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:53.279314 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4c6bdd11-cad9-444c-8738-2982059c2f59 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:53.279822 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4c6bdd11-cad9-444c-8738-2982059c2f59 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:53.651805 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4c6bdd11-cad9-444c-8738-2982059c2f59 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:53.672214 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4c6bdd11-cad9-444c-8738-2982059c2f59 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:53.674901 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4c6bdd11-cad9-444c-8738-2982059c2f59 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:53.676444 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4c6bdd11-cad9-444c-8738-2982059c2f59 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 1732 microversion: 2.25 time: 0.433691 Sep 16 12:58:53.690409 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1487/3065] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:53 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 1732 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:58:53.803384 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-53f86865-1e4c-4519-b1af-6f16cbbd5e6f tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:53.804010 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-53f86865-1e4c-4519-b1af-6f16cbbd5e6f tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] [instance: 68271bbe-e34a-4c63-93fe-e595e5b3da05] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:53.834636 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-53f86865-1e4c-4519-b1af-6f16cbbd5e6f tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:53.835310 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-53f86865-1e4c-4519-b1af-6f16cbbd5e6f tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:53.835762 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-53f86865-1e4c-4519-b1af-6f16cbbd5e6f tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:53.836522 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-53f86865-1e4c-4519-b1af-6f16cbbd5e6f tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:53.836982 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-53f86865-1e4c-4519-b1af-6f16cbbd5e6f tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:53.837401 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-53f86865-1e4c-4519-b1af-6f16cbbd5e6f tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:53.842635 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:58:54.584685 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-53f86865-1e4c-4519-b1af-6f16cbbd5e6f tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:54.595060 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-53f86865-1e4c-4519-b1af-6f16cbbd5e6f tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:54.601187 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-53f86865-1e4c-4519-b1af-6f16cbbd5e6f tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:54.609943 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-53f86865-1e4c-4519-b1af-6f16cbbd5e6f tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] 10.222.0.67 "GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05" status: 200 len: 1408 microversion: 2.54 time: 0.810651 Sep 16 12:58:54.610801 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1488/3066] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:53 2022] GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05 => generated 1408 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:58:54.708427 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ef1acc17-44fb-446d-bab6-e768d86dd3eb tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:54.710312 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ef1acc17-44fb-446d-bab6-e768d86dd3eb tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:54.721538 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ef1acc17-44fb-446d-bab6-e768d86dd3eb tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:54.722274 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ef1acc17-44fb-446d-bab6-e768d86dd3eb tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:54.722903 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ef1acc17-44fb-446d-bab6-e768d86dd3eb tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:54.727742 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ef1acc17-44fb-446d-bab6-e768d86dd3eb tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:54.728430 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ef1acc17-44fb-446d-bab6-e768d86dd3eb tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:54.729095 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ef1acc17-44fb-446d-bab6-e768d86dd3eb tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:54.852990 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-97f63c97-8ecf-44dc-9914-7bf6cd988ca8 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:58:54.853510 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-97f63c97-8ecf-44dc-9914-7bf6cd988ca8 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:58:54.853875 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-97f63c97-8ecf-44dc-9914-7bf6cd988ca8 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:58:54.864544 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-97f63c97-8ecf-44dc-9914-7bf6cd988ca8 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:58:54.865033 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-97f63c97-8ecf-44dc-9914-7bf6cd988ca8 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:58:54.898720 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97f63c97-8ecf-44dc-9914-7bf6cd988ca8 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:54.901547 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97f63c97-8ecf-44dc-9914-7bf6cd988ca8 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:54.906970 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97f63c97-8ecf-44dc-9914-7bf6cd988ca8 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:54.907807 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97f63c97-8ecf-44dc-9914-7bf6cd988ca8 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:54.915058 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97f63c97-8ecf-44dc-9914-7bf6cd988ca8 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:54.915884 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97f63c97-8ecf-44dc-9914-7bf6cd988ca8 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:54.975813 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-97f63c97-8ecf-44dc-9914-7bf6cd988ca8 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Getting quotas for project 18ad456d126a4c25accb04f76a159733. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:58:54.995939 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-97f63c97-8ecf-44dc-9914-7bf6cd988ca8 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Getting quotas for user 24cf3952918747349e71c4ac1e7b00c6 and project 18ad456d126a4c25accb04f76a159733. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:58:55.021000 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-97f63c97-8ecf-44dc-9914-7bf6cd988ca8 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:58:55.027524 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-97f63c97-8ecf-44dc-9914-7bf6cd988ca8 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 5316af91-4d35-4a6e-9584-05d2a5b5cce6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:58:55.059074 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ef1acc17-44fb-446d-bab6-e768d86dd3eb tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:55.071076 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ef1acc17-44fb-446d-bab6-e768d86dd3eb tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:55.074796 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ef1acc17-44fb-446d-bab6-e768d86dd3eb tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:55.076145 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ef1acc17-44fb-446d-bab6-e768d86dd3eb tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 1732 microversion: 2.25 time: 0.374277 Sep 16 12:58:55.078960 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1489/3067] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:54 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 1732 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:58:55.154566 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-97f63c97-8ecf-44dc-9914-7bf6cd988ca8 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.892600 Sep 16 12:58:55.161132 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1579/3068] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:58:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:58:55.166387 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-af131ef1-3e54-4edc-a03e-52f06c4b99cd tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:55.167815 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-af131ef1-3e54-4edc-a03e-52f06c4b99cd tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 5316af91-4d35-4a6e-9584-05d2a5b5cce6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:55.464280 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=10 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:58:55.638326 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-581c8d3b-966d-4a1e-93e9-3ec5c5ae3800 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:55.638950 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-581c8d3b-966d-4a1e-93e9-3ec5c5ae3800 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] [instance: 68271bbe-e34a-4c63-93fe-e595e5b3da05] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:55.664242 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-581c8d3b-966d-4a1e-93e9-3ec5c5ae3800 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:55.664750 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-581c8d3b-966d-4a1e-93e9-3ec5c5ae3800 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:55.665194 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-581c8d3b-966d-4a1e-93e9-3ec5c5ae3800 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:55.665908 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-581c8d3b-966d-4a1e-93e9-3ec5c5ae3800 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:55.666368 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-581c8d3b-966d-4a1e-93e9-3ec5c5ae3800 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:55.667682 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-581c8d3b-966d-4a1e-93e9-3ec5c5ae3800 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:55.839728 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-581c8d3b-966d-4a1e-93e9-3ec5c5ae3800 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:55.839917 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-af131ef1-3e54-4edc-a03e-52f06c4b99cd tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:55.859005 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-af131ef1-3e54-4edc-a03e-52f06c4b99cd tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6" status: 200 len: 1212 microversion: 2.1 time: 0.696390 Sep 16 12:58:55.864639 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-581c8d3b-966d-4a1e-93e9-3ec5c5ae3800 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:55.868303 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-581c8d3b-966d-4a1e-93e9-3ec5c5ae3800 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:55.868714 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1490/3069] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:55 2022] GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6 => generated 1212 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:55.874195 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-581c8d3b-966d-4a1e-93e9-3ec5c5ae3800 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] 10.222.0.67 "GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05" status: 200 len: 1408 microversion: 2.54 time: 0.239726 Sep 16 12:58:55.892176 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1580/3070] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:55 2022] GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05 => generated 1408 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:58:56.107275 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6928b1cc-3449-479a-a2a9-abba9254ffc4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:56.109395 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6928b1cc-3449-479a-a2a9-abba9254ffc4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:56.124876 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6928b1cc-3449-479a-a2a9-abba9254ffc4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:56.137336 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6928b1cc-3449-479a-a2a9-abba9254ffc4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:56.138008 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6928b1cc-3449-479a-a2a9-abba9254ffc4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:56.138945 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6928b1cc-3449-479a-a2a9-abba9254ffc4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:56.141840 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6928b1cc-3449-479a-a2a9-abba9254ffc4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:56.144589 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6928b1cc-3449-479a-a2a9-abba9254ffc4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:56.388434 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6928b1cc-3449-479a-a2a9-abba9254ffc4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:56.402780 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6928b1cc-3449-479a-a2a9-abba9254ffc4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:56.422246 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6928b1cc-3449-479a-a2a9-abba9254ffc4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:56.422527 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6928b1cc-3449-479a-a2a9-abba9254ffc4 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 1664 microversion: 2.25 time: 0.320021 Sep 16 12:58:56.426012 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1491/3071] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:56 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 1664 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:58:56.786859 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-a263454f-8fc5-4a21-854d-184bc5d571ad req-bb57f524-581d-4b71-83f1-048e09af50cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d49156a2-d78c-4601-a431-e09716c76ce8", "name": "network-vif-deleted", "tag": "d289a714-1b0e-4177-adf6-0d59780fa902"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:58:56.818235 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:58:56.834254 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a263454f-8fc5-4a21-854d-184bc5d571ad req-bb57f524-581d-4b71-83f1-048e09af50cb service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:56.835148 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a263454f-8fc5-4a21-854d-184bc5d571ad req-bb57f524-581d-4b71-83f1-048e09af50cb service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:56.838003 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a263454f-8fc5-4a21-854d-184bc5d571ad req-bb57f524-581d-4b71-83f1-048e09af50cb service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:56.881767 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a12756e3-d66a-49c9-ae60-63b30085c029 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:56.882408 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a12756e3-d66a-49c9-ae60-63b30085c029 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 5316af91-4d35-4a6e-9584-05d2a5b5cce6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:56.906968 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-a263454f-8fc5-4a21-854d-184bc5d571ad req-bb57f524-581d-4b71-83f1-048e09af50cb service nova] Creating event network-vif-deleted:d289a714-1b0e-4177-adf6-0d59780fa902 for instance d49156a2-d78c-4601-a431-e09716c76ce8 on n-h1-858094-4 Sep 16 12:58:56.911700 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a12756e3-d66a-49c9-ae60-63b30085c029 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:56.912578 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a12756e3-d66a-49c9-ae60-63b30085c029 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:56.913813 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a12756e3-d66a-49c9-ae60-63b30085c029 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:56.921607 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a12756e3-d66a-49c9-ae60-63b30085c029 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:56.923210 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a12756e3-d66a-49c9-ae60-63b30085c029 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:56.924761 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a12756e3-d66a-49c9-ae60-63b30085c029 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:56.927247 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-a263454f-8fc5-4a21-854d-184bc5d571ad req-bb57f524-581d-4b71-83f1-048e09af50cb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148487 Sep 16 12:58:56.932719 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1581/3072] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:58:56.949419 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0125cc34-eda2-4327-ba0b-2ae6fcc06e21 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:56.958645 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0125cc34-eda2-4327-ba0b-2ae6fcc06e21 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] [instance: 68271bbe-e34a-4c63-93fe-e595e5b3da05] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:56.987045 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0125cc34-eda2-4327-ba0b-2ae6fcc06e21 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:56.993402 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0125cc34-eda2-4327-ba0b-2ae6fcc06e21 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:56.994470 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0125cc34-eda2-4327-ba0b-2ae6fcc06e21 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:56.997841 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0125cc34-eda2-4327-ba0b-2ae6fcc06e21 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:57.000270 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0125cc34-eda2-4327-ba0b-2ae6fcc06e21 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:57.002380 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0125cc34-eda2-4327-ba0b-2ae6fcc06e21 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:57.395533 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a12756e3-d66a-49c9-ae60-63b30085c029 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:57.408862 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a12756e3-d66a-49c9-ae60-63b30085c029 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6" status: 200 len: 1264 microversion: 2.1 time: 0.530893 Sep 16 12:58:57.428671 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1492/3073] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:56 2022] GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6 => generated 1264 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:57.455348 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c85ccfcf-96e5-4289-95bd-889428d4dddc tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:57.458304 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c85ccfcf-96e5-4289-95bd-889428d4dddc tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:57.471144 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0125cc34-eda2-4327-ba0b-2ae6fcc06e21 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:57.494714 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c85ccfcf-96e5-4289-95bd-889428d4dddc tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:57.502688 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0125cc34-eda2-4327-ba0b-2ae6fcc06e21 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:57.506595 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c85ccfcf-96e5-4289-95bd-889428d4dddc tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:57.510130 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0125cc34-eda2-4327-ba0b-2ae6fcc06e21 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:57.510812 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c85ccfcf-96e5-4289-95bd-889428d4dddc tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:57.513081 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c85ccfcf-96e5-4289-95bd-889428d4dddc tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:57.514634 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0125cc34-eda2-4327-ba0b-2ae6fcc06e21 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] 10.222.0.67 "GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05" status: 200 len: 1408 microversion: 2.54 time: 0.578245 Sep 16 12:58:57.516547 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c85ccfcf-96e5-4289-95bd-889428d4dddc tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:57.520898 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1582/3074] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:56 2022] GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05 => generated 1408 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:58:57.522020 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c85ccfcf-96e5-4289-95bd-889428d4dddc tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:57.627055 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c85ccfcf-96e5-4289-95bd-889428d4dddc tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:57.636080 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c85ccfcf-96e5-4289-95bd-889428d4dddc tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:57.636959 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c85ccfcf-96e5-4289-95bd-889428d4dddc tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:57.637805 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-c85ccfcf-96e5-4289-95bd-889428d4dddc tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lazy-loading 'fault' on Instance uuid d49156a2-d78c-4601-a431-e09716c76ce8 {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:58:57.712354 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c85ccfcf-96e5-4289-95bd-889428d4dddc tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:57.722805 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c85ccfcf-96e5-4289-95bd-889428d4dddc tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:57.727570 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c85ccfcf-96e5-4289-95bd-889428d4dddc tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:57.741719 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c85ccfcf-96e5-4289-95bd-889428d4dddc tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 200 len: 1375 microversion: 2.25 time: 0.292057 Sep 16 12:58:57.743476 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1493/3075] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:57 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 1375 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:58:58.442347 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-34d90c64-edae-4ae9-953c-9d3a3268d81d tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:58.442980 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-34d90c64-edae-4ae9-953c-9d3a3268d81d tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 5316af91-4d35-4a6e-9584-05d2a5b5cce6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:58.472034 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34d90c64-edae-4ae9-953c-9d3a3268d81d tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:58.473144 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34d90c64-edae-4ae9-953c-9d3a3268d81d tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:58.474333 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34d90c64-edae-4ae9-953c-9d3a3268d81d tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:58.478110 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34d90c64-edae-4ae9-953c-9d3a3268d81d tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:58.482599 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34d90c64-edae-4ae9-953c-9d3a3268d81d tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:58.483209 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34d90c64-edae-4ae9-953c-9d3a3268d81d tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:58.564469 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-73a3268d-f6a3-4185-a785-e23ac5ea6d05 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:58.566222 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-73a3268d-f6a3-4185-a785-e23ac5ea6d05 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] [instance: 68271bbe-e34a-4c63-93fe-e595e5b3da05] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:58.581070 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-73a3268d-f6a3-4185-a785-e23ac5ea6d05 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:58.582449 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-73a3268d-f6a3-4185-a785-e23ac5ea6d05 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:58.584917 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-73a3268d-f6a3-4185-a785-e23ac5ea6d05 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:58.584917 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-73a3268d-f6a3-4185-a785-e23ac5ea6d05 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:58.585609 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-73a3268d-f6a3-4185-a785-e23ac5ea6d05 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:58.586285 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-73a3268d-f6a3-4185-a785-e23ac5ea6d05 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:58.950183 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-73a3268d-f6a3-4185-a785-e23ac5ea6d05 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:58.965447 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-34d90c64-edae-4ae9-953c-9d3a3268d81d tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:58.982231 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-73a3268d-f6a3-4185-a785-e23ac5ea6d05 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:58.987504 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-73a3268d-f6a3-4185-a785-e23ac5ea6d05 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:58:58.987760 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-34d90c64-edae-4ae9-953c-9d3a3268d81d tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6" status: 200 len: 1270 microversion: 2.1 time: 0.545776 Sep 16 12:58:58.988536 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1583/3076] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:58 2022] GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6 => generated 1270 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:58:58.995539 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-73a3268d-f6a3-4185-a785-e23ac5ea6d05 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] 10.222.0.67 "GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05" status: 200 len: 1408 microversion: 2.54 time: 0.438601 Sep 16 12:58:58.997147 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1494/3077] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:58 2022] GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05 => generated 1408 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:58:59.015774 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1cfb784f-bbc4-4015-b223-57691a6ca46f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:59.019827 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d06af178-9023-46f0-ae67-c12dd9981d21 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:59.020672 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1cfb784f-bbc4-4015-b223-57691a6ca46f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: e8b6a81c-dbec-452e-bd82-a4c86b9c44fd] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:59.026625 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d06af178-9023-46f0-ae67-c12dd9981d21 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: d49156a2-d78c-4601-a431-e09716c76ce8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:59.032399 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cfb784f-bbc4-4015-b223-57691a6ca46f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:59.033440 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cfb784f-bbc4-4015-b223-57691a6ca46f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:59.035114 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cfb784f-bbc4-4015-b223-57691a6ca46f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:59.037266 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cfb784f-bbc4-4015-b223-57691a6ca46f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:59.039173 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d06af178-9023-46f0-ae67-c12dd9981d21 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:59.040421 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cfb784f-bbc4-4015-b223-57691a6ca46f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:59.041207 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cfb784f-bbc4-4015-b223-57691a6ca46f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:59.044997 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d06af178-9023-46f0-ae67-c12dd9981d21 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:59.045980 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d06af178-9023-46f0-ae67-c12dd9981d21 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:59.050531 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d06af178-9023-46f0-ae67-c12dd9981d21 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:59.051438 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d06af178-9023-46f0-ae67-c12dd9981d21 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:59.052093 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d06af178-9023-46f0-ae67-c12dd9981d21 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:59.081262 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-d06af178-9023-46f0-ae67-c12dd9981d21 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] HTTP exception thrown: Instance d49156a2-d78c-4601-a431-e09716c76ce8 could not be found. Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d06af178-9023-46f0-ae67-c12dd9981d21 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Request method failure captured: Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 HTTP/1.1 Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHE297bgLwu6A_IDcOSJSdu6eRNIiYzXjFD_trhQ5Zrp-ooRgkPARidIZIqqeJe2Kdku_XuXoM_SolPfWGD0o3QxZ3wv79x5WFDUj7ADR64ChdpxVvvmkrz9v_xYZxdcsZLTCMHNC36-c1pMZgicMh57Lg46Lm4e3CjZ0UGOU8qLK0o Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: X-Openstack-Nova-Api-Version: 2.25 Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: da915844493a4928ac8830897afa126f Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1786781270 Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/da915844493a4928ac8830897afa126f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/da915844493a4928ac8830897afa126f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_da915844493a4928ac8830897afa126f", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/da915844493a4928ac8830897afa126f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1786781270 Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: da915844493a4928ac8830897afa126f Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1786781270 Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-LiveAutoBlockMigrationV225Test-1786781270-project Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: ab6ca4cf98e14358bf8e0f625812fbb9 Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1786781270-project Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance d49156a2-d78c-4601-a431-e09716c76ce8 could not be found. Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'd49156a2-d78c-4601-a431-e09716c76ce8'} Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d49156a2-d78c-4601-a431-e09716c76ce8 could not be found. Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d49156a2-d78c-4601-a431-e09716c76ce8 could not be found. Sep 16 12:58:59.083336 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:58:59.087497 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:58:59.087497 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:58:59.087497 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:58:59.087497 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:58:59.087497 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:58:59.087497 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:58:59.087497 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:58:59.087497 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d49156a2-d78c-4601-a431-e09716c76ce8 could not be found. Sep 16 12:58:59.087497 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:58:59.094755 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d06af178-9023-46f0-ae67-c12dd9981d21 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Returning 404 to user: Instance d49156a2-d78c-4601-a431-e09716c76ce8 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:58:59.095984 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d06af178-9023-46f0-ae67-c12dd9981d21 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8" status: 404 len: 111 microversion: 2.25 time: 0.082150 Sep 16 12:58:59.096810 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1495/3078] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:58:59 2022] GET /compute/v2.1/servers/d49156a2-d78c-4601-a431-e09716c76ce8 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 12:58:59.112847 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5086484e-a6a0-47e7-821d-b266c52b380f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '.version_select at 0x7f103589aaf0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:59.118826 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1cfb784f-bbc4-4015-b223-57691a6ca46f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: e8b6a81c-dbec-452e-bd82-a4c86b9c44fd] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:58:59.151660 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5086484e-a6a0-47e7-821d-b266c52b380f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1607659794" status: 204 len: 0 microversion: 2.25 time: 0.048892 Sep 16 12:58:59.157202 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1496/3079] 10.222.0.67 () {60 vars in 1262 bytes} [Fri Sep 16 12:58:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1607659794 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 12:58:59.284885 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1cfb784f-bbc4-4015-b223-57691a6ca46f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd" status: 204 len: 0 microversion: 2.1 time: 0.294540 Sep 16 12:58:59.286258 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1584/3080] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:58:58 2022] DELETE /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:58:59.299864 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-09b8c390-d01a-4e35-a99d-cb6089f52487 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:58:59.300820 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-09b8c390-d01a-4e35-a99d-cb6089f52487 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: e8b6a81c-dbec-452e-bd82-a4c86b9c44fd] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:58:59.312338 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-09b8c390-d01a-4e35-a99d-cb6089f52487 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:59.313282 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-09b8c390-d01a-4e35-a99d-cb6089f52487 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:59.314714 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-09b8c390-d01a-4e35-a99d-cb6089f52487 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:58:59.315722 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-09b8c390-d01a-4e35-a99d-cb6089f52487 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:58:59.316475 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-09b8c390-d01a-4e35-a99d-cb6089f52487 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:58:59.317840 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-09b8c390-d01a-4e35-a99d-cb6089f52487 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:00.012972 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7fef289c-163b-4b48-9337-15b0b40c0425 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:00.014259 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7fef289c-163b-4b48-9337-15b0b40c0425 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 5316af91-4d35-4a6e-9584-05d2a5b5cce6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:00.023079 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7fef289c-163b-4b48-9337-15b0b40c0425 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:00.023564 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7fef289c-163b-4b48-9337-15b0b40c0425 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:00.040436 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7fef289c-163b-4b48-9337-15b0b40c0425 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:00.044408 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7fef289c-163b-4b48-9337-15b0b40c0425 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:00.053006 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7fef289c-163b-4b48-9337-15b0b40c0425 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:00.053641 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7fef289c-163b-4b48-9337-15b0b40c0425 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:00.279320 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7fef289c-163b-4b48-9337-15b0b40c0425 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:00.289688 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7fef289c-163b-4b48-9337-15b0b40c0425 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6" status: 200 len: 1270 microversion: 2.1 time: 0.282299 Sep 16 12:59:00.290289 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1585/3081] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:00 2022] GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6 => generated 1270 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:59:00.302183 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c0ad7c97-ace2-4dab-93ad-56ada97c1410 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:00.305680 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c0ad7c97-ace2-4dab-93ad-56ada97c1410 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] [instance: 68271bbe-e34a-4c63-93fe-e595e5b3da05] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:00.324340 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0ad7c97-ace2-4dab-93ad-56ada97c1410 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:00.325859 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0ad7c97-ace2-4dab-93ad-56ada97c1410 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:00.326382 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0ad7c97-ace2-4dab-93ad-56ada97c1410 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:00.328113 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0ad7c97-ace2-4dab-93ad-56ada97c1410 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:00.329881 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0ad7c97-ace2-4dab-93ad-56ada97c1410 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:00.334482 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0ad7c97-ace2-4dab-93ad-56ada97c1410 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:00.446392 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-09b8c390-d01a-4e35-a99d-cb6089f52487 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:00.459814 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-09b8c390-d01a-4e35-a99d-cb6089f52487 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd" status: 200 len: 1552 microversion: 2.1 time: 1.169149 Sep 16 12:59:00.464839 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1497/3082] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:58:59 2022] GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd => generated 1552 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:00.564332 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c0ad7c97-ace2-4dab-93ad-56ada97c1410 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:00.575951 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c0ad7c97-ace2-4dab-93ad-56ada97c1410 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:00.583104 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c0ad7c97-ace2-4dab-93ad-56ada97c1410 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:00.584456 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c0ad7c97-ace2-4dab-93ad-56ada97c1410 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] 10.222.0.67 "GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05" status: 200 len: 1408 microversion: 2.54 time: 0.293125 Sep 16 12:59:00.585006 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1586/3083] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:59:00 2022] GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05 => generated 1408 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:59:01.321305 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e18db8b1-ae56-49d5-b7c5-590fe2b7b196 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:01.322138 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e18db8b1-ae56-49d5-b7c5-590fe2b7b196 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 5316af91-4d35-4a6e-9584-05d2a5b5cce6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:01.339134 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e18db8b1-ae56-49d5-b7c5-590fe2b7b196 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:01.340196 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e18db8b1-ae56-49d5-b7c5-590fe2b7b196 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:01.343579 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e18db8b1-ae56-49d5-b7c5-590fe2b7b196 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:01.345486 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e18db8b1-ae56-49d5-b7c5-590fe2b7b196 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:01.347333 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e18db8b1-ae56-49d5-b7c5-590fe2b7b196 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:01.350257 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e18db8b1-ae56-49d5-b7c5-590fe2b7b196 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:01.486207 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b2b14eb1-1bc3-470c-b725-6ad6b3297097 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:01.486835 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b2b14eb1-1bc3-470c-b725-6ad6b3297097 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: e8b6a81c-dbec-452e-bd82-a4c86b9c44fd] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:01.499477 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2b14eb1-1bc3-470c-b725-6ad6b3297097 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:01.501377 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2b14eb1-1bc3-470c-b725-6ad6b3297097 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:01.502223 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2b14eb1-1bc3-470c-b725-6ad6b3297097 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:01.503441 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2b14eb1-1bc3-470c-b725-6ad6b3297097 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:01.504017 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2b14eb1-1bc3-470c-b725-6ad6b3297097 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:01.504575 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2b14eb1-1bc3-470c-b725-6ad6b3297097 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:02.061317 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e18db8b1-ae56-49d5-b7c5-590fe2b7b196 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:02.092660 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e18db8b1-ae56-49d5-b7c5-590fe2b7b196 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6" status: 200 len: 1312 microversion: 2.1 time: 0.777069 Sep 16 12:59:02.096599 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1498/3084] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:01 2022] GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6 => generated 1312 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:02.111656 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-136a4075-98b9-49e3-844f-c3f9e5f7bed5 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:02.113741 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-136a4075-98b9-49e3-844f-c3f9e5f7bed5 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] [instance: 68271bbe-e34a-4c63-93fe-e595e5b3da05] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:02.132373 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-136a4075-98b9-49e3-844f-c3f9e5f7bed5 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:02.133140 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-136a4075-98b9-49e3-844f-c3f9e5f7bed5 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:02.134220 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-136a4075-98b9-49e3-844f-c3f9e5f7bed5 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:02.135117 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-136a4075-98b9-49e3-844f-c3f9e5f7bed5 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:02.136806 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-136a4075-98b9-49e3-844f-c3f9e5f7bed5 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:02.137549 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-136a4075-98b9-49e3-844f-c3f9e5f7bed5 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:02.190917 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b2b14eb1-1bc3-470c-b725-6ad6b3297097 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:02.205596 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b2b14eb1-1bc3-470c-b725-6ad6b3297097 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd" status: 200 len: 1552 microversion: 2.1 time: 0.723238 Sep 16 12:59:02.218364 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1587/3085] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:01 2022] GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd => generated 1552 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:02.318651 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4eb8bd1d-5d15-439c-b2da-266b83383454 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:02.321001 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4eb8bd1d-5d15-439c-b2da-266b83383454 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 272fddb0-eba2-4559-b76d-460bd65246ec] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:02.331340 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4eb8bd1d-5d15-439c-b2da-266b83383454 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:02.332356 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4eb8bd1d-5d15-439c-b2da-266b83383454 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:02.334876 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4eb8bd1d-5d15-439c-b2da-266b83383454 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:02.336187 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4eb8bd1d-5d15-439c-b2da-266b83383454 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:02.337799 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4eb8bd1d-5d15-439c-b2da-266b83383454 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:02.338833 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4eb8bd1d-5d15-439c-b2da-266b83383454 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:02.376053 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-136a4075-98b9-49e3-844f-c3f9e5f7bed5 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:02.385754 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-136a4075-98b9-49e3-844f-c3f9e5f7bed5 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:02.387423 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-136a4075-98b9-49e3-844f-c3f9e5f7bed5 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:02.388215 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4eb8bd1d-5d15-439c-b2da-266b83383454 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073315 Sep 16 12:59:02.395253 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-136a4075-98b9-49e3-844f-c3f9e5f7bed5 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] 10.222.0.67 "GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05" status: 200 len: 1408 microversion: 2.54 time: 0.297254 Sep 16 12:59:02.396212 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1499/3086] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:59:02 2022] GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05 => generated 1408 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:59:02.402330 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1588/3087] 10.222.0.67 () {58 vars in 1302 bytes} [Fri Sep 16 12:59:02 2022] GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 12:59:02.412396 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9841e7d6-30e8-4cdf-bc52-69f2c2eb8c71 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:02.413142 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9841e7d6-30e8-4cdf-bc52-69f2c2eb8c71 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 272fddb0-eba2-4559-b76d-460bd65246ec] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:02.433225 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9841e7d6-30e8-4cdf-bc52-69f2c2eb8c71 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:02.433734 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9841e7d6-30e8-4cdf-bc52-69f2c2eb8c71 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:02.434177 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9841e7d6-30e8-4cdf-bc52-69f2c2eb8c71 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:02.440816 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9841e7d6-30e8-4cdf-bc52-69f2c2eb8c71 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:02.441686 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9841e7d6-30e8-4cdf-bc52-69f2c2eb8c71 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:02.442158 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9841e7d6-30e8-4cdf-bc52-69f2c2eb8c71 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:02.517677 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9841e7d6-30e8-4cdf-bc52-69f2c2eb8c71 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec/os-volume_attachments/7b381151-4633-43ce-900d-79c33282a557" status: 200 len: 194 microversion: 2.1 time: 0.119916 Sep 16 12:59:02.528739 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1500/3088] 10.222.0.67 () {58 vars in 1413 bytes} [Fri Sep 16 12:59:02 2022] GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec/os-volume_attachments/7b381151-4633-43ce-900d-79c33282a557 => generated 194 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:59:03.119116 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ef1c88c7-4cc0-4d7b-8f26-a3200b729145 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:03.121582 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ef1c88c7-4cc0-4d7b-8f26-a3200b729145 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 5316af91-4d35-4a6e-9584-05d2a5b5cce6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:03.129473 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef1c88c7-4cc0-4d7b-8f26-a3200b729145 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:03.129976 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef1c88c7-4cc0-4d7b-8f26-a3200b729145 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:03.130418 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef1c88c7-4cc0-4d7b-8f26-a3200b729145 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:03.132959 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef1c88c7-4cc0-4d7b-8f26-a3200b729145 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:03.133445 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef1c88c7-4cc0-4d7b-8f26-a3200b729145 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:03.133922 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef1c88c7-4cc0-4d7b-8f26-a3200b729145 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:03.236759 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-457320dd-d978-4c3b-a536-ec4168b5eb1e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:03.237282 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-457320dd-d978-4c3b-a536-ec4168b5eb1e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: e8b6a81c-dbec-452e-bd82-a4c86b9c44fd] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:03.247674 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-457320dd-d978-4c3b-a536-ec4168b5eb1e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:03.250993 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-457320dd-d978-4c3b-a536-ec4168b5eb1e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:03.252731 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-457320dd-d978-4c3b-a536-ec4168b5eb1e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:03.253662 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-457320dd-d978-4c3b-a536-ec4168b5eb1e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:03.257373 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-457320dd-d978-4c3b-a536-ec4168b5eb1e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:03.258074 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-457320dd-d978-4c3b-a536-ec4168b5eb1e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:04.351094 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ef1c88c7-4cc0-4d7b-8f26-a3200b729145 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:04.367831 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ef1c88c7-4cc0-4d7b-8f26-a3200b729145 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6" status: 200 len: 1312 microversion: 2.1 time: 1.249212 Sep 16 12:59:04.368982 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1589/3089] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:03 2022] GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6 => generated 1312 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:04.376486 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-86365904-9dd2-4a61-b5b7-5fec3d97cd7a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:04.377103 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-86365904-9dd2-4a61-b5b7-5fec3d97cd7a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] [instance: 68271bbe-e34a-4c63-93fe-e595e5b3da05] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:04.389642 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-457320dd-d978-4c3b-a536-ec4168b5eb1e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:04.400135 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86365904-9dd2-4a61-b5b7-5fec3d97cd7a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:04.400655 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86365904-9dd2-4a61-b5b7-5fec3d97cd7a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:04.401170 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86365904-9dd2-4a61-b5b7-5fec3d97cd7a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:04.402675 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86365904-9dd2-4a61-b5b7-5fec3d97cd7a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:04.403166 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86365904-9dd2-4a61-b5b7-5fec3d97cd7a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:04.403613 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86365904-9dd2-4a61-b5b7-5fec3d97cd7a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:04.404833 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-457320dd-d978-4c3b-a536-ec4168b5eb1e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd" status: 200 len: 1552 microversion: 2.1 time: 1.171239 Sep 16 12:59:04.409114 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1501/3090] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:03 2022] GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd => generated 1552 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:04.420427 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f73554a9-3d28-4c00-b8df-5ba7bbc00f8a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:04.423787 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f73554a9-3d28-4c00-b8df-5ba7bbc00f8a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 4fbd6b22-2181-4786-9116-a8c8eafb9933] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:04.442877 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f73554a9-3d28-4c00-b8df-5ba7bbc00f8a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:04.443971 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f73554a9-3d28-4c00-b8df-5ba7bbc00f8a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:04.445269 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f73554a9-3d28-4c00-b8df-5ba7bbc00f8a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:04.450329 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f73554a9-3d28-4c00-b8df-5ba7bbc00f8a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:04.451385 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f73554a9-3d28-4c00-b8df-5ba7bbc00f8a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:04.452054 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f73554a9-3d28-4c00-b8df-5ba7bbc00f8a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:04.519009 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f73554a9-3d28-4c00-b8df-5ba7bbc00f8a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 4fbd6b22-2181-4786-9116-a8c8eafb9933] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:59:04.830523 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f73554a9-3d28-4c00-b8df-5ba7bbc00f8a tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933" status: 204 len: 0 microversion: 2.25 time: 0.419791 Sep 16 12:59:04.831135 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1502/3091] 10.222.0.67 () {60 vars in 1280 bytes} [Fri Sep 16 12:59:04 2022] DELETE /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 12:59:04.840543 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-5c63c7b9-a290-486e-abe0-2b48a5dfe305 req-520613dd-6d7d-4c0c-84e3-e6321e8538a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8b6a81c-dbec-452e-bd82-a4c86b9c44fd", "name": "network-vif-deleted", "tag": "2467419c-0246-4695-9b97-df325e585a17"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:59:04.882939 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-5c63c7b9-a290-486e-abe0-2b48a5dfe305 req-520613dd-6d7d-4c0c-84e3-e6321e8538a9 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:04.883651 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-5c63c7b9-a290-486e-abe0-2b48a5dfe305 req-520613dd-6d7d-4c0c-84e3-e6321e8538a9 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:04.884621 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-5c63c7b9-a290-486e-abe0-2b48a5dfe305 req-520613dd-6d7d-4c0c-84e3-e6321e8538a9 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:04.914621 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-86365904-9dd2-4a61-b5b7-5fec3d97cd7a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:04.924885 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-5c63c7b9-a290-486e-abe0-2b48a5dfe305 req-520613dd-6d7d-4c0c-84e3-e6321e8538a9 service nova] Creating event network-vif-deleted:2467419c-0246-4695-9b97-df325e585a17 for instance e8b6a81c-dbec-452e-bd82-a4c86b9c44fd on n-h2-858094-4 Sep 16 12:59:04.931692 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-86365904-9dd2-4a61-b5b7-5fec3d97cd7a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:04.938474 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-5c63c7b9-a290-486e-abe0-2b48a5dfe305 req-520613dd-6d7d-4c0c-84e3-e6321e8538a9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104434 Sep 16 12:59:04.942179 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1503/3092] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:59:04.954007 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-86365904-9dd2-4a61-b5b7-5fec3d97cd7a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:04.956865 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-86365904-9dd2-4a61-b5b7-5fec3d97cd7a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] 10.222.0.67 "GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05" status: 200 len: 1408 microversion: 2.54 time: 0.586732 Sep 16 12:59:04.959022 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8db2d883-d096-4be3-adb4-8a7e0006f485 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:04.960488 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8db2d883-d096-4be3-adb4-8a7e0006f485 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 4fbd6b22-2181-4786-9116-a8c8eafb9933] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:04.971338 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8db2d883-d096-4be3-adb4-8a7e0006f485 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:04.972379 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8db2d883-d096-4be3-adb4-8a7e0006f485 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:04.973121 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8db2d883-d096-4be3-adb4-8a7e0006f485 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:04.974124 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8db2d883-d096-4be3-adb4-8a7e0006f485 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:04.974736 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8db2d883-d096-4be3-adb4-8a7e0006f485 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:04.975322 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8db2d883-d096-4be3-adb4-8a7e0006f485 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:04.999669 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1590/3093] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:59:04 2022] GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05 => generated 1408 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:59:05.394451 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ee00373d-f27e-4c34-9ffc-5435d6698b54 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "858ce97e-f3c0-4933-9667-e49c8109ec4b"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:59:05.400453 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ee00373d-f27e-4c34-9ffc-5435d6698b54 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 272fddb0-eba2-4559-b76d-460bd65246ec] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:05.408329 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:59:05.414794 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:59:05.441666 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee00373d-f27e-4c34-9ffc-5435d6698b54 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:05.442169 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee00373d-f27e-4c34-9ffc-5435d6698b54 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:05.444896 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee00373d-f27e-4c34-9ffc-5435d6698b54 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:05.445652 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee00373d-f27e-4c34-9ffc-5435d6698b54 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:05.446120 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee00373d-f27e-4c34-9ffc-5435d6698b54 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:05.450897 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee00373d-f27e-4c34-9ffc-5435d6698b54 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:05.836385 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8db2d883-d096-4be3-adb4-8a7e0006f485 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:05.855353 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8db2d883-d096-4be3-adb4-8a7e0006f485 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:05.857530 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8db2d883-d096-4be3-adb4-8a7e0006f485 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:05.862605 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8db2d883-d096-4be3-adb4-8a7e0006f485 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933" status: 200 len: 1550 microversion: 2.25 time: 0.918999 Sep 16 12:59:05.870066 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1504/3094] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:59:04 2022] GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933 => generated 1550 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:59:05.875878 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:59:05.883650 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b2d4d902-80ac-4f25-b31b-a9922b2c8e7f tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:05.888848 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b2d4d902-80ac-4f25-b31b-a9922b2c8e7f tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 5316af91-4d35-4a6e-9584-05d2a5b5cce6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:05.900482 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b2d4d902-80ac-4f25-b31b-a9922b2c8e7f tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:05.907756 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b2d4d902-80ac-4f25-b31b-a9922b2c8e7f tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:05.908592 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b2d4d902-80ac-4f25-b31b-a9922b2c8e7f tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:05.909670 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b2d4d902-80ac-4f25-b31b-a9922b2c8e7f tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:05.910834 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b2d4d902-80ac-4f25-b31b-a9922b2c8e7f tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:05.911493 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b2d4d902-80ac-4f25-b31b-a9922b2c8e7f tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:06.015368 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ee00373d-f27e-4c34-9ffc-5435d6698b54 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "POST /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.626956 Sep 16 12:59:06.024094 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1591/3095] 10.222.0.67 () {60 vars in 1323 bytes} [Fri Sep 16 12:59:05 2022] POST /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec/os-volume_attachments => generated 194 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:59:06.033120 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ddfe1d1c-8d34-401e-9557-c9d85845b0e1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:06.034694 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ddfe1d1c-8d34-401e-9557-c9d85845b0e1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: e8b6a81c-dbec-452e-bd82-a4c86b9c44fd] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:06.052438 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ddfe1d1c-8d34-401e-9557-c9d85845b0e1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:06.053329 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ddfe1d1c-8d34-401e-9557-c9d85845b0e1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:06.054100 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ddfe1d1c-8d34-401e-9557-c9d85845b0e1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:06.055064 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ddfe1d1c-8d34-401e-9557-c9d85845b0e1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:06.058864 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ddfe1d1c-8d34-401e-9557-c9d85845b0e1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:06.059598 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ddfe1d1c-8d34-401e-9557-c9d85845b0e1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:06.840355 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ddfe1d1c-8d34-401e-9557-c9d85845b0e1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:06.857424 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ddfe1d1c-8d34-401e-9557-c9d85845b0e1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd" status: 200 len: 1344 microversion: 2.1 time: 0.833746 Sep 16 12:59:06.862298 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1592/3096] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:06 2022] GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd => generated 1344 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:06.874713 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8998e30f-fc2a-4dd4-9271-c51104ea74d9 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:06.876959 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8998e30f-fc2a-4dd4-9271-c51104ea74d9 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] [instance: 68271bbe-e34a-4c63-93fe-e595e5b3da05] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:06.898169 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8998e30f-fc2a-4dd4-9271-c51104ea74d9 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:06.899061 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8998e30f-fc2a-4dd4-9271-c51104ea74d9 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:06.899744 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8998e30f-fc2a-4dd4-9271-c51104ea74d9 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:06.905538 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8998e30f-fc2a-4dd4-9271-c51104ea74d9 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:06.906337 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8998e30f-fc2a-4dd4-9271-c51104ea74d9 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:06.907052 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8998e30f-fc2a-4dd4-9271-c51104ea74d9 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:07.430029 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8998e30f-fc2a-4dd4-9271-c51104ea74d9 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:07.443034 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:59:07.463663 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8998e30f-fc2a-4dd4-9271-c51104ea74d9 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:07.467586 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8998e30f-fc2a-4dd4-9271-c51104ea74d9 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:07.471378 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8998e30f-fc2a-4dd4-9271-c51104ea74d9 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] 10.222.0.67 "GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05" status: 200 len: 1408 microversion: 2.54 time: 0.607713 Sep 16 12:59:07.474429 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1593/3097] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:59:06 2022] GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05 => generated 1408 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:59:07.492841 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9d0fd6fb-d2bf-460d-9a7b-32ed0701dd22 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:07.494499 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9d0fd6fb-d2bf-460d-9a7b-32ed0701dd22 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 4fbd6b22-2181-4786-9116-a8c8eafb9933] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:07.507078 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9d0fd6fb-d2bf-460d-9a7b-32ed0701dd22 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:07.510068 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9d0fd6fb-d2bf-460d-9a7b-32ed0701dd22 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:07.510864 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9d0fd6fb-d2bf-460d-9a7b-32ed0701dd22 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:07.513224 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9d0fd6fb-d2bf-460d-9a7b-32ed0701dd22 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:07.515289 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9d0fd6fb-d2bf-460d-9a7b-32ed0701dd22 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:07.515989 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9d0fd6fb-d2bf-460d-9a7b-32ed0701dd22 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:07.875554 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-b2d4d902-80ac-4f25-b31b-a9922b2c8e7f tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:07.888609 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b2d4d902-80ac-4f25-b31b-a9922b2c8e7f tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6" status: 200 len: 1333 microversion: 2.1 time: 2.013377 Sep 16 12:59:07.897918 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1505/3098] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:05 2022] GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6 => generated 1333 bytes in 2023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:07.908776 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e7847180-ffb8-4f7b-9c8c-7e00aea57fb9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:07.921976 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e7847180-ffb8-4f7b-9c8c-7e00aea57fb9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: e8b6a81c-dbec-452e-bd82-a4c86b9c44fd] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:07.938726 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e7847180-ffb8-4f7b-9c8c-7e00aea57fb9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:07.939388 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e7847180-ffb8-4f7b-9c8c-7e00aea57fb9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:07.939976 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e7847180-ffb8-4f7b-9c8c-7e00aea57fb9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:07.940871 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e7847180-ffb8-4f7b-9c8c-7e00aea57fb9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:07.941471 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e7847180-ffb8-4f7b-9c8c-7e00aea57fb9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:07.942036 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e7847180-ffb8-4f7b-9c8c-7e00aea57fb9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:07.957626 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:59:08.145272 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e7847180-ffb8-4f7b-9c8c-7e00aea57fb9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:08.156873 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e7847180-ffb8-4f7b-9c8c-7e00aea57fb9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd" status: 200 len: 1344 microversion: 2.1 time: 0.256404 Sep 16 12:59:08.165494 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1506/3099] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:07 2022] GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd => generated 1344 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:08.384115 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9d0fd6fb-d2bf-460d-9a7b-32ed0701dd22 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:08.399326 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9d0fd6fb-d2bf-460d-9a7b-32ed0701dd22 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:08.401158 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9d0fd6fb-d2bf-460d-9a7b-32ed0701dd22 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:08.402867 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9d0fd6fb-d2bf-460d-9a7b-32ed0701dd22 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933" status: 200 len: 1550 microversion: 2.25 time: 0.927138 Sep 16 12:59:08.403454 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1594/3100] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:59:07 2022] GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933 => generated 1550 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:59:08.507646 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-dcd8e48a-435a-49b5-a535-f812cbdb3b06 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:08.508305 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-dcd8e48a-435a-49b5-a535-f812cbdb3b06 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] [instance: 68271bbe-e34a-4c63-93fe-e595e5b3da05] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:08.524940 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dcd8e48a-435a-49b5-a535-f812cbdb3b06 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:08.525434 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dcd8e48a-435a-49b5-a535-f812cbdb3b06 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:08.525864 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dcd8e48a-435a-49b5-a535-f812cbdb3b06 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:08.527009 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dcd8e48a-435a-49b5-a535-f812cbdb3b06 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:08.527814 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dcd8e48a-435a-49b5-a535-f812cbdb3b06 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:08.528604 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dcd8e48a-435a-49b5-a535-f812cbdb3b06 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:08.830077 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-dcd8e48a-435a-49b5-a535-f812cbdb3b06 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:08.852252 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-dcd8e48a-435a-49b5-a535-f812cbdb3b06 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:08.865507 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-dcd8e48a-435a-49b5-a535-f812cbdb3b06 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:08.874812 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-dcd8e48a-435a-49b5-a535-f812cbdb3b06 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] 10.222.0.67 "GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05" status: 200 len: 1408 microversion: 2.54 time: 0.368047 Sep 16 12:59:08.876291 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1507/3101] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:59:08 2022] GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05 => generated 1408 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:59:08.920991 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-023acb83-f67b-4e81-ae5f-c4ee389e3422 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:08.921676 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-023acb83-f67b-4e81-ae5f-c4ee389e3422 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 5316af91-4d35-4a6e-9584-05d2a5b5cce6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:08.938754 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-023acb83-f67b-4e81-ae5f-c4ee389e3422 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:08.939988 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-023acb83-f67b-4e81-ae5f-c4ee389e3422 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:08.940466 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-023acb83-f67b-4e81-ae5f-c4ee389e3422 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:08.941192 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-023acb83-f67b-4e81-ae5f-c4ee389e3422 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:08.941827 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-023acb83-f67b-4e81-ae5f-c4ee389e3422 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:08.942269 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-023acb83-f67b-4e81-ae5f-c4ee389e3422 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:09.185893 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e08cc83c-7825-4270-b1d7-24ae896da289 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:09.186915 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e08cc83c-7825-4270-b1d7-24ae896da289 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: e8b6a81c-dbec-452e-bd82-a4c86b9c44fd] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:09.205053 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e08cc83c-7825-4270-b1d7-24ae896da289 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:09.206096 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e08cc83c-7825-4270-b1d7-24ae896da289 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:09.206753 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e08cc83c-7825-4270-b1d7-24ae896da289 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:09.207682 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e08cc83c-7825-4270-b1d7-24ae896da289 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:09.208378 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e08cc83c-7825-4270-b1d7-24ae896da289 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:09.209087 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e08cc83c-7825-4270-b1d7-24ae896da289 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:09.462767 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e08cc83c-7825-4270-b1d7-24ae896da289 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:09.471560 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-023acb83-f67b-4e81-ae5f-c4ee389e3422 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:09.474569 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e08cc83c-7825-4270-b1d7-24ae896da289 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd" status: 200 len: 1344 microversion: 2.1 time: 0.294918 Sep 16 12:59:09.475776 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1508/3102] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:09 2022] GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd => generated 1344 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:09.487581 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-023acb83-f67b-4e81-ae5f-c4ee389e3422 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6" status: 200 len: 1333 microversion: 2.1 time: 0.569453 Sep 16 12:59:09.488469 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1595/3103] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:08 2022] GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6 => generated 1333 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:09.496105 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a42f6b2a-aa19-4afc-bd57-9a8e23188ecc tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:09.496105 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a42f6b2a-aa19-4afc-bd57-9a8e23188ecc tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 4fbd6b22-2181-4786-9116-a8c8eafb9933] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:09.503731 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-3b0f3c4c-4d7c-4ef9-8ef7-c2f443362fa5 req-5870e073-3897-4063-90ef-5ce4f2dc2ccf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fbd6b22-2181-4786-9116-a8c8eafb9933", "name": "network-vif-deleted", "tag": "c56b7ce5-25b3-4ac0-bcbf-28e9db2c0185"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:59:09.532064 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3b0f3c4c-4d7c-4ef9-8ef7-c2f443362fa5 req-5870e073-3897-4063-90ef-5ce4f2dc2ccf service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:09.532587 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3b0f3c4c-4d7c-4ef9-8ef7-c2f443362fa5 req-5870e073-3897-4063-90ef-5ce4f2dc2ccf service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:09.533019 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3b0f3c4c-4d7c-4ef9-8ef7-c2f443362fa5 req-5870e073-3897-4063-90ef-5ce4f2dc2ccf service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:09.537794 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a42f6b2a-aa19-4afc-bd57-9a8e23188ecc tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:09.538486 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a42f6b2a-aa19-4afc-bd57-9a8e23188ecc tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:09.539035 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a42f6b2a-aa19-4afc-bd57-9a8e23188ecc tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:09.539866 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a42f6b2a-aa19-4afc-bd57-9a8e23188ecc tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:09.544405 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a42f6b2a-aa19-4afc-bd57-9a8e23188ecc tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:09.544976 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a42f6b2a-aa19-4afc-bd57-9a8e23188ecc tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:09.567510 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-3b0f3c4c-4d7c-4ef9-8ef7-c2f443362fa5 req-5870e073-3897-4063-90ef-5ce4f2dc2ccf service nova] Creating event network-vif-deleted:c56b7ce5-25b3-4ac0-bcbf-28e9db2c0185 for instance 4fbd6b22-2181-4786-9116-a8c8eafb9933 on n-h1-858094-4 Sep 16 12:59:09.577565 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-3b0f3c4c-4d7c-4ef9-8ef7-c2f443362fa5 req-5870e073-3897-4063-90ef-5ce4f2dc2ccf service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083968 Sep 16 12:59:09.584482 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1596/3104] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:59:09.893781 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a42f6b2a-aa19-4afc-bd57-9a8e23188ecc tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:09.905531 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a42f6b2a-aa19-4afc-bd57-9a8e23188ecc tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:09.907437 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ea6f0ac0-7065-43e6-91d3-e3ec01be62d1 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:09.907960 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a42f6b2a-aa19-4afc-bd57-9a8e23188ecc tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:09.908884 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ea6f0ac0-7065-43e6-91d3-e3ec01be62d1 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] [instance: 68271bbe-e34a-4c63-93fe-e595e5b3da05] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:09.909662 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a42f6b2a-aa19-4afc-bd57-9a8e23188ecc tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933" status: 200 len: 1332 microversion: 2.25 time: 0.430249 Sep 16 12:59:09.910814 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1509/3105] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:59:09 2022] GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933 => generated 1332 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:59:09.935733 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea6f0ac0-7065-43e6-91d3-e3ec01be62d1 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:09.936523 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea6f0ac0-7065-43e6-91d3-e3ec01be62d1 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:09.937122 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea6f0ac0-7065-43e6-91d3-e3ec01be62d1 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:09.938033 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea6f0ac0-7065-43e6-91d3-e3ec01be62d1 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:09.938646 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea6f0ac0-7065-43e6-91d3-e3ec01be62d1 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:09.939229 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea6f0ac0-7065-43e6-91d3-e3ec01be62d1 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:10.085047 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ea6f0ac0-7065-43e6-91d3-e3ec01be62d1 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:10.097228 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ea6f0ac0-7065-43e6-91d3-e3ec01be62d1 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:10.100765 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ea6f0ac0-7065-43e6-91d3-e3ec01be62d1 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:10.103143 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ea6f0ac0-7065-43e6-91d3-e3ec01be62d1 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] 10.222.0.67 "GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05" status: 200 len: 1408 microversion: 2.54 time: 0.201266 Sep 16 12:59:10.103772 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1597/3106] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:59:09 2022] GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05 => generated 1408 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:59:10.522102 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1ee29cbb-8e5b-4366-a2f4-939e2e914cd6 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:10.522788 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1ee29cbb-8e5b-4366-a2f4-939e2e914cd6 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 5316af91-4d35-4a6e-9584-05d2a5b5cce6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:10.524737 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4bd5291b-e837-4873-b0a8-50a34ea7a1aa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:10.525673 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-4bd5291b-e837-4873-b0a8-50a34ea7a1aa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: e8b6a81c-dbec-452e-bd82-a4c86b9c44fd] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:10.537092 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ee29cbb-8e5b-4366-a2f4-939e2e914cd6 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:10.537766 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ee29cbb-8e5b-4366-a2f4-939e2e914cd6 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:10.538390 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ee29cbb-8e5b-4366-a2f4-939e2e914cd6 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:10.539594 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ee29cbb-8e5b-4366-a2f4-939e2e914cd6 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:10.540229 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ee29cbb-8e5b-4366-a2f4-939e2e914cd6 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:10.542221 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4bd5291b-e837-4873-b0a8-50a34ea7a1aa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:10.543080 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ee29cbb-8e5b-4366-a2f4-939e2e914cd6 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:10.543789 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4bd5291b-e837-4873-b0a8-50a34ea7a1aa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:10.548821 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4bd5291b-e837-4873-b0a8-50a34ea7a1aa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:10.549826 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4bd5291b-e837-4873-b0a8-50a34ea7a1aa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:10.550485 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4bd5291b-e837-4873-b0a8-50a34ea7a1aa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:10.551109 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4bd5291b-e837-4873-b0a8-50a34ea7a1aa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:10.720715 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4bd5291b-e837-4873-b0a8-50a34ea7a1aa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:10.750435 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4bd5291b-e837-4873-b0a8-50a34ea7a1aa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd" status: 200 len: 1344 microversion: 2.1 time: 0.251365 Sep 16 12:59:10.751388 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1510/3107] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:10 2022] GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd => generated 1344 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:10.940495 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f5ac0d5d-d4b0-4505-93bc-4bb922910e94 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:10.941958 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f5ac0d5d-d4b0-4505-93bc-4bb922910e94 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 4fbd6b22-2181-4786-9116-a8c8eafb9933] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:10.950072 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f5ac0d5d-d4b0-4505-93bc-4bb922910e94 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:10.950960 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f5ac0d5d-d4b0-4505-93bc-4bb922910e94 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:10.952016 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f5ac0d5d-d4b0-4505-93bc-4bb922910e94 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:10.969238 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f5ac0d5d-d4b0-4505-93bc-4bb922910e94 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:10.972433 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f5ac0d5d-d4b0-4505-93bc-4bb922910e94 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:10.973174 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f5ac0d5d-d4b0-4505-93bc-4bb922910e94 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:11.010207 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-f5ac0d5d-d4b0-4505-93bc-4bb922910e94 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] HTTP exception thrown: Instance 4fbd6b22-2181-4786-9116-a8c8eafb9933 could not be found. Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f5ac0d5d-d4b0-4505-93bc-4bb922910e94 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Request method failure captured: Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933 HTTP/1.1 Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHE297bgLwu6A_IDcOSJSdu6eRNIiYzXjFD_trhQ5Zrp-ooRgkPARidIZIqqeJe2Kdku_XuXoM_SolPfWGD0o3QxZ3wv79x5WFDUj7ADR64ChdpxVvvmkrz9v_xYZxdcsZLTCMHNC36-c1pMZgicMh57Lg46Lm4e3CjZ0UGOU8qLK0o Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: X-Openstack-Nova-Api-Version: 2.25 Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: da915844493a4928ac8830897afa126f Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1786781270 Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/da915844493a4928ac8830897afa126f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/da915844493a4928ac8830897afa126f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_da915844493a4928ac8830897afa126f", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/da915844493a4928ac8830897afa126f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1786781270 Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: da915844493a4928ac8830897afa126f Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1786781270 Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-LiveAutoBlockMigrationV225Test-1786781270-project Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: ab6ca4cf98e14358bf8e0f625812fbb9 Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1786781270-project Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance 4fbd6b22-2181-4786-9116-a8c8eafb9933 could not be found. Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '4fbd6b22-2181-4786-9116-a8c8eafb9933'} Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fbd6b22-2181-4786-9116-a8c8eafb9933 could not be found. Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fbd6b22-2181-4786-9116-a8c8eafb9933 could not be found. Sep 16 12:59:11.022224 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:11.033767 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:59:11.033767 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:11.033767 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:59:11.033767 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:59:11.033767 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:59:11.033767 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:59:11.033767 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:59:11.033767 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fbd6b22-2181-4786-9116-a8c8eafb9933 could not be found. Sep 16 12:59:11.033767 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:11.033767 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f5ac0d5d-d4b0-4505-93bc-4bb922910e94 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Returning 404 to user: Instance 4fbd6b22-2181-4786-9116-a8c8eafb9933 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:59:11.033767 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f5ac0d5d-d4b0-4505-93bc-4bb922910e94 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933" status: 404 len: 111 microversion: 2.25 time: 0.088646 Sep 16 12:59:11.033767 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1511/3108] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:59:10 2022] GET /compute/v2.1/servers/4fbd6b22-2181-4786-9116-a8c8eafb9933 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 12:59:11.033767 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-31cdf920-22d4-4e77-bacb-c2f7bf1a492f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:11.033767 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-31cdf920-22d4-4e77-bacb-c2f7bf1a492f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 041df092-33d4-4b71-84d8-7cd479d32b4f] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:11.049027 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1ee29cbb-8e5b-4366-a2f4-939e2e914cd6 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:11.049516 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-31cdf920-22d4-4e77-bacb-c2f7bf1a492f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:11.050029 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-31cdf920-22d4-4e77-bacb-c2f7bf1a492f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:11.050474 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-31cdf920-22d4-4e77-bacb-c2f7bf1a492f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:11.051190 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-31cdf920-22d4-4e77-bacb-c2f7bf1a492f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:11.051704 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-31cdf920-22d4-4e77-bacb-c2f7bf1a492f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:11.053042 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-31cdf920-22d4-4e77-bacb-c2f7bf1a492f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:11.072458 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1ee29cbb-8e5b-4366-a2f4-939e2e914cd6 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6" status: 200 len: 1333 microversion: 2.1 time: 0.557970 Sep 16 12:59:11.076293 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1598/3109] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:10 2022] GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6 => generated 1333 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:11.103799 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-31cdf920-22d4-4e77-bacb-c2f7bf1a492f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 041df092-33d4-4b71-84d8-7cd479d32b4f] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:59:11.136148 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-42393136-cb88-4e6e-a331-e17f482d320b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:11.137211 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-42393136-cb88-4e6e-a331-e17f482d320b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] [instance: 68271bbe-e34a-4c63-93fe-e595e5b3da05] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:11.146529 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-42393136-cb88-4e6e-a331-e17f482d320b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:11.152045 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-42393136-cb88-4e6e-a331-e17f482d320b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:11.152928 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-42393136-cb88-4e6e-a331-e17f482d320b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:11.155184 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-42393136-cb88-4e6e-a331-e17f482d320b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:11.156688 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-42393136-cb88-4e6e-a331-e17f482d320b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:11.157299 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-42393136-cb88-4e6e-a331-e17f482d320b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:11.251876 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-31cdf920-22d4-4e77-bacb-c2f7bf1a492f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "DELETE /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f" status: 204 len: 0 microversion: 2.25 time: 0.222498 Sep 16 12:59:11.256189 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1512/3110] 10.222.0.67 () {60 vars in 1280 bytes} [Fri Sep 16 12:59:11 2022] DELETE /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 16 12:59:11.262933 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9caf6482-2ccd-47fa-b8cb-1c8a0ba841f9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:11.263818 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9caf6482-2ccd-47fa-b8cb-1c8a0ba841f9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 041df092-33d4-4b71-84d8-7cd479d32b4f] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:11.271728 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9caf6482-2ccd-47fa-b8cb-1c8a0ba841f9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:11.272559 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9caf6482-2ccd-47fa-b8cb-1c8a0ba841f9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:11.273222 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9caf6482-2ccd-47fa-b8cb-1c8a0ba841f9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:11.274247 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9caf6482-2ccd-47fa-b8cb-1c8a0ba841f9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:11.274909 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9caf6482-2ccd-47fa-b8cb-1c8a0ba841f9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:11.275506 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9caf6482-2ccd-47fa-b8cb-1c8a0ba841f9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:11.677234 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-42393136-cb88-4e6e-a331-e17f482d320b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:11.691034 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-42393136-cb88-4e6e-a331-e17f482d320b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:11.693343 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-42393136-cb88-4e6e-a331-e17f482d320b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:11.695446 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-42393136-cb88-4e6e-a331-e17f482d320b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] 10.222.0.67 "GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05" status: 200 len: 1408 microversion: 2.54 time: 0.564023 Sep 16 12:59:11.720833 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1599/3111] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:59:11 2022] GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05 => generated 1408 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:59:11.869555 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2fb66765-4d5e-43ea-968f-5605a491b9b6 tempest-FlavorsV2NegativeTest-1832567754 tempest-FlavorsV2NegativeTest-1832567754-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:11.879034 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2fb66765-4d5e-43ea-968f-5605a491b9b6 tempest-FlavorsV2NegativeTest-1832567754 tempest-FlavorsV2NegativeTest-1832567754-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.155374 Sep 16 12:59:11.879712 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1600/3112] 10.222.0.67 () {58 vars in 1137 bytes} [Fri Sep 16 12:59:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:59:11.886549 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-2f4a2bd3-fca9-46bc-9f03-1c72a46620e4 req-aa27cdb9-9902-4c0b-a6f9-d7c7292fa7e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5316af91-4d35-4a6e-9584-05d2a5b5cce6", "tag": "23475454-423f-4d72-a3c8-e9e9cbc581b5"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:59:11.908354 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2f4a2bd3-fca9-46bc-9f03-1c72a46620e4 req-aa27cdb9-9902-4c0b-a6f9-d7c7292fa7e2 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:11.909373 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2f4a2bd3-fca9-46bc-9f03-1c72a46620e4 req-aa27cdb9-9902-4c0b-a6f9-d7c7292fa7e2 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:11.910192 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2f4a2bd3-fca9-46bc-9f03-1c72a46620e4 req-aa27cdb9-9902-4c0b-a6f9-d7c7292fa7e2 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:11.923010 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-2f4a2bd3-fca9-46bc-9f03-1c72a46620e4 req-aa27cdb9-9902-4c0b-a6f9-d7c7292fa7e2 service nova] Creating event network-changed:23475454-423f-4d72-a3c8-e9e9cbc581b5 for instance 5316af91-4d35-4a6e-9584-05d2a5b5cce6 on n-h2-858094-4 Sep 16 12:59:11.928030 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-2f4a2bd3-fca9-46bc-9f03-1c72a46620e4 req-aa27cdb9-9902-4c0b-a6f9-d7c7292fa7e2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046924 Sep 16 12:59:11.928758 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1601/3113] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:59:11.934146 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f0678961-9fed-4c21-852a-886c3d87d540 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:11.934852 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f0678961-9fed-4c21-852a-886c3d87d540 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: e8b6a81c-dbec-452e-bd82-a4c86b9c44fd] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:11.941597 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0678961-9fed-4c21-852a-886c3d87d540 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:11.942091 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0678961-9fed-4c21-852a-886c3d87d540 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:11.942527 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0678961-9fed-4c21-852a-886c3d87d540 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:11.943215 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0678961-9fed-4c21-852a-886c3d87d540 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:11.943669 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0678961-9fed-4c21-852a-886c3d87d540 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:11.944091 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0678961-9fed-4c21-852a-886c3d87d540 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:11.979167 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0678961-9fed-4c21-852a-886c3d87d540 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:11.980073 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0678961-9fed-4c21-852a-886c3d87d540 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:11.981000 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0678961-9fed-4c21-852a-886c3d87d540 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:11.981642 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-f0678961-9fed-4c21-852a-886c3d87d540 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lazy-loading 'fault' on Instance uuid e8b6a81c-dbec-452e-bd82-a4c86b9c44fd {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:59:12.054975 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9caf6482-2ccd-47fa-b8cb-1c8a0ba841f9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:12.076270 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9caf6482-2ccd-47fa-b8cb-1c8a0ba841f9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:12.078833 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9caf6482-2ccd-47fa-b8cb-1c8a0ba841f9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:12.081224 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9caf6482-2ccd-47fa-b8cb-1c8a0ba841f9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f" status: 200 len: 1563 microversion: 2.25 time: 0.822598 Sep 16 12:59:12.082494 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1513/3114] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:59:11 2022] GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f => generated 1563 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:59:12.108646 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-bebd326b-157b-4ca0-a83d-370611a027fd tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:12.109663 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-bebd326b-157b-4ca0-a83d-370611a027fd tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 5316af91-4d35-4a6e-9584-05d2a5b5cce6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:12.118928 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bebd326b-157b-4ca0-a83d-370611a027fd tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:12.119808 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bebd326b-157b-4ca0-a83d-370611a027fd tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:12.121420 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bebd326b-157b-4ca0-a83d-370611a027fd tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:12.123273 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bebd326b-157b-4ca0-a83d-370611a027fd tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:12.125148 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bebd326b-157b-4ca0-a83d-370611a027fd tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:12.130639 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bebd326b-157b-4ca0-a83d-370611a027fd tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:12.141469 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f0678961-9fed-4c21-852a-886c3d87d540 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:12.165816 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f0678961-9fed-4c21-852a-886c3d87d540 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd" status: 200 len: 1349 microversion: 2.1 time: 0.233587 Sep 16 12:59:12.168438 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1602/3115] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:11 2022] GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd => generated 1349 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:12.701053 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-11a85746-1dfa-4965-ab2a-c00ad6b2f70c tempest-FlavorsV2NegativeTest-1832567754 tempest-FlavorsV2NegativeTest-1832567754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1345016979", "imageRef": "9237aeba-3962-4549-a3db-6e9905eda2c4", "flavorRef": "452"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:59:12.770713 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-11a85746-1dfa-4965-ab2a-c00ad6b2f70c tempest-FlavorsV2NegativeTest-1832567754 tempest-FlavorsV2NegativeTest-1832567754-project] validate_networks() for None {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:59:12.790469 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-bebd326b-157b-4ca0-a83d-370611a027fd tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:12.799393 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-bebd326b-157b-4ca0-a83d-370611a027fd tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6" status: 200 len: 1333 microversion: 2.1 time: 0.696196 Sep 16 12:59:12.800582 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1514/3116] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:12 2022] GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6 => generated 1333 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:59:12.805646 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-eaf91ddf-155a-48ae-b770-44b4e21aec5e tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:12.806463 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-eaf91ddf-155a-48ae-b770-44b4e21aec5e tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] [instance: 68271bbe-e34a-4c63-93fe-e595e5b3da05] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:12.812960 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eaf91ddf-155a-48ae-b770-44b4e21aec5e tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:12.813695 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eaf91ddf-155a-48ae-b770-44b4e21aec5e tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:12.814404 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eaf91ddf-155a-48ae-b770-44b4e21aec5e tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:12.815300 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eaf91ddf-155a-48ae-b770-44b4e21aec5e tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:12.815913 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eaf91ddf-155a-48ae-b770-44b4e21aec5e tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:12.816372 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eaf91ddf-155a-48ae-b770-44b4e21aec5e tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:12.974905 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-eaf91ddf-155a-48ae-b770-44b4e21aec5e tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:12.984746 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-eaf91ddf-155a-48ae-b770-44b4e21aec5e tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:12.986184 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-eaf91ddf-155a-48ae-b770-44b4e21aec5e tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:12.987357 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-eaf91ddf-155a-48ae-b770-44b4e21aec5e tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] 10.222.0.67 "GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05" status: 200 len: 1408 microversion: 2.54 time: 0.185669 Sep 16 12:59:12.988279 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1515/3117] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:59:12 2022] GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05 => generated 1408 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:59:13.115656 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-181173ca-db05-49a8-9990-94cbebc6fe9f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:13.117822 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-181173ca-db05-49a8-9990-94cbebc6fe9f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 041df092-33d4-4b71-84d8-7cd479d32b4f] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:13.132972 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-181173ca-db05-49a8-9990-94cbebc6fe9f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:13.133812 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-181173ca-db05-49a8-9990-94cbebc6fe9f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:13.134408 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-181173ca-db05-49a8-9990-94cbebc6fe9f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:13.135478 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-181173ca-db05-49a8-9990-94cbebc6fe9f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:13.138077 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-181173ca-db05-49a8-9990-94cbebc6fe9f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:13.138768 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-181173ca-db05-49a8-9990-94cbebc6fe9f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:13.913612 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-11a85746-1dfa-4965-ab2a-c00ad6b2f70c tempest-FlavorsV2NegativeTest-1832567754 tempest-FlavorsV2NegativeTest-1832567754-project] HTTP exception thrown: Flavor's memory is too small for requested image. Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-11a85746-1dfa-4965-ab2a-c00ad6b2f70c tempest-FlavorsV2NegativeTest-1832567754 tempest-FlavorsV2NegativeTest-1832567754-project] Request method failure captured: Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 143 Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHMfnauZKafzonXZz9CQ0VqlbtDvtUQZy4mioW88nNQW2opL09YwW3t1eCB11iwrN1y-zwbVozJbqKnhHpt6ZLTk3tguqe6QtKViVAyNG2-hufrGy53DmIYSabScZQkKZuQfqzXA8ab2HnL7ftEZu3iDB7WQ3rGQh2ian4hgQb-6pkQ Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 5ae8de0381d04ab5be157fa8c54a300c Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-FlavorsV2NegativeTest-1832567754 Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5ae8de0381d04ab5be157fa8c54a300c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5ae8de0381d04ab5be157fa8c54a300c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5ae8de0381d04ab5be157fa8c54a300c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5ae8de0381d04ab5be157fa8c54a300c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-FlavorsV2NegativeTest-1832567754 Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 5ae8de0381d04ab5be157fa8c54a300c Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1832567754 Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-FlavorsV2NegativeTest-1832567754-project Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 3aa753d289f6476e91564c9d37c411b6 Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-FlavorsV2NegativeTest-1832567754-project Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1345016979", "imageRef": "9237aeba-3962-4549-a3db-6e9905eda2c4", "flavorRef": "452"}} Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: exception: Flavor's memory is too small for requested image. Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1345016979', 'imageRef': '9237aeba-3962-4549-a3db-6e9905eda2c4', 'flavorRef': '452'}}} Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:59:13.915620 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:59:13.920253 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 12:59:13.920253 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:59:13.920253 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 16 12:59:13.920253 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Sep 16 12:59:13.920253 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 16 12:59:13.920253 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Sep 16 12:59:13.920253 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:59:13.920253 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:59:13.920253 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:59:13.920253 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:59:13.920253 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:59:13.920253 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:59:13.920253 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:59:13.920253 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:59:13.920253 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Sep 16 12:59:13.920253 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:59:13.922826 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-11a85746-1dfa-4965-ab2a-c00ad6b2f70c tempest-FlavorsV2NegativeTest-1832567754 tempest-FlavorsV2NegativeTest-1832567754-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:59:13.923779 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-11a85746-1dfa-4965-ab2a-c00ad6b2f70c tempest-FlavorsV2NegativeTest-1832567754 tempest-FlavorsV2NegativeTest-1832567754-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 1.226852 Sep 16 12:59:13.926226 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1603/3118] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:59:12 2022] POST /compute/v2.1/servers => generated 93 bytes in 1228 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 16 12:59:13.931941 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c9b334e6-6b85-4b8b-a777-1efdb05e3e8d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:13.932773 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c9b334e6-6b85-4b8b-a777-1efdb05e3e8d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: e8b6a81c-dbec-452e-bd82-a4c86b9c44fd] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:13.940210 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9b334e6-6b85-4b8b-a777-1efdb05e3e8d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:13.940791 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9b334e6-6b85-4b8b-a777-1efdb05e3e8d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:13.941280 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9b334e6-6b85-4b8b-a777-1efdb05e3e8d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:13.942298 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9b334e6-6b85-4b8b-a777-1efdb05e3e8d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:13.942978 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9b334e6-6b85-4b8b-a777-1efdb05e3e8d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:13.943626 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9b334e6-6b85-4b8b-a777-1efdb05e3e8d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:13.961461 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-c9b334e6-6b85-4b8b-a777-1efdb05e3e8d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] HTTP exception thrown: Instance e8b6a81c-dbec-452e-bd82-a4c86b9c44fd could not be found. Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c9b334e6-6b85-4b8b-a777-1efdb05e3e8d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Request method failure captured: Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd HTTP/1.1 Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHK-ai74OxrHHqL5ZA97hOvy32Q6xIReVrKhZIj6PEPyQ_UB4rFs-7hdJCkozKZ5clo_9DaVkBFgsUmiSN_gmVaPdL8FT-f5QYKPk-CE61XDTK1RMhpnQkeVMlba4E4KaPfDCDA8WSNup3uH3mzkxsd2kp-OesctbTYQkqWqHnAvC3I Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_cfe82d8dd4fb42cbb054a6f069424c57", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-DeleteServersTestJSON-1385458479 Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-DeleteServersTestJSON-1385458479-project Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 2e531a7026054c34b2a78a1c484cbe02 Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-DeleteServersTestJSON-1385458479-project Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance e8b6a81c-dbec-452e-bd82-a4c86b9c44fd could not be found. Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': 'e8b6a81c-dbec-452e-bd82-a4c86b9c44fd'} Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8b6a81c-dbec-452e-bd82-a4c86b9c44fd could not be found. Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8b6a81c-dbec-452e-bd82-a4c86b9c44fd could not be found. Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:59:13.963012 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:59:13.968505 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:59:13.968505 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:59:13.968505 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:59:13.968505 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:59:13.968505 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:59:13.968505 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8b6a81c-dbec-452e-bd82-a4c86b9c44fd could not be found. Sep 16 12:59:13.968505 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:59:13.968505 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c9b334e6-6b85-4b8b-a777-1efdb05e3e8d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Returning 404 to user: Instance e8b6a81c-dbec-452e-bd82-a4c86b9c44fd could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:59:13.968505 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c9b334e6-6b85-4b8b-a777-1efdb05e3e8d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd" status: 404 len: 111 microversion: 2.1 time: 0.041467 Sep 16 12:59:13.968505 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1604/3119] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:13 2022] GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:59:13.987019 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c0b0a969-c45d-4669-9c8c-3230bc323c61 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:13.988994 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c0b0a969-c45d-4669-9c8c-3230bc323c61 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 5316af91-4d35-4a6e-9584-05d2a5b5cce6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:13.994103 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0b0a969-c45d-4669-9c8c-3230bc323c61 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:13.994597 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0b0a969-c45d-4669-9c8c-3230bc323c61 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:13.995026 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0b0a969-c45d-4669-9c8c-3230bc323c61 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:13.998705 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0b0a969-c45d-4669-9c8c-3230bc323c61 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:13.999195 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0b0a969-c45d-4669-9c8c-3230bc323c61 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:13.999631 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0b0a969-c45d-4669-9c8c-3230bc323c61 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:14.100642 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-181173ca-db05-49a8-9990-94cbebc6fe9f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:14.113067 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-181173ca-db05-49a8-9990-94cbebc6fe9f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:14.114743 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-181173ca-db05-49a8-9990-94cbebc6fe9f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:14.116147 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-181173ca-db05-49a8-9990-94cbebc6fe9f tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f" status: 200 len: 1563 microversion: 2.25 time: 1.004530 Sep 16 12:59:14.128546 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1516/3120] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:59:13 2022] GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f => generated 1563 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:59:14.143340 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5fb1f6b0-2815-4c95-ab80-9324916f43ad tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:14.143879 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5fb1f6b0-2815-4c95-ab80-9324916f43ad tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] [instance: 68271bbe-e34a-4c63-93fe-e595e5b3da05] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:14.150216 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5fb1f6b0-2815-4c95-ab80-9324916f43ad tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:14.150893 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5fb1f6b0-2815-4c95-ab80-9324916f43ad tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:14.151576 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5fb1f6b0-2815-4c95-ab80-9324916f43ad tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:14.153122 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5fb1f6b0-2815-4c95-ab80-9324916f43ad tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:14.153745 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5fb1f6b0-2815-4c95-ab80-9324916f43ad tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:14.154523 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5fb1f6b0-2815-4c95-ab80-9324916f43ad tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:14.399311 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5fb1f6b0-2815-4c95-ab80-9324916f43ad tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:14.413181 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5fb1f6b0-2815-4c95-ab80-9324916f43ad tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:14.414787 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5fb1f6b0-2815-4c95-ab80-9324916f43ad tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:14.423968 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5fb1f6b0-2815-4c95-ab80-9324916f43ad tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] 10.222.0.67 "GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05" status: 200 len: 1414 microversion: 2.54 time: 0.294120 Sep 16 12:59:14.441114 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1517/3121] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:59:14 2022] GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05 => generated 1414 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:59:14.450558 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-400b5b1f-24b7-4706-baff-296a91000b76 req-c12da171-7c23-4584-bb54-ad70af9082e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5316af91-4d35-4a6e-9584-05d2a5b5cce6", "tag": "1b214136-996e-4af9-b3fe-97e16120f399"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:59:14.461430 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-400b5b1f-24b7-4706-baff-296a91000b76 req-c12da171-7c23-4584-bb54-ad70af9082e2 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:14.462262 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-400b5b1f-24b7-4706-baff-296a91000b76 req-c12da171-7c23-4584-bb54-ad70af9082e2 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:14.463178 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-400b5b1f-24b7-4706-baff-296a91000b76 req-c12da171-7c23-4584-bb54-ad70af9082e2 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:14.504509 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-400b5b1f-24b7-4706-baff-296a91000b76 req-c12da171-7c23-4584-bb54-ad70af9082e2 service nova] Creating event network-changed:1b214136-996e-4af9-b3fe-97e16120f399 for instance 5316af91-4d35-4a6e-9584-05d2a5b5cce6 on n-h2-858094-4 Sep 16 12:59:14.520681 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-400b5b1f-24b7-4706-baff-296a91000b76 req-c12da171-7c23-4584-bb54-ad70af9082e2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078004 Sep 16 12:59:14.521606 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1518/3122] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:59:14.535521 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c51d4a82-0210-49fd-b272-3e54fd8c9a5d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:14.538511 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c51d4a82-0210-49fd-b272-3e54fd8c9a5d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: e8b6a81c-dbec-452e-bd82-a4c86b9c44fd] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:14.553907 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c51d4a82-0210-49fd-b272-3e54fd8c9a5d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:14.557066 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c51d4a82-0210-49fd-b272-3e54fd8c9a5d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:14.563381 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c51d4a82-0210-49fd-b272-3e54fd8c9a5d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:14.564623 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c51d4a82-0210-49fd-b272-3e54fd8c9a5d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:14.565490 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c51d4a82-0210-49fd-b272-3e54fd8c9a5d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:14.566204 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c51d4a82-0210-49fd-b272-3e54fd8c9a5d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:14.587306 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-c51d4a82-0210-49fd-b272-3e54fd8c9a5d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] HTTP exception thrown: Instance e8b6a81c-dbec-452e-bd82-a4c86b9c44fd could not be found. Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c51d4a82-0210-49fd-b272-3e54fd8c9a5d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Request method failure captured: Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd/os-volume_attachments HTTP/1.1 Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHK-ai74OxrHHqL5ZA97hOvy32Q6xIReVrKhZIj6PEPyQ_UB4rFs-7hdJCkozKZ5clo_9DaVkBFgsUmiSN_gmVaPdL8FT-f5QYKPk-CE61XDTK1RMhpnQkeVMlba4E4KaPfDCDA8WSNup3uH3mzkxsd2kp-OesctbTYQkqWqHnAvC3I Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_cfe82d8dd4fb42cbb054a6f069424c57", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-DeleteServersTestJSON-1385458479 Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-DeleteServersTestJSON-1385458479-project Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 2e531a7026054c34b2a78a1c484cbe02 Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-DeleteServersTestJSON-1385458479-project Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance e8b6a81c-dbec-452e-bd82-a4c86b9c44fd could not be found. Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'server_id': 'e8b6a81c-dbec-452e-bd82-a4c86b9c44fd'} Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8b6a81c-dbec-452e-bd82-a4c86b9c44fd could not be found. Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:59:14.591209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:59:14.595134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8b6a81c-dbec-452e-bd82-a4c86b9c44fd could not be found. Sep 16 12:59:14.595134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:14.595134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:59:14.595134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:14.595134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:59:14.595134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:59:14.595134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:59:14.595134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:59:14.595134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:59:14.595134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8b6a81c-dbec-452e-bd82-a4c86b9c44fd could not be found. Sep 16 12:59:14.595134 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:14.599069 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c51d4a82-0210-49fd-b272-3e54fd8c9a5d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Returning 404 to user: Instance e8b6a81c-dbec-452e-bd82-a4c86b9c44fd could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:59:14.600199 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c51d4a82-0210-49fd-b272-3e54fd8c9a5d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.077141 Sep 16 12:59:14.601013 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1519/3123] 10.222.0.67 () {58 vars in 1302 bytes} [Fri Sep 16 12:59:14 2022] GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd/os-volume_attachments => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:59:14.853289 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-bdeeda5a-3c87-4b67-9513-ed63df826ea1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1081765917", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": [{"uuid": "4c6a423f-0493-4448-999c-84f17e899760"}]}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:59:14.961425 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-bdeeda5a-3c87-4b67-9513-ed63df826ea1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] validate_networks() for [('4c6a423f-0493-4448-999c-84f17e899760', None, None, None, None, None)] {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:59:14.982285 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c0b0a969-c45d-4669-9c8c-3230bc323c61 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:14.993730 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c0b0a969-c45d-4669-9c8c-3230bc323c61 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6" status: 200 len: 1333 microversion: 2.1 time: 1.024425 Sep 16 12:59:15.000916 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1605/3124] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:13 2022] GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6 => generated 1333 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:15.149570 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-08c3c6c6-e26c-4ca0-ab4f-a20c2afc5fe9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:15.150251 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-08c3c6c6-e26c-4ca0-ab4f-a20c2afc5fe9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 041df092-33d4-4b71-84d8-7cd479d32b4f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:15.169195 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08c3c6c6-e26c-4ca0-ab4f-a20c2afc5fe9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:15.169729 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08c3c6c6-e26c-4ca0-ab4f-a20c2afc5fe9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:15.170174 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08c3c6c6-e26c-4ca0-ab4f-a20c2afc5fe9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:15.171516 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08c3c6c6-e26c-4ca0-ab4f-a20c2afc5fe9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:15.172338 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08c3c6c6-e26c-4ca0-ab4f-a20c2afc5fe9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:15.172939 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08c3c6c6-e26c-4ca0-ab4f-a20c2afc5fe9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:16.307499 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-08c3c6c6-e26c-4ca0-ab4f-a20c2afc5fe9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:16.325222 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-08c3c6c6-e26c-4ca0-ab4f-a20c2afc5fe9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:16.328670 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-08c3c6c6-e26c-4ca0-ab4f-a20c2afc5fe9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:16.330756 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-08c3c6c6-e26c-4ca0-ab4f-a20c2afc5fe9 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f" status: 200 len: 1563 microversion: 2.25 time: 1.188757 Sep 16 12:59:16.334594 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1606/3125] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:59:15 2022] GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f => generated 1563 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:59:16.341439 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-63ebaaa2-4fe9-4195-97a3-fd42f2c7b0c2 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:16.345032 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-63ebaaa2-4fe9-4195-97a3-fd42f2c7b0c2 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] [instance: 68271bbe-e34a-4c63-93fe-e595e5b3da05] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:16.393355 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63ebaaa2-4fe9-4195-97a3-fd42f2c7b0c2 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:16.396524 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63ebaaa2-4fe9-4195-97a3-fd42f2c7b0c2 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.040s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:16.400301 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63ebaaa2-4fe9-4195-97a3-fd42f2c7b0c2 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:16.401320 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63ebaaa2-4fe9-4195-97a3-fd42f2c7b0c2 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:16.416444 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63ebaaa2-4fe9-4195-97a3-fd42f2c7b0c2 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:16.423307 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63ebaaa2-4fe9-4195-97a3-fd42f2c7b0c2 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:17.006139 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-63ebaaa2-4fe9-4195-97a3-fd42f2c7b0c2 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:17.033978 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-63ebaaa2-4fe9-4195-97a3-fd42f2c7b0c2 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:17.044610 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-63ebaaa2-4fe9-4195-97a3-fd42f2c7b0c2 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:17.045965 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-63ebaaa2-4fe9-4195-97a3-fd42f2c7b0c2 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] 10.222.0.67 "GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05" status: 200 len: 1414 microversion: 2.54 time: 0.710091 Sep 16 12:59:17.046561 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1607/3126] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:59:16 2022] GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05 => generated 1414 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:59:17.096304 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8d4311e3-e722-4ec6-bc2f-8e6595df9e61 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:17.099259 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-bdeeda5a-3c87-4b67-9513-ed63df826ea1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:59:17.100420 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-bdeeda5a-3c87-4b67-9513-ed63df826ea1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:59:17.101069 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-bdeeda5a-3c87-4b67-9513-ed63df826ea1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:59:17.101447 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8d4311e3-e722-4ec6-bc2f-8e6595df9e61 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 5316af91-4d35-4a6e-9584-05d2a5b5cce6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:17.101829 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-bdeeda5a-3c87-4b67-9513-ed63df826ea1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:59:17.102471 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-bdeeda5a-3c87-4b67-9513-ed63df826ea1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:59:17.120603 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bdeeda5a-3c87-4b67-9513-ed63df826ea1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:17.121618 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bdeeda5a-3c87-4b67-9513-ed63df826ea1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:17.123729 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bdeeda5a-3c87-4b67-9513-ed63df826ea1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:17.124944 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bdeeda5a-3c87-4b67-9513-ed63df826ea1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:17.126938 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bdeeda5a-3c87-4b67-9513-ed63df826ea1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:17.128353 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bdeeda5a-3c87-4b67-9513-ed63df826ea1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:17.153052 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d4311e3-e722-4ec6-bc2f-8e6595df9e61 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:17.156433 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d4311e3-e722-4ec6-bc2f-8e6595df9e61 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:17.157379 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d4311e3-e722-4ec6-bc2f-8e6595df9e61 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:17.169554 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d4311e3-e722-4ec6-bc2f-8e6595df9e61 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:17.170462 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d4311e3-e722-4ec6-bc2f-8e6595df9e61 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:17.171007 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d4311e3-e722-4ec6-bc2f-8e6595df9e61 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:17.231035 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-bdeeda5a-3c87-4b67-9513-ed63df826ea1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Getting quotas for project cfe82d8dd4fb42cbb054a6f069424c57. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:59:17.246264 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-bdeeda5a-3c87-4b67-9513-ed63df826ea1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Getting quotas for user 2e531a7026054c34b2a78a1c484cbe02 and project cfe82d8dd4fb42cbb054a6f069424c57. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:59:17.291057 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:59:17.293079 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-bdeeda5a-3c87-4b67-9513-ed63df826ea1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:59:17.297567 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-bdeeda5a-3c87-4b67-9513-ed63df826ea1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: f06d8960-bb68-4f5c-b54b-61cc10e342e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:59:17.407517 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-bdeeda5a-3c87-4b67-9513-ed63df826ea1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.557965 Sep 16 12:59:17.410302 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1520/3127] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:59:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:59:17.427526 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-57c438aa-62b9-4b9f-9ed3-2009afc69fd2 req-f05bb789-69ed-4f78-9f82-0bcc423544ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "041df092-33d4-4b71-84d8-7cd479d32b4f", "name": "network-vif-deleted", "tag": "756cd197-6a93-4b4a-b498-7ebcbb3246c2"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:59:17.442345 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-57c438aa-62b9-4b9f-9ed3-2009afc69fd2 req-f05bb789-69ed-4f78-9f82-0bcc423544ea service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:17.442821 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-57c438aa-62b9-4b9f-9ed3-2009afc69fd2 req-f05bb789-69ed-4f78-9f82-0bcc423544ea service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:17.443248 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-57c438aa-62b9-4b9f-9ed3-2009afc69fd2 req-f05bb789-69ed-4f78-9f82-0bcc423544ea service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:17.463590 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-57c438aa-62b9-4b9f-9ed3-2009afc69fd2 req-f05bb789-69ed-4f78-9f82-0bcc423544ea service nova] Creating event network-vif-deleted:756cd197-6a93-4b4a-b498-7ebcbb3246c2 for instance 041df092-33d4-4b71-84d8-7cd479d32b4f on n-h1-858094-4 Sep 16 12:59:17.470055 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-57c438aa-62b9-4b9f-9ed3-2009afc69fd2 req-f05bb789-69ed-4f78-9f82-0bcc423544ea service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057338 Sep 16 12:59:17.471308 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1521/3128] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:59:17.478329 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-558c5429-a509-4a39-a522-d7ca7f471e44 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:17.479504 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-558c5429-a509-4a39-a522-d7ca7f471e44 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 041df092-33d4-4b71-84d8-7cd479d32b4f] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:17.488925 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-558c5429-a509-4a39-a522-d7ca7f471e44 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:17.490373 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-558c5429-a509-4a39-a522-d7ca7f471e44 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:17.490997 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-558c5429-a509-4a39-a522-d7ca7f471e44 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:17.491908 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-558c5429-a509-4a39-a522-d7ca7f471e44 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:17.492592 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-558c5429-a509-4a39-a522-d7ca7f471e44 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:17.493256 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-558c5429-a509-4a39-a522-d7ca7f471e44 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:17.607980 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-558c5429-a509-4a39-a522-d7ca7f471e44 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:17.608512 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-558c5429-a509-4a39-a522-d7ca7f471e44 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:17.608954 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-558c5429-a509-4a39-a522-d7ca7f471e44 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:17.609412 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-558c5429-a509-4a39-a522-d7ca7f471e44 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lazy-loading 'fault' on Instance uuid 041df092-33d4-4b71-84d8-7cd479d32b4f {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:59:17.707406 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-558c5429-a509-4a39-a522-d7ca7f471e44 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:17.725943 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-558c5429-a509-4a39-a522-d7ca7f471e44 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:17.727230 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-558c5429-a509-4a39-a522-d7ca7f471e44 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab6ca4cf98e14358bf8e0f625812fbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da915844493a4928ac8830897afa126f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:17.728561 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-558c5429-a509-4a39-a522-d7ca7f471e44 tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f" status: 200 len: 1351 microversion: 2.25 time: 0.255819 Sep 16 12:59:17.729038 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1522/3129] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:59:17 2022] GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f => generated 1351 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:59:17.734569 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-10feef81-cceb-4522-9aba-b74b8729a0f3 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:17.741779 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-10feef81-cceb-4522-9aba-b74b8729a0f3 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: f06d8960-bb68-4f5c-b54b-61cc10e342e3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:17.810548 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8d4311e3-e722-4ec6-bc2f-8e6595df9e61 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:17.820035 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8d4311e3-e722-4ec6-bc2f-8e6595df9e61 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6" status: 200 len: 1333 microversion: 2.1 time: 0.763452 Sep 16 12:59:17.821295 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1608/3130] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:17 2022] GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6 => generated 1333 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:17.866200 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-10feef81-cceb-4522-9aba-b74b8729a0f3 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:17.876471 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-10feef81-cceb-4522-9aba-b74b8729a0f3 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/f06d8960-bb68-4f5c-b54b-61cc10e342e3" status: 200 len: 1215 microversion: 2.1 time: 0.146338 Sep 16 12:59:17.877173 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1523/3131] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:17 2022] GET /compute/v2.1/servers/f06d8960-bb68-4f5c-b54b-61cc10e342e3 => generated 1215 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:17.909797 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8f68bc74-eba9-4c98-b1ee-269143681a58 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:17.910323 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8f68bc74-eba9-4c98-b1ee-269143681a58 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: f06d8960-bb68-4f5c-b54b-61cc10e342e3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:17.957838 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8f68bc74-eba9-4c98-b1ee-269143681a58 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: f06d8960-bb68-4f5c-b54b-61cc10e342e3] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:59:18.075387 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-55b64734-4ff4-4e00-a1f1-aba12a78108b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:18.076041 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-55b64734-4ff4-4e00-a1f1-aba12a78108b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] [instance: 68271bbe-e34a-4c63-93fe-e595e5b3da05] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:18.094295 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-55b64734-4ff4-4e00-a1f1-aba12a78108b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:18.102129 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-55b64734-4ff4-4e00-a1f1-aba12a78108b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:18.102779 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-55b64734-4ff4-4e00-a1f1-aba12a78108b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:18.103427 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-55b64734-4ff4-4e00-a1f1-aba12a78108b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:18.103760 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-55b64734-4ff4-4e00-a1f1-aba12a78108b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:18.104212 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-55b64734-4ff4-4e00-a1f1-aba12a78108b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:18.335555 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-55b64734-4ff4-4e00-a1f1-aba12a78108b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:18.356884 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-55b64734-4ff4-4e00-a1f1-aba12a78108b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:18.358868 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-55b64734-4ff4-4e00-a1f1-aba12a78108b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:18.367461 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-55b64734-4ff4-4e00-a1f1-aba12a78108b tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] 10.222.0.67 "GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05" status: 200 len: 1399 microversion: 2.54 time: 0.290918 Sep 16 12:59:18.394318 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1524/3132] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:59:18 2022] GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05 => generated 1399 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:59:18.434031 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b489e426-31fe-4bb3-bed3-ff2a01f867fd tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Calling method '.version_select at 0x7f1035440ee0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:18.516795 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b489e426-31fe-4bb3-bed3-ff2a01f867fd tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1618922604" status: 204 len: 0 microversion: 2.54 time: 0.108374 Sep 16 12:59:18.520179 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1525/3133] 10.222.0.67 () {60 vars in 1319 bytes} [Fri Sep 16 12:59:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1618922604 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 12:59:18.543041 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.scheduler.client.report [None req-8f68bc74-eba9-4c98-b1ee-269143681a58 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Deleted allocations for instance f06d8960-bb68-4f5c-b54b-61cc10e342e3 Sep 16 12:59:18.557791 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4331527d-5679-4327-bc6c-498f7a30830e tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:18.558724 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-4331527d-5679-4327-bc6c-498f7a30830e tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] [instance: 68271bbe-e34a-4c63-93fe-e595e5b3da05] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:18.578138 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8f68bc74-eba9-4c98-b1ee-269143681a58 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f06d8960-bb68-4f5c-b54b-61cc10e342e3" status: 204 len: 0 microversion: 2.1 time: 0.676918 Sep 16 12:59:18.582417 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1609/3134] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:59:17 2022] DELETE /compute/v2.1/servers/f06d8960-bb68-4f5c-b54b-61cc10e342e3 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:59:18.584517 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4331527d-5679-4327-bc6c-498f7a30830e tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:18.586194 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4331527d-5679-4327-bc6c-498f7a30830e tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:18.586833 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4331527d-5679-4327-bc6c-498f7a30830e tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:18.590125 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4331527d-5679-4327-bc6c-498f7a30830e tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:18.595025 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-06481ad6-acae-49a1-bf3f-cb55b02b1032 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:18.595545 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4331527d-5679-4327-bc6c-498f7a30830e tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:18.596212 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4331527d-5679-4327-bc6c-498f7a30830e tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:18.601901 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-06481ad6-acae-49a1-bf3f-cb55b02b1032 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: f06d8960-bb68-4f5c-b54b-61cc10e342e3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:18.634228 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06481ad6-acae-49a1-bf3f-cb55b02b1032 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:18.635004 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06481ad6-acae-49a1-bf3f-cb55b02b1032 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:18.635607 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06481ad6-acae-49a1-bf3f-cb55b02b1032 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:18.637082 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06481ad6-acae-49a1-bf3f-cb55b02b1032 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:18.637711 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06481ad6-acae-49a1-bf3f-cb55b02b1032 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:18.640320 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06481ad6-acae-49a1-bf3f-cb55b02b1032 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:18.653173 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:59:18.684688 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-4331527d-5679-4327-bc6c-498f7a30830e tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] [instance: 68271bbe-e34a-4c63-93fe-e595e5b3da05] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:59:18.839312 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4331527d-5679-4327-bc6c-498f7a30830e tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] 10.222.0.67 "DELETE /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05" status: 204 len: 0 microversion: 2.54 time: 0.299347 Sep 16 12:59:18.848699 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1526/3135] 10.222.0.67 () {60 vars in 1280 bytes} [Fri Sep 16 12:59:18 2022] DELETE /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 12:59:18.859707 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-06481ad6-acae-49a1-bf3f-cb55b02b1032 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:18.861527 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6bc92ea2-b889-48b6-b20d-2cdf64f3126b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:18.862257 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6bc92ea2-b889-48b6-b20d-2cdf64f3126b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] [instance: 041df092-33d4-4b71-84d8-7cd479d32b4f] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:18.871264 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-06481ad6-acae-49a1-bf3f-cb55b02b1032 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/f06d8960-bb68-4f5c-b54b-61cc10e342e3" status: 200 len: 1219 microversion: 2.1 time: 0.286875 Sep 16 12:59:18.876184 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1610/3136] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:18 2022] GET /compute/v2.1/servers/f06d8960-bb68-4f5c-b54b-61cc10e342e3 => generated 1219 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:18.892619 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-170d236a-f25d-40b5-9e11-536d368027fc tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:18.893182 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6bc92ea2-b889-48b6-b20d-2cdf64f3126b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:18.893683 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6bc92ea2-b889-48b6-b20d-2cdf64f3126b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:18.894367 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-170d236a-f25d-40b5-9e11-536d368027fc tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 5316af91-4d35-4a6e-9584-05d2a5b5cce6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:18.911724 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-170d236a-f25d-40b5-9e11-536d368027fc tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:18.912530 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-170d236a-f25d-40b5-9e11-536d368027fc tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:18.912736 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6bc92ea2-b889-48b6-b20d-2cdf64f3126b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:18.913096 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-170d236a-f25d-40b5-9e11-536d368027fc tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:18.913679 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6bc92ea2-b889-48b6-b20d-2cdf64f3126b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:18.914169 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6bc92ea2-b889-48b6-b20d-2cdf64f3126b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:18.914605 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6bc92ea2-b889-48b6-b20d-2cdf64f3126b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:18.915226 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-170d236a-f25d-40b5-9e11-536d368027fc tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:18.915783 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-170d236a-f25d-40b5-9e11-536d368027fc tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:18.916570 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-170d236a-f25d-40b5-9e11-536d368027fc tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:18.956629 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-6bc92ea2-b889-48b6-b20d-2cdf64f3126b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] HTTP exception thrown: Instance 041df092-33d4-4b71-84d8-7cd479d32b4f could not be found. Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6bc92ea2-b889-48b6-b20d-2cdf64f3126b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Request method failure captured: Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f HTTP/1.1 Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHE297bgLwu6A_IDcOSJSdu6eRNIiYzXjFD_trhQ5Zrp-ooRgkPARidIZIqqeJe2Kdku_XuXoM_SolPfWGD0o3QxZ3wv79x5WFDUj7ADR64ChdpxVvvmkrz9v_xYZxdcsZLTCMHNC36-c1pMZgicMh57Lg46Lm4e3CjZ0UGOU8qLK0o Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: X-Openstack-Nova-Api-Version: 2.25 Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: da915844493a4928ac8830897afa126f Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1786781270 Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/da915844493a4928ac8830897afa126f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/da915844493a4928ac8830897afa126f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_da915844493a4928ac8830897afa126f", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/da915844493a4928ac8830897afa126f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1786781270 Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: da915844493a4928ac8830897afa126f Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1786781270 Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-LiveAutoBlockMigrationV225Test-1786781270-project Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: ab6ca4cf98e14358bf8e0f625812fbb9 Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1786781270-project Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance 041df092-33d4-4b71-84d8-7cd479d32b4f could not be found. Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '041df092-33d4-4b71-84d8-7cd479d32b4f'} Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 041df092-33d4-4b71-84d8-7cd479d32b4f could not be found. Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 041df092-33d4-4b71-84d8-7cd479d32b4f could not be found. Sep 16 12:59:18.964505 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:18.969493 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:59:18.969493 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:18.969493 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:59:18.969493 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:59:18.969493 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:59:18.969493 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:59:18.969493 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:59:18.969493 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 041df092-33d4-4b71-84d8-7cd479d32b4f could not be found. Sep 16 12:59:18.969493 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:18.969493 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6bc92ea2-b889-48b6-b20d-2cdf64f3126b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] Returning 404 to user: Instance 041df092-33d4-4b71-84d8-7cd479d32b4f could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:59:18.969493 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6bc92ea2-b889-48b6-b20d-2cdf64f3126b tempest-LiveAutoBlockMigrationV225Test-1786781270 tempest-LiveAutoBlockMigrationV225Test-1786781270-project] 10.222.0.67 "GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f" status: 404 len: 111 microversion: 2.25 time: 0.118127 Sep 16 12:59:18.969493 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1527/3137] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:59:18 2022] GET /compute/v2.1/servers/041df092-33d4-4b71-84d8-7cd479d32b4f => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 12:59:18.971497 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0d3084a0-82cf-461a-88e0-fdef152afe03 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:18.974065 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0d3084a0-82cf-461a-88e0-fdef152afe03 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] [instance: 68271bbe-e34a-4c63-93fe-e595e5b3da05] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:18.994721 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0d3084a0-82cf-461a-88e0-fdef152afe03 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:18.996865 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0d3084a0-82cf-461a-88e0-fdef152afe03 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:18.997670 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0d3084a0-82cf-461a-88e0-fdef152afe03 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:19.000596 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0d3084a0-82cf-461a-88e0-fdef152afe03 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:19.001226 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0d3084a0-82cf-461a-88e0-fdef152afe03 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:19.001754 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0d3084a0-82cf-461a-88e0-fdef152afe03 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:19.510180 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0d3084a0-82cf-461a-88e0-fdef152afe03 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:19.520919 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0d3084a0-82cf-461a-88e0-fdef152afe03 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:19.522588 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0d3084a0-82cf-461a-88e0-fdef152afe03 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:19.524010 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0d3084a0-82cf-461a-88e0-fdef152afe03 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] 10.222.0.67 "GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05" status: 200 len: 1405 microversion: 2.54 time: 0.556290 Sep 16 12:59:19.524942 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1528/3138] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:59:18 2022] GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05 => generated 1405 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 12:59:19.901597 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ad806ee2-320f-4df1-8627-1253fcf953e8 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:19.902641 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ad806ee2-320f-4df1-8627-1253fcf953e8 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: f06d8960-bb68-4f5c-b54b-61cc10e342e3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:19.918549 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ad806ee2-320f-4df1-8627-1253fcf953e8 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:19.919214 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ad806ee2-320f-4df1-8627-1253fcf953e8 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:19.919758 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ad806ee2-320f-4df1-8627-1253fcf953e8 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:19.920614 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ad806ee2-320f-4df1-8627-1253fcf953e8 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:19.921179 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ad806ee2-320f-4df1-8627-1253fcf953e8 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:19.921737 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ad806ee2-320f-4df1-8627-1253fcf953e8 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:19.954825 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-ad806ee2-320f-4df1-8627-1253fcf953e8 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] HTTP exception thrown: Instance f06d8960-bb68-4f5c-b54b-61cc10e342e3 could not be found. Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ad806ee2-320f-4df1-8627-1253fcf953e8 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Request method failure captured: Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/f06d8960-bb68-4f5c-b54b-61cc10e342e3 HTTP/1.1 Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHK-ai74OxrHHqL5ZA97hOvy32Q6xIReVrKhZIj6PEPyQ_UB4rFs-7hdJCkozKZ5clo_9DaVkBFgsUmiSN_gmVaPdL8FT-f5QYKPk-CE61XDTK1RMhpnQkeVMlba4E4KaPfDCDA8WSNup3uH3mzkxsd2kp-OesctbTYQkqWqHnAvC3I Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_cfe82d8dd4fb42cbb054a6f069424c57", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-DeleteServersTestJSON-1385458479 Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-DeleteServersTestJSON-1385458479-project Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 2e531a7026054c34b2a78a1c484cbe02 Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-DeleteServersTestJSON-1385458479-project Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance f06d8960-bb68-4f5c-b54b-61cc10e342e3 could not be found. Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'f06d8960-bb68-4f5c-b54b-61cc10e342e3'} Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f06d8960-bb68-4f5c-b54b-61cc10e342e3 could not be found. Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f06d8960-bb68-4f5c-b54b-61cc10e342e3 could not be found. Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:59:19.968772 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:19.973642 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:59:19.973642 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:59:19.973642 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:59:19.973642 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:59:19.973642 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:59:19.973642 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f06d8960-bb68-4f5c-b54b-61cc10e342e3 could not be found. Sep 16 12:59:19.973642 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:19.973642 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ad806ee2-320f-4df1-8627-1253fcf953e8 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Returning 404 to user: Instance f06d8960-bb68-4f5c-b54b-61cc10e342e3 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:59:19.974986 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ad806ee2-320f-4df1-8627-1253fcf953e8 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/f06d8960-bb68-4f5c-b54b-61cc10e342e3" status: 404 len: 111 microversion: 2.1 time: 0.077356 Sep 16 12:59:19.975680 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1529/3139] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:19 2022] GET /compute/v2.1/servers/f06d8960-bb68-4f5c-b54b-61cc10e342e3 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 12:59:20.063142 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-170d236a-f25d-40b5-9e11-536d368027fc tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:20.072174 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-170d236a-f25d-40b5-9e11-536d368027fc tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6" status: 200 len: 1333 microversion: 2.1 time: 1.194414 Sep 16 12:59:20.078991 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1611/3140] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:18 2022] GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6 => generated 1333 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:20.222718 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7bf21242-5cf2-4c19-a58f-08a2e820390f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-371522768", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": [{"uuid": "4c6a423f-0493-4448-999c-84f17e899760"}]}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:59:20.372319 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-7bf21242-5cf2-4c19-a58f-08a2e820390f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] validate_networks() for [('4c6a423f-0493-4448-999c-84f17e899760', None, None, None, None, None)] {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:59:20.551246 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9abca19a-d91e-44ca-bddf-ad0c194b768e tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:20.551929 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9abca19a-d91e-44ca-bddf-ad0c194b768e tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] [instance: 68271bbe-e34a-4c63-93fe-e595e5b3da05] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:20.577328 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9abca19a-d91e-44ca-bddf-ad0c194b768e tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:20.584205 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9abca19a-d91e-44ca-bddf-ad0c194b768e tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:20.587507 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9abca19a-d91e-44ca-bddf-ad0c194b768e tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:20.594364 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9abca19a-d91e-44ca-bddf-ad0c194b768e tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:20.598985 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9abca19a-d91e-44ca-bddf-ad0c194b768e tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:20.599822 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9abca19a-d91e-44ca-bddf-ad0c194b768e tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:21.173161 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9abca19a-d91e-44ca-bddf-ad0c194b768e tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:21.187688 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9abca19a-d91e-44ca-bddf-ad0c194b768e tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:21.196115 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9abca19a-d91e-44ca-bddf-ad0c194b768e tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:21.197681 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9abca19a-d91e-44ca-bddf-ad0c194b768e tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] 10.222.0.67 "GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05" status: 200 len: 1405 microversion: 2.54 time: 0.650651 Sep 16 12:59:21.199651 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1612/3141] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:59:20 2022] GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05 => generated 1405 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:59:21.216091 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c2ec29e7-70ca-4ca4-b23c-32120e74b471 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:21.217000 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c2ec29e7-70ca-4ca4-b23c-32120e74b471 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 5316af91-4d35-4a6e-9584-05d2a5b5cce6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:21.229753 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2ec29e7-70ca-4ca4-b23c-32120e74b471 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:21.230708 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2ec29e7-70ca-4ca4-b23c-32120e74b471 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:21.231324 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2ec29e7-70ca-4ca4-b23c-32120e74b471 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:21.233143 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2ec29e7-70ca-4ca4-b23c-32120e74b471 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:21.236868 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2ec29e7-70ca-4ca4-b23c-32120e74b471 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:21.237537 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2ec29e7-70ca-4ca4-b23c-32120e74b471 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:21.882782 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c2ec29e7-70ca-4ca4-b23c-32120e74b471 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:21.891607 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c2ec29e7-70ca-4ca4-b23c-32120e74b471 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6" status: 200 len: 1333 microversion: 2.1 time: 0.690482 Sep 16 12:59:21.898493 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1613/3142] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:21 2022] GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6 => generated 1333 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:22.225155 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d0a5cc02-cf18-4e99-b6b3-315ef813650a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:22.225823 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d0a5cc02-cf18-4e99-b6b3-315ef813650a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] [instance: 68271bbe-e34a-4c63-93fe-e595e5b3da05] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:22.254124 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0a5cc02-cf18-4e99-b6b3-315ef813650a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:22.254994 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0a5cc02-cf18-4e99-b6b3-315ef813650a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:22.257500 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0a5cc02-cf18-4e99-b6b3-315ef813650a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:22.266181 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0a5cc02-cf18-4e99-b6b3-315ef813650a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:22.267875 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0a5cc02-cf18-4e99-b6b3-315ef813650a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:22.269244 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0a5cc02-cf18-4e99-b6b3-315ef813650a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:22.375372 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0a5cc02-cf18-4e99-b6b3-315ef813650a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:22.378146 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0a5cc02-cf18-4e99-b6b3-315ef813650a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:22.380353 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0a5cc02-cf18-4e99-b6b3-315ef813650a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:22.381972 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-d0a5cc02-cf18-4e99-b6b3-315ef813650a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lazy-loading 'fault' on Instance uuid 68271bbe-e34a-4c63-93fe-e595e5b3da05 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:59:22.617064 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d0a5cc02-cf18-4e99-b6b3-315ef813650a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:22.621968 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:59:22.627815 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d0a5cc02-cf18-4e99-b6b3-315ef813650a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:22.638720 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d0a5cc02-cf18-4e99-b6b3-315ef813650a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5b0416153144ec5973d671bdd22ba33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a6db3fbe124de2af50db325deea520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:22.643175 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d0a5cc02-cf18-4e99-b6b3-315ef813650a tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] 10.222.0.67 "GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05" status: 200 len: 1410 microversion: 2.54 time: 0.422102 Sep 16 12:59:22.651181 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1614/3143] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:59:22 2022] GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05 => generated 1410 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 12:59:22.810807 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-7bf21242-5cf2-4c19-a58f-08a2e820390f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:59:22.812393 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-7bf21242-5cf2-4c19-a58f-08a2e820390f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:59:22.817740 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-7bf21242-5cf2-4c19-a58f-08a2e820390f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:59:22.820735 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-7bf21242-5cf2-4c19-a58f-08a2e820390f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:59:22.822330 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-7bf21242-5cf2-4c19-a58f-08a2e820390f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:59:22.879090 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7bf21242-5cf2-4c19-a58f-08a2e820390f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:22.880624 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7bf21242-5cf2-4c19-a58f-08a2e820390f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:22.881661 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7bf21242-5cf2-4c19-a58f-08a2e820390f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:22.883366 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7bf21242-5cf2-4c19-a58f-08a2e820390f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:22.893723 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7bf21242-5cf2-4c19-a58f-08a2e820390f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:22.895737 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7bf21242-5cf2-4c19-a58f-08a2e820390f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:22.921563 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fadf97ab-0278-489b-a6f7-7a9c874b8883 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:22.922186 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fadf97ab-0278-489b-a6f7-7a9c874b8883 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 5316af91-4d35-4a6e-9584-05d2a5b5cce6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:22.932386 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fadf97ab-0278-489b-a6f7-7a9c874b8883 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:22.933753 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fadf97ab-0278-489b-a6f7-7a9c874b8883 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:22.942063 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fadf97ab-0278-489b-a6f7-7a9c874b8883 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:22.942824 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fadf97ab-0278-489b-a6f7-7a9c874b8883 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:22.945924 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fadf97ab-0278-489b-a6f7-7a9c874b8883 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:22.946384 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fadf97ab-0278-489b-a6f7-7a9c874b8883 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:22.998790 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-7bf21242-5cf2-4c19-a58f-08a2e820390f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Getting quotas for project cfe82d8dd4fb42cbb054a6f069424c57. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:59:23.019545 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-7bf21242-5cf2-4c19-a58f-08a2e820390f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Getting quotas for user 2e531a7026054c34b2a78a1c484cbe02 and project cfe82d8dd4fb42cbb054a6f069424c57. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:59:23.062076 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7bf21242-5cf2-4c19-a58f-08a2e820390f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:59:23.069587 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7bf21242-5cf2-4c19-a58f-08a2e820390f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 45c75956-6533-4add-91e9-419a2043d9e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:59:23.249640 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7bf21242-5cf2-4c19-a58f-08a2e820390f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.031309 Sep 16 12:59:23.252904 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1530/3144] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:59:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 3035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:59:23.265584 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-13e9b8fc-d392-442b-b842-ea4e36336a75 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:23.266442 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-13e9b8fc-d392-442b-b842-ea4e36336a75 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 45c75956-6533-4add-91e9-419a2043d9e1] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:23.799633 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-13e9b8fc-d392-442b-b842-ea4e36336a75 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:23.825724 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-13e9b8fc-d392-442b-b842-ea4e36336a75 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1" status: 200 len: 1214 microversion: 2.1 time: 0.565445 Sep 16 12:59:23.837094 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1531/3145] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:23 2022] GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1 => generated 1214 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:59:23.853055 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9cd542bb-c660-4e4f-a4a6-7d1ab177a392 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:23.853891 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9cd542bb-c660-4e4f-a4a6-7d1ab177a392 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] [instance: 68271bbe-e34a-4c63-93fe-e595e5b3da05] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:23.866124 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9cd542bb-c660-4e4f-a4a6-7d1ab177a392 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:23.870308 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9cd542bb-c660-4e4f-a4a6-7d1ab177a392 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:23.875889 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9cd542bb-c660-4e4f-a4a6-7d1ab177a392 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:23.876958 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9cd542bb-c660-4e4f-a4a6-7d1ab177a392 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:23.877604 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9cd542bb-c660-4e4f-a4a6-7d1ab177a392 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:23.884366 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9cd542bb-c660-4e4f-a4a6-7d1ab177a392 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:23.911989 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-9cd542bb-c660-4e4f-a4a6-7d1ab177a392 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] HTTP exception thrown: Instance 68271bbe-e34a-4c63-93fe-e595e5b3da05 could not be found. Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9cd542bb-c660-4e4f-a4a6-7d1ab177a392 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Request method failure captured: Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05 HTTP/1.1 Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHL6Svdd5nXnuy7lquZLoFCeKLaq9QpDW-b1COjAmjyliwahO1LhCjBVSkyJ8pNv0CSSy4Fkv9HtIOX3S3cJ64G-Dg-hdMXmEzDI9O2cjCevxwJ5NtiyBJaQRjk3fInvAJVu-s7w-Py4OfwwDi5sBTllUgJtLsX48mVzqPqFlwDGuWs Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: X-Openstack-Nova-Api-Version: 2.54 Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: e2a6db3fbe124de2af50db325deea520 Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ServerShowV254Test-605873761 Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e2a6db3fbe124de2af50db325deea520"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e2a6db3fbe124de2af50db325deea520"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e2a6db3fbe124de2af50db325deea520", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e2a6db3fbe124de2af50db325deea520"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ServerShowV254Test-605873761 Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: e2a6db3fbe124de2af50db325deea520 Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ServerShowV254Test-605873761 Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ServerShowV254Test-605873761-project Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: d5b0416153144ec5973d671bdd22ba33 Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ServerShowV254Test-605873761-project Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance 68271bbe-e34a-4c63-93fe-e595e5b3da05 could not be found. Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '68271bbe-e34a-4c63-93fe-e595e5b3da05'} Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68271bbe-e34a-4c63-93fe-e595e5b3da05 could not be found. Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68271bbe-e34a-4c63-93fe-e595e5b3da05 could not be found. Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:59:23.933817 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:23.944325 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:59:23.944325 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:59:23.944325 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:59:23.944325 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:59:23.944325 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:59:23.944325 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68271bbe-e34a-4c63-93fe-e595e5b3da05 could not be found. Sep 16 12:59:23.944325 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:23.944325 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9cd542bb-c660-4e4f-a4a6-7d1ab177a392 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] Returning 404 to user: Instance 68271bbe-e34a-4c63-93fe-e595e5b3da05 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:59:23.944325 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9cd542bb-c660-4e4f-a4a6-7d1ab177a392 tempest-ServerShowV254Test-605873761 tempest-ServerShowV254Test-605873761-project] 10.222.0.67 "GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05" status: 404 len: 111 microversion: 2.54 time: 0.096979 Sep 16 12:59:23.944325 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1532/3146] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 12:59:23 2022] GET /compute/v2.1/servers/68271bbe-e34a-4c63-93fe-e595e5b3da05 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 12:59:24.046087 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fadf97ab-0278-489b-a6f7-7a9c874b8883 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:24.056793 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fadf97ab-0278-489b-a6f7-7a9c874b8883 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6" status: 200 len: 1333 microversion: 2.1 time: 1.139666 Sep 16 12:59:24.057402 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1615/3147] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:22 2022] GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6 => generated 1333 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:59:24.411348 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a384e1f9-16c1-4b2b-8faa-f920d0b04223 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:24.416214 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a384e1f9-16c1-4b2b-8faa-f920d0b04223 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 272fddb0-eba2-4559-b76d-460bd65246ec] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:24.453967 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a384e1f9-16c1-4b2b-8faa-f920d0b04223 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:24.454493 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a384e1f9-16c1-4b2b-8faa-f920d0b04223 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:24.454943 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a384e1f9-16c1-4b2b-8faa-f920d0b04223 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:24.455670 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a384e1f9-16c1-4b2b-8faa-f920d0b04223 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:24.458518 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a384e1f9-16c1-4b2b-8faa-f920d0b04223 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:24.461085 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a384e1f9-16c1-4b2b-8faa-f920d0b04223 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:24.557766 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a384e1f9-16c1-4b2b-8faa-f920d0b04223 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.150547 Sep 16 12:59:24.559047 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1533/3148] 10.222.0.67 () {58 vars in 1302 bytes} [Fri Sep 16 12:59:24 2022] GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec/os-volume_attachments => generated 371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:59:24.707217 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-abaa8fc6-316d-40c7-a2dd-0f5affe6a287 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:24.708494 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-abaa8fc6-316d-40c7-a2dd-0f5affe6a287 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 272fddb0-eba2-4559-b76d-460bd65246ec] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:24.729393 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abaa8fc6-316d-40c7-a2dd-0f5affe6a287 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:24.742868 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abaa8fc6-316d-40c7-a2dd-0f5affe6a287 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:24.744212 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abaa8fc6-316d-40c7-a2dd-0f5affe6a287 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:24.751076 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abaa8fc6-316d-40c7-a2dd-0f5affe6a287 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:24.757810 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abaa8fc6-316d-40c7-a2dd-0f5affe6a287 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:24.759965 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abaa8fc6-316d-40c7-a2dd-0f5affe6a287 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:24.869436 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fca02fea-5c1a-480e-94a4-085bf26c43d2 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:24.870216 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-fca02fea-5c1a-480e-94a4-085bf26c43d2 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 45c75956-6533-4add-91e9-419a2043d9e1] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:24.886863 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fca02fea-5c1a-480e-94a4-085bf26c43d2 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:24.893094 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fca02fea-5c1a-480e-94a4-085bf26c43d2 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:24.894642 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fca02fea-5c1a-480e-94a4-085bf26c43d2 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:24.899448 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fca02fea-5c1a-480e-94a4-085bf26c43d2 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:24.907013 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fca02fea-5c1a-480e-94a4-085bf26c43d2 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:24.907658 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fca02fea-5c1a-480e-94a4-085bf26c43d2 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:24.910200 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-abaa8fc6-316d-40c7-a2dd-0f5affe6a287 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec/os-volume_attachments/7b381151-4633-43ce-900d-79c33282a557" status: 200 len: 194 microversion: 2.1 time: 0.205162 Sep 16 12:59:24.917027 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1616/3149] 10.222.0.67 () {58 vars in 1413 bytes} [Fri Sep 16 12:59:24 2022] GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec/os-volume_attachments/7b381151-4633-43ce-900d-79c33282a557 => generated 194 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:59:24.954324 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-685e1dab-1762-4c1d-92cd-a88204b1b236 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:24.961656 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-685e1dab-1762-4c1d-92cd-a88204b1b236 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 272fddb0-eba2-4559-b76d-460bd65246ec] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:24.992287 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-685e1dab-1762-4c1d-92cd-a88204b1b236 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:24.996754 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-685e1dab-1762-4c1d-92cd-a88204b1b236 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:25.004716 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-685e1dab-1762-4c1d-92cd-a88204b1b236 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:25.008481 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-685e1dab-1762-4c1d-92cd-a88204b1b236 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:25.009891 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-685e1dab-1762-4c1d-92cd-a88204b1b236 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:25.012806 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-685e1dab-1762-4c1d-92cd-a88204b1b236 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:25.141112 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-fca02fea-5c1a-480e-94a4-085bf26c43d2 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:25.149930 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-fca02fea-5c1a-480e-94a4-085bf26c43d2 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1" status: 200 len: 1210 microversion: 2.1 time: 0.286924 Sep 16 12:59:25.150528 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1534/3150] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:24 2022] GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1 => generated 1210 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:25.210743 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-bc4c3e07-351c-49e2-a732-498205326c59 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:25.225668 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-bc4c3e07-351c-49e2-a732-498205326c59 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 5316af91-4d35-4a6e-9584-05d2a5b5cce6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:25.257887 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bc4c3e07-351c-49e2-a732-498205326c59 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:25.265450 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bc4c3e07-351c-49e2-a732-498205326c59 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:25.268222 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bc4c3e07-351c-49e2-a732-498205326c59 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:25.269128 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bc4c3e07-351c-49e2-a732-498205326c59 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:25.273619 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bc4c3e07-351c-49e2-a732-498205326c59 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:25.279234 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bc4c3e07-351c-49e2-a732-498205326c59 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:25.362806 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-685e1dab-1762-4c1d-92cd-a88204b1b236 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lazy-loading 'services' on Instance uuid 272fddb0-eba2-4559-b76d-460bd65246ec {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:59:25.583091 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-685e1dab-1762-4c1d-92cd-a88204b1b236 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "DELETE /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec/os-volume_attachments/7b381151-4633-43ce-900d-79c33282a557" status: 202 len: 0 microversion: 2.1 time: 0.660379 Sep 16 12:59:25.604620 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1617/3151] 10.222.0.67 () {58 vars in 1416 bytes} [Fri Sep 16 12:59:24 2022] DELETE /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec/os-volume_attachments/7b381151-4633-43ce-900d-79c33282a557 => generated 0 bytes in 686 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 12:59:26.191357 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-abc84e72-44a5-40ba-9752-09e31fabe50d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:26.192413 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-abc84e72-44a5-40ba-9752-09e31fabe50d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 45c75956-6533-4add-91e9-419a2043d9e1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:26.218806 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abc84e72-44a5-40ba-9752-09e31fabe50d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:26.219823 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abc84e72-44a5-40ba-9752-09e31fabe50d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:26.221712 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abc84e72-44a5-40ba-9752-09e31fabe50d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:26.225345 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abc84e72-44a5-40ba-9752-09e31fabe50d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:26.226217 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abc84e72-44a5-40ba-9752-09e31fabe50d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:26.228366 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abc84e72-44a5-40ba-9752-09e31fabe50d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:26.906611 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-abc84e72-44a5-40ba-9752-09e31fabe50d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:26.926567 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-abc84e72-44a5-40ba-9752-09e31fabe50d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1" status: 200 len: 1272 microversion: 2.1 time: 0.744199 Sep 16 12:59:26.929888 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1618/3152] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:26 2022] GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1 => generated 1272 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:27.153895 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-bc4c3e07-351c-49e2-a732-498205326c59 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:27.166341 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-bc4c3e07-351c-49e2-a732-498205326c59 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6" status: 200 len: 1333 microversion: 2.1 time: 1.984695 Sep 16 12:59:27.172856 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1535/3153] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:25 2022] GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6 => generated 1333 bytes in 1992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:27.957649 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c7f1cf2f-e2fa-464f-bc20-d5a662f6febc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:27.959062 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c7f1cf2f-e2fa-464f-bc20-d5a662f6febc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 45c75956-6533-4add-91e9-419a2043d9e1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:27.962472 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:59:27.987171 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c7f1cf2f-e2fa-464f-bc20-d5a662f6febc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:27.994183 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c7f1cf2f-e2fa-464f-bc20-d5a662f6febc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:27.994677 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c7f1cf2f-e2fa-464f-bc20-d5a662f6febc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:27.995460 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c7f1cf2f-e2fa-464f-bc20-d5a662f6febc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:27.995934 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c7f1cf2f-e2fa-464f-bc20-d5a662f6febc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:27.996384 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c7f1cf2f-e2fa-464f-bc20-d5a662f6febc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:28.122027 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:59:28.202076 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-feab60a9-9347-43dc-bff5-51aeed636321 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:28.204381 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-feab60a9-9347-43dc-bff5-51aeed636321 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 5316af91-4d35-4a6e-9584-05d2a5b5cce6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:28.238913 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-feab60a9-9347-43dc-bff5-51aeed636321 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:28.239430 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-feab60a9-9347-43dc-bff5-51aeed636321 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:28.239881 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-feab60a9-9347-43dc-bff5-51aeed636321 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:28.249119 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-feab60a9-9347-43dc-bff5-51aeed636321 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:28.249663 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-feab60a9-9347-43dc-bff5-51aeed636321 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:28.250075 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-feab60a9-9347-43dc-bff5-51aeed636321 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:28.441800 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c7f1cf2f-e2fa-464f-bc20-d5a662f6febc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:28.461504 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c7f1cf2f-e2fa-464f-bc20-d5a662f6febc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1" status: 200 len: 1272 microversion: 2.1 time: 0.512389 Sep 16 12:59:28.466944 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1619/3154] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:27 2022] GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1 => generated 1272 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:28.947733 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-feab60a9-9347-43dc-bff5-51aeed636321 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:28.969531 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-feab60a9-9347-43dc-bff5-51aeed636321 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6" status: 200 len: 1333 microversion: 2.1 time: 0.768278 Sep 16 12:59:28.972512 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1536/3155] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:28 2022] GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6 => generated 1333 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:59:29.497056 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-37c101be-a2fb-423c-96d9-68052d2411df tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:29.498408 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-37c101be-a2fb-423c-96d9-68052d2411df tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 45c75956-6533-4add-91e9-419a2043d9e1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:29.547910 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37c101be-a2fb-423c-96d9-68052d2411df tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:29.557166 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37c101be-a2fb-423c-96d9-68052d2411df tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:29.560691 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37c101be-a2fb-423c-96d9-68052d2411df tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:29.561511 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37c101be-a2fb-423c-96d9-68052d2411df tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:29.562000 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37c101be-a2fb-423c-96d9-68052d2411df tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:29.574776 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37c101be-a2fb-423c-96d9-68052d2411df tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:29.994240 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-28403538-6aa6-4b8c-aa99-32d32efd18ea tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:29.995247 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-28403538-6aa6-4b8c-aa99-32d32efd18ea tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 5316af91-4d35-4a6e-9584-05d2a5b5cce6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:30.017506 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-28403538-6aa6-4b8c-aa99-32d32efd18ea tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:30.018023 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-28403538-6aa6-4b8c-aa99-32d32efd18ea tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:30.021235 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-28403538-6aa6-4b8c-aa99-32d32efd18ea tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:30.023716 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-28403538-6aa6-4b8c-aa99-32d32efd18ea tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:30.026278 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-28403538-6aa6-4b8c-aa99-32d32efd18ea tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:30.029622 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-28403538-6aa6-4b8c-aa99-32d32efd18ea tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:30.306810 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-37c101be-a2fb-423c-96d9-68052d2411df tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:30.322411 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-37c101be-a2fb-423c-96d9-68052d2411df tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1" status: 200 len: 1314 microversion: 2.1 time: 0.835070 Sep 16 12:59:30.326065 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1620/3156] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:29 2022] GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1 => generated 1314 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:30.904173 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-28403538-6aa6-4b8c-aa99-32d32efd18ea tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:30.943118 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-28403538-6aa6-4b8c-aa99-32d32efd18ea tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6" status: 200 len: 1333 microversion: 2.1 time: 0.953074 Sep 16 12:59:30.954585 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1537/3157] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:29 2022] GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6 => generated 1333 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:31.353636 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ba67cc27-7c1f-46d5-828f-b8e82f0ad64c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:31.357453 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ba67cc27-7c1f-46d5-828f-b8e82f0ad64c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 45c75956-6533-4add-91e9-419a2043d9e1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:31.369310 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba67cc27-7c1f-46d5-828f-b8e82f0ad64c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:31.369991 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba67cc27-7c1f-46d5-828f-b8e82f0ad64c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:31.370656 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba67cc27-7c1f-46d5-828f-b8e82f0ad64c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:31.374791 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba67cc27-7c1f-46d5-828f-b8e82f0ad64c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:31.376901 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba67cc27-7c1f-46d5-828f-b8e82f0ad64c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:31.377571 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba67cc27-7c1f-46d5-828f-b8e82f0ad64c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:31.979638 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-40a6e667-1212-4782-be41-92a82cc744f1 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:31.980882 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-40a6e667-1212-4782-be41-92a82cc744f1 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 5316af91-4d35-4a6e-9584-05d2a5b5cce6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:32.002850 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-40a6e667-1212-4782-be41-92a82cc744f1 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:32.006924 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-40a6e667-1212-4782-be41-92a82cc744f1 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:32.008435 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-40a6e667-1212-4782-be41-92a82cc744f1 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:32.012877 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-40a6e667-1212-4782-be41-92a82cc744f1 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:32.015170 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-40a6e667-1212-4782-be41-92a82cc744f1 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:32.016471 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-40a6e667-1212-4782-be41-92a82cc744f1 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:32.048006 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ba67cc27-7c1f-46d5-828f-b8e82f0ad64c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:32.064503 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ba67cc27-7c1f-46d5-828f-b8e82f0ad64c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1" status: 200 len: 1314 microversion: 2.1 time: 0.717126 Sep 16 12:59:32.067655 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1621/3158] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:31 2022] GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1 => generated 1314 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:32.360220 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-89ce92e6-59a5-493a-a925-3b81c5f0460f req-4ac499bf-7bd1-4b83-aa13-770c562264e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5316af91-4d35-4a6e-9584-05d2a5b5cce6", "name": "network-vif-plugged", "status": "completed", "tag": "1b214136-996e-4af9-b3fe-97e16120f399"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:59:32.404689 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-89ce92e6-59a5-493a-a925-3b81c5f0460f req-4ac499bf-7bd1-4b83-aa13-770c562264e4 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:32.405741 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-89ce92e6-59a5-493a-a925-3b81c5f0460f req-4ac499bf-7bd1-4b83-aa13-770c562264e4 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:32.409575 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-89ce92e6-59a5-493a-a925-3b81c5f0460f req-4ac499bf-7bd1-4b83-aa13-770c562264e4 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:32.441734 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-89ce92e6-59a5-493a-a925-3b81c5f0460f req-4ac499bf-7bd1-4b83-aa13-770c562264e4 service nova] Creating event network-vif-plugged:1b214136-996e-4af9-b3fe-97e16120f399 for instance 5316af91-4d35-4a6e-9584-05d2a5b5cce6 on n-h2-858094-4 Sep 16 12:59:32.461737 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-89ce92e6-59a5-493a-a925-3b81c5f0460f req-4ac499bf-7bd1-4b83-aa13-770c562264e4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105735 Sep 16 12:59:32.467339 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1622/3159] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:59:32.982638 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=4 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:59:33.100088 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d74926e5-f4b1-48de-b806-e6ea7938f2ba tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:33.101094 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d74926e5-f4b1-48de-b806-e6ea7938f2ba tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 45c75956-6533-4add-91e9-419a2043d9e1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:33.119701 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d74926e5-f4b1-48de-b806-e6ea7938f2ba tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:33.120283 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d74926e5-f4b1-48de-b806-e6ea7938f2ba tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:33.121441 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d74926e5-f4b1-48de-b806-e6ea7938f2ba tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:33.124559 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d74926e5-f4b1-48de-b806-e6ea7938f2ba tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:33.127366 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d74926e5-f4b1-48de-b806-e6ea7938f2ba tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:33.128916 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d74926e5-f4b1-48de-b806-e6ea7938f2ba tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:33.297708 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-40a6e667-1212-4782-be41-92a82cc744f1 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:33.309946 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-40a6e667-1212-4782-be41-92a82cc744f1 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6" status: 200 len: 1333 microversion: 2.1 time: 1.334420 Sep 16 12:59:33.322778 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1538/3160] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:31 2022] GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6 => generated 1333 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:33.835272 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d74926e5-f4b1-48de-b806-e6ea7938f2ba tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:33.861457 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d74926e5-f4b1-48de-b806-e6ea7938f2ba tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1" status: 200 len: 1314 microversion: 2.1 time: 0.752450 Sep 16 12:59:33.875838 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1623/3161] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:33 2022] GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1 => generated 1314 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:33.942911 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-82c9db2f-e46c-4122-8e93-7514babb74de req-fecf9bb5-69a7-4539-81cc-8ed93d9daa5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45c75956-6533-4add-91e9-419a2043d9e1", "tag": "a393a675-10b0-4b27-8958-c7b26fed3228"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:59:33.956649 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=16 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:59:33.977277 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-82c9db2f-e46c-4122-8e93-7514babb74de req-fecf9bb5-69a7-4539-81cc-8ed93d9daa5b service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:33.977807 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-82c9db2f-e46c-4122-8e93-7514babb74de req-fecf9bb5-69a7-4539-81cc-8ed93d9daa5b service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:33.985216 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-82c9db2f-e46c-4122-8e93-7514babb74de req-fecf9bb5-69a7-4539-81cc-8ed93d9daa5b service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:34.040267 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-82c9db2f-e46c-4122-8e93-7514babb74de req-fecf9bb5-69a7-4539-81cc-8ed93d9daa5b service nova] Creating event network-changed:a393a675-10b0-4b27-8958-c7b26fed3228 for instance 45c75956-6533-4add-91e9-419a2043d9e1 on n-h1-858094-4 Sep 16 12:59:34.057566 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-82c9db2f-e46c-4122-8e93-7514babb74de req-fecf9bb5-69a7-4539-81cc-8ed93d9daa5b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118433 Sep 16 12:59:34.065618 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1539/3162] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:59:34.347075 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-39050f3f-d109-4979-aa62-f3055c15b9e2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:34.347730 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-39050f3f-d109-4979-aa62-f3055c15b9e2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 5316af91-4d35-4a6e-9584-05d2a5b5cce6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:34.362396 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39050f3f-d109-4979-aa62-f3055c15b9e2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:34.362908 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39050f3f-d109-4979-aa62-f3055c15b9e2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:34.363417 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39050f3f-d109-4979-aa62-f3055c15b9e2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:34.364241 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39050f3f-d109-4979-aa62-f3055c15b9e2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:34.364767 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39050f3f-d109-4979-aa62-f3055c15b9e2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:34.365265 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39050f3f-d109-4979-aa62-f3055c15b9e2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:34.553300 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-68d93f23-0b1b-498a-943f-fc6bbdfc8507 req-eec58768-da27-4bae-8f46-61141f5045c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5316af91-4d35-4a6e-9584-05d2a5b5cce6", "name": "network-vif-plugged", "status": "completed", "tag": "23475454-423f-4d72-a3c8-e9e9cbc581b5"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:59:34.590566 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-68d93f23-0b1b-498a-943f-fc6bbdfc8507 req-eec58768-da27-4bae-8f46-61141f5045c2 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:34.591303 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-68d93f23-0b1b-498a-943f-fc6bbdfc8507 req-eec58768-da27-4bae-8f46-61141f5045c2 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:34.591745 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-68d93f23-0b1b-498a-943f-fc6bbdfc8507 req-eec58768-da27-4bae-8f46-61141f5045c2 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:34.627699 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-68d93f23-0b1b-498a-943f-fc6bbdfc8507 req-eec58768-da27-4bae-8f46-61141f5045c2 service nova] Creating event network-vif-plugged:23475454-423f-4d72-a3c8-e9e9cbc581b5 for instance 5316af91-4d35-4a6e-9584-05d2a5b5cce6 on n-h2-858094-4 Sep 16 12:59:34.645722 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-68d93f23-0b1b-498a-943f-fc6bbdfc8507 req-eec58768-da27-4bae-8f46-61141f5045c2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097506 Sep 16 12:59:34.647801 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1540/3163] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:59:34.896782 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-dee4afd5-9791-4363-9911-e7d8c6fa3ad4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:34.898327 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-dee4afd5-9791-4363-9911-e7d8c6fa3ad4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 45c75956-6533-4add-91e9-419a2043d9e1] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:34.923661 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dee4afd5-9791-4363-9911-e7d8c6fa3ad4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:34.925171 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dee4afd5-9791-4363-9911-e7d8c6fa3ad4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:34.927029 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dee4afd5-9791-4363-9911-e7d8c6fa3ad4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:34.928093 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dee4afd5-9791-4363-9911-e7d8c6fa3ad4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:34.929612 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dee4afd5-9791-4363-9911-e7d8c6fa3ad4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:34.932678 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dee4afd5-9791-4363-9911-e7d8c6fa3ad4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:35.626880 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-39050f3f-d109-4979-aa62-f3055c15b9e2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:35.650698 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-39050f3f-d109-4979-aa62-f3055c15b9e2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6" status: 200 len: 1333 microversion: 2.1 time: 1.307376 Sep 16 12:59:35.651321 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1624/3164] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:34 2022] GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6 => generated 1333 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:36.187678 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-dee4afd5-9791-4363-9911-e7d8c6fa3ad4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:36.216775 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-dee4afd5-9791-4363-9911-e7d8c6fa3ad4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1" status: 200 len: 1314 microversion: 2.1 time: 1.324793 Sep 16 12:59:36.238048 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1541/3165] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:34 2022] GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1 => generated 1314 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:59:36.678200 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d0429a25-c056-40f0-b99c-66cfb18d95f5 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:36.679750 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d0429a25-c056-40f0-b99c-66cfb18d95f5 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 5316af91-4d35-4a6e-9584-05d2a5b5cce6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:36.711934 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0429a25-c056-40f0-b99c-66cfb18d95f5 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:36.712411 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0429a25-c056-40f0-b99c-66cfb18d95f5 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:36.715401 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0429a25-c056-40f0-b99c-66cfb18d95f5 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:36.717777 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0429a25-c056-40f0-b99c-66cfb18d95f5 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:36.718291 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0429a25-c056-40f0-b99c-66cfb18d95f5 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:36.718733 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0429a25-c056-40f0-b99c-66cfb18d95f5 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:37.179104 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0ca5a91a-a52b-425d-b110-d8167ed8983d tempest-FloatingIPsTestJSON-596548026 tempest-FloatingIPsTestJSON-596548026-project] Action: 'create', calling method: .version_select at 0x7f1035afd280>, body: {"pool": null} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:59:37.718408 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d0429a25-c056-40f0-b99c-66cfb18d95f5 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:37.732461 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d0429a25-c056-40f0-b99c-66cfb18d95f5 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6" status: 200 len: 1333 microversion: 2.1 time: 1.060740 Sep 16 12:59:37.737870 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1625/3166] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:36 2022] GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6 => generated 1333 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:37.744842 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-704b4b53-c1cd-4d14-9e69-ac1119bfdbd0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:37.747582 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-704b4b53-c1cd-4d14-9e69-ac1119bfdbd0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 45c75956-6533-4add-91e9-419a2043d9e1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:37.764207 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-704b4b53-c1cd-4d14-9e69-ac1119bfdbd0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:37.766131 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-704b4b53-c1cd-4d14-9e69-ac1119bfdbd0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:37.767455 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-704b4b53-c1cd-4d14-9e69-ac1119bfdbd0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:37.769357 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-704b4b53-c1cd-4d14-9e69-ac1119bfdbd0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:37.771151 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-704b4b53-c1cd-4d14-9e69-ac1119bfdbd0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:37.772882 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-704b4b53-c1cd-4d14-9e69-ac1119bfdbd0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:38.862705 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-704b4b53-c1cd-4d14-9e69-ac1119bfdbd0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:38.882677 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-704b4b53-c1cd-4d14-9e69-ac1119bfdbd0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1" status: 200 len: 1314 microversion: 2.1 time: 1.139364 Sep 16 12:59:38.883555 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1626/3167] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:37 2022] GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1 => generated 1314 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:38.907865 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1e8235b2-693b-455b-8fe3-7992a0e48402 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:38.908727 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1e8235b2-693b-455b-8fe3-7992a0e48402 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 272fddb0-eba2-4559-b76d-460bd65246ec] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:38.918483 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1e8235b2-693b-455b-8fe3-7992a0e48402 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:38.919247 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1e8235b2-693b-455b-8fe3-7992a0e48402 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:38.919975 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1e8235b2-693b-455b-8fe3-7992a0e48402 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:38.920905 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1e8235b2-693b-455b-8fe3-7992a0e48402 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:38.921814 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1e8235b2-693b-455b-8fe3-7992a0e48402 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:38.923003 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1e8235b2-693b-455b-8fe3-7992a0e48402 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:38.958859 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1e8235b2-693b-455b-8fe3-7992a0e48402 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec/os-volume_attachments/858ce97e-f3c0-4933-9667-e49c8109ec4b" status: 200 len: 194 microversion: 2.1 time: 0.055384 Sep 16 12:59:38.959664 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1627/3168] 10.222.0.67 () {58 vars in 1413 bytes} [Fri Sep 16 12:59:38 2022] GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec/os-volume_attachments/858ce97e-f3c0-4933-9667-e49c8109ec4b => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:59:38.964720 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-319b365d-2fdb-40ad-be0a-ee9e5a4b6ac2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:38.966107 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-319b365d-2fdb-40ad-be0a-ee9e5a4b6ac2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 5316af91-4d35-4a6e-9584-05d2a5b5cce6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:38.972539 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-319b365d-2fdb-40ad-be0a-ee9e5a4b6ac2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:38.973281 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-319b365d-2fdb-40ad-be0a-ee9e5a4b6ac2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:38.973892 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-319b365d-2fdb-40ad-be0a-ee9e5a4b6ac2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:38.974597 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-319b365d-2fdb-40ad-be0a-ee9e5a4b6ac2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:38.975045 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-319b365d-2fdb-40ad-be0a-ee9e5a4b6ac2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:38.975461 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-319b365d-2fdb-40ad-be0a-ee9e5a4b6ac2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:39.976003 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-319b365d-2fdb-40ad-be0a-ee9e5a4b6ac2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:39.994557 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-319b365d-2fdb-40ad-be0a-ee9e5a4b6ac2 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6" status: 200 len: 1669 microversion: 2.1 time: 1.033557 Sep 16 12:59:40.019715 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1628/3169] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:38 2022] GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6 => generated 1669 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:40.031471 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2c2b321b-4f96-4d8e-8f00-4fa01083adb1 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:40.041793 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2c2b321b-4f96-4d8e-8f00-4fa01083adb1 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 272fddb0-eba2-4559-b76d-460bd65246ec] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:40.094389 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2c2b321b-4f96-4d8e-8f00-4fa01083adb1 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:40.094389 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2c2b321b-4f96-4d8e-8f00-4fa01083adb1 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:40.094389 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2c2b321b-4f96-4d8e-8f00-4fa01083adb1 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:40.094723 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2c2b321b-4f96-4d8e-8f00-4fa01083adb1 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:40.095307 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2c2b321b-4f96-4d8e-8f00-4fa01083adb1 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:40.095969 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2c2b321b-4f96-4d8e-8f00-4fa01083adb1 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:40.304371 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-2c2b321b-4f96-4d8e-8f00-4fa01083adb1 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lazy-loading 'services' on Instance uuid 272fddb0-eba2-4559-b76d-460bd65246ec {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:59:40.448366 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2c2b321b-4f96-4d8e-8f00-4fa01083adb1 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "DELETE /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec/os-volume_attachments/858ce97e-f3c0-4933-9667-e49c8109ec4b" status: 202 len: 0 microversion: 2.1 time: 0.426903 Sep 16 12:59:40.449940 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1629/3170] 10.222.0.67 () {58 vars in 1416 bytes} [Fri Sep 16 12:59:40 2022] DELETE /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec/os-volume_attachments/858ce97e-f3c0-4933-9667-e49c8109ec4b => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:59:40.462428 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5c66206b-a608-47f1-9161-e41b44a6cf71 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:40.463160 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5c66206b-a608-47f1-9161-e41b44a6cf71 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 45c75956-6533-4add-91e9-419a2043d9e1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:40.483748 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c66206b-a608-47f1-9161-e41b44a6cf71 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:40.484294 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c66206b-a608-47f1-9161-e41b44a6cf71 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:40.492843 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c66206b-a608-47f1-9161-e41b44a6cf71 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:40.494079 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c66206b-a608-47f1-9161-e41b44a6cf71 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:40.494714 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c66206b-a608-47f1-9161-e41b44a6cf71 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:40.495302 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c66206b-a608-47f1-9161-e41b44a6cf71 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:42.229620 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5c66206b-a608-47f1-9161-e41b44a6cf71 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:42.237936 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:59:42.242155 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5c66206b-a608-47f1-9161-e41b44a6cf71 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1" status: 200 len: 1314 microversion: 2.1 time: 1.790498 Sep 16 12:59:42.246538 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1630/3171] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:40 2022] GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1 => generated 1314 bytes in 1796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:42.265966 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ce256441-7dbd-48ad-8a2d-68c8720bcf97 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:42.269992 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ce256441-7dbd-48ad-8a2d-68c8720bcf97 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 5316af91-4d35-4a6e-9584-05d2a5b5cce6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:42.282810 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce256441-7dbd-48ad-8a2d-68c8720bcf97 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:42.284793 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce256441-7dbd-48ad-8a2d-68c8720bcf97 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:42.290352 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce256441-7dbd-48ad-8a2d-68c8720bcf97 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:42.291525 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce256441-7dbd-48ad-8a2d-68c8720bcf97 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:42.292025 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce256441-7dbd-48ad-8a2d-68c8720bcf97 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:42.292515 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce256441-7dbd-48ad-8a2d-68c8720bcf97 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:42.346520 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ce256441-7dbd-48ad-8a2d-68c8720bcf97 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6/ips" status: 200 len: 180 microversion: 2.1 time: 0.096228 Sep 16 12:59:42.348768 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1631/3172] 10.222.0.67 () {58 vars in 1248 bytes} [Fri Sep 16 12:59:42 2022] GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6/ips => generated 180 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:59:42.362694 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-33be28a7-6522-45e8-a639-6c489922afac tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:42.365762 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-33be28a7-6522-45e8-a639-6c489922afac tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 5316af91-4d35-4a6e-9584-05d2a5b5cce6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:42.384054 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33be28a7-6522-45e8-a639-6c489922afac tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:42.384589 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33be28a7-6522-45e8-a639-6c489922afac tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:42.385056 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33be28a7-6522-45e8-a639-6c489922afac tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:42.385757 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33be28a7-6522-45e8-a639-6c489922afac tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:42.386214 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33be28a7-6522-45e8-a639-6c489922afac tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:42.386736 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33be28a7-6522-45e8-a639-6c489922afac tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:42.455264 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-33be28a7-6522-45e8-a639-6c489922afac tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 5316af91-4d35-4a6e-9584-05d2a5b5cce6] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:59:42.580582 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-33be28a7-6522-45e8-a639-6c489922afac tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "DELETE /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6" status: 204 len: 0 microversion: 2.1 time: 0.223285 Sep 16 12:59:42.582772 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1632/3173] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:59:42 2022] DELETE /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:59:42.594865 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3cab8d69-e187-4802-bf35-983f417b7784 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:42.595908 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3cab8d69-e187-4802-bf35-983f417b7784 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 5316af91-4d35-4a6e-9584-05d2a5b5cce6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:42.605136 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3cab8d69-e187-4802-bf35-983f417b7784 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:42.606003 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3cab8d69-e187-4802-bf35-983f417b7784 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:42.606890 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3cab8d69-e187-4802-bf35-983f417b7784 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:42.607830 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3cab8d69-e187-4802-bf35-983f417b7784 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:42.608863 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3cab8d69-e187-4802-bf35-983f417b7784 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:42.609463 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3cab8d69-e187-4802-bf35-983f417b7784 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:43.190997 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3cab8d69-e187-4802-bf35-983f417b7784 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:43.201137 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3cab8d69-e187-4802-bf35-983f417b7784 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6" status: 200 len: 1675 microversion: 2.1 time: 0.612814 Sep 16 12:59:43.204768 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1633/3174] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:42 2022] GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6 => generated 1675 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:43.274764 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-653c24c7-96e3-495a-87ba-d32cd945e06c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:43.275509 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-653c24c7-96e3-495a-87ba-d32cd945e06c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 45c75956-6533-4add-91e9-419a2043d9e1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:43.286338 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-653c24c7-96e3-495a-87ba-d32cd945e06c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:43.297524 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-653c24c7-96e3-495a-87ba-d32cd945e06c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:43.298222 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-653c24c7-96e3-495a-87ba-d32cd945e06c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:43.299455 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-653c24c7-96e3-495a-87ba-d32cd945e06c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:43.301814 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-653c24c7-96e3-495a-87ba-d32cd945e06c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:43.302492 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-653c24c7-96e3-495a-87ba-d32cd945e06c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:44.221092 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-653c24c7-96e3-495a-87ba-d32cd945e06c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:44.237766 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-653c24c7-96e3-495a-87ba-d32cd945e06c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1" status: 200 len: 1314 microversion: 2.1 time: 0.966721 Sep 16 12:59:44.239035 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1634/3175] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:43 2022] GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1 => generated 1314 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:59:44.244744 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-3b698a4c-191c-4245-bb71-133422ccfcaf req-4cdc4626-78a7-487d-ba0e-c5c745636ce3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45c75956-6533-4add-91e9-419a2043d9e1", "name": "network-vif-plugged", "status": "completed", "tag": "a393a675-10b0-4b27-8958-c7b26fed3228"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:59:44.258158 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3b698a4c-191c-4245-bb71-133422ccfcaf req-4cdc4626-78a7-487d-ba0e-c5c745636ce3 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:44.259033 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3b698a4c-191c-4245-bb71-133422ccfcaf req-4cdc4626-78a7-487d-ba0e-c5c745636ce3 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:44.259634 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3b698a4c-191c-4245-bb71-133422ccfcaf req-4cdc4626-78a7-487d-ba0e-c5c745636ce3 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:44.702813 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-3b698a4c-191c-4245-bb71-133422ccfcaf req-4cdc4626-78a7-487d-ba0e-c5c745636ce3 service nova] Creating event network-vif-plugged:a393a675-10b0-4b27-8958-c7b26fed3228 for instance 45c75956-6533-4add-91e9-419a2043d9e1 on n-h1-858094-4 Sep 16 12:59:44.721182 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-3b698a4c-191c-4245-bb71-133422ccfcaf req-4cdc4626-78a7-487d-ba0e-c5c745636ce3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.480300 Sep 16 12:59:44.721982 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1635/3176] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:59:44.736789 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d44109ef-af08-47e8-906e-1a2e6f4a2f33 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:44.740732 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d44109ef-af08-47e8-906e-1a2e6f4a2f33 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 5316af91-4d35-4a6e-9584-05d2a5b5cce6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:44.757809 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d44109ef-af08-47e8-906e-1a2e6f4a2f33 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:44.758317 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d44109ef-af08-47e8-906e-1a2e6f4a2f33 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:44.758763 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d44109ef-af08-47e8-906e-1a2e6f4a2f33 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:44.762930 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d44109ef-af08-47e8-906e-1a2e6f4a2f33 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:44.763416 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d44109ef-af08-47e8-906e-1a2e6f4a2f33 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:44.767264 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d44109ef-af08-47e8-906e-1a2e6f4a2f33 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:44.913347 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:59:45.984060 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0ca5a91a-a52b-425d-b110-d8167ed8983d tempest-FloatingIPsTestJSON-596548026 tempest-FloatingIPsTestJSON-596548026-project] 10.222.0.67 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 9.116943 Sep 16 12:59:45.996441 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1542/3177] 10.222.0.67 () {60 vars in 1170 bytes} [Fri Sep 16 12:59:36 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 9130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:59:46.009191 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c72e6abf-84c0-488f-9d9e-42e74c91c225 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:46.017623 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c72e6abf-84c0-488f-9d9e-42e74c91c225 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 45c75956-6533-4add-91e9-419a2043d9e1] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:46.029592 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c72e6abf-84c0-488f-9d9e-42e74c91c225 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:46.030407 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c72e6abf-84c0-488f-9d9e-42e74c91c225 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:46.033803 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c72e6abf-84c0-488f-9d9e-42e74c91c225 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:46.037196 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c72e6abf-84c0-488f-9d9e-42e74c91c225 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:46.038297 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c72e6abf-84c0-488f-9d9e-42e74c91c225 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:46.041194 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c72e6abf-84c0-488f-9d9e-42e74c91c225 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:46.334905 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d44109ef-af08-47e8-906e-1a2e6f4a2f33 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:46.346710 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d44109ef-af08-47e8-906e-1a2e6f4a2f33 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6" status: 200 len: 1654 microversion: 2.1 time: 1.619416 Sep 16 12:59:46.347297 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1636/3178] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:44 2022] GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6 => generated 1654 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:46.363258 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-e35843bc-1e07-4f34-84a1-11dfaafe723d req-8e64a07a-deb5-4dcd-88fb-52913971c90a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5316af91-4d35-4a6e-9584-05d2a5b5cce6", "name": "network-vif-deleted", "tag": "1b214136-996e-4af9-b3fe-97e16120f399"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:59:46.386009 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e35843bc-1e07-4f34-84a1-11dfaafe723d req-8e64a07a-deb5-4dcd-88fb-52913971c90a service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:46.387389 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e35843bc-1e07-4f34-84a1-11dfaafe723d req-8e64a07a-deb5-4dcd-88fb-52913971c90a service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:46.388022 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e35843bc-1e07-4f34-84a1-11dfaafe723d req-8e64a07a-deb5-4dcd-88fb-52913971c90a service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:46.408209 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-e35843bc-1e07-4f34-84a1-11dfaafe723d req-8e64a07a-deb5-4dcd-88fb-52913971c90a service nova] Creating event network-vif-deleted:1b214136-996e-4af9-b3fe-97e16120f399 for instance 5316af91-4d35-4a6e-9584-05d2a5b5cce6 on n-h2-858094-4 Sep 16 12:59:46.431758 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-e35843bc-1e07-4f34-84a1-11dfaafe723d req-8e64a07a-deb5-4dcd-88fb-52913971c90a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082981 Sep 16 12:59:46.432770 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1637/3179] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:59:46.438474 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b29d0955-459d-4736-8ed1-2b2d06f98ccd tempest-FloatingIPsTestJSON-596548026 tempest-FloatingIPsTestJSON-596548026-project] Calling method '.version_select at 0x7f1034ae7af0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:46.654814 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c72e6abf-84c0-488f-9d9e-42e74c91c225 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:46.666295 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c72e6abf-84c0-488f-9d9e-42e74c91c225 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1" status: 200 len: 1314 microversion: 2.1 time: 0.668540 Sep 16 12:59:46.680193 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1543/3180] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:45 2022] GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1 => generated 1314 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:47.376409 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-695d86de-bcba-4430-9476-3ddb8a2e91a4 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:47.378546 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-695d86de-bcba-4430-9476-3ddb8a2e91a4 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 5316af91-4d35-4a6e-9584-05d2a5b5cce6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:47.392726 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-695d86de-bcba-4430-9476-3ddb8a2e91a4 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:47.395244 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-695d86de-bcba-4430-9476-3ddb8a2e91a4 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:47.396192 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-695d86de-bcba-4430-9476-3ddb8a2e91a4 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:47.408536 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-695d86de-bcba-4430-9476-3ddb8a2e91a4 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:47.410447 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-695d86de-bcba-4430-9476-3ddb8a2e91a4 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:47.411282 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-695d86de-bcba-4430-9476-3ddb8a2e91a4 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:47.488847 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b29d0955-459d-4736-8ed1-2b2d06f98ccd tempest-FloatingIPsTestJSON-596548026 tempest-FloatingIPsTestJSON-596548026-project] 10.222.0.67 "GET /compute/v2.1/os-floating-ips/8af73a2c-81ff-4577-8b3a-2cd24f025463" status: 200 len: 142 microversion: 2.1 time: 1.054547 Sep 16 12:59:47.490430 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1638/3181] 10.222.0.67 () {58 vars in 1260 bytes} [Fri Sep 16 12:59:46 2022] GET /compute/v2.1/os-floating-ips/8af73a2c-81ff-4577-8b3a-2cd24f025463 => generated 142 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:59:47.506774 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3d2eae79-c3ac-48c4-a99a-61950d1e2c83 tempest-FloatingIPsTestJSON-596548026 tempest-FloatingIPsTestJSON-596548026-project] Calling method '.version_select at 0x7f1034a69e50>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:47.998369 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3d2eae79-c3ac-48c4-a99a-61950d1e2c83 tempest-FloatingIPsTestJSON-596548026 tempest-FloatingIPsTestJSON-596548026-project] 10.222.0.67 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.495946 Sep 16 12:59:47.999619 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1639/3182] 10.222.0.67 () {58 vars in 1149 bytes} [Fri Sep 16 12:59:47 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:59:48.004989 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-77311266-011b-46d8-b88f-61a54a410191 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:48.005975 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-77311266-011b-46d8-b88f-61a54a410191 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 45c75956-6533-4add-91e9-419a2043d9e1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:48.032881 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77311266-011b-46d8-b88f-61a54a410191 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:48.033789 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77311266-011b-46d8-b88f-61a54a410191 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:48.034450 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77311266-011b-46d8-b88f-61a54a410191 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:48.045590 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77311266-011b-46d8-b88f-61a54a410191 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:48.046299 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77311266-011b-46d8-b88f-61a54a410191 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:48.046998 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77311266-011b-46d8-b88f-61a54a410191 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:48.608416 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-695d86de-bcba-4430-9476-3ddb8a2e91a4 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:48.622461 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-695d86de-bcba-4430-9476-3ddb8a2e91a4 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6" status: 200 len: 1496 microversion: 2.1 time: 1.250364 Sep 16 12:59:48.623166 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1544/3183] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:47 2022] GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6 => generated 1496 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:59:48.645346 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-dcce95e4-e623-479e-a9f2-d08196aefad7 tempest-FloatingIPsTestJSON-596548026 tempest-FloatingIPsTestJSON-596548026-project] Calling method '.version_select at 0x7f1035ffadc0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:48.991301 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-77311266-011b-46d8-b88f-61a54a410191 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:49.005694 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-77311266-011b-46d8-b88f-61a54a410191 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1" status: 200 len: 1500 microversion: 2.1 time: 1.004613 Sep 16 12:59:49.009809 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1640/3184] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:47 2022] GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1 => generated 1500 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:49.022927 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-908193bf-9bf3-437f-bb5a-d3555856e322 req-1ba4261b-1e90-4dfb-b911-edf0873b3844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5316af91-4d35-4a6e-9584-05d2a5b5cce6", "name": "network-vif-unplugged", "status": "completed", "tag": "23475454-423f-4d72-a3c8-e9e9cbc581b5"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:59:49.053925 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-908193bf-9bf3-437f-bb5a-d3555856e322 req-1ba4261b-1e90-4dfb-b911-edf0873b3844 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:49.055049 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-908193bf-9bf3-437f-bb5a-d3555856e322 req-1ba4261b-1e90-4dfb-b911-edf0873b3844 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:49.055761 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-908193bf-9bf3-437f-bb5a-d3555856e322 req-1ba4261b-1e90-4dfb-b911-edf0873b3844 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:49.088251 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-908193bf-9bf3-437f-bb5a-d3555856e322 req-1ba4261b-1e90-4dfb-b911-edf0873b3844 service nova] Creating event network-vif-unplugged:23475454-423f-4d72-a3c8-e9e9cbc581b5 for instance 5316af91-4d35-4a6e-9584-05d2a5b5cce6 on n-h2-858094-4 Sep 16 12:59:49.104678 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-908193bf-9bf3-437f-bb5a-d3555856e322 req-1ba4261b-1e90-4dfb-b911-edf0873b3844 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090587 Sep 16 12:59:49.112622 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1641/3185] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:59:49.123088 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6bc40e15-eb47-4cd6-8909-1e24e98853bb tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:59:49.124495 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6bc40e15-eb47-4cd6-8909-1e24e98853bb tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 45c75956-6533-4add-91e9-419a2043d9e1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:49.138960 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6bc40e15-eb47-4cd6-8909-1e24e98853bb tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:49.144310 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6bc40e15-eb47-4cd6-8909-1e24e98853bb tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:49.145594 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6bc40e15-eb47-4cd6-8909-1e24e98853bb tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:49.153694 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6bc40e15-eb47-4cd6-8909-1e24e98853bb tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:49.155652 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6bc40e15-eb47-4cd6-8909-1e24e98853bb tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:49.158126 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6bc40e15-eb47-4cd6-8909-1e24e98853bb tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:49.332657 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6bc40e15-eb47-4cd6-8909-1e24e98853bb tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "POST /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1/action" status: 202 len: 0 microversion: 2.1 time: 0.217863 Sep 16 12:59:49.336410 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1642/3186] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 12:59:49 2022] POST /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:59:49.349578 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8cbed931-fc8a-416b-bbaf-181e994b04c5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:49.350741 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8cbed931-fc8a-416b-bbaf-181e994b04c5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 45c75956-6533-4add-91e9-419a2043d9e1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:49.374986 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cbed931-fc8a-416b-bbaf-181e994b04c5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:49.376356 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cbed931-fc8a-416b-bbaf-181e994b04c5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:49.378353 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cbed931-fc8a-416b-bbaf-181e994b04c5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:49.379181 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cbed931-fc8a-416b-bbaf-181e994b04c5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:49.381484 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cbed931-fc8a-416b-bbaf-181e994b04c5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:49.383098 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cbed931-fc8a-416b-bbaf-181e994b04c5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:50.525778 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8cbed931-fc8a-416b-bbaf-181e994b04c5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:50.551799 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8cbed931-fc8a-416b-bbaf-181e994b04c5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1" status: 200 len: 1505 microversion: 2.1 time: 1.210126 Sep 16 12:59:50.581364 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1643/3187] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:49 2022] GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1 => generated 1505 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:50.587980 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6e951fcb-3cfe-4aec-9b74-c2a388606fff tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:50.588802 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6e951fcb-3cfe-4aec-9b74-c2a388606fff tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 5316af91-4d35-4a6e-9584-05d2a5b5cce6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:50.596786 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e951fcb-3cfe-4aec-9b74-c2a388606fff tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:50.597512 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e951fcb-3cfe-4aec-9b74-c2a388606fff tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:50.598135 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e951fcb-3cfe-4aec-9b74-c2a388606fff tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:50.598990 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e951fcb-3cfe-4aec-9b74-c2a388606fff tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:50.599588 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e951fcb-3cfe-4aec-9b74-c2a388606fff tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:50.600390 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e951fcb-3cfe-4aec-9b74-c2a388606fff tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:50.669672 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e951fcb-3cfe-4aec-9b74-c2a388606fff tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:50.670171 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e951fcb-3cfe-4aec-9b74-c2a388606fff tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:50.670614 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e951fcb-3cfe-4aec-9b74-c2a388606fff tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:50.671075 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-6e951fcb-3cfe-4aec-9b74-c2a388606fff tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lazy-loading 'fault' on Instance uuid 5316af91-4d35-4a6e-9584-05d2a5b5cce6 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:59:50.815236 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6e951fcb-3cfe-4aec-9b74-c2a388606fff tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf3952918747349e71c4ac1e7b00c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ad456d126a4c25accb04f76a159733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:50.834201 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6e951fcb-3cfe-4aec-9b74-c2a388606fff tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6" status: 200 len: 1302 microversion: 2.1 time: 0.251430 Sep 16 12:59:50.835485 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1644/3188] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:50 2022] GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6 => generated 1302 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:50.841057 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-8d2170d2-b9c7-4590-82dc-212ecf1764fc req-281a0fdb-6905-44ea-b413-6bd621569254 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5316af91-4d35-4a6e-9584-05d2a5b5cce6", "name": "network-vif-deleted", "tag": "23475454-423f-4d72-a3c8-e9e9cbc581b5"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:59:50.868441 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8d2170d2-b9c7-4590-82dc-212ecf1764fc req-281a0fdb-6905-44ea-b413-6bd621569254 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:50.869194 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8d2170d2-b9c7-4590-82dc-212ecf1764fc req-281a0fdb-6905-44ea-b413-6bd621569254 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:50.869792 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8d2170d2-b9c7-4590-82dc-212ecf1764fc req-281a0fdb-6905-44ea-b413-6bd621569254 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:50.883715 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-8d2170d2-b9c7-4590-82dc-212ecf1764fc req-281a0fdb-6905-44ea-b413-6bd621569254 service nova] Creating event network-vif-deleted:23475454-423f-4d72-a3c8-e9e9cbc581b5 for instance 5316af91-4d35-4a6e-9584-05d2a5b5cce6 on n-h2-858094-4 Sep 16 12:59:50.890194 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-8d2170d2-b9c7-4590-82dc-212ecf1764fc req-281a0fdb-6905-44ea-b413-6bd621569254 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053159 Sep 16 12:59:50.891009 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1645/3189] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:59:50.897662 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a4de25c5-d756-4ff3-9862-97493eec7f55 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:50.905437 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a4de25c5-d756-4ff3-9862-97493eec7f55 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 272fddb0-eba2-4559-b76d-460bd65246ec] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:50.912687 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4de25c5-d756-4ff3-9862-97493eec7f55 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:50.913278 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4de25c5-d756-4ff3-9862-97493eec7f55 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:50.913613 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4de25c5-d756-4ff3-9862-97493eec7f55 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:50.914588 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4de25c5-d756-4ff3-9862-97493eec7f55 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:50.926482 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4de25c5-d756-4ff3-9862-97493eec7f55 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:50.927146 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4de25c5-d756-4ff3-9862-97493eec7f55 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:50.988881 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a4de25c5-d756-4ff3-9862-97493eec7f55 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.096462 Sep 16 12:59:50.995096 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1646/3190] 10.222.0.67 () {58 vars in 1302 bytes} [Fri Sep 16 12:59:50 2022] GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec/os-volume_attachments => generated 25 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 12:59:51.284599 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b9c9a13e-2e0a-42b0-b625-676947de2825 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:51.287132 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b9c9a13e-2e0a-42b0-b625-676947de2825 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 272fddb0-eba2-4559-b76d-460bd65246ec] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:51.294818 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9c9a13e-2e0a-42b0-b625-676947de2825 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:51.295389 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9c9a13e-2e0a-42b0-b625-676947de2825 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:51.295907 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9c9a13e-2e0a-42b0-b625-676947de2825 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:51.296757 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9c9a13e-2e0a-42b0-b625-676947de2825 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:51.297287 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9c9a13e-2e0a-42b0-b625-676947de2825 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:51.297787 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9c9a13e-2e0a-42b0-b625-676947de2825 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:51.334309 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b9c9a13e-2e0a-42b0-b625-676947de2825 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053490 Sep 16 12:59:51.342312 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1647/3191] 10.222.0.67 () {58 vars in 1302 bytes} [Fri Sep 16 12:59:51 2022] GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 16 12:59:51.444623 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b9806aca-335a-4b6e-81e8-cbfa262a45b3 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:51.445244 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b9806aca-335a-4b6e-81e8-cbfa262a45b3 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 272fddb0-eba2-4559-b76d-460bd65246ec] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:51.454882 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9806aca-335a-4b6e-81e8-cbfa262a45b3 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:51.455489 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9806aca-335a-4b6e-81e8-cbfa262a45b3 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:51.456007 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9806aca-335a-4b6e-81e8-cbfa262a45b3 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:51.456960 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9806aca-335a-4b6e-81e8-cbfa262a45b3 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:51.458374 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9806aca-335a-4b6e-81e8-cbfa262a45b3 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:51.459042 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9806aca-335a-4b6e-81e8-cbfa262a45b3 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:51.531782 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b9806aca-335a-4b6e-81e8-cbfa262a45b3 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 272fddb0-eba2-4559-b76d-460bd65246ec] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:59:51.583052 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:59:51.713031 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b9806aca-335a-4b6e-81e8-cbfa262a45b3 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "DELETE /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec" status: 204 len: 0 microversion: 2.1 time: 0.272887 Sep 16 12:59:51.718030 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1648/3192] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:59:51 2022] DELETE /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:59:51.721476 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0c148f71-2c9c-4150-ad1a-6e3380288f94 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:51.726709 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0c148f71-2c9c-4150-ad1a-6e3380288f94 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 45c75956-6533-4add-91e9-419a2043d9e1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:51.740906 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c148f71-2c9c-4150-ad1a-6e3380288f94 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:51.743254 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c148f71-2c9c-4150-ad1a-6e3380288f94 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:51.744979 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c148f71-2c9c-4150-ad1a-6e3380288f94 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:51.746204 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c148f71-2c9c-4150-ad1a-6e3380288f94 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:51.751538 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c148f71-2c9c-4150-ad1a-6e3380288f94 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:51.752072 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c148f71-2c9c-4150-ad1a-6e3380288f94 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:51.836420 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-dcce95e4-e623-479e-a9f2-d08196aefad7 tempest-FloatingIPsTestJSON-596548026 tempest-FloatingIPsTestJSON-596548026-project] 10.222.0.67 "DELETE /compute/v2.1/os-floating-ips/8af73a2c-81ff-4577-8b3a-2cd24f025463" status: 202 len: 0 microversion: 2.1 time: 3.194893 Sep 16 12:59:51.837914 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1545/3193] 10.222.0.67 () {58 vars in 1263 bytes} [Fri Sep 16 12:59:48 2022] DELETE /compute/v2.1/os-floating-ips/8af73a2c-81ff-4577-8b3a-2cd24f025463 => generated 0 bytes in 3197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 12:59:51.843966 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-67125f77-9429-48e7-86ed-72e41e84f21e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:51.844870 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-67125f77-9429-48e7-86ed-72e41e84f21e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 272fddb0-eba2-4559-b76d-460bd65246ec] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:51.868691 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-67125f77-9429-48e7-86ed-72e41e84f21e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:51.869373 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-67125f77-9429-48e7-86ed-72e41e84f21e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:51.869936 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-67125f77-9429-48e7-86ed-72e41e84f21e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:51.872693 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-67125f77-9429-48e7-86ed-72e41e84f21e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:51.878585 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-67125f77-9429-48e7-86ed-72e41e84f21e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:51.879253 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-67125f77-9429-48e7-86ed-72e41e84f21e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:51.934469 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:59:52.354554 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0c148f71-2c9c-4150-ad1a-6e3380288f94 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:52.379293 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0c148f71-2c9c-4150-ad1a-6e3380288f94 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1" status: 200 len: 1485 microversion: 2.1 time: 0.662852 Sep 16 12:59:52.383136 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1649/3194] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:51 2022] GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1 => generated 1485 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:52.400815 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2418e695-834c-40e4-a3ab-faf6692ebd97 tempest-FloatingIPsTestJSON-596548026 tempest-FloatingIPsTestJSON-596548026-project] Action: 'create', calling method: .version_select at 0x7f1034b21670>, body: {"pool": null} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:59:52.445103 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-67125f77-9429-48e7-86ed-72e41e84f21e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:52.459150 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-67125f77-9429-48e7-86ed-72e41e84f21e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec" status: 200 len: 1676 microversion: 2.1 time: 0.619827 Sep 16 12:59:52.460265 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1546/3195] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:51 2022] GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec => generated 1676 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:52.466456 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5246295d-f368-4ebb-b386-d5b08a829326 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:52.467432 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5246295d-f368-4ebb-b386-d5b08a829326 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 5316af91-4d35-4a6e-9584-05d2a5b5cce6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:52.475227 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5246295d-f368-4ebb-b386-d5b08a829326 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:52.475972 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5246295d-f368-4ebb-b386-d5b08a829326 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:52.477438 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5246295d-f368-4ebb-b386-d5b08a829326 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:52.478514 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5246295d-f368-4ebb-b386-d5b08a829326 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:52.479295 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5246295d-f368-4ebb-b386-d5b08a829326 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:52.479999 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5246295d-f368-4ebb-b386-d5b08a829326 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:52.521273 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-5246295d-f368-4ebb-b386-d5b08a829326 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] HTTP exception thrown: Instance 5316af91-4d35-4a6e-9584-05d2a5b5cce6 could not be found. Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5246295d-f368-4ebb-b386-d5b08a829326 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Request method failure captured: Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6 HTTP/1.1 Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHK_YnSmFNONV0iWyfIemnYEfvNBytCPZbi7N25amGQ6cWDZ6HV_kECLyT-_Jd3sLrSclC_OwD8SedcsAYzrJLpYoE4A8Tx1VzT0n1URdkSaC0srJQEQsJRhfXlPAxlq-FovgwQN4kGwZgDUiY-Toc-xdH52Xyev6VrEkHr8elxAtSE Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 18ad456d126a4c25accb04f76a159733 Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ServersTestMultiNic-131966873 Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/18ad456d126a4c25accb04f76a159733"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/18ad456d126a4c25accb04f76a159733"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_18ad456d126a4c25accb04f76a159733", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/18ad456d126a4c25accb04f76a159733"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ServersTestMultiNic-131966873 Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 18ad456d126a4c25accb04f76a159733 Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ServersTestMultiNic-131966873 Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ServersTestMultiNic-131966873-project Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 24cf3952918747349e71c4ac1e7b00c6 Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ServersTestMultiNic-131966873-project Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance 5316af91-4d35-4a6e-9584-05d2a5b5cce6 could not be found. Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '5316af91-4d35-4a6e-9584-05d2a5b5cce6'} Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5316af91-4d35-4a6e-9584-05d2a5b5cce6 could not be found. Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5316af91-4d35-4a6e-9584-05d2a5b5cce6 could not be found. Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:59:52.523209 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:52.529038 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:59:52.529038 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:59:52.529038 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:59:52.529038 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:59:52.529038 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:59:52.529038 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5316af91-4d35-4a6e-9584-05d2a5b5cce6 could not be found. Sep 16 12:59:52.529038 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:52.529038 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5246295d-f368-4ebb-b386-d5b08a829326 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Returning 404 to user: Instance 5316af91-4d35-4a6e-9584-05d2a5b5cce6 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:59:52.530000 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5246295d-f368-4ebb-b386-d5b08a829326 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6" status: 404 len: 111 microversion: 2.1 time: 0.068494 Sep 16 12:59:52.530577 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1547/3196] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:52 2022] GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:59:52.542317 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8ba26a4c-ddcf-4b6d-93de-d22dd4607403 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:52.543659 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8ba26a4c-ddcf-4b6d-93de-d22dd4607403 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 45c75956-6533-4add-91e9-419a2043d9e1] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:52.550373 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8ba26a4c-ddcf-4b6d-93de-d22dd4607403 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:52.550938 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8ba26a4c-ddcf-4b6d-93de-d22dd4607403 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:52.551386 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8ba26a4c-ddcf-4b6d-93de-d22dd4607403 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:52.552093 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8ba26a4c-ddcf-4b6d-93de-d22dd4607403 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:52.552635 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8ba26a4c-ddcf-4b6d-93de-d22dd4607403 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:52.553060 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8ba26a4c-ddcf-4b6d-93de-d22dd4607403 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:52.583398 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8ba26a4c-ddcf-4b6d-93de-d22dd4607403 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 45c75956-6533-4add-91e9-419a2043d9e1] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 12:59:52.712937 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8ba26a4c-ddcf-4b6d-93de-d22dd4607403 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "DELETE /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1" status: 204 len: 0 microversion: 2.1 time: 0.178575 Sep 16 12:59:52.714269 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1548/3197] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:59:52 2022] DELETE /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 12:59:52.725339 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0ab20fe2-a076-422b-87f9-98fe26989dfa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:52.727400 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0ab20fe2-a076-422b-87f9-98fe26989dfa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 45c75956-6533-4add-91e9-419a2043d9e1] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:52.735044 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0ab20fe2-a076-422b-87f9-98fe26989dfa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:52.736392 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0ab20fe2-a076-422b-87f9-98fe26989dfa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:52.737575 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0ab20fe2-a076-422b-87f9-98fe26989dfa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:52.738718 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0ab20fe2-a076-422b-87f9-98fe26989dfa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:52.739778 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0ab20fe2-a076-422b-87f9-98fe26989dfa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:52.741597 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0ab20fe2-a076-422b-87f9-98fe26989dfa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:53.594431 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0ab20fe2-a076-422b-87f9-98fe26989dfa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:53.602391 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0ab20fe2-a076-422b-87f9-98fe26989dfa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1" status: 200 len: 1491 microversion: 2.1 time: 0.882614 Sep 16 12:59:53.602907 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1549/3198] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:52 2022] GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1 => generated 1491 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:53.625525 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2223b117-90e8-4faf-84c9-ca58101426d4 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:53.629335 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-2223b117-90e8-4faf-84c9-ca58101426d4 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 272fddb0-eba2-4559-b76d-460bd65246ec] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:53.639345 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2223b117-90e8-4faf-84c9-ca58101426d4 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:53.640507 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2223b117-90e8-4faf-84c9-ca58101426d4 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:53.641136 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2223b117-90e8-4faf-84c9-ca58101426d4 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:53.642038 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2223b117-90e8-4faf-84c9-ca58101426d4 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:53.642659 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2223b117-90e8-4faf-84c9-ca58101426d4 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:53.643425 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2223b117-90e8-4faf-84c9-ca58101426d4 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:54.315398 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-2223b117-90e8-4faf-84c9-ca58101426d4 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:54.332466 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2223b117-90e8-4faf-84c9-ca58101426d4 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec" status: 200 len: 1676 microversion: 2.1 time: 0.712404 Sep 16 12:59:54.333464 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1550/3199] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:53 2022] GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec => generated 1676 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:54.626582 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-91c03ea3-ed7c-40c7-8232-ef380ae84c0c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:54.637849 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-91c03ea3-ed7c-40c7-8232-ef380ae84c0c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 45c75956-6533-4add-91e9-419a2043d9e1] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:54.650657 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-91c03ea3-ed7c-40c7-8232-ef380ae84c0c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:54.651409 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-91c03ea3-ed7c-40c7-8232-ef380ae84c0c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:54.652011 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-91c03ea3-ed7c-40c7-8232-ef380ae84c0c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:54.653514 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-91c03ea3-ed7c-40c7-8232-ef380ae84c0c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:54.654250 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-91c03ea3-ed7c-40c7-8232-ef380ae84c0c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:54.654840 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-91c03ea3-ed7c-40c7-8232-ef380ae84c0c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:55.845987 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-91c03ea3-ed7c-40c7-8232-ef380ae84c0c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:55.862667 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-91c03ea3-ed7c-40c7-8232-ef380ae84c0c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1" status: 200 len: 1491 microversion: 2.1 time: 1.239952 Sep 16 12:59:55.873108 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1551/3200] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:54 2022] GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1 => generated 1491 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 12:59:55.895429 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-039c01bc-9ab2-41b1-8b37-098bab01558e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:55.896152 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-039c01bc-9ab2-41b1-8b37-098bab01558e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 272fddb0-eba2-4559-b76d-460bd65246ec] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:55.904857 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-039c01bc-9ab2-41b1-8b37-098bab01558e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:55.905370 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-039c01bc-9ab2-41b1-8b37-098bab01558e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:55.906448 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-039c01bc-9ab2-41b1-8b37-098bab01558e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:55.907193 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-039c01bc-9ab2-41b1-8b37-098bab01558e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:55.907660 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-039c01bc-9ab2-41b1-8b37-098bab01558e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:55.908204 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-039c01bc-9ab2-41b1-8b37-098bab01558e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:56.478116 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-039c01bc-9ab2-41b1-8b37-098bab01558e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:56.493729 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-039c01bc-9ab2-41b1-8b37-098bab01558e tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec" status: 200 len: 1676 microversion: 2.1 time: 0.608344 Sep 16 12:59:56.503759 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1552/3201] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:55 2022] GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec => generated 1676 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:56.727996 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-26eec383-da76-41d2-9ba0-913bfd23052b tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1943683372", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:59:56.818261 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-26eec383-da76-41d2-9ba0-913bfd23052b tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] validate_networks() for None {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 12:59:57.941251 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-26eec383-da76-41d2-9ba0-913bfd23052b tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 12:59:57.942766 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-26eec383-da76-41d2-9ba0-913bfd23052b tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 12:59:57.943470 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-26eec383-da76-41d2-9ba0-913bfd23052b tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 12:59:57.944159 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-26eec383-da76-41d2-9ba0-913bfd23052b tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 12:59:57.945367 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-26eec383-da76-41d2-9ba0-913bfd23052b tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 12:59:57.979123 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-26eec383-da76-41d2-9ba0-913bfd23052b tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:57.981514 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-26eec383-da76-41d2-9ba0-913bfd23052b tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:57.983800 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-26eec383-da76-41d2-9ba0-913bfd23052b tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:57.985525 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-26eec383-da76-41d2-9ba0-913bfd23052b tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:57.986228 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-26eec383-da76-41d2-9ba0-913bfd23052b tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:57.987392 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-26eec383-da76-41d2-9ba0-913bfd23052b tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:58.012788 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-26eec383-da76-41d2-9ba0-913bfd23052b tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Getting quotas for project 9bc3ef4fd0374ac4b74900369ca779aa. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 12:59:58.020653 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-26eec383-da76-41d2-9ba0-913bfd23052b tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Getting quotas for user eb0e6121124d4a15a63ac359bff5aedb and project 9bc3ef4fd0374ac4b74900369ca779aa. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 12:59:58.036993 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-26eec383-da76-41d2-9ba0-913bfd23052b tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 12:59:58.040035 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-26eec383-da76-41d2-9ba0-913bfd23052b tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: 08836465-8c0f-454b-9e19-8bb6bd44f931] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 12:59:58.116956 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-26eec383-da76-41d2-9ba0-913bfd23052b tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.601357 Sep 16 12:59:58.125322 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1553/3202] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:59:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 12:59:58.130844 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-de231a5e-13a5-4038-b66e-1daad8595ccc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:58.132508 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-de231a5e-13a5-4038-b66e-1daad8595ccc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 45c75956-6533-4add-91e9-419a2043d9e1] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:58.140403 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-de231a5e-13a5-4038-b66e-1daad8595ccc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:58.141261 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-de231a5e-13a5-4038-b66e-1daad8595ccc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:58.141958 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-de231a5e-13a5-4038-b66e-1daad8595ccc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:58.142892 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-de231a5e-13a5-4038-b66e-1daad8595ccc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:58.143583 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-de231a5e-13a5-4038-b66e-1daad8595ccc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:58.144298 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-de231a5e-13a5-4038-b66e-1daad8595ccc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:58.192974 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-de231a5e-13a5-4038-b66e-1daad8595ccc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:58.193777 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-de231a5e-13a5-4038-b66e-1daad8595ccc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:58.195618 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-de231a5e-13a5-4038-b66e-1daad8595ccc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:58.196400 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-de231a5e-13a5-4038-b66e-1daad8595ccc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lazy-loading 'fault' on Instance uuid 45c75956-6533-4add-91e9-419a2043d9e1 {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 12:59:58.430191 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-de231a5e-13a5-4038-b66e-1daad8595ccc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:58.448289 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-de231a5e-13a5-4038-b66e-1daad8595ccc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1" status: 200 len: 1304 microversion: 2.1 time: 0.321291 Sep 16 12:59:58.481885 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1554/3203] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:58 2022] GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1 => generated 1304 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:58.508279 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-cd328a66-e58b-46e3-a764-fad123745a6c tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:58.516463 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-cd328a66-e58b-46e3-a764-fad123745a6c tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 272fddb0-eba2-4559-b76d-460bd65246ec] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:58.534840 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cd328a66-e58b-46e3-a764-fad123745a6c tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:58.535324 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cd328a66-e58b-46e3-a764-fad123745a6c tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:58.535763 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cd328a66-e58b-46e3-a764-fad123745a6c tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:58.536563 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cd328a66-e58b-46e3-a764-fad123745a6c tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:58.537018 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cd328a66-e58b-46e3-a764-fad123745a6c tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:58.537445 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cd328a66-e58b-46e3-a764-fad123745a6c tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:58.750282 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-cd328a66-e58b-46e3-a764-fad123745a6c tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65566509bf544a398cbb9c29ace613c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a67136b9d8041fd8e62a81be2d6b48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:58.766244 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-cd328a66-e58b-46e3-a764-fad123745a6c tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec" status: 200 len: 1608 microversion: 2.1 time: 0.280650 Sep 16 12:59:58.767445 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1555/3204] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:58 2022] GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec => generated 1608 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:58.779703 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-ddd2c39f-86a3-4f28-9e84-d1fcde2536a5 req-73574f02-3eb9-4dd9-b5b1-096f66e884ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45c75956-6533-4add-91e9-419a2043d9e1", "name": "network-vif-deleted", "tag": "a393a675-10b0-4b27-8958-c7b26fed3228"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:59:58.800976 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-ddd2c39f-86a3-4f28-9e84-d1fcde2536a5 req-73574f02-3eb9-4dd9-b5b1-096f66e884ae service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:58.802785 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-ddd2c39f-86a3-4f28-9e84-d1fcde2536a5 req-73574f02-3eb9-4dd9-b5b1-096f66e884ae service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:58.804019 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-ddd2c39f-86a3-4f28-9e84-d1fcde2536a5 req-73574f02-3eb9-4dd9-b5b1-096f66e884ae service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:58.833365 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-ddd2c39f-86a3-4f28-9e84-d1fcde2536a5 req-73574f02-3eb9-4dd9-b5b1-096f66e884ae service nova] Creating event network-vif-deleted:a393a675-10b0-4b27-8958-c7b26fed3228 for instance 45c75956-6533-4add-91e9-419a2043d9e1 on n-h1-858094-4 Sep 16 12:59:58.846058 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-ddd2c39f-86a3-4f28-9e84-d1fcde2536a5 req-73574f02-3eb9-4dd9-b5b1-096f66e884ae service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075709 Sep 16 12:59:58.849511 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1556/3205] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 12:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:59:58.851273 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-ddd2c39f-86a3-4f28-9e84-d1fcde2536a5 req-73574f02-3eb9-4dd9-b5b1-096f66e884ae service nova] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:58.854907 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-ddd2c39f-86a3-4f28-9e84-d1fcde2536a5 req-73574f02-3eb9-4dd9-b5b1-096f66e884ae service nova] 10.222.0.67 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003533 Sep 16 12:59:58.856861 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2418e695-834c-40e4-a3ab-faf6692ebd97 tempest-FloatingIPsTestJSON-596548026 tempest-FloatingIPsTestJSON-596548026-project] 10.222.0.67 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.469863 Sep 16 12:59:58.858167 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1650/3206] 10.222.0.67 () {60 vars in 1170 bytes} [Fri Sep 16 12:59:52 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 12:59:58.858872 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1557/3207] 10.222.0.67 () {56 vars in 886 bytes} [Fri Sep 16 12:59:58 2022] GET /compute/ => generated 377 bytes in 8 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 16 12:59:58.870383 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fefc4840-4a16-49d3-962e-0670bbb60346 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:58.871871 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-18ac3675-ab91-4dde-909d-06c5b9309f35 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:58.872768 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-18ac3675-ab91-4dde-909d-06c5b9309f35 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 5316af91-4d35-4a6e-9584-05d2a5b5cce6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:58.875995 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-fefc4840-4a16-49d3-962e-0670bbb60346 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: 08836465-8c0f-454b-9e19-8bb6bd44f931] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:58.879382 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 12:59:58.881394 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18ac3675-ab91-4dde-909d-06c5b9309f35 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:58.882117 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18ac3675-ab91-4dde-909d-06c5b9309f35 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:58.882859 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18ac3675-ab91-4dde-909d-06c5b9309f35 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:58.885576 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18ac3675-ab91-4dde-909d-06c5b9309f35 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:58.887685 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18ac3675-ab91-4dde-909d-06c5b9309f35 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:58.889262 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18ac3675-ab91-4dde-909d-06c5b9309f35 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:58.907624 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-18ac3675-ab91-4dde-909d-06c5b9309f35 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] HTTP exception thrown: Instance 5316af91-4d35-4a6e-9584-05d2a5b5cce6 could not be found. Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-18ac3675-ab91-4dde-909d-06c5b9309f35 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Request method failure captured: Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6 HTTP/1.1 Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHK_YnSmFNONV0iWyfIemnYEfvNBytCPZbi7N25amGQ6cWDZ6HV_kECLyT-_Jd3sLrSclC_OwD8SedcsAYzrJLpYoE4A8Tx1VzT0n1URdkSaC0srJQEQsJRhfXlPAxlq-FovgwQN4kGwZgDUiY-Toc-xdH52Xyev6VrEkHr8elxAtSE Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 18ad456d126a4c25accb04f76a159733 Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersTestMultiNic-131966873 Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/18ad456d126a4c25accb04f76a159733"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/18ad456d126a4c25accb04f76a159733"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_18ad456d126a4c25accb04f76a159733", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/18ad456d126a4c25accb04f76a159733"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ServersTestMultiNic-131966873 Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 18ad456d126a4c25accb04f76a159733 Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersTestMultiNic-131966873 Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ServersTestMultiNic-131966873-project Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 24cf3952918747349e71c4ac1e7b00c6 Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ServersTestMultiNic-131966873-project Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 5316af91-4d35-4a6e-9584-05d2a5b5cce6 could not be found. Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '5316af91-4d35-4a6e-9584-05d2a5b5cce6'} Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5316af91-4d35-4a6e-9584-05d2a5b5cce6 could not be found. Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:59:58.910785 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:59:58.915469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5316af91-4d35-4a6e-9584-05d2a5b5cce6 could not be found. Sep 16 12:59:58.915469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:59:58.915469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:59:58.915469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:59:58.915469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:59:58.915469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:59:58.915469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:59:58.915469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:59:58.915469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:59:58.915469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5316af91-4d35-4a6e-9584-05d2a5b5cce6 could not be found. Sep 16 12:59:58.915469 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 12:59:58.915469 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-18ac3675-ab91-4dde-909d-06c5b9309f35 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Returning 404 to user: Instance 5316af91-4d35-4a6e-9584-05d2a5b5cce6 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:59:58.917642 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-18ac3675-ab91-4dde-909d-06c5b9309f35 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "DELETE /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6" status: 404 len: 111 microversion: 2.1 time: 0.048862 Sep 16 12:59:58.919440 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1651/3208] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:59:58 2022] DELETE /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:59:58.937799 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-00d7c54a-da2e-47c9-923c-65dca94ffb02 tempest-FloatingIPsTestJSON-596548026 tempest-FloatingIPsTestJSON-596548026-project] Calling method '.version_select at 0x7f1034a69f70>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:59.178636 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-fefc4840-4a16-49d3-962e-0670bbb60346 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0e6121124d4a15a63ac359bff5aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc3ef4fd0374ac4b74900369ca779aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 12:59:59.202210 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-fefc4840-4a16-49d3-962e-0670bbb60346 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "GET /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931" status: 200 len: 1219 microversion: 2.1 time: 0.341670 Sep 16 12:59:59.203015 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1558/3209] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:58 2022] GET /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931 => generated 1219 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 12:59:59.209572 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e5ed8350-6b35-42f8-a94e-af120d4d3fed tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:59.210195 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e5ed8350-6b35-42f8-a94e-af120d4d3fed tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 5316af91-4d35-4a6e-9584-05d2a5b5cce6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:59.236940 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e5ed8350-6b35-42f8-a94e-af120d4d3fed tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:59.239724 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e5ed8350-6b35-42f8-a94e-af120d4d3fed tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:59.240867 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e5ed8350-6b35-42f8-a94e-af120d4d3fed tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:59.241888 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e5ed8350-6b35-42f8-a94e-af120d4d3fed tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:59.242527 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e5ed8350-6b35-42f8-a94e-af120d4d3fed tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:59.243165 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e5ed8350-6b35-42f8-a94e-af120d4d3fed tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:59.268166 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-e5ed8350-6b35-42f8-a94e-af120d4d3fed tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] HTTP exception thrown: Instance 5316af91-4d35-4a6e-9584-05d2a5b5cce6 could not be found. Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e5ed8350-6b35-42f8-a94e-af120d4d3fed tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Request method failure captured: Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6 HTTP/1.1 Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHK_YnSmFNONV0iWyfIemnYEfvNBytCPZbi7N25amGQ6cWDZ6HV_kECLyT-_Jd3sLrSclC_OwD8SedcsAYzrJLpYoE4A8Tx1VzT0n1URdkSaC0srJQEQsJRhfXlPAxlq-FovgwQN4kGwZgDUiY-Toc-xdH52Xyev6VrEkHr8elxAtSE Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 18ad456d126a4c25accb04f76a159733 Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ServersTestMultiNic-131966873 Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/18ad456d126a4c25accb04f76a159733"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/18ad456d126a4c25accb04f76a159733"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_18ad456d126a4c25accb04f76a159733", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/18ad456d126a4c25accb04f76a159733"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ServersTestMultiNic-131966873 Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 18ad456d126a4c25accb04f76a159733 Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ServersTestMultiNic-131966873 Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ServersTestMultiNic-131966873-project Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 24cf3952918747349e71c4ac1e7b00c6 Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ServersTestMultiNic-131966873-project Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance 5316af91-4d35-4a6e-9584-05d2a5b5cce6 could not be found. Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '5316af91-4d35-4a6e-9584-05d2a5b5cce6'} Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5316af91-4d35-4a6e-9584-05d2a5b5cce6 could not be found. Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5316af91-4d35-4a6e-9584-05d2a5b5cce6 could not be found. Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:59:59.270851 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:59.275079 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:59:59.275079 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:59:59.275079 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:59:59.275079 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:59:59.275079 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:59:59.275079 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5316af91-4d35-4a6e-9584-05d2a5b5cce6 could not be found. Sep 16 12:59:59.275079 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:59.277880 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e5ed8350-6b35-42f8-a94e-af120d4d3fed tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Returning 404 to user: Instance 5316af91-4d35-4a6e-9584-05d2a5b5cce6 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:59:59.279601 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e5ed8350-6b35-42f8-a94e-af120d4d3fed tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6" status: 404 len: 111 microversion: 2.1 time: 0.075001 Sep 16 12:59:59.280856 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1559/3210] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:59 2022] GET /compute/v2.1/servers/5316af91-4d35-4a6e-9584-05d2a5b5cce6 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:59:59.290931 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8bd6b3db-69be-432c-8038-b52bc245e716 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:59.294573 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8bd6b3db-69be-432c-8038-b52bc245e716 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 536f2ffa-d5a1-4060-9ef1-f305cf164fd3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:59.304232 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bd6b3db-69be-432c-8038-b52bc245e716 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:59.305136 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bd6b3db-69be-432c-8038-b52bc245e716 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:59.305804 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bd6b3db-69be-432c-8038-b52bc245e716 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:59.309782 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bd6b3db-69be-432c-8038-b52bc245e716 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:59.312135 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bd6b3db-69be-432c-8038-b52bc245e716 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:59.312612 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bd6b3db-69be-432c-8038-b52bc245e716 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:59.333392 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-8bd6b3db-69be-432c-8038-b52bc245e716 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] HTTP exception thrown: Instance 536f2ffa-d5a1-4060-9ef1-f305cf164fd3 could not be found. Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8bd6b3db-69be-432c-8038-b52bc245e716 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Request method failure captured: Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: request: DELETE /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3 HTTP/1.1 Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHK_YnSmFNONV0iWyfIemnYEfvNBytCPZbi7N25amGQ6cWDZ6HV_kECLyT-_Jd3sLrSclC_OwD8SedcsAYzrJLpYoE4A8Tx1VzT0n1URdkSaC0srJQEQsJRhfXlPAxlq-FovgwQN4kGwZgDUiY-Toc-xdH52Xyev6VrEkHr8elxAtSE Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 18ad456d126a4c25accb04f76a159733 Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ServersTestMultiNic-131966873 Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/18ad456d126a4c25accb04f76a159733"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/18ad456d126a4c25accb04f76a159733"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_18ad456d126a4c25accb04f76a159733", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/18ad456d126a4c25accb04f76a159733"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ServersTestMultiNic-131966873 Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 18ad456d126a4c25accb04f76a159733 Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ServersTestMultiNic-131966873 Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ServersTestMultiNic-131966873-project Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 24cf3952918747349e71c4ac1e7b00c6 Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ServersTestMultiNic-131966873-project Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance 536f2ffa-d5a1-4060-9ef1-f305cf164fd3 could not be found. Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '536f2ffa-d5a1-4060-9ef1-f305cf164fd3'} Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 536f2ffa-d5a1-4060-9ef1-f305cf164fd3 could not be found. Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:59:59.335639 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:59:59.341983 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 536f2ffa-d5a1-4060-9ef1-f305cf164fd3 could not be found. Sep 16 12:59:59.341983 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:59.341983 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:59:59.341983 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:59.341983 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:59:59.341983 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:59:59.341983 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:59:59.341983 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:59:59.341983 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:59:59.341983 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 536f2ffa-d5a1-4060-9ef1-f305cf164fd3 could not be found. Sep 16 12:59:59.341983 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:59.344280 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8bd6b3db-69be-432c-8038-b52bc245e716 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Returning 404 to user: Instance 536f2ffa-d5a1-4060-9ef1-f305cf164fd3 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:59:59.345928 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8bd6b3db-69be-432c-8038-b52bc245e716 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "DELETE /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3" status: 404 len: 111 microversion: 2.1 time: 0.060043 Sep 16 12:59:59.347039 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1560/3211] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 12:59:59 2022] DELETE /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:59:59.370847 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1ee17a92-3145-4699-8c18-e94050963a08 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:59.376898 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-1ee17a92-3145-4699-8c18-e94050963a08 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] [instance: 536f2ffa-d5a1-4060-9ef1-f305cf164fd3] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:59.398684 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1ee17a92-3145-4699-8c18-e94050963a08 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:59.400735 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1ee17a92-3145-4699-8c18-e94050963a08 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:59.401386 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1ee17a92-3145-4699-8c18-e94050963a08 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:59.404741 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1ee17a92-3145-4699-8c18-e94050963a08 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:59.407956 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1ee17a92-3145-4699-8c18-e94050963a08 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:59.412904 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1ee17a92-3145-4699-8c18-e94050963a08 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:59.461106 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-1ee17a92-3145-4699-8c18-e94050963a08 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] HTTP exception thrown: Instance 536f2ffa-d5a1-4060-9ef1-f305cf164fd3 could not be found. Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1ee17a92-3145-4699-8c18-e94050963a08 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Request method failure captured: Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3 HTTP/1.1 Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHK_YnSmFNONV0iWyfIemnYEfvNBytCPZbi7N25amGQ6cWDZ6HV_kECLyT-_Jd3sLrSclC_OwD8SedcsAYzrJLpYoE4A8Tx1VzT0n1URdkSaC0srJQEQsJRhfXlPAxlq-FovgwQN4kGwZgDUiY-Toc-xdH52Xyev6VrEkHr8elxAtSE Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 18ad456d126a4c25accb04f76a159733 Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ServersTestMultiNic-131966873 Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/18ad456d126a4c25accb04f76a159733"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/18ad456d126a4c25accb04f76a159733"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_18ad456d126a4c25accb04f76a159733", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/18ad456d126a4c25accb04f76a159733"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ServersTestMultiNic-131966873 Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 18ad456d126a4c25accb04f76a159733 Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ServersTestMultiNic-131966873 Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ServersTestMultiNic-131966873-project Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 24cf3952918747349e71c4ac1e7b00c6 Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ServersTestMultiNic-131966873-project Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance 536f2ffa-d5a1-4060-9ef1-f305cf164fd3 could not be found. Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '536f2ffa-d5a1-4060-9ef1-f305cf164fd3'} Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 536f2ffa-d5a1-4060-9ef1-f305cf164fd3 could not be found. Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 536f2ffa-d5a1-4060-9ef1-f305cf164fd3 could not be found. Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:59:59.463153 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:59.469874 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:59:59.469874 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:59:59.469874 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:59:59.469874 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:59:59.469874 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:59:59.469874 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 536f2ffa-d5a1-4060-9ef1-f305cf164fd3 could not be found. Sep 16 12:59:59.469874 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:59.471705 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1ee17a92-3145-4699-8c18-e94050963a08 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] Returning 404 to user: Instance 536f2ffa-d5a1-4060-9ef1-f305cf164fd3 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:59:59.472863 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1ee17a92-3145-4699-8c18-e94050963a08 tempest-ServersTestMultiNic-131966873 tempest-ServersTestMultiNic-131966873-project] 10.222.0.67 "GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3" status: 404 len: 111 microversion: 2.1 time: 0.118051 Sep 16 12:59:59.477179 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1561/3212] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:59 2022] GET /compute/v2.1/servers/536f2ffa-d5a1-4060-9ef1-f305cf164fd3 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:59:59.483710 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d1c3b4f4-a2b0-4eda-8d17-a1c89973164c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 12:59:59.484957 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d1c3b4f4-a2b0-4eda-8d17-a1c89973164c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 45c75956-6533-4add-91e9-419a2043d9e1] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 12:59:59.492652 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d1c3b4f4-a2b0-4eda-8d17-a1c89973164c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:59.493433 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d1c3b4f4-a2b0-4eda-8d17-a1c89973164c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:59.493943 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d1c3b4f4-a2b0-4eda-8d17-a1c89973164c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:59.495638 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d1c3b4f4-a2b0-4eda-8d17-a1c89973164c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 12:59:59.496442 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d1c3b4f4-a2b0-4eda-8d17-a1c89973164c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 12:59:59.496949 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d1c3b4f4-a2b0-4eda-8d17-a1c89973164c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 12:59:59.513945 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-d1c3b4f4-a2b0-4eda-8d17-a1c89973164c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] HTTP exception thrown: Instance 45c75956-6533-4add-91e9-419a2043d9e1 could not be found. Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d1c3b4f4-a2b0-4eda-8d17-a1c89973164c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Request method failure captured: Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1 HTTP/1.1 Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHK-ai74OxrHHqL5ZA97hOvy32Q6xIReVrKhZIj6PEPyQ_UB4rFs-7hdJCkozKZ5clo_9DaVkBFgsUmiSN_gmVaPdL8FT-f5QYKPk-CE61XDTK1RMhpnQkeVMlba4E4KaPfDCDA8WSNup3uH3mzkxsd2kp-OesctbTYQkqWqHnAvC3I Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_cfe82d8dd4fb42cbb054a6f069424c57", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-DeleteServersTestJSON-1385458479 Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-DeleteServersTestJSON-1385458479-project Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 2e531a7026054c34b2a78a1c484cbe02 Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-DeleteServersTestJSON-1385458479-project Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance 45c75956-6533-4add-91e9-419a2043d9e1 could not be found. Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '45c75956-6533-4add-91e9-419a2043d9e1'} Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45c75956-6533-4add-91e9-419a2043d9e1 could not be found. Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45c75956-6533-4add-91e9-419a2043d9e1 could not be found. Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 12:59:59.515663 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:59.519820 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 12:59:59.519820 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 12:59:59.519820 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 12:59:59.519820 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 12:59:59.519820 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 12:59:59.519820 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45c75956-6533-4add-91e9-419a2043d9e1 could not be found. Sep 16 12:59:59.519820 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 12:59:59.519820 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d1c3b4f4-a2b0-4eda-8d17-a1c89973164c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Returning 404 to user: Instance 45c75956-6533-4add-91e9-419a2043d9e1 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 12:59:59.519820 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d1c3b4f4-a2b0-4eda-8d17-a1c89973164c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1" status: 404 len: 111 microversion: 2.1 time: 0.037998 Sep 16 12:59:59.519820 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1562/3213] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 12:59:59 2022] GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 12:59:59.685351 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-263aed39-0de1-496a-a640-d85dc2da0bbc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1315785279", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": [{"uuid": "4c6a423f-0493-4448-999c-84f17e899760"}]}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 12:59:59.817507 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-263aed39-0de1-496a-a640-d85dc2da0bbc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] validate_networks() for [('4c6a423f-0493-4448-999c-84f17e899760', None, None, None, None, None)] {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:00:02.448793 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-263aed39-0de1-496a-a640-d85dc2da0bbc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:00:02.449447 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-263aed39-0de1-496a-a640-d85dc2da0bbc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:00:02.449896 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-263aed39-0de1-496a-a640-d85dc2da0bbc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:00:02.450551 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-263aed39-0de1-496a-a640-d85dc2da0bbc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:00:02.451415 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-263aed39-0de1-496a-a640-d85dc2da0bbc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:00:02.473095 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-263aed39-0de1-496a-a640-d85dc2da0bbc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:02.475776 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-263aed39-0de1-496a-a640-d85dc2da0bbc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:02.476317 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-263aed39-0de1-496a-a640-d85dc2da0bbc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:02.478515 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-263aed39-0de1-496a-a640-d85dc2da0bbc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:02.478997 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-263aed39-0de1-496a-a640-d85dc2da0bbc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:02.479433 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-263aed39-0de1-496a-a640-d85dc2da0bbc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:02.519111 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-263aed39-0de1-496a-a640-d85dc2da0bbc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Getting quotas for project cfe82d8dd4fb42cbb054a6f069424c57. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:00:02.532749 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-263aed39-0de1-496a-a640-d85dc2da0bbc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Getting quotas for user 2e531a7026054c34b2a78a1c484cbe02 and project cfe82d8dd4fb42cbb054a6f069424c57. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:00:02.555895 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-263aed39-0de1-496a-a640-d85dc2da0bbc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:00:02.565891 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-263aed39-0de1-496a-a640-d85dc2da0bbc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:00:02.648231 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-263aed39-0de1-496a-a640-d85dc2da0bbc tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.970153 Sep 16 13:00:02.663926 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1563/3214] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 12:59:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 13:00:02.673946 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e20bd491-4d80-444f-84c4-5c6349b4d6ed tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:02.674801 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e20bd491-4d80-444f-84c4-5c6349b4d6ed tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 272fddb0-eba2-4559-b76d-460bd65246ec] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:02.681612 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e20bd491-4d80-444f-84c4-5c6349b4d6ed tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:02.682345 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e20bd491-4d80-444f-84c4-5c6349b4d6ed tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:02.682941 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e20bd491-4d80-444f-84c4-5c6349b4d6ed tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:02.683895 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e20bd491-4d80-444f-84c4-5c6349b4d6ed tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:02.684853 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e20bd491-4d80-444f-84c4-5c6349b4d6ed tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:02.685621 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e20bd491-4d80-444f-84c4-5c6349b4d6ed tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:02.738948 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-e20bd491-4d80-444f-84c4-5c6349b4d6ed tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] HTTP exception thrown: Instance 272fddb0-eba2-4559-b76d-460bd65246ec could not be found. Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e20bd491-4d80-444f-84c4-5c6349b4d6ed tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Request method failure captured: Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec HTTP/1.1 Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHG3SwHS-l0WitPOzDSYA44CeJXLIzVxgr-MHeRUPHLkCmQshOXungF3JmTqRR5iusdVZCtU5BHnBL7LOCSV4K_6utRyxrplivDCcD85IiEW1gN4Yw9gJp7Mrm5YkkjyT9tJc58fqahkRyPfD_CsC349BMa6OwVpDa780GBoFo4Gi0E Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 7a67136b9d8041fd8e62a81be2d6b48d Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-AttachVolumeTestJSON-2140946303 Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7a67136b9d8041fd8e62a81be2d6b48d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7a67136b9d8041fd8e62a81be2d6b48d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7a67136b9d8041fd8e62a81be2d6b48d", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7a67136b9d8041fd8e62a81be2d6b48d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-AttachVolumeTestJSON-2140946303 Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 7a67136b9d8041fd8e62a81be2d6b48d Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2140946303 Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-AttachVolumeTestJSON-2140946303-project Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 65566509bf544a398cbb9c29ace613c5 Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-AttachVolumeTestJSON-2140946303-project Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance 272fddb0-eba2-4559-b76d-460bd65246ec could not be found. Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '272fddb0-eba2-4559-b76d-460bd65246ec'} Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 272fddb0-eba2-4559-b76d-460bd65246ec could not be found. Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 272fddb0-eba2-4559-b76d-460bd65246ec could not be found. Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:00:02.741282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:00:02.746243 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:00:02.746243 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:00:02.746243 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:00:02.746243 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:00:02.746243 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:00:02.746243 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 272fddb0-eba2-4559-b76d-460bd65246ec could not be found. Sep 16 13:00:02.746243 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:00:02.748608 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e20bd491-4d80-444f-84c4-5c6349b4d6ed tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Returning 404 to user: Instance 272fddb0-eba2-4559-b76d-460bd65246ec could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:00:02.750165 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e20bd491-4d80-444f-84c4-5c6349b4d6ed tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec" status: 404 len: 111 microversion: 2.1 time: 0.085100 Sep 16 13:00:02.754980 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1564/3215] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:02 2022] GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:00:02.760543 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c17deafc-b6ec-4c1e-ba4e-d75fe058a370 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:02.761407 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c17deafc-b6ec-4c1e-ba4e-d75fe058a370 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: 08836465-8c0f-454b-9e19-8bb6bd44f931] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:02.768916 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c17deafc-b6ec-4c1e-ba4e-d75fe058a370 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:02.769590 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c17deafc-b6ec-4c1e-ba4e-d75fe058a370 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:02.770326 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c17deafc-b6ec-4c1e-ba4e-d75fe058a370 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:02.777026 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c17deafc-b6ec-4c1e-ba4e-d75fe058a370 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:02.778437 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c17deafc-b6ec-4c1e-ba4e-d75fe058a370 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:02.778894 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c17deafc-b6ec-4c1e-ba4e-d75fe058a370 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:03.063810 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c17deafc-b6ec-4c1e-ba4e-d75fe058a370 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0e6121124d4a15a63ac359bff5aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc3ef4fd0374ac4b74900369ca779aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:03.082864 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c17deafc-b6ec-4c1e-ba4e-d75fe058a370 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "GET /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931" status: 200 len: 1277 microversion: 2.1 time: 0.326542 Sep 16 13:00:03.083470 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1565/3216] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:02 2022] GET /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931 => generated 1277 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:03.097124 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-c89b5989-c29f-48af-90ae-9da90f051200 req-e56b8c52-3cd5-429c-b76b-59f9abda095d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "272fddb0-eba2-4559-b76d-460bd65246ec", "name": "network-vif-deleted", "tag": "137f7ed1-df61-44ac-b25d-fb1d5a0609d4"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:00:03.150335 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-c89b5989-c29f-48af-90ae-9da90f051200 req-e56b8c52-3cd5-429c-b76b-59f9abda095d service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:03.150829 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-c89b5989-c29f-48af-90ae-9da90f051200 req-e56b8c52-3cd5-429c-b76b-59f9abda095d service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:03.151261 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-c89b5989-c29f-48af-90ae-9da90f051200 req-e56b8c52-3cd5-429c-b76b-59f9abda095d service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:03.193076 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-c89b5989-c29f-48af-90ae-9da90f051200 req-e56b8c52-3cd5-429c-b76b-59f9abda095d service nova] Creating event network-vif-deleted:137f7ed1-df61-44ac-b25d-fb1d5a0609d4 for instance 272fddb0-eba2-4559-b76d-460bd65246ec on n-h2-858094-4 Sep 16 13:00:03.208243 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-c89b5989-c29f-48af-90ae-9da90f051200 req-e56b8c52-3cd5-429c-b76b-59f9abda095d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122809 Sep 16 13:00:03.208742 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1566/3217] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:00:03.224925 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2b1008df-a5a0-4f2c-9728-0f1ba6c3517a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:03.225925 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-2b1008df-a5a0-4f2c-9728-0f1ba6c3517a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:03.672187 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-2b1008df-a5a0-4f2c-9728-0f1ba6c3517a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:03.686122 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2b1008df-a5a0-4f2c-9728-0f1ba6c3517a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 200 len: 1215 microversion: 2.1 time: 0.474173 Sep 16 13:00:03.688703 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1567/3218] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:03 2022] GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 1215 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:03.702825 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e7032d00-24b7-4856-9e33-602a05eb7857 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '.version_select at 0x7f1034ea95e0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:03.748650 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e7032d00-24b7-4856-9e33-602a05eb7857 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1378354979" status: 202 len: 0 microversion: 2.1 time: 0.049399 Sep 16 13:00:03.752594 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1568/3219] 10.222.0.67 () {58 vars in 1221 bytes} [Fri Sep 16 13:00:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1378354979 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:00:04.107891 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d434d897-64e0-4204-9b12-73ed154499bd tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:04.108696 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d434d897-64e0-4204-9b12-73ed154499bd tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: 08836465-8c0f-454b-9e19-8bb6bd44f931] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:04.116682 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d434d897-64e0-4204-9b12-73ed154499bd tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:04.122124 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d434d897-64e0-4204-9b12-73ed154499bd tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:04.122809 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d434d897-64e0-4204-9b12-73ed154499bd tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:04.129204 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d434d897-64e0-4204-9b12-73ed154499bd tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:04.129916 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d434d897-64e0-4204-9b12-73ed154499bd tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:04.130524 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d434d897-64e0-4204-9b12-73ed154499bd tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:04.488611 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d434d897-64e0-4204-9b12-73ed154499bd tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0e6121124d4a15a63ac359bff5aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc3ef4fd0374ac4b74900369ca779aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:04.499798 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d434d897-64e0-4204-9b12-73ed154499bd tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "GET /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931" status: 200 len: 1277 microversion: 2.1 time: 0.396286 Sep 16 13:00:04.500600 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1569/3220] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:04 2022] GET /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931 => generated 1277 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:00:04.725808 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-cfc8aa16-0694-48a7-a307-a19fbfa3942a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:04.727746 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-cfc8aa16-0694-48a7-a307-a19fbfa3942a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:04.753477 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cfc8aa16-0694-48a7-a307-a19fbfa3942a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:04.754002 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cfc8aa16-0694-48a7-a307-a19fbfa3942a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:04.757276 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cfc8aa16-0694-48a7-a307-a19fbfa3942a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:04.758213 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cfc8aa16-0694-48a7-a307-a19fbfa3942a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:04.762129 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cfc8aa16-0694-48a7-a307-a19fbfa3942a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:04.763025 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cfc8aa16-0694-48a7-a307-a19fbfa3942a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:04.872749 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-00d7c54a-da2e-47c9-923c-65dca94ffb02 tempest-FloatingIPsTestJSON-596548026 tempest-FloatingIPsTestJSON-596548026-project] 10.222.0.67 "DELETE /compute/v2.1/os-floating-ips/04003baf-2ba3-4b32-9791-bf4a067f4f01" status: 202 len: 0 microversion: 2.1 time: 5.947720 Sep 16 13:00:04.877489 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1652/3221] 10.222.0.67 () {58 vars in 1263 bytes} [Fri Sep 16 12:59:58 2022] DELETE /compute/v2.1/os-floating-ips/04003baf-2ba3-4b32-9791-bf4a067f4f01 => generated 0 bytes in 5958 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:00:04.900476 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-29838fe5-545d-4818-b7f4-3a1bbacec2d7 tempest-FloatingIPsTestJSON-596548026 tempest-FloatingIPsTestJSON-596548026-project] Calling method '.version_select at 0x7f1034b30b80>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:04.961746 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-cfc8aa16-0694-48a7-a307-a19fbfa3942a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:04.972931 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-cfc8aa16-0694-48a7-a307-a19fbfa3942a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 200 len: 1273 microversion: 2.1 time: 0.255802 Sep 16 13:00:04.980343 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1570/3222] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:04 2022] GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 1273 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:05.113117 n-d-858094-4 devstack@n-api.service[128779]: DEBUG neutronclient.v2_0.client [None req-29838fe5-545d-4818-b7f4-3a1bbacec2d7 tempest-FloatingIPsTestJSON-596548026 tempest-FloatingIPsTestJSON-596548026-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 04003baf-2ba3-4b32-9791-bf4a067f4f01 could not be found", "detail": ""}} {{(pid=128779) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 13:00:05.113835 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-29838fe5-545d-4818-b7f4-3a1bbacec2d7 tempest-FloatingIPsTestJSON-596548026 tempest-FloatingIPsTestJSON-596548026-project] HTTP exception thrown: Floating IP not found for ID 04003baf-2ba3-4b32-9791-bf4a067f4f01 Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-29838fe5-545d-4818-b7f4-3a1bbacec2d7 tempest-FloatingIPsTestJSON-596548026 tempest-FloatingIPsTestJSON-596548026-project] Request method failure captured: Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/os-floating-ips/04003baf-2ba3-4b32-9791-bf4a067f4f01 HTTP/1.1 Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHM4xRq396eGTvDazI3xxqTad_bb5Rnp3Mabks_vXc12WcTk62OdceQRUP4b_jSUuQmn6TjHKhTdFZW4gBdW_Fn4G0B9CtjozNoEfPsV4Sc3QZmi64gOXq0tPWxn13DdYdhyEL5bVcegufgskk_x5B7XxNGOkqpkdc6MLD7mYPKNvIU Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 69c9f8e6296847c49b4016b84b482950 Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-FloatingIPsTestJSON-596548026 Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/69c9f8e6296847c49b4016b84b482950"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/69c9f8e6296847c49b4016b84b482950"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_69c9f8e6296847c49b4016b84b482950", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/69c9f8e6296847c49b4016b84b482950"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-FloatingIPsTestJSON-596548026 Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 69c9f8e6296847c49b4016b84b482950 Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-FloatingIPsTestJSON-596548026 Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-FloatingIPsTestJSON-596548026-project Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 79ab49386ae04c75a3ac788818f36e46 Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-FloatingIPsTestJSON-596548026-project Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: exception: Floating IP not found for ID 04003baf-2ba3-4b32-9791-bf4a067f4f01 Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '04003baf-2ba3-4b32-9791-bf4a067f4f01'} Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 04003baf-2ba3-4b32-9791-bf4a067f4f01 could not be found Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4af27cf4-1e16-40e3-9541-bc96b3de38d4'] Sep 16 13:00:05.115660 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:00:05.120808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:00:05.120808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:00:05.120808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:00:05.120808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 16 13:00:05.120808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 16 13:00:05.120808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 16 13:00:05.120808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 16 13:00:05.120808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 04003baf-2ba3-4b32-9791-bf4a067f4f01. Sep 16 13:00:05.120808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:00:05.120808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:00:05.120808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:00:05.120808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:00:05.120808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:00:05.120808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:00:05.120808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:00:05.120808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:00:05.120808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:00:05.120808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:00:05.120808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:00:05.120808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:00:05.120808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 16 13:00:05.120808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 16 13:00:05.120808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 04003baf-2ba3-4b32-9791-bf4a067f4f01 Sep 16 13:00:05.120808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:00:05.120808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:00:05.120808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:00:05.120808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:00:05.120808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:00:05.120808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:00:05.120808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:00:05.120808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:00:05.120808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 04003baf-2ba3-4b32-9791-bf4a067f4f01 Sep 16 13:00:05.120808 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:00:05.120808 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-29838fe5-545d-4818-b7f4-3a1bbacec2d7 tempest-FloatingIPsTestJSON-596548026 tempest-FloatingIPsTestJSON-596548026-project] Returning 404 to user: Floating IP not found for ID 04003baf-2ba3-4b32-9791-bf4a067f4f01 {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:00:05.120808 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-29838fe5-545d-4818-b7f4-3a1bbacec2d7 tempest-FloatingIPsTestJSON-596548026 tempest-FloatingIPsTestJSON-596548026-project] 10.222.0.67 "GET /compute/v2.1/os-floating-ips/04003baf-2ba3-4b32-9791-bf4a067f4f01" status: 404 len: 111 microversion: 2.1 time: 0.238194 Sep 16 13:00:05.120808 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1653/3223] 10.222.0.67 () {58 vars in 1260 bytes} [Fri Sep 16 13:00:04 2022] GET /compute/v2.1/os-floating-ips/04003baf-2ba3-4b32-9791-bf4a067f4f01 => generated 111 bytes in 240 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:00:05.127549 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-52ac0f54-c67c-4ddf-a7b2-67f782d4e0bf tempest-FloatingIPsTestJSON-596548026 tempest-FloatingIPsTestJSON-596548026-project] Calling method '.version_select at 0x7f1034ea95e0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:05.530934 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-39544498-844d-4c0e-988d-ff594c955d94 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:05.532554 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-39544498-844d-4c0e-988d-ff594c955d94 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: 08836465-8c0f-454b-9e19-8bb6bd44f931] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:05.550209 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39544498-844d-4c0e-988d-ff594c955d94 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:05.552968 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39544498-844d-4c0e-988d-ff594c955d94 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:05.554351 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39544498-844d-4c0e-988d-ff594c955d94 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:05.556543 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39544498-844d-4c0e-988d-ff594c955d94 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:05.559914 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39544498-844d-4c0e-988d-ff594c955d94 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:05.561678 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39544498-844d-4c0e-988d-ff594c955d94 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:06.175062 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-39544498-844d-4c0e-988d-ff594c955d94 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0e6121124d4a15a63ac359bff5aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc3ef4fd0374ac4b74900369ca779aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:06.185413 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-39544498-844d-4c0e-988d-ff594c955d94 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "GET /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931" status: 200 len: 1277 microversion: 2.1 time: 0.664318 Sep 16 13:00:06.198246 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1654/3224] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:05 2022] GET /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931 => generated 1277 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:06.203597 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-06f25d41-7117-48b8-b429-05089dde5cd0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:06.204862 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-06f25d41-7117-48b8-b429-05089dde5cd0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:06.219120 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06f25d41-7117-48b8-b429-05089dde5cd0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:06.221036 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06f25d41-7117-48b8-b429-05089dde5cd0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:06.224787 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06f25d41-7117-48b8-b429-05089dde5cd0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:06.225839 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06f25d41-7117-48b8-b429-05089dde5cd0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:06.226707 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06f25d41-7117-48b8-b429-05089dde5cd0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:06.227335 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06f25d41-7117-48b8-b429-05089dde5cd0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:06.304002 n-d-858094-4 devstack@n-api.service[128780]: DEBUG neutronclient.v2_0.client [None req-52ac0f54-c67c-4ddf-a7b2-67f782d4e0bf tempest-FloatingIPsTestJSON-596548026 tempest-FloatingIPsTestJSON-596548026-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 04003baf-2ba3-4b32-9791-bf4a067f4f01 could not be found", "detail": ""}} {{(pid=128780) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 13:00:06.305383 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-52ac0f54-c67c-4ddf-a7b2-67f782d4e0bf tempest-FloatingIPsTestJSON-596548026 tempest-FloatingIPsTestJSON-596548026-project] HTTP exception thrown: Floating IP not found for ID 04003baf-2ba3-4b32-9791-bf4a067f4f01 Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-52ac0f54-c67c-4ddf-a7b2-67f782d4e0bf tempest-FloatingIPsTestJSON-596548026 tempest-FloatingIPsTestJSON-596548026-project] Request method failure captured: Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: request: DELETE /compute/v2.1/os-floating-ips/04003baf-2ba3-4b32-9791-bf4a067f4f01 HTTP/1.1 Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHM4xRq396eGTvDazI3xxqTad_bb5Rnp3Mabks_vXc12WcTk62OdceQRUP4b_jSUuQmn6TjHKhTdFZW4gBdW_Fn4G0B9CtjozNoEfPsV4Sc3QZmi64gOXq0tPWxn13DdYdhyEL5bVcegufgskk_x5B7XxNGOkqpkdc6MLD7mYPKNvIU Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 69c9f8e6296847c49b4016b84b482950 Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-FloatingIPsTestJSON-596548026 Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/69c9f8e6296847c49b4016b84b482950"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/69c9f8e6296847c49b4016b84b482950"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_69c9f8e6296847c49b4016b84b482950", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/69c9f8e6296847c49b4016b84b482950"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-FloatingIPsTestJSON-596548026 Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 69c9f8e6296847c49b4016b84b482950 Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-FloatingIPsTestJSON-596548026 Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-FloatingIPsTestJSON-596548026-project Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 79ab49386ae04c75a3ac788818f36e46 Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-FloatingIPsTestJSON-596548026-project Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: exception: Floating IP not found for ID 04003baf-2ba3-4b32-9791-bf4a067f4f01 Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '04003baf-2ba3-4b32-9791-bf4a067f4f01'} Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 04003baf-2ba3-4b32-9791-bf4a067f4f01 could not be found Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-16ae9d3d-9a4b-4239-86a3-c306e6c2fddf'] Sep 16 13:00:06.307775 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:00:06.312827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:00:06.312827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:00:06.312827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:00:06.312827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 16 13:00:06.312827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 16 13:00:06.312827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 16 13:00:06.312827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 16 13:00:06.312827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 04003baf-2ba3-4b32-9791-bf4a067f4f01. Sep 16 13:00:06.312827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:00:06.312827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:00:06.312827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:00:06.312827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:00:06.312827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:00:06.312827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:00:06.312827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:00:06.312827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:00:06.312827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:00:06.312827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:00:06.312827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:00:06.312827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:00:06.312827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 16 13:00:06.312827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 16 13:00:06.312827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 04003baf-2ba3-4b32-9791-bf4a067f4f01 Sep 16 13:00:06.312827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:00:06.312827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:00:06.312827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:00:06.312827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:00:06.312827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:00:06.312827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:00:06.312827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:00:06.312827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:00:06.312827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 04003baf-2ba3-4b32-9791-bf4a067f4f01 Sep 16 13:00:06.312827 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:00:06.317295 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-52ac0f54-c67c-4ddf-a7b2-67f782d4e0bf tempest-FloatingIPsTestJSON-596548026 tempest-FloatingIPsTestJSON-596548026-project] Returning 404 to user: Floating IP not found for ID 04003baf-2ba3-4b32-9791-bf4a067f4f01 {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:00:06.318453 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-52ac0f54-c67c-4ddf-a7b2-67f782d4e0bf tempest-FloatingIPsTestJSON-596548026 tempest-FloatingIPsTestJSON-596548026-project] 10.222.0.67 "DELETE /compute/v2.1/os-floating-ips/04003baf-2ba3-4b32-9791-bf4a067f4f01" status: 404 len: 111 microversion: 2.1 time: 1.195051 Sep 16 13:00:06.319209 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1571/3225] 10.222.0.67 () {58 vars in 1263 bytes} [Fri Sep 16 13:00:05 2022] DELETE /compute/v2.1/os-floating-ips/04003baf-2ba3-4b32-9791-bf4a067f4f01 => generated 111 bytes in 1196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:00:06.554717 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-06f25d41-7117-48b8-b429-05089dde5cd0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:06.563959 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-06f25d41-7117-48b8-b429-05089dde5cd0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 200 len: 1273 microversion: 2.1 time: 0.371803 Sep 16 13:00:06.564578 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1655/3226] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:06 2022] GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 1273 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:06.711230 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2bad2227-cfb8-4033-a4f6-fd8a5074e43b tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Action: 'create', calling method: .version_select at 0x7f1039a91790>, body: {"keypair": {"name": "tempest-keypair-292398918", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQCR3yXDfHneaohDNciCHoJRRdJKPL7fwth+mL9dMahL6cocIeJL+IMtWU4V2OqHBRjuCY9BZFLK/wHEOJX2Lvz6GrcRqRsIRJvQJuKVjTXshHlE9B0fDbnoXkBf72NkA=="}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:00:06.730414 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-2bad2227-cfb8-4033-a4f6-fd8a5074e43b tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Getting quotas for project bdbc66ae4c664cd18af4bad57bbf12c4. Resources: {'key_pairs'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:00:06.738401 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:00:06.745495 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-2bad2227-cfb8-4033-a4f6-fd8a5074e43b tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Getting quotas for user ae41c8e822064e3dad16dbce0a3bcc5b and project bdbc66ae4c664cd18af4bad57bbf12c4. Resources: {'key_pairs'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:00:06.792172 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2bad2227-cfb8-4033-a4f6-fd8a5074e43b tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.084143 Sep 16 13:00:06.795589 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1572/3227] 10.222.0.67 () {62 vars in 1200 bytes} [Fri Sep 16 13:00:06 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 91 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 16 13:00:07.212593 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-032bf9e4-f66a-4be5-95f0-6ecb951f53ab tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:07.213186 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-032bf9e4-f66a-4be5-95f0-6ecb951f53ab tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: 08836465-8c0f-454b-9e19-8bb6bd44f931] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:07.221994 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-032bf9e4-f66a-4be5-95f0-6ecb951f53ab tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:07.222843 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-032bf9e4-f66a-4be5-95f0-6ecb951f53ab tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:07.223770 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-032bf9e4-f66a-4be5-95f0-6ecb951f53ab tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:07.225002 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-032bf9e4-f66a-4be5-95f0-6ecb951f53ab tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:07.225621 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-032bf9e4-f66a-4be5-95f0-6ecb951f53ab tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:07.226231 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-032bf9e4-f66a-4be5-95f0-6ecb951f53ab tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:07.592943 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e9ecc8c5-fb23-4469-991b-2d65002d27de tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:07.594196 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e9ecc8c5-fb23-4469-991b-2d65002d27de tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:07.621762 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e9ecc8c5-fb23-4469-991b-2d65002d27de tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:07.622539 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e9ecc8c5-fb23-4469-991b-2d65002d27de tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:07.623134 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e9ecc8c5-fb23-4469-991b-2d65002d27de tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:07.625420 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e9ecc8c5-fb23-4469-991b-2d65002d27de tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:07.625912 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e9ecc8c5-fb23-4469-991b-2d65002d27de tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:07.626343 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e9ecc8c5-fb23-4469-991b-2d65002d27de tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:07.651013 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:00:07.942494 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e9ecc8c5-fb23-4469-991b-2d65002d27de tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:07.954794 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e9ecc8c5-fb23-4469-991b-2d65002d27de tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 200 len: 1273 microversion: 2.1 time: 0.367700 Sep 16 13:00:07.955581 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1573/3228] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:07 2022] GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 1273 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:00:08.279243 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-032bf9e4-f66a-4be5-95f0-6ecb951f53ab tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0e6121124d4a15a63ac359bff5aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc3ef4fd0374ac4b74900369ca779aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:08.289087 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-032bf9e4-f66a-4be5-95f0-6ecb951f53ab tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "GET /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931" status: 200 len: 1319 microversion: 2.1 time: 1.080492 Sep 16 13:00:08.290246 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1656/3229] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:07 2022] GET /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931 => generated 1319 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:08.980067 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-265d381d-049a-45d6-891e-a8accccce7c5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:08.981727 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-265d381d-049a-45d6-891e-a8accccce7c5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:08.999656 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-265d381d-049a-45d6-891e-a8accccce7c5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:09.001870 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-265d381d-049a-45d6-891e-a8accccce7c5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:09.002423 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-265d381d-049a-45d6-891e-a8accccce7c5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:09.003201 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-265d381d-049a-45d6-891e-a8accccce7c5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:09.003656 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-265d381d-049a-45d6-891e-a8accccce7c5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:09.008643 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-265d381d-049a-45d6-891e-a8accccce7c5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:09.312654 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-85463719-2815-459c-a8f2-c951c53d096b tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:09.313282 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-85463719-2815-459c-a8f2-c951c53d096b tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: 08836465-8c0f-454b-9e19-8bb6bd44f931] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:09.320594 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-85463719-2815-459c-a8f2-c951c53d096b tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:09.321320 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-85463719-2815-459c-a8f2-c951c53d096b tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:09.321963 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-85463719-2815-459c-a8f2-c951c53d096b tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:09.323048 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-85463719-2815-459c-a8f2-c951c53d096b tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:09.323671 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-85463719-2815-459c-a8f2-c951c53d096b tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:09.324450 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-85463719-2815-459c-a8f2-c951c53d096b tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:10.122589 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-85463719-2815-459c-a8f2-c951c53d096b tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0e6121124d4a15a63ac359bff5aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc3ef4fd0374ac4b74900369ca779aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:10.124754 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-265d381d-049a-45d6-891e-a8accccce7c5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:10.140450 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-265d381d-049a-45d6-891e-a8accccce7c5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 200 len: 1315 microversion: 2.1 time: 1.164502 Sep 16 13:00:10.141638 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1574/3230] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:08 2022] GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 1315 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:10.149279 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-85463719-2815-459c-a8f2-c951c53d096b tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "GET /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931" status: 200 len: 1319 microversion: 2.1 time: 0.840786 Sep 16 13:00:10.153102 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1657/3231] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:09 2022] GET /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931 => generated 1319 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:10.176962 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-19c5a9b2-36e9-4334-ad43-5ef44f3e50bb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-567758343", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "5fe80c07-1468-4c04-9291-5fbc50b9c34f"}, {"port": "96ec0261-1181-470b-971b-163682a9e81d", "tag": "port-1"}, {"port": "9b032a10-f56e-47fc-b941-54f12778f01c", "tag": "port-2"}, {"uuid": "cbc422c8-d561-47f7-afec-ef049a9a76c5", "tag": "net-1"}, {"uuid": "cbc422c8-d561-47f7-afec-ef049a9a76c5"}, {"uuid": "231c3494-8d9a-44ba-b103-fc49819648f0", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "231c3494-8d9a-44ba-b103-fc49819648f0", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "8124889a-1324-4f5c-be49-affae661794d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "f41a9fbd-22b0-4f49-9820-d776f1d510eb", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "ee7d26c2-8d83-4349-9c2e-9ac832b61a91", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--516841147"}], "key_name": "tempest-keypair-292398918", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:00:11.166654 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5d1a413f-3587-4d22-b3db-c97c9816e3fa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:11.168272 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5d1a413f-3587-4d22-b3db-c97c9816e3fa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:11.182101 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d1a413f-3587-4d22-b3db-c97c9816e3fa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:11.182888 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d1a413f-3587-4d22-b3db-c97c9816e3fa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:11.183508 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d1a413f-3587-4d22-b3db-c97c9816e3fa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:11.188274 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d1a413f-3587-4d22-b3db-c97c9816e3fa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:11.188966 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d1a413f-3587-4d22-b3db-c97c9816e3fa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:11.189617 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d1a413f-3587-4d22-b3db-c97c9816e3fa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:11.707908 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-19c5a9b2-36e9-4334-ad43-5ef44f3e50bb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] validate_networks() for [('5fe80c07-1468-4c04-9291-5fbc50b9c34f', None, None, None, None, None), (None, None, '96ec0261-1181-470b-971b-163682a9e81d', None, None, None), (None, None, '9b032a10-f56e-47fc-b941-54f12778f01c', None, None, None), ('cbc422c8-d561-47f7-afec-ef049a9a76c5', None, None, None, None, None), ('cbc422c8-d561-47f7-afec-ef049a9a76c5', None, None, None, None, None), ('231c3494-8d9a-44ba-b103-fc49819648f0', '10.2.2.100', None, None, None, None), ('231c3494-8d9a-44ba-b103-fc49819648f0', '10.2.2.200', None, None, None, None)] {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:00:12.505439 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=4 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:00:12.518707 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5d1a413f-3587-4d22-b3db-c97c9816e3fa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:12.537330 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5d1a413f-3587-4d22-b3db-c97c9816e3fa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 200 len: 1315 microversion: 2.1 time: 1.374404 Sep 16 13:00:12.537856 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1658/3232] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:11 2022] GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 1315 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:00:12.554523 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d1a110f5-c80f-4473-ba32-f7ecad564ff0 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:12.555143 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d1a110f5-c80f-4473-ba32-f7ecad564ff0 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: 08836465-8c0f-454b-9e19-8bb6bd44f931] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:12.573468 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1a110f5-c80f-4473-ba32-f7ecad564ff0 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:12.574804 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1a110f5-c80f-4473-ba32-f7ecad564ff0 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:12.575566 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1a110f5-c80f-4473-ba32-f7ecad564ff0 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:12.576444 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1a110f5-c80f-4473-ba32-f7ecad564ff0 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:12.577204 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1a110f5-c80f-4473-ba32-f7ecad564ff0 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:12.578003 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1a110f5-c80f-4473-ba32-f7ecad564ff0 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:13.308412 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d1a110f5-c80f-4473-ba32-f7ecad564ff0 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0e6121124d4a15a63ac359bff5aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc3ef4fd0374ac4b74900369ca779aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:13.325886 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d1a110f5-c80f-4473-ba32-f7ecad564ff0 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "GET /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931" status: 200 len: 1319 microversion: 2.1 time: 0.785267 Sep 16 13:00:13.329834 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1659/3233] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:12 2022] GET /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931 => generated 1319 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:13.561986 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-40f160fa-4e07-42b3-b6a9-26cf9d2ef763 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:13.563208 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-40f160fa-4e07-42b3-b6a9-26cf9d2ef763 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:13.585135 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40f160fa-4e07-42b3-b6a9-26cf9d2ef763 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:13.585824 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40f160fa-4e07-42b3-b6a9-26cf9d2ef763 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:13.587101 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40f160fa-4e07-42b3-b6a9-26cf9d2ef763 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:13.589781 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40f160fa-4e07-42b3-b6a9-26cf9d2ef763 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:13.592286 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40f160fa-4e07-42b3-b6a9-26cf9d2ef763 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:13.595138 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40f160fa-4e07-42b3-b6a9-26cf9d2ef763 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:15.323636 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-40f160fa-4e07-42b3-b6a9-26cf9d2ef763 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:15.334759 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-40f160fa-4e07-42b3-b6a9-26cf9d2ef763 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 200 len: 1315 microversion: 2.1 time: 1.777909 Sep 16 13:00:15.340825 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1660/3234] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:13 2022] GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 1315 bytes in 1784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:15.360948 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ce87cc4a-a179-4767-91e7-621132225656 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:15.362744 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ce87cc4a-a179-4767-91e7-621132225656 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: 08836465-8c0f-454b-9e19-8bb6bd44f931] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:15.378401 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce87cc4a-a179-4767-91e7-621132225656 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:15.379287 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce87cc4a-a179-4767-91e7-621132225656 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:15.380059 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce87cc4a-a179-4767-91e7-621132225656 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:15.381266 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce87cc4a-a179-4767-91e7-621132225656 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:15.381990 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce87cc4a-a179-4767-91e7-621132225656 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:15.382652 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce87cc4a-a179-4767-91e7-621132225656 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:16.216300 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ce87cc4a-a179-4767-91e7-621132225656 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0e6121124d4a15a63ac359bff5aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc3ef4fd0374ac4b74900369ca779aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:16.229185 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ce87cc4a-a179-4767-91e7-621132225656 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "GET /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931" status: 200 len: 1319 microversion: 2.1 time: 0.884735 Sep 16 13:00:16.230142 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1661/3235] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:15 2022] GET /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931 => generated 1319 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:16.256994 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-11c1fb1f-4bae-4e7a-a10d-e71571213a32 req-7862ad94-4935-4082-ae98-cbcacb8506b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08836465-8c0f-454b-9e19-8bb6bd44f931", "tag": "49603217-44ca-43b5-b254-906cf820af9e"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:00:16.283980 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-11c1fb1f-4bae-4e7a-a10d-e71571213a32 req-7862ad94-4935-4082-ae98-cbcacb8506b4 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:16.284716 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-11c1fb1f-4bae-4e7a-a10d-e71571213a32 req-7862ad94-4935-4082-ae98-cbcacb8506b4 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:16.286183 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-11c1fb1f-4bae-4e7a-a10d-e71571213a32 req-7862ad94-4935-4082-ae98-cbcacb8506b4 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:16.326539 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-11c1fb1f-4bae-4e7a-a10d-e71571213a32 req-7862ad94-4935-4082-ae98-cbcacb8506b4 service nova] Creating event network-changed:49603217-44ca-43b5-b254-906cf820af9e for instance 08836465-8c0f-454b-9e19-8bb6bd44f931 on n-h1-858094-4 Sep 16 13:00:16.342304 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-11c1fb1f-4bae-4e7a-a10d-e71571213a32 req-7862ad94-4935-4082-ae98-cbcacb8506b4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104327 Sep 16 13:00:16.344883 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1662/3236] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:00:16.361028 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2079f39f-d7e8-4c26-b68b-679110a95611 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:16.365444 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2079f39f-d7e8-4c26-b68b-679110a95611 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 272fddb0-eba2-4559-b76d-460bd65246ec] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:16.385486 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2079f39f-d7e8-4c26-b68b-679110a95611 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:16.386663 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2079f39f-d7e8-4c26-b68b-679110a95611 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:16.390513 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2079f39f-d7e8-4c26-b68b-679110a95611 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:16.394539 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2079f39f-d7e8-4c26-b68b-679110a95611 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:16.396306 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2079f39f-d7e8-4c26-b68b-679110a95611 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:16.397072 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2079f39f-d7e8-4c26-b68b-679110a95611 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:16.460032 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-2079f39f-d7e8-4c26-b68b-679110a95611 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] HTTP exception thrown: Instance 272fddb0-eba2-4559-b76d-460bd65246ec could not be found. Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2079f39f-d7e8-4c26-b68b-679110a95611 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Request method failure captured: Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec HTTP/1.1 Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHG3SwHS-l0WitPOzDSYA44CeJXLIzVxgr-MHeRUPHLkCmQshOXungF3JmTqRR5iusdVZCtU5BHnBL7LOCSV4K_6utRyxrplivDCcD85IiEW1gN4Yw9gJp7Mrm5YkkjyT9tJc58fqahkRyPfD_CsC349BMa6OwVpDa780GBoFo4Gi0E Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 7a67136b9d8041fd8e62a81be2d6b48d Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-AttachVolumeTestJSON-2140946303 Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7a67136b9d8041fd8e62a81be2d6b48d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7a67136b9d8041fd8e62a81be2d6b48d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7a67136b9d8041fd8e62a81be2d6b48d", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7a67136b9d8041fd8e62a81be2d6b48d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-AttachVolumeTestJSON-2140946303 Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 7a67136b9d8041fd8e62a81be2d6b48d Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2140946303 Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-AttachVolumeTestJSON-2140946303-project Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 65566509bf544a398cbb9c29ace613c5 Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-AttachVolumeTestJSON-2140946303-project Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 272fddb0-eba2-4559-b76d-460bd65246ec could not be found. Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '272fddb0-eba2-4559-b76d-460bd65246ec'} Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 272fddb0-eba2-4559-b76d-460bd65246ec could not be found. Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:00:16.465710 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:00:16.470039 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 272fddb0-eba2-4559-b76d-460bd65246ec could not be found. Sep 16 13:00:16.470039 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:00:16.470039 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:00:16.470039 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:00:16.470039 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:00:16.470039 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:00:16.470039 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:00:16.470039 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:00:16.470039 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:00:16.470039 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 272fddb0-eba2-4559-b76d-460bd65246ec could not be found. Sep 16 13:00:16.470039 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:00:16.480521 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2079f39f-d7e8-4c26-b68b-679110a95611 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Returning 404 to user: Instance 272fddb0-eba2-4559-b76d-460bd65246ec could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:00:16.482741 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2079f39f-d7e8-4c26-b68b-679110a95611 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "DELETE /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec" status: 404 len: 111 microversion: 2.1 time: 0.135488 Sep 16 13:00:16.484109 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1663/3237] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 13:00:16 2022] DELETE /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:00:16.491581 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6d6ce155-5ccd-47a2-9b25-83292c70b881 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:16.493089 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6d6ce155-5ccd-47a2-9b25-83292c70b881 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:16.502428 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d6ce155-5ccd-47a2-9b25-83292c70b881 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:16.503156 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d6ce155-5ccd-47a2-9b25-83292c70b881 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:16.503604 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d6ce155-5ccd-47a2-9b25-83292c70b881 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:16.504349 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d6ce155-5ccd-47a2-9b25-83292c70b881 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:16.504813 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d6ce155-5ccd-47a2-9b25-83292c70b881 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:16.505244 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d6ce155-5ccd-47a2-9b25-83292c70b881 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:16.759550 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=20 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:00:17.630894 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6d6ce155-5ccd-47a2-9b25-83292c70b881 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:17.647028 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6d6ce155-5ccd-47a2-9b25-83292c70b881 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 200 len: 1315 microversion: 2.1 time: 1.161076 Sep 16 13:00:17.648284 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1664/3238] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:16 2022] GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 1315 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:17.655263 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cf0f8322-dfb9-4341-b1e3-091a723ef7c6 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:17.656100 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cf0f8322-dfb9-4341-b1e3-091a723ef7c6 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 272fddb0-eba2-4559-b76d-460bd65246ec] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:17.664918 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf0f8322-dfb9-4341-b1e3-091a723ef7c6 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:17.665725 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf0f8322-dfb9-4341-b1e3-091a723ef7c6 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:17.666373 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf0f8322-dfb9-4341-b1e3-091a723ef7c6 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:17.667920 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf0f8322-dfb9-4341-b1e3-091a723ef7c6 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:17.669114 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf0f8322-dfb9-4341-b1e3-091a723ef7c6 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:17.670127 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf0f8322-dfb9-4341-b1e3-091a723ef7c6 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:17.688060 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-cf0f8322-dfb9-4341-b1e3-091a723ef7c6 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] HTTP exception thrown: Instance 272fddb0-eba2-4559-b76d-460bd65246ec could not be found. Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cf0f8322-dfb9-4341-b1e3-091a723ef7c6 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Request method failure captured: Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec HTTP/1.1 Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHG3SwHS-l0WitPOzDSYA44CeJXLIzVxgr-MHeRUPHLkCmQshOXungF3JmTqRR5iusdVZCtU5BHnBL7LOCSV4K_6utRyxrplivDCcD85IiEW1gN4Yw9gJp7Mrm5YkkjyT9tJc58fqahkRyPfD_CsC349BMa6OwVpDa780GBoFo4Gi0E Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 7a67136b9d8041fd8e62a81be2d6b48d Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-AttachVolumeTestJSON-2140946303 Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7a67136b9d8041fd8e62a81be2d6b48d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7a67136b9d8041fd8e62a81be2d6b48d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7a67136b9d8041fd8e62a81be2d6b48d", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7a67136b9d8041fd8e62a81be2d6b48d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-AttachVolumeTestJSON-2140946303 Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 7a67136b9d8041fd8e62a81be2d6b48d Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2140946303 Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-AttachVolumeTestJSON-2140946303-project Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 65566509bf544a398cbb9c29ace613c5 Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-AttachVolumeTestJSON-2140946303-project Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 272fddb0-eba2-4559-b76d-460bd65246ec could not be found. Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '272fddb0-eba2-4559-b76d-460bd65246ec'} Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 272fddb0-eba2-4559-b76d-460bd65246ec could not be found. Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 272fddb0-eba2-4559-b76d-460bd65246ec could not be found. Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:00:17.691895 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:00:17.696561 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:00:17.696561 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:00:17.696561 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:00:17.696561 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:00:17.696561 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:00:17.696561 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 272fddb0-eba2-4559-b76d-460bd65246ec could not be found. Sep 16 13:00:17.696561 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:00:17.709072 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cf0f8322-dfb9-4341-b1e3-091a723ef7c6 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Returning 404 to user: Instance 272fddb0-eba2-4559-b76d-460bd65246ec could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:00:17.712007 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cf0f8322-dfb9-4341-b1e3-091a723ef7c6 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec" status: 404 len: 111 microversion: 2.1 time: 0.060901 Sep 16 13:00:17.734921 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1665/3239] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:17 2022] GET /compute/v2.1/servers/272fddb0-eba2-4559-b76d-460bd65246ec => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:00:17.749493 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dcc6b82d-9e64-4c9e-8489-5388452a5dbc tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:17.753290 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dcc6b82d-9e64-4c9e-8489-5388452a5dbc tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: 08836465-8c0f-454b-9e19-8bb6bd44f931] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:17.763659 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dcc6b82d-9e64-4c9e-8489-5388452a5dbc tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:17.764202 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dcc6b82d-9e64-4c9e-8489-5388452a5dbc tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:17.764656 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dcc6b82d-9e64-4c9e-8489-5388452a5dbc tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:17.765376 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dcc6b82d-9e64-4c9e-8489-5388452a5dbc tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:17.765841 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dcc6b82d-9e64-4c9e-8489-5388452a5dbc tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:17.766274 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dcc6b82d-9e64-4c9e-8489-5388452a5dbc tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:18.345550 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dcc6b82d-9e64-4c9e-8489-5388452a5dbc tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0e6121124d4a15a63ac359bff5aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc3ef4fd0374ac4b74900369ca779aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:18.353483 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dcc6b82d-9e64-4c9e-8489-5388452a5dbc tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "GET /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931" status: 200 len: 1319 microversion: 2.1 time: 0.614516 Sep 16 13:00:18.356468 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1666/3240] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:17 2022] GET /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931 => generated 1319 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:18.408287 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-659334d9-9fba-40a7-bbcd-fc0316cec4d6 req-3ff0e9eb-347d-4391-a347-4656e3a1fe12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "464c1886-1201-4b29-b61a-727d5c9e22b6", "tag": "116c6c97-9499-4c0e-861c-371e4ecf4ba2"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:00:18.427797 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-659334d9-9fba-40a7-bbcd-fc0316cec4d6 req-3ff0e9eb-347d-4391-a347-4656e3a1fe12 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:18.428311 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-659334d9-9fba-40a7-bbcd-fc0316cec4d6 req-3ff0e9eb-347d-4391-a347-4656e3a1fe12 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:18.431021 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-659334d9-9fba-40a7-bbcd-fc0316cec4d6 req-3ff0e9eb-347d-4391-a347-4656e3a1fe12 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:18.464659 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-659334d9-9fba-40a7-bbcd-fc0316cec4d6 req-3ff0e9eb-347d-4391-a347-4656e3a1fe12 service nova] Creating event network-changed:116c6c97-9499-4c0e-861c-371e4ecf4ba2 for instance 464c1886-1201-4b29-b61a-727d5c9e22b6 on n-h2-858094-4 Sep 16 13:00:18.474026 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-659334d9-9fba-40a7-bbcd-fc0316cec4d6 req-3ff0e9eb-347d-4391-a347-4656e3a1fe12 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069819 Sep 16 13:00:18.479179 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1667/3241] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:00:18.675210 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fa8b5d6c-f4f1-449d-97a2-f2f4e6945622 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:18.675914 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fa8b5d6c-f4f1-449d-97a2-f2f4e6945622 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:18.685117 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa8b5d6c-f4f1-449d-97a2-f2f4e6945622 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:18.685618 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa8b5d6c-f4f1-449d-97a2-f2f4e6945622 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:18.686064 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa8b5d6c-f4f1-449d-97a2-f2f4e6945622 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:18.686781 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa8b5d6c-f4f1-449d-97a2-f2f4e6945622 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:18.687383 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa8b5d6c-f4f1-449d-97a2-f2f4e6945622 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:18.687666 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa8b5d6c-f4f1-449d-97a2-f2f4e6945622 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:19.141014 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fa8b5d6c-f4f1-449d-97a2-f2f4e6945622 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:19.154615 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fa8b5d6c-f4f1-449d-97a2-f2f4e6945622 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 200 len: 1315 microversion: 2.1 time: 0.483781 Sep 16 13:00:19.160886 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1668/3242] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:18 2022] GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 1315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:00:19.401307 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8f0690f1-fe4b-4951-9c08-eb2d9fb0237a tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:19.402236 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8f0690f1-fe4b-4951-9c08-eb2d9fb0237a tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: 08836465-8c0f-454b-9e19-8bb6bd44f931] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:19.429698 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f0690f1-fe4b-4951-9c08-eb2d9fb0237a tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:19.432633 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f0690f1-fe4b-4951-9c08-eb2d9fb0237a tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:19.433071 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f0690f1-fe4b-4951-9c08-eb2d9fb0237a tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:19.433920 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f0690f1-fe4b-4951-9c08-eb2d9fb0237a tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:19.434405 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f0690f1-fe4b-4951-9c08-eb2d9fb0237a tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:19.444706 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f0690f1-fe4b-4951-9c08-eb2d9fb0237a tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:19.973012 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8f0690f1-fe4b-4951-9c08-eb2d9fb0237a tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0e6121124d4a15a63ac359bff5aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc3ef4fd0374ac4b74900369ca779aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:19.982056 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8f0690f1-fe4b-4951-9c08-eb2d9fb0237a tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "GET /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931" status: 200 len: 1319 microversion: 2.1 time: 0.606387 Sep 16 13:00:19.982658 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1669/3243] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:19 2022] GET /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931 => generated 1319 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:20.130677 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=9 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:00:20.186177 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-12150116-fa4b-455a-a11d-1e1dcbe18be9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:20.186840 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-12150116-fa4b-455a-a11d-1e1dcbe18be9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:20.201379 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12150116-fa4b-455a-a11d-1e1dcbe18be9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:20.202002 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12150116-fa4b-455a-a11d-1e1dcbe18be9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:20.202459 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12150116-fa4b-455a-a11d-1e1dcbe18be9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:20.203214 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12150116-fa4b-455a-a11d-1e1dcbe18be9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:20.203678 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12150116-fa4b-455a-a11d-1e1dcbe18be9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:20.204288 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12150116-fa4b-455a-a11d-1e1dcbe18be9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:21.447010 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-12150116-fa4b-455a-a11d-1e1dcbe18be9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:21.464884 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:00:21.471429 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-12150116-fa4b-455a-a11d-1e1dcbe18be9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 200 len: 1315 microversion: 2.1 time: 1.289523 Sep 16 13:00:21.474768 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1670/3244] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:20 2022] GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 1315 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:21.494961 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0ce15b27-b37c-4bb1-869c-f0a0747a3cd7 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:21.505596 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0ce15b27-b37c-4bb1-869c-f0a0747a3cd7 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: 08836465-8c0f-454b-9e19-8bb6bd44f931] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:21.529110 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ce15b27-b37c-4bb1-869c-f0a0747a3cd7 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:21.532531 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ce15b27-b37c-4bb1-869c-f0a0747a3cd7 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:21.533258 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ce15b27-b37c-4bb1-869c-f0a0747a3cd7 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:21.535516 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ce15b27-b37c-4bb1-869c-f0a0747a3cd7 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:21.536921 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ce15b27-b37c-4bb1-869c-f0a0747a3cd7 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:21.540957 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ce15b27-b37c-4bb1-869c-f0a0747a3cd7 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:21.585650 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-19c5a9b2-36e9-4334-ad43-5ef44f3e50bb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:00:21.586941 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-19c5a9b2-36e9-4334-ad43-5ef44f3e50bb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:00:21.587717 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-19c5a9b2-36e9-4334-ad43-5ef44f3e50bb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:00:21.588417 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-19c5a9b2-36e9-4334-ad43-5ef44f3e50bb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:00:21.589049 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-19c5a9b2-36e9-4334-ad43-5ef44f3e50bb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:00:21.615967 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19c5a9b2-36e9-4334-ad43-5ef44f3e50bb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:21.624402 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19c5a9b2-36e9-4334-ad43-5ef44f3e50bb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:21.626508 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19c5a9b2-36e9-4334-ad43-5ef44f3e50bb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:21.628990 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19c5a9b2-36e9-4334-ad43-5ef44f3e50bb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:21.645768 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19c5a9b2-36e9-4334-ad43-5ef44f3e50bb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:21.648521 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-19c5a9b2-36e9-4334-ad43-5ef44f3e50bb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:21.733315 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-19c5a9b2-36e9-4334-ad43-5ef44f3e50bb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Getting quotas for project bdbc66ae4c664cd18af4bad57bbf12c4. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:00:21.740594 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-19c5a9b2-36e9-4334-ad43-5ef44f3e50bb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Getting quotas for user ae41c8e822064e3dad16dbce0a3bcc5b and project bdbc66ae4c664cd18af4bad57bbf12c4. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:00:22.039076 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0ce15b27-b37c-4bb1-869c-f0a0747a3cd7 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0e6121124d4a15a63ac359bff5aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc3ef4fd0374ac4b74900369ca779aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:22.046393 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-19c5a9b2-36e9-4334-ad43-5ef44f3e50bb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:00:22.050209 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-19c5a9b2-36e9-4334-ad43-5ef44f3e50bb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='8124889a-1324-4f5c-be49-affae661794d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='f41a9fbd-22b0-4f49-9820-d776f1d510eb',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ee7d26c2-8d83-4349-9c2e-9ac832b61a91',volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:00:22.051622 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0ce15b27-b37c-4bb1-869c-f0a0747a3cd7 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "GET /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931" status: 200 len: 1319 microversion: 2.1 time: 0.573689 Sep 16 13:00:22.054544 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1671/3245] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:21 2022] GET /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931 => generated 1319 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:22.232496 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0c9d7277-de23-4633-af2c-2286e40f588f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:22.233111 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0c9d7277-de23-4633-af2c-2286e40f588f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:22.244584 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c9d7277-de23-4633-af2c-2286e40f588f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:22.248222 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c9d7277-de23-4633-af2c-2286e40f588f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:22.249151 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c9d7277-de23-4633-af2c-2286e40f588f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:22.250200 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c9d7277-de23-4633-af2c-2286e40f588f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:22.251437 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c9d7277-de23-4633-af2c-2286e40f588f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:22.252636 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c9d7277-de23-4633-af2c-2286e40f588f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:22.286542 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-0c9d7277-de23-4633-af2c-2286e40f588f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] HTTP exception thrown: Instance 9ad8536a-46b8-4821-8fb0-2c743927bb88 could not be found. Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0c9d7277-de23-4633-af2c-2286e40f588f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Request method failure captured: Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 HTTP/1.1 Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHG3SwHS-l0WitPOzDSYA44CeJXLIzVxgr-MHeRUPHLkCmQshOXungF3JmTqRR5iusdVZCtU5BHnBL7LOCSV4K_6utRyxrplivDCcD85IiEW1gN4Yw9gJp7Mrm5YkkjyT9tJc58fqahkRyPfD_CsC349BMa6OwVpDa780GBoFo4Gi0E Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 7a67136b9d8041fd8e62a81be2d6b48d Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-AttachVolumeTestJSON-2140946303 Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7a67136b9d8041fd8e62a81be2d6b48d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7a67136b9d8041fd8e62a81be2d6b48d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7a67136b9d8041fd8e62a81be2d6b48d", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7a67136b9d8041fd8e62a81be2d6b48d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-AttachVolumeTestJSON-2140946303 Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 7a67136b9d8041fd8e62a81be2d6b48d Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2140946303 Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-AttachVolumeTestJSON-2140946303-project Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 65566509bf544a398cbb9c29ace613c5 Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-AttachVolumeTestJSON-2140946303-project Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 9ad8536a-46b8-4821-8fb0-2c743927bb88 could not be found. Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '9ad8536a-46b8-4821-8fb0-2c743927bb88'} Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ad8536a-46b8-4821-8fb0-2c743927bb88 could not be found. Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:00:22.297184 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:00:22.306256 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ad8536a-46b8-4821-8fb0-2c743927bb88 could not be found. Sep 16 13:00:22.306256 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:00:22.306256 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:00:22.306256 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:00:22.306256 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:00:22.306256 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:00:22.306256 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:00:22.306256 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:00:22.306256 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:00:22.306256 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ad8536a-46b8-4821-8fb0-2c743927bb88 could not be found. Sep 16 13:00:22.306256 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:00:22.306256 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0c9d7277-de23-4633-af2c-2286e40f588f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Returning 404 to user: Instance 9ad8536a-46b8-4821-8fb0-2c743927bb88 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:00:22.306256 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0c9d7277-de23-4633-af2c-2286e40f588f tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "DELETE /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 404 len: 111 microversion: 2.1 time: 0.073720 Sep 16 13:00:22.306256 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1672/3246] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 13:00:22 2022] DELETE /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:00:22.310745 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0372c398-f70a-4652-9484-c04aaf29bad4 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:22.319094 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0372c398-f70a-4652-9484-c04aaf29bad4 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] [instance: 9ad8536a-46b8-4821-8fb0-2c743927bb88] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:22.341387 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0372c398-f70a-4652-9484-c04aaf29bad4 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:22.342091 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0372c398-f70a-4652-9484-c04aaf29bad4 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:22.342717 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0372c398-f70a-4652-9484-c04aaf29bad4 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:22.343646 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0372c398-f70a-4652-9484-c04aaf29bad4 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:22.344654 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0372c398-f70a-4652-9484-c04aaf29bad4 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:22.345412 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0372c398-f70a-4652-9484-c04aaf29bad4 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:22.382142 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-0372c398-f70a-4652-9484-c04aaf29bad4 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] HTTP exception thrown: Instance 9ad8536a-46b8-4821-8fb0-2c743927bb88 could not be found. Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0372c398-f70a-4652-9484-c04aaf29bad4 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Request method failure captured: Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 HTTP/1.1 Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHG3SwHS-l0WitPOzDSYA44CeJXLIzVxgr-MHeRUPHLkCmQshOXungF3JmTqRR5iusdVZCtU5BHnBL7LOCSV4K_6utRyxrplivDCcD85IiEW1gN4Yw9gJp7Mrm5YkkjyT9tJc58fqahkRyPfD_CsC349BMa6OwVpDa780GBoFo4Gi0E Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 7a67136b9d8041fd8e62a81be2d6b48d Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-AttachVolumeTestJSON-2140946303 Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7a67136b9d8041fd8e62a81be2d6b48d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7a67136b9d8041fd8e62a81be2d6b48d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7a67136b9d8041fd8e62a81be2d6b48d", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7a67136b9d8041fd8e62a81be2d6b48d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-AttachVolumeTestJSON-2140946303 Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 7a67136b9d8041fd8e62a81be2d6b48d Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2140946303 Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-AttachVolumeTestJSON-2140946303-project Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 65566509bf544a398cbb9c29ace613c5 Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-AttachVolumeTestJSON-2140946303-project Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 9ad8536a-46b8-4821-8fb0-2c743927bb88 could not be found. Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '9ad8536a-46b8-4821-8fb0-2c743927bb88'} Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ad8536a-46b8-4821-8fb0-2c743927bb88 could not be found. Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ad8536a-46b8-4821-8fb0-2c743927bb88 could not be found. Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:00:22.388948 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:00:22.394924 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:00:22.394924 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:00:22.394924 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:00:22.394924 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:00:22.394924 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:00:22.394924 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ad8536a-46b8-4821-8fb0-2c743927bb88 could not be found. Sep 16 13:00:22.394924 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:00:22.396345 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0372c398-f70a-4652-9484-c04aaf29bad4 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] Returning 404 to user: Instance 9ad8536a-46b8-4821-8fb0-2c743927bb88 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:00:22.397752 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0372c398-f70a-4652-9484-c04aaf29bad4 tempest-AttachVolumeTestJSON-2140946303 tempest-AttachVolumeTestJSON-2140946303-project] 10.222.0.67 "GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88" status: 404 len: 111 microversion: 2.1 time: 0.092115 Sep 16 13:00:22.398505 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1673/3247] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:22 2022] GET /compute/v2.1/servers/9ad8536a-46b8-4821-8fb0-2c743927bb88 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 13:00:22.520395 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8b29856b-850b-4d2b-b1ba-8f05c23f18d1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:22.521141 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8b29856b-850b-4d2b-b1ba-8f05c23f18d1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:22.547681 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b29856b-850b-4d2b-b1ba-8f05c23f18d1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:22.552886 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b29856b-850b-4d2b-b1ba-8f05c23f18d1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:22.554247 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b29856b-850b-4d2b-b1ba-8f05c23f18d1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:22.558068 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b29856b-850b-4d2b-b1ba-8f05c23f18d1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:22.560336 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b29856b-850b-4d2b-b1ba-8f05c23f18d1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:22.562767 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b29856b-850b-4d2b-b1ba-8f05c23f18d1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:22.775053 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-19c5a9b2-36e9-4334-ad43-5ef44f3e50bb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 12.631864 Sep 16 13:00:22.777245 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1575/3248] 10.222.0.67 () {62 vars in 1189 bytes} [Fri Sep 16 13:00:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 12635 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 16 13:00:22.792976 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e855ad9b-1a7e-4765-943e-5ecf86d19007 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:22.795054 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e855ad9b-1a7e-4765-943e-5ecf86d19007 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:23.181156 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e855ad9b-1a7e-4765-943e-5ecf86d19007 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:23.193689 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e855ad9b-1a7e-4765-943e-5ecf86d19007 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:23.197681 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e855ad9b-1a7e-4765-943e-5ecf86d19007 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:23.203022 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e855ad9b-1a7e-4765-943e-5ecf86d19007 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1284 microversion: 2.42 time: 0.418656 Sep 16 13:00:23.204012 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1576/3249] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:00:22 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1284 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:00:23.215084 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-729b4ed7-ae20-4fa8-a3ef-5e961207be74 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:23.216296 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-729b4ed7-ae20-4fa8-a3ef-5e961207be74 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: 08836465-8c0f-454b-9e19-8bb6bd44f931] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:23.230594 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-729b4ed7-ae20-4fa8-a3ef-5e961207be74 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:23.231189 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-729b4ed7-ae20-4fa8-a3ef-5e961207be74 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:23.231868 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-729b4ed7-ae20-4fa8-a3ef-5e961207be74 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:23.236618 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-729b4ed7-ae20-4fa8-a3ef-5e961207be74 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:23.237142 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-729b4ed7-ae20-4fa8-a3ef-5e961207be74 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:23.237597 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-729b4ed7-ae20-4fa8-a3ef-5e961207be74 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:23.571698 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8b29856b-850b-4d2b-b1ba-8f05c23f18d1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:23.584174 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8b29856b-850b-4d2b-b1ba-8f05c23f18d1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 200 len: 1315 microversion: 2.1 time: 1.073484 Sep 16 13:00:23.604772 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1674/3250] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:22 2022] GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 1315 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:00:23.848607 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-91e7ce18-2d3e-4a59-a9ff-83addad7bd1a req-32279b12-d981-4c2a-8a7f-7199e9f3b500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08836465-8c0f-454b-9e19-8bb6bd44f931", "name": "network-vif-plugged", "status": "completed", "tag": "49603217-44ca-43b5-b254-906cf820af9e"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:00:23.889092 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-91e7ce18-2d3e-4a59-a9ff-83addad7bd1a req-32279b12-d981-4c2a-8a7f-7199e9f3b500 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:23.890880 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-91e7ce18-2d3e-4a59-a9ff-83addad7bd1a req-32279b12-d981-4c2a-8a7f-7199e9f3b500 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:23.894722 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-91e7ce18-2d3e-4a59-a9ff-83addad7bd1a req-32279b12-d981-4c2a-8a7f-7199e9f3b500 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:23.923185 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-729b4ed7-ae20-4fa8-a3ef-5e961207be74 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0e6121124d4a15a63ac359bff5aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc3ef4fd0374ac4b74900369ca779aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:23.929215 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-91e7ce18-2d3e-4a59-a9ff-83addad7bd1a req-32279b12-d981-4c2a-8a7f-7199e9f3b500 service nova] Creating event network-vif-plugged:49603217-44ca-43b5-b254-906cf820af9e for instance 08836465-8c0f-454b-9e19-8bb6bd44f931 on n-h1-858094-4 Sep 16 13:00:23.934044 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-729b4ed7-ae20-4fa8-a3ef-5e961207be74 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "GET /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931" status: 200 len: 1319 microversion: 2.1 time: 0.728625 Sep 16 13:00:23.941920 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-91e7ce18-2d3e-4a59-a9ff-83addad7bd1a req-32279b12-d981-4c2a-8a7f-7199e9f3b500 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096990 Sep 16 13:00:23.943128 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1675/3251] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:00:23.943270 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1577/3252] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:23 2022] GET /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931 => generated 1319 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:24.232945 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0668eb58-6468-4823-9c39-4f6cdf93baa8 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:24.233981 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0668eb58-6468-4823-9c39-4f6cdf93baa8 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:24.609651 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0668eb58-6468-4823-9c39-4f6cdf93baa8 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:24.617893 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-12ae7e7c-990f-4a40-a2cd-1fb9832c82c1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:24.618567 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-12ae7e7c-990f-4a40-a2cd-1fb9832c82c1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:24.625709 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0668eb58-6468-4823-9c39-4f6cdf93baa8 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:24.627913 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0668eb58-6468-4823-9c39-4f6cdf93baa8 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:24.629717 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0668eb58-6468-4823-9c39-4f6cdf93baa8 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1284 microversion: 2.42 time: 0.401659 Sep 16 13:00:24.630008 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-12ae7e7c-990f-4a40-a2cd-1fb9832c82c1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:24.630508 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-12ae7e7c-990f-4a40-a2cd-1fb9832c82c1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:24.630943 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-12ae7e7c-990f-4a40-a2cd-1fb9832c82c1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:24.639534 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-12ae7e7c-990f-4a40-a2cd-1fb9832c82c1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:24.640045 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-12ae7e7c-990f-4a40-a2cd-1fb9832c82c1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:24.640522 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-12ae7e7c-990f-4a40-a2cd-1fb9832c82c1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:24.645189 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1676/3253] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:00:24 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1284 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:00:24.963143 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d5f06955-69da-40af-b53e-398c5806093c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:24.964992 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d5f06955-69da-40af-b53e-398c5806093c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: 08836465-8c0f-454b-9e19-8bb6bd44f931] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:24.976957 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5f06955-69da-40af-b53e-398c5806093c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:24.981638 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5f06955-69da-40af-b53e-398c5806093c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:24.982181 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5f06955-69da-40af-b53e-398c5806093c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:24.983102 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5f06955-69da-40af-b53e-398c5806093c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:24.983585 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5f06955-69da-40af-b53e-398c5806093c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:24.984021 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5f06955-69da-40af-b53e-398c5806093c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:25.173501 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-12ae7e7c-990f-4a40-a2cd-1fb9832c82c1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:25.193822 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-12ae7e7c-990f-4a40-a2cd-1fb9832c82c1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 200 len: 1315 microversion: 2.1 time: 0.580181 Sep 16 13:00:25.198091 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1578/3254] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:24 2022] GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 1315 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:25.339090 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d5f06955-69da-40af-b53e-398c5806093c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0e6121124d4a15a63ac359bff5aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc3ef4fd0374ac4b74900369ca779aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:25.350322 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d5f06955-69da-40af-b53e-398c5806093c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "GET /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931" status: 200 len: 1319 microversion: 2.1 time: 0.391241 Sep 16 13:00:25.350910 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1677/3255] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:24 2022] GET /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931 => generated 1319 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:00:25.666308 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e711434a-268b-4105-aff7-b4de29f85320 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:25.669368 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e711434a-268b-4105-aff7-b4de29f85320 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:25.692249 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e711434a-268b-4105-aff7-b4de29f85320 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:25.692863 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e711434a-268b-4105-aff7-b4de29f85320 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:25.693696 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e711434a-268b-4105-aff7-b4de29f85320 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:25.694415 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e711434a-268b-4105-aff7-b4de29f85320 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:25.695062 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e711434a-268b-4105-aff7-b4de29f85320 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:25.695653 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e711434a-268b-4105-aff7-b4de29f85320 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:25.907669 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e711434a-268b-4105-aff7-b4de29f85320 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:25.924675 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e711434a-268b-4105-aff7-b4de29f85320 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:25.926433 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e711434a-268b-4105-aff7-b4de29f85320 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:25.927603 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e711434a-268b-4105-aff7-b4de29f85320 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1526 microversion: 2.42 time: 0.271283 Sep 16 13:00:25.928206 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1579/3256] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:00:25 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1526 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:00:26.225876 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-167ab81c-cfcb-4515-943d-3dc6848b5a3e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:26.226664 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-167ab81c-cfcb-4515-943d-3dc6848b5a3e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:26.262002 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-167ab81c-cfcb-4515-943d-3dc6848b5a3e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:26.263048 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-167ab81c-cfcb-4515-943d-3dc6848b5a3e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:26.263781 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-167ab81c-cfcb-4515-943d-3dc6848b5a3e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:26.264749 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-167ab81c-cfcb-4515-943d-3dc6848b5a3e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:26.266440 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-167ab81c-cfcb-4515-943d-3dc6848b5a3e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:26.273554 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-167ab81c-cfcb-4515-943d-3dc6848b5a3e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:26.376018 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a2f07bbd-9a61-4d35-9abb-dcd3883d361e tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:26.376673 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a2f07bbd-9a61-4d35-9abb-dcd3883d361e tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: 08836465-8c0f-454b-9e19-8bb6bd44f931] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:26.403083 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a2f07bbd-9a61-4d35-9abb-dcd3883d361e tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:26.404273 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a2f07bbd-9a61-4d35-9abb-dcd3883d361e tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:26.411479 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a2f07bbd-9a61-4d35-9abb-dcd3883d361e tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:26.413966 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a2f07bbd-9a61-4d35-9abb-dcd3883d361e tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:26.414654 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a2f07bbd-9a61-4d35-9abb-dcd3883d361e tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:26.420253 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a2f07bbd-9a61-4d35-9abb-dcd3883d361e tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:26.992968 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a2f07bbd-9a61-4d35-9abb-dcd3883d361e tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0e6121124d4a15a63ac359bff5aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc3ef4fd0374ac4b74900369ca779aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:27.003769 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a2f07bbd-9a61-4d35-9abb-dcd3883d361e tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "GET /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931" status: 200 len: 1469 microversion: 2.1 time: 0.632208 Sep 16 13:00:27.005872 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1580/3257] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:26 2022] GET /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931 => generated 1469 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:00:27.032537 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-bc3e52db-dd2d-4e3d-95a7-e1c18e43ff04 req-fbd262b0-6169-4700-8ad9-98ef551fb5bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "464c1886-1201-4b29-b61a-727d5c9e22b6", "name": "network-vif-plugged", "status": "completed", "tag": "116c6c97-9499-4c0e-861c-371e4ecf4ba2"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:00:27.067216 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-bc3e52db-dd2d-4e3d-95a7-e1c18e43ff04 req-fbd262b0-6169-4700-8ad9-98ef551fb5bd service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:27.069208 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-bc3e52db-dd2d-4e3d-95a7-e1c18e43ff04 req-fbd262b0-6169-4700-8ad9-98ef551fb5bd service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:27.078256 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-bc3e52db-dd2d-4e3d-95a7-e1c18e43ff04 req-fbd262b0-6169-4700-8ad9-98ef551fb5bd service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:27.097595 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-bc3e52db-dd2d-4e3d-95a7-e1c18e43ff04 req-fbd262b0-6169-4700-8ad9-98ef551fb5bd service nova] Creating event network-vif-plugged:116c6c97-9499-4c0e-861c-371e4ecf4ba2 for instance 464c1886-1201-4b29-b61a-727d5c9e22b6 on n-h2-858094-4 Sep 16 13:00:27.115835 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-bc3e52db-dd2d-4e3d-95a7-e1c18e43ff04 req-fbd262b0-6169-4700-8ad9-98ef551fb5bd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106203 Sep 16 13:00:27.129966 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1581/3258] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:00:27.155553 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e031b55c-3e00-4094-ad9e-c47027bd9bd2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:27.157582 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e031b55c-3e00-4094-ad9e-c47027bd9bd2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:27.167990 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-167ab81c-cfcb-4515-943d-3dc6848b5a3e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:27.179274 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-167ab81c-cfcb-4515-943d-3dc6848b5a3e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 200 len: 1315 microversion: 2.1 time: 0.958346 Sep 16 13:00:27.179871 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1678/3259] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:26 2022] GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 1315 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:27.183286 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e031b55c-3e00-4094-ad9e-c47027bd9bd2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:27.190508 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e031b55c-3e00-4094-ad9e-c47027bd9bd2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:27.191214 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e031b55c-3e00-4094-ad9e-c47027bd9bd2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:27.192143 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e031b55c-3e00-4094-ad9e-c47027bd9bd2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:27.196831 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e031b55c-3e00-4094-ad9e-c47027bd9bd2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:27.207092 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e031b55c-3e00-4094-ad9e-c47027bd9bd2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:27.962558 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-63373e3e-4273-4120-9244-d6ea6f592571 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-403237373", "block_migration": true, "disk_over_commit": false}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:00:27.965303 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-63373e3e-4273-4120-9244-d6ea6f592571 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] [instance: 08836465-8c0f-454b-9e19-8bb6bd44f931] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:27.992062 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63373e3e-4273-4120-9244-d6ea6f592571 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:27.992765 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63373e3e-4273-4120-9244-d6ea6f592571 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:27.993218 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63373e3e-4273-4120-9244-d6ea6f592571 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:27.993942 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63373e3e-4273-4120-9244-d6ea6f592571 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:27.994413 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63373e3e-4273-4120-9244-d6ea6f592571 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:27.994847 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63373e3e-4273-4120-9244-d6ea6f592571 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:28.067427 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-63373e3e-4273-4120-9244-d6ea6f592571 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Lazy-loading 'flavor' on Instance uuid 08836465-8c0f-454b-9e19-8bb6bd44f931 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:00:28.091609 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-63373e3e-4273-4120-9244-d6ea6f592571 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] [instance: 08836465-8c0f-454b-9e19-8bb6bd44f931] Going to try to live migrate instance to tempest-host-403237373 {{(pid=128779) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 16 13:00:28.116648 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-63373e3e-4273-4120-9244-d6ea6f592571 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] HTTP exception thrown: Compute host tempest-host-403237373 could not be found. Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-63373e3e-4273-4120-9244-d6ea6f592571 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Request method failure captured: Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931/action HTTP/1.1 Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 106 Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHNLKE6-K3_qw5cXTQdexG7YsIW4x_EvMA4fP7QK5rq8_XViBgfGQ3ndZLMtVi3tgqpgOe6UlhTRgGE23GqduH-n2unSpp63Xvp6tnwrYkdh83kmdueVqtFaYp94gF770_IYe_YlsUlJothXFDG55XzsHt_Or1prBFxwX0_QI6yS5os Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 618a577f242f42f499e403f61a21ebf2 Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-LiveMigrationNegativeTest-785527900 Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,admin,reader Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,admin,reader Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/618a577f242f42f499e403f61a21ebf2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/618a577f242f42f499e403f61a21ebf2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_618a577f242f42f499e403f61a21ebf2", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/618a577f242f42f499e403f61a21ebf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-LiveMigrationNegativeTest-785527900 Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 618a577f242f42f499e403f61a21ebf2 Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-785527900 Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-LiveMigrationNegativeTest-785527900-project-admin Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 3628c1050b12420ebc06e2c96b3c2ae1 Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-LiveMigrationNegativeTest-785527900-project-admin Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: {"os-migrateLive": {"host": "tempest-host-403237373", "block_migration": true, "disk_over_commit": false}} Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: exception: Compute host tempest-host-403237373 could not be found. Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '08836465-8c0f-454b-9e19-8bb6bd44f931', 'body': {'os-migrateLive': {'host': 'tempest-host-403237373', 'block_migration': True, 'disk_over_commit': False}}} Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Sep 16 13:00:28.128766 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Sep 16 13:00:28.132854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Sep 16 13:00:28.132854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:00:28.132854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Sep 16 13:00:28.132854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Sep 16 13:00:28.132854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Sep 16 13:00:28.132854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Sep 16 13:00:28.132854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Sep 16 13:00:28.132854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Sep 16 13:00:28.132854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-403237373 could not be found. Sep 16 13:00:28.132854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:00:28.132854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:00:28.132854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:00:28.132854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:00:28.132854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:00:28.132854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:00:28.132854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:00:28.132854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:00:28.132854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:00:28.132854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:00:28.132854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:00:28.132854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:00:28.132854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:00:28.132854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:00:28.132854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:00:28.132854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:00:28.132854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 16 13:00:28.132854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Sep 16 13:00:28.132854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 16 13:00:28.132854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-403237373 could not be found. Sep 16 13:00:28.132854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:00:28.132854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:00:28.132854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:00:28.132854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:00:28.132854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:00:28.132854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:00:28.132854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:00:28.132854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:00:28.132854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-403237373 could not be found. Sep 16 13:00:28.132854 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:00:28.132854 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-63373e3e-4273-4120-9244-d6ea6f592571 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Returning 400 to user: Compute host tempest-host-403237373 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:00:28.135409 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-63373e3e-4273-4120-9244-d6ea6f592571 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931/action" status: 400 len: 99 microversion: 2.1 time: 0.945575 Sep 16 13:00:28.135409 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1679/3260] 10.222.0.67 () {60 vars in 1279 bytes} [Fri Sep 16 13:00:27 2022] POST /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931/action => generated 99 bytes in 947 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 16 13:00:28.153751 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-84faf254-bc64-446d-a69c-9114e31da290 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:28.155081 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-84faf254-bc64-446d-a69c-9114e31da290 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: 08836465-8c0f-454b-9e19-8bb6bd44f931] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:28.178184 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-84faf254-bc64-446d-a69c-9114e31da290 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:28.179798 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-84faf254-bc64-446d-a69c-9114e31da290 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:28.182070 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-84faf254-bc64-446d-a69c-9114e31da290 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:28.183276 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-84faf254-bc64-446d-a69c-9114e31da290 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:28.185671 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-84faf254-bc64-446d-a69c-9114e31da290 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:28.186906 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-84faf254-bc64-446d-a69c-9114e31da290 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:28.355660 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e031b55c-3e00-4094-ad9e-c47027bd9bd2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:28.370919 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e031b55c-3e00-4094-ad9e-c47027bd9bd2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:28.377993 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e031b55c-3e00-4094-ad9e-c47027bd9bd2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:28.379230 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e031b55c-3e00-4094-ad9e-c47027bd9bd2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1592 microversion: 2.42 time: 1.247878 Sep 16 13:00:28.379813 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1582/3261] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:00:27 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1592 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:00:28.397852 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0afd30bc-a858-4057-af9b-96d8f090b9eb tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:28.401489 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0afd30bc-a858-4057-af9b-96d8f090b9eb tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:28.419979 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0afd30bc-a858-4057-af9b-96d8f090b9eb tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:28.420789 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0afd30bc-a858-4057-af9b-96d8f090b9eb tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:28.421571 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0afd30bc-a858-4057-af9b-96d8f090b9eb tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:28.422619 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0afd30bc-a858-4057-af9b-96d8f090b9eb tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:28.423333 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0afd30bc-a858-4057-af9b-96d8f090b9eb tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:28.423996 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0afd30bc-a858-4057-af9b-96d8f090b9eb tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:29.306154 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-84faf254-bc64-446d-a69c-9114e31da290 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0e6121124d4a15a63ac359bff5aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc3ef4fd0374ac4b74900369ca779aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:29.321506 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-84faf254-bc64-446d-a69c-9114e31da290 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "GET /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931" status: 200 len: 1469 microversion: 2.1 time: 1.181099 Sep 16 13:00:29.322028 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1680/3262] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:28 2022] GET /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931 => generated 1469 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:29.406472 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5f12491e-a70d-4aca-9d11-de4010fd0cb2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:29.407604 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5f12491e-a70d-4aca-9d11-de4010fd0cb2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:29.421197 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=58 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:00:29.423479 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f12491e-a70d-4aca-9d11-de4010fd0cb2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:29.425655 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f12491e-a70d-4aca-9d11-de4010fd0cb2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:29.426383 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f12491e-a70d-4aca-9d11-de4010fd0cb2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:29.430387 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f12491e-a70d-4aca-9d11-de4010fd0cb2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:29.431442 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f12491e-a70d-4aca-9d11-de4010fd0cb2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:29.432162 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f12491e-a70d-4aca-9d11-de4010fd0cb2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:29.630285 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0afd30bc-a858-4057-af9b-96d8f090b9eb tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:29.645010 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0afd30bc-a858-4057-af9b-96d8f090b9eb tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 200 len: 1315 microversion: 2.1 time: 1.249647 Sep 16 13:00:29.648872 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1583/3263] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:28 2022] GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 1315 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:29.666231 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7012acbb-3c3b-44bd-aaf1-723d56fd6a1c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-590857683", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:00:29.788999 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-7012acbb-3c3b-44bd-aaf1-723d56fd6a1c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] validate_networks() for None {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:00:30.136696 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5f12491e-a70d-4aca-9d11-de4010fd0cb2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:30.154325 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5f12491e-a70d-4aca-9d11-de4010fd0cb2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:30.155809 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5f12491e-a70d-4aca-9d11-de4010fd0cb2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:30.161352 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5f12491e-a70d-4aca-9d11-de4010fd0cb2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1592 microversion: 2.42 time: 0.758901 Sep 16 13:00:30.162694 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1681/3264] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:00:29 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1592 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:00:30.675176 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-40c1ed71-183e-4f26-81c3-8c8e4a34b87f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:30.675842 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-40c1ed71-183e-4f26-81c3-8c8e4a34b87f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:30.686300 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40c1ed71-183e-4f26-81c3-8c8e4a34b87f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:30.686717 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40c1ed71-183e-4f26-81c3-8c8e4a34b87f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:30.687166 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40c1ed71-183e-4f26-81c3-8c8e4a34b87f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:30.687891 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40c1ed71-183e-4f26-81c3-8c8e4a34b87f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:30.694314 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40c1ed71-183e-4f26-81c3-8c8e4a34b87f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:30.694779 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40c1ed71-183e-4f26-81c3-8c8e4a34b87f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:31.239841 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-7012acbb-3c3b-44bd-aaf1-723d56fd6a1c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:00:31.240416 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-7012acbb-3c3b-44bd-aaf1-723d56fd6a1c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:00:31.240783 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-7012acbb-3c3b-44bd-aaf1-723d56fd6a1c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:00:31.241201 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-7012acbb-3c3b-44bd-aaf1-723d56fd6a1c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:00:31.241618 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-7012acbb-3c3b-44bd-aaf1-723d56fd6a1c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:00:31.259355 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7012acbb-3c3b-44bd-aaf1-723d56fd6a1c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:31.259865 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7012acbb-3c3b-44bd-aaf1-723d56fd6a1c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:31.260375 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7012acbb-3c3b-44bd-aaf1-723d56fd6a1c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:31.264652 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7012acbb-3c3b-44bd-aaf1-723d56fd6a1c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:31.266532 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7012acbb-3c3b-44bd-aaf1-723d56fd6a1c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:31.268769 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7012acbb-3c3b-44bd-aaf1-723d56fd6a1c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:31.319588 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-7012acbb-3c3b-44bd-aaf1-723d56fd6a1c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Getting quotas for project 9bc3ef4fd0374ac4b74900369ca779aa. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:00:31.346672 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-7012acbb-3c3b-44bd-aaf1-723d56fd6a1c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Getting quotas for user eb0e6121124d4a15a63ac359bff5aedb and project 9bc3ef4fd0374ac4b74900369ca779aa. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:00:31.377566 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7012acbb-3c3b-44bd-aaf1-723d56fd6a1c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:00:31.383791 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7012acbb-3c3b-44bd-aaf1-723d56fd6a1c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: cbc794b1-563e-49d1-92d9-86cea9a9bf75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:00:31.460266 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7012acbb-3c3b-44bd-aaf1-723d56fd6a1c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.809154 Sep 16 13:00:31.464096 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1584/3265] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 13:00:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 13:00:31.475195 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e45e428e-2c60-4e15-806d-fd5cbd9df989 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:31.479869 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e45e428e-2c60-4e15-806d-fd5cbd9df989 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:31.512888 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e45e428e-2c60-4e15-806d-fd5cbd9df989 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:31.514542 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e45e428e-2c60-4e15-806d-fd5cbd9df989 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:31.515184 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e45e428e-2c60-4e15-806d-fd5cbd9df989 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:31.520587 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e45e428e-2c60-4e15-806d-fd5cbd9df989 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:31.521087 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e45e428e-2c60-4e15-806d-fd5cbd9df989 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:31.521534 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e45e428e-2c60-4e15-806d-fd5cbd9df989 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:31.730665 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e45e428e-2c60-4e15-806d-fd5cbd9df989 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:31.744857 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e45e428e-2c60-4e15-806d-fd5cbd9df989 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:31.750098 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e45e428e-2c60-4e15-806d-fd5cbd9df989 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:31.751817 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e45e428e-2c60-4e15-806d-fd5cbd9df989 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1592 microversion: 2.42 time: 0.286311 Sep 16 13:00:31.756887 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1585/3266] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:00:31 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1592 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:00:31.763813 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d2d8b63a-ff9a-48b2-b9b0-1cf04bd814ea tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:31.768915 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d2d8b63a-ff9a-48b2-b9b0-1cf04bd814ea tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: cbc794b1-563e-49d1-92d9-86cea9a9bf75] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:31.847652 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-40c1ed71-183e-4f26-81c3-8c8e4a34b87f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:31.886776 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-40c1ed71-183e-4f26-81c3-8c8e4a34b87f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 200 len: 1501 microversion: 2.1 time: 1.216746 Sep 16 13:00:31.897581 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d2d8b63a-ff9a-48b2-b9b0-1cf04bd814ea tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0e6121124d4a15a63ac359bff5aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc3ef4fd0374ac4b74900369ca779aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:31.898088 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1682/3267] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:30 2022] GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 1501 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:31.911320 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d2d8b63a-ff9a-48b2-b9b0-1cf04bd814ea tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75" status: 200 len: 1218 microversion: 2.1 time: 0.153093 Sep 16 13:00:31.913073 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1586/3268] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:31 2022] GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75 => generated 1218 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:31.926280 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3dd3423b-6992-47f7-bb91-1d3b9e346653 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:00:31.927071 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3dd3423b-6992-47f7-bb91-1d3b9e346653 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:31.947217 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3dd3423b-6992-47f7-bb91-1d3b9e346653 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:31.948201 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3dd3423b-6992-47f7-bb91-1d3b9e346653 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:31.950610 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3dd3423b-6992-47f7-bb91-1d3b9e346653 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:31.953697 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3dd3423b-6992-47f7-bb91-1d3b9e346653 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:31.955179 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3dd3423b-6992-47f7-bb91-1d3b9e346653 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:31.957327 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3dd3423b-6992-47f7-bb91-1d3b9e346653 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:32.022180 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-3dd3423b-6992-47f7-bb91-1d3b9e346653 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lazy-loading 'flavor' on Instance uuid 464c1886-1201-4b29-b61a-727d5c9e22b6 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:00:32.490334 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3dd3423b-6992-47f7-bb91-1d3b9e346653 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "POST /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6/action" status: 202 len: 0 microversion: 2.1 time: 0.568134 Sep 16 13:00:32.493977 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1683/3269] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 13:00:31 2022] POST /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6/action => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:00:32.507404 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b3fba77d-96b7-49f7-82a7-ec992f411686 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:32.508413 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b3fba77d-96b7-49f7-82a7-ec992f411686 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:32.534834 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b3fba77d-96b7-49f7-82a7-ec992f411686 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:32.535369 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b3fba77d-96b7-49f7-82a7-ec992f411686 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:32.536793 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b3fba77d-96b7-49f7-82a7-ec992f411686 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:32.539018 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b3fba77d-96b7-49f7-82a7-ec992f411686 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:32.540668 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b3fba77d-96b7-49f7-82a7-ec992f411686 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:32.541872 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b3fba77d-96b7-49f7-82a7-ec992f411686 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:32.787610 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-44ce6677-cba8-4f96-beb5-3266bbf9cbb5 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:32.788526 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-44ce6677-cba8-4f96-beb5-3266bbf9cbb5 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:32.813962 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44ce6677-cba8-4f96-beb5-3266bbf9cbb5 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:32.814633 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44ce6677-cba8-4f96-beb5-3266bbf9cbb5 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:32.816660 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44ce6677-cba8-4f96-beb5-3266bbf9cbb5 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:32.817668 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44ce6677-cba8-4f96-beb5-3266bbf9cbb5 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:32.818649 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44ce6677-cba8-4f96-beb5-3266bbf9cbb5 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:32.820225 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44ce6677-cba8-4f96-beb5-3266bbf9cbb5 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:33.137989 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-44ce6677-cba8-4f96-beb5-3266bbf9cbb5 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:33.155502 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-44ce6677-cba8-4f96-beb5-3266bbf9cbb5 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:33.159172 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-44ce6677-cba8-4f96-beb5-3266bbf9cbb5 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:33.162349 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-44ce6677-cba8-4f96-beb5-3266bbf9cbb5 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1592 microversion: 2.42 time: 0.381662 Sep 16 13:00:33.165657 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1684/3270] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:00:32 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1592 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:00:33.180224 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4685ec7a-807c-4f23-b4e1-aa27cfc5837d tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:33.187791 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4685ec7a-807c-4f23-b4e1-aa27cfc5837d tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: cbc794b1-563e-49d1-92d9-86cea9a9bf75] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:33.194594 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4685ec7a-807c-4f23-b4e1-aa27cfc5837d tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:33.197346 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4685ec7a-807c-4f23-b4e1-aa27cfc5837d tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:33.199131 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4685ec7a-807c-4f23-b4e1-aa27cfc5837d tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:33.200917 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4685ec7a-807c-4f23-b4e1-aa27cfc5837d tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:33.203691 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4685ec7a-807c-4f23-b4e1-aa27cfc5837d tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:33.204366 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4685ec7a-807c-4f23-b4e1-aa27cfc5837d tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:33.511786 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4685ec7a-807c-4f23-b4e1-aa27cfc5837d tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0e6121124d4a15a63ac359bff5aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc3ef4fd0374ac4b74900369ca779aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:33.525757 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4685ec7a-807c-4f23-b4e1-aa27cfc5837d tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75" status: 200 len: 1214 microversion: 2.1 time: 0.358782 Sep 16 13:00:33.555971 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1685/3271] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:33 2022] GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75 => generated 1214 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:33.595888 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-b3fba77d-96b7-49f7-82a7-ec992f411686 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:33.610960 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b3fba77d-96b7-49f7-82a7-ec992f411686 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 200 len: 1507 microversion: 2.1 time: 1.113052 Sep 16 13:00:33.614685 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1587/3272] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:32 2022] GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 1507 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:34.196440 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-038e1ca0-868a-4350-84a7-2936aa26efe4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:34.198444 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-038e1ca0-868a-4350-84a7-2936aa26efe4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:34.245366 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-038e1ca0-868a-4350-84a7-2936aa26efe4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:34.246551 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-038e1ca0-868a-4350-84a7-2936aa26efe4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:34.246551 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-038e1ca0-868a-4350-84a7-2936aa26efe4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:34.247471 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-038e1ca0-868a-4350-84a7-2936aa26efe4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:34.247951 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-038e1ca0-868a-4350-84a7-2936aa26efe4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:34.250390 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-038e1ca0-868a-4350-84a7-2936aa26efe4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:34.284419 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-45ba077a-2a64-46d2-a56e-2d8239b1e4ec tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Action: 'create', calling method: .version_select at 0x7f1035bf4040>, body: {"keypair": {"name": "tempest-keypair-1492500719", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzmApiZ2fZZ3eeDCu5FNFyRWllY+yz7Y2ceqkW0HbSCEiPYL3que9x2nzip08n3hSCeldr49UkQ8iKNvt7gmQ0D7k2vYCKtiWvBiFh6JQUKLdTTOFDQ5QDiv2M/D/Qw2g=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:00:34.363007 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-45ba077a-2a64-46d2-a56e-2d8239b1e4ec tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Getting quotas for project e3f3ad027f264333a95500ef691b7815. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:00:34.399797 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-45ba077a-2a64-46d2-a56e-2d8239b1e4ec tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Getting quotas for user ba5727658d094c049054160852163cee and project e3f3ad027f264333a95500ef691b7815. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:00:34.493859 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-45ba077a-2a64-46d2-a56e-2d8239b1e4ec tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.533422 Sep 16 13:00:34.498908 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1686/3273] 10.222.0.67 () {62 vars in 1200 bytes} [Fri Sep 16 13:00:33 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 539 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 16 13:00:34.555615 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-425f59f9-6bfb-4413-ab21-f9e65d60e4ea tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:34.556373 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-425f59f9-6bfb-4413-ab21-f9e65d60e4ea tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: cbc794b1-563e-49d1-92d9-86cea9a9bf75] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:34.568769 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-425f59f9-6bfb-4413-ab21-f9e65d60e4ea tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:34.569275 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-425f59f9-6bfb-4413-ab21-f9e65d60e4ea tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:34.569717 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-425f59f9-6bfb-4413-ab21-f9e65d60e4ea tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:34.572903 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-425f59f9-6bfb-4413-ab21-f9e65d60e4ea tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:34.574209 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-425f59f9-6bfb-4413-ab21-f9e65d60e4ea tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:34.576277 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-425f59f9-6bfb-4413-ab21-f9e65d60e4ea tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:35.398399 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-425f59f9-6bfb-4413-ab21-f9e65d60e4ea tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0e6121124d4a15a63ac359bff5aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc3ef4fd0374ac4b74900369ca779aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:35.415458 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-425f59f9-6bfb-4413-ab21-f9e65d60e4ea tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75" status: 200 len: 1276 microversion: 2.1 time: 0.864170 Sep 16 13:00:35.416251 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1687/3274] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:34 2022] GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75 => generated 1276 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:00:35.432798 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-81bae7c9-dd7a-4745-87c1-040f486c1b88 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:35.433784 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-81bae7c9-dd7a-4745-87c1-040f486c1b88 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:35.450408 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81bae7c9-dd7a-4745-87c1-040f486c1b88 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:35.451214 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81bae7c9-dd7a-4745-87c1-040f486c1b88 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:35.453152 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81bae7c9-dd7a-4745-87c1-040f486c1b88 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:35.454895 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81bae7c9-dd7a-4745-87c1-040f486c1b88 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:35.456314 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81bae7c9-dd7a-4745-87c1-040f486c1b88 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:35.458625 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81bae7c9-dd7a-4745-87c1-040f486c1b88 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:36.278672 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-038e1ca0-868a-4350-84a7-2936aa26efe4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:36.304572 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-038e1ca0-868a-4350-84a7-2936aa26efe4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:36.306440 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-038e1ca0-868a-4350-84a7-2936aa26efe4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:36.313731 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-038e1ca0-868a-4350-84a7-2936aa26efe4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1659 microversion: 2.42 time: 2.122108 Sep 16 13:00:36.315679 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1588/3275] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:00:34 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1659 bytes in 2127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:00:36.444997 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d5acdef8-dc62-4dee-969d-58bf4afbc5b8 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:36.446543 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d5acdef8-dc62-4dee-969d-58bf4afbc5b8 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: cbc794b1-563e-49d1-92d9-86cea9a9bf75] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:36.456290 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d5acdef8-dc62-4dee-969d-58bf4afbc5b8 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:36.461225 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d5acdef8-dc62-4dee-969d-58bf4afbc5b8 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:36.462357 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d5acdef8-dc62-4dee-969d-58bf4afbc5b8 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:36.463757 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d5acdef8-dc62-4dee-969d-58bf4afbc5b8 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:36.464583 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d5acdef8-dc62-4dee-969d-58bf4afbc5b8 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:36.467860 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d5acdef8-dc62-4dee-969d-58bf4afbc5b8 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:36.525260 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-81bae7c9-dd7a-4745-87c1-040f486c1b88 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:36.539202 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-81bae7c9-dd7a-4745-87c1-040f486c1b88 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 200 len: 1507 microversion: 2.1 time: 1.121428 Sep 16 13:00:36.540432 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1688/3276] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:35 2022] GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 1507 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:36.875198 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d5acdef8-dc62-4dee-969d-58bf4afbc5b8 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0e6121124d4a15a63ac359bff5aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc3ef4fd0374ac4b74900369ca779aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:36.901186 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d5acdef8-dc62-4dee-969d-58bf4afbc5b8 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75" status: 200 len: 1276 microversion: 2.1 time: 0.461243 Sep 16 13:00:36.918610 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1589/3277] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:36 2022] GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75 => generated 1276 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:37.349474 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-351acb63-48fb-4bb1-af31-876feb42d7b3 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:37.350102 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-351acb63-48fb-4bb1-af31-876feb42d7b3 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:37.358684 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-351acb63-48fb-4bb1-af31-876feb42d7b3 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:37.359333 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-351acb63-48fb-4bb1-af31-876feb42d7b3 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:37.360756 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-351acb63-48fb-4bb1-af31-876feb42d7b3 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:37.361855 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-351acb63-48fb-4bb1-af31-876feb42d7b3 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:37.362334 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-351acb63-48fb-4bb1-af31-876feb42d7b3 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:37.362761 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-351acb63-48fb-4bb1-af31-876feb42d7b3 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:37.439779 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:00:37.571627 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-387c8f14-2d63-4108-ae34-7db3d6701f89 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:37.573026 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-387c8f14-2d63-4108-ae34-7db3d6701f89 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:37.588280 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=7 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:00:37.589943 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-387c8f14-2d63-4108-ae34-7db3d6701f89 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:37.591247 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-387c8f14-2d63-4108-ae34-7db3d6701f89 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:37.591805 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-387c8f14-2d63-4108-ae34-7db3d6701f89 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:37.592725 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-387c8f14-2d63-4108-ae34-7db3d6701f89 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:37.593437 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-387c8f14-2d63-4108-ae34-7db3d6701f89 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:37.594091 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-387c8f14-2d63-4108-ae34-7db3d6701f89 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:38.307729 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-351acb63-48fb-4bb1-af31-876feb42d7b3 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:38.337379 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-351acb63-48fb-4bb1-af31-876feb42d7b3 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:38.338855 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-351acb63-48fb-4bb1-af31-876feb42d7b3 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:38.340060 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-351acb63-48fb-4bb1-af31-876feb42d7b3 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1659 microversion: 2.42 time: 0.994608 Sep 16 13:00:38.352286 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1689/3278] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:00:37 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1659 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:00:38.352286 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-33555626-e237-46e8-a7e0-2870f877ca4d tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:38.352286 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-33555626-e237-46e8-a7e0-2870f877ca4d tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: cbc794b1-563e-49d1-92d9-86cea9a9bf75] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:38.366180 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33555626-e237-46e8-a7e0-2870f877ca4d tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:38.366970 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33555626-e237-46e8-a7e0-2870f877ca4d tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:38.367664 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33555626-e237-46e8-a7e0-2870f877ca4d tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:38.368735 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33555626-e237-46e8-a7e0-2870f877ca4d tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:38.369453 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33555626-e237-46e8-a7e0-2870f877ca4d tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:38.370532 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33555626-e237-46e8-a7e0-2870f877ca4d tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:38.598919 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-33555626-e237-46e8-a7e0-2870f877ca4d tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0e6121124d4a15a63ac359bff5aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc3ef4fd0374ac4b74900369ca779aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:38.616467 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-33555626-e237-46e8-a7e0-2870f877ca4d tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75" status: 200 len: 1276 microversion: 2.1 time: 0.272168 Sep 16 13:00:38.621870 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1690/3279] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:38 2022] GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75 => generated 1276 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:38.739274 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-387c8f14-2d63-4108-ae34-7db3d6701f89 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:38.751368 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-387c8f14-2d63-4108-ae34-7db3d6701f89 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 200 len: 1507 microversion: 2.1 time: 1.183592 Sep 16 13:00:38.764265 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1590/3280] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:37 2022] GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 1507 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:39.377481 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cd4cc991-d488-4d0e-9741-ff5fa3a11a83 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:39.378359 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cd4cc991-d488-4d0e-9741-ff5fa3a11a83 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:39.394952 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd4cc991-d488-4d0e-9741-ff5fa3a11a83 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:39.398922 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd4cc991-d488-4d0e-9741-ff5fa3a11a83 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:39.399685 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd4cc991-d488-4d0e-9741-ff5fa3a11a83 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:39.400842 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd4cc991-d488-4d0e-9741-ff5fa3a11a83 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:39.401478 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd4cc991-d488-4d0e-9741-ff5fa3a11a83 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:39.402406 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd4cc991-d488-4d0e-9741-ff5fa3a11a83 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:39.644163 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3ba1f2ce-5ffb-4ae3-a764-deb49dd15b86 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:39.646122 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3ba1f2ce-5ffb-4ae3-a764-deb49dd15b86 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: cbc794b1-563e-49d1-92d9-86cea9a9bf75] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:39.661123 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3ba1f2ce-5ffb-4ae3-a764-deb49dd15b86 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:39.670781 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3ba1f2ce-5ffb-4ae3-a764-deb49dd15b86 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:39.671646 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3ba1f2ce-5ffb-4ae3-a764-deb49dd15b86 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:39.674092 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3ba1f2ce-5ffb-4ae3-a764-deb49dd15b86 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:39.677397 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3ba1f2ce-5ffb-4ae3-a764-deb49dd15b86 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:39.677989 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3ba1f2ce-5ffb-4ae3-a764-deb49dd15b86 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:39.977296 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cd4cc991-d488-4d0e-9741-ff5fa3a11a83 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:40.002304 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cd4cc991-d488-4d0e-9741-ff5fa3a11a83 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:40.004574 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cd4cc991-d488-4d0e-9741-ff5fa3a11a83 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:40.012437 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cd4cc991-d488-4d0e-9741-ff5fa3a11a83 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1705 microversion: 2.42 time: 0.646281 Sep 16 13:00:40.019163 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1691/3281] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:00:39 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1705 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:00:40.041275 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3d8639ae-bbf0-4754-8644-2f44fc5ea989 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:40.042094 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3d8639ae-bbf0-4754-8644-2f44fc5ea989 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:40.062307 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d8639ae-bbf0-4754-8644-2f44fc5ea989 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:40.068897 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d8639ae-bbf0-4754-8644-2f44fc5ea989 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:40.069711 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d8639ae-bbf0-4754-8644-2f44fc5ea989 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:40.070634 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d8639ae-bbf0-4754-8644-2f44fc5ea989 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:40.072059 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d8639ae-bbf0-4754-8644-2f44fc5ea989 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:40.072528 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d8639ae-bbf0-4754-8644-2f44fc5ea989 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:40.305090 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3ba1f2ce-5ffb-4ae3-a764-deb49dd15b86 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0e6121124d4a15a63ac359bff5aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc3ef4fd0374ac4b74900369ca779aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:40.313296 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3ba1f2ce-5ffb-4ae3-a764-deb49dd15b86 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75" status: 200 len: 1318 microversion: 2.1 time: 0.673120 Sep 16 13:00:40.321301 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1591/3282] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:39 2022] GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75 => generated 1318 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:40.504803 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3d8639ae-bbf0-4754-8644-2f44fc5ea989 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:40.531883 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3d8639ae-bbf0-4754-8644-2f44fc5ea989 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 200 len: 1507 microversion: 2.1 time: 0.507517 Sep 16 13:00:40.539327 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1692/3283] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:40 2022] GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 1507 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:41.040573 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5bb812e9-3e14-4256-bb9d-641bbdef01ef tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:41.041375 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5bb812e9-3e14-4256-bb9d-641bbdef01ef tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:41.054982 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5bb812e9-3e14-4256-bb9d-641bbdef01ef tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:41.065441 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5bb812e9-3e14-4256-bb9d-641bbdef01ef tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:41.067975 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5bb812e9-3e14-4256-bb9d-641bbdef01ef tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:41.070425 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5bb812e9-3e14-4256-bb9d-641bbdef01ef tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:41.071892 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5bb812e9-3e14-4256-bb9d-641bbdef01ef tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:41.072998 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5bb812e9-3e14-4256-bb9d-641bbdef01ef tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:41.294156 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=4 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:00:41.907117 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=16 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:00:41.913369 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2add235c-9ce5-4ff3-a003-c90ee49dedba tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Action: 'create', calling method: .version_select at 0x7f10399e14c0>, body: {"keypair": {"name": "tempest-keypair-833490", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGh/VlI4CvWjfAwUi75MWLR5xAF30fgf0jpd1SePWIXlPw4PcB9IljQmR+pME33KGXwlP2jfRPsv816VlTKnu/rYDJk2Ig+apQAenp0zvu612pQK38ae/MaHl9PFBEeLUw=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:00:41.985663 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-2add235c-9ce5-4ff3-a003-c90ee49dedba tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Getting quotas for project 337bc9a50c6846ada58b194c94d0f193. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:00:42.017564 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-2add235c-9ce5-4ff3-a003-c90ee49dedba tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Getting quotas for user 968cbe62235f472fb9002171f19e1375 and project 337bc9a50c6846ada58b194c94d0f193. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:00:42.123498 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2add235c-9ce5-4ff3-a003-c90ee49dedba tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.940257 Sep 16 13:00:42.128525 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1693/3284] 10.222.0.67 () {60 vars in 1159 bytes} [Fri Sep 16 13:00:41 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:00:42.163412 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e1322491-9f9a-495a-948d-934d2694ca43 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:42.166929 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e1322491-9f9a-495a-948d-934d2694ca43 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: cbc794b1-563e-49d1-92d9-86cea9a9bf75] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:42.219350 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1322491-9f9a-495a-948d-934d2694ca43 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:42.220263 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1322491-9f9a-495a-948d-934d2694ca43 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:42.223165 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1322491-9f9a-495a-948d-934d2694ca43 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:42.229366 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1322491-9f9a-495a-948d-934d2694ca43 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:42.229978 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1322491-9f9a-495a-948d-934d2694ca43 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:42.238924 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1322491-9f9a-495a-948d-934d2694ca43 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:43.062240 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5bb812e9-3e14-4256-bb9d-641bbdef01ef tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:43.081565 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5bb812e9-3e14-4256-bb9d-641bbdef01ef tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:43.085931 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5bb812e9-3e14-4256-bb9d-641bbdef01ef tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:43.089576 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5bb812e9-3e14-4256-bb9d-641bbdef01ef tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1751 microversion: 2.42 time: 2.052941 Sep 16 13:00:43.093149 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1592/3285] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:00:41 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1751 bytes in 2057 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:00:43.099913 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1204516f-3619-4854-a901-2dd1ecd8549e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:43.104556 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-1204516f-3619-4854-a901-2dd1ecd8549e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:43.125276 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1204516f-3619-4854-a901-2dd1ecd8549e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:43.125935 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1204516f-3619-4854-a901-2dd1ecd8549e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:43.126487 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1204516f-3619-4854-a901-2dd1ecd8549e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:43.129051 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1204516f-3619-4854-a901-2dd1ecd8549e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:43.129653 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1204516f-3619-4854-a901-2dd1ecd8549e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:43.133952 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1204516f-3619-4854-a901-2dd1ecd8549e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:43.181956 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e1322491-9f9a-495a-948d-934d2694ca43 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0e6121124d4a15a63ac359bff5aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc3ef4fd0374ac4b74900369ca779aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:43.202587 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e1322491-9f9a-495a-948d-934d2694ca43 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75" status: 200 len: 1318 microversion: 2.1 time: 1.070516 Sep 16 13:00:43.207602 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1694/3286] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:42 2022] GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75 => generated 1318 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:43.227724 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f7eba9aa-4be9-470a-92cb-4088f22e9a58 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1862747981", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9c660356-b242-47cf-8b53-5c05af82a4ce"}], "security_groups": [{"name": "tempest-securitygroup--476671575"}], "key_name": "tempest-keypair-1492500719", "user_data": "}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:00:43.818918 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-f7eba9aa-4be9-470a-92cb-4088f22e9a58 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] validate_networks() for [('9c660356-b242-47cf-8b53-5c05af82a4ce', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:00:44.283674 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1204516f-3619-4854-a901-2dd1ecd8549e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:44.300834 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1204516f-3619-4854-a901-2dd1ecd8549e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 200 len: 1507 microversion: 2.1 time: 1.206476 Sep 16 13:00:44.318993 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1593/3287] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:43 2022] GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 1507 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:44.334125 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5d2c4927-09f3-4e9c-8fe2-ebe35d613ccf tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:44.336470 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5d2c4927-09f3-4e9c-8fe2-ebe35d613ccf tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:44.358725 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5d2c4927-09f3-4e9c-8fe2-ebe35d613ccf tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:44.362118 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5d2c4927-09f3-4e9c-8fe2-ebe35d613ccf tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:44.362789 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5d2c4927-09f3-4e9c-8fe2-ebe35d613ccf tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:44.363632 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5d2c4927-09f3-4e9c-8fe2-ebe35d613ccf tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:44.364772 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5d2c4927-09f3-4e9c-8fe2-ebe35d613ccf tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:44.370213 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5d2c4927-09f3-4e9c-8fe2-ebe35d613ccf tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:46.492546 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5d2c4927-09f3-4e9c-8fe2-ebe35d613ccf tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:46.508058 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5d2c4927-09f3-4e9c-8fe2-ebe35d613ccf tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:46.509582 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5d2c4927-09f3-4e9c-8fe2-ebe35d613ccf tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:46.510804 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5d2c4927-09f3-4e9c-8fe2-ebe35d613ccf tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1751 microversion: 2.42 time: 2.199919 Sep 16 13:00:46.528285 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1594/3288] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:00:44 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1751 bytes in 2217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:00:46.556475 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b8ec9f22-06dd-4dbe-856f-52d529b39c64 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:46.559350 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b8ec9f22-06dd-4dbe-856f-52d529b39c64 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: cbc794b1-563e-49d1-92d9-86cea9a9bf75] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:46.562687 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-f7eba9aa-4be9-470a-92cb-4088f22e9a58 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:00:46.563208 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-f7eba9aa-4be9-470a-92cb-4088f22e9a58 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:00:46.563850 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-f7eba9aa-4be9-470a-92cb-4088f22e9a58 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:00:46.564457 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-f7eba9aa-4be9-470a-92cb-4088f22e9a58 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:00:46.565824 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-f7eba9aa-4be9-470a-92cb-4088f22e9a58 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:00:46.586336 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b8ec9f22-06dd-4dbe-856f-52d529b39c64 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:46.595397 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b8ec9f22-06dd-4dbe-856f-52d529b39c64 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:46.595925 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b8ec9f22-06dd-4dbe-856f-52d529b39c64 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:46.596978 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b8ec9f22-06dd-4dbe-856f-52d529b39c64 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:46.602330 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b8ec9f22-06dd-4dbe-856f-52d529b39c64 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:46.604399 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b8ec9f22-06dd-4dbe-856f-52d529b39c64 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:46.606046 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7eba9aa-4be9-470a-92cb-4088f22e9a58 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:46.615270 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7eba9aa-4be9-470a-92cb-4088f22e9a58 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:46.616089 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7eba9aa-4be9-470a-92cb-4088f22e9a58 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:46.619808 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7eba9aa-4be9-470a-92cb-4088f22e9a58 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:46.620577 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7eba9aa-4be9-470a-92cb-4088f22e9a58 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:46.630098 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7eba9aa-4be9-470a-92cb-4088f22e9a58 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:46.664501 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=100 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:00:46.709384 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-f7eba9aa-4be9-470a-92cb-4088f22e9a58 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Getting quotas for project e3f3ad027f264333a95500ef691b7815. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:00:46.727677 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-f7eba9aa-4be9-470a-92cb-4088f22e9a58 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Getting quotas for user ba5727658d094c049054160852163cee and project e3f3ad027f264333a95500ef691b7815. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:00:46.769134 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f7eba9aa-4be9-470a-92cb-4088f22e9a58 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:00:46.771768 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f7eba9aa-4be9-470a-92cb-4088f22e9a58 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:00:46.894432 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f7eba9aa-4be9-470a-92cb-4088f22e9a58 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.681944 Sep 16 13:00:46.896942 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1695/3289] 10.222.0.67 () {62 vars in 1188 bytes} [Fri Sep 16 13:00:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 3689 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 16 13:00:46.907585 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-213b84b6-5448-4276-9635-e414d33c11d2 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:46.911875 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-213b84b6-5448-4276-9635-e414d33c11d2 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:46.926075 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-213b84b6-5448-4276-9635-e414d33c11d2 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:46.930758 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-213b84b6-5448-4276-9635-e414d33c11d2 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:46.933868 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-213b84b6-5448-4276-9635-e414d33c11d2 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:46.935341 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-213b84b6-5448-4276-9635-e414d33c11d2 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:46.936402 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-213b84b6-5448-4276-9635-e414d33c11d2 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:46.938815 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-213b84b6-5448-4276-9635-e414d33c11d2 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:47.841330 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-b8ec9f22-06dd-4dbe-856f-52d529b39c64 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0e6121124d4a15a63ac359bff5aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc3ef4fd0374ac4b74900369ca779aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:47.866038 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b8ec9f22-06dd-4dbe-856f-52d529b39c64 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75" status: 200 len: 1318 microversion: 2.1 time: 1.329865 Sep 16 13:00:47.866248 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1595/3290] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:46 2022] GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75 => generated 1318 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:47.880158 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-dff5919d-fe95-4a92-91f0-5429d39a7ccc tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:47.881668 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-dff5919d-fe95-4a92-91f0-5429d39a7ccc tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:47.894612 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dff5919d-fe95-4a92-91f0-5429d39a7ccc tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:47.908813 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dff5919d-fe95-4a92-91f0-5429d39a7ccc tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:47.913907 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dff5919d-fe95-4a92-91f0-5429d39a7ccc tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:47.914818 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dff5919d-fe95-4a92-91f0-5429d39a7ccc tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:47.915734 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dff5919d-fe95-4a92-91f0-5429d39a7ccc tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:47.921026 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dff5919d-fe95-4a92-91f0-5429d39a7ccc tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:48.877861 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-dff5919d-fe95-4a92-91f0-5429d39a7ccc tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:48.887879 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-dff5919d-fe95-4a92-91f0-5429d39a7ccc tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:48.897859 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-dff5919d-fe95-4a92-91f0-5429d39a7ccc tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:48.899054 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-dff5919d-fe95-4a92-91f0-5429d39a7ccc tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1286 microversion: 2.20 time: 1.031770 Sep 16 13:00:48.916846 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1596/3291] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:00:47 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1286 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:00:48.922647 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1a4838f0-2329-47c6-ac42-bb244b547fe3 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:48.923575 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-1a4838f0-2329-47c6-ac42-bb244b547fe3 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:48.930393 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1a4838f0-2329-47c6-ac42-bb244b547fe3 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:48.932754 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1a4838f0-2329-47c6-ac42-bb244b547fe3 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:48.936427 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1a4838f0-2329-47c6-ac42-bb244b547fe3 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:48.937989 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1a4838f0-2329-47c6-ac42-bb244b547fe3 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:48.940661 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1a4838f0-2329-47c6-ac42-bb244b547fe3 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:48.941221 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1a4838f0-2329-47c6-ac42-bb244b547fe3 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:49.036731 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-213b84b6-5448-4276-9635-e414d33c11d2 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:49.051634 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-213b84b6-5448-4276-9635-e414d33c11d2 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 200 len: 1507 microversion: 2.1 time: 2.150105 Sep 16 13:00:49.052658 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1696/3292] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:46 2022] GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 1507 bytes in 2155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:49.559201 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-29439629-232f-4902-9478-13fb92d0b6b2 tempest-FloatingIPsNegativeTestJSON-1498048569 tempest-FloatingIPsNegativeTestJSON-1498048569-project] Calling method '.version_select at 0x7f10399b74c0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:49.790108 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-29439629-232f-4902-9478-13fb92d0b6b2 tempest-FloatingIPsNegativeTestJSON-1498048569 tempest-FloatingIPsNegativeTestJSON-1498048569-project] 10.222.0.67 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.736306 Sep 16 13:00:49.792790 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1697/3293] 10.222.0.67 () {58 vars in 1149 bytes} [Fri Sep 16 13:00:49 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:00:49.794274 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1a4838f0-2329-47c6-ac42-bb244b547fe3 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:49.811968 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a02cb12f-5bad-4997-ac9a-df13e1e25888 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:49.813721 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a02cb12f-5bad-4997-ac9a-df13e1e25888 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: cbc794b1-563e-49d1-92d9-86cea9a9bf75] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:49.823562 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1a4838f0-2329-47c6-ac42-bb244b547fe3 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:49.831730 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1a4838f0-2329-47c6-ac42-bb244b547fe3 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:49.837496 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1a4838f0-2329-47c6-ac42-bb244b547fe3 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1797 microversion: 2.42 time: 0.915910 Sep 16 13:00:49.839861 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1597/3294] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:00:48 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1797 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:00:49.841285 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a02cb12f-5bad-4997-ac9a-df13e1e25888 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:49.846601 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a02cb12f-5bad-4997-ac9a-df13e1e25888 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:49.849486 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a02cb12f-5bad-4997-ac9a-df13e1e25888 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:49.850421 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a02cb12f-5bad-4997-ac9a-df13e1e25888 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:49.851034 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a02cb12f-5bad-4997-ac9a-df13e1e25888 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:49.852557 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a02cb12f-5bad-4997-ac9a-df13e1e25888 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:49.858380 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8fdf7dcf-1971-4c0a-a934-f67008dfc409 tempest-FloatingIPsNegativeTestJSON-1498048569 tempest-FloatingIPsNegativeTestJSON-1498048569-project] Action: 'create', calling method: .version_select at 0x7f103542b700>, body: {"pool": "non_exist_pool"} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:00:50.142875 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-8fdf7dcf-1971-4c0a-a934-f67008dfc409 tempest-FloatingIPsNegativeTestJSON-1498048569 tempest-FloatingIPsNegativeTestJSON-1498048569-project] HTTP exception thrown: Floating IP pool not found. Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8fdf7dcf-1971-4c0a-a934-f67008dfc409 tempest-FloatingIPsNegativeTestJSON-1498048569 tempest-FloatingIPsNegativeTestJSON-1498048569-project] Request method failure captured: Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 26 Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHOA9CnAn-IAndzaL26wgJ69ShW0C-PfnwI2mJ_JrwgvA44TOkdBMfGtFnPyYWNjG0Ii0lBOeZejMCc_4D7TTEHTl0bCLJGp7QPQsxojs6dxIIXZvJnNZR5kRhBUB_temx9vLZAnquuTle7mjnmGVb8WwhgXafdLVhl62-5hfF59aRY Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 76c78ef5e90d4b799519b8b2d1d48060 Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1498048569 Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/76c78ef5e90d4b799519b8b2d1d48060"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/76c78ef5e90d4b799519b8b2d1d48060"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_76c78ef5e90d4b799519b8b2d1d48060", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/76c78ef5e90d4b799519b8b2d1d48060"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1498048569 Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 76c78ef5e90d4b799519b8b2d1d48060 Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1498048569 Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-FloatingIPsNegativeTestJSON-1498048569-project Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: ddf32e6a1c884a84813c700cf87d6501 Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1498048569-project Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: {"pool": "non_exist_pool"} Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: exception: Floating IP pool not found. Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'body': {'pool': 'non_exist_pool'}} Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:00:50.146353 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:00:50.151809 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Sep 16 13:00:50.151809 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:00:50.153403 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8fdf7dcf-1971-4c0a-a934-f67008dfc409 tempest-FloatingIPsNegativeTestJSON-1498048569 tempest-FloatingIPsNegativeTestJSON-1498048569-project] Returning 404 to user: Floating IP pool not found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:00:50.154285 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8fdf7dcf-1971-4c0a-a934-f67008dfc409 tempest-FloatingIPsNegativeTestJSON-1498048569 tempest-FloatingIPsNegativeTestJSON-1498048569-project] 10.222.0.67 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.312012 Sep 16 13:00:50.155140 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1598/3295] 10.222.0.67 () {60 vars in 1170 bytes} [Fri Sep 16 13:00:49 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 314 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 13:00:50.175013 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a248d519-f004-412f-9dfd-886aad14deb1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:50.176168 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a248d519-f004-412f-9dfd-886aad14deb1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:50.185684 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a248d519-f004-412f-9dfd-886aad14deb1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:50.186399 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a248d519-f004-412f-9dfd-886aad14deb1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:50.187204 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a248d519-f004-412f-9dfd-886aad14deb1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:50.188084 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a248d519-f004-412f-9dfd-886aad14deb1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:50.188711 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a248d519-f004-412f-9dfd-886aad14deb1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:50.189292 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a248d519-f004-412f-9dfd-886aad14deb1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:50.385058 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a248d519-f004-412f-9dfd-886aad14deb1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:50.396395 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a248d519-f004-412f-9dfd-886aad14deb1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:50.404909 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a248d519-f004-412f-9dfd-886aad14deb1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:50.409731 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a248d519-f004-412f-9dfd-886aad14deb1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1340 microversion: 2.20 time: 0.253244 Sep 16 13:00:50.412247 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1599/3296] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:00:50 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1340 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:00:50.434532 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-eea7944f-fccd-4057-bc98-115a88c6161b req-4288ad74-6398-4e43-b21c-3606be52d7c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbc794b1-563e-49d1-92d9-86cea9a9bf75", "tag": "62dbe1ae-a63f-40d9-b089-d8e7f6ba2713"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:00:50.459987 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-eea7944f-fccd-4057-bc98-115a88c6161b req-4288ad74-6398-4e43-b21c-3606be52d7c0 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:50.465471 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-eea7944f-fccd-4057-bc98-115a88c6161b req-4288ad74-6398-4e43-b21c-3606be52d7c0 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:50.466173 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-eea7944f-fccd-4057-bc98-115a88c6161b req-4288ad74-6398-4e43-b21c-3606be52d7c0 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:50.501518 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-eea7944f-fccd-4057-bc98-115a88c6161b req-4288ad74-6398-4e43-b21c-3606be52d7c0 service nova] Creating event network-changed:62dbe1ae-a63f-40d9-b089-d8e7f6ba2713 for instance cbc794b1-563e-49d1-92d9-86cea9a9bf75 on n-h2-858094-4 Sep 16 13:00:50.509235 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-eea7944f-fccd-4057-bc98-115a88c6161b req-4288ad74-6398-4e43-b21c-3606be52d7c0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084629 Sep 16 13:00:50.512014 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1600/3297] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:00:50.529717 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d5b04b85-3758-4fa4-a15f-f86937133174 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:50.530723 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d5b04b85-3758-4fa4-a15f-f86937133174 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:50.542142 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d5b04b85-3758-4fa4-a15f-f86937133174 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:50.546850 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d5b04b85-3758-4fa4-a15f-f86937133174 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:50.547593 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d5b04b85-3758-4fa4-a15f-f86937133174 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:50.548562 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d5b04b85-3758-4fa4-a15f-f86937133174 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:50.549186 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d5b04b85-3758-4fa4-a15f-f86937133174 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:50.549791 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d5b04b85-3758-4fa4-a15f-f86937133174 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:51.722795 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a02cb12f-5bad-4997-ac9a-df13e1e25888 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0e6121124d4a15a63ac359bff5aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc3ef4fd0374ac4b74900369ca779aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:51.738397 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a02cb12f-5bad-4997-ac9a-df13e1e25888 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75" status: 200 len: 1318 microversion: 2.1 time: 1.941633 Sep 16 13:00:51.740429 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1698/3298] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:49 2022] GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75 => generated 1318 bytes in 1947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:51.753144 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f73167f5-07c3-4aaf-9a02-468256de9916 tempest-FloatingIPsNegativeTestJSON-1498048569 tempest-FloatingIPsNegativeTestJSON-1498048569-project] Calling method '.version_select at 0x7f10399b7820>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:52.165718 n-d-858094-4 devstack@n-api.service[128779]: DEBUG neutronclient.v2_0.client [None req-f73167f5-07c3-4aaf-9a02-468256de9916 tempest-FloatingIPsNegativeTestJSON-1498048569 tempest-FloatingIPsNegativeTestJSON-1498048569-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 2e3382e0-a4cb-433b-935c-d45e04e1b084 could not be found", "detail": ""}} {{(pid=128779) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 13:00:52.166587 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-f73167f5-07c3-4aaf-9a02-468256de9916 tempest-FloatingIPsNegativeTestJSON-1498048569 tempest-FloatingIPsNegativeTestJSON-1498048569-project] HTTP exception thrown: Floating IP not found for ID 2e3382e0-a4cb-433b-935c-d45e04e1b084 Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f73167f5-07c3-4aaf-9a02-468256de9916 tempest-FloatingIPsNegativeTestJSON-1498048569 tempest-FloatingIPsNegativeTestJSON-1498048569-project] Request method failure captured: Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/os-floating-ips/2e3382e0-a4cb-433b-935c-d45e04e1b084 HTTP/1.1 Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHOA9CnAn-IAndzaL26wgJ69ShW0C-PfnwI2mJ_JrwgvA44TOkdBMfGtFnPyYWNjG0Ii0lBOeZejMCc_4D7TTEHTl0bCLJGp7QPQsxojs6dxIIXZvJnNZR5kRhBUB_temx9vLZAnquuTle7mjnmGVb8WwhgXafdLVhl62-5hfF59aRY Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 76c78ef5e90d4b799519b8b2d1d48060 Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1498048569 Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/76c78ef5e90d4b799519b8b2d1d48060"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/76c78ef5e90d4b799519b8b2d1d48060"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_76c78ef5e90d4b799519b8b2d1d48060", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/76c78ef5e90d4b799519b8b2d1d48060"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1498048569 Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 76c78ef5e90d4b799519b8b2d1d48060 Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1498048569 Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-FloatingIPsNegativeTestJSON-1498048569-project Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: ddf32e6a1c884a84813c700cf87d6501 Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1498048569-project Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: exception: Floating IP not found for ID 2e3382e0-a4cb-433b-935c-d45e04e1b084 Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '2e3382e0-a4cb-433b-935c-d45e04e1b084'} Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 2e3382e0-a4cb-433b-935c-d45e04e1b084 could not be found Sep 16 13:00:52.169537 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c5e0ebb-1286-4fa0-b829-acf759d85729'] Sep 16 13:00:52.174172 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:00:52.174172 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:00:52.174172 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:00:52.174172 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:00:52.174172 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 16 13:00:52.174172 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 16 13:00:52.174172 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 16 13:00:52.174172 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 16 13:00:52.174172 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 2e3382e0-a4cb-433b-935c-d45e04e1b084. Sep 16 13:00:52.174172 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:00:52.174172 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:00:52.174172 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:00:52.174172 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:00:52.174172 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:00:52.174172 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:00:52.174172 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:00:52.174172 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:00:52.174172 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:00:52.174172 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:00:52.174172 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:00:52.174172 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:00:52.174172 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 16 13:00:52.174172 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 16 13:00:52.174172 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 2e3382e0-a4cb-433b-935c-d45e04e1b084 Sep 16 13:00:52.174172 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:00:52.174172 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:00:52.174172 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:00:52.174172 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:00:52.174172 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:00:52.174172 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:00:52.174172 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:00:52.174172 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:00:52.174172 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 2e3382e0-a4cb-433b-935c-d45e04e1b084 Sep 16 13:00:52.174172 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:00:52.179229 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f73167f5-07c3-4aaf-9a02-468256de9916 tempest-FloatingIPsNegativeTestJSON-1498048569 tempest-FloatingIPsNegativeTestJSON-1498048569-project] Returning 404 to user: Floating IP not found for ID 2e3382e0-a4cb-433b-935c-d45e04e1b084 {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:00:52.179229 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f73167f5-07c3-4aaf-9a02-468256de9916 tempest-FloatingIPsNegativeTestJSON-1498048569 tempest-FloatingIPsNegativeTestJSON-1498048569-project] 10.222.0.67 "DELETE /compute/v2.1/os-floating-ips/2e3382e0-a4cb-433b-935c-d45e04e1b084" status: 404 len: 111 microversion: 2.1 time: 0.437044 Sep 16 13:00:52.179736 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1699/3299] 10.222.0.67 () {58 vars in 1263 bytes} [Fri Sep 16 13:00:51 2022] DELETE /compute/v2.1/os-floating-ips/2e3382e0-a4cb-433b-935c-d45e04e1b084 => generated 111 bytes in 438 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:00:52.192499 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-eec69cde-c3fc-4c19-abdd-2884798ca21e tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:52.196267 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-eec69cde-c3fc-4c19-abdd-2884798ca21e tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:52.211630 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eec69cde-c3fc-4c19-abdd-2884798ca21e tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:52.212508 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eec69cde-c3fc-4c19-abdd-2884798ca21e tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:52.213535 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eec69cde-c3fc-4c19-abdd-2884798ca21e tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:52.217278 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eec69cde-c3fc-4c19-abdd-2884798ca21e tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:52.217929 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eec69cde-c3fc-4c19-abdd-2884798ca21e tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:52.218532 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eec69cde-c3fc-4c19-abdd-2884798ca21e tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:52.243938 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d5b04b85-3758-4fa4-a15f-f86937133174 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:52.281237 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d5b04b85-3758-4fa4-a15f-f86937133174 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 200 len: 1507 microversion: 2.1 time: 1.761666 Sep 16 13:00:52.292165 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1601/3300] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:50 2022] GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 1507 bytes in 1773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:52.307411 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e1b3f6ed-2b8e-478e-a04f-08bd1f5ab0f1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:52.308172 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e1b3f6ed-2b8e-478e-a04f-08bd1f5ab0f1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:52.328306 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1b3f6ed-2b8e-478e-a04f-08bd1f5ab0f1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:52.329708 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1b3f6ed-2b8e-478e-a04f-08bd1f5ab0f1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:52.329708 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1b3f6ed-2b8e-478e-a04f-08bd1f5ab0f1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:52.330073 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1b3f6ed-2b8e-478e-a04f-08bd1f5ab0f1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:52.331022 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1b3f6ed-2b8e-478e-a04f-08bd1f5ab0f1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:52.331472 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1b3f6ed-2b8e-478e-a04f-08bd1f5ab0f1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:52.638955 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e1b3f6ed-2b8e-478e-a04f-08bd1f5ab0f1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:52.658176 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e1b3f6ed-2b8e-478e-a04f-08bd1f5ab0f1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:52.659678 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e1b3f6ed-2b8e-478e-a04f-08bd1f5ab0f1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:52.660863 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e1b3f6ed-2b8e-478e-a04f-08bd1f5ab0f1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1340 microversion: 2.20 time: 0.370295 Sep 16 13:00:52.661436 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1602/3301] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:00:52 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1340 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:00:52.676922 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-10945d81-ffef-4e2c-9bd7-523efac94b75 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-330179331", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9af47dcf-ef82-4350-bfb1-14c70158aca5"}], "security_groups": [{"name": "tempest-securitygroup--190602253"}], "key_name": "tempest-keypair-833490", "user_data": "}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:00:53.107498 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-eec69cde-c3fc-4c19-abdd-2884798ca21e tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:53.119154 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-eec69cde-c3fc-4c19-abdd-2884798ca21e tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:53.129681 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-eec69cde-c3fc-4c19-abdd-2884798ca21e tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:53.131043 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-eec69cde-c3fc-4c19-abdd-2884798ca21e tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1843 microversion: 2.42 time: 0.950090 Sep 16 13:00:53.132530 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1700/3302] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:00:52 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1843 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:00:53.150805 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5dd4c15d-be69-4b16-98b6-d6c61908d83a tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:53.155749 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5dd4c15d-be69-4b16-98b6-d6c61908d83a tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: cbc794b1-563e-49d1-92d9-86cea9a9bf75] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:53.173017 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5dd4c15d-be69-4b16-98b6-d6c61908d83a tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:53.173595 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5dd4c15d-be69-4b16-98b6-d6c61908d83a tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:53.174276 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5dd4c15d-be69-4b16-98b6-d6c61908d83a tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:53.177258 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5dd4c15d-be69-4b16-98b6-d6c61908d83a tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:53.178002 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5dd4c15d-be69-4b16-98b6-d6c61908d83a tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:53.182942 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5dd4c15d-be69-4b16-98b6-d6c61908d83a tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:53.205599 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-10945d81-ffef-4e2c-9bd7-523efac94b75 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] validate_networks() for [('9af47dcf-ef82-4350-bfb1-14c70158aca5', None, None, None, None, None)] {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:00:54.047020 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5dd4c15d-be69-4b16-98b6-d6c61908d83a tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0e6121124d4a15a63ac359bff5aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc3ef4fd0374ac4b74900369ca779aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:54.058289 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5dd4c15d-be69-4b16-98b6-d6c61908d83a tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75" status: 200 len: 1318 microversion: 2.1 time: 0.924176 Sep 16 13:00:54.080116 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1701/3303] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:53 2022] GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75 => generated 1318 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:54.097827 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7428366a-fd9c-4c13-8bf0-3a41bb7ed050 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:54.098561 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7428366a-fd9c-4c13-8bf0-3a41bb7ed050 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:54.118577 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7428366a-fd9c-4c13-8bf0-3a41bb7ed050 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:54.121316 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7428366a-fd9c-4c13-8bf0-3a41bb7ed050 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:54.126964 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7428366a-fd9c-4c13-8bf0-3a41bb7ed050 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:54.130051 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7428366a-fd9c-4c13-8bf0-3a41bb7ed050 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:54.130712 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7428366a-fd9c-4c13-8bf0-3a41bb7ed050 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:54.134052 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7428366a-fd9c-4c13-8bf0-3a41bb7ed050 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:55.941083 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7428366a-fd9c-4c13-8bf0-3a41bb7ed050 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:55.958371 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7428366a-fd9c-4c13-8bf0-3a41bb7ed050 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 200 len: 1507 microversion: 2.1 time: 1.873796 Sep 16 13:00:55.962225 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1702/3304] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:54 2022] GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 1507 bytes in 1882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:55.975259 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-10945d81-ffef-4e2c-9bd7-523efac94b75 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:00:55.976359 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-10945d81-ffef-4e2c-9bd7-523efac94b75 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:00:55.977098 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-10945d81-ffef-4e2c-9bd7-523efac94b75 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:00:55.977755 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-10945d81-ffef-4e2c-9bd7-523efac94b75 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:00:55.978393 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-10945d81-ffef-4e2c-9bd7-523efac94b75 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:00:56.000030 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d787a94d-d83a-4f0f-aff3-a2b631d321c6 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:56.004413 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d787a94d-d83a-4f0f-aff3-a2b631d321c6 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:56.005334 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-10945d81-ffef-4e2c-9bd7-523efac94b75 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:56.011812 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-10945d81-ffef-4e2c-9bd7-523efac94b75 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:56.013017 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-10945d81-ffef-4e2c-9bd7-523efac94b75 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:56.014081 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-10945d81-ffef-4e2c-9bd7-523efac94b75 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:56.016365 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-10945d81-ffef-4e2c-9bd7-523efac94b75 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:56.023810 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-10945d81-ffef-4e2c-9bd7-523efac94b75 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:56.050006 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d787a94d-d83a-4f0f-aff3-a2b631d321c6 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:56.057373 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d787a94d-d83a-4f0f-aff3-a2b631d321c6 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:56.057850 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d787a94d-d83a-4f0f-aff3-a2b631d321c6 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:56.063477 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d787a94d-d83a-4f0f-aff3-a2b631d321c6 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:56.064635 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d787a94d-d83a-4f0f-aff3-a2b631d321c6 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:56.065632 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d787a94d-d83a-4f0f-aff3-a2b631d321c6 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:56.086337 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-10945d81-ffef-4e2c-9bd7-523efac94b75 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Getting quotas for project 337bc9a50c6846ada58b194c94d0f193. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:00:56.117635 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-10945d81-ffef-4e2c-9bd7-523efac94b75 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Getting quotas for user 968cbe62235f472fb9002171f19e1375 and project 337bc9a50c6846ada58b194c94d0f193. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:00:56.164747 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-10945d81-ffef-4e2c-9bd7-523efac94b75 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:00:56.175927 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-10945d81-ffef-4e2c-9bd7-523efac94b75 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:00:56.311918 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-10945d81-ffef-4e2c-9bd7-523efac94b75 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.646346 Sep 16 13:00:56.317413 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1603/3305] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 13:00:52 2022] POST /compute/v2.1/servers => generated 408 bytes in 3655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 13:00:56.329562 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0d3b0d29-cc84-4929-8e3e-7ceb9325ba7f tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:56.330507 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0d3b0d29-cc84-4929-8e3e-7ceb9325ba7f tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:56.349315 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0d3b0d29-cc84-4929-8e3e-7ceb9325ba7f tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:56.349973 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0d3b0d29-cc84-4929-8e3e-7ceb9325ba7f tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:56.350449 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0d3b0d29-cc84-4929-8e3e-7ceb9325ba7f tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:56.353456 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0d3b0d29-cc84-4929-8e3e-7ceb9325ba7f tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:56.354186 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0d3b0d29-cc84-4929-8e3e-7ceb9325ba7f tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:56.354712 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0d3b0d29-cc84-4929-8e3e-7ceb9325ba7f tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:56.359223 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d787a94d-d83a-4f0f-aff3-a2b631d321c6 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:56.378022 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d787a94d-d83a-4f0f-aff3-a2b631d321c6 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:56.382840 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d787a94d-d83a-4f0f-aff3-a2b631d321c6 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:56.385366 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d787a94d-d83a-4f0f-aff3-a2b631d321c6 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1340 microversion: 2.20 time: 0.420180 Sep 16 13:00:56.406918 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1703/3306] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:00:55 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1340 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:00:56.412150 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bbf985f4-cc46-4177-a951-06d9d0477b1c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:56.431774 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bbf985f4-cc46-4177-a951-06d9d0477b1c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: cbc794b1-563e-49d1-92d9-86cea9a9bf75] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:56.442029 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bbf985f4-cc46-4177-a951-06d9d0477b1c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:56.442532 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bbf985f4-cc46-4177-a951-06d9d0477b1c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:56.453031 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bbf985f4-cc46-4177-a951-06d9d0477b1c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:56.453843 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bbf985f4-cc46-4177-a951-06d9d0477b1c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:56.454330 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bbf985f4-cc46-4177-a951-06d9d0477b1c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:56.459899 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bbf985f4-cc46-4177-a951-06d9d0477b1c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:56.685772 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:00:56.748319 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=16 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:00:57.149462 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0d3b0d29-cc84-4929-8e3e-7ceb9325ba7f tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:57.170494 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0d3b0d29-cc84-4929-8e3e-7ceb9325ba7f tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:57.172375 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0d3b0d29-cc84-4929-8e3e-7ceb9325ba7f tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:57.173589 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0d3b0d29-cc84-4929-8e3e-7ceb9325ba7f tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1843 microversion: 2.42 time: 0.854861 Sep 16 13:00:57.174154 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1604/3307] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:00:56 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1843 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:00:57.178754 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e636bd07-a74f-44de-bdb1-0811de115c22 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:57.179365 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e636bd07-a74f-44de-bdb1-0811de115c22 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:57.475569 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e636bd07-a74f-44de-bdb1-0811de115c22 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:57.485266 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e636bd07-a74f-44de-bdb1-0811de115c22 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1234 microversion: 2.1 time: 0.310053 Sep 16 13:00:57.485870 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1605/3308] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:57 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1234 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:57.520677 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d1f64d4d-8d34-417a-95a0-dcf535169b2b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:57.521697 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d1f64d4d-8d34-417a-95a0-dcf535169b2b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:57.531062 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d1f64d4d-8d34-417a-95a0-dcf535169b2b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:57.535113 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d1f64d4d-8d34-417a-95a0-dcf535169b2b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:57.535587 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d1f64d4d-8d34-417a-95a0-dcf535169b2b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:57.536366 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d1f64d4d-8d34-417a-95a0-dcf535169b2b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:57.536830 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d1f64d4d-8d34-417a-95a0-dcf535169b2b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:57.537254 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d1f64d4d-8d34-417a-95a0-dcf535169b2b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:57.801974 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bbf985f4-cc46-4177-a951-06d9d0477b1c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0e6121124d4a15a63ac359bff5aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc3ef4fd0374ac4b74900369ca779aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:57.814135 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bbf985f4-cc46-4177-a951-06d9d0477b1c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75" status: 200 len: 1318 microversion: 2.1 time: 1.405761 Sep 16 13:00:57.828042 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1704/3309] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:56 2022] GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75 => generated 1318 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:57.842037 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fe496063-7dee-490d-b58a-22b3668a4794 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:57.842671 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fe496063-7dee-490d-b58a-22b3668a4794 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:57.873294 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe496063-7dee-490d-b58a-22b3668a4794 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:57.873802 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe496063-7dee-490d-b58a-22b3668a4794 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:57.883247 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe496063-7dee-490d-b58a-22b3668a4794 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:57.884476 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe496063-7dee-490d-b58a-22b3668a4794 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:57.885137 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe496063-7dee-490d-b58a-22b3668a4794 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:57.885757 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe496063-7dee-490d-b58a-22b3668a4794 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:58.631933 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d1f64d4d-8d34-417a-95a0-dcf535169b2b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:58.647385 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d1f64d4d-8d34-417a-95a0-dcf535169b2b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 200 len: 1507 microversion: 2.1 time: 1.140773 Sep 16 13:00:58.647985 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1606/3310] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:57 2022] GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 1507 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:58.664755 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0fca0b5f-66ae-411e-b259-81763e335135 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:58.665649 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0fca0b5f-66ae-411e-b259-81763e335135 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:58.673554 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0fca0b5f-66ae-411e-b259-81763e335135 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:58.674226 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0fca0b5f-66ae-411e-b259-81763e335135 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:58.674825 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0fca0b5f-66ae-411e-b259-81763e335135 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:58.675668 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0fca0b5f-66ae-411e-b259-81763e335135 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:58.678047 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0fca0b5f-66ae-411e-b259-81763e335135 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:58.678802 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0fca0b5f-66ae-411e-b259-81763e335135 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:59.227004 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fe496063-7dee-490d-b58a-22b3668a4794 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:59.252500 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fe496063-7dee-490d-b58a-22b3668a4794 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:59.266127 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fe496063-7dee-490d-b58a-22b3668a4794 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:59.270713 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fe496063-7dee-490d-b58a-22b3668a4794 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1407 microversion: 2.20 time: 1.441369 Sep 16 13:00:59.272809 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1705/3311] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:00:57 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1407 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:00:59.288149 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fcc37367-d8b8-4b78-b010-7a66ba8f55c5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:59.295766 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fcc37367-d8b8-4b78-b010-7a66ba8f55c5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:59.309447 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcc37367-d8b8-4b78-b010-7a66ba8f55c5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:59.311021 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcc37367-d8b8-4b78-b010-7a66ba8f55c5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:59.311602 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcc37367-d8b8-4b78-b010-7a66ba8f55c5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:59.312690 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcc37367-d8b8-4b78-b010-7a66ba8f55c5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:59.313451 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcc37367-d8b8-4b78-b010-7a66ba8f55c5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:59.314207 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcc37367-d8b8-4b78-b010-7a66ba8f55c5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:59.350768 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0fca0b5f-66ae-411e-b259-81763e335135 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:59.371193 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0fca0b5f-66ae-411e-b259-81763e335135 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:59.379005 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0fca0b5f-66ae-411e-b259-81763e335135 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:59.380269 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0fca0b5f-66ae-411e-b259-81763e335135 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1843 microversion: 2.42 time: 0.730985 Sep 16 13:00:59.380841 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1607/3312] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:00:58 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1843 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:00:59.572819 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fcc37367-d8b8-4b78-b010-7a66ba8f55c5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:00:59.585150 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fcc37367-d8b8-4b78-b010-7a66ba8f55c5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1292 microversion: 2.1 time: 0.310984 Sep 16 13:00:59.588857 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1706/3313] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:59 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1292 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:00:59.615244 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-da3b69f3-9875-4fc8-9adb-4626d5459d68 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:59.622025 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-da3b69f3-9875-4fc8-9adb-4626d5459d68 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: cbc794b1-563e-49d1-92d9-86cea9a9bf75] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:59.624195 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=5 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:00:59.643827 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da3b69f3-9875-4fc8-9adb-4626d5459d68 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:59.648804 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da3b69f3-9875-4fc8-9adb-4626d5459d68 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:59.649480 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da3b69f3-9875-4fc8-9adb-4626d5459d68 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:59.653055 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da3b69f3-9875-4fc8-9adb-4626d5459d68 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:59.655186 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da3b69f3-9875-4fc8-9adb-4626d5459d68 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:59.656074 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da3b69f3-9875-4fc8-9adb-4626d5459d68 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:59.688254 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-c778765a-9a0d-4488-8407-7149fabff68c req-b48deb21-4a17-4559-a465-53a78d1661dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "defaddc3-3750-4d8a-b18a-dd6fdce1dbbf", "tag": "8a23d825-e263-4839-8617-11f3b05818ce"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:00:59.711374 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-c778765a-9a0d-4488-8407-7149fabff68c req-b48deb21-4a17-4559-a465-53a78d1661dc service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:59.713643 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-c778765a-9a0d-4488-8407-7149fabff68c req-b48deb21-4a17-4559-a465-53a78d1661dc service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:59.714992 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-c778765a-9a0d-4488-8407-7149fabff68c req-b48deb21-4a17-4559-a465-53a78d1661dc service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:59.733484 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-c778765a-9a0d-4488-8407-7149fabff68c req-b48deb21-4a17-4559-a465-53a78d1661dc service nova] Creating event network-changed:8a23d825-e263-4839-8617-11f3b05818ce for instance defaddc3-3750-4d8a-b18a-dd6fdce1dbbf on n-h1-858094-4 Sep 16 13:00:59.739648 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-c778765a-9a0d-4488-8407-7149fabff68c req-b48deb21-4a17-4559-a465-53a78d1661dc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.356752 Sep 16 13:00:59.740540 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1608/3314] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:00:59.746237 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-96076ad8-604c-42e7-a015-5ffcec99cbf9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:00:59.747173 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-96076ad8-604c-42e7-a015-5ffcec99cbf9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:00:59.754087 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-96076ad8-604c-42e7-a015-5ffcec99cbf9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:59.755245 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-96076ad8-604c-42e7-a015-5ffcec99cbf9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:59.755867 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-96076ad8-604c-42e7-a015-5ffcec99cbf9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:00:59.756837 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-96076ad8-604c-42e7-a015-5ffcec99cbf9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:00:59.757466 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-96076ad8-604c-42e7-a015-5ffcec99cbf9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:00:59.758278 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-96076ad8-604c-42e7-a015-5ffcec99cbf9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:01.170763 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-da3b69f3-9875-4fc8-9adb-4626d5459d68 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0e6121124d4a15a63ac359bff5aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc3ef4fd0374ac4b74900369ca779aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:01.195297 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-da3b69f3-9875-4fc8-9adb-4626d5459d68 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75" status: 200 len: 1318 microversion: 2.1 time: 1.593066 Sep 16 13:01:01.198386 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1707/3315] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:59 2022] GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75 => generated 1318 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:01.234169 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7b05e4b4-fc53-4978-a11b-806197b68d65 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:01.235082 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7b05e4b4-fc53-4978-a11b-806197b68d65 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:01.258983 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b05e4b4-fc53-4978-a11b-806197b68d65 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:01.262808 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b05e4b4-fc53-4978-a11b-806197b68d65 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:01.263752 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b05e4b4-fc53-4978-a11b-806197b68d65 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:01.267648 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b05e4b4-fc53-4978-a11b-806197b68d65 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:01.269841 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b05e4b4-fc53-4978-a11b-806197b68d65 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:01.271691 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b05e4b4-fc53-4978-a11b-806197b68d65 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:01.496328 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-96076ad8-604c-42e7-a015-5ffcec99cbf9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:01.514242 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-96076ad8-604c-42e7-a015-5ffcec99cbf9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 200 len: 1528 microversion: 2.1 time: 1.772101 Sep 16 13:01:01.516586 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1609/3316] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:00:59 2022] GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 1528 bytes in 1775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:01.533277 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ce2fec75-e370-41c8-9cfe-55307ddb61b6 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:01.535491 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ce2fec75-e370-41c8-9cfe-55307ddb61b6 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:01.547800 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce2fec75-e370-41c8-9cfe-55307ddb61b6 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:01.548340 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce2fec75-e370-41c8-9cfe-55307ddb61b6 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:01.548785 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce2fec75-e370-41c8-9cfe-55307ddb61b6 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:01.549550 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce2fec75-e370-41c8-9cfe-55307ddb61b6 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:01.551212 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce2fec75-e370-41c8-9cfe-55307ddb61b6 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:01.551672 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ce2fec75-e370-41c8-9cfe-55307ddb61b6 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:02.307300 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7b05e4b4-fc53-4978-a11b-806197b68d65 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:02.320445 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7b05e4b4-fc53-4978-a11b-806197b68d65 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:02.330433 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7b05e4b4-fc53-4978-a11b-806197b68d65 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:02.333931 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7b05e4b4-fc53-4978-a11b-806197b68d65 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1407 microversion: 2.20 time: 1.118957 Sep 16 13:01:02.336754 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1708/3317] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:01:01 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1407 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:01:02.349000 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-63f3950d-05af-4464-b9b8-fc065c81e855 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:02.351325 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-63f3950d-05af-4464-b9b8-fc065c81e855 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:02.368929 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63f3950d-05af-4464-b9b8-fc065c81e855 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:02.369936 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63f3950d-05af-4464-b9b8-fc065c81e855 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:02.371292 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63f3950d-05af-4464-b9b8-fc065c81e855 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:02.373442 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63f3950d-05af-4464-b9b8-fc065c81e855 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:02.374302 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63f3950d-05af-4464-b9b8-fc065c81e855 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:02.374974 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63f3950d-05af-4464-b9b8-fc065c81e855 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:02.408179 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:01:02.782331 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ce2fec75-e370-41c8-9cfe-55307ddb61b6 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:02.797524 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ce2fec75-e370-41c8-9cfe-55307ddb61b6 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:02.799140 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ce2fec75-e370-41c8-9cfe-55307ddb61b6 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:02.808962 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ce2fec75-e370-41c8-9cfe-55307ddb61b6 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1852 microversion: 2.42 time: 1.282125 Sep 16 13:01:02.813529 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1610/3318] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:01:01 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1852 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:01:02.837413 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-63f3950d-05af-4464-b9b8-fc065c81e855 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:02.848823 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-63f3950d-05af-4464-b9b8-fc065c81e855 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1292 microversion: 2.1 time: 0.510715 Sep 16 13:01:02.849728 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1709/3319] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:02 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1292 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:02.860688 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e74c3f0b-2fc4-4dc3-8afc-be7e8b8a0229 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:02.865597 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e74c3f0b-2fc4-4dc3-8afc-be7e8b8a0229 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: cbc794b1-563e-49d1-92d9-86cea9a9bf75] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:02.876225 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e74c3f0b-2fc4-4dc3-8afc-be7e8b8a0229 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:02.877074 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e74c3f0b-2fc4-4dc3-8afc-be7e8b8a0229 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:02.877880 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e74c3f0b-2fc4-4dc3-8afc-be7e8b8a0229 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:02.878848 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e74c3f0b-2fc4-4dc3-8afc-be7e8b8a0229 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:02.879701 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e74c3f0b-2fc4-4dc3-8afc-be7e8b8a0229 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:02.880367 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e74c3f0b-2fc4-4dc3-8afc-be7e8b8a0229 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:03.357084 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-e1fe3458-7052-43ec-a728-b62e19a7b4e6 req-068eef38-54fd-4085-9a28-8873bf23a884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbc794b1-563e-49d1-92d9-86cea9a9bf75", "name": "network-vif-plugged", "status": "completed", "tag": "62dbe1ae-a63f-40d9-b089-d8e7f6ba2713"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:01:03.405263 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-e1fe3458-7052-43ec-a728-b62e19a7b4e6 req-068eef38-54fd-4085-9a28-8873bf23a884 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:03.408651 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-e1fe3458-7052-43ec-a728-b62e19a7b4e6 req-068eef38-54fd-4085-9a28-8873bf23a884 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:03.409971 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-e1fe3458-7052-43ec-a728-b62e19a7b4e6 req-068eef38-54fd-4085-9a28-8873bf23a884 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:03.465487 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-e1fe3458-7052-43ec-a728-b62e19a7b4e6 req-068eef38-54fd-4085-9a28-8873bf23a884 service nova] Creating event network-vif-plugged:62dbe1ae-a63f-40d9-b089-d8e7f6ba2713 for instance cbc794b1-563e-49d1-92d9-86cea9a9bf75 on n-h2-858094-4 Sep 16 13:01:03.493227 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-e1fe3458-7052-43ec-a728-b62e19a7b4e6 req-068eef38-54fd-4085-9a28-8873bf23a884 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.668485 Sep 16 13:01:03.494254 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1611/3320] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:01:03.522169 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2af14554-7cbb-407d-934b-05cf36bf899b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:03.524956 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-2af14554-7cbb-407d-934b-05cf36bf899b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:03.562046 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2af14554-7cbb-407d-934b-05cf36bf899b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:03.563763 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e74c3f0b-2fc4-4dc3-8afc-be7e8b8a0229 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0e6121124d4a15a63ac359bff5aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc3ef4fd0374ac4b74900369ca779aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:03.566003 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2af14554-7cbb-407d-934b-05cf36bf899b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:03.567123 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2af14554-7cbb-407d-934b-05cf36bf899b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:03.573482 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2af14554-7cbb-407d-934b-05cf36bf899b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:03.577095 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2af14554-7cbb-407d-934b-05cf36bf899b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:03.579053 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e74c3f0b-2fc4-4dc3-8afc-be7e8b8a0229 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75" status: 200 len: 1318 microversion: 2.1 time: 0.725195 Sep 16 13:01:03.579767 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2af14554-7cbb-407d-934b-05cf36bf899b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:03.597162 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1710/3321] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:02 2022] GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75 => generated 1318 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:03.610536 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1433f3c8-9cd3-4fd9-a5ba-940ac921b49c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:03.613370 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1433f3c8-9cd3-4fd9-a5ba-940ac921b49c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:03.630125 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1433f3c8-9cd3-4fd9-a5ba-940ac921b49c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:03.631006 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1433f3c8-9cd3-4fd9-a5ba-940ac921b49c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:03.631707 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1433f3c8-9cd3-4fd9-a5ba-940ac921b49c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:03.635314 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1433f3c8-9cd3-4fd9-a5ba-940ac921b49c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:03.636244 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1433f3c8-9cd3-4fd9-a5ba-940ac921b49c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:03.636950 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1433f3c8-9cd3-4fd9-a5ba-940ac921b49c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:04.558100 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1433f3c8-9cd3-4fd9-a5ba-940ac921b49c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:04.577514 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1433f3c8-9cd3-4fd9-a5ba-940ac921b49c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:04.579730 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1433f3c8-9cd3-4fd9-a5ba-940ac921b49c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:04.581153 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1433f3c8-9cd3-4fd9-a5ba-940ac921b49c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1407 microversion: 2.20 time: 0.981081 Sep 16 13:01:04.582283 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1711/3322] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:01:03 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1407 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:01:04.587212 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d429b347-c5fc-43e3-aa4b-d903423858b9 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:04.592729 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d429b347-c5fc-43e3-aa4b-d903423858b9 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:04.606757 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d429b347-c5fc-43e3-aa4b-d903423858b9 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:04.613137 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d429b347-c5fc-43e3-aa4b-d903423858b9 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:04.613856 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d429b347-c5fc-43e3-aa4b-d903423858b9 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:04.614750 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d429b347-c5fc-43e3-aa4b-d903423858b9 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:04.615365 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d429b347-c5fc-43e3-aa4b-d903423858b9 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:04.615962 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d429b347-c5fc-43e3-aa4b-d903423858b9 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:05.154406 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-2af14554-7cbb-407d-934b-05cf36bf899b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:05.166780 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2af14554-7cbb-407d-934b-05cf36bf899b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 200 len: 1523 microversion: 2.1 time: 1.666862 Sep 16 13:01:05.171194 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1612/3323] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:03 2022] GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 1523 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:05.191474 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-edb124ac-45c2-43a0-a14a-7f3f59e5ba8b tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:05.192034 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-edb124ac-45c2-43a0-a14a-7f3f59e5ba8b tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:05.218522 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-edb124ac-45c2-43a0-a14a-7f3f59e5ba8b tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:05.224980 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-edb124ac-45c2-43a0-a14a-7f3f59e5ba8b tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:05.230001 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-edb124ac-45c2-43a0-a14a-7f3f59e5ba8b tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:05.231966 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-edb124ac-45c2-43a0-a14a-7f3f59e5ba8b tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:05.243496 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-edb124ac-45c2-43a0-a14a-7f3f59e5ba8b tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:05.243996 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-edb124ac-45c2-43a0-a14a-7f3f59e5ba8b tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:05.393040 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-edb124ac-45c2-43a0-a14a-7f3f59e5ba8b tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:05.411321 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-edb124ac-45c2-43a0-a14a-7f3f59e5ba8b tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1292 microversion: 2.1 time: 0.226986 Sep 16 13:01:05.416667 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1613/3324] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:05 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1292 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:05.440622 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-64bf4c73-4550-475f-95b9-942a5a12b98b tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:05.441034 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-64bf4c73-4550-475f-95b9-942a5a12b98b tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: cbc794b1-563e-49d1-92d9-86cea9a9bf75] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:05.454485 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-64bf4c73-4550-475f-95b9-942a5a12b98b tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:05.459717 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-64bf4c73-4550-475f-95b9-942a5a12b98b tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:05.460499 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-64bf4c73-4550-475f-95b9-942a5a12b98b tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:05.461246 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-64bf4c73-4550-475f-95b9-942a5a12b98b tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:05.462123 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-64bf4c73-4550-475f-95b9-942a5a12b98b tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:05.462570 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-64bf4c73-4550-475f-95b9-942a5a12b98b tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:05.482597 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d429b347-c5fc-43e3-aa4b-d903423858b9 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:05.498260 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d429b347-c5fc-43e3-aa4b-d903423858b9 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:05.499715 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d429b347-c5fc-43e3-aa4b-d903423858b9 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:05.504594 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d429b347-c5fc-43e3-aa4b-d903423858b9 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1852 microversion: 2.42 time: 0.921035 Sep 16 13:01:05.516165 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1712/3325] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:01:04 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1852 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:01:05.516165 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-9ca00ac9-6b1a-47e8-944f-264887d0ae79 req-175883e2-5944-41db-9fef-1aa7a1ec4176 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66413dbd-455f-45f6-b057-39a11a9f2d44", "tag": "3a5b1f2b-2004-4cf4-93bd-f498b62488fe"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:01:05.540576 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9ca00ac9-6b1a-47e8-944f-264887d0ae79 req-175883e2-5944-41db-9fef-1aa7a1ec4176 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:05.541075 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9ca00ac9-6b1a-47e8-944f-264887d0ae79 req-175883e2-5944-41db-9fef-1aa7a1ec4176 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:05.541492 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9ca00ac9-6b1a-47e8-944f-264887d0ae79 req-175883e2-5944-41db-9fef-1aa7a1ec4176 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:05.555545 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-9ca00ac9-6b1a-47e8-944f-264887d0ae79 req-175883e2-5944-41db-9fef-1aa7a1ec4176 service nova] Creating event network-changed:3a5b1f2b-2004-4cf4-93bd-f498b62488fe for instance 66413dbd-455f-45f6-b057-39a11a9f2d44 on n-h1-858094-4 Sep 16 13:01:05.584555 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-9ca00ac9-6b1a-47e8-944f-264887d0ae79 req-175883e2-5944-41db-9fef-1aa7a1ec4176 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067870 Sep 16 13:01:05.588275 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1713/3326] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:01:05.623487 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5bc7bf09-68a9-46e9-9961-8e5499f1adc6 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:05.623775 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5bc7bf09-68a9-46e9-9961-8e5499f1adc6 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:05.647304 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bc7bf09-68a9-46e9-9961-8e5499f1adc6 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:05.648957 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bc7bf09-68a9-46e9-9961-8e5499f1adc6 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:05.649674 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bc7bf09-68a9-46e9-9961-8e5499f1adc6 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:05.651409 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bc7bf09-68a9-46e9-9961-8e5499f1adc6 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:05.652174 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bc7bf09-68a9-46e9-9961-8e5499f1adc6 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:05.652908 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bc7bf09-68a9-46e9-9961-8e5499f1adc6 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:06.057965 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:01:06.456619 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5bc7bf09-68a9-46e9-9961-8e5499f1adc6 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:06.477631 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5bc7bf09-68a9-46e9-9961-8e5499f1adc6 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:06.484801 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5bc7bf09-68a9-46e9-9961-8e5499f1adc6 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:06.485848 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5bc7bf09-68a9-46e9-9961-8e5499f1adc6 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1407 microversion: 2.20 time: 0.882313 Sep 16 13:01:06.491062 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1714/3327] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:01:05 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1407 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:01:06.501129 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-e04dc5df-1b6f-440f-a51e-1e6e69d98154 req-57806aba-e0d6-4d2d-b1ed-ce29267a05e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "464c1886-1201-4b29-b61a-727d5c9e22b6", "name": "network-vif-plugged", "status": "completed", "tag": "116c6c97-9499-4c0e-861c-371e4ecf4ba2"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:01:06.519402 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e04dc5df-1b6f-440f-a51e-1e6e69d98154 req-57806aba-e0d6-4d2d-b1ed-ce29267a05e4 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:06.520552 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e04dc5df-1b6f-440f-a51e-1e6e69d98154 req-57806aba-e0d6-4d2d-b1ed-ce29267a05e4 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:06.521418 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e04dc5df-1b6f-440f-a51e-1e6e69d98154 req-57806aba-e0d6-4d2d-b1ed-ce29267a05e4 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:06.541176 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-e04dc5df-1b6f-440f-a51e-1e6e69d98154 req-57806aba-e0d6-4d2d-b1ed-ce29267a05e4 service nova] Creating event network-vif-plugged:116c6c97-9499-4c0e-861c-371e4ecf4ba2 for instance 464c1886-1201-4b29-b61a-727d5c9e22b6 on n-h2-858094-4 Sep 16 13:01:06.550274 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-e04dc5df-1b6f-440f-a51e-1e6e69d98154 req-57806aba-e0d6-4d2d-b1ed-ce29267a05e4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055628 Sep 16 13:01:06.552286 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1715/3328] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:01:06.560239 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dae61f27-7a02-46a3-84b3-691ce743929d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:06.562344 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dae61f27-7a02-46a3-84b3-691ce743929d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:06.570710 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dae61f27-7a02-46a3-84b3-691ce743929d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:06.572183 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dae61f27-7a02-46a3-84b3-691ce743929d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:06.572945 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dae61f27-7a02-46a3-84b3-691ce743929d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:06.573919 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dae61f27-7a02-46a3-84b3-691ce743929d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:06.574581 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dae61f27-7a02-46a3-84b3-691ce743929d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:06.575313 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dae61f27-7a02-46a3-84b3-691ce743929d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:06.721296 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-64bf4c73-4550-475f-95b9-942a5a12b98b tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0e6121124d4a15a63ac359bff5aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc3ef4fd0374ac4b74900369ca779aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:06.729992 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-64bf4c73-4550-475f-95b9-942a5a12b98b tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75" status: 200 len: 1318 microversion: 2.1 time: 1.296385 Sep 16 13:01:06.730725 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1614/3329] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:05 2022] GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75 => generated 1318 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:06.736549 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e4fa2ff5-f80a-492c-a514-c7a3ac13f9d7 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:06.737762 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e4fa2ff5-f80a-492c-a514-c7a3ac13f9d7 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:06.746197 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e4fa2ff5-f80a-492c-a514-c7a3ac13f9d7 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:06.747602 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e4fa2ff5-f80a-492c-a514-c7a3ac13f9d7 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:06.748326 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e4fa2ff5-f80a-492c-a514-c7a3ac13f9d7 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:06.749263 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e4fa2ff5-f80a-492c-a514-c7a3ac13f9d7 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:06.750241 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e4fa2ff5-f80a-492c-a514-c7a3ac13f9d7 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:06.750749 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e4fa2ff5-f80a-492c-a514-c7a3ac13f9d7 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:07.344013 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dae61f27-7a02-46a3-84b3-691ce743929d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:07.370569 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dae61f27-7a02-46a3-84b3-691ce743929d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 200 len: 1523 microversion: 2.1 time: 0.816846 Sep 16 13:01:07.371164 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1716/3330] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:06 2022] GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 1523 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:07.485127 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=8 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:01:07.833201 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1bab2c0c-7239-455c-9d45-7919217ea41c tempest-ImagesMetadataNegativeTestJSON-293561128 tempest-ImagesMetadataNegativeTestJSON-293561128-project] Calling method '.version_select at 0x7f1039a21700>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:07.870949 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-1bab2c0c-7239-455c-9d45-7919217ea41c tempest-ImagesMetadataNegativeTestJSON-293561128 tempest-ImagesMetadataNegativeTestJSON-293561128-project] HTTP exception thrown: Image not found. Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1bab2c0c-7239-455c-9d45-7919217ea41c tempest-ImagesMetadataNegativeTestJSON-293561128 tempest-ImagesMetadataNegativeTestJSON-293561128-project] Request method failure captured: Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/images/7bc815c5-d9bb-454f-b78c-f5dd2d8bb09f/metadata/os_distro HTTP/1.1 Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHOS1S8Urc0zzff8Dr9myqXSz7s6YA9Uldt2dfe_2GEsFsihTgeGxUPPV3PTdVe0EZ6evFBIs1LH-vmgb5dEJPiqkBlppuZhG05AGc915LM42JOx8rDRA9pAn6S3O-1TM8CiVRh0GP0wrjidLfh3hFz8FQ45s_hf5GTTWg_VSTOKlgI Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 363bd2f84a034903a7535f459d4521bf Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-293561128 Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/363bd2f84a034903a7535f459d4521bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/363bd2f84a034903a7535f459d4521bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_363bd2f84a034903a7535f459d4521bf", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/363bd2f84a034903a7535f459d4521bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-293561128 Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 363bd2f84a034903a7535f459d4521bf Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-293561128 Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ImagesMetadataNegativeTestJSON-293561128-project Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 575b5a51f44e4be58f5c644cc693b4af Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-293561128-project Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: exception: Image not found. Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'image_id': '7bc815c5-d9bb-454f-b78c-f5dd2d8bb09f', 'id': 'os_distro'} Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7bc815c5-d9bb-454f-b78c-f5dd2d8bb09f Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 16 13:01:07.885123 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7bc815c5-d9bb-454f-b78c-f5dd2d8bb09f could not be found. Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1bab2c0c-7239-455c-9d45-7919217ea41c tempest-ImagesMetadataNegativeTestJSON-293561128 tempest-ImagesMetadataNegativeTestJSON-293561128-project] Returning 404 to user: Image not found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1bab2c0c-7239-455c-9d45-7919217ea41c tempest-ImagesMetadataNegativeTestJSON-293561128 tempest-ImagesMetadataNegativeTestJSON-293561128-project] 10.222.0.67 "DELETE /compute/v2.1/images/7bc815c5-d9bb-454f-b78c-f5dd2d8bb09f/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.504650 Sep 16 13:01:07.890994 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1717/3331] 10.222.0.67 () {58 vars in 1293 bytes} [Fri Sep 16 13:01:07 2022] DELETE /compute/v2.1/images/7bc815c5-d9bb-454f-b78c-f5dd2d8bb09f/metadata/os_distro => generated 62 bytes in 509 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 13:01:07.902153 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e4fa2ff5-f80a-492c-a514-c7a3ac13f9d7 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:07.902830 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-83922f52-9171-40c1-a737-9af03ea216d4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:07.903700 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-83922f52-9171-40c1-a737-9af03ea216d4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:07.916634 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e4fa2ff5-f80a-492c-a514-c7a3ac13f9d7 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1359 microversion: 2.1 time: 1.182520 Sep 16 13:01:07.918223 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1615/3332] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:06 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1359 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:07.925813 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83922f52-9171-40c1-a737-9af03ea216d4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:07.928441 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83922f52-9171-40c1-a737-9af03ea216d4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:07.928905 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83922f52-9171-40c1-a737-9af03ea216d4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:07.929957 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83922f52-9171-40c1-a737-9af03ea216d4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:07.933500 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83922f52-9171-40c1-a737-9af03ea216d4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:07.934300 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83922f52-9171-40c1-a737-9af03ea216d4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:07.937670 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ec8ba209-5e63-4740-9968-2a0cd9507ba8 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:07.938492 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ec8ba209-5e63-4740-9968-2a0cd9507ba8 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:07.951763 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:01:07.958633 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ec8ba209-5e63-4740-9968-2a0cd9507ba8 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:07.961920 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ec8ba209-5e63-4740-9968-2a0cd9507ba8 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:07.963487 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ec8ba209-5e63-4740-9968-2a0cd9507ba8 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:07.966694 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ec8ba209-5e63-4740-9968-2a0cd9507ba8 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:07.967854 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ec8ba209-5e63-4740-9968-2a0cd9507ba8 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:07.970563 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ec8ba209-5e63-4740-9968-2a0cd9507ba8 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:08.643559 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-83922f52-9171-40c1-a737-9af03ea216d4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:08.655469 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-83922f52-9171-40c1-a737-9af03ea216d4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:08.658848 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-83922f52-9171-40c1-a737-9af03ea216d4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:08.660483 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-83922f52-9171-40c1-a737-9af03ea216d4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1852 microversion: 2.42 time: 0.768966 Sep 16 13:01:08.662826 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1718/3333] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:01:07 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1852 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:01:08.671979 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-27c8e575-c5c8-4160-8834-7e574423b394 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:08.674139 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-27c8e575-c5c8-4160-8834-7e574423b394 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: cbc794b1-563e-49d1-92d9-86cea9a9bf75] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:08.681174 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27c8e575-c5c8-4160-8834-7e574423b394 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:08.683256 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27c8e575-c5c8-4160-8834-7e574423b394 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:08.684174 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27c8e575-c5c8-4160-8834-7e574423b394 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:08.685572 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27c8e575-c5c8-4160-8834-7e574423b394 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:08.687255 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27c8e575-c5c8-4160-8834-7e574423b394 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:08.688692 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27c8e575-c5c8-4160-8834-7e574423b394 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:08.800516 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ec8ba209-5e63-4740-9968-2a0cd9507ba8 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:08.805866 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=100 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:01:08.828890 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ec8ba209-5e63-4740-9968-2a0cd9507ba8 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:08.833971 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ec8ba209-5e63-4740-9968-2a0cd9507ba8 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:08.837878 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ec8ba209-5e63-4740-9968-2a0cd9507ba8 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1407 microversion: 2.20 time: 0.913460 Sep 16 13:01:08.838790 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1616/3334] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:01:07 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1407 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:01:08.857273 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-eff69303-750d-4ec8-b9e5-2d5d0afd4d38 tempest-ImagesMetadataNegativeTestJSON-293561128 tempest-ImagesMetadataNegativeTestJSON-293561128-project] Calling method '.version_select at 0x7f10399b8940>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:08.900254 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-eff69303-750d-4ec8-b9e5-2d5d0afd4d38 tempest-ImagesMetadataNegativeTestJSON-293561128 tempest-ImagesMetadataNegativeTestJSON-293561128-project] HTTP exception thrown: Image not found. Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-eff69303-750d-4ec8-b9e5-2d5d0afd4d38 tempest-ImagesMetadataNegativeTestJSON-293561128 tempest-ImagesMetadataNegativeTestJSON-293561128-project] Request method failure captured: Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/images/3c7887c5-8261-4682-ae8e-04f93c138ad0/metadata/os_version HTTP/1.1 Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHOS1S8Urc0zzff8Dr9myqXSz7s6YA9Uldt2dfe_2GEsFsihTgeGxUPPV3PTdVe0EZ6evFBIs1LH-vmgb5dEJPiqkBlppuZhG05AGc915LM42JOx8rDRA9pAn6S3O-1TM8CiVRh0GP0wrjidLfh3hFz8FQ45s_hf5GTTWg_VSTOKlgI Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 363bd2f84a034903a7535f459d4521bf Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-293561128 Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/363bd2f84a034903a7535f459d4521bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/363bd2f84a034903a7535f459d4521bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_363bd2f84a034903a7535f459d4521bf", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/363bd2f84a034903a7535f459d4521bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-293561128 Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 363bd2f84a034903a7535f459d4521bf Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-293561128 Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ImagesMetadataNegativeTestJSON-293561128-project Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 575b5a51f44e4be58f5c644cc693b4af Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-293561128-project Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: exception: Image not found. Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'image_id': '3c7887c5-8261-4682-ae8e-04f93c138ad0', 'id': 'os_version'} Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3c7887c5-8261-4682-ae8e-04f93c138ad0 Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 16 13:01:08.903282 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3c7887c5-8261-4682-ae8e-04f93c138ad0 could not be found. Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 13:01:08.909788 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:01:08.917831 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-eff69303-750d-4ec8-b9e5-2d5d0afd4d38 tempest-ImagesMetadataNegativeTestJSON-293561128 tempest-ImagesMetadataNegativeTestJSON-293561128-project] Returning 404 to user: Image not found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:01:08.919632 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-eff69303-750d-4ec8-b9e5-2d5d0afd4d38 tempest-ImagesMetadataNegativeTestJSON-293561128 tempest-ImagesMetadataNegativeTestJSON-293561128-project] 10.222.0.67 "GET /compute/v2.1/images/3c7887c5-8261-4682-ae8e-04f93c138ad0/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.079465 Sep 16 13:01:08.920924 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1617/3335] 10.222.0.67 () {58 vars in 1293 bytes} [Fri Sep 16 13:01:08 2022] GET /compute/v2.1/images/3c7887c5-8261-4682-ae8e-04f93c138ad0/metadata/os_version => generated 62 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 13:01:08.926140 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-90ae972b-05cb-4ee5-b634-8b9a4a0139ae req-990187b4-df65-4b38-8be6-5d711f0538ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "defaddc3-3750-4d8a-b18a-dd6fdce1dbbf", "tag": "96ec0261-1181-470b-971b-163682a9e81d"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:01:08.939653 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-90ae972b-05cb-4ee5-b634-8b9a4a0139ae req-990187b4-df65-4b38-8be6-5d711f0538ab service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:08.942823 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-90ae972b-05cb-4ee5-b634-8b9a4a0139ae req-990187b4-df65-4b38-8be6-5d711f0538ab service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:08.943571 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-90ae972b-05cb-4ee5-b634-8b9a4a0139ae req-990187b4-df65-4b38-8be6-5d711f0538ab service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:08.960983 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-90ae972b-05cb-4ee5-b634-8b9a4a0139ae req-990187b4-df65-4b38-8be6-5d711f0538ab service nova] Creating event network-changed:96ec0261-1181-470b-971b-163682a9e81d for instance defaddc3-3750-4d8a-b18a-dd6fdce1dbbf on n-h1-858094-4 Sep 16 13:01:08.967268 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-90ae972b-05cb-4ee5-b634-8b9a4a0139ae req-990187b4-df65-4b38-8be6-5d711f0538ab service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044952 Sep 16 13:01:08.968604 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1618/3336] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:01:08.975105 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-83983595-ed2d-4d4e-a6c0-26f0175beedd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:08.976111 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-83983595-ed2d-4d4e-a6c0-26f0175beedd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:08.985550 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-83983595-ed2d-4d4e-a6c0-26f0175beedd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:08.986441 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-83983595-ed2d-4d4e-a6c0-26f0175beedd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:08.987124 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-83983595-ed2d-4d4e-a6c0-26f0175beedd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:08.988360 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-83983595-ed2d-4d4e-a6c0-26f0175beedd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:08.989218 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-83983595-ed2d-4d4e-a6c0-26f0175beedd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:08.989952 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-83983595-ed2d-4d4e-a6c0-26f0175beedd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:09.507240 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-27c8e575-c5c8-4160-8834-7e574423b394 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0e6121124d4a15a63ac359bff5aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc3ef4fd0374ac4b74900369ca779aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:09.522027 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-27c8e575-c5c8-4160-8834-7e574423b394 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75" status: 200 len: 1467 microversion: 2.1 time: 0.857508 Sep 16 13:01:09.526241 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1719/3337] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:08 2022] GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75 => generated 1467 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:09.541173 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a3c1bf6c-8efc-44b7-be13-e061b2c9e862 tempest-ImagesMetadataNegativeTestJSON-293561128 tempest-ImagesMetadataNegativeTestJSON-293561128-project] Calling method '.version_select at 0x7f1039957dc0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:09.575829 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-a3c1bf6c-8efc-44b7-be13-e061b2c9e862 tempest-ImagesMetadataNegativeTestJSON-293561128 tempest-ImagesMetadataNegativeTestJSON-293561128-project] HTTP exception thrown: Image not found. Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a3c1bf6c-8efc-44b7-be13-e061b2c9e862 tempest-ImagesMetadataNegativeTestJSON-293561128 tempest-ImagesMetadataNegativeTestJSON-293561128-project] Request method failure captured: Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/images/8d6dc02a-a067-4776-9b54-d2f055216ba5/metadata HTTP/1.1 Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHOS1S8Urc0zzff8Dr9myqXSz7s6YA9Uldt2dfe_2GEsFsihTgeGxUPPV3PTdVe0EZ6evFBIs1LH-vmgb5dEJPiqkBlppuZhG05AGc915LM42JOx8rDRA9pAn6S3O-1TM8CiVRh0GP0wrjidLfh3hFz8FQ45s_hf5GTTWg_VSTOKlgI Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 363bd2f84a034903a7535f459d4521bf Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-293561128 Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/363bd2f84a034903a7535f459d4521bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/363bd2f84a034903a7535f459d4521bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_363bd2f84a034903a7535f459d4521bf", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/363bd2f84a034903a7535f459d4521bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-293561128 Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 363bd2f84a034903a7535f459d4521bf Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-293561128 Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ImagesMetadataNegativeTestJSON-293561128-project Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 575b5a51f44e4be58f5c644cc693b4af Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-293561128-project Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: exception: Image not found. Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'image_id': '8d6dc02a-a067-4776-9b54-d2f055216ba5'} Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8d6dc02a-a067-4776-9b54-d2f055216ba5 Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 16 13:01:09.579935 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8d6dc02a-a067-4776-9b54-d2f055216ba5 could not be found. Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a3c1bf6c-8efc-44b7-be13-e061b2c9e862 tempest-ImagesMetadataNegativeTestJSON-293561128 tempest-ImagesMetadataNegativeTestJSON-293561128-project] Returning 404 to user: Image not found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a3c1bf6c-8efc-44b7-be13-e061b2c9e862 tempest-ImagesMetadataNegativeTestJSON-293561128 tempest-ImagesMetadataNegativeTestJSON-293561128-project] 10.222.0.67 "GET /compute/v2.1/images/8d6dc02a-a067-4776-9b54-d2f055216ba5/metadata" status: 404 len: 62 microversion: 2.1 time: 0.054201 Sep 16 13:01:09.584824 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1720/3338] 10.222.0.67 () {58 vars in 1260 bytes} [Fri Sep 16 13:01:09 2022] GET /compute/v2.1/images/8d6dc02a-a067-4776-9b54-d2f055216ba5/metadata => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 13:01:09.597401 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d86a298d-2f59-472f-81aa-2a00784fdbb6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:09.597713 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d86a298d-2f59-472f-81aa-2a00784fdbb6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:09.612438 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d86a298d-2f59-472f-81aa-2a00784fdbb6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:09.613332 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d86a298d-2f59-472f-81aa-2a00784fdbb6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:09.617858 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d86a298d-2f59-472f-81aa-2a00784fdbb6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:09.618733 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d86a298d-2f59-472f-81aa-2a00784fdbb6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:09.619310 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d86a298d-2f59-472f-81aa-2a00784fdbb6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:09.619821 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d86a298d-2f59-472f-81aa-2a00784fdbb6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:09.732966 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-83983595-ed2d-4d4e-a6c0-26f0175beedd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:09.745672 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-83983595-ed2d-4d4e-a6c0-26f0175beedd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 200 len: 1523 microversion: 2.1 time: 0.775497 Sep 16 13:01:09.761722 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1619/3339] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:08 2022] GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 1523 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:09.774681 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b4ae28b9-9f9b-456a-ab59-d031d7b685d6 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:01:09.775618 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b4ae28b9-9f9b-456a-ab59-d031d7b685d6 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] [instance: cbc794b1-563e-49d1-92d9-86cea9a9bf75] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:09.783964 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b4ae28b9-9f9b-456a-ab59-d031d7b685d6 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:09.785541 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b4ae28b9-9f9b-456a-ab59-d031d7b685d6 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:09.786359 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b4ae28b9-9f9b-456a-ab59-d031d7b685d6 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:09.787365 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b4ae28b9-9f9b-456a-ab59-d031d7b685d6 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:09.788359 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b4ae28b9-9f9b-456a-ab59-d031d7b685d6 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:09.789061 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b4ae28b9-9f9b-456a-ab59-d031d7b685d6 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:09.820470 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-b4ae28b9-9f9b-456a-ab59-d031d7b685d6 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Lazy-loading 'flavor' on Instance uuid cbc794b1-563e-49d1-92d9-86cea9a9bf75 {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:01:09.933656 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b4ae28b9-9f9b-456a-ab59-d031d7b685d6 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75/action" status: 202 len: 0 microversion: 2.1 time: 0.163330 Sep 16 13:01:09.934713 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1620/3340] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 13:01:09 2022] POST /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:01:09.942865 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f36e3c3c-9699-486d-85f4-0295485c7803 tempest-ImagesMetadataNegativeTestJSON-293561128 tempest-ImagesMetadataNegativeTestJSON-293561128-project] Action: 'update_all', calling method: .version_select at 0x7f1039a91ca0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:01:09.993936 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-f36e3c3c-9699-486d-85f4-0295485c7803 tempest-ImagesMetadataNegativeTestJSON-293561128 tempest-ImagesMetadataNegativeTestJSON-293561128-project] HTTP exception thrown: Image not found. Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f36e3c3c-9699-486d-85f4-0295485c7803 tempest-ImagesMetadataNegativeTestJSON-293561128 tempest-ImagesMetadataNegativeTestJSON-293561128-project] Request method failure captured: Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: request: PUT /compute/v2.1/images/0ccab53f-5a8e-4481-86e5-adc75fd77b05/metadata HTTP/1.1 Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 57 Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHOS1S8Urc0zzff8Dr9myqXSz7s6YA9Uldt2dfe_2GEsFsihTgeGxUPPV3PTdVe0EZ6evFBIs1LH-vmgb5dEJPiqkBlppuZhG05AGc915LM42JOx8rDRA9pAn6S3O-1TM8CiVRh0GP0wrjidLfh3hFz8FQ45s_hf5GTTWg_VSTOKlgI Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 363bd2f84a034903a7535f459d4521bf Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-293561128 Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/363bd2f84a034903a7535f459d4521bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/363bd2f84a034903a7535f459d4521bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_363bd2f84a034903a7535f459d4521bf", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/363bd2f84a034903a7535f459d4521bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-293561128 Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 363bd2f84a034903a7535f459d4521bf Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-293561128 Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ImagesMetadataNegativeTestJSON-293561128-project Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 575b5a51f44e4be58f5c644cc693b4af Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-293561128-project Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: exception: Image not found. Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'image_id': '0ccab53f-5a8e-4481-86e5-adc75fd77b05', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0ccab53f-5a8e-4481-86e5-adc75fd77b05 Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 16 13:01:09.996184 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0ccab53f-5a8e-4481-86e5-adc75fd77b05 could not be found. Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 13:01:10.002052 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:01:10.009373 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f36e3c3c-9699-486d-85f4-0295485c7803 tempest-ImagesMetadataNegativeTestJSON-293561128 tempest-ImagesMetadataNegativeTestJSON-293561128-project] Returning 404 to user: Image not found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:01:10.010518 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f36e3c3c-9699-486d-85f4-0295485c7803 tempest-ImagesMetadataNegativeTestJSON-293561128 tempest-ImagesMetadataNegativeTestJSON-293561128-project] 10.222.0.67 "PUT /compute/v2.1/images/0ccab53f-5a8e-4481-86e5-adc75fd77b05/metadata" status: 404 len: 62 microversion: 2.1 time: 0.072254 Sep 16 13:01:10.017695 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1621/3341] 10.222.0.67 () {60 vars in 1280 bytes} [Fri Sep 16 13:01:09 2022] PUT /compute/v2.1/images/0ccab53f-5a8e-4481-86e5-adc75fd77b05/metadata => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 13:01:10.024444 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-856f0fc8-f61f-4561-a691-d63a531343b6 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:10.025568 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-856f0fc8-f61f-4561-a691-d63a531343b6 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:10.032842 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-856f0fc8-f61f-4561-a691-d63a531343b6 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:10.033698 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-856f0fc8-f61f-4561-a691-d63a531343b6 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:10.034372 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-856f0fc8-f61f-4561-a691-d63a531343b6 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:10.035328 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-856f0fc8-f61f-4561-a691-d63a531343b6 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:10.036014 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-856f0fc8-f61f-4561-a691-d63a531343b6 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:10.036715 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-856f0fc8-f61f-4561-a691-d63a531343b6 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:10.518188 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d86a298d-2f59-472f-81aa-2a00784fdbb6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:10.543183 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d86a298d-2f59-472f-81aa-2a00784fdbb6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1359 microversion: 2.1 time: 0.958868 Sep 16 13:01:10.562494 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1721/3342] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:09 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1359 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:10.569719 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5f6482d6-f318-47ab-90e6-2ae8622a3bed tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:10.570543 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5f6482d6-f318-47ab-90e6-2ae8622a3bed tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:10.580116 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f6482d6-f318-47ab-90e6-2ae8622a3bed tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:10.581156 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f6482d6-f318-47ab-90e6-2ae8622a3bed tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:10.582241 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f6482d6-f318-47ab-90e6-2ae8622a3bed tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:10.583974 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f6482d6-f318-47ab-90e6-2ae8622a3bed tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:10.584923 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f6482d6-f318-47ab-90e6-2ae8622a3bed tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:10.585794 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f6482d6-f318-47ab-90e6-2ae8622a3bed tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:10.654419 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-856f0fc8-f61f-4561-a691-d63a531343b6 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:10.664711 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-856f0fc8-f61f-4561-a691-d63a531343b6 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:10.673377 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-856f0fc8-f61f-4561-a691-d63a531343b6 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:10.674887 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-856f0fc8-f61f-4561-a691-d63a531343b6 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1873 microversion: 2.42 time: 0.655782 Sep 16 13:01:10.698758 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1622/3343] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:01:10 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1873 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:01:10.704993 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f5ea8fa3-51b8-43fb-b41b-958aacbcc160 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:10.712615 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f5ea8fa3-51b8-43fb-b41b-958aacbcc160 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: cbc794b1-563e-49d1-92d9-86cea9a9bf75] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:10.726859 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f5ea8fa3-51b8-43fb-b41b-958aacbcc160 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:10.728739 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f5ea8fa3-51b8-43fb-b41b-958aacbcc160 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:10.729453 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f5ea8fa3-51b8-43fb-b41b-958aacbcc160 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:10.733379 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f5ea8fa3-51b8-43fb-b41b-958aacbcc160 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:10.734484 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f5ea8fa3-51b8-43fb-b41b-958aacbcc160 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:10.735180 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f5ea8fa3-51b8-43fb-b41b-958aacbcc160 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:11.958760 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f5ea8fa3-51b8-43fb-b41b-958aacbcc160 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0e6121124d4a15a63ac359bff5aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc3ef4fd0374ac4b74900369ca779aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:11.971228 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f5ea8fa3-51b8-43fb-b41b-958aacbcc160 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75" status: 200 len: 1458 microversion: 2.1 time: 1.270064 Sep 16 13:01:11.973751 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1623/3344] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:10 2022] GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75 => generated 1458 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:11.980383 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2f9868d2-c520-43ec-a78b-1b52d744275b tempest-ImagesMetadataNegativeTestJSON-293561128 tempest-ImagesMetadataNegativeTestJSON-293561128-project] Action: 'update', calling method: .version_select at 0x7f1039a4a040>, body: {"meta": {"os_distro": "alt"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:01:12.046209 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-2f9868d2-c520-43ec-a78b-1b52d744275b tempest-ImagesMetadataNegativeTestJSON-293561128 tempest-ImagesMetadataNegativeTestJSON-293561128-project] HTTP exception thrown: Image not found. Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2f9868d2-c520-43ec-a78b-1b52d744275b tempest-ImagesMetadataNegativeTestJSON-293561128 tempest-ImagesMetadataNegativeTestJSON-293561128-project] Request method failure captured: Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: request: PUT /compute/v2.1/images/05840b44-1cf3-43fa-b204-a5978057dc4e/metadata/os_distro HTTP/1.1 Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 30 Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHOS1S8Urc0zzff8Dr9myqXSz7s6YA9Uldt2dfe_2GEsFsihTgeGxUPPV3PTdVe0EZ6evFBIs1LH-vmgb5dEJPiqkBlppuZhG05AGc915LM42JOx8rDRA9pAn6S3O-1TM8CiVRh0GP0wrjidLfh3hFz8FQ45s_hf5GTTWg_VSTOKlgI Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 363bd2f84a034903a7535f459d4521bf Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-293561128 Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/363bd2f84a034903a7535f459d4521bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/363bd2f84a034903a7535f459d4521bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_363bd2f84a034903a7535f459d4521bf", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/363bd2f84a034903a7535f459d4521bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-293561128 Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 363bd2f84a034903a7535f459d4521bf Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-293561128 Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ImagesMetadataNegativeTestJSON-293561128-project Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 575b5a51f44e4be58f5c644cc693b4af Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-293561128-project Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: {"meta": {"os_distro": "alt"}} Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: exception: Image not found. Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'image_id': '05840b44-1cf3-43fa-b204-a5978057dc4e', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 05840b44-1cf3-43fa-b204-a5978057dc4e Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 16 13:01:12.049210 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 05840b44-1cf3-43fa-b204-a5978057dc4e could not be found. Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 13:01:12.053350 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:01:12.058695 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2f9868d2-c520-43ec-a78b-1b52d744275b tempest-ImagesMetadataNegativeTestJSON-293561128 tempest-ImagesMetadataNegativeTestJSON-293561128-project] Returning 404 to user: Image not found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:01:12.060454 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2f9868d2-c520-43ec-a78b-1b52d744275b tempest-ImagesMetadataNegativeTestJSON-293561128 tempest-ImagesMetadataNegativeTestJSON-293561128-project] 10.222.0.67 "PUT /compute/v2.1/images/05840b44-1cf3-43fa-b204-a5978057dc4e/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.085379 Sep 16 13:01:12.061589 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1624/3345] 10.222.0.67 () {60 vars in 1310 bytes} [Fri Sep 16 13:01:11 2022] PUT /compute/v2.1/images/05840b44-1cf3-43fa-b204-a5978057dc4e/metadata/os_distro => generated 62 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 13:01:12.070500 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-914e738b-94aa-46b2-9ec1-10cd63857d9f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:12.072958 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-914e738b-94aa-46b2-9ec1-10cd63857d9f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:12.093908 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-914e738b-94aa-46b2-9ec1-10cd63857d9f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:12.094679 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-914e738b-94aa-46b2-9ec1-10cd63857d9f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:12.095448 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-914e738b-94aa-46b2-9ec1-10cd63857d9f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:12.097866 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-914e738b-94aa-46b2-9ec1-10cd63857d9f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:12.100974 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-914e738b-94aa-46b2-9ec1-10cd63857d9f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:12.101962 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-914e738b-94aa-46b2-9ec1-10cd63857d9f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:13.165492 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-914e738b-94aa-46b2-9ec1-10cd63857d9f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:13.174140 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-914e738b-94aa-46b2-9ec1-10cd63857d9f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 200 len: 1523 microversion: 2.1 time: 1.111176 Sep 16 13:01:13.174715 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1625/3346] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:12 2022] GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 1523 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:13.201461 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7b2b0481-a874-4216-b8c5-3c43bdc883e2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:13.208306 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7b2b0481-a874-4216-b8c5-3c43bdc883e2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:13.224473 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7b2b0481-a874-4216-b8c5-3c43bdc883e2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:13.225182 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7b2b0481-a874-4216-b8c5-3c43bdc883e2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:13.225994 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7b2b0481-a874-4216-b8c5-3c43bdc883e2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:13.226884 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7b2b0481-a874-4216-b8c5-3c43bdc883e2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:13.227561 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7b2b0481-a874-4216-b8c5-3c43bdc883e2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:13.230738 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7b2b0481-a874-4216-b8c5-3c43bdc883e2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:13.358668 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5f6482d6-f318-47ab-90e6-2ae8622a3bed tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:13.373409 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5f6482d6-f318-47ab-90e6-2ae8622a3bed tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:13.374941 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5f6482d6-f318-47ab-90e6-2ae8622a3bed tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:13.391119 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5f6482d6-f318-47ab-90e6-2ae8622a3bed tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1407 microversion: 2.20 time: 2.827373 Sep 16 13:01:13.415437 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1722/3347] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:01:10 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1407 bytes in 2852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:01:13.435756 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-aa73a4e1-c5ae-45a1-afa7-2bfc54df2c9c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:13.436546 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-aa73a4e1-c5ae-45a1-afa7-2bfc54df2c9c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:13.469461 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa73a4e1-c5ae-45a1-afa7-2bfc54df2c9c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:13.470273 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa73a4e1-c5ae-45a1-afa7-2bfc54df2c9c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:13.470912 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa73a4e1-c5ae-45a1-afa7-2bfc54df2c9c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:13.472010 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa73a4e1-c5ae-45a1-afa7-2bfc54df2c9c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:13.472657 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa73a4e1-c5ae-45a1-afa7-2bfc54df2c9c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:13.473238 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa73a4e1-c5ae-45a1-afa7-2bfc54df2c9c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:13.930472 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7b2b0481-a874-4216-b8c5-3c43bdc883e2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:13.942324 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7b2b0481-a874-4216-b8c5-3c43bdc883e2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1359 microversion: 2.1 time: 0.747770 Sep 16 13:01:13.947573 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1626/3348] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:13 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1359 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:13.956159 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-abf7e995-9557-44f1-a29e-b6988c640081 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:13.959477 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-abf7e995-9557-44f1-a29e-b6988c640081 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] [instance: cbc794b1-563e-49d1-92d9-86cea9a9bf75] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:13.984400 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-abf7e995-9557-44f1-a29e-b6988c640081 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:13.985437 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-abf7e995-9557-44f1-a29e-b6988c640081 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:13.986103 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-abf7e995-9557-44f1-a29e-b6988c640081 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:13.987593 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-abf7e995-9557-44f1-a29e-b6988c640081 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:13.988620 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-abf7e995-9557-44f1-a29e-b6988c640081 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:13.991107 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-abf7e995-9557-44f1-a29e-b6988c640081 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:14.127584 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-aa73a4e1-c5ae-45a1-afa7-2bfc54df2c9c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:14.137830 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-aa73a4e1-c5ae-45a1-afa7-2bfc54df2c9c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:14.147817 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-aa73a4e1-c5ae-45a1-afa7-2bfc54df2c9c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:14.149073 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-aa73a4e1-c5ae-45a1-afa7-2bfc54df2c9c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1873 microversion: 2.42 time: 0.732558 Sep 16 13:01:14.149977 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1723/3349] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:01:13 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1873 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:01:14.159195 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e928a12b-3e5c-49d5-b13d-796110821300 tempest-ImagesMetadataNegativeTestJSON-293561128 tempest-ImagesMetadataNegativeTestJSON-293561128-project] Action: 'create', calling method: .version_select at 0x7f1034bac670>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:01:14.202313 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-e928a12b-3e5c-49d5-b13d-796110821300 tempest-ImagesMetadataNegativeTestJSON-293561128 tempest-ImagesMetadataNegativeTestJSON-293561128-project] HTTP exception thrown: Image not found. Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e928a12b-3e5c-49d5-b13d-796110821300 tempest-ImagesMetadataNegativeTestJSON-293561128 tempest-ImagesMetadataNegativeTestJSON-293561128-project] Request method failure captured: Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: request: POST /compute/v2.1/images/ed370628-99d5-4614-baed-62ac4153589a/metadata HTTP/1.1 Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 57 Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHOS1S8Urc0zzff8Dr9myqXSz7s6YA9Uldt2dfe_2GEsFsihTgeGxUPPV3PTdVe0EZ6evFBIs1LH-vmgb5dEJPiqkBlppuZhG05AGc915LM42JOx8rDRA9pAn6S3O-1TM8CiVRh0GP0wrjidLfh3hFz8FQ45s_hf5GTTWg_VSTOKlgI Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 363bd2f84a034903a7535f459d4521bf Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-293561128 Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/363bd2f84a034903a7535f459d4521bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/363bd2f84a034903a7535f459d4521bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_363bd2f84a034903a7535f459d4521bf", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/363bd2f84a034903a7535f459d4521bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-293561128 Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 363bd2f84a034903a7535f459d4521bf Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-293561128 Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ImagesMetadataNegativeTestJSON-293561128-project Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 575b5a51f44e4be58f5c644cc693b4af Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-293561128-project Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: exception: Image not found. Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'image_id': 'ed370628-99d5-4614-baed-62ac4153589a', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ed370628-99d5-4614-baed-62ac4153589a Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 16 13:01:14.204651 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ed370628-99d5-4614-baed-62ac4153589a could not be found. Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 13:01:14.209753 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:01:14.215604 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e928a12b-3e5c-49d5-b13d-796110821300 tempest-ImagesMetadataNegativeTestJSON-293561128 tempest-ImagesMetadataNegativeTestJSON-293561128-project] Returning 404 to user: Image not found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:01:14.215604 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e928a12b-3e5c-49d5-b13d-796110821300 tempest-ImagesMetadataNegativeTestJSON-293561128 tempest-ImagesMetadataNegativeTestJSON-293561128-project] 10.222.0.67 "POST /compute/v2.1/images/ed370628-99d5-4614-baed-62ac4153589a/metadata" status: 404 len: 62 microversion: 2.1 time: 0.064299 Sep 16 13:01:14.216288 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1724/3350] 10.222.0.67 () {60 vars in 1281 bytes} [Fri Sep 16 13:01:14 2022] POST /compute/v2.1/images/ed370628-99d5-4614-baed-62ac4153589a/metadata => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 13:01:14.226805 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-c7727664-75bd-43e9-a11b-d5bb72f0fb1a req-5dbabaee-c47d-4848-8207-2336d94e6e1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "defaddc3-3750-4d8a-b18a-dd6fdce1dbbf", "tag": "9b032a10-f56e-47fc-b941-54f12778f01c"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:01:14.241212 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c7727664-75bd-43e9-a11b-d5bb72f0fb1a req-5dbabaee-c47d-4848-8207-2336d94e6e1d service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:14.241853 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c7727664-75bd-43e9-a11b-d5bb72f0fb1a req-5dbabaee-c47d-4848-8207-2336d94e6e1d service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:14.242387 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c7727664-75bd-43e9-a11b-d5bb72f0fb1a req-5dbabaee-c47d-4848-8207-2336d94e6e1d service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:14.271833 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-c7727664-75bd-43e9-a11b-d5bb72f0fb1a req-5dbabaee-c47d-4848-8207-2336d94e6e1d service nova] Creating event network-changed:9b032a10-f56e-47fc-b941-54f12778f01c for instance defaddc3-3750-4d8a-b18a-dd6fdce1dbbf on n-h1-858094-4 Sep 16 13:01:14.292425 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-c7727664-75bd-43e9-a11b-d5bb72f0fb1a req-5dbabaee-c47d-4848-8207-2336d94e6e1d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074479 Sep 16 13:01:14.302580 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1725/3351] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:01:14.324742 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2d1623e9-77aa-4b4e-97bb-6da675a3d5f5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:14.333633 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2d1623e9-77aa-4b4e-97bb-6da675a3d5f5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:14.364975 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2d1623e9-77aa-4b4e-97bb-6da675a3d5f5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:14.365609 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2d1623e9-77aa-4b4e-97bb-6da675a3d5f5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:14.371428 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2d1623e9-77aa-4b4e-97bb-6da675a3d5f5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:14.376280 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2d1623e9-77aa-4b4e-97bb-6da675a3d5f5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:14.378031 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2d1623e9-77aa-4b4e-97bb-6da675a3d5f5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:14.383968 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2d1623e9-77aa-4b4e-97bb-6da675a3d5f5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:15.621266 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2d1623e9-77aa-4b4e-97bb-6da675a3d5f5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:15.635305 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2d1623e9-77aa-4b4e-97bb-6da675a3d5f5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 200 len: 1523 microversion: 2.1 time: 1.328635 Sep 16 13:01:15.635849 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1726/3352] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:14 2022] GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 1523 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:15.662549 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ca6df629-5314-46b3-900b-6becd8c46fd4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:15.665187 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ca6df629-5314-46b3-900b-6becd8c46fd4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:15.700075 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca6df629-5314-46b3-900b-6becd8c46fd4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:15.701927 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca6df629-5314-46b3-900b-6becd8c46fd4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:15.702390 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca6df629-5314-46b3-900b-6becd8c46fd4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:15.705419 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca6df629-5314-46b3-900b-6becd8c46fd4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:15.706510 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca6df629-5314-46b3-900b-6becd8c46fd4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:15.706510 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca6df629-5314-46b3-900b-6becd8c46fd4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:16.136869 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-abf7e995-9557-44f1-a29e-b6988c640081 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75" status: 200 len: 1609 microversion: 2.1 time: 2.173695 Sep 16 13:01:16.138829 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1627/3353] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:13 2022] GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75 => generated 1609 bytes in 2189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:16.151268 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-eebf7b0f-9398-44e1-a5da-bddcc7c02c98 req-374e5a1d-7218-404d-a5ca-c278bf280470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66413dbd-455f-45f6-b057-39a11a9f2d44", "name": "network-vif-plugged", "status": "completed", "tag": "3a5b1f2b-2004-4cf4-93bd-f498b62488fe"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:01:16.213843 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-eebf7b0f-9398-44e1-a5da-bddcc7c02c98 req-374e5a1d-7218-404d-a5ca-c278bf280470 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:16.218230 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-eebf7b0f-9398-44e1-a5da-bddcc7c02c98 req-374e5a1d-7218-404d-a5ca-c278bf280470 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:16.219097 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-eebf7b0f-9398-44e1-a5da-bddcc7c02c98 req-374e5a1d-7218-404d-a5ca-c278bf280470 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:16.260379 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-eebf7b0f-9398-44e1-a5da-bddcc7c02c98 req-374e5a1d-7218-404d-a5ca-c278bf280470 service nova] Creating event network-vif-plugged:3a5b1f2b-2004-4cf4-93bd-f498b62488fe for instance 66413dbd-455f-45f6-b057-39a11a9f2d44 on n-h1-858094-4 Sep 16 13:01:16.275751 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-eebf7b0f-9398-44e1-a5da-bddcc7c02c98 req-374e5a1d-7218-404d-a5ca-c278bf280470 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135240 Sep 16 13:01:16.276686 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1628/3354] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:01:16.306388 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-45939851-b70a-4719-8b97-18b8657706de tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:16.308669 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-45939851-b70a-4719-8b97-18b8657706de tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:16.358793 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-45939851-b70a-4719-8b97-18b8657706de tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:16.364846 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-45939851-b70a-4719-8b97-18b8657706de tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:16.365321 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-45939851-b70a-4719-8b97-18b8657706de tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:16.366075 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-45939851-b70a-4719-8b97-18b8657706de tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:16.366543 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-45939851-b70a-4719-8b97-18b8657706de tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:16.368435 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-45939851-b70a-4719-8b97-18b8657706de tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:16.817484 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ca6df629-5314-46b3-900b-6becd8c46fd4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:16.833449 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ca6df629-5314-46b3-900b-6becd8c46fd4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:16.847215 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ca6df629-5314-46b3-900b-6becd8c46fd4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:16.849700 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ca6df629-5314-46b3-900b-6becd8c46fd4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1407 microversion: 2.20 time: 1.205519 Sep 16 13:01:16.877333 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1727/3355] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:01:15 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1407 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:01:16.894175 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6ad68838-b987-47d0-a73b-a1b598e8eb3a tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:16.895505 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6ad68838-b987-47d0-a73b-a1b598e8eb3a tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:16.906201 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ad68838-b987-47d0-a73b-a1b598e8eb3a tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:16.908354 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ad68838-b987-47d0-a73b-a1b598e8eb3a tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:16.909160 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ad68838-b987-47d0-a73b-a1b598e8eb3a tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:16.911637 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ad68838-b987-47d0-a73b-a1b598e8eb3a tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:16.914295 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ad68838-b987-47d0-a73b-a1b598e8eb3a tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:16.914951 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ad68838-b987-47d0-a73b-a1b598e8eb3a tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:17.102047 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-45939851-b70a-4719-8b97-18b8657706de tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:17.117202 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-45939851-b70a-4719-8b97-18b8657706de tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1359 microversion: 2.1 time: 0.838943 Sep 16 13:01:17.121515 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1629/3356] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:16 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1359 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:17.140102 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3de0cbb0-d2a2-443d-b446-4aeb19d67c62 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:17.151642 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3de0cbb0-d2a2-443d-b446-4aeb19d67c62 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:17.152511 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3de0cbb0-d2a2-443d-b446-4aeb19d67c62 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:17.153403 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3de0cbb0-d2a2-443d-b446-4aeb19d67c62 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:17.156784 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3de0cbb0-d2a2-443d-b446-4aeb19d67c62 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:17.157723 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3de0cbb0-d2a2-443d-b446-4aeb19d67c62 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:17.160914 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3de0cbb0-d2a2-443d-b446-4aeb19d67c62 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:17.270375 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3de0cbb0-d2a2-443d-b446-4aeb19d67c62 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.144599 Sep 16 13:01:17.280760 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1630/3357] 10.222.0.67 () {58 vars in 1176 bytes} [Fri Sep 16 13:01:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:01:17.286008 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-64d0fb52-3aa4-42d8-a1b4-a49ef90dcc7f req-56c37dd2-0de5-44fb-8779-a99217cf7281 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af5e660b-de79-42ca-a8de-fe06738b9771", "tag": "3af800e8-0d1f-497b-bca5-8901587cb91c"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:01:17.330218 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-64d0fb52-3aa4-42d8-a1b4-a49ef90dcc7f req-56c37dd2-0de5-44fb-8779-a99217cf7281 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:17.330819 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-64d0fb52-3aa4-42d8-a1b4-a49ef90dcc7f req-56c37dd2-0de5-44fb-8779-a99217cf7281 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:17.336421 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-64d0fb52-3aa4-42d8-a1b4-a49ef90dcc7f req-56c37dd2-0de5-44fb-8779-a99217cf7281 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:17.366713 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-64d0fb52-3aa4-42d8-a1b4-a49ef90dcc7f req-56c37dd2-0de5-44fb-8779-a99217cf7281 service nova] Creating event network-changed:3af800e8-0d1f-497b-bca5-8901587cb91c for instance af5e660b-de79-42ca-a8de-fe06738b9771 on n-h2-858094-4 Sep 16 13:01:17.379361 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-64d0fb52-3aa4-42d8-a1b4-a49ef90dcc7f req-56c37dd2-0de5-44fb-8779-a99217cf7281 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095443 Sep 16 13:01:17.383810 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1631/3358] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:01:17.399720 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-22c85d3d-ceb0-4e6d-bfaa-364990a9f887 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:17.403842 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-22c85d3d-ceb0-4e6d-bfaa-364990a9f887 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:17.426508 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-22c85d3d-ceb0-4e6d-bfaa-364990a9f887 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:17.427117 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-22c85d3d-ceb0-4e6d-bfaa-364990a9f887 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:17.430510 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-22c85d3d-ceb0-4e6d-bfaa-364990a9f887 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:17.431814 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-22c85d3d-ceb0-4e6d-bfaa-364990a9f887 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:17.432728 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-22c85d3d-ceb0-4e6d-bfaa-364990a9f887 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:17.433513 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-22c85d3d-ceb0-4e6d-bfaa-364990a9f887 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:17.498842 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6ad68838-b987-47d0-a73b-a1b598e8eb3a tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:17.525632 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6ad68838-b987-47d0-a73b-a1b598e8eb3a tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:17.530857 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6ad68838-b987-47d0-a73b-a1b598e8eb3a tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:17.536605 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6ad68838-b987-47d0-a73b-a1b598e8eb3a tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1873 microversion: 2.42 time: 0.654559 Sep 16 13:01:17.538064 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1728/3359] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:01:16 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1873 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:01:17.562330 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cdd8e2e6-139b-4a2d-9091-45d684103039 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858094-4", "block_migration": true, "disk_over_commit": false}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:01:17.565980 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cdd8e2e6-139b-4a2d-9091-45d684103039 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] [instance: cbc794b1-563e-49d1-92d9-86cea9a9bf75] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:17.573427 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cdd8e2e6-139b-4a2d-9091-45d684103039 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:17.573951 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cdd8e2e6-139b-4a2d-9091-45d684103039 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:17.574387 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cdd8e2e6-139b-4a2d-9091-45d684103039 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:17.576085 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cdd8e2e6-139b-4a2d-9091-45d684103039 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:17.576601 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cdd8e2e6-139b-4a2d-9091-45d684103039 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:17.577046 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cdd8e2e6-139b-4a2d-9091-45d684103039 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:17.615067 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-cdd8e2e6-139b-4a2d-9091-45d684103039 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Lazy-loading 'flavor' on Instance uuid cbc794b1-563e-49d1-92d9-86cea9a9bf75 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:01:17.638849 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-cdd8e2e6-139b-4a2d-9091-45d684103039 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance cbc794b1-563e-49d1-92d9-86cea9a9bf75 while it is in vm_state suspended Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cdd8e2e6-139b-4a2d-9091-45d684103039 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Request method failure captured: Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75/action HTTP/1.1 Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 97 Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHNLKE6-K3_qw5cXTQdexG7YsIW4x_EvMA4fP7QK5rq8_XViBgfGQ3ndZLMtVi3tgqpgOe6UlhTRgGE23GqduH-n2unSpp63Xvp6tnwrYkdh83kmdueVqtFaYp94gF770_IYe_YlsUlJothXFDG55XzsHt_Or1prBFxwX0_QI6yS5os Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 618a577f242f42f499e403f61a21ebf2 Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-LiveMigrationNegativeTest-785527900 Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,admin,reader Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,admin,reader Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/618a577f242f42f499e403f61a21ebf2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/618a577f242f42f499e403f61a21ebf2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_618a577f242f42f499e403f61a21ebf2", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/618a577f242f42f499e403f61a21ebf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-LiveMigrationNegativeTest-785527900 Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 618a577f242f42f499e403f61a21ebf2 Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-785527900 Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-LiveMigrationNegativeTest-785527900-project-admin Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 3628c1050b12420ebc06e2c96b3c2ae1 Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-LiveMigrationNegativeTest-785527900-project-admin Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: {"os-migrateLive": {"host": "n-h1-858094-4", "block_migration": true, "disk_over_commit": false}} Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: exception: Cannot 'os-migrateLive' instance cbc794b1-563e-49d1-92d9-86cea9a9bf75 while it is in vm_state suspended Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': 'cbc794b1-563e-49d1-92d9-86cea9a9bf75', 'body': {'os-migrateLive': {'host': 'n-h1-858094-4', 'block_migration': True, 'disk_over_commit': False}}} Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cbc794b1-563e-49d1-92d9-86cea9a9bf75 in vm_state suspended. Cannot live_migrate while the instance is in this state. Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:01:17.640844 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:01:17.645633 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:01:17.645633 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:01:17.645633 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:01:17.645633 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:01:17.645633 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:01:17.645633 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:01:17.645633 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:01:17.645633 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:01:17.645633 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:01:17.645633 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:01:17.645633 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:01:17.645633 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 16 13:01:17.645633 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Sep 16 13:01:17.645633 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 16 13:01:17.645633 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 16 13:01:17.645633 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 16 13:01:17.645633 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance cbc794b1-563e-49d1-92d9-86cea9a9bf75 while it is in vm_state suspended Sep 16 13:01:17.645633 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:01:17.645633 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:01:17.645633 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:01:17.645633 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:01:17.645633 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:01:17.645633 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:01:17.645633 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:01:17.645633 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:01:17.645633 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance cbc794b1-563e-49d1-92d9-86cea9a9bf75 while it is in vm_state suspended Sep 16 13:01:17.645633 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:01:17.645633 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cdd8e2e6-139b-4a2d-9091-45d684103039 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance cbc794b1-563e-49d1-92d9-86cea9a9bf75 while it is in vm_state suspended {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:01:17.645633 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cdd8e2e6-139b-4a2d-9091-45d684103039 tempest-LiveMigrationNegativeTest-785527900 tempest-LiveMigrationNegativeTest-785527900-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75/action" status: 409 len: 155 microversion: 2.1 time: 0.102276 Sep 16 13:01:17.649118 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1729/3360] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 13:01:17 2022] POST /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75/action => generated 155 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 16 13:01:17.655559 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b0007221-ca8a-4ea5-b058-bbf53325970a tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:17.656064 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b0007221-ca8a-4ea5-b058-bbf53325970a tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: cbc794b1-563e-49d1-92d9-86cea9a9bf75] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:17.663209 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0007221-ca8a-4ea5-b058-bbf53325970a tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:17.663715 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0007221-ca8a-4ea5-b058-bbf53325970a tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:17.664176 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0007221-ca8a-4ea5-b058-bbf53325970a tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:17.664934 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0007221-ca8a-4ea5-b058-bbf53325970a tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:17.665442 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0007221-ca8a-4ea5-b058-bbf53325970a tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:17.665873 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0007221-ca8a-4ea5-b058-bbf53325970a tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:17.768419 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b0007221-ca8a-4ea5-b058-bbf53325970a tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: cbc794b1-563e-49d1-92d9-86cea9a9bf75] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:01:17.821531 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:01:17.971325 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b0007221-ca8a-4ea5-b058-bbf53325970a tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "DELETE /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75" status: 204 len: 0 microversion: 2.1 time: 0.320121 Sep 16 13:01:17.971722 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1730/3361] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 13:01:17 2022] DELETE /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:01:17.986411 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3efa2d88-89b4-4e9b-aec7-c28abe6c0400 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:17.987772 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3efa2d88-89b4-4e9b-aec7-c28abe6c0400 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:18.016390 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3efa2d88-89b4-4e9b-aec7-c28abe6c0400 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:18.017096 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3efa2d88-89b4-4e9b-aec7-c28abe6c0400 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:18.017888 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3efa2d88-89b4-4e9b-aec7-c28abe6c0400 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:18.023523 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3efa2d88-89b4-4e9b-aec7-c28abe6c0400 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:18.024308 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3efa2d88-89b4-4e9b-aec7-c28abe6c0400 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:18.025273 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3efa2d88-89b4-4e9b-aec7-c28abe6c0400 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:18.026554 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-22c85d3d-ceb0-4e6d-bfaa-364990a9f887 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:18.035922 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-22c85d3d-ceb0-4e6d-bfaa-364990a9f887 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 200 len: 1523 microversion: 2.1 time: 0.648225 Sep 16 13:01:18.036542 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1632/3362] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:17 2022] GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 1523 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:18.043834 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b191d961-d29a-48ec-8fb9-f8733874872e tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:18.046698 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b191d961-d29a-48ec-8fb9-f8733874872e tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: cbc794b1-563e-49d1-92d9-86cea9a9bf75] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:18.077751 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b191d961-d29a-48ec-8fb9-f8733874872e tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:18.088792 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b191d961-d29a-48ec-8fb9-f8733874872e tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:18.089616 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b191d961-d29a-48ec-8fb9-f8733874872e tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:18.090422 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b191d961-d29a-48ec-8fb9-f8733874872e tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:18.096942 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b191d961-d29a-48ec-8fb9-f8733874872e tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:18.097542 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b191d961-d29a-48ec-8fb9-f8733874872e tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:18.600971 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-b191d961-d29a-48ec-8fb9-f8733874872e tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0e6121124d4a15a63ac359bff5aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc3ef4fd0374ac4b74900369ca779aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:18.611082 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b191d961-d29a-48ec-8fb9-f8733874872e tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75" status: 200 len: 1464 microversion: 2.1 time: 0.570976 Sep 16 13:01:18.611682 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1633/3363] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:18 2022] GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75 => generated 1464 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:18.626923 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b5bd7c87-3472-4172-a4c9-e04f17d4a192 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:18.636210 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b5bd7c87-3472-4172-a4c9-e04f17d4a192 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:18.644014 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3efa2d88-89b4-4e9b-aec7-c28abe6c0400 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:18.657973 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3efa2d88-89b4-4e9b-aec7-c28abe6c0400 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:18.661856 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3efa2d88-89b4-4e9b-aec7-c28abe6c0400 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:18.663478 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3efa2d88-89b4-4e9b-aec7-c28abe6c0400 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1407 microversion: 2.20 time: 0.687241 Sep 16 13:01:18.663661 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b5bd7c87-3472-4172-a4c9-e04f17d4a192 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:18.664218 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b5bd7c87-3472-4172-a4c9-e04f17d4a192 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:18.665820 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b5bd7c87-3472-4172-a4c9-e04f17d4a192 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:18.666574 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b5bd7c87-3472-4172-a4c9-e04f17d4a192 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:18.667797 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1731/3364] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:01:17 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1407 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:01:18.685228 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b5bd7c87-3472-4172-a4c9-e04f17d4a192 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:18.687933 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b5bd7c87-3472-4172-a4c9-e04f17d4a192 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:18.936482 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-90f4ea4f-417c-4d6f-a502-565e7dbaed55 tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] Action: 'create', calling method: .version_select at 0x7f1034b414c0>, body: {"keypair": {"name": "tempest-keypair-1028163108", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAg9gKxrIA8ZC++qKl23MPkSP3o4QNREvFqcxQzDUOOeVu9bCXjn5JcbDxqebo89gqbqkPUY8wr6XNW1AOkV2o3/uahUOE6UoTreHeU+CMXUweYyYHLWZYCTCIzfOdi/sg=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:01:18.978895 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-90f4ea4f-417c-4d6f-a502-565e7dbaed55 tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] Getting quotas for project 96531eff18ec41e5af05abc67e141823. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:01:18.990779 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-90f4ea4f-417c-4d6f-a502-565e7dbaed55 tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] Getting quotas for user b6ff4f738e564361a8bfc961d120118e and project 96531eff18ec41e5af05abc67e141823. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:01:19.049761 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-90f4ea4f-417c-4d6f-a502-565e7dbaed55 tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.379871 Sep 16 13:01:19.051034 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1732/3365] 10.222.0.67 () {60 vars in 1159 bytes} [Fri Sep 16 13:01:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:01:19.061116 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ebfbe7f9-24d4-4eb9-b560-7785e60d3f7d tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:19.063804 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ebfbe7f9-24d4-4eb9-b560-7785e60d3f7d tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:19.089082 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebfbe7f9-24d4-4eb9-b560-7785e60d3f7d tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:19.089082 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebfbe7f9-24d4-4eb9-b560-7785e60d3f7d tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:19.091181 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebfbe7f9-24d4-4eb9-b560-7785e60d3f7d tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:19.093702 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebfbe7f9-24d4-4eb9-b560-7785e60d3f7d tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:19.095709 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebfbe7f9-24d4-4eb9-b560-7785e60d3f7d tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:19.096390 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebfbe7f9-24d4-4eb9-b560-7785e60d3f7d tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:19.522453 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-b5bd7c87-3472-4172-a4c9-e04f17d4a192 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:19.533654 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b5bd7c87-3472-4172-a4c9-e04f17d4a192 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1359 microversion: 2.1 time: 0.913382 Sep 16 13:01:19.536203 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1634/3366] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:18 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1359 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:19.552207 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-67a78ddd-fb86-4ca8-b7ba-9ec58fb12ab7 tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] Calling method '.version_select at 0x7f1035785430>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:19.570039 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-67a78ddd-fb86-4ca8-b7ba-9ec58fb12ab7 tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] 10.222.0.67 "GET /compute/v2.1/os-keypairs/tempest-keypair-1028163108" status: 200 len: 498 microversion: 2.1 time: 0.032517 Sep 16 13:01:19.580220 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1635/3367] 10.222.0.67 () {58 vars in 1218 bytes} [Fri Sep 16 13:01:19 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1028163108 => generated 498 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:01:19.586242 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c7ced0ec-4e46-47b4-a058-90d201ec7d05 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:19.593029 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c7ced0ec-4e46-47b4-a058-90d201ec7d05 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:19.612505 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c7ced0ec-4e46-47b4-a058-90d201ec7d05 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:19.614120 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c7ced0ec-4e46-47b4-a058-90d201ec7d05 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:19.614777 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c7ced0ec-4e46-47b4-a058-90d201ec7d05 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:19.615685 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c7ced0ec-4e46-47b4-a058-90d201ec7d05 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:19.616336 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c7ced0ec-4e46-47b4-a058-90d201ec7d05 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:19.616949 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c7ced0ec-4e46-47b4-a058-90d201ec7d05 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:21.123923 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ebfbe7f9-24d4-4eb9-b560-7785e60d3f7d tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:21.133889 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c7ced0ec-4e46-47b4-a058-90d201ec7d05 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:21.155334 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c7ced0ec-4e46-47b4-a058-90d201ec7d05 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 200 len: 1523 microversion: 2.1 time: 1.572954 Sep 16 13:01:21.156175 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1636/3368] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:19 2022] GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 1523 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:21.169655 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ebfbe7f9-24d4-4eb9-b560-7785e60d3f7d tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:21.174781 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ebfbe7f9-24d4-4eb9-b560-7785e60d3f7d tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:21.176894 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-f44d6a9e-0fa2-40fd-84d4-290a166cd5f2 req-6c800719-772a-4618-85a9-9a67cb772431 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "defaddc3-3750-4d8a-b18a-dd6fdce1dbbf", "tag": "8874748b-6030-4aea-9e6b-79db8c8d555d"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:01:21.180353 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ebfbe7f9-24d4-4eb9-b560-7785e60d3f7d tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1873 microversion: 2.42 time: 2.128100 Sep 16 13:01:21.186045 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1733/3369] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:01:19 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1873 bytes in 2134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:01:21.212287 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-46c67688-83b3-484a-bb2b-ac27bc3f9e96 tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] Calling method '.version_select at 0x7f1034b21280>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:21.215136 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-f44d6a9e-0fa2-40fd-84d4-290a166cd5f2 req-6c800719-772a-4618-85a9-9a67cb772431 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:21.218152 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-f44d6a9e-0fa2-40fd-84d4-290a166cd5f2 req-6c800719-772a-4618-85a9-9a67cb772431 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:21.224742 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-f44d6a9e-0fa2-40fd-84d4-290a166cd5f2 req-6c800719-772a-4618-85a9-9a67cb772431 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:21.298038 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-f44d6a9e-0fa2-40fd-84d4-290a166cd5f2 req-6c800719-772a-4618-85a9-9a67cb772431 service nova] Creating event network-changed:8874748b-6030-4aea-9e6b-79db8c8d555d for instance defaddc3-3750-4d8a-b18a-dd6fdce1dbbf on n-h1-858094-4 Sep 16 13:01:21.312741 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-46c67688-83b3-484a-bb2b-ac27bc3f9e96 tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1028163108" status: 202 len: 0 microversion: 2.1 time: 0.120630 Sep 16 13:01:21.315224 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1734/3370] 10.222.0.67 () {58 vars in 1221 bytes} [Fri Sep 16 13:01:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1028163108 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:01:21.321345 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-f44d6a9e-0fa2-40fd-84d4-290a166cd5f2 req-6c800719-772a-4618-85a9-9a67cb772431 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163776 Sep 16 13:01:21.342143 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1637/3371] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:01:21.361962 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-523fb6cc-b3fa-46aa-8bb4-46fa3df87a2c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:21.368585 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-523fb6cc-b3fa-46aa-8bb4-46fa3df87a2c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: cbc794b1-563e-49d1-92d9-86cea9a9bf75] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:21.374926 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-bf5df596-e3e8-4d60-be45-14a5ab277d5f tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:21.388570 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-bf5df596-e3e8-4d60-be45-14a5ab277d5f tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:21.405643 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-523fb6cc-b3fa-46aa-8bb4-46fa3df87a2c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:21.409313 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-523fb6cc-b3fa-46aa-8bb4-46fa3df87a2c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:21.411338 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-523fb6cc-b3fa-46aa-8bb4-46fa3df87a2c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:21.413870 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-523fb6cc-b3fa-46aa-8bb4-46fa3df87a2c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:21.424384 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bf5df596-e3e8-4d60-be45-14a5ab277d5f tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:21.424689 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-523fb6cc-b3fa-46aa-8bb4-46fa3df87a2c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:21.425938 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-523fb6cc-b3fa-46aa-8bb4-46fa3df87a2c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:21.431436 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bf5df596-e3e8-4d60-be45-14a5ab277d5f tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:21.435251 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bf5df596-e3e8-4d60-be45-14a5ab277d5f tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:21.438891 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bf5df596-e3e8-4d60-be45-14a5ab277d5f tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:21.441544 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bf5df596-e3e8-4d60-be45-14a5ab277d5f tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:21.442258 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bf5df596-e3e8-4d60-be45-14a5ab277d5f tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:22.013836 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-523fb6cc-b3fa-46aa-8bb4-46fa3df87a2c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0e6121124d4a15a63ac359bff5aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc3ef4fd0374ac4b74900369ca779aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:22.081521 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-523fb6cc-b3fa-46aa-8bb4-46fa3df87a2c tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75" status: 200 len: 1422 microversion: 2.1 time: 0.763880 Sep 16 13:01:22.088627 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1735/3372] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:21 2022] GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75 => generated 1422 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:22.148735 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-bf5df596-e3e8-4d60-be45-14a5ab277d5f tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:22.164700 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c5bbc35f-8927-493b-a1a5-08cc061941e0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:22.165330 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c5bbc35f-8927-493b-a1a5-08cc061941e0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:22.167721 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-bf5df596-e3e8-4d60-be45-14a5ab277d5f tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:22.172821 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-bf5df596-e3e8-4d60-be45-14a5ab277d5f tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:22.176669 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-bf5df596-e3e8-4d60-be45-14a5ab277d5f tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1600 microversion: 2.20 time: 0.832874 Sep 16 13:01:22.179819 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1638/3373] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:01:21 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1600 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:01:22.203973 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1a6c61c3-ab12-4f40-bbb6-f6071e20c085 tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] Action: 'create', calling method: .version_select at 0x7f1039b234c0>, body: {"keypair": {"name": "tempest-keypair-1313034981", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLliZeBWprVnpi0BgAA0aX3Bl/Cl7kdrYIepXOWYJZ1ajd61tdPj4WGeyx7/lGVB3DWLjmXDxPnkl7w20IKWHAH9OdRg5ztH946ewOBzOYV+KlEigRL9P6u6boBaEnD+KA=="}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:01:22.210784 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5bbc35f-8927-493b-a1a5-08cc061941e0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:22.213083 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5bbc35f-8927-493b-a1a5-08cc061941e0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:22.213737 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5bbc35f-8927-493b-a1a5-08cc061941e0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:22.219821 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5bbc35f-8927-493b-a1a5-08cc061941e0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:22.220606 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5bbc35f-8927-493b-a1a5-08cc061941e0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:22.221055 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5bbc35f-8927-493b-a1a5-08cc061941e0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:22.266008 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-1a6c61c3-ab12-4f40-bbb6-f6071e20c085 tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] Getting quotas for project 96531eff18ec41e5af05abc67e141823. Resources: {'key_pairs'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:01:22.287108 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-1a6c61c3-ab12-4f40-bbb6-f6071e20c085 tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] Getting quotas for user b6ff4f738e564361a8bfc961d120118e and project 96531eff18ec41e5af05abc67e141823. Resources: {'key_pairs'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:01:22.427258 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1a6c61c3-ab12-4f40-bbb6-f6071e20c085 tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.242792 Sep 16 13:01:22.427929 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1639/3374] 10.222.0.67 () {60 vars in 1159 bytes} [Fri Sep 16 13:01:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:01:22.439746 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4a0865a1-3b1f-4af2-97b3-49618d806f69 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:22.458502 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-4a0865a1-3b1f-4af2-97b3-49618d806f69 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:22.474640 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4a0865a1-3b1f-4af2-97b3-49618d806f69 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:22.475157 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4a0865a1-3b1f-4af2-97b3-49618d806f69 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:22.475580 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4a0865a1-3b1f-4af2-97b3-49618d806f69 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:22.478015 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4a0865a1-3b1f-4af2-97b3-49618d806f69 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:22.478764 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4a0865a1-3b1f-4af2-97b3-49618d806f69 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:22.479610 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4a0865a1-3b1f-4af2-97b3-49618d806f69 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:22.547845 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:01:23.713663 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4a0865a1-3b1f-4af2-97b3-49618d806f69 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:23.725570 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4a0865a1-3b1f-4af2-97b3-49618d806f69 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 200 len: 1523 microversion: 2.1 time: 1.289039 Sep 16 13:01:23.728484 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1640/3375] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:22 2022] GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 1523 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:23.737928 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c5bbc35f-8927-493b-a1a5-08cc061941e0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:23.739007 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-538b6b9c-e139-40eb-a909-f7bf5c4f314d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:23.739516 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-538b6b9c-e139-40eb-a909-f7bf5c4f314d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:23.753913 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-538b6b9c-e139-40eb-a909-f7bf5c4f314d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:23.760533 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-538b6b9c-e139-40eb-a909-f7bf5c4f314d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:23.761267 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-538b6b9c-e139-40eb-a909-f7bf5c4f314d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:23.762719 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-538b6b9c-e139-40eb-a909-f7bf5c4f314d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:23.763576 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-538b6b9c-e139-40eb-a909-f7bf5c4f314d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:23.764181 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-538b6b9c-e139-40eb-a909-f7bf5c4f314d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:23.766790 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c5bbc35f-8927-493b-a1a5-08cc061941e0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1359 microversion: 2.1 time: 1.674929 Sep 16 13:01:23.772455 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1736/3376] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:22 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1359 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:23.780884 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7ef2d6da-4b0f-4b75-ae46-832166e9e884 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:23.782124 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7ef2d6da-4b0f-4b75-ae46-832166e9e884 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:23.792286 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ef2d6da-4b0f-4b75-ae46-832166e9e884 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:23.796247 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ef2d6da-4b0f-4b75-ae46-832166e9e884 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:23.797184 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ef2d6da-4b0f-4b75-ae46-832166e9e884 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:23.798389 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ef2d6da-4b0f-4b75-ae46-832166e9e884 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:23.805304 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ef2d6da-4b0f-4b75-ae46-832166e9e884 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:23.812743 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ef2d6da-4b0f-4b75-ae46-832166e9e884 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:24.159189 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-538b6b9c-e139-40eb-a909-f7bf5c4f314d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.429505 Sep 16 13:01:24.160065 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1641/3377] 10.222.0.67 () {60 vars in 1316 bytes} [Fri Sep 16 13:01:23 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44/os-interface => generated 285 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:01:24.165045 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-efdb7784-456c-4f85-a4a4-ba779e60adc5 tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] Calling method '.version_select at 0x7f1039b6aa60>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:24.200850 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-efdb7784-456c-4f85-a4a4-ba779e60adc5 tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1313034981" status: 202 len: 0 microversion: 2.1 time: 0.038822 Sep 16 13:01:24.202070 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1642/3378] 10.222.0.67 () {58 vars in 1221 bytes} [Fri Sep 16 13:01:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1313034981 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:01:24.208112 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-be496fc3-10bf-4afb-aa24-af469509b6bb tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:24.209040 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-be496fc3-10bf-4afb-aa24-af469509b6bb tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: cbc794b1-563e-49d1-92d9-86cea9a9bf75] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:24.225917 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-be496fc3-10bf-4afb-aa24-af469509b6bb tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:24.226716 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-be496fc3-10bf-4afb-aa24-af469509b6bb tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:24.228333 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-be496fc3-10bf-4afb-aa24-af469509b6bb tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:24.231372 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-be496fc3-10bf-4afb-aa24-af469509b6bb tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:24.233897 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-be496fc3-10bf-4afb-aa24-af469509b6bb tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:24.234542 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-be496fc3-10bf-4afb-aa24-af469509b6bb tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:24.257942 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-be496fc3-10bf-4afb-aa24-af469509b6bb tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] HTTP exception thrown: Instance cbc794b1-563e-49d1-92d9-86cea9a9bf75 could not be found. Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-be496fc3-10bf-4afb-aa24-af469509b6bb tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Request method failure captured: Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75 HTTP/1.1 Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHNKJ_J6cN6jPBzMvOd6ir-anoDpohg2YGFEu6gt5vPCDPAwGBtannKUA3LhEAXNGw4vh_z3q_EB0s-zno1yH-Mp-nylosMieKTH51rub2QyTW_Aojivq-4rbpXTvmeIic7c6f4-SurTXSD05r3HFHbnSffUhqUgdUbrJ90o9knDVBg Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 9bc3ef4fd0374ac4b74900369ca779aa Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-LiveMigrationNegativeTest-1708726340 Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9bc3ef4fd0374ac4b74900369ca779aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9bc3ef4fd0374ac4b74900369ca779aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9bc3ef4fd0374ac4b74900369ca779aa", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9bc3ef4fd0374ac4b74900369ca779aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-LiveMigrationNegativeTest-1708726340 Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 9bc3ef4fd0374ac4b74900369ca779aa Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1708726340 Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-LiveMigrationNegativeTest-1708726340-project Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: eb0e6121124d4a15a63ac359bff5aedb Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-LiveMigrationNegativeTest-1708726340-project Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance cbc794b1-563e-49d1-92d9-86cea9a9bf75 could not be found. Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'cbc794b1-563e-49d1-92d9-86cea9a9bf75'} Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbc794b1-563e-49d1-92d9-86cea9a9bf75 could not be found. Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbc794b1-563e-49d1-92d9-86cea9a9bf75 could not be found. Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:01:24.260048 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:01:24.266307 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:01:24.266307 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:01:24.266307 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:01:24.266307 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:01:24.266307 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:01:24.266307 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbc794b1-563e-49d1-92d9-86cea9a9bf75 could not be found. Sep 16 13:01:24.266307 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:01:24.268335 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-be496fc3-10bf-4afb-aa24-af469509b6bb tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Returning 404 to user: Instance cbc794b1-563e-49d1-92d9-86cea9a9bf75 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:01:24.269389 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-be496fc3-10bf-4afb-aa24-af469509b6bb tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75" status: 404 len: 111 microversion: 2.1 time: 0.066101 Sep 16 13:01:24.274174 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1643/3379] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:24 2022] GET /compute/v2.1/servers/cbc794b1-563e-49d1-92d9-86cea9a9bf75 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:01:24.281190 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-a3ce07df-a5c4-4ce2-bf6e-9de82cbc95f2 req-67947e04-eae8-4a34-a95c-13d4e27b6165 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbc794b1-563e-49d1-92d9-86cea9a9bf75", "name": "network-vif-deleted", "tag": "62dbe1ae-a63f-40d9-b089-d8e7f6ba2713"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:01:24.292720 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-a3ce07df-a5c4-4ce2-bf6e-9de82cbc95f2 req-67947e04-eae8-4a34-a95c-13d4e27b6165 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:24.293396 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-a3ce07df-a5c4-4ce2-bf6e-9de82cbc95f2 req-67947e04-eae8-4a34-a95c-13d4e27b6165 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:24.294640 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-a3ce07df-a5c4-4ce2-bf6e-9de82cbc95f2 req-67947e04-eae8-4a34-a95c-13d4e27b6165 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:24.310901 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-a3ce07df-a5c4-4ce2-bf6e-9de82cbc95f2 req-67947e04-eae8-4a34-a95c-13d4e27b6165 service nova] Creating event network-vif-deleted:62dbe1ae-a63f-40d9-b089-d8e7f6ba2713 for instance cbc794b1-563e-49d1-92d9-86cea9a9bf75 on n-h2-858094-4 Sep 16 13:01:24.317985 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-a3ce07df-a5c4-4ce2-bf6e-9de82cbc95f2 req-67947e04-eae8-4a34-a95c-13d4e27b6165 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042359 Sep 16 13:01:24.319103 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1644/3380] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:01:24.326789 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-aad3accf-1046-40ce-92d7-7e45e543c281 req-e72f739c-24f9-47d8-965d-f2254ebcc371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af5e660b-de79-42ca-a8de-fe06738b9771", "name": "network-vif-plugged", "status": "completed", "tag": "3af800e8-0d1f-497b-bca5-8901587cb91c"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:01:24.339101 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-aad3accf-1046-40ce-92d7-7e45e543c281 req-e72f739c-24f9-47d8-965d-f2254ebcc371 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:24.339767 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-aad3accf-1046-40ce-92d7-7e45e543c281 req-e72f739c-24f9-47d8-965d-f2254ebcc371 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:24.340482 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-aad3accf-1046-40ce-92d7-7e45e543c281 req-e72f739c-24f9-47d8-965d-f2254ebcc371 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:24.354326 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-aad3accf-1046-40ce-92d7-7e45e543c281 req-e72f739c-24f9-47d8-965d-f2254ebcc371 service nova] Creating event network-vif-plugged:3af800e8-0d1f-497b-bca5-8901587cb91c for instance af5e660b-de79-42ca-a8de-fe06738b9771 on n-h2-858094-4 Sep 16 13:01:24.365411 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-aad3accf-1046-40ce-92d7-7e45e543c281 req-e72f739c-24f9-47d8-965d-f2254ebcc371 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044550 Sep 16 13:01:24.366367 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1645/3381] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:01:24.403535 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-703faab5-7365-4cf8-8aa2-e3ecd1bf428d tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] Action: 'create', calling method: .version_select at 0x7f1034e0cca0>, body: {"keypair": {"name": "tempest-keypair-1182455332", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:01:24.439430 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-703faab5-7365-4cf8-8aa2-e3ecd1bf428d tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] Getting quotas for project 96531eff18ec41e5af05abc67e141823. Resources: {'key_pairs'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:01:24.446588 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-703faab5-7365-4cf8-8aa2-e3ecd1bf428d tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] Getting quotas for user b6ff4f738e564361a8bfc961d120118e and project 96531eff18ec41e5af05abc67e141823. Resources: {'key_pairs'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:01:24.489911 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-703faab5-7365-4cf8-8aa2-e3ecd1bf428d tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.120643 Sep 16 13:01:24.491274 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1646/3382] 10.222.0.67 () {60 vars in 1159 bytes} [Fri Sep 16 13:01:24 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:01:24.506225 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9dcf396b-efd4-4973-b52e-84beafc999ed tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:24.506901 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9dcf396b-efd4-4973-b52e-84beafc999ed tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: 08836465-8c0f-454b-9e19-8bb6bd44f931] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:24.535886 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9dcf396b-efd4-4973-b52e-84beafc999ed tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:24.536538 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9dcf396b-efd4-4973-b52e-84beafc999ed tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:24.536989 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9dcf396b-efd4-4973-b52e-84beafc999ed tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:24.537832 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9dcf396b-efd4-4973-b52e-84beafc999ed tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:24.538178 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9dcf396b-efd4-4973-b52e-84beafc999ed tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:24.538601 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9dcf396b-efd4-4973-b52e-84beafc999ed tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:24.596327 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7ef2d6da-4b0f-4b75-ae46-832166e9e884 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:24.614443 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7ef2d6da-4b0f-4b75-ae46-832166e9e884 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:24.619298 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7ef2d6da-4b0f-4b75-ae46-832166e9e884 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:24.623733 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7ef2d6da-4b0f-4b75-ae46-832166e9e884 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1873 microversion: 2.42 time: 0.848668 Sep 16 13:01:24.637596 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1737/3383] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:01:23 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1873 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:01:24.654735 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9dcf396b-efd4-4973-b52e-84beafc999ed tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: 08836465-8c0f-454b-9e19-8bb6bd44f931] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:01:24.661353 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5a6a780b-e57d-40ad-83c2-e84733130fb0 tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] Calling method '.version_select at 0x7f10399e1a60>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:24.715035 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5a6a780b-e57d-40ad-83c2-e84733130fb0 tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1182455332" status: 202 len: 0 microversion: 2.1 time: 0.068399 Sep 16 13:01:24.715904 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1738/3384] 10.222.0.67 () {58 vars in 1221 bytes} [Fri Sep 16 13:01:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1182455332 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:01:24.738712 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-54b57bb2-20ad-48db-a0ef-14b040e95395 tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] Action: 'create', calling method: .version_select at 0x7f1039a338b0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-594084879", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZxZ6wU89Wy3okxGKqdSfQgL6l5CpCnF5hymB/q/3TGjFQeE6u4TsDGEZPyqOORXnZPX5lJPwF8LQrwRCNRGm9+wYaWT8J5OQS819UNLv+Msl17EtpDHGU6B1gYo9Gvtw=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:01:24.836587 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-54b57bb2-20ad-48db-a0ef-14b040e95395 tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] Getting quotas for project 96531eff18ec41e5af05abc67e141823. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:01:24.854150 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-54b57bb2-20ad-48db-a0ef-14b040e95395 tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] Getting quotas for user b6ff4f738e564361a8bfc961d120118e and project 96531eff18ec41e5af05abc67e141823. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:01:24.917959 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-54b57bb2-20ad-48db-a0ef-14b040e95395 tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.183282 Sep 16 13:01:24.920653 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9dcf396b-efd4-4973-b52e-84beafc999ed tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "DELETE /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931" status: 204 len: 0 microversion: 2.1 time: 0.427575 Sep 16 13:01:24.932863 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1739/3385] 10.222.0.67 () {60 vars in 1159 bytes} [Fri Sep 16 13:01:24 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:01:24.938426 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d9d51149-0364-464f-8ffd-4f986796f0cd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:24.939831 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1647/3386] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 13:01:24 2022] DELETE /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:01:24.949261 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d9d51149-0364-464f-8ffd-4f986796f0cd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:24.951856 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d0d81d84-fc46-4384-93ce-239b3f4ab5cd tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:24.955662 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d0d81d84-fc46-4384-93ce-239b3f4ab5cd tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:24.966020 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9d51149-0364-464f-8ffd-4f986796f0cd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:24.968762 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9d51149-0364-464f-8ffd-4f986796f0cd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:24.970314 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9d51149-0364-464f-8ffd-4f986796f0cd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:24.971346 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9d51149-0364-464f-8ffd-4f986796f0cd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:24.974216 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9d51149-0364-464f-8ffd-4f986796f0cd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:24.974617 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d0d81d84-fc46-4384-93ce-239b3f4ab5cd tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:24.975408 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d0d81d84-fc46-4384-93ce-239b3f4ab5cd tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:24.976099 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9d51149-0364-464f-8ffd-4f986796f0cd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:24.976821 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d0d81d84-fc46-4384-93ce-239b3f4ab5cd tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:24.979265 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d0d81d84-fc46-4384-93ce-239b3f4ab5cd tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:24.980020 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d0d81d84-fc46-4384-93ce-239b3f4ab5cd tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:24.984485 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d0d81d84-fc46-4384-93ce-239b3f4ab5cd tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:25.525897 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d9d51149-0364-464f-8ffd-4f986796f0cd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:25.542476 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d9d51149-0364-464f-8ffd-4f986796f0cd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 200 len: 1523 microversion: 2.1 time: 0.607833 Sep 16 13:01:25.558910 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1740/3387] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:24 2022] GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 1523 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:25.559186 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d0d81d84-fc46-4384-93ce-239b3f4ab5cd tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:25.563692 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d0d81d84-fc46-4384-93ce-239b3f4ab5cd tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1359 microversion: 2.1 time: 0.620243 Sep 16 13:01:25.566375 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1648/3388] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:24 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1359 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:25.575091 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9d92c0c8-48fa-40e5-9fe1-040acb523dce tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] Action: 'create', calling method: .version_select at 0x7f1039a23e50>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1940997843", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPns5WfQ3w606tDHCNhy5inQE07XqjThs0DL3NBMtqcW6Z3YfydOXnrZXLlx9SLnV+D6R9t5AXCJBIY27cyxPlC/K9VRx7GldhBB5DhMf/dMQS6HapMjlx3Y8d6lOujfNQ=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:01:25.582949 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4ff71951-4746-4f68-8c91-6ca23abafb55 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:25.584376 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-4ff71951-4746-4f68-8c91-6ca23abafb55 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: 08836465-8c0f-454b-9e19-8bb6bd44f931] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:25.617763 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4ff71951-4746-4f68-8c91-6ca23abafb55 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:25.620348 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4ff71951-4746-4f68-8c91-6ca23abafb55 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:25.620995 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4ff71951-4746-4f68-8c91-6ca23abafb55 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:25.625311 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4ff71951-4746-4f68-8c91-6ca23abafb55 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:25.626725 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4ff71951-4746-4f68-8c91-6ca23abafb55 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:25.628910 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4ff71951-4746-4f68-8c91-6ca23abafb55 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:25.636547 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-9d92c0c8-48fa-40e5-9fe1-040acb523dce tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] Getting quotas for project 96531eff18ec41e5af05abc67e141823. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:01:25.660997 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-9d92c0c8-48fa-40e5-9fe1-040acb523dce tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] Getting quotas for user b6ff4f738e564361a8bfc961d120118e and project 96531eff18ec41e5af05abc67e141823. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:01:25.679848 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:01:25.724979 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9d92c0c8-48fa-40e5-9fe1-040acb523dce tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.178461 Sep 16 13:01:25.727391 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1741/3389] 10.222.0.67 () {60 vars in 1159 bytes} [Fri Sep 16 13:01:25 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:01:25.739610 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a23b16c9-cb0d-4adb-b0a9-9a3a2f5ec85c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:25.741454 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a23b16c9-cb0d-4adb-b0a9-9a3a2f5ec85c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:25.750233 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a23b16c9-cb0d-4adb-b0a9-9a3a2f5ec85c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:25.751821 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a23b16c9-cb0d-4adb-b0a9-9a3a2f5ec85c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:25.752878 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a23b16c9-cb0d-4adb-b0a9-9a3a2f5ec85c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:25.754307 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a23b16c9-cb0d-4adb-b0a9-9a3a2f5ec85c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:25.755555 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a23b16c9-cb0d-4adb-b0a9-9a3a2f5ec85c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:25.756516 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a23b16c9-cb0d-4adb-b0a9-9a3a2f5ec85c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:26.142238 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a23b16c9-cb0d-4adb-b0a9-9a3a2f5ec85c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:26.164439 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a23b16c9-cb0d-4adb-b0a9-9a3a2f5ec85c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:26.166790 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a23b16c9-cb0d-4adb-b0a9-9a3a2f5ec85c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:26.177881 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a23b16c9-cb0d-4adb-b0a9-9a3a2f5ec85c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1873 microversion: 2.42 time: 0.439004 Sep 16 13:01:26.179075 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1742/3390] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:01:25 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1873 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:01:26.184139 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9ae0eb76-6644-4ac3-aa5f-f8166466816e tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] Action: 'create', calling method: .version_select at 0x7f1039a74af0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1856209834", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtHhHRJ7BeNy1HopCsFZ8PvuR882+jZg9/zUbjo87VhLtAa0us3ZISGkmNEdwJnMc5IRlP+OqvU+NSnKL2wDjlAbyiOuU86rGYkoxUc2ikyUIm6YcqUiZIpjpJLjttufw=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:01:26.235156 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-9ae0eb76-6644-4ac3-aa5f-f8166466816e tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] Getting quotas for project 96531eff18ec41e5af05abc67e141823. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:01:26.253635 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-9ae0eb76-6644-4ac3-aa5f-f8166466816e tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] Getting quotas for user b6ff4f738e564361a8bfc961d120118e and project 96531eff18ec41e5af05abc67e141823. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:01:26.330309 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9ae0eb76-6644-4ac3-aa5f-f8166466816e tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.148715 Sep 16 13:01:26.338333 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1743/3391] 10.222.0.67 () {60 vars in 1159 bytes} [Fri Sep 16 13:01:26 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:01:26.348177 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4ff71951-4746-4f68-8c91-6ca23abafb55 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0e6121124d4a15a63ac359bff5aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc3ef4fd0374ac4b74900369ca779aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:26.356937 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-138d7d42-3b78-4046-8c4c-9ffcbd63d97b tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] Calling method '.version_select at 0x7f1039a21790>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:26.370870 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4ff71951-4746-4f68-8c91-6ca23abafb55 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "GET /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931" status: 200 len: 1475 microversion: 2.1 time: 0.802766 Sep 16 13:01:26.372099 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1649/3392] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:25 2022] GET /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931 => generated 1475 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:26.396939 n-d-858094-4 devstack@n-api.service[128779]: WARNING oslo_db.sqlalchemy.utils [None req-138d7d42-3b78-4046-8c4c-9ffcbd63d97b tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 16 13:01:26.421356 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-138d7d42-3b78-4046-8c4c-9ffcbd63d97b tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] 10.222.0.67 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.081650 Sep 16 13:01:26.422178 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-9bfcea88-9905-4cde-a29f-9eff968df52b req-6a000928-ffa8-4e39-aa8b-1d21202935aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "defaddc3-3750-4d8a-b18a-dd6fdce1dbbf", "tag": "c7eb5869-5d95-47b8-9539-2bec50eb4428"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:01:26.429804 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1744/3393] 10.222.0.67 () {58 vars in 1137 bytes} [Fri Sep 16 13:01:26 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:26.440454 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d44ddd19-2ef6-4ee0-ac54-e854fb2dca87 tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] Calling method '.version_select at 0x7f103995fca0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:26.479790 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d44ddd19-2ef6-4ee0-ac54-e854fb2dca87 tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1856209834" status: 202 len: 0 microversion: 2.1 time: 0.047615 Sep 16 13:01:26.480802 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1745/3394] 10.222.0.67 () {58 vars in 1278 bytes} [Fri Sep 16 13:01:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1856209834 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:01:26.487889 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-9bfcea88-9905-4cde-a29f-9eff968df52b req-6a000928-ffa8-4e39-aa8b-1d21202935aa service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:26.488743 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-9bfcea88-9905-4cde-a29f-9eff968df52b req-6a000928-ffa8-4e39-aa8b-1d21202935aa service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:26.490782 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-9bfcea88-9905-4cde-a29f-9eff968df52b req-6a000928-ffa8-4e39-aa8b-1d21202935aa service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:26.497823 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0c0c02cd-2cb8-46cf-a59a-d9456d7ee48c tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] Calling method '.version_select at 0x7f1034b41040>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:26.535184 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0c0c02cd-2cb8-46cf-a59a-d9456d7ee48c tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1940997843" status: 202 len: 0 microversion: 2.1 time: 0.048061 Sep 16 13:01:26.536220 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1746/3395] 10.222.0.67 () {58 vars in 1278 bytes} [Fri Sep 16 13:01:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1940997843 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:01:26.546120 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-9bfcea88-9905-4cde-a29f-9eff968df52b req-6a000928-ffa8-4e39-aa8b-1d21202935aa service nova] Creating event network-changed:c7eb5869-5d95-47b8-9539-2bec50eb4428 for instance defaddc3-3750-4d8a-b18a-dd6fdce1dbbf on n-h1-858094-4 Sep 16 13:01:26.548940 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-30156daf-30fe-4c94-8017-06f3dc1a9bef tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] Calling method '.version_select at 0x7f1039957280>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:26.555953 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-9bfcea88-9905-4cde-a29f-9eff968df52b req-6a000928-ffa8-4e39-aa8b-1d21202935aa service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142105 Sep 16 13:01:26.557483 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1650/3396] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:01:26.604562 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-94a307d7-ea8d-47e3-a9cf-4f23f887fce0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:26.606347 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-94a307d7-ea8d-47e3-a9cf-4f23f887fce0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:26.609431 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-30156daf-30fe-4c94-8017-06f3dc1a9bef tempest-KeyPairsV2TestJSON-422196156 tempest-KeyPairsV2TestJSON-422196156-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-594084879" status: 202 len: 0 microversion: 2.1 time: 0.068690 Sep 16 13:01:26.615362 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1747/3397] 10.222.0.67 () {58 vars in 1275 bytes} [Fri Sep 16 13:01:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-594084879 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:01:26.628557 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-97bf59f6-b0bc-4efc-9775-9681a8838635 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:26.635507 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-97bf59f6-b0bc-4efc-9775-9681a8838635 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:26.652064 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97bf59f6-b0bc-4efc-9775-9681a8838635 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:26.652551 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-94a307d7-ea8d-47e3-a9cf-4f23f887fce0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:26.654504 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-94a307d7-ea8d-47e3-a9cf-4f23f887fce0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:26.654890 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97bf59f6-b0bc-4efc-9775-9681a8838635 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:26.655037 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-94a307d7-ea8d-47e3-a9cf-4f23f887fce0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:26.655642 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-94a307d7-ea8d-47e3-a9cf-4f23f887fce0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:26.655927 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97bf59f6-b0bc-4efc-9775-9681a8838635 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:26.656105 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-94a307d7-ea8d-47e3-a9cf-4f23f887fce0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:26.656601 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-94a307d7-ea8d-47e3-a9cf-4f23f887fce0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:26.667750 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97bf59f6-b0bc-4efc-9775-9681a8838635 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:26.683799 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97bf59f6-b0bc-4efc-9775-9681a8838635 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:26.685727 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97bf59f6-b0bc-4efc-9775-9681a8838635 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:27.207983 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:01:27.235213 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-97bf59f6-b0bc-4efc-9775-9681a8838635 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:27.246148 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-97bf59f6-b0bc-4efc-9775-9681a8838635 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1546 microversion: 2.1 time: 0.626537 Sep 16 13:01:27.252437 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1748/3398] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:26 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1546 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:27.273384 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cd742c16-ecd1-40d6-b905-5e2f5d49ed39 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:27.274226 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cd742c16-ecd1-40d6-b905-5e2f5d49ed39 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:27.282606 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd742c16-ecd1-40d6-b905-5e2f5d49ed39 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:27.283105 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd742c16-ecd1-40d6-b905-5e2f5d49ed39 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:27.283543 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd742c16-ecd1-40d6-b905-5e2f5d49ed39 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:27.284272 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd742c16-ecd1-40d6-b905-5e2f5d49ed39 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:27.284729 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd742c16-ecd1-40d6-b905-5e2f5d49ed39 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:27.285152 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd742c16-ecd1-40d6-b905-5e2f5d49ed39 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:27.500944 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-94a307d7-ea8d-47e3-a9cf-4f23f887fce0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:27.515084 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-94a307d7-ea8d-47e3-a9cf-4f23f887fce0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 200 len: 1523 microversion: 2.1 time: 0.950474 Sep 16 13:01:27.515782 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1651/3399] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:26 2022] GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 1523 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:27.539701 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ff057a5d-b68c-4ef6-baa2-5fcb6fd01c48 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:27.540487 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ff057a5d-b68c-4ef6-baa2-5fcb6fd01c48 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:27.548398 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ff057a5d-b68c-4ef6-baa2-5fcb6fd01c48 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:27.548908 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ff057a5d-b68c-4ef6-baa2-5fcb6fd01c48 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:27.549581 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ff057a5d-b68c-4ef6-baa2-5fcb6fd01c48 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:27.550765 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ff057a5d-b68c-4ef6-baa2-5fcb6fd01c48 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:27.551298 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ff057a5d-b68c-4ef6-baa2-5fcb6fd01c48 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:27.551802 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ff057a5d-b68c-4ef6-baa2-5fcb6fd01c48 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:27.931944 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ff057a5d-b68c-4ef6-baa2-5fcb6fd01c48 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.401467 Sep 16 13:01:27.932789 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1652/3400] 10.222.0.67 () {58 vars in 1275 bytes} [Fri Sep 16 13:01:27 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771/os-interface => generated 284 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:01:27.948455 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-43478361-94f6-4cf9-a677-7bb4de2b1ad1 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:27.949337 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-43478361-94f6-4cf9-a677-7bb4de2b1ad1 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: 08836465-8c0f-454b-9e19-8bb6bd44f931] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:27.969801 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-43478361-94f6-4cf9-a677-7bb4de2b1ad1 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:27.974044 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-43478361-94f6-4cf9-a677-7bb4de2b1ad1 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:27.975571 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-43478361-94f6-4cf9-a677-7bb4de2b1ad1 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:27.979745 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-43478361-94f6-4cf9-a677-7bb4de2b1ad1 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:27.980580 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-43478361-94f6-4cf9-a677-7bb4de2b1ad1 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:27.982588 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-43478361-94f6-4cf9-a677-7bb4de2b1ad1 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:28.919893 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cd742c16-ecd1-40d6-b905-5e2f5d49ed39 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:28.937849 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cd742c16-ecd1-40d6-b905-5e2f5d49ed39 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:28.939578 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cd742c16-ecd1-40d6-b905-5e2f5d49ed39 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:28.956612 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cd742c16-ecd1-40d6-b905-5e2f5d49ed39 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1873 microversion: 2.42 time: 1.705672 Sep 16 13:01:28.957767 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1749/3401] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:01:27 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1873 bytes in 1708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:01:29.396587 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-8f0db8ac-6703-4c1e-8343-efd8d843d8f2 req-8559658a-be45-41da-8739-0e50955f0830 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66413dbd-455f-45f6-b057-39a11a9f2d44", "tag": "3a5b1f2b-2004-4cf4-93bd-f498b62488fe"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:01:29.407558 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8f0db8ac-6703-4c1e-8343-efd8d843d8f2 req-8559658a-be45-41da-8739-0e50955f0830 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:29.408351 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8f0db8ac-6703-4c1e-8343-efd8d843d8f2 req-8559658a-be45-41da-8739-0e50955f0830 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:29.408971 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8f0db8ac-6703-4c1e-8343-efd8d843d8f2 req-8559658a-be45-41da-8739-0e50955f0830 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:29.427225 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-8f0db8ac-6703-4c1e-8343-efd8d843d8f2 req-8559658a-be45-41da-8739-0e50955f0830 service nova] Creating event network-changed:3a5b1f2b-2004-4cf4-93bd-f498b62488fe for instance 66413dbd-455f-45f6-b057-39a11a9f2d44 on n-h1-858094-4 Sep 16 13:01:29.439749 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-8f0db8ac-6703-4c1e-8343-efd8d843d8f2 req-8559658a-be45-41da-8739-0e50955f0830 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.480432 Sep 16 13:01:29.440736 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1750/3402] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:01:29.446329 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c473545d-5486-4c4b-9d7e-6046067a6f31 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:29.447146 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c473545d-5486-4c4b-9d7e-6046067a6f31 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:29.482368 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-43478361-94f6-4cf9-a677-7bb4de2b1ad1 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0e6121124d4a15a63ac359bff5aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc3ef4fd0374ac4b74900369ca779aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:29.491876 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c473545d-5486-4c4b-9d7e-6046067a6f31 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:29.492352 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-43478361-94f6-4cf9-a677-7bb4de2b1ad1 tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "GET /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931" status: 200 len: 1475 microversion: 2.1 time: 1.558072 Sep 16 13:01:29.492953 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1653/3403] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:27 2022] GET /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931 => generated 1475 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:29.502805 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c473545d-5486-4c4b-9d7e-6046067a6f31 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:29.502805 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c473545d-5486-4c4b-9d7e-6046067a6f31 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:29.502805 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c473545d-5486-4c4b-9d7e-6046067a6f31 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:29.502805 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c473545d-5486-4c4b-9d7e-6046067a6f31 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:29.502805 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c473545d-5486-4c4b-9d7e-6046067a6f31 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:29.643285 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-3e229978-e579-49b5-94a5-4ed52240973b req-deecc49b-3622-4c77-8333-3c6507613a40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "defaddc3-3750-4d8a-b18a-dd6fdce1dbbf", "tag": "8c121ccb-eba9-4b08-98af-afba73327fcc"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:01:29.669751 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:01:29.679612 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-3e229978-e579-49b5-94a5-4ed52240973b req-deecc49b-3622-4c77-8333-3c6507613a40 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:29.682209 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-3e229978-e579-49b5-94a5-4ed52240973b req-deecc49b-3622-4c77-8333-3c6507613a40 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:29.683500 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-3e229978-e579-49b5-94a5-4ed52240973b req-deecc49b-3622-4c77-8333-3c6507613a40 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:29.721870 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-3e229978-e579-49b5-94a5-4ed52240973b req-deecc49b-3622-4c77-8333-3c6507613a40 service nova] Creating event network-changed:8c121ccb-eba9-4b08-98af-afba73327fcc for instance defaddc3-3750-4d8a-b18a-dd6fdce1dbbf on n-h1-858094-4 Sep 16 13:01:29.730371 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-3e229978-e579-49b5-94a5-4ed52240973b req-deecc49b-3622-4c77-8333-3c6507613a40 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095548 Sep 16 13:01:29.731819 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1654/3404] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:01:29.989699 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0822a5c3-9c88-4d25-859e-ded0dae022d2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:29.990440 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0822a5c3-9c88-4d25-859e-ded0dae022d2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:30.000626 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0822a5c3-9c88-4d25-859e-ded0dae022d2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:30.001118 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0822a5c3-9c88-4d25-859e-ded0dae022d2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:30.001728 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0822a5c3-9c88-4d25-859e-ded0dae022d2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:30.002918 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0822a5c3-9c88-4d25-859e-ded0dae022d2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:30.003572 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0822a5c3-9c88-4d25-859e-ded0dae022d2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:30.004436 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0822a5c3-9c88-4d25-859e-ded0dae022d2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:30.623666 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c473545d-5486-4c4b-9d7e-6046067a6f31 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:30.664210 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c473545d-5486-4c4b-9d7e-6046067a6f31 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 200 len: 1505 microversion: 2.1 time: 1.222157 Sep 16 13:01:30.670967 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1751/3405] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:29 2022] GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 1505 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:30.700985 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-47a4d60d-acd3-4991-ac8e-5e94d834106e tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:30.703874 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-47a4d60d-acd3-4991-ac8e-5e94d834106e tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: 08836465-8c0f-454b-9e19-8bb6bd44f931] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:30.723463 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47a4d60d-acd3-4991-ac8e-5e94d834106e tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:30.724682 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47a4d60d-acd3-4991-ac8e-5e94d834106e tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:30.727976 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47a4d60d-acd3-4991-ac8e-5e94d834106e tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:30.731700 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47a4d60d-acd3-4991-ac8e-5e94d834106e tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:30.732564 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47a4d60d-acd3-4991-ac8e-5e94d834106e tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:30.733163 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47a4d60d-acd3-4991-ac8e-5e94d834106e tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:30.790139 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47a4d60d-acd3-4991-ac8e-5e94d834106e tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:30.792733 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47a4d60d-acd3-4991-ac8e-5e94d834106e tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:30.795065 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47a4d60d-acd3-4991-ac8e-5e94d834106e tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:30.796011 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-47a4d60d-acd3-4991-ac8e-5e94d834106e tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lazy-loading 'fault' on Instance uuid 08836465-8c0f-454b-9e19-8bb6bd44f931 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:01:31.179419 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-47a4d60d-acd3-4991-ac8e-5e94d834106e tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0e6121124d4a15a63ac359bff5aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc3ef4fd0374ac4b74900369ca779aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:31.190666 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-47a4d60d-acd3-4991-ac8e-5e94d834106e tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "GET /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931" status: 200 len: 1309 microversion: 2.1 time: 0.514022 Sep 16 13:01:31.205465 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1752/3406] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:30 2022] GET /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931 => generated 1309 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:31.217442 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-934eb22a-4b5a-448e-a10f-0e016932c808 req-dc0e3703-c3d2-4aff-b6af-0e80506d0c94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "464c1886-1201-4b29-b61a-727d5c9e22b6", "name": "network-vif-unplugged", "status": "completed", "tag": "116c6c97-9499-4c0e-861c-371e4ecf4ba2"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:01:31.230800 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-934eb22a-4b5a-448e-a10f-0e016932c808 req-dc0e3703-c3d2-4aff-b6af-0e80506d0c94 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:31.231877 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-934eb22a-4b5a-448e-a10f-0e016932c808 req-dc0e3703-c3d2-4aff-b6af-0e80506d0c94 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:31.232405 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-934eb22a-4b5a-448e-a10f-0e016932c808 req-dc0e3703-c3d2-4aff-b6af-0e80506d0c94 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:31.270408 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-934eb22a-4b5a-448e-a10f-0e016932c808 req-dc0e3703-c3d2-4aff-b6af-0e80506d0c94 service nova] Creating event network-vif-unplugged:116c6c97-9499-4c0e-861c-371e4ecf4ba2 for instance 464c1886-1201-4b29-b61a-727d5c9e22b6 on n-h2-858094-4 Sep 16 13:01:31.277983 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-934eb22a-4b5a-448e-a10f-0e016932c808 req-dc0e3703-c3d2-4aff-b6af-0e80506d0c94 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070342 Sep 16 13:01:31.279219 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1753/3407] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:01:31.346026 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0822a5c3-9c88-4d25-859e-ded0dae022d2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:31.357995 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0822a5c3-9c88-4d25-859e-ded0dae022d2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:31.360154 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0822a5c3-9c88-4d25-859e-ded0dae022d2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:31.361661 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0822a5c3-9c88-4d25-859e-ded0dae022d2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1873 microversion: 2.42 time: 1.378354 Sep 16 13:01:31.362455 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1655/3408] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:01:29 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1873 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:01:31.459576 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-018bb6e4-62a8-48cb-a6a1-f9f98a92819e req-e8fcc079-326e-477b-b330-abeff9a65f94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af5e660b-de79-42ca-a8de-fe06738b9771", "tag": "3af800e8-0d1f-497b-bca5-8901587cb91c"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:01:31.476015 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-018bb6e4-62a8-48cb-a6a1-f9f98a92819e req-e8fcc079-326e-477b-b330-abeff9a65f94 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:31.479860 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-018bb6e4-62a8-48cb-a6a1-f9f98a92819e req-e8fcc079-326e-477b-b330-abeff9a65f94 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:31.483922 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-018bb6e4-62a8-48cb-a6a1-f9f98a92819e req-e8fcc079-326e-477b-b330-abeff9a65f94 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:31.532490 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-018bb6e4-62a8-48cb-a6a1-f9f98a92819e req-e8fcc079-326e-477b-b330-abeff9a65f94 service nova] Creating event network-changed:3af800e8-0d1f-497b-bca5-8901587cb91c for instance af5e660b-de79-42ca-a8de-fe06738b9771 on n-h2-858094-4 Sep 16 13:01:31.541797 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-018bb6e4-62a8-48cb-a6a1-f9f98a92819e req-e8fcc079-326e-477b-b330-abeff9a65f94 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087627 Sep 16 13:01:31.543045 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1754/3409] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:01:31.698661 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-56c7375e-8f84-450c-ae7f-d492d3680f2a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:31.699616 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-56c7375e-8f84-450c-ae7f-d492d3680f2a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:31.707499 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-56c7375e-8f84-450c-ae7f-d492d3680f2a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:31.708256 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-56c7375e-8f84-450c-ae7f-d492d3680f2a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:31.708883 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-56c7375e-8f84-450c-ae7f-d492d3680f2a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:31.710118 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-56c7375e-8f84-450c-ae7f-d492d3680f2a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:31.710958 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-56c7375e-8f84-450c-ae7f-d492d3680f2a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:31.711547 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-56c7375e-8f84-450c-ae7f-d492d3680f2a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:32.180851 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-b4ed7e00-3447-4f62-96f0-91f09c62daa2 req-ac202a8c-2175-44d9-9ca2-2dc14a784c9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08836465-8c0f-454b-9e19-8bb6bd44f931", "name": "network-vif-deleted", "tag": "49603217-44ca-43b5-b254-906cf820af9e"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:01:32.200980 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b4ed7e00-3447-4f62-96f0-91f09c62daa2 req-ac202a8c-2175-44d9-9ca2-2dc14a784c9f service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:32.202022 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b4ed7e00-3447-4f62-96f0-91f09c62daa2 req-ac202a8c-2175-44d9-9ca2-2dc14a784c9f service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:32.202960 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b4ed7e00-3447-4f62-96f0-91f09c62daa2 req-ac202a8c-2175-44d9-9ca2-2dc14a784c9f service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:32.218581 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-b4ed7e00-3447-4f62-96f0-91f09c62daa2 req-ac202a8c-2175-44d9-9ca2-2dc14a784c9f service nova] Creating event network-vif-deleted:49603217-44ca-43b5-b254-906cf820af9e for instance 08836465-8c0f-454b-9e19-8bb6bd44f931 on n-h1-858094-4 Sep 16 13:01:32.230626 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-b4ed7e00-3447-4f62-96f0-91f09c62daa2 req-ac202a8c-2175-44d9-9ca2-2dc14a784c9f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055059 Sep 16 13:01:32.231968 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1755/3410] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:01:32.258054 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3ab008dc-af69-4ea4-8bcc-ad54a95f20ee tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:32.259172 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3ab008dc-af69-4ea4-8bcc-ad54a95f20ee tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] [instance: 08836465-8c0f-454b-9e19-8bb6bd44f931] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:32.271396 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ab008dc-af69-4ea4-8bcc-ad54a95f20ee tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:32.272634 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ab008dc-af69-4ea4-8bcc-ad54a95f20ee tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:32.273297 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ab008dc-af69-4ea4-8bcc-ad54a95f20ee tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:32.274659 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ab008dc-af69-4ea4-8bcc-ad54a95f20ee tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:32.275342 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ab008dc-af69-4ea4-8bcc-ad54a95f20ee tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:32.275977 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ab008dc-af69-4ea4-8bcc-ad54a95f20ee tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:32.328447 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-3ab008dc-af69-4ea4-8bcc-ad54a95f20ee tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] HTTP exception thrown: Instance 08836465-8c0f-454b-9e19-8bb6bd44f931 could not be found. Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3ab008dc-af69-4ea4-8bcc-ad54a95f20ee tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Request method failure captured: Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931 HTTP/1.1 Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHNKJ_J6cN6jPBzMvOd6ir-anoDpohg2YGFEu6gt5vPCDPAwGBtannKUA3LhEAXNGw4vh_z3q_EB0s-zno1yH-Mp-nylosMieKTH51rub2QyTW_Aojivq-4rbpXTvmeIic7c6f4-SurTXSD05r3HFHbnSffUhqUgdUbrJ90o9knDVBg Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 9bc3ef4fd0374ac4b74900369ca779aa Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-LiveMigrationNegativeTest-1708726340 Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9bc3ef4fd0374ac4b74900369ca779aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9bc3ef4fd0374ac4b74900369ca779aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9bc3ef4fd0374ac4b74900369ca779aa", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9bc3ef4fd0374ac4b74900369ca779aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-LiveMigrationNegativeTest-1708726340 Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 9bc3ef4fd0374ac4b74900369ca779aa Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1708726340 Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-LiveMigrationNegativeTest-1708726340-project Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: eb0e6121124d4a15a63ac359bff5aedb Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-LiveMigrationNegativeTest-1708726340-project Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 08836465-8c0f-454b-9e19-8bb6bd44f931 could not be found. Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '08836465-8c0f-454b-9e19-8bb6bd44f931'} Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08836465-8c0f-454b-9e19-8bb6bd44f931 could not be found. Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08836465-8c0f-454b-9e19-8bb6bd44f931 could not be found. Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:01:32.330968 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:01:32.338779 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:01:32.338779 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:01:32.338779 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:01:32.338779 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:01:32.338779 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:01:32.338779 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08836465-8c0f-454b-9e19-8bb6bd44f931 could not be found. Sep 16 13:01:32.338779 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:01:32.338779 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3ab008dc-af69-4ea4-8bcc-ad54a95f20ee tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] Returning 404 to user: Instance 08836465-8c0f-454b-9e19-8bb6bd44f931 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:01:32.338779 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3ab008dc-af69-4ea4-8bcc-ad54a95f20ee tempest-LiveMigrationNegativeTest-1708726340 tempest-LiveMigrationNegativeTest-1708726340-project] 10.222.0.67 "GET /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931" status: 404 len: 111 microversion: 2.1 time: 0.099154 Sep 16 13:01:32.338779 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1756/3411] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:32 2022] GET /compute/v2.1/servers/08836465-8c0f-454b-9e19-8bb6bd44f931 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:01:32.394398 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d96295f3-8a7c-4faf-a25c-737c44b8f149 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:32.395989 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d96295f3-8a7c-4faf-a25c-737c44b8f149 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:32.406725 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d96295f3-8a7c-4faf-a25c-737c44b8f149 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:32.407549 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d96295f3-8a7c-4faf-a25c-737c44b8f149 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:32.408191 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d96295f3-8a7c-4faf-a25c-737c44b8f149 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:32.409252 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d96295f3-8a7c-4faf-a25c-737c44b8f149 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:32.409887 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d96295f3-8a7c-4faf-a25c-737c44b8f149 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:32.410679 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d96295f3-8a7c-4faf-a25c-737c44b8f149 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:33.156164 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-56c7375e-8f84-450c-ae7f-d492d3680f2a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:33.164431 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-56c7375e-8f84-450c-ae7f-d492d3680f2a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 200 len: 1505 microversion: 2.1 time: 1.471254 Sep 16 13:01:33.190596 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d96295f3-8a7c-4faf-a25c-737c44b8f149 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:33.201394 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1656/3412] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:31 2022] GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 1505 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:33.203858 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d96295f3-8a7c-4faf-a25c-737c44b8f149 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:33.222733 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d96295f3-8a7c-4faf-a25c-737c44b8f149 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:33.224830 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d96295f3-8a7c-4faf-a25c-737c44b8f149 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1873 microversion: 2.42 time: 0.834743 Sep 16 13:01:33.225587 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1757/3413] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:01:32 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1873 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:01:34.199797 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-980aa642-fd40-4be9-b153-1ec852ecd1d0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:34.201288 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-980aa642-fd40-4be9-b153-1ec852ecd1d0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:34.210189 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-980aa642-fd40-4be9-b153-1ec852ecd1d0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:34.211000 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-980aa642-fd40-4be9-b153-1ec852ecd1d0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:34.211607 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-980aa642-fd40-4be9-b153-1ec852ecd1d0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:34.212522 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-980aa642-fd40-4be9-b153-1ec852ecd1d0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:34.213193 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-980aa642-fd40-4be9-b153-1ec852ecd1d0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:34.213961 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-980aa642-fd40-4be9-b153-1ec852ecd1d0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:34.256494 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d3f2b4a7-e3fb-4578-9e9e-0f79a20faeac tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:34.257728 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d3f2b4a7-e3fb-4578-9e9e-0f79a20faeac tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:34.267911 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3f2b4a7-e3fb-4578-9e9e-0f79a20faeac tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:34.268740 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3f2b4a7-e3fb-4578-9e9e-0f79a20faeac tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:34.269371 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3f2b4a7-e3fb-4578-9e9e-0f79a20faeac tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:34.270255 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3f2b4a7-e3fb-4578-9e9e-0f79a20faeac tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:34.270878 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3f2b4a7-e3fb-4578-9e9e-0f79a20faeac tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:34.271468 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3f2b4a7-e3fb-4578-9e9e-0f79a20faeac tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:34.459557 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=8 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:01:34.761695 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-980aa642-fd40-4be9-b153-1ec852ecd1d0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:34.787590 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-980aa642-fd40-4be9-b153-1ec852ecd1d0 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 200 len: 1448 microversion: 2.1 time: 0.593034 Sep 16 13:01:34.791148 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1657/3414] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:34 2022] GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 1448 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:34.817577 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-1454c48c-604e-4090-a880-fc97dd705729 req-6f3389f9-4dbd-401c-8a63-8de3695f753e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "defaddc3-3750-4d8a-b18a-dd6fdce1dbbf", "tag": "328ce2f8-022c-446e-b388-06295b8c63e7"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:01:34.863427 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-1454c48c-604e-4090-a880-fc97dd705729 req-6f3389f9-4dbd-401c-8a63-8de3695f753e service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:34.867521 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-1454c48c-604e-4090-a880-fc97dd705729 req-6f3389f9-4dbd-401c-8a63-8de3695f753e service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:34.869703 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-1454c48c-604e-4090-a880-fc97dd705729 req-6f3389f9-4dbd-401c-8a63-8de3695f753e service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:34.920745 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-1454c48c-604e-4090-a880-fc97dd705729 req-6f3389f9-4dbd-401c-8a63-8de3695f753e service nova] Creating event network-changed:328ce2f8-022c-446e-b388-06295b8c63e7 for instance defaddc3-3750-4d8a-b18a-dd6fdce1dbbf on n-h1-858094-4 Sep 16 13:01:34.929082 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-1454c48c-604e-4090-a880-fc97dd705729 req-6f3389f9-4dbd-401c-8a63-8de3695f753e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133242 Sep 16 13:01:34.930569 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1658/3415] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:01:34.936365 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-79df2c6b-0e4e-4a27-b491-a38c3f5cb76a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:34.937481 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-79df2c6b-0e4e-4a27-b491-a38c3f5cb76a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:34.945111 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-79df2c6b-0e4e-4a27-b491-a38c3f5cb76a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:34.945600 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-79df2c6b-0e4e-4a27-b491-a38c3f5cb76a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:34.946219 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-79df2c6b-0e4e-4a27-b491-a38c3f5cb76a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:34.947315 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-79df2c6b-0e4e-4a27-b491-a38c3f5cb76a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:34.947943 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-79df2c6b-0e4e-4a27-b491-a38c3f5cb76a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:34.949374 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-79df2c6b-0e4e-4a27-b491-a38c3f5cb76a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:34.988902 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-79df2c6b-0e4e-4a27-b491-a38c3f5cb76a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:01:34.999023 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.compute.api [None req-79df2c6b-0e4e-4a27-b491-a38c3f5cb76a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Working on deleting snapshot 9c73168c-ff3e-40c3-98b2-1cb5a136f78f from shelved instance... Sep 16 13:01:35.017109 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d3f2b4a7-e3fb-4578-9e9e-0f79a20faeac tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:35.032815 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d3f2b4a7-e3fb-4578-9e9e-0f79a20faeac tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:35.046843 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d3f2b4a7-e3fb-4578-9e9e-0f79a20faeac tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:35.050934 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d3f2b4a7-e3fb-4578-9e9e-0f79a20faeac tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1873 microversion: 2.42 time: 0.797367 Sep 16 13:01:35.054613 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1758/3416] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:01:34 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1873 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:01:36.086781 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-13f65bc8-0a7c-4293-9e78-aae6ab9fa7fb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:36.087429 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-13f65bc8-0a7c-4293-9e78-aae6ab9fa7fb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:36.109377 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13f65bc8-0a7c-4293-9e78-aae6ab9fa7fb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:36.113757 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13f65bc8-0a7c-4293-9e78-aae6ab9fa7fb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:36.114548 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13f65bc8-0a7c-4293-9e78-aae6ab9fa7fb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:36.115671 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13f65bc8-0a7c-4293-9e78-aae6ab9fa7fb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:36.116337 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13f65bc8-0a7c-4293-9e78-aae6ab9fa7fb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:36.116501 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-79df2c6b-0e4e-4a27-b491-a38c3f5cb76a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Doing local delete in cell 19bb4c25-c68f-412b-8c46-4f5dc22c63ee(cell1) {{(pid=128780) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 16 13:01:36.117272 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-79df2c6b-0e4e-4a27-b491-a38c3f5cb76a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:36.117758 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-79df2c6b-0e4e-4a27-b491-a38c3f5cb76a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:36.118215 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-79df2c6b-0e4e-4a27-b491-a38c3f5cb76a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:36.118644 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.compute.api [None req-79df2c6b-0e4e-4a27-b491-a38c3f5cb76a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 16 13:01:36.123608 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13f65bc8-0a7c-4293-9e78-aae6ab9fa7fb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:36.133353 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:01:36.141914 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-79df2c6b-0e4e-4a27-b491-a38c3f5cb76a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] deallocate_for_instance() {{(pid=128780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 16 13:01:36.289486 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=16 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:01:37.703421 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-13f65bc8-0a7c-4293-9e78-aae6ab9fa7fb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:37.732026 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-13f65bc8-0a7c-4293-9e78-aae6ab9fa7fb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:37.735041 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-13f65bc8-0a7c-4293-9e78-aae6ab9fa7fb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:37.745533 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-13f65bc8-0a7c-4293-9e78-aae6ab9fa7fb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1873 microversion: 2.42 time: 1.664386 Sep 16 13:01:37.760718 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1759/3417] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:01:36 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1873 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:01:38.779916 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6060598b-ad36-4d3f-8156-27ebbb3229c1 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:38.781018 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6060598b-ad36-4d3f-8156-27ebbb3229c1 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:38.791427 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6060598b-ad36-4d3f-8156-27ebbb3229c1 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:38.791884 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6060598b-ad36-4d3f-8156-27ebbb3229c1 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:38.792452 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6060598b-ad36-4d3f-8156-27ebbb3229c1 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:38.793243 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6060598b-ad36-4d3f-8156-27ebbb3229c1 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:38.794375 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6060598b-ad36-4d3f-8156-27ebbb3229c1 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:38.794869 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6060598b-ad36-4d3f-8156-27ebbb3229c1 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:39.991487 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6060598b-ad36-4d3f-8156-27ebbb3229c1 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:40.011100 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6060598b-ad36-4d3f-8156-27ebbb3229c1 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:40.013533 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6060598b-ad36-4d3f-8156-27ebbb3229c1 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:40.019860 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6060598b-ad36-4d3f-8156-27ebbb3229c1 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1873 microversion: 2.42 time: 1.244850 Sep 16 13:01:40.020867 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1760/3418] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:01:38 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1873 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:01:40.608460 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-193264eb-0d43-4cfb-842f-2e94b2d9b459 req-4828dc5e-d98b-43e2-a645-8c584a9f7f9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "464c1886-1201-4b29-b61a-727d5c9e22b6", "name": "network-vif-deleted", "tag": "116c6c97-9499-4c0e-861c-371e4ecf4ba2"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:01:40.611187 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-79df2c6b-0e4e-4a27-b491-a38c3f5cb76a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Updating instance_info_cache with network_info: [] {{(pid=128780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 16 13:01:40.633006 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-193264eb-0d43-4cfb-842f-2e94b2d9b459 req-4828dc5e-d98b-43e2-a645-8c584a9f7f9d service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:40.633775 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-193264eb-0d43-4cfb-842f-2e94b2d9b459 req-4828dc5e-d98b-43e2-a645-8c584a9f7f9d service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:40.634321 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-193264eb-0d43-4cfb-842f-2e94b2d9b459 req-4828dc5e-d98b-43e2-a645-8c584a9f7f9d service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:40.651466 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:01:40.669830 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.compute.server_external_events [req-193264eb-0d43-4cfb-842f-2e94b2d9b459 req-4828dc5e-d98b-43e2-a645-8c584a9f7f9d service nova] Unable to find a host for instance 464c1886-1201-4b29-b61a-727d5c9e22b6. Dropping event network-vif-deleted {{(pid=128779) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 16 13:01:40.673880 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-193264eb-0d43-4cfb-842f-2e94b2d9b459 req-4828dc5e-d98b-43e2-a645-8c584a9f7f9d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.069284 Sep 16 13:01:40.675893 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1761/3419] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 74 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 16 13:01:41.048852 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c9084e9f-9f91-4f97-8b42-5f877af41383 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:41.049463 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c9084e9f-9f91-4f97-8b42-5f877af41383 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:41.061402 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9084e9f-9f91-4f97-8b42-5f877af41383 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:41.070635 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9084e9f-9f91-4f97-8b42-5f877af41383 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:41.072244 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9084e9f-9f91-4f97-8b42-5f877af41383 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:41.076677 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9084e9f-9f91-4f97-8b42-5f877af41383 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:41.077182 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9084e9f-9f91-4f97-8b42-5f877af41383 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:41.077630 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9084e9f-9f91-4f97-8b42-5f877af41383 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:41.411797 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-79df2c6b-0e4e-4a27-b491-a38c3f5cb76a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "DELETE /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 204 len: 0 microversion: 2.1 time: 6.478856 Sep 16 13:01:41.414898 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1659/3420] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 13:01:34 2022] DELETE /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 0 bytes in 6483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:01:41.432002 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1c333ad5-545b-40bd-a4b2-6299a3525859 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:41.444294 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-1c333ad5-545b-40bd-a4b2-6299a3525859 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:41.474210 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1c333ad5-545b-40bd-a4b2-6299a3525859 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:41.475176 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1c333ad5-545b-40bd-a4b2-6299a3525859 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:41.476903 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1c333ad5-545b-40bd-a4b2-6299a3525859 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:41.477846 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1c333ad5-545b-40bd-a4b2-6299a3525859 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:41.478484 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1c333ad5-545b-40bd-a4b2-6299a3525859 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:41.487465 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1c333ad5-545b-40bd-a4b2-6299a3525859 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:41.518857 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-1c333ad5-545b-40bd-a4b2-6299a3525859 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] HTTP exception thrown: Instance 464c1886-1201-4b29-b61a-727d5c9e22b6 could not be found. Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1c333ad5-545b-40bd-a4b2-6299a3525859 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Request method failure captured: Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 HTTP/1.1 Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHK-ai74OxrHHqL5ZA97hOvy32Q6xIReVrKhZIj6PEPyQ_UB4rFs-7hdJCkozKZ5clo_9DaVkBFgsUmiSN_gmVaPdL8FT-f5QYKPk-CE61XDTK1RMhpnQkeVMlba4E4KaPfDCDA8WSNup3uH3mzkxsd2kp-OesctbTYQkqWqHnAvC3I Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_cfe82d8dd4fb42cbb054a6f069424c57", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-DeleteServersTestJSON-1385458479-project Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 2e531a7026054c34b2a78a1c484cbe02 Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-DeleteServersTestJSON-1385458479-project Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance 464c1886-1201-4b29-b61a-727d5c9e22b6 could not be found. Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '464c1886-1201-4b29-b61a-727d5c9e22b6'} Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 464c1886-1201-4b29-b61a-727d5c9e22b6 could not be found. Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 464c1886-1201-4b29-b61a-727d5c9e22b6 could not be found. Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:01:41.522867 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:01:41.528424 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:01:41.528424 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:01:41.528424 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:01:41.528424 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:01:41.528424 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:01:41.528424 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 464c1886-1201-4b29-b61a-727d5c9e22b6 could not be found. Sep 16 13:01:41.528424 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:01:41.531129 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1c333ad5-545b-40bd-a4b2-6299a3525859 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Returning 404 to user: Instance 464c1886-1201-4b29-b61a-727d5c9e22b6 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:01:41.532461 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1c333ad5-545b-40bd-a4b2-6299a3525859 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 404 len: 111 microversion: 2.1 time: 0.112904 Sep 16 13:01:41.533610 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1660/3421] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:41 2022] GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 13:01:41.788971 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e06c5b3a-cb8c-4a90-bb29-4b3b223df852 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-461500238", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": [{"uuid": "4c6a423f-0493-4448-999c-84f17e899760"}]}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:01:41.801048 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c9084e9f-9f91-4f97-8b42-5f877af41383 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:41.819952 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c9084e9f-9f91-4f97-8b42-5f877af41383 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:41.821497 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c9084e9f-9f91-4f97-8b42-5f877af41383 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:41.830877 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c9084e9f-9f91-4f97-8b42-5f877af41383 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1873 microversion: 2.42 time: 0.785723 Sep 16 13:01:41.831485 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1762/3422] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:01:41 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1873 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:01:41.942012 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-e06c5b3a-cb8c-4a90-bb29-4b3b223df852 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] validate_networks() for [('4c6a423f-0493-4448-999c-84f17e899760', None, None, None, None, None)] {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:01:42.931351 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-049cddbb-c938-4422-8bb3-90e9f6d3ba54 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Action: 'create', calling method: .version_select at 0x7f1034b21ee0>, body: {"keypair": {"name": "tempest-keypair-28586967", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeNrjWESoxEzYBWpvO3tfmmDT0wSvBBUi/rCg64kWsv3D3IJ7ehRlPvQ+SXjPz1aIZs0EG9v42e/f866+xy0PnYgu+eLBHl3Qq7nNm3ac13Dm6hyTLN1eQs9b+Vtreo9A=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:01:42.993676 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-049cddbb-c938-4422-8bb3-90e9f6d3ba54 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Getting quotas for project 82287f900aa34e05ba0e0cf7ba924585. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:01:43.022002 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-049cddbb-c938-4422-8bb3-90e9f6d3ba54 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Getting quotas for user d50f1d810ba34ef6a419d376f2b6c9bf and project 82287f900aa34e05ba0e0cf7ba924585. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:01:43.073310 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-049cddbb-c938-4422-8bb3-90e9f6d3ba54 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.325273 Sep 16 13:01:43.077711 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1763/3423] 10.222.0.67 () {60 vars in 1159 bytes} [Fri Sep 16 13:01:42 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:01:43.086036 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a16a6614-b47a-4209-9d5e-9f0958bf476f tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:43.086928 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a16a6614-b47a-4209-9d5e-9f0958bf476f tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:43.094374 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a16a6614-b47a-4209-9d5e-9f0958bf476f tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:43.095199 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a16a6614-b47a-4209-9d5e-9f0958bf476f tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:43.095862 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a16a6614-b47a-4209-9d5e-9f0958bf476f tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:43.097027 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a16a6614-b47a-4209-9d5e-9f0958bf476f tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:43.098535 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a16a6614-b47a-4209-9d5e-9f0958bf476f tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:43.099616 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a16a6614-b47a-4209-9d5e-9f0958bf476f tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:43.928825 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a16a6614-b47a-4209-9d5e-9f0958bf476f tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:43.950298 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a16a6614-b47a-4209-9d5e-9f0958bf476f tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:43.954462 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a16a6614-b47a-4209-9d5e-9f0958bf476f tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:43.956204 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a16a6614-b47a-4209-9d5e-9f0958bf476f tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1873 microversion: 2.42 time: 0.876957 Sep 16 13:01:43.957292 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1764/3424] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:01:43 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1873 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:01:44.399095 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-e06c5b3a-cb8c-4a90-bb29-4b3b223df852 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:01:44.400234 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-e06c5b3a-cb8c-4a90-bb29-4b3b223df852 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:01:44.400901 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-e06c5b3a-cb8c-4a90-bb29-4b3b223df852 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:01:44.401491 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-e06c5b3a-cb8c-4a90-bb29-4b3b223df852 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:01:44.402077 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-e06c5b3a-cb8c-4a90-bb29-4b3b223df852 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:01:44.432969 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e06c5b3a-cb8c-4a90-bb29-4b3b223df852 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:44.433453 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e06c5b3a-cb8c-4a90-bb29-4b3b223df852 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:44.437481 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e06c5b3a-cb8c-4a90-bb29-4b3b223df852 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:44.438591 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e06c5b3a-cb8c-4a90-bb29-4b3b223df852 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:44.438928 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e06c5b3a-cb8c-4a90-bb29-4b3b223df852 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:44.439365 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e06c5b3a-cb8c-4a90-bb29-4b3b223df852 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:44.475324 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-e06c5b3a-cb8c-4a90-bb29-4b3b223df852 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Getting quotas for project cfe82d8dd4fb42cbb054a6f069424c57. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:01:44.482145 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-e06c5b3a-cb8c-4a90-bb29-4b3b223df852 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Getting quotas for user 2e531a7026054c34b2a78a1c484cbe02 and project cfe82d8dd4fb42cbb054a6f069424c57. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:01:44.498283 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e06c5b3a-cb8c-4a90-bb29-4b3b223df852 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:01:44.501013 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e06c5b3a-cb8c-4a90-bb29-4b3b223df852 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:01:44.598649 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e06c5b3a-cb8c-4a90-bb29-4b3b223df852 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.813767 Sep 16 13:01:44.616466 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-153f2adb-af41-4e7a-821c-a4184af6857d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:44.617591 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-153f2adb-af41-4e7a-821c-a4184af6857d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:44.620813 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1661/3425] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 13:01:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 13:01:44.744067 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-153f2adb-af41-4e7a-821c-a4184af6857d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:44.752647 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-153f2adb-af41-4e7a-821c-a4184af6857d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c" status: 200 len: 1214 microversion: 2.1 time: 0.144574 Sep 16 13:01:44.757129 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1765/3426] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:44 2022] GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c => generated 1214 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:44.987548 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-51fdda53-0bf2-4a6c-a906-6e0cef83d74c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:44.988185 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-51fdda53-0bf2-4a6c-a906-6e0cef83d74c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:45.004037 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-51fdda53-0bf2-4a6c-a906-6e0cef83d74c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:45.004685 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-51fdda53-0bf2-4a6c-a906-6e0cef83d74c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:45.006448 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-51fdda53-0bf2-4a6c-a906-6e0cef83d74c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:45.008949 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-51fdda53-0bf2-4a6c-a906-6e0cef83d74c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:45.009412 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-51fdda53-0bf2-4a6c-a906-6e0cef83d74c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:45.011041 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-51fdda53-0bf2-4a6c-a906-6e0cef83d74c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:45.775759 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9f5d02f2-1b65-48ed-84f7-9de352ba0ded tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:45.777213 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9f5d02f2-1b65-48ed-84f7-9de352ba0ded tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:45.795337 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f5d02f2-1b65-48ed-84f7-9de352ba0ded tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:45.796223 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f5d02f2-1b65-48ed-84f7-9de352ba0ded tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:45.796856 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f5d02f2-1b65-48ed-84f7-9de352ba0ded tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:45.797772 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f5d02f2-1b65-48ed-84f7-9de352ba0ded tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:45.798401 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f5d02f2-1b65-48ed-84f7-9de352ba0ded tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:45.798998 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f5d02f2-1b65-48ed-84f7-9de352ba0ded tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:46.014956 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-51fdda53-0bf2-4a6c-a906-6e0cef83d74c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:46.023722 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9f5d02f2-1b65-48ed-84f7-9de352ba0ded tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:46.052439 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9f5d02f2-1b65-48ed-84f7-9de352ba0ded tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c" status: 200 len: 1266 microversion: 2.1 time: 0.279529 Sep 16 13:01:46.056584 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1766/3427] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:45 2022] GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c => generated 1266 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:46.061733 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-51fdda53-0bf2-4a6c-a906-6e0cef83d74c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:46.063994 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-51fdda53-0bf2-4a6c-a906-6e0cef83d74c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:46.066164 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-51fdda53-0bf2-4a6c-a906-6e0cef83d74c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1873 microversion: 2.42 time: 1.085468 Sep 16 13:01:46.076811 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1662/3428] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:01:44 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1873 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:01:46.099541 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1bc7e58a-9136-46d2-a8ea-3b848ce6f264 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "949764d7-e109-4aa2-8e93-b6c6fed88453"}], "security_groups": [{"name": "tempest-securitygroup--1882718182"}], "key_name": "tempest-keypair-28586967", "user_data": "}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:01:46.928995 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-1bc7e58a-9136-46d2-a8ea-3b848ce6f264 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] validate_networks() for [('949764d7-e109-4aa2-8e93-b6c6fed88453', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:01:47.083056 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ec2494ac-0bac-45d8-8359-16cf4fbe130c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:47.084437 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ec2494ac-0bac-45d8-8359-16cf4fbe130c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:47.117641 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ec2494ac-0bac-45d8-8359-16cf4fbe130c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:47.118561 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ec2494ac-0bac-45d8-8359-16cf4fbe130c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:47.119264 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ec2494ac-0bac-45d8-8359-16cf4fbe130c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:47.120246 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ec2494ac-0bac-45d8-8359-16cf4fbe130c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:47.120936 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ec2494ac-0bac-45d8-8359-16cf4fbe130c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:47.121634 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ec2494ac-0bac-45d8-8359-16cf4fbe130c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:47.446669 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ec2494ac-0bac-45d8-8359-16cf4fbe130c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:47.458052 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ec2494ac-0bac-45d8-8359-16cf4fbe130c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c" status: 200 len: 1272 microversion: 2.1 time: 0.378968 Sep 16 13:01:47.459738 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1663/3429] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:47 2022] GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c => generated 1272 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:47.469015 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7da91ac0-7dc9-4ff5-92ab-4162f36a572c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:47.490014 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7da91ac0-7dc9-4ff5-92ab-4162f36a572c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:47.510758 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7da91ac0-7dc9-4ff5-92ab-4162f36a572c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:47.514299 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7da91ac0-7dc9-4ff5-92ab-4162f36a572c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:47.515452 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7da91ac0-7dc9-4ff5-92ab-4162f36a572c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:47.518808 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7da91ac0-7dc9-4ff5-92ab-4162f36a572c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:47.519509 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7da91ac0-7dc9-4ff5-92ab-4162f36a572c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:47.520686 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7da91ac0-7dc9-4ff5-92ab-4162f36a572c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:48.127854 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7da91ac0-7dc9-4ff5-92ab-4162f36a572c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:48.136401 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7da91ac0-7dc9-4ff5-92ab-4162f36a572c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:48.138435 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7da91ac0-7dc9-4ff5-92ab-4162f36a572c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:48.140331 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7da91ac0-7dc9-4ff5-92ab-4162f36a572c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1873 microversion: 2.42 time: 0.677979 Sep 16 13:01:48.157483 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1664/3430] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:01:47 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1873 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:01:48.483012 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3853cc27-e823-4e88-b69f-ce3cea9d6bc4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:48.483641 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3853cc27-e823-4e88-b69f-ce3cea9d6bc4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:48.496633 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3853cc27-e823-4e88-b69f-ce3cea9d6bc4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:48.504830 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3853cc27-e823-4e88-b69f-ce3cea9d6bc4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:48.505120 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3853cc27-e823-4e88-b69f-ce3cea9d6bc4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:48.509100 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3853cc27-e823-4e88-b69f-ce3cea9d6bc4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:48.511181 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3853cc27-e823-4e88-b69f-ce3cea9d6bc4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:48.516468 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3853cc27-e823-4e88-b69f-ce3cea9d6bc4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:48.792005 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3853cc27-e823-4e88-b69f-ce3cea9d6bc4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:48.802320 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3853cc27-e823-4e88-b69f-ce3cea9d6bc4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c" status: 200 len: 1272 microversion: 2.1 time: 0.323591 Sep 16 13:01:48.802929 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1665/3431] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:48 2022] GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c => generated 1272 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:01:49.083152 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-1bc7e58a-9136-46d2-a8ea-3b848ce6f264 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:01:49.084656 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-1bc7e58a-9136-46d2-a8ea-3b848ce6f264 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:01:49.085483 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-1bc7e58a-9136-46d2-a8ea-3b848ce6f264 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:01:49.086061 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-1bc7e58a-9136-46d2-a8ea-3b848ce6f264 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:01:49.086638 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-1bc7e58a-9136-46d2-a8ea-3b848ce6f264 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:01:49.104299 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1bc7e58a-9136-46d2-a8ea-3b848ce6f264 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:49.105337 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1bc7e58a-9136-46d2-a8ea-3b848ce6f264 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:49.106668 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1bc7e58a-9136-46d2-a8ea-3b848ce6f264 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:49.107709 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1bc7e58a-9136-46d2-a8ea-3b848ce6f264 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:49.108460 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1bc7e58a-9136-46d2-a8ea-3b848ce6f264 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:49.109966 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1bc7e58a-9136-46d2-a8ea-3b848ce6f264 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:49.165557 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-1bc7e58a-9136-46d2-a8ea-3b848ce6f264 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Getting quotas for project 82287f900aa34e05ba0e0cf7ba924585. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:01:49.171931 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-aae71024-90a9-4132-bf17-03c7abc98b05 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:49.172466 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-1bc7e58a-9136-46d2-a8ea-3b848ce6f264 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Getting quotas for user d50f1d810ba34ef6a419d376f2b6c9bf and project 82287f900aa34e05ba0e0cf7ba924585. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:01:49.172582 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-aae71024-90a9-4132-bf17-03c7abc98b05 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:49.179734 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aae71024-90a9-4132-bf17-03c7abc98b05 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:49.180263 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aae71024-90a9-4132-bf17-03c7abc98b05 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:49.182103 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aae71024-90a9-4132-bf17-03c7abc98b05 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:49.184922 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aae71024-90a9-4132-bf17-03c7abc98b05 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:49.188500 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aae71024-90a9-4132-bf17-03c7abc98b05 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:49.191766 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-aae71024-90a9-4132-bf17-03c7abc98b05 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:49.195562 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1bc7e58a-9136-46d2-a8ea-3b848ce6f264 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:01:49.198678 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1bc7e58a-9136-46d2-a8ea-3b848ce6f264 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] [instance: 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:01:49.243537 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:01:49.285058 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1bc7e58a-9136-46d2-a8ea-3b848ce6f264 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.225591 Sep 16 13:01:49.285947 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1767/3432] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 13:01:46 2022] POST /compute/v2.1/servers => generated 409 bytes in 3228 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 13:01:49.299285 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3dafc0fc-d208-462c-9b33-de33d0d24a0c tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:49.301018 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3dafc0fc-d208-462c-9b33-de33d0d24a0c tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] [instance: 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:49.491139 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3dafc0fc-d208-462c-9b33-de33d0d24a0c tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50f1d810ba34ef6a419d376f2b6c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82287f900aa34e05ba0e0cf7ba924585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:49.504495 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3dafc0fc-d208-462c-9b33-de33d0d24a0c tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] 10.222.0.67 "GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8" status: 200 len: 1224 microversion: 2.1 time: 0.210160 Sep 16 13:01:49.508570 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1768/3433] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:49 2022] GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8 => generated 1224 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:01:49.827048 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-aae71024-90a9-4132-bf17-03c7abc98b05 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:49.854798 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-aae71024-90a9-4132-bf17-03c7abc98b05 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:49.862901 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-aae71024-90a9-4132-bf17-03c7abc98b05 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:49.867746 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-aae71024-90a9-4132-bf17-03c7abc98b05 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1873 microversion: 2.42 time: 0.700858 Sep 16 13:01:49.893869 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1666/3434] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:01:49 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1873 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:01:49.920257 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8c2dbad4-5599-4d12-9894-4d41f222e67e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:49.921708 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8c2dbad4-5599-4d12-9894-4d41f222e67e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:49.940681 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8c2dbad4-5599-4d12-9894-4d41f222e67e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:49.944341 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8c2dbad4-5599-4d12-9894-4d41f222e67e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:49.946831 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8c2dbad4-5599-4d12-9894-4d41f222e67e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:49.947883 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8c2dbad4-5599-4d12-9894-4d41f222e67e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:49.951058 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8c2dbad4-5599-4d12-9894-4d41f222e67e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:49.954616 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8c2dbad4-5599-4d12-9894-4d41f222e67e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:49.968875 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b0b5d546-eaac-4be9-b3e2-2a5d891b1467 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1467629855", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:01:50.075602 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-b0b5d546-eaac-4be9-b3e2-2a5d891b1467 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] validate_networks() for None {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:01:51.115490 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8c2dbad4-5599-4d12-9894-4d41f222e67e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:51.154130 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8c2dbad4-5599-4d12-9894-4d41f222e67e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c" status: 200 len: 1314 microversion: 2.1 time: 1.258025 Sep 16 13:01:51.156062 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1667/3435] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:49 2022] GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c => generated 1314 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:51.161667 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-574ad5b8-b856-46d3-8822-c850964cb550 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:51.162791 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-574ad5b8-b856-46d3-8822-c850964cb550 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] [instance: 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:51.170237 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-574ad5b8-b856-46d3-8822-c850964cb550 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:51.171470 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-574ad5b8-b856-46d3-8822-c850964cb550 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:51.172343 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-574ad5b8-b856-46d3-8822-c850964cb550 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:51.174134 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-574ad5b8-b856-46d3-8822-c850964cb550 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:51.174931 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-574ad5b8-b856-46d3-8822-c850964cb550 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:51.175712 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-574ad5b8-b856-46d3-8822-c850964cb550 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:51.366579 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-574ad5b8-b856-46d3-8822-c850964cb550 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50f1d810ba34ef6a419d376f2b6c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82287f900aa34e05ba0e0cf7ba924585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:51.379973 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-574ad5b8-b856-46d3-8822-c850964cb550 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] 10.222.0.67 "GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8" status: 200 len: 1284 microversion: 2.1 time: 0.222535 Sep 16 13:01:51.386068 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1668/3436] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:51 2022] GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8 => generated 1284 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:51.400950 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d5a16391-6aba-43de-8891-b758fd39aa39 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:51.400950 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d5a16391-6aba-43de-8891-b758fd39aa39 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:51.421065 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d5a16391-6aba-43de-8891-b758fd39aa39 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:51.421566 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d5a16391-6aba-43de-8891-b758fd39aa39 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:51.422001 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d5a16391-6aba-43de-8891-b758fd39aa39 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:51.422708 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d5a16391-6aba-43de-8891-b758fd39aa39 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:51.423160 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d5a16391-6aba-43de-8891-b758fd39aa39 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:51.423589 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d5a16391-6aba-43de-8891-b758fd39aa39 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:51.531342 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b0b5d546-eaac-4be9-b3e2-2a5d891b1467 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:01:51.532461 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b0b5d546-eaac-4be9-b3e2-2a5d891b1467 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:01:51.533156 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b0b5d546-eaac-4be9-b3e2-2a5d891b1467 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:01:51.533559 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b0b5d546-eaac-4be9-b3e2-2a5d891b1467 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:01:51.533976 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b0b5d546-eaac-4be9-b3e2-2a5d891b1467 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:01:51.545296 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0b5d546-eaac-4be9-b3e2-2a5d891b1467 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:51.546313 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0b5d546-eaac-4be9-b3e2-2a5d891b1467 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:51.546921 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0b5d546-eaac-4be9-b3e2-2a5d891b1467 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:51.547914 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0b5d546-eaac-4be9-b3e2-2a5d891b1467 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:51.548626 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0b5d546-eaac-4be9-b3e2-2a5d891b1467 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:51.549264 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0b5d546-eaac-4be9-b3e2-2a5d891b1467 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:51.579700 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-b0b5d546-eaac-4be9-b3e2-2a5d891b1467 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Getting quotas for project ea1a2dd1e1504bd08826f75f48817169. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:01:51.586499 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-b0b5d546-eaac-4be9-b3e2-2a5d891b1467 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Getting quotas for user 8b626d35721d4889bdd6facc201a5998 and project ea1a2dd1e1504bd08826f75f48817169. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:01:51.610021 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b0b5d546-eaac-4be9-b3e2-2a5d891b1467 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:01:51.613196 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b0b5d546-eaac-4be9-b3e2-2a5d891b1467 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] [instance: aec891b0-f64b-4305-a527-356ed01b1445] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:01:51.693197 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b0b5d546-eaac-4be9-b3e2-2a5d891b1467 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.044410 Sep 16 13:01:51.695646 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1769/3437] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 13:01:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 13:01:51.725156 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0a44d4aa-3c09-43fd-b292-73405071851b tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:51.728778 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0a44d4aa-3c09-43fd-b292-73405071851b tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] [instance: aec891b0-f64b-4305-a527-356ed01b1445] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:51.949522 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0a44d4aa-3c09-43fd-b292-73405071851b tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b626d35721d4889bdd6facc201a5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1a2dd1e1504bd08826f75f48817169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:51.957523 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0a44d4aa-3c09-43fd-b292-73405071851b tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] 10.222.0.67 "GET /compute/v2.1/servers/aec891b0-f64b-4305-a527-356ed01b1445" status: 200 len: 1214 microversion: 2.1 time: 0.243251 Sep 16 13:01:51.966066 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1770/3438] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:51 2022] GET /compute/v2.1/servers/aec891b0-f64b-4305-a527-356ed01b1445 => generated 1214 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:52.181100 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ede9aa67-d13d-4097-bda0-337dc4acd400 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:52.181724 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ede9aa67-d13d-4097-bda0-337dc4acd400 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:52.202388 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ede9aa67-d13d-4097-bda0-337dc4acd400 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:52.202849 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ede9aa67-d13d-4097-bda0-337dc4acd400 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:52.204639 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ede9aa67-d13d-4097-bda0-337dc4acd400 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:52.208884 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ede9aa67-d13d-4097-bda0-337dc4acd400 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:52.209731 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ede9aa67-d13d-4097-bda0-337dc4acd400 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:52.210451 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ede9aa67-d13d-4097-bda0-337dc4acd400 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:52.226613 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d5a16391-6aba-43de-8891-b758fd39aa39 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:52.241276 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d5a16391-6aba-43de-8891-b758fd39aa39 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:52.242838 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d5a16391-6aba-43de-8891-b758fd39aa39 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:52.244065 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d5a16391-6aba-43de-8891-b758fd39aa39 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1873 microversion: 2.42 time: 0.857018 Sep 16 13:01:52.244660 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1669/3439] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:01:51 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1873 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:01:52.414700 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e26dcf39-5f2f-4f76-838d-3fe1c62d0fb3 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:52.415610 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e26dcf39-5f2f-4f76-838d-3fe1c62d0fb3 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] [instance: 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:52.432348 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e26dcf39-5f2f-4f76-838d-3fe1c62d0fb3 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:52.433251 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e26dcf39-5f2f-4f76-838d-3fe1c62d0fb3 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:52.434735 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e26dcf39-5f2f-4f76-838d-3fe1c62d0fb3 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:52.436055 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e26dcf39-5f2f-4f76-838d-3fe1c62d0fb3 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:52.436838 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e26dcf39-5f2f-4f76-838d-3fe1c62d0fb3 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:52.437976 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e26dcf39-5f2f-4f76-838d-3fe1c62d0fb3 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:52.587550 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e26dcf39-5f2f-4f76-838d-3fe1c62d0fb3 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50f1d810ba34ef6a419d376f2b6c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82287f900aa34e05ba0e0cf7ba924585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:52.610652 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e26dcf39-5f2f-4f76-838d-3fe1c62d0fb3 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] 10.222.0.67 "GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8" status: 200 len: 1282 microversion: 2.1 time: 0.200446 Sep 16 13:01:52.614997 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1670/3440] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:52 2022] GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8 => generated 1282 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:52.822061 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ede9aa67-d13d-4097-bda0-337dc4acd400 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:52.839487 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ede9aa67-d13d-4097-bda0-337dc4acd400 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c" status: 200 len: 1314 microversion: 2.1 time: 0.662087 Sep 16 13:01:52.840003 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1771/3441] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:52 2022] GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c => generated 1314 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:01:52.985819 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c40814d7-bf83-4669-88d2-c3c62c9943a8 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:52.986519 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c40814d7-bf83-4669-88d2-c3c62c9943a8 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] [instance: aec891b0-f64b-4305-a527-356ed01b1445] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:52.996152 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c40814d7-bf83-4669-88d2-c3c62c9943a8 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:52.998062 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c40814d7-bf83-4669-88d2-c3c62c9943a8 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:52.999851 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c40814d7-bf83-4669-88d2-c3c62c9943a8 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:53.001236 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c40814d7-bf83-4669-88d2-c3c62c9943a8 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:53.002021 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c40814d7-bf83-4669-88d2-c3c62c9943a8 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:53.002696 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c40814d7-bf83-4669-88d2-c3c62c9943a8 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:53.171460 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c40814d7-bf83-4669-88d2-c3c62c9943a8 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b626d35721d4889bdd6facc201a5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1a2dd1e1504bd08826f75f48817169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:53.182198 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c40814d7-bf83-4669-88d2-c3c62c9943a8 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] 10.222.0.67 "GET /compute/v2.1/servers/aec891b0-f64b-4305-a527-356ed01b1445" status: 200 len: 1266 microversion: 2.1 time: 0.201727 Sep 16 13:01:53.185496 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1671/3442] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:52 2022] GET /compute/v2.1/servers/aec891b0-f64b-4305-a527-356ed01b1445 => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:53.271216 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ee89ec50-39c6-4aa8-8bf1-7a536517d95c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:53.271865 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ee89ec50-39c6-4aa8-8bf1-7a536517d95c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:53.277519 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-cedd0b09-f638-46e0-9f19-283d9da90f7d req-b0c65acf-3948-40f5-bb13-5266cebf6e5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2074945c-006a-4c9a-91db-b3029d04112c", "tag": "8ed61b00-7040-4c1a-8607-f72eeebb12d5"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:01:53.291257 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee89ec50-39c6-4aa8-8bf1-7a536517d95c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:53.291933 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee89ec50-39c6-4aa8-8bf1-7a536517d95c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:53.292709 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee89ec50-39c6-4aa8-8bf1-7a536517d95c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:53.293927 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee89ec50-39c6-4aa8-8bf1-7a536517d95c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:53.295000 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee89ec50-39c6-4aa8-8bf1-7a536517d95c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:53.295494 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee89ec50-39c6-4aa8-8bf1-7a536517d95c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:53.306722 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-cedd0b09-f638-46e0-9f19-283d9da90f7d req-b0c65acf-3948-40f5-bb13-5266cebf6e5d service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:53.308160 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-cedd0b09-f638-46e0-9f19-283d9da90f7d req-b0c65acf-3948-40f5-bb13-5266cebf6e5d service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:53.309022 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-cedd0b09-f638-46e0-9f19-283d9da90f7d req-b0c65acf-3948-40f5-bb13-5266cebf6e5d service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:53.351645 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-cedd0b09-f638-46e0-9f19-283d9da90f7d req-b0c65acf-3948-40f5-bb13-5266cebf6e5d service nova] Creating event network-changed:8ed61b00-7040-4c1a-8607-f72eeebb12d5 for instance 2074945c-006a-4c9a-91db-b3029d04112c on n-h2-858094-4 Sep 16 13:01:53.392114 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-cedd0b09-f638-46e0-9f19-283d9da90f7d req-b0c65acf-3948-40f5-bb13-5266cebf6e5d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118125 Sep 16 13:01:53.394600 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1672/3443] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:01:53.644895 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a8ad7180-4d2f-42fa-8aa0-8965feeae88c tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:53.646278 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a8ad7180-4d2f-42fa-8aa0-8965feeae88c tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] [instance: 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:53.668079 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8ad7180-4d2f-42fa-8aa0-8965feeae88c tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:53.671614 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8ad7180-4d2f-42fa-8aa0-8965feeae88c tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:53.672108 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8ad7180-4d2f-42fa-8aa0-8965feeae88c tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:53.679882 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8ad7180-4d2f-42fa-8aa0-8965feeae88c tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:53.680466 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8ad7180-4d2f-42fa-8aa0-8965feeae88c tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:53.683324 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8ad7180-4d2f-42fa-8aa0-8965feeae88c tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:54.464807 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:01:54.492227 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=6 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:01:54.810673 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ee89ec50-39c6-4aa8-8bf1-7a536517d95c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:54.828870 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ee89ec50-39c6-4aa8-8bf1-7a536517d95c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:54.830364 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ee89ec50-39c6-4aa8-8bf1-7a536517d95c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:54.832381 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ee89ec50-39c6-4aa8-8bf1-7a536517d95c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1873 microversion: 2.42 time: 1.564716 Sep 16 13:01:54.833074 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1772/3444] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:01:53 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1873 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:01:54.838332 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-70818773-463d-42bd-b98e-fa70020d0eef tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:54.839167 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-70818773-463d-42bd-b98e-fa70020d0eef tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:54.847638 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70818773-463d-42bd-b98e-fa70020d0eef tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:54.848396 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70818773-463d-42bd-b98e-fa70020d0eef tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:54.848961 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70818773-463d-42bd-b98e-fa70020d0eef tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:54.849663 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70818773-463d-42bd-b98e-fa70020d0eef tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:54.850284 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70818773-463d-42bd-b98e-fa70020d0eef tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:54.850869 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70818773-463d-42bd-b98e-fa70020d0eef tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:54.929731 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a8ad7180-4d2f-42fa-8aa0-8965feeae88c tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50f1d810ba34ef6a419d376f2b6c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82287f900aa34e05ba0e0cf7ba924585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:54.939797 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a8ad7180-4d2f-42fa-8aa0-8965feeae88c tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] 10.222.0.67 "GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8" status: 200 len: 1350 microversion: 2.1 time: 1.303205 Sep 16 13:01:54.940436 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1673/3445] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:53 2022] GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8 => generated 1350 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:54.957927 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-046a3e42-1e7d-44a7-a877-773e4924c180 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:54.958083 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-046a3e42-1e7d-44a7-a877-773e4924c180 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] [instance: aec891b0-f64b-4305-a527-356ed01b1445] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:54.970775 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-046a3e42-1e7d-44a7-a877-773e4924c180 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:54.971452 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-046a3e42-1e7d-44a7-a877-773e4924c180 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:54.972000 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-046a3e42-1e7d-44a7-a877-773e4924c180 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:54.973355 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-046a3e42-1e7d-44a7-a877-773e4924c180 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:54.974094 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-046a3e42-1e7d-44a7-a877-773e4924c180 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:54.974752 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-046a3e42-1e7d-44a7-a877-773e4924c180 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:54.980458 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:RELEASE=1,nova_cell1:SELECT=84,nova_cell1:UPDATE=13,nova_cell1:DELETE=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:01:55.128180 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-046a3e42-1e7d-44a7-a877-773e4924c180 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b626d35721d4889bdd6facc201a5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1a2dd1e1504bd08826f75f48817169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:55.139183 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-046a3e42-1e7d-44a7-a877-773e4924c180 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] 10.222.0.67 "GET /compute/v2.1/servers/aec891b0-f64b-4305-a527-356ed01b1445" status: 200 len: 1272 microversion: 2.1 time: 0.196580 Sep 16 13:01:55.160073 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1674/3446] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:54 2022] GET /compute/v2.1/servers/aec891b0-f64b-4305-a527-356ed01b1445 => generated 1272 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:55.243553 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-70818773-463d-42bd-b98e-fa70020d0eef tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:55.255511 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-70818773-463d-42bd-b98e-fa70020d0eef tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c" status: 200 len: 1314 microversion: 2.1 time: 0.420897 Sep 16 13:01:55.273701 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1773/3447] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:54 2022] GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:55.872234 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d2260858-ff69-4987-896b-c1466ab8f5f4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:55.873093 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d2260858-ff69-4987-896b-c1466ab8f5f4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:55.886702 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d2260858-ff69-4987-896b-c1466ab8f5f4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:55.887883 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d2260858-ff69-4987-896b-c1466ab8f5f4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:55.888865 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d2260858-ff69-4987-896b-c1466ab8f5f4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:55.889840 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d2260858-ff69-4987-896b-c1466ab8f5f4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:55.890541 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d2260858-ff69-4987-896b-c1466ab8f5f4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:55.891209 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d2260858-ff69-4987-896b-c1466ab8f5f4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:55.966032 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e143e9f6-9fd4-4160-9642-5787f93b4c8e tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:55.967781 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e143e9f6-9fd4-4160-9642-5787f93b4c8e tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] [instance: 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:55.975982 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e143e9f6-9fd4-4160-9642-5787f93b4c8e tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:55.976834 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e143e9f6-9fd4-4160-9642-5787f93b4c8e tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:55.977510 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e143e9f6-9fd4-4160-9642-5787f93b4c8e tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:55.978645 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e143e9f6-9fd4-4160-9642-5787f93b4c8e tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:55.979348 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e143e9f6-9fd4-4160-9642-5787f93b4c8e tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:55.979971 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e143e9f6-9fd4-4160-9642-5787f93b4c8e tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:56.483705 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d2260858-ff69-4987-896b-c1466ab8f5f4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:56.507104 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d2260858-ff69-4987-896b-c1466ab8f5f4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:56.508899 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d2260858-ff69-4987-896b-c1466ab8f5f4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:56.510225 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d2260858-ff69-4987-896b-c1466ab8f5f4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1873 microversion: 2.42 time: 0.647672 Sep 16 13:01:56.511036 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1675/3448] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:01:55 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1873 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:01:56.516644 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2dfe2f61-68f6-4ee5-80ee-8662fa5ca432 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:56.517257 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-2dfe2f61-68f6-4ee5-80ee-8662fa5ca432 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] [instance: aec891b0-f64b-4305-a527-356ed01b1445] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:56.537986 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2dfe2f61-68f6-4ee5-80ee-8662fa5ca432 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:56.538481 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2dfe2f61-68f6-4ee5-80ee-8662fa5ca432 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:56.538708 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e143e9f6-9fd4-4160-9642-5787f93b4c8e tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50f1d810ba34ef6a419d376f2b6c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82287f900aa34e05ba0e0cf7ba924585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:56.538923 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2dfe2f61-68f6-4ee5-80ee-8662fa5ca432 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:56.539635 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2dfe2f61-68f6-4ee5-80ee-8662fa5ca432 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:56.540094 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2dfe2f61-68f6-4ee5-80ee-8662fa5ca432 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:56.547803 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2dfe2f61-68f6-4ee5-80ee-8662fa5ca432 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:56.549599 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e143e9f6-9fd4-4160-9642-5787f93b4c8e tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] 10.222.0.67 "GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8" status: 200 len: 1350 microversion: 2.1 time: 0.588148 Sep 16 13:01:56.566521 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1774/3449] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:55 2022] GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8 => generated 1350 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:56.572227 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8bd5669d-10ae-4dc2-a421-4c9921af817a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:56.577266 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8bd5669d-10ae-4dc2-a421-4c9921af817a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:56.588506 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8bd5669d-10ae-4dc2-a421-4c9921af817a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:56.589316 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8bd5669d-10ae-4dc2-a421-4c9921af817a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:56.589950 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8bd5669d-10ae-4dc2-a421-4c9921af817a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:56.591032 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8bd5669d-10ae-4dc2-a421-4c9921af817a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:56.591702 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8bd5669d-10ae-4dc2-a421-4c9921af817a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:56.592337 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8bd5669d-10ae-4dc2-a421-4c9921af817a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:56.737691 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-2dfe2f61-68f6-4ee5-80ee-8662fa5ca432 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b626d35721d4889bdd6facc201a5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1a2dd1e1504bd08826f75f48817169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:56.769208 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2dfe2f61-68f6-4ee5-80ee-8662fa5ca432 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] 10.222.0.67 "GET /compute/v2.1/servers/aec891b0-f64b-4305-a527-356ed01b1445" status: 200 len: 1272 microversion: 2.1 time: 0.256322 Sep 16 13:01:56.769839 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1676/3450] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:56 2022] GET /compute/v2.1/servers/aec891b0-f64b-4305-a527-356ed01b1445 => generated 1272 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:57.059884 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8bd5669d-10ae-4dc2-a421-4c9921af817a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:57.075189 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8bd5669d-10ae-4dc2-a421-4c9921af817a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c" status: 200 len: 1314 microversion: 2.1 time: 0.502853 Sep 16 13:01:57.078428 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1775/3451] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:56 2022] GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c => generated 1314 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:57.485988 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-c105161a-98ae-45d5-a856-6f7e22b33601 req-8c966f70-4835-4e8d-9348-7e86afb6a3f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64cebb2a-47ea-4fac-ac5d-24bb6311d8e8", "tag": "b7230234-bb6e-4e87-88c3-bcd278e26f85"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:01:57.516005 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-c105161a-98ae-45d5-a856-6f7e22b33601 req-8c966f70-4835-4e8d-9348-7e86afb6a3f2 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:57.517025 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-c105161a-98ae-45d5-a856-6f7e22b33601 req-8c966f70-4835-4e8d-9348-7e86afb6a3f2 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:57.517666 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-c105161a-98ae-45d5-a856-6f7e22b33601 req-8c966f70-4835-4e8d-9348-7e86afb6a3f2 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:57.539704 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e1475fd2-771b-4ff2-b650-313096fa6365 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:57.540367 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e1475fd2-771b-4ff2-b650-313096fa6365 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:57.546950 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-c105161a-98ae-45d5-a856-6f7e22b33601 req-8c966f70-4835-4e8d-9348-7e86afb6a3f2 service nova] Creating event network-changed:b7230234-bb6e-4e87-88c3-bcd278e26f85 for instance 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8 on n-h1-858094-4 Sep 16 13:01:57.549496 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1475fd2-771b-4ff2-b650-313096fa6365 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:57.549998 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1475fd2-771b-4ff2-b650-313096fa6365 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:57.550434 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1475fd2-771b-4ff2-b650-313096fa6365 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:57.556608 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-c105161a-98ae-45d5-a856-6f7e22b33601 req-8c966f70-4835-4e8d-9348-7e86afb6a3f2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073676 Sep 16 13:01:57.557628 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1677/3452] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:01:57.561608 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1475fd2-771b-4ff2-b650-313096fa6365 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:57.562302 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1475fd2-771b-4ff2-b650-313096fa6365 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:57.562908 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1475fd2-771b-4ff2-b650-313096fa6365 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:57.582713 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0feeb94d-2a55-423e-8fb6-b4fc2a9dffa0 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:57.583627 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0feeb94d-2a55-423e-8fb6-b4fc2a9dffa0 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] [instance: 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:57.599558 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0feeb94d-2a55-423e-8fb6-b4fc2a9dffa0 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:57.600213 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0feeb94d-2a55-423e-8fb6-b4fc2a9dffa0 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:57.602735 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0feeb94d-2a55-423e-8fb6-b4fc2a9dffa0 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:57.603646 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0feeb94d-2a55-423e-8fb6-b4fc2a9dffa0 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:57.605205 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0feeb94d-2a55-423e-8fb6-b4fc2a9dffa0 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:57.606676 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0feeb94d-2a55-423e-8fb6-b4fc2a9dffa0 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:58.459691 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e1475fd2-771b-4ff2-b650-313096fa6365 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:58.466654 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0feeb94d-2a55-423e-8fb6-b4fc2a9dffa0 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50f1d810ba34ef6a419d376f2b6c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82287f900aa34e05ba0e0cf7ba924585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:58.475041 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0feeb94d-2a55-423e-8fb6-b4fc2a9dffa0 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] 10.222.0.67 "GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8" status: 200 len: 1350 microversion: 2.1 time: 0.898285 Sep 16 13:01:58.491615 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e1475fd2-771b-4ff2-b650-313096fa6365 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:58.491615 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e1475fd2-771b-4ff2-b650-313096fa6365 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:58.491615 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e1475fd2-771b-4ff2-b650-313096fa6365 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1873 microversion: 2.42 time: 0.946744 Sep 16 13:01:58.491615 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1776/3453] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:01:57 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1873 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:01:58.491615 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cb730306-b452-4067-946f-3ed531cf8d65 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:58.491615 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cb730306-b452-4067-946f-3ed531cf8d65 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] [instance: aec891b0-f64b-4305-a527-356ed01b1445] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:58.492939 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1678/3454] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:57 2022] GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8 => generated 1350 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:01:58.501484 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb730306-b452-4067-946f-3ed531cf8d65 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:58.502354 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb730306-b452-4067-946f-3ed531cf8d65 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:58.503025 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb730306-b452-4067-946f-3ed531cf8d65 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:58.504264 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb730306-b452-4067-946f-3ed531cf8d65 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:58.504965 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb730306-b452-4067-946f-3ed531cf8d65 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:58.505093 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b778c94a-6ad7-446a-be88-b8670ceb2cbd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:58.505586 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b778c94a-6ad7-446a-be88-b8670ceb2cbd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:58.506878 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb730306-b452-4067-946f-3ed531cf8d65 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:58.526514 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b778c94a-6ad7-446a-be88-b8670ceb2cbd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:58.527233 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b778c94a-6ad7-446a-be88-b8670ceb2cbd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:58.528432 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b778c94a-6ad7-446a-be88-b8670ceb2cbd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:58.532522 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b778c94a-6ad7-446a-be88-b8670ceb2cbd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:58.533233 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b778c94a-6ad7-446a-be88-b8670ceb2cbd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:58.533971 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b778c94a-6ad7-446a-be88-b8670ceb2cbd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:59.089415 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-b778c94a-6ad7-446a-be88-b8670ceb2cbd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:59.096028 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cb730306-b452-4067-946f-3ed531cf8d65 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b626d35721d4889bdd6facc201a5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1a2dd1e1504bd08826f75f48817169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:59.104779 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cb730306-b452-4067-946f-3ed531cf8d65 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] 10.222.0.67 "GET /compute/v2.1/servers/aec891b0-f64b-4305-a527-356ed01b1445" status: 200 len: 1314 microversion: 2.1 time: 0.619936 Sep 16 13:01:59.105375 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1777/3455] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:58 2022] GET /compute/v2.1/servers/aec891b0-f64b-4305-a527-356ed01b1445 => generated 1314 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:59.108225 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b778c94a-6ad7-446a-be88-b8670ceb2cbd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c" status: 200 len: 1314 microversion: 2.1 time: 0.613571 Sep 16 13:01:59.113577 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1679/3456] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:58 2022] GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c => generated 1314 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:59.505044 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cfcd7b84-4002-4462-be17-69a6ac4f950d tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:59.505659 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cfcd7b84-4002-4462-be17-69a6ac4f950d tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] [instance: 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:59.514200 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cfcd7b84-4002-4462-be17-69a6ac4f950d tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:59.514703 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cfcd7b84-4002-4462-be17-69a6ac4f950d tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:59.515145 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cfcd7b84-4002-4462-be17-69a6ac4f950d tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:59.515895 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cfcd7b84-4002-4462-be17-69a6ac4f950d tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:59.518425 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cfcd7b84-4002-4462-be17-69a6ac4f950d tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:59.518896 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cfcd7b84-4002-4462-be17-69a6ac4f950d tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:59.520180 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-78da0896-a5af-4661-98a0-cba86666b768 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:01:59.521487 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-78da0896-a5af-4661-98a0-cba86666b768 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:01:59.532652 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-78da0896-a5af-4661-98a0-cba86666b768 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:59.533404 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-78da0896-a5af-4661-98a0-cba86666b768 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:59.534404 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-78da0896-a5af-4661-98a0-cba86666b768 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:59.536194 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-78da0896-a5af-4661-98a0-cba86666b768 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:01:59.536908 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-78da0896-a5af-4661-98a0-cba86666b768 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:01:59.537512 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-78da0896-a5af-4661-98a0-cba86666b768 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:01:59.916171 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cfcd7b84-4002-4462-be17-69a6ac4f950d tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50f1d810ba34ef6a419d376f2b6c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82287f900aa34e05ba0e0cf7ba924585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:59.923912 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cfcd7b84-4002-4462-be17-69a6ac4f950d tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] 10.222.0.67 "GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8" status: 200 len: 1350 microversion: 2.1 time: 0.422629 Sep 16 13:01:59.936600 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1778/3457] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:01:59 2022] GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8 => generated 1350 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:01:59.943440 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-78da0896-a5af-4661-98a0-cba86666b768 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:59.959105 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-78da0896-a5af-4661-98a0-cba86666b768 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:59.984969 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-78da0896-a5af-4661-98a0-cba86666b768 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:01:59.987281 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-78da0896-a5af-4661-98a0-cba86666b768 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1873 microversion: 2.42 time: 0.478409 Sep 16 13:01:59.992902 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1680/3458] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:01:59 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1873 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:02:00.072967 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-bb4ebf44-53ce-4732-9e57-7f1b0bb0e57e req-b5e89c49-c1a0-4858-bf5a-f9ed7d8416e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aec891b0-f64b-4305-a527-356ed01b1445", "tag": "a2ab8eb4-c338-459a-b674-f31ee11bfd20"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:02:00.095746 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bb4ebf44-53ce-4732-9e57-7f1b0bb0e57e req-b5e89c49-c1a0-4858-bf5a-f9ed7d8416e1 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:00.096455 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bb4ebf44-53ce-4732-9e57-7f1b0bb0e57e req-b5e89c49-c1a0-4858-bf5a-f9ed7d8416e1 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:00.097265 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bb4ebf44-53ce-4732-9e57-7f1b0bb0e57e req-b5e89c49-c1a0-4858-bf5a-f9ed7d8416e1 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:00.117896 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-bb4ebf44-53ce-4732-9e57-7f1b0bb0e57e req-b5e89c49-c1a0-4858-bf5a-f9ed7d8416e1 service nova] Creating event network-changed:a2ab8eb4-c338-459a-b674-f31ee11bfd20 for instance aec891b0-f64b-4305-a527-356ed01b1445 on n-h2-858094-4 Sep 16 13:02:00.126259 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-bb4ebf44-53ce-4732-9e57-7f1b0bb0e57e req-b5e89c49-c1a0-4858-bf5a-f9ed7d8416e1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057340 Sep 16 13:02:00.128068 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1779/3459] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:02:00.135832 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f4a58d69-2ada-425a-9935-90b55fde0cc0 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:00.136495 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f4a58d69-2ada-425a-9935-90b55fde0cc0 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] [instance: aec891b0-f64b-4305-a527-356ed01b1445] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:00.139504 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d132a16d-ca7d-477d-b8d0-44138432c421 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:00.140482 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d132a16d-ca7d-477d-b8d0-44138432c421 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:00.150945 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d132a16d-ca7d-477d-b8d0-44138432c421 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:00.152862 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d132a16d-ca7d-477d-b8d0-44138432c421 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:00.153769 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d132a16d-ca7d-477d-b8d0-44138432c421 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:00.155848 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:02:00.156602 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d132a16d-ca7d-477d-b8d0-44138432c421 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:00.157475 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d132a16d-ca7d-477d-b8d0-44138432c421 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:00.158137 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d132a16d-ca7d-477d-b8d0-44138432c421 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:00.165341 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f4a58d69-2ada-425a-9935-90b55fde0cc0 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:00.165845 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f4a58d69-2ada-425a-9935-90b55fde0cc0 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:00.169900 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f4a58d69-2ada-425a-9935-90b55fde0cc0 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:00.171450 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f4a58d69-2ada-425a-9935-90b55fde0cc0 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:00.171935 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f4a58d69-2ada-425a-9935-90b55fde0cc0 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:00.178119 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f4a58d69-2ada-425a-9935-90b55fde0cc0 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:00.546791 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d132a16d-ca7d-477d-b8d0-44138432c421 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:00.550898 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f4a58d69-2ada-425a-9935-90b55fde0cc0 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b626d35721d4889bdd6facc201a5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1a2dd1e1504bd08826f75f48817169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:00.563944 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f4a58d69-2ada-425a-9935-90b55fde0cc0 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] 10.222.0.67 "GET /compute/v2.1/servers/aec891b0-f64b-4305-a527-356ed01b1445" status: 200 len: 1314 microversion: 2.1 time: 0.435510 Sep 16 13:02:00.568450 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d132a16d-ca7d-477d-b8d0-44138432c421 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c" status: 200 len: 1314 microversion: 2.1 time: 0.432164 Sep 16 13:02:00.569176 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1780/3460] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:00 2022] GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:02:00.584550 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1681/3461] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:00 2022] GET /compute/v2.1/servers/aec891b0-f64b-4305-a527-356ed01b1445 => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:02:00.946872 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a845c4a8-fb0f-4733-9007-540133a0ccdd tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:00.947521 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a845c4a8-fb0f-4733-9007-540133a0ccdd tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] [instance: 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:00.962038 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a845c4a8-fb0f-4733-9007-540133a0ccdd tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:00.962543 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a845c4a8-fb0f-4733-9007-540133a0ccdd tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:00.963037 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a845c4a8-fb0f-4733-9007-540133a0ccdd tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:00.963770 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a845c4a8-fb0f-4733-9007-540133a0ccdd tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:00.964268 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a845c4a8-fb0f-4733-9007-540133a0ccdd tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:00.964700 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a845c4a8-fb0f-4733-9007-540133a0ccdd tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:01.023557 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-92b5541d-da89-4577-a3cc-6a3f5cf4254c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:01.025001 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-92b5541d-da89-4577-a3cc-6a3f5cf4254c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:01.032271 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92b5541d-da89-4577-a3cc-6a3f5cf4254c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:01.033014 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92b5541d-da89-4577-a3cc-6a3f5cf4254c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:01.033649 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92b5541d-da89-4577-a3cc-6a3f5cf4254c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:01.034547 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92b5541d-da89-4577-a3cc-6a3f5cf4254c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:01.035181 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92b5541d-da89-4577-a3cc-6a3f5cf4254c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:01.035790 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92b5541d-da89-4577-a3cc-6a3f5cf4254c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:01.432431 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a845c4a8-fb0f-4733-9007-540133a0ccdd tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50f1d810ba34ef6a419d376f2b6c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82287f900aa34e05ba0e0cf7ba924585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:01.447413 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a845c4a8-fb0f-4733-9007-540133a0ccdd tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] 10.222.0.67 "GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8" status: 200 len: 1350 microversion: 2.1 time: 0.499296 Sep 16 13:02:01.449676 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1781/3462] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:00 2022] GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8 => generated 1350 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:01.460138 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-c0654c81-d19f-4bb2-98b0-afb7ec31145d req-cfc7b72a-854d-438f-8413-dd609d4a6d53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2074945c-006a-4c9a-91db-b3029d04112c", "name": "network-vif-plugged", "status": "completed", "tag": "8ed61b00-7040-4c1a-8607-f72eeebb12d5"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:02:01.484306 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c0654c81-d19f-4bb2-98b0-afb7ec31145d req-cfc7b72a-854d-438f-8413-dd609d4a6d53 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:01.484797 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c0654c81-d19f-4bb2-98b0-afb7ec31145d req-cfc7b72a-854d-438f-8413-dd609d4a6d53 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:01.487807 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c0654c81-d19f-4bb2-98b0-afb7ec31145d req-cfc7b72a-854d-438f-8413-dd609d4a6d53 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:01.494685 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-92b5541d-da89-4577-a3cc-6a3f5cf4254c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:01.508385 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-c0654c81-d19f-4bb2-98b0-afb7ec31145d req-cfc7b72a-854d-438f-8413-dd609d4a6d53 service nova] Creating event network-vif-plugged:8ed61b00-7040-4c1a-8607-f72eeebb12d5 for instance 2074945c-006a-4c9a-91db-b3029d04112c on n-h2-858094-4 Sep 16 13:02:01.513894 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-92b5541d-da89-4577-a3cc-6a3f5cf4254c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:01.515111 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-c0654c81-d19f-4bb2-98b0-afb7ec31145d req-cfc7b72a-854d-438f-8413-dd609d4a6d53 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064027 Sep 16 13:02:01.515749 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1782/3463] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:02:01.524467 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-92b5541d-da89-4577-a3cc-6a3f5cf4254c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:01.525897 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-92b5541d-da89-4577-a3cc-6a3f5cf4254c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1873 microversion: 2.42 time: 0.507685 Sep 16 13:02:01.540150 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1682/3464] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:02:01 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1873 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:02:01.591501 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:02:01.592303 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-03f19564-3940-4dde-958c-0a31831ea1e5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:01.592939 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-03f19564-3940-4dde-958c-0a31831ea1e5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:01.599039 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-78040d92-5a8b-43da-9611-c255156e5f87 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:01.600292 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-78040d92-5a8b-43da-9611-c255156e5f87 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] [instance: aec891b0-f64b-4305-a527-356ed01b1445] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:01.604411 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-03f19564-3940-4dde-958c-0a31831ea1e5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:01.605276 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-03f19564-3940-4dde-958c-0a31831ea1e5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:01.607212 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-03f19564-3940-4dde-958c-0a31831ea1e5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:01.608767 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-03f19564-3940-4dde-958c-0a31831ea1e5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:01.609706 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-03f19564-3940-4dde-958c-0a31831ea1e5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:01.610415 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-03f19564-3940-4dde-958c-0a31831ea1e5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:01.621254 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78040d92-5a8b-43da-9611-c255156e5f87 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:01.623844 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78040d92-5a8b-43da-9611-c255156e5f87 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:01.624337 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78040d92-5a8b-43da-9611-c255156e5f87 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:01.625172 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78040d92-5a8b-43da-9611-c255156e5f87 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:01.625936 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78040d92-5a8b-43da-9611-c255156e5f87 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:01.626241 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78040d92-5a8b-43da-9611-c255156e5f87 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:01.642821 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:02:01.956843 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=22 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:02:02.085350 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-03f19564-3940-4dde-958c-0a31831ea1e5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:02.100782 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-03f19564-3940-4dde-958c-0a31831ea1e5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c" status: 200 len: 1314 microversion: 2.1 time: 0.513659 Sep 16 13:02:02.102597 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1683/3465] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:01 2022] GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c => generated 1314 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:02.136703 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-78040d92-5a8b-43da-9611-c255156e5f87 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b626d35721d4889bdd6facc201a5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1a2dd1e1504bd08826f75f48817169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:02.151756 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-78040d92-5a8b-43da-9611-c255156e5f87 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] 10.222.0.67 "GET /compute/v2.1/servers/aec891b0-f64b-4305-a527-356ed01b1445" status: 200 len: 1314 microversion: 2.1 time: 0.563953 Sep 16 13:02:02.153255 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1783/3466] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:01 2022] GET /compute/v2.1/servers/aec891b0-f64b-4305-a527-356ed01b1445 => generated 1314 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:02.474748 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d250daf5-d430-4311-82f8-3b17c7e3ac3e tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:02.475464 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d250daf5-d430-4311-82f8-3b17c7e3ac3e tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] [instance: 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:02.482692 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d250daf5-d430-4311-82f8-3b17c7e3ac3e tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:02.483524 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d250daf5-d430-4311-82f8-3b17c7e3ac3e tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:02.484314 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d250daf5-d430-4311-82f8-3b17c7e3ac3e tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:02.485224 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d250daf5-d430-4311-82f8-3b17c7e3ac3e tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:02.486019 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d250daf5-d430-4311-82f8-3b17c7e3ac3e tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:02.486802 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d250daf5-d430-4311-82f8-3b17c7e3ac3e tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:02.555215 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3c173f79-0a2a-487d-b7e7-7cc280a6b708 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:02.555987 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3c173f79-0a2a-487d-b7e7-7cc280a6b708 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:02.569333 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c173f79-0a2a-487d-b7e7-7cc280a6b708 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:02.570304 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c173f79-0a2a-487d-b7e7-7cc280a6b708 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:02.570769 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c173f79-0a2a-487d-b7e7-7cc280a6b708 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:02.575333 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c173f79-0a2a-487d-b7e7-7cc280a6b708 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:02.575772 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c173f79-0a2a-487d-b7e7-7cc280a6b708 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:02.576247 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c173f79-0a2a-487d-b7e7-7cc280a6b708 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:03.581951 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d250daf5-d430-4311-82f8-3b17c7e3ac3e tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50f1d810ba34ef6a419d376f2b6c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82287f900aa34e05ba0e0cf7ba924585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:03.597314 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d250daf5-d430-4311-82f8-3b17c7e3ac3e tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] 10.222.0.67 "GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8" status: 200 len: 1350 microversion: 2.1 time: 1.126386 Sep 16 13:02:03.599011 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1684/3467] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:02 2022] GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8 => generated 1350 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:03.606850 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fae07f60-efe5-4209-900d-7c85db79deda tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:03.608752 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-fae07f60-efe5-4209-900d-7c85db79deda tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:03.620402 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3c173f79-0a2a-487d-b7e7-7cc280a6b708 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:03.625610 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fae07f60-efe5-4209-900d-7c85db79deda tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:03.627681 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fae07f60-efe5-4209-900d-7c85db79deda tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:03.628691 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fae07f60-efe5-4209-900d-7c85db79deda tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:03.631059 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fae07f60-efe5-4209-900d-7c85db79deda tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:03.632151 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3c173f79-0a2a-487d-b7e7-7cc280a6b708 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:03.632769 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fae07f60-efe5-4209-900d-7c85db79deda tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:03.633491 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fae07f60-efe5-4209-900d-7c85db79deda tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:03.633626 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3c173f79-0a2a-487d-b7e7-7cc280a6b708 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:03.634801 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3c173f79-0a2a-487d-b7e7-7cc280a6b708 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1873 microversion: 2.42 time: 1.083682 Sep 16 13:02:03.635360 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1784/3468] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:02:02 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1873 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:02:03.649564 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e81bff7a-5dff-4006-a4d0-5848e2b7d886 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:03.653313 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e81bff7a-5dff-4006-a4d0-5848e2b7d886 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] [instance: aec891b0-f64b-4305-a527-356ed01b1445] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:03.663850 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e81bff7a-5dff-4006-a4d0-5848e2b7d886 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:03.664391 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e81bff7a-5dff-4006-a4d0-5848e2b7d886 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:03.664830 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e81bff7a-5dff-4006-a4d0-5848e2b7d886 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:03.665534 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e81bff7a-5dff-4006-a4d0-5848e2b7d886 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:03.666150 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e81bff7a-5dff-4006-a4d0-5848e2b7d886 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:03.666578 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e81bff7a-5dff-4006-a4d0-5848e2b7d886 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:04.165554 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e81bff7a-5dff-4006-a4d0-5848e2b7d886 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b626d35721d4889bdd6facc201a5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1a2dd1e1504bd08826f75f48817169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:04.180878 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e81bff7a-5dff-4006-a4d0-5848e2b7d886 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] 10.222.0.67 "GET /compute/v2.1/servers/aec891b0-f64b-4305-a527-356ed01b1445" status: 200 len: 1314 microversion: 2.1 time: 0.534269 Sep 16 13:02:04.181865 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1785/3469] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:03 2022] GET /compute/v2.1/servers/aec891b0-f64b-4305-a527-356ed01b1445 => generated 1314 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:04.202655 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e0380a8d-8015-4c76-a444-d6295acb5444 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:04.203194 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e0380a8d-8015-4c76-a444-d6295acb5444 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:04.224365 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0380a8d-8015-4c76-a444-d6295acb5444 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:04.225073 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0380a8d-8015-4c76-a444-d6295acb5444 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:04.225709 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0380a8d-8015-4c76-a444-d6295acb5444 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:04.226628 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0380a8d-8015-4c76-a444-d6295acb5444 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:04.227663 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0380a8d-8015-4c76-a444-d6295acb5444 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:04.228204 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0380a8d-8015-4c76-a444-d6295acb5444 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:04.233704 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-fae07f60-efe5-4209-900d-7c85db79deda tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:04.245997 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-fae07f60-efe5-4209-900d-7c85db79deda tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c" status: 200 len: 1500 microversion: 2.1 time: 0.645541 Sep 16 13:02:04.248816 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1685/3470] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:03 2022] GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c => generated 1500 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:04.274337 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-377d6f3e-d44b-4aa7-a9db-d58456f87ec7 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:02:04.283006 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-377d6f3e-d44b-4aa7-a9db-d58456f87ec7 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:04.284678 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-377d6f3e-d44b-4aa7-a9db-d58456f87ec7 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:04.285342 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-377d6f3e-d44b-4aa7-a9db-d58456f87ec7 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:04.319095 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-377d6f3e-d44b-4aa7-a9db-d58456f87ec7 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Going to try to stop instance {{(pid=128780) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 16 13:02:04.377455 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-377d6f3e-d44b-4aa7-a9db-d58456f87ec7 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "POST /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c/action" status: 202 len: 0 microversion: 2.1 time: 0.106349 Sep 16 13:02:04.378352 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1686/3471] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 13:02:04 2022] POST /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:02:04.390348 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2c8063d4-8fc4-45de-b750-18a87cd0906e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:04.391532 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-2c8063d4-8fc4-45de-b750-18a87cd0906e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:04.429540 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c8063d4-8fc4-45de-b750-18a87cd0906e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:04.430180 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c8063d4-8fc4-45de-b750-18a87cd0906e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:04.430644 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c8063d4-8fc4-45de-b750-18a87cd0906e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:04.431425 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c8063d4-8fc4-45de-b750-18a87cd0906e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:04.431909 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c8063d4-8fc4-45de-b750-18a87cd0906e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:04.432345 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c8063d4-8fc4-45de-b750-18a87cd0906e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:04.603335 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e0380a8d-8015-4c76-a444-d6295acb5444 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:04.618084 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e0380a8d-8015-4c76-a444-d6295acb5444 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1665 microversion: 2.1 time: 0.420017 Sep 16 13:02:04.620230 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1786/3472] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:04 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1665 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:04.638413 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8d92996f-f28b-4c99-9795-c55ab0994fe3 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:04.639394 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8d92996f-f28b-4c99-9795-c55ab0994fe3 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] [instance: 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:04.649373 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d92996f-f28b-4c99-9795-c55ab0994fe3 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:04.650425 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d92996f-f28b-4c99-9795-c55ab0994fe3 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:04.650973 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d92996f-f28b-4c99-9795-c55ab0994fe3 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:04.651781 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d92996f-f28b-4c99-9795-c55ab0994fe3 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:04.652452 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d92996f-f28b-4c99-9795-c55ab0994fe3 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:04.653883 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d92996f-f28b-4c99-9795-c55ab0994fe3 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:04.750326 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-2c8063d4-8fc4-45de-b750-18a87cd0906e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:04.763271 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2c8063d4-8fc4-45de-b750-18a87cd0906e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c" status: 200 len: 1510 microversion: 2.1 time: 0.379892 Sep 16 13:02:04.764175 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1687/3473] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:04 2022] GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c => generated 1510 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:02:04.768622 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-13fca8ac-1a24-4087-8a4c-02e5d6354d24 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:04.769240 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-13fca8ac-1a24-4087-8a4c-02e5d6354d24 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:04.785583 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-13fca8ac-1a24-4087-8a4c-02e5d6354d24 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:04.786294 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-13fca8ac-1a24-4087-8a4c-02e5d6354d24 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:04.786909 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-13fca8ac-1a24-4087-8a4c-02e5d6354d24 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:04.787813 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-13fca8ac-1a24-4087-8a4c-02e5d6354d24 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:04.788307 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-13fca8ac-1a24-4087-8a4c-02e5d6354d24 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:04.788741 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-13fca8ac-1a24-4087-8a4c-02e5d6354d24 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:04.847271 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8d92996f-f28b-4c99-9795-c55ab0994fe3 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50f1d810ba34ef6a419d376f2b6c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82287f900aa34e05ba0e0cf7ba924585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:04.856854 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8d92996f-f28b-4c99-9795-c55ab0994fe3 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] 10.222.0.67 "GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8" status: 200 len: 1350 microversion: 2.1 time: 0.234225 Sep 16 13:02:04.857570 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1787/3474] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:04 2022] GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8 => generated 1350 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:04.863743 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2d3d1d33-b454-4001-87f6-43466c120216 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:04.864896 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2d3d1d33-b454-4001-87f6-43466c120216 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:04.872333 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2d3d1d33-b454-4001-87f6-43466c120216 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:04.872856 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2d3d1d33-b454-4001-87f6-43466c120216 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:04.873284 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2d3d1d33-b454-4001-87f6-43466c120216 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:04.874207 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2d3d1d33-b454-4001-87f6-43466c120216 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:04.874831 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2d3d1d33-b454-4001-87f6-43466c120216 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:04.875438 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2d3d1d33-b454-4001-87f6-43466c120216 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:05.098307 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-13fca8ac-1a24-4087-8a4c-02e5d6354d24 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:05.116446 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-13fca8ac-1a24-4087-8a4c-02e5d6354d24 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1665 microversion: 2.1 time: 0.350335 Sep 16 13:02:05.149889 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1688/3475] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:04 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1665 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:05.162794 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2d3d1d33-b454-4001-87f6-43466c120216 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:05.174261 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2d3d1d33-b454-4001-87f6-43466c120216 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:05.176141 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2d3d1d33-b454-4001-87f6-43466c120216 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:05.177605 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2d3d1d33-b454-4001-87f6-43466c120216 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1873 microversion: 2.42 time: 0.318899 Sep 16 13:02:05.178778 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1788/3476] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:02:04 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1873 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:02:05.198428 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8e2573bb-4a45-4864-addd-3c54bdb5fdc2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:05.204048 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8e2573bb-4a45-4864-addd-3c54bdb5fdc2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:05.212678 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8e2573bb-4a45-4864-addd-3c54bdb5fdc2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:05.213592 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8e2573bb-4a45-4864-addd-3c54bdb5fdc2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:05.214268 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8e2573bb-4a45-4864-addd-3c54bdb5fdc2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:05.215570 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8e2573bb-4a45-4864-addd-3c54bdb5fdc2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:05.216072 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8e2573bb-4a45-4864-addd-3c54bdb5fdc2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:05.216703 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8e2573bb-4a45-4864-addd-3c54bdb5fdc2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:05.331724 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d92db148-af73-4589-bab6-c4cc416ce09b tempest-PortsAdminExtendedAttrsTestJSON-1173104216 tempest-PortsAdminExtendedAttrsTestJSON-1173104216-project-admin] Calling method '.version_select at 0x7f1035bad4c0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:05.334826 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d92db148-af73-4589-bab6-c4cc416ce09b tempest-PortsAdminExtendedAttrsTestJSON-1173104216 tempest-PortsAdminExtendedAttrsTestJSON-1173104216-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:05.335734 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d92db148-af73-4589-bab6-c4cc416ce09b tempest-PortsAdminExtendedAttrsTestJSON-1173104216 tempest-PortsAdminExtendedAttrsTestJSON-1173104216-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:05.336664 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d92db148-af73-4589-bab6-c4cc416ce09b tempest-PortsAdminExtendedAttrsTestJSON-1173104216 tempest-PortsAdminExtendedAttrsTestJSON-1173104216-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:05.366169 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d92db148-af73-4589-bab6-c4cc416ce09b tempest-PortsAdminExtendedAttrsTestJSON-1173104216 tempest-PortsAdminExtendedAttrsTestJSON-1173104216-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:05.367623 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d92db148-af73-4589-bab6-c4cc416ce09b tempest-PortsAdminExtendedAttrsTestJSON-1173104216 tempest-PortsAdminExtendedAttrsTestJSON-1173104216-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:05.368393 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d92db148-af73-4589-bab6-c4cc416ce09b tempest-PortsAdminExtendedAttrsTestJSON-1173104216 tempest-PortsAdminExtendedAttrsTestJSON-1173104216-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:05.381317 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d92db148-af73-4589-bab6-c4cc416ce09b tempest-PortsAdminExtendedAttrsTestJSON-1173104216 tempest-PortsAdminExtendedAttrsTestJSON-1173104216-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:05.382182 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d92db148-af73-4589-bab6-c4cc416ce09b tempest-PortsAdminExtendedAttrsTestJSON-1173104216 tempest-PortsAdminExtendedAttrsTestJSON-1173104216-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:05.382868 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d92db148-af73-4589-bab6-c4cc416ce09b tempest-PortsAdminExtendedAttrsTestJSON-1173104216 tempest-PortsAdminExtendedAttrsTestJSON-1173104216-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:05.390816 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d92db148-af73-4589-bab6-c4cc416ce09b tempest-PortsAdminExtendedAttrsTestJSON-1173104216 tempest-PortsAdminExtendedAttrsTestJSON-1173104216-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.239666 Sep 16 13:02:05.391755 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1689/3477] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 13:02:05 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:02:05.407727 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3a08f6f2-cc71-4409-9b2d-d27abb15407d tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:05.409641 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3a08f6f2-cc71-4409-9b2d-d27abb15407d tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] [instance: aec891b0-f64b-4305-a527-356ed01b1445] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:05.417262 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3a08f6f2-cc71-4409-9b2d-d27abb15407d tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:05.418152 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3a08f6f2-cc71-4409-9b2d-d27abb15407d tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:05.420095 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3a08f6f2-cc71-4409-9b2d-d27abb15407d tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:05.421913 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3a08f6f2-cc71-4409-9b2d-d27abb15407d tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:05.423045 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3a08f6f2-cc71-4409-9b2d-d27abb15407d tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:05.423801 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3a08f6f2-cc71-4409-9b2d-d27abb15407d tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:05.431454 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8e2573bb-4a45-4864-addd-3c54bdb5fdc2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:05.442395 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8e2573bb-4a45-4864-addd-3c54bdb5fdc2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1665 microversion: 2.1 time: 0.262249 Sep 16 13:02:05.453292 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:02:05.456964 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1789/3478] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:05 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1665 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:05.479499 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d57f5741-4c50-4bdb-95da-3d5530f0c5fa tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-751664764"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:02:05.483194 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d57f5741-4c50-4bdb-95da-3d5530f0c5fa tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:05.490047 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d57f5741-4c50-4bdb-95da-3d5530f0c5fa tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:05.490769 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d57f5741-4c50-4bdb-95da-3d5530f0c5fa tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:05.491574 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d57f5741-4c50-4bdb-95da-3d5530f0c5fa tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:05.492505 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d57f5741-4c50-4bdb-95da-3d5530f0c5fa tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:05.495761 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d57f5741-4c50-4bdb-95da-3d5530f0c5fa tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:05.496486 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d57f5741-4c50-4bdb-95da-3d5530f0c5fa tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:05.621999 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3a08f6f2-cc71-4409-9b2d-d27abb15407d tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b626d35721d4889bdd6facc201a5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1a2dd1e1504bd08826f75f48817169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:05.635566 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3a08f6f2-cc71-4409-9b2d-d27abb15407d tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] 10.222.0.67 "GET /compute/v2.1/servers/aec891b0-f64b-4305-a527-356ed01b1445" status: 200 len: 1314 microversion: 2.1 time: 0.241905 Sep 16 13:02:05.636385 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1690/3479] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:05 2022] GET /compute/v2.1/servers/aec891b0-f64b-4305-a527-356ed01b1445 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:05.729590 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-b01bcab3-2bee-420b-8d7f-301131a56673 req-7320aec7-9039-4d48-8a40-e5452bc8f749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aec891b0-f64b-4305-a527-356ed01b1445", "name": "network-vif-plugged", "status": "completed", "tag": "a2ab8eb4-c338-459a-b674-f31ee11bfd20"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:02:05.741223 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-b01bcab3-2bee-420b-8d7f-301131a56673 req-7320aec7-9039-4d48-8a40-e5452bc8f749 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:05.741453 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d57f5741-4c50-4bdb-95da-3d5530f0c5fa tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "POST /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771/action" status: 202 len: 0 microversion: 2.1 time: 0.267532 Sep 16 13:02:05.742063 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1790/3480] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 13:02:05 2022] POST /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Sep 16 13:02:05.742809 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-b01bcab3-2bee-420b-8d7f-301131a56673 req-7320aec7-9039-4d48-8a40-e5452bc8f749 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:05.744002 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-b01bcab3-2bee-420b-8d7f-301131a56673 req-7320aec7-9039-4d48-8a40-e5452bc8f749 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:05.785403 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-b01bcab3-2bee-420b-8d7f-301131a56673 req-7320aec7-9039-4d48-8a40-e5452bc8f749 service nova] Creating event network-vif-plugged:a2ab8eb4-c338-459a-b674-f31ee11bfd20 for instance aec891b0-f64b-4305-a527-356ed01b1445 on n-h2-858094-4 Sep 16 13:02:05.787815 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1580aa16-5a40-4553-ab0f-e3550220c7a5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:05.788565 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1580aa16-5a40-4553-ab0f-e3550220c7a5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:05.792851 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-b01bcab3-2bee-420b-8d7f-301131a56673 req-7320aec7-9039-4d48-8a40-e5452bc8f749 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066854 Sep 16 13:02:05.793919 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1691/3481] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:02:05.799999 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1580aa16-5a40-4553-ab0f-e3550220c7a5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:05.800736 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1580aa16-5a40-4553-ab0f-e3550220c7a5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:05.801410 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1580aa16-5a40-4553-ab0f-e3550220c7a5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:05.802281 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1580aa16-5a40-4553-ab0f-e3550220c7a5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:05.802892 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1580aa16-5a40-4553-ab0f-e3550220c7a5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:05.803512 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1580aa16-5a40-4553-ab0f-e3550220c7a5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:05.892768 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f65dac14-089d-41b7-8c4b-7f8ba8f3fff2 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:05.893769 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f65dac14-089d-41b7-8c4b-7f8ba8f3fff2 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] [instance: 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:05.905655 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f65dac14-089d-41b7-8c4b-7f8ba8f3fff2 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:05.906721 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f65dac14-089d-41b7-8c4b-7f8ba8f3fff2 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:05.908319 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f65dac14-089d-41b7-8c4b-7f8ba8f3fff2 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:05.909547 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f65dac14-089d-41b7-8c4b-7f8ba8f3fff2 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:05.911050 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f65dac14-089d-41b7-8c4b-7f8ba8f3fff2 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:05.911935 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f65dac14-089d-41b7-8c4b-7f8ba8f3fff2 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:06.155187 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1580aa16-5a40-4553-ab0f-e3550220c7a5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:06.164287 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1580aa16-5a40-4553-ab0f-e3550220c7a5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c" status: 200 len: 1510 microversion: 2.1 time: 0.379940 Sep 16 13:02:06.174629 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1791/3482] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:05 2022] GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c => generated 1510 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:02:06.206091 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4763a9d1-1be1-4b0b-b1e6-3e8234b43dec tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:06.206720 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4763a9d1-1be1-4b0b-b1e6-3e8234b43dec tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:06.213275 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4763a9d1-1be1-4b0b-b1e6-3e8234b43dec tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:06.214021 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4763a9d1-1be1-4b0b-b1e6-3e8234b43dec tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:06.214632 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4763a9d1-1be1-4b0b-b1e6-3e8234b43dec tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:06.216159 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4763a9d1-1be1-4b0b-b1e6-3e8234b43dec tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:06.216805 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4763a9d1-1be1-4b0b-b1e6-3e8234b43dec tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:06.217526 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4763a9d1-1be1-4b0b-b1e6-3e8234b43dec tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:06.253068 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f65dac14-089d-41b7-8c4b-7f8ba8f3fff2 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50f1d810ba34ef6a419d376f2b6c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82287f900aa34e05ba0e0cf7ba924585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:06.265731 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f65dac14-089d-41b7-8c4b-7f8ba8f3fff2 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] 10.222.0.67 "GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8" status: 200 len: 1350 microversion: 2.1 time: 0.378520 Sep 16 13:02:06.266393 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1692/3483] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:05 2022] GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8 => generated 1350 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:02:06.561761 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4763a9d1-1be1-4b0b-b1e6-3e8234b43dec tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:06.573359 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4763a9d1-1be1-4b0b-b1e6-3e8234b43dec tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:06.575203 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4763a9d1-1be1-4b0b-b1e6-3e8234b43dec tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:06.577815 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4763a9d1-1be1-4b0b-b1e6-3e8234b43dec tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1873 microversion: 2.42 time: 0.375170 Sep 16 13:02:06.578591 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1792/3484] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:02:06 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1873 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:02:06.660713 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9de16c61-5a12-40df-a58a-3787987bb0ad tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:06.661361 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9de16c61-5a12-40df-a58a-3787987bb0ad tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] [instance: aec891b0-f64b-4305-a527-356ed01b1445] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:06.671798 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9de16c61-5a12-40df-a58a-3787987bb0ad tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:06.672610 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9de16c61-5a12-40df-a58a-3787987bb0ad tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:06.673216 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9de16c61-5a12-40df-a58a-3787987bb0ad tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:06.674845 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9de16c61-5a12-40df-a58a-3787987bb0ad tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:06.675496 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9de16c61-5a12-40df-a58a-3787987bb0ad tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:06.676111 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9de16c61-5a12-40df-a58a-3787987bb0ad tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:06.972964 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9de16c61-5a12-40df-a58a-3787987bb0ad tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b626d35721d4889bdd6facc201a5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1a2dd1e1504bd08826f75f48817169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:06.984357 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9de16c61-5a12-40df-a58a-3787987bb0ad tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] 10.222.0.67 "GET /compute/v2.1/servers/aec891b0-f64b-4305-a527-356ed01b1445" status: 200 len: 1314 microversion: 2.1 time: 0.328001 Sep 16 13:02:07.001494 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1693/3485] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:06 2022] GET /compute/v2.1/servers/aec891b0-f64b-4305-a527-356ed01b1445 => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:07.188848 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f3d89033-a042-412d-9c24-4f4ac38d9b44 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:07.190029 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f3d89033-a042-412d-9c24-4f4ac38d9b44 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:07.196343 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3d89033-a042-412d-9c24-4f4ac38d9b44 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:07.196830 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3d89033-a042-412d-9c24-4f4ac38d9b44 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:07.197356 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3d89033-a042-412d-9c24-4f4ac38d9b44 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:07.202160 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3d89033-a042-412d-9c24-4f4ac38d9b44 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:07.202907 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3d89033-a042-412d-9c24-4f4ac38d9b44 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:07.203515 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3d89033-a042-412d-9c24-4f4ac38d9b44 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:07.290400 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e34ea119-7626-450d-8b85-0b5100e0364b tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:07.291114 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e34ea119-7626-450d-8b85-0b5100e0364b tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] [instance: 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:07.299159 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e34ea119-7626-450d-8b85-0b5100e0364b tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:07.299950 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e34ea119-7626-450d-8b85-0b5100e0364b tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:07.300401 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e34ea119-7626-450d-8b85-0b5100e0364b tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:07.301116 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e34ea119-7626-450d-8b85-0b5100e0364b tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:07.301567 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e34ea119-7626-450d-8b85-0b5100e0364b tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:07.302346 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e34ea119-7626-450d-8b85-0b5100e0364b tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:07.632995 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f3d89033-a042-412d-9c24-4f4ac38d9b44 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:07.644890 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f3d89033-a042-412d-9c24-4f4ac38d9b44 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c" status: 200 len: 1510 microversion: 2.1 time: 0.461848 Sep 16 13:02:07.645752 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1793/3486] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:07 2022] GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c => generated 1510 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:07.650717 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-db0ae91b-0621-44ee-8efa-e0f44fca74bd tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:07.657738 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-db0ae91b-0621-44ee-8efa-e0f44fca74bd tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:07.675984 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db0ae91b-0621-44ee-8efa-e0f44fca74bd tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:07.676329 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db0ae91b-0621-44ee-8efa-e0f44fca74bd tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:07.676697 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db0ae91b-0621-44ee-8efa-e0f44fca74bd tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:07.677411 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db0ae91b-0621-44ee-8efa-e0f44fca74bd tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:07.677861 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db0ae91b-0621-44ee-8efa-e0f44fca74bd tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:07.678282 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db0ae91b-0621-44ee-8efa-e0f44fca74bd tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:08.160002 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e34ea119-7626-450d-8b85-0b5100e0364b tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50f1d810ba34ef6a419d376f2b6c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82287f900aa34e05ba0e0cf7ba924585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:08.177615 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e34ea119-7626-450d-8b85-0b5100e0364b tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] 10.222.0.67 "GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8" status: 200 len: 1350 microversion: 2.1 time: 0.887412 Sep 16 13:02:08.180147 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1694/3487] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:07 2022] GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8 => generated 1350 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:02:08.187811 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6e4b04c9-22ce-430c-801e-5ab018196dd7 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:08.188930 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6e4b04c9-22ce-430c-801e-5ab018196dd7 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] [instance: aec891b0-f64b-4305-a527-356ed01b1445] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:08.203743 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6e4b04c9-22ce-430c-801e-5ab018196dd7 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:08.204776 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6e4b04c9-22ce-430c-801e-5ab018196dd7 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:08.205767 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6e4b04c9-22ce-430c-801e-5ab018196dd7 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:08.207174 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6e4b04c9-22ce-430c-801e-5ab018196dd7 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:08.207860 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6e4b04c9-22ce-430c-801e-5ab018196dd7 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:08.208598 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6e4b04c9-22ce-430c-801e-5ab018196dd7 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:08.458721 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-db0ae91b-0621-44ee-8efa-e0f44fca74bd tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:08.479225 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-db0ae91b-0621-44ee-8efa-e0f44fca74bd tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:08.483958 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-db0ae91b-0621-44ee-8efa-e0f44fca74bd tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:08.487414 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-db0ae91b-0621-44ee-8efa-e0f44fca74bd tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1873 microversion: 2.42 time: 0.840450 Sep 16 13:02:08.488713 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1794/3488] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:02:07 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1873 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:02:08.531567 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6e4b04c9-22ce-430c-801e-5ab018196dd7 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b626d35721d4889bdd6facc201a5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1a2dd1e1504bd08826f75f48817169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:08.541120 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6e4b04c9-22ce-430c-801e-5ab018196dd7 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] 10.222.0.67 "GET /compute/v2.1/servers/aec891b0-f64b-4305-a527-356ed01b1445" status: 200 len: 1464 microversion: 2.1 time: 0.359653 Sep 16 13:02:08.541960 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1695/3489] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:08 2022] GET /compute/v2.1/servers/aec891b0-f64b-4305-a527-356ed01b1445 => generated 1464 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:08.669272 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8a29c564-37da-4293-b78e-7c33719ed61a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:08.669927 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8a29c564-37da-4293-b78e-7c33719ed61a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:08.677136 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8a29c564-37da-4293-b78e-7c33719ed61a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:08.677723 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8a29c564-37da-4293-b78e-7c33719ed61a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:08.678221 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8a29c564-37da-4293-b78e-7c33719ed61a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:08.679181 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8a29c564-37da-4293-b78e-7c33719ed61a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:08.680097 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8a29c564-37da-4293-b78e-7c33719ed61a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:08.680908 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8a29c564-37da-4293-b78e-7c33719ed61a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:08.757451 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ab9ad275-a3ac-4865-9544-8237edc6f067 tempest-TenantUsagesTestJSON-924266839 tempest-TenantUsagesTestJSON-924266839-project-admin] Calling method '.version_select at 0x7f103995f3a0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:08.785870 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab9ad275-a3ac-4865-9544-8237edc6f067 tempest-TenantUsagesTestJSON-924266839 tempest-TenantUsagesTestJSON-924266839-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:08.786688 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab9ad275-a3ac-4865-9544-8237edc6f067 tempest-TenantUsagesTestJSON-924266839 tempest-TenantUsagesTestJSON-924266839-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:08.787679 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab9ad275-a3ac-4865-9544-8237edc6f067 tempest-TenantUsagesTestJSON-924266839 tempest-TenantUsagesTestJSON-924266839-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:08.809947 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab9ad275-a3ac-4865-9544-8237edc6f067 tempest-TenantUsagesTestJSON-924266839 tempest-TenantUsagesTestJSON-924266839-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:08.810809 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab9ad275-a3ac-4865-9544-8237edc6f067 tempest-TenantUsagesTestJSON-924266839 tempest-TenantUsagesTestJSON-924266839-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:08.811551 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab9ad275-a3ac-4865-9544-8237edc6f067 tempest-TenantUsagesTestJSON-924266839 tempest-TenantUsagesTestJSON-924266839-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:08.837228 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ab9ad275-a3ac-4865-9544-8237edc6f067 tempest-TenantUsagesTestJSON-924266839 tempest-TenantUsagesTestJSON-924266839-project-admin] 10.222.0.67 "GET /compute/v2.1/os-simple-tenant-usage/ea1a2dd1e1504bd08826f75f48817169?start=2022-09-15T13%3A02%3A08.560302&end=2022-09-17T13%3A02%3A08.560302" status: 200 len: 695 microversion: 2.1 time: 0.272864 Sep 16 13:02:08.837863 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1795/3490] 10.222.0.67 () {58 vars in 1412 bytes} [Fri Sep 16 13:02:08 2022] GET /compute/v2.1/os-simple-tenant-usage/ea1a2dd1e1504bd08826f75f48817169?start=2022-09-15T13%3A02%3A08.560302&end=2022-09-17T13%3A02%3A08.560302 => generated 695 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:02:08.854298 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cf00972a-f328-46fe-afb6-79b31ccf7fec tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Calling method '.version_select at 0x7f10399d79d0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:08.866485 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf00972a-f328-46fe-afb6-79b31ccf7fec tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:08.867137 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf00972a-f328-46fe-afb6-79b31ccf7fec tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:08.867664 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf00972a-f328-46fe-afb6-79b31ccf7fec tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:08.873710 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8a29c564-37da-4293-b78e-7c33719ed61a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:08.881714 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8a29c564-37da-4293-b78e-7c33719ed61a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c" status: 200 len: 1510 microversion: 2.1 time: 0.216496 Sep 16 13:02:08.886086 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1696/3491] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:08 2022] GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c => generated 1510 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:02:08.892971 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf00972a-f328-46fe-afb6-79b31ccf7fec tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:08.893805 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf00972a-f328-46fe-afb6-79b31ccf7fec tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:08.894455 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf00972a-f328-46fe-afb6-79b31ccf7fec tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:08.910737 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cf00972a-f328-46fe-afb6-79b31ccf7fec tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] 10.222.0.67 "GET /compute/v2.1/os-simple-tenant-usage/ea1a2dd1e1504bd08826f75f48817169?start=2022-09-15T13%3A02%3A08.560302&end=2022-09-17T13%3A02%3A08.560302" status: 200 len: 695 microversion: 2.1 time: 0.060986 Sep 16 13:02:08.911341 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1796/3492] 10.222.0.67 () {58 vars in 1412 bytes} [Fri Sep 16 13:02:08 2022] GET /compute/v2.1/os-simple-tenant-usage/ea1a2dd1e1504bd08826f75f48817169?start=2022-09-15T13%3A02%3A08.560302&end=2022-09-17T13%3A02%3A08.560302 => generated 695 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:02:08.928077 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d77b8b34-7736-4c7e-8e22-e9f2e8aacb8c tempest-TenantUsagesTestJSON-924266839 tempest-TenantUsagesTestJSON-924266839-project-admin] Calling method '.version_select at 0x7f103593ca60>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:08.938050 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d77b8b34-7736-4c7e-8e22-e9f2e8aacb8c tempest-TenantUsagesTestJSON-924266839 tempest-TenantUsagesTestJSON-924266839-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:08.938895 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d77b8b34-7736-4c7e-8e22-e9f2e8aacb8c tempest-TenantUsagesTestJSON-924266839 tempest-TenantUsagesTestJSON-924266839-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:08.939392 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d77b8b34-7736-4c7e-8e22-e9f2e8aacb8c tempest-TenantUsagesTestJSON-924266839 tempest-TenantUsagesTestJSON-924266839-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:08.956628 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d77b8b34-7736-4c7e-8e22-e9f2e8aacb8c tempest-TenantUsagesTestJSON-924266839 tempest-TenantUsagesTestJSON-924266839-project-admin] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:08.957490 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d77b8b34-7736-4c7e-8e22-e9f2e8aacb8c tempest-TenantUsagesTestJSON-924266839 tempest-TenantUsagesTestJSON-924266839-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:08.957992 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d77b8b34-7736-4c7e-8e22-e9f2e8aacb8c tempest-TenantUsagesTestJSON-924266839 tempest-TenantUsagesTestJSON-924266839-project-admin] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:09.119304 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d77b8b34-7736-4c7e-8e22-e9f2e8aacb8c tempest-TenantUsagesTestJSON-924266839 tempest-TenantUsagesTestJSON-924266839-project-admin] 10.222.0.67 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-15T13%3A02%3A08.560302&end=2022-09-17T13%3A02%3A08.560302&detailed=1" status: 200 len: 41885 microversion: 2.1 time: 0.195214 Sep 16 13:02:09.130996 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1697/3493] 10.222.0.67 () {58 vars in 1335 bytes} [Fri Sep 16 13:02:08 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-15T13%3A02%3A08.560302&end=2022-09-17T13%3A02%3A08.560302&detailed=1 => generated 41885 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:02:09.175383 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fb3108bd-af53-46c3-a5cc-5febcf6abda2 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:09.177217 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fb3108bd-af53-46c3-a5cc-5febcf6abda2 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] [instance: aec891b0-f64b-4305-a527-356ed01b1445] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:09.185697 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb3108bd-af53-46c3-a5cc-5febcf6abda2 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:09.186574 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb3108bd-af53-46c3-a5cc-5febcf6abda2 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:09.187319 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb3108bd-af53-46c3-a5cc-5febcf6abda2 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:09.188352 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb3108bd-af53-46c3-a5cc-5febcf6abda2 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:09.189342 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb3108bd-af53-46c3-a5cc-5febcf6abda2 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:09.190209 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb3108bd-af53-46c3-a5cc-5febcf6abda2 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:09.210379 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-78b1df83-50db-4c21-b9bd-19b27b32f746 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:09.211644 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-78b1df83-50db-4c21-b9bd-19b27b32f746 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] [instance: 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:09.220470 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-78b1df83-50db-4c21-b9bd-19b27b32f746 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:09.221262 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-78b1df83-50db-4c21-b9bd-19b27b32f746 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:09.221947 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-78b1df83-50db-4c21-b9bd-19b27b32f746 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:09.223015 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-78b1df83-50db-4c21-b9bd-19b27b32f746 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:09.223717 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-78b1df83-50db-4c21-b9bd-19b27b32f746 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:09.224395 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-78b1df83-50db-4c21-b9bd-19b27b32f746 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:09.229390 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fb3108bd-af53-46c3-a5cc-5febcf6abda2 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] [instance: aec891b0-f64b-4305-a527-356ed01b1445] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:02:09.390475 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fb3108bd-af53-46c3-a5cc-5febcf6abda2 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] 10.222.0.67 "DELETE /compute/v2.1/servers/aec891b0-f64b-4305-a527-356ed01b1445" status: 204 len: 0 microversion: 2.1 time: 0.220271 Sep 16 13:02:09.391727 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1797/3494] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 13:02:09 2022] DELETE /compute/v2.1/servers/aec891b0-f64b-4305-a527-356ed01b1445 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:02:09.402734 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f1b8e2a3-a795-429a-911e-5a2836e87eb9 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:09.404888 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f1b8e2a3-a795-429a-911e-5a2836e87eb9 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] [instance: aec891b0-f64b-4305-a527-356ed01b1445] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:09.412190 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-78b1df83-50db-4c21-b9bd-19b27b32f746 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50f1d810ba34ef6a419d376f2b6c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82287f900aa34e05ba0e0cf7ba924585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:09.412392 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1b8e2a3-a795-429a-911e-5a2836e87eb9 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:09.413093 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1b8e2a3-a795-429a-911e-5a2836e87eb9 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:09.413967 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1b8e2a3-a795-429a-911e-5a2836e87eb9 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:09.414970 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1b8e2a3-a795-429a-911e-5a2836e87eb9 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:09.415513 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1b8e2a3-a795-429a-911e-5a2836e87eb9 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:09.416020 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1b8e2a3-a795-429a-911e-5a2836e87eb9 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:09.433444 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-78b1df83-50db-4c21-b9bd-19b27b32f746 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] 10.222.0.67 "GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8" status: 200 len: 1350 microversion: 2.1 time: 0.229445 Sep 16 13:02:09.436191 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1698/3495] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:09 2022] GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8 => generated 1350 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:09.445167 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:02:09.517080 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-acce8577-0fb0-4f0a-beed-e6e7771a2add tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:09.517700 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-acce8577-0fb0-4f0a-beed-e6e7771a2add tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:09.524163 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-acce8577-0fb0-4f0a-beed-e6e7771a2add tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:09.524823 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-acce8577-0fb0-4f0a-beed-e6e7771a2add tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:09.525418 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-acce8577-0fb0-4f0a-beed-e6e7771a2add tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:09.526274 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-acce8577-0fb0-4f0a-beed-e6e7771a2add tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:09.526884 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-acce8577-0fb0-4f0a-beed-e6e7771a2add tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:09.527486 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-acce8577-0fb0-4f0a-beed-e6e7771a2add tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:09.581579 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f1b8e2a3-a795-429a-911e-5a2836e87eb9 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b626d35721d4889bdd6facc201a5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1a2dd1e1504bd08826f75f48817169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:09.597098 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f1b8e2a3-a795-429a-911e-5a2836e87eb9 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] 10.222.0.67 "GET /compute/v2.1/servers/aec891b0-f64b-4305-a527-356ed01b1445" status: 200 len: 1470 microversion: 2.1 time: 0.200357 Sep 16 13:02:09.598019 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1798/3496] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:09 2022] GET /compute/v2.1/servers/aec891b0-f64b-4305-a527-356ed01b1445 => generated 1470 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:09.772441 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-acce8577-0fb0-4f0a-beed-e6e7771a2add tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:09.789674 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-acce8577-0fb0-4f0a-beed-e6e7771a2add tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:09.791534 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-acce8577-0fb0-4f0a-beed-e6e7771a2add tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:09.793907 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-acce8577-0fb0-4f0a-beed-e6e7771a2add tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1873 microversion: 2.42 time: 0.280990 Sep 16 13:02:09.795107 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1699/3497] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:02:09 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1873 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:02:09.911618 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-da4c05a3-659e-47a6-bcaa-d6c8a96c97e6 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:09.912366 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-da4c05a3-659e-47a6-bcaa-d6c8a96c97e6 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:09.924495 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da4c05a3-659e-47a6-bcaa-d6c8a96c97e6 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:09.925156 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da4c05a3-659e-47a6-bcaa-d6c8a96c97e6 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:09.926061 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da4c05a3-659e-47a6-bcaa-d6c8a96c97e6 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:09.927556 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da4c05a3-659e-47a6-bcaa-d6c8a96c97e6 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:09.928910 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da4c05a3-659e-47a6-bcaa-d6c8a96c97e6 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:09.930025 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da4c05a3-659e-47a6-bcaa-d6c8a96c97e6 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:10.112320 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-da4c05a3-659e-47a6-bcaa-d6c8a96c97e6 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:10.125198 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-da4c05a3-659e-47a6-bcaa-d6c8a96c97e6 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c" status: 200 len: 1510 microversion: 2.1 time: 0.217376 Sep 16 13:02:10.126328 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1799/3498] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:09 2022] GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c => generated 1510 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:10.460383 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b1721c64-a18b-4580-b9c0-4c3539ba5af5 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:10.461787 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b1721c64-a18b-4580-b9c0-4c3539ba5af5 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] [instance: 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:10.495469 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b1721c64-a18b-4580-b9c0-4c3539ba5af5 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:10.495968 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b1721c64-a18b-4580-b9c0-4c3539ba5af5 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:10.497041 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b1721c64-a18b-4580-b9c0-4c3539ba5af5 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:10.503994 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b1721c64-a18b-4580-b9c0-4c3539ba5af5 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:10.504545 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b1721c64-a18b-4580-b9c0-4c3539ba5af5 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:10.505007 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b1721c64-a18b-4580-b9c0-4c3539ba5af5 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:10.622350 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a4dfa7e3-52d7-4529-8cc3-53e52572986c tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:10.623218 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a4dfa7e3-52d7-4529-8cc3-53e52572986c tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] [instance: aec891b0-f64b-4305-a527-356ed01b1445] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:10.642315 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4dfa7e3-52d7-4529-8cc3-53e52572986c tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:10.643107 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4dfa7e3-52d7-4529-8cc3-53e52572986c tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:10.644750 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4dfa7e3-52d7-4529-8cc3-53e52572986c tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:10.645748 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4dfa7e3-52d7-4529-8cc3-53e52572986c tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:10.646457 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4dfa7e3-52d7-4529-8cc3-53e52572986c tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:10.665482 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4dfa7e3-52d7-4529-8cc3-53e52572986c tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:10.961785 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-b1721c64-a18b-4580-b9c0-4c3539ba5af5 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50f1d810ba34ef6a419d376f2b6c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82287f900aa34e05ba0e0cf7ba924585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:10.975172 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b1721c64-a18b-4580-b9c0-4c3539ba5af5 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] 10.222.0.67 "GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8" status: 200 len: 1350 microversion: 2.1 time: 0.520064 Sep 16 13:02:10.976564 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1700/3499] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:10 2022] GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8 => generated 1350 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:10.982702 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c3436141-4ee8-44af-8df6-b2618b423543 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:10.983400 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c3436141-4ee8-44af-8df6-b2618b423543 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:10.997494 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c3436141-4ee8-44af-8df6-b2618b423543 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:11.000508 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c3436141-4ee8-44af-8df6-b2618b423543 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:11.001255 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c3436141-4ee8-44af-8df6-b2618b423543 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:11.002953 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c3436141-4ee8-44af-8df6-b2618b423543 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:11.004841 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c3436141-4ee8-44af-8df6-b2618b423543 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:11.005298 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c3436141-4ee8-44af-8df6-b2618b423543 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:11.265125 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a4dfa7e3-52d7-4529-8cc3-53e52572986c tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b626d35721d4889bdd6facc201a5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1a2dd1e1504bd08826f75f48817169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:11.288200 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a4dfa7e3-52d7-4529-8cc3-53e52572986c tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] 10.222.0.67 "GET /compute/v2.1/servers/aec891b0-f64b-4305-a527-356ed01b1445" status: 200 len: 1470 microversion: 2.1 time: 0.660632 Sep 16 13:02:11.288200 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1800/3500] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:10 2022] GET /compute/v2.1/servers/aec891b0-f64b-4305-a527-356ed01b1445 => generated 1470 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:02:11.295996 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c258db52-add1-4f0e-b5bd-a5ceede4116b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:11.299471 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c258db52-add1-4f0e-b5bd-a5ceede4116b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:11.312995 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c258db52-add1-4f0e-b5bd-a5ceede4116b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:11.315493 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c258db52-add1-4f0e-b5bd-a5ceede4116b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:11.316227 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c258db52-add1-4f0e-b5bd-a5ceede4116b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:11.317461 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c258db52-add1-4f0e-b5bd-a5ceede4116b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:11.320792 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c258db52-add1-4f0e-b5bd-a5ceede4116b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:11.321693 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c258db52-add1-4f0e-b5bd-a5ceede4116b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:11.714127 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c3436141-4ee8-44af-8df6-b2618b423543 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:11.736319 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c3436141-4ee8-44af-8df6-b2618b423543 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:11.737888 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c3436141-4ee8-44af-8df6-b2618b423543 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:11.745506 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c3436141-4ee8-44af-8df6-b2618b423543 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1873 microversion: 2.42 time: 0.766846 Sep 16 13:02:11.746350 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1701/3501] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:02:10 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1873 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:02:11.770777 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-22c1ff0f-3851-495a-b6df-cd7319fa4837 req-de1c6e1c-53c4-40cf-bac1-1defe2153108 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af5e660b-de79-42ca-a8de-fe06738b9771", "name": "network-vif-plugged", "status": "completed", "tag": "3af800e8-0d1f-497b-bca5-8901587cb91c"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:02:11.801037 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-22c1ff0f-3851-495a-b6df-cd7319fa4837 req-de1c6e1c-53c4-40cf-bac1-1defe2153108 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:11.801772 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-22c1ff0f-3851-495a-b6df-cd7319fa4837 req-de1c6e1c-53c4-40cf-bac1-1defe2153108 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:11.802792 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-22c1ff0f-3851-495a-b6df-cd7319fa4837 req-de1c6e1c-53c4-40cf-bac1-1defe2153108 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:11.830352 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-22c1ff0f-3851-495a-b6df-cd7319fa4837 req-de1c6e1c-53c4-40cf-bac1-1defe2153108 service nova] Creating event network-vif-plugged:3af800e8-0d1f-497b-bca5-8901587cb91c for instance af5e660b-de79-42ca-a8de-fe06738b9771 on n-h2-858094-4 Sep 16 13:02:11.836975 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-22c1ff0f-3851-495a-b6df-cd7319fa4837 req-de1c6e1c-53c4-40cf-bac1-1defe2153108 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087813 Sep 16 13:02:11.838131 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1702/3502] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:02:11.855259 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c258db52-add1-4f0e-b5bd-a5ceede4116b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:11.868880 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c258db52-add1-4f0e-b5bd-a5ceede4116b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c" status: 200 len: 1510 microversion: 2.1 time: 0.586984 Sep 16 13:02:11.870699 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1801/3503] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:11 2022] GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c => generated 1510 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:12.009181 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1a4f67ee-5825-478d-a5b1-9cb62e20fc48 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:12.010357 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-1a4f67ee-5825-478d-a5b1-9cb62e20fc48 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] [instance: 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:12.035681 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1a4f67ee-5825-478d-a5b1-9cb62e20fc48 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:12.036934 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1a4f67ee-5825-478d-a5b1-9cb62e20fc48 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:12.037576 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1a4f67ee-5825-478d-a5b1-9cb62e20fc48 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:12.038695 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1a4f67ee-5825-478d-a5b1-9cb62e20fc48 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:12.039475 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1a4f67ee-5825-478d-a5b1-9cb62e20fc48 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:12.040401 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1a4f67ee-5825-478d-a5b1-9cb62e20fc48 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:12.307976 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-344b9dae-9457-40f6-b04a-d60a9253c332 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:12.308724 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-344b9dae-9457-40f6-b04a-d60a9253c332 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] [instance: aec891b0-f64b-4305-a527-356ed01b1445] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:12.322810 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-344b9dae-9457-40f6-b04a-d60a9253c332 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:12.323550 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-344b9dae-9457-40f6-b04a-d60a9253c332 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:12.324732 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-344b9dae-9457-40f6-b04a-d60a9253c332 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:12.328598 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-344b9dae-9457-40f6-b04a-d60a9253c332 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:12.330595 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-344b9dae-9457-40f6-b04a-d60a9253c332 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:12.332005 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-344b9dae-9457-40f6-b04a-d60a9253c332 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:12.406969 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1a4f67ee-5825-478d-a5b1-9cb62e20fc48 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50f1d810ba34ef6a419d376f2b6c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82287f900aa34e05ba0e0cf7ba924585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:12.415602 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1a4f67ee-5825-478d-a5b1-9cb62e20fc48 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] 10.222.0.67 "GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8" status: 200 len: 1350 microversion: 2.1 time: 0.414040 Sep 16 13:02:12.422287 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1703/3504] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:11 2022] GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8 => generated 1350 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:12.470420 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-344b9dae-9457-40f6-b04a-d60a9253c332 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b626d35721d4889bdd6facc201a5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1a2dd1e1504bd08826f75f48817169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:12.479473 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-344b9dae-9457-40f6-b04a-d60a9253c332 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] 10.222.0.67 "GET /compute/v2.1/servers/aec891b0-f64b-4305-a527-356ed01b1445" status: 200 len: 1428 microversion: 2.1 time: 0.175821 Sep 16 13:02:12.484063 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1802/3505] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:12 2022] GET /compute/v2.1/servers/aec891b0-f64b-4305-a527-356ed01b1445 => generated 1428 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:12.643838 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-b0a86814-f971-4816-bb2e-f4237d82c9ac req-434947fd-ff69-4239-be6a-be4f52c7601d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aec891b0-f64b-4305-a527-356ed01b1445", "name": "network-vif-deleted", "tag": "a2ab8eb4-c338-459a-b674-f31ee11bfd20"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:02:12.672397 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-b0a86814-f971-4816-bb2e-f4237d82c9ac req-434947fd-ff69-4239-be6a-be4f52c7601d service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:12.672984 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-b0a86814-f971-4816-bb2e-f4237d82c9ac req-434947fd-ff69-4239-be6a-be4f52c7601d service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:12.673504 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-b0a86814-f971-4816-bb2e-f4237d82c9ac req-434947fd-ff69-4239-be6a-be4f52c7601d service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:12.708329 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-b0a86814-f971-4816-bb2e-f4237d82c9ac req-434947fd-ff69-4239-be6a-be4f52c7601d service nova] Creating event network-vif-deleted:a2ab8eb4-c338-459a-b674-f31ee11bfd20 for instance aec891b0-f64b-4305-a527-356ed01b1445 on n-h2-858094-4 Sep 16 13:02:12.718013 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-b0a86814-f971-4816-bb2e-f4237d82c9ac req-434947fd-ff69-4239-be6a-be4f52c7601d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077760 Sep 16 13:02:12.726063 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1704/3506] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:02:12.777210 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2288a4a8-a7a8-48f6-9905-6c9075d6aa33 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:12.778891 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2288a4a8-a7a8-48f6-9905-6c9075d6aa33 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:12.790594 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2288a4a8-a7a8-48f6-9905-6c9075d6aa33 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:12.796002 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2288a4a8-a7a8-48f6-9905-6c9075d6aa33 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:12.796763 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2288a4a8-a7a8-48f6-9905-6c9075d6aa33 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:12.818655 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2288a4a8-a7a8-48f6-9905-6c9075d6aa33 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:12.819368 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2288a4a8-a7a8-48f6-9905-6c9075d6aa33 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:12.819974 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2288a4a8-a7a8-48f6-9905-6c9075d6aa33 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:12.900571 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-eb3990f0-bd36-40b5-87ea-02784aff48d4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:12.901558 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-eb3990f0-bd36-40b5-87ea-02784aff48d4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:12.914198 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eb3990f0-bd36-40b5-87ea-02784aff48d4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:12.916087 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eb3990f0-bd36-40b5-87ea-02784aff48d4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:12.917142 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eb3990f0-bd36-40b5-87ea-02784aff48d4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:12.920852 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eb3990f0-bd36-40b5-87ea-02784aff48d4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:12.921548 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eb3990f0-bd36-40b5-87ea-02784aff48d4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:12.923516 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eb3990f0-bd36-40b5-87ea-02784aff48d4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:13.403755 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2288a4a8-a7a8-48f6-9905-6c9075d6aa33 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:13.415790 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2288a4a8-a7a8-48f6-9905-6c9075d6aa33 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:13.426326 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2288a4a8-a7a8-48f6-9905-6c9075d6aa33 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:13.428992 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2288a4a8-a7a8-48f6-9905-6c9075d6aa33 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1873 microversion: 2.42 time: 0.655385 Sep 16 13:02:13.432038 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1803/3507] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:02:12 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1873 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:02:13.449480 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-52de1f6b-8ada-4fe4-8a9e-b831dc7aa8f9 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:13.450580 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-52de1f6b-8ada-4fe4-8a9e-b831dc7aa8f9 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] [instance: 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:13.471172 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52de1f6b-8ada-4fe4-8a9e-b831dc7aa8f9 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:13.471680 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52de1f6b-8ada-4fe4-8a9e-b831dc7aa8f9 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:13.472139 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52de1f6b-8ada-4fe4-8a9e-b831dc7aa8f9 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:13.473090 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52de1f6b-8ada-4fe4-8a9e-b831dc7aa8f9 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:13.473721 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52de1f6b-8ada-4fe4-8a9e-b831dc7aa8f9 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:13.474323 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52de1f6b-8ada-4fe4-8a9e-b831dc7aa8f9 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:13.575171 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-eb3990f0-bd36-40b5-87ea-02784aff48d4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:13.595294 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-eb3990f0-bd36-40b5-87ea-02784aff48d4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c" status: 200 len: 1510 microversion: 2.1 time: 0.698028 Sep 16 13:02:13.596219 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1705/3508] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:12 2022] GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c => generated 1510 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:02:13.611038 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-28cf162a-998d-41b8-84fa-c7646d7fac59 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:13.621989 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-28cf162a-998d-41b8-84fa-c7646d7fac59 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] [instance: aec891b0-f64b-4305-a527-356ed01b1445] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:13.637143 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-28cf162a-998d-41b8-84fa-c7646d7fac59 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:13.638636 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-28cf162a-998d-41b8-84fa-c7646d7fac59 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:13.642769 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-28cf162a-998d-41b8-84fa-c7646d7fac59 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:13.643928 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-28cf162a-998d-41b8-84fa-c7646d7fac59 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:13.644638 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-28cf162a-998d-41b8-84fa-c7646d7fac59 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:13.645279 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-28cf162a-998d-41b8-84fa-c7646d7fac59 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:13.688083 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-28cf162a-998d-41b8-84fa-c7646d7fac59 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] HTTP exception thrown: Instance aec891b0-f64b-4305-a527-356ed01b1445 could not be found. Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-28cf162a-998d-41b8-84fa-c7646d7fac59 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Request method failure captured: Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/aec891b0-f64b-4305-a527-356ed01b1445 HTTP/1.1 Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHO8d2SA8K-haskvKUxbCCctOXYumf5wvP8-pEiid6wqIH6aYj2k4Q2QplfNrPCWll0VcB6laQUP0LnfKrdst4Zzs7lsXxaCzCpTU-SAJumWJF0C2N-mZ7wWDynlkSpk0FsBeEeOjT2cSSFzzUdo6vBzY8xFVRsSAmffRsDelhHt7CM Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: ea1a2dd1e1504bd08826f75f48817169 Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-TenantUsagesTestJSON-49952860 Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ea1a2dd1e1504bd08826f75f48817169"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/ea1a2dd1e1504bd08826f75f48817169"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_ea1a2dd1e1504bd08826f75f48817169", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ea1a2dd1e1504bd08826f75f48817169"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-TenantUsagesTestJSON-49952860 Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: ea1a2dd1e1504bd08826f75f48817169 Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-TenantUsagesTestJSON-49952860 Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-TenantUsagesTestJSON-49952860-project Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 8b626d35721d4889bdd6facc201a5998 Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-TenantUsagesTestJSON-49952860-project Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance aec891b0-f64b-4305-a527-356ed01b1445 could not be found. Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'aec891b0-f64b-4305-a527-356ed01b1445'} Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aec891b0-f64b-4305-a527-356ed01b1445 could not be found. Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aec891b0-f64b-4305-a527-356ed01b1445 could not be found. Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:02:13.693308 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:02:13.698179 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:02:13.698179 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:02:13.698179 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:02:13.698179 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:02:13.698179 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:02:13.698179 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aec891b0-f64b-4305-a527-356ed01b1445 could not be found. Sep 16 13:02:13.698179 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:02:13.703540 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-28cf162a-998d-41b8-84fa-c7646d7fac59 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] Returning 404 to user: Instance aec891b0-f64b-4305-a527-356ed01b1445 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:02:13.704788 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-28cf162a-998d-41b8-84fa-c7646d7fac59 tempest-TenantUsagesTestJSON-49952860 tempest-TenantUsagesTestJSON-49952860-project] 10.222.0.67 "GET /compute/v2.1/servers/aec891b0-f64b-4305-a527-356ed01b1445" status: 404 len: 111 microversion: 2.1 time: 0.107441 Sep 16 13:02:13.712888 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1706/3509] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:13 2022] GET /compute/v2.1/servers/aec891b0-f64b-4305-a527-356ed01b1445 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:02:13.863760 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-52de1f6b-8ada-4fe4-8a9e-b831dc7aa8f9 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50f1d810ba34ef6a419d376f2b6c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82287f900aa34e05ba0e0cf7ba924585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:13.876641 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-52de1f6b-8ada-4fe4-8a9e-b831dc7aa8f9 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] 10.222.0.67 "GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8" status: 200 len: 1350 microversion: 2.1 time: 0.437499 Sep 16 13:02:13.878754 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1804/3510] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:13 2022] GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8 => generated 1350 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:14.135284 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-b7865089-dea5-4f69-9633-b32be82fa490 req-de39b4b9-37d4-41ec-b31e-fff7311f109e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "defaddc3-3750-4d8a-b18a-dd6fdce1dbbf", "name": "network-vif-plugged", "status": "completed", "tag": "328ce2f8-022c-446e-b388-06295b8c63e7"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:02:14.153842 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-b7865089-dea5-4f69-9633-b32be82fa490 req-de39b4b9-37d4-41ec-b31e-fff7311f109e service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:14.155672 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-b7865089-dea5-4f69-9633-b32be82fa490 req-de39b4b9-37d4-41ec-b31e-fff7311f109e service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:14.156463 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-b7865089-dea5-4f69-9633-b32be82fa490 req-de39b4b9-37d4-41ec-b31e-fff7311f109e service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:14.174615 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-b7865089-dea5-4f69-9633-b32be82fa490 req-de39b4b9-37d4-41ec-b31e-fff7311f109e service nova] Creating event network-vif-plugged:328ce2f8-022c-446e-b388-06295b8c63e7 for instance defaddc3-3750-4d8a-b18a-dd6fdce1dbbf on n-h1-858094-4 Sep 16 13:02:14.185570 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-b7865089-dea5-4f69-9633-b32be82fa490 req-de39b4b9-37d4-41ec-b31e-fff7311f109e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056883 Sep 16 13:02:14.187091 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1707/3511] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:02:14.457370 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cc70114d-daa1-476a-a714-3ce31ef4a4c4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:14.457984 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cc70114d-daa1-476a-a714-3ce31ef4a4c4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:14.467031 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:02:14.469657 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc70114d-daa1-476a-a714-3ce31ef4a4c4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:14.470159 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc70114d-daa1-476a-a714-3ce31ef4a4c4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:14.470603 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc70114d-daa1-476a-a714-3ce31ef4a4c4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:14.472273 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc70114d-daa1-476a-a714-3ce31ef4a4c4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:14.473292 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc70114d-daa1-476a-a714-3ce31ef4a4c4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:14.473960 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc70114d-daa1-476a-a714-3ce31ef4a4c4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:14.626224 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-bc46e429-9ea9-4c28-ae84-b4afab1cf37a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:14.626946 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-bc46e429-9ea9-4c28-ae84-b4afab1cf37a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:14.641991 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bc46e429-9ea9-4c28-ae84-b4afab1cf37a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:14.643227 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bc46e429-9ea9-4c28-ae84-b4afab1cf37a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:14.646179 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bc46e429-9ea9-4c28-ae84-b4afab1cf37a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:14.647288 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bc46e429-9ea9-4c28-ae84-b4afab1cf37a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:14.647995 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bc46e429-9ea9-4c28-ae84-b4afab1cf37a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:14.649380 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bc46e429-9ea9-4c28-ae84-b4afab1cf37a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:15.089927 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cc70114d-daa1-476a-a714-3ce31ef4a4c4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:15.108304 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cc70114d-daa1-476a-a714-3ce31ef4a4c4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:15.110298 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cc70114d-daa1-476a-a714-3ce31ef4a4c4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:15.113139 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cc70114d-daa1-476a-a714-3ce31ef4a4c4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1873 microversion: 2.42 time: 0.660181 Sep 16 13:02:15.129193 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1805/3512] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:02:14 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1873 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:02:15.144032 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e002f357-57dd-49db-b233-be006a5ed144 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:15.144684 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e002f357-57dd-49db-b233-be006a5ed144 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] [instance: 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:15.163141 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e002f357-57dd-49db-b233-be006a5ed144 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:15.164467 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e002f357-57dd-49db-b233-be006a5ed144 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:15.166636 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e002f357-57dd-49db-b233-be006a5ed144 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:15.170634 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e002f357-57dd-49db-b233-be006a5ed144 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:15.171985 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e002f357-57dd-49db-b233-be006a5ed144 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:15.173380 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e002f357-57dd-49db-b233-be006a5ed144 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:15.206156 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-bc46e429-9ea9-4c28-ae84-b4afab1cf37a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:15.219371 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-bc46e429-9ea9-4c28-ae84-b4afab1cf37a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c" status: 200 len: 1510 microversion: 2.1 time: 0.599140 Sep 16 13:02:15.227910 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1708/3513] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:14 2022] GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c => generated 1510 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:15.691282 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e002f357-57dd-49db-b233-be006a5ed144 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50f1d810ba34ef6a419d376f2b6c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82287f900aa34e05ba0e0cf7ba924585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:15.707533 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e002f357-57dd-49db-b233-be006a5ed144 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] 10.222.0.67 "GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8" status: 200 len: 1350 microversion: 2.1 time: 0.577094 Sep 16 13:02:15.710365 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1806/3514] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:15 2022] GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8 => generated 1350 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:16.152094 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-891fea93-c722-4801-b36f-fd47f52d325c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:16.152892 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-891fea93-c722-4801-b36f-fd47f52d325c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:16.164760 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-891fea93-c722-4801-b36f-fd47f52d325c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:16.166728 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-891fea93-c722-4801-b36f-fd47f52d325c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:16.167588 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-891fea93-c722-4801-b36f-fd47f52d325c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:16.168592 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-891fea93-c722-4801-b36f-fd47f52d325c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:16.169225 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-891fea93-c722-4801-b36f-fd47f52d325c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:16.169966 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-891fea93-c722-4801-b36f-fd47f52d325c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:16.256080 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dfba386b-3385-466c-8e8a-4db71a4ed94d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:16.257302 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dfba386b-3385-466c-8e8a-4db71a4ed94d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:16.265919 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfba386b-3385-466c-8e8a-4db71a4ed94d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:16.268766 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfba386b-3385-466c-8e8a-4db71a4ed94d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:16.269424 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfba386b-3385-466c-8e8a-4db71a4ed94d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:16.274240 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfba386b-3385-466c-8e8a-4db71a4ed94d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:16.275653 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfba386b-3385-466c-8e8a-4db71a4ed94d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:16.276418 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfba386b-3385-466c-8e8a-4db71a4ed94d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:17.515549 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dfba386b-3385-466c-8e8a-4db71a4ed94d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:17.533259 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dfba386b-3385-466c-8e8a-4db71a4ed94d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c" status: 200 len: 1510 microversion: 2.1 time: 1.280880 Sep 16 13:02:17.534654 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1807/3515] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:16 2022] GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c => generated 1510 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:17.539894 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-a3b1e658-0426-4992-8061-238b51bc5ea1 req-c6219496-5fc9-4711-8c87-7d24828e7290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "defaddc3-3750-4d8a-b18a-dd6fdce1dbbf", "name": "network-vif-plugged", "status": "completed", "tag": "8c121ccb-eba9-4b08-98af-afba73327fcc"}, {"server_uuid": "defaddc3-3750-4d8a-b18a-dd6fdce1dbbf", "name": "network-vif-plugged", "status": "completed", "tag": "9b032a10-f56e-47fc-b941-54f12778f01c"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:02:17.552840 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a3b1e658-0426-4992-8061-238b51bc5ea1 req-c6219496-5fc9-4711-8c87-7d24828e7290 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:17.553626 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a3b1e658-0426-4992-8061-238b51bc5ea1 req-c6219496-5fc9-4711-8c87-7d24828e7290 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:17.554652 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a3b1e658-0426-4992-8061-238b51bc5ea1 req-c6219496-5fc9-4711-8c87-7d24828e7290 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:17.574366 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-a3b1e658-0426-4992-8061-238b51bc5ea1 req-c6219496-5fc9-4711-8c87-7d24828e7290 service nova] Creating event network-vif-plugged:8c121ccb-eba9-4b08-98af-afba73327fcc for instance defaddc3-3750-4d8a-b18a-dd6fdce1dbbf on n-h1-858094-4 Sep 16 13:02:17.583099 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-a3b1e658-0426-4992-8061-238b51bc5ea1 req-c6219496-5fc9-4711-8c87-7d24828e7290 service nova] Creating event network-vif-plugged:9b032a10-f56e-47fc-b941-54f12778f01c for instance defaddc3-3750-4d8a-b18a-dd6fdce1dbbf on n-h1-858094-4 Sep 16 13:02:17.615579 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-a3b1e658-0426-4992-8061-238b51bc5ea1 req-c6219496-5fc9-4711-8c87-7d24828e7290 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.075575 Sep 16 13:02:17.617390 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1808/3516] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:02:17.631349 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d27bf2ad-5dd2-435f-a00e-03f88a125e5b tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:17.632595 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d27bf2ad-5dd2-435f-a00e-03f88a125e5b tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] [instance: 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:17.654393 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d27bf2ad-5dd2-435f-a00e-03f88a125e5b tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:17.654990 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d27bf2ad-5dd2-435f-a00e-03f88a125e5b tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:17.655539 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d27bf2ad-5dd2-435f-a00e-03f88a125e5b tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:17.656360 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d27bf2ad-5dd2-435f-a00e-03f88a125e5b tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:17.656863 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d27bf2ad-5dd2-435f-a00e-03f88a125e5b tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:17.657373 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d27bf2ad-5dd2-435f-a00e-03f88a125e5b tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:17.695765 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-891fea93-c722-4801-b36f-fd47f52d325c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:17.718758 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-891fea93-c722-4801-b36f-fd47f52d325c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:17.724946 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-891fea93-c722-4801-b36f-fd47f52d325c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:17.727182 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-891fea93-c722-4801-b36f-fd47f52d325c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1873 microversion: 2.42 time: 1.584038 Sep 16 13:02:17.729727 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1709/3517] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:02:16 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1873 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:02:18.043867 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d27bf2ad-5dd2-435f-a00e-03f88a125e5b tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50f1d810ba34ef6a419d376f2b6c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82287f900aa34e05ba0e0cf7ba924585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:18.052744 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d27bf2ad-5dd2-435f-a00e-03f88a125e5b tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] 10.222.0.67 "GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8" status: 200 len: 1350 microversion: 2.1 time: 0.433893 Sep 16 13:02:18.061638 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1809/3518] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:17 2022] GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8 => generated 1350 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:18.566970 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b3c62d4f-328d-48d1-81e4-476c004ca39c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:18.567719 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b3c62d4f-328d-48d1-81e4-476c004ca39c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:18.583279 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b3c62d4f-328d-48d1-81e4-476c004ca39c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:18.583793 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b3c62d4f-328d-48d1-81e4-476c004ca39c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:18.584326 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b3c62d4f-328d-48d1-81e4-476c004ca39c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:18.585093 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b3c62d4f-328d-48d1-81e4-476c004ca39c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:18.585738 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b3c62d4f-328d-48d1-81e4-476c004ca39c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:18.586171 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b3c62d4f-328d-48d1-81e4-476c004ca39c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:18.768325 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f115b0ea-c0a1-4ec2-a793-4bf063551103 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:18.769049 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f115b0ea-c0a1-4ec2-a793-4bf063551103 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:18.782447 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f115b0ea-c0a1-4ec2-a793-4bf063551103 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:18.783685 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f115b0ea-c0a1-4ec2-a793-4bf063551103 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:18.785125 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f115b0ea-c0a1-4ec2-a793-4bf063551103 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:18.786020 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f115b0ea-c0a1-4ec2-a793-4bf063551103 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:18.786980 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f115b0ea-c0a1-4ec2-a793-4bf063551103 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:18.787909 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f115b0ea-c0a1-4ec2-a793-4bf063551103 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:18.893938 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:02:18.956568 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:02:19.107286 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-b3c62d4f-328d-48d1-81e4-476c004ca39c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:19.149649 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b3c62d4f-328d-48d1-81e4-476c004ca39c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c" status: 200 len: 1510 microversion: 2.1 time: 0.582187 Sep 16 13:02:19.150233 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1710/3519] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:18 2022] GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c => generated 1510 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:19.156278 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3506e876-f916-4fdd-a462-4ccd87b81fa3 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:19.159590 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3506e876-f916-4fdd-a462-4ccd87b81fa3 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] [instance: 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:19.196818 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3506e876-f916-4fdd-a462-4ccd87b81fa3 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:19.198986 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3506e876-f916-4fdd-a462-4ccd87b81fa3 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:19.202845 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3506e876-f916-4fdd-a462-4ccd87b81fa3 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:19.205959 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3506e876-f916-4fdd-a462-4ccd87b81fa3 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:19.207271 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3506e876-f916-4fdd-a462-4ccd87b81fa3 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:19.209019 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3506e876-f916-4fdd-a462-4ccd87b81fa3 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:19.302389 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=100 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:02:19.439085 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f115b0ea-c0a1-4ec2-a793-4bf063551103 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:19.468306 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f115b0ea-c0a1-4ec2-a793-4bf063551103 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:19.472909 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f115b0ea-c0a1-4ec2-a793-4bf063551103 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:19.483366 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f115b0ea-c0a1-4ec2-a793-4bf063551103 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1873 microversion: 2.42 time: 0.720485 Sep 16 13:02:19.486620 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1810/3520] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:02:18 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1873 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:02:19.513106 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-db2a85e1-65ef-4abd-9988-045b22a85ade tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] Calling method '.version_select at 0x7f1039a238b0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:19.614822 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3506e876-f916-4fdd-a462-4ccd87b81fa3 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50f1d810ba34ef6a419d376f2b6c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82287f900aa34e05ba0e0cf7ba924585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:19.636811 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3506e876-f916-4fdd-a462-4ccd87b81fa3 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] 10.222.0.67 "GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8" status: 200 len: 1350 microversion: 2.1 time: 0.477880 Sep 16 13:02:19.645697 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1711/3521] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:19 2022] GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8 => generated 1350 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:19.673455 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-db2a85e1-65ef-4abd-9988-045b22a85ade tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] 10.222.0.67 "GET /compute/v2.1/images/e0e6bcef-c132-41cd-8e3f-18405c3e639d" status: 200 len: 636 microversion: 2.1 time: 0.185418 Sep 16 13:02:19.674864 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1811/3522] 10.222.0.67 () {58 vars in 1233 bytes} [Fri Sep 16 13:02:19 2022] GET /compute/v2.1/images/e0e6bcef-c132-41cd-8e3f-18405c3e639d => generated 636 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:02:19.693105 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-65fc8049-299b-45b8-bacb-84cc57040383 tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] Action: 'update_all', calling method: .version_select at 0x7f1035bad4c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:02:19.818811 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-65fc8049-299b-45b8-bacb-84cc57040383 tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] Getting quotas for project f7c3266916f645e0a50d6f110a749bb2. Resources: dict_keys(['metadata_items']) {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:02:19.828168 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-65fc8049-299b-45b8-bacb-84cc57040383 tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] Getting quotas for user 28158ee3021f40d8baedca1f953d4da7 and project f7c3266916f645e0a50d6f110a749bb2. Resources: dict_keys(['metadata_items']) {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:02:19.846011 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-b0231a2a-b30b-42ec-b81b-b2d309bfb9ef req-902c2093-0ab8-4980-88cb-154a0e794be8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64cebb2a-47ea-4fac-ac5d-24bb6311d8e8", "name": "network-vif-plugged", "status": "completed", "tag": "b7230234-bb6e-4e87-88c3-bcd278e26f85"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:02:19.880760 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b0231a2a-b30b-42ec-b81b-b2d309bfb9ef req-902c2093-0ab8-4980-88cb-154a0e794be8 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:19.894564 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b0231a2a-b30b-42ec-b81b-b2d309bfb9ef req-902c2093-0ab8-4980-88cb-154a0e794be8 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:19.895120 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b0231a2a-b30b-42ec-b81b-b2d309bfb9ef req-902c2093-0ab8-4980-88cb-154a0e794be8 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:19.936063 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-b0231a2a-b30b-42ec-b81b-b2d309bfb9ef req-902c2093-0ab8-4980-88cb-154a0e794be8 service nova] Creating event network-vif-plugged:b7230234-bb6e-4e87-88c3-bcd278e26f85 for instance 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8 on n-h1-858094-4 Sep 16 13:02:19.954871 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-b0231a2a-b30b-42ec-b81b-b2d309bfb9ef req-902c2093-0ab8-4980-88cb-154a0e794be8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113913 Sep 16 13:02:19.957907 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1812/3523] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:02:20.182209 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9ade8c68-e412-4f7e-a84f-d0207d5f6d6c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:20.191162 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9ade8c68-e412-4f7e-a84f-d0207d5f6d6c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:20.207371 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ade8c68-e412-4f7e-a84f-d0207d5f6d6c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:20.209570 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ade8c68-e412-4f7e-a84f-d0207d5f6d6c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:20.211675 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ade8c68-e412-4f7e-a84f-d0207d5f6d6c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:20.213390 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ade8c68-e412-4f7e-a84f-d0207d5f6d6c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:20.214408 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ade8c68-e412-4f7e-a84f-d0207d5f6d6c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:20.216165 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ade8c68-e412-4f7e-a84f-d0207d5f6d6c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:20.453847 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-65fc8049-299b-45b8-bacb-84cc57040383 tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] 10.222.0.67 "PUT /compute/v2.1/images/e0e6bcef-c132-41cd-8e3f-18405c3e639d/metadata" status: 200 len: 61 microversion: 2.1 time: 0.767150 Sep 16 13:02:20.455895 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1712/3524] 10.222.0.67 () {60 vars in 1280 bytes} [Fri Sep 16 13:02:19 2022] PUT /compute/v2.1/images/e0e6bcef-c132-41cd-8e3f-18405c3e639d/metadata => generated 61 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:02:20.468930 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d6e66b82-e7cf-4578-84e6-b294dd279ade tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] Calling method '.version_select at 0x7f10349dc940>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:20.648881 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9ade8c68-e412-4f7e-a84f-d0207d5f6d6c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:20.661679 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9ade8c68-e412-4f7e-a84f-d0207d5f6d6c tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c" status: 200 len: 1510 microversion: 2.1 time: 0.483654 Sep 16 13:02:20.663685 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1813/3525] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:20 2022] GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c => generated 1510 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:20.681549 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c4a2d9ba-351e-4e0b-86c0-cc49ee86eca5 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:20.682610 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c4a2d9ba-351e-4e0b-86c0-cc49ee86eca5 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:20.699879 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4a2d9ba-351e-4e0b-86c0-cc49ee86eca5 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:20.702147 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4a2d9ba-351e-4e0b-86c0-cc49ee86eca5 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:20.703303 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4a2d9ba-351e-4e0b-86c0-cc49ee86eca5 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:20.708792 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4a2d9ba-351e-4e0b-86c0-cc49ee86eca5 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:20.710320 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4a2d9ba-351e-4e0b-86c0-cc49ee86eca5 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:20.710772 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4a2d9ba-351e-4e0b-86c0-cc49ee86eca5 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:21.090903 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c4a2d9ba-351e-4e0b-86c0-cc49ee86eca5 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:21.106779 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c4a2d9ba-351e-4e0b-86c0-cc49ee86eca5 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:21.108676 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c4a2d9ba-351e-4e0b-86c0-cc49ee86eca5 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:21.110424 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c4a2d9ba-351e-4e0b-86c0-cc49ee86eca5 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1873 microversion: 2.42 time: 0.445216 Sep 16 13:02:21.111693 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1814/3526] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:02:20 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1873 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:02:21.117310 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-96a2dcad-d66d-45f5-9892-8fb6fee2dbcc tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:21.118128 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-96a2dcad-d66d-45f5-9892-8fb6fee2dbcc tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] [instance: 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:21.126761 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96a2dcad-d66d-45f5-9892-8fb6fee2dbcc tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:21.127514 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96a2dcad-d66d-45f5-9892-8fb6fee2dbcc tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:21.128878 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96a2dcad-d66d-45f5-9892-8fb6fee2dbcc tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:21.130265 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96a2dcad-d66d-45f5-9892-8fb6fee2dbcc tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:21.131006 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96a2dcad-d66d-45f5-9892-8fb6fee2dbcc tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:21.131605 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96a2dcad-d66d-45f5-9892-8fb6fee2dbcc tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:21.208454 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d6e66b82-e7cf-4578-84e6-b294dd279ade tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] 10.222.0.67 "DELETE /compute/v2.1/images/e0e6bcef-c132-41cd-8e3f-18405c3e639d/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.746527 Sep 16 13:02:21.209052 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1713/3527] 10.222.0.67 () {58 vars in 1296 bytes} [Fri Sep 16 13:02:20 2022] DELETE /compute/v2.1/images/e0e6bcef-c132-41cd-8e3f-18405c3e639d/metadata/os_version => generated 0 bytes in 749 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:02:21.218531 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b6c5a532-e937-48f9-b586-d03b6b249468 tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] Calling method '.version_select at 0x7f10349345e0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:21.342077 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b6c5a532-e937-48f9-b586-d03b6b249468 tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] 10.222.0.67 "GET /compute/v2.1/images/e0e6bcef-c132-41cd-8e3f-18405c3e639d/metadata" status: 200 len: 37 microversion: 2.1 time: 0.122486 Sep 16 13:02:21.343297 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1714/3528] 10.222.0.67 () {58 vars in 1260 bytes} [Fri Sep 16 13:02:21 2022] GET /compute/v2.1/images/e0e6bcef-c132-41cd-8e3f-18405c3e639d/metadata => generated 37 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:02:21.357955 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-26820b28-3c5c-45e5-a4f4-0a7e16e4bac8 tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] Action: 'update_all', calling method: .version_select at 0x7f1034b37550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:02:21.458162 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-96a2dcad-d66d-45f5-9892-8fb6fee2dbcc tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50f1d810ba34ef6a419d376f2b6c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82287f900aa34e05ba0e0cf7ba924585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:21.467827 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-96a2dcad-d66d-45f5-9892-8fb6fee2dbcc tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] 10.222.0.67 "GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8" status: 200 len: 1350 microversion: 2.1 time: 0.354816 Sep 16 13:02:21.468607 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-26820b28-3c5c-45e5-a4f4-0a7e16e4bac8 tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] Getting quotas for project f7c3266916f645e0a50d6f110a749bb2. Resources: dict_keys(['metadata_items']) {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:02:21.475390 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1815/3529] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:21 2022] GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8 => generated 1350 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:21.484413 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-26820b28-3c5c-45e5-a4f4-0a7e16e4bac8 tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] Getting quotas for user 28158ee3021f40d8baedca1f953d4da7 and project f7c3266916f645e0a50d6f110a749bb2. Resources: dict_keys(['metadata_items']) {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:02:21.690553 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7ec30c7e-72b2-4aa5-90e5-63c01890fac4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:21.691326 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7ec30c7e-72b2-4aa5-90e5-63c01890fac4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:21.704891 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ec30c7e-72b2-4aa5-90e5-63c01890fac4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:21.705639 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ec30c7e-72b2-4aa5-90e5-63c01890fac4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:21.706905 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ec30c7e-72b2-4aa5-90e5-63c01890fac4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:21.708244 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ec30c7e-72b2-4aa5-90e5-63c01890fac4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:21.710520 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ec30c7e-72b2-4aa5-90e5-63c01890fac4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:21.716227 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ec30c7e-72b2-4aa5-90e5-63c01890fac4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:22.041579 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7ec30c7e-72b2-4aa5-90e5-63c01890fac4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:22.058120 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7ec30c7e-72b2-4aa5-90e5-63c01890fac4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c" status: 200 len: 1510 microversion: 2.1 time: 0.372764 Sep 16 13:02:22.060644 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1816/3530] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:21 2022] GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c => generated 1510 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:02:22.068937 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-1d4641b8-5461-4066-beb8-d7392d0bb97c req-3b026c86-22d7-4b96-b860-f7f2a1d13f58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "defaddc3-3750-4d8a-b18a-dd6fdce1dbbf", "name": "network-vif-plugged", "status": "completed", "tag": "8a23d825-e263-4839-8617-11f3b05818ce"}, {"server_uuid": "defaddc3-3750-4d8a-b18a-dd6fdce1dbbf", "name": "network-vif-plugged", "status": "completed", "tag": "c7eb5869-5d95-47b8-9539-2bec50eb4428"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:02:22.090629 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1d4641b8-5461-4066-beb8-d7392d0bb97c req-3b026c86-22d7-4b96-b860-f7f2a1d13f58 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:22.092333 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1d4641b8-5461-4066-beb8-d7392d0bb97c req-3b026c86-22d7-4b96-b860-f7f2a1d13f58 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:22.093826 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1d4641b8-5461-4066-beb8-d7392d0bb97c req-3b026c86-22d7-4b96-b860-f7f2a1d13f58 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:22.102317 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:02:22.125222 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-1d4641b8-5461-4066-beb8-d7392d0bb97c req-3b026c86-22d7-4b96-b860-f7f2a1d13f58 service nova] Creating event network-vif-plugged:8a23d825-e263-4839-8617-11f3b05818ce for instance defaddc3-3750-4d8a-b18a-dd6fdce1dbbf on n-h1-858094-4 Sep 16 13:02:22.126000 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-1d4641b8-5461-4066-beb8-d7392d0bb97c req-3b026c86-22d7-4b96-b860-f7f2a1d13f58 service nova] Creating event network-vif-plugged:c7eb5869-5d95-47b8-9539-2bec50eb4428 for instance defaddc3-3750-4d8a-b18a-dd6fdce1dbbf on n-h1-858094-4 Sep 16 13:02:22.139983 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-1d4641b8-5461-4066-beb8-d7392d0bb97c req-3b026c86-22d7-4b96-b860-f7f2a1d13f58 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.077654 Sep 16 13:02:22.142899 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1817/3531] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:02:22.146285 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-26820b28-3c5c-45e5-a4f4-0a7e16e4bac8 tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] 10.222.0.67 "PUT /compute/v2.1/images/e0e6bcef-c132-41cd-8e3f-18405c3e639d/metadata" status: 200 len: 61 microversion: 2.1 time: 0.795058 Sep 16 13:02:22.147186 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1715/3532] 10.222.0.67 () {60 vars in 1280 bytes} [Fri Sep 16 13:02:21 2022] PUT /compute/v2.1/images/e0e6bcef-c132-41cd-8e3f-18405c3e639d/metadata => generated 61 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:02:22.149740 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b4d64a29-9a52-42e1-a323-7bbf4d6185ae tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:22.150497 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b4d64a29-9a52-42e1-a323-7bbf4d6185ae tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:22.160990 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-79b816ee-aa7a-4323-bcd3-4b03b671ec53 tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] Calling method '.version_select at 0x7f1034935ca0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:22.162924 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4d64a29-9a52-42e1-a323-7bbf4d6185ae tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:22.163979 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4d64a29-9a52-42e1-a323-7bbf4d6185ae tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:22.164503 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4d64a29-9a52-42e1-a323-7bbf4d6185ae tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:22.165224 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4d64a29-9a52-42e1-a323-7bbf4d6185ae tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:22.165683 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4d64a29-9a52-42e1-a323-7bbf4d6185ae tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:22.166244 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4d64a29-9a52-42e1-a323-7bbf4d6185ae tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:22.216888 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-79b816ee-aa7a-4323-bcd3-4b03b671ec53 tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] 10.222.0.67 "GET /compute/v2.1/images/e0e6bcef-c132-41cd-8e3f-18405c3e639d/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.064185 Sep 16 13:02:22.217553 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1716/3533] 10.222.0.67 () {58 vars in 1290 bytes} [Fri Sep 16 13:02:22 2022] GET /compute/v2.1/images/e0e6bcef-c132-41cd-8e3f-18405c3e639d/metadata/os_distro => generated 33 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 16 13:02:22.231539 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a48ebd07-7bc5-4bfc-aeb6-b3fe50969bcb tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] Action: 'update_all', calling method: .version_select at 0x7f10349dc280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:02:22.330330 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-a48ebd07-7bc5-4bfc-aeb6-b3fe50969bcb tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] Getting quotas for project f7c3266916f645e0a50d6f110a749bb2. Resources: dict_keys(['metadata_items']) {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:02:22.349192 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-a48ebd07-7bc5-4bfc-aeb6-b3fe50969bcb tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] Getting quotas for user 28158ee3021f40d8baedca1f953d4da7 and project f7c3266916f645e0a50d6f110a749bb2. Resources: dict_keys(['metadata_items']) {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:02:22.660610 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b4d64a29-9a52-42e1-a323-7bbf4d6185ae tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:22.667934 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a48ebd07-7bc5-4bfc-aeb6-b3fe50969bcb tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] 10.222.0.67 "PUT /compute/v2.1/images/e0e6bcef-c132-41cd-8e3f-18405c3e639d/metadata" status: 200 len: 61 microversion: 2.1 time: 0.441280 Sep 16 13:02:22.669424 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1717/3534] 10.222.0.67 () {60 vars in 1280 bytes} [Fri Sep 16 13:02:22 2022] PUT /compute/v2.1/images/e0e6bcef-c132-41cd-8e3f-18405c3e639d/metadata => generated 61 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:02:22.674014 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2e30827c-bf0c-46b3-aecd-02203e3a3228 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:22.676245 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-2e30827c-bf0c-46b3-aecd-02203e3a3228 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] [instance: 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:22.683723 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b4d64a29-9a52-42e1-a323-7bbf4d6185ae tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:22.685963 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b4d64a29-9a52-42e1-a323-7bbf4d6185ae tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:22.687189 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b4d64a29-9a52-42e1-a323-7bbf4d6185ae tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1873 microversion: 2.42 time: 0.542972 Sep 16 13:02:22.691105 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1818/3535] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:02:22 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1873 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:02:22.692419 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2e30827c-bf0c-46b3-aecd-02203e3a3228 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:22.693101 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2e30827c-bf0c-46b3-aecd-02203e3a3228 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:22.693725 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2e30827c-bf0c-46b3-aecd-02203e3a3228 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:22.694608 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2e30827c-bf0c-46b3-aecd-02203e3a3228 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:22.695394 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2e30827c-bf0c-46b3-aecd-02203e3a3228 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:22.695984 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2e30827c-bf0c-46b3-aecd-02203e3a3228 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:22.712584 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e7172b2f-e280-4611-9081-9a0206b432c4 tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] Calling method '.version_select at 0x7f1034b413a0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:22.837806 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e7172b2f-e280-4611-9081-9a0206b432c4 tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] 10.222.0.67 "GET /compute/v2.1/images/e0e6bcef-c132-41cd-8e3f-18405c3e639d/metadata" status: 200 len: 61 microversion: 2.1 time: 0.145330 Sep 16 13:02:22.848687 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1819/3536] 10.222.0.67 () {58 vars in 1260 bytes} [Fri Sep 16 13:02:22 2022] GET /compute/v2.1/images/e0e6bcef-c132-41cd-8e3f-18405c3e639d/metadata => generated 61 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:02:22.855415 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3e151909-c4b3-45d3-8b95-40c647abbb46 tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] Action: 'update_all', calling method: .version_select at 0x7f10356328b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:02:22.925432 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-3e151909-c4b3-45d3-8b95-40c647abbb46 tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] Getting quotas for project f7c3266916f645e0a50d6f110a749bb2. Resources: dict_keys(['metadata_items']) {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:02:22.932782 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-3e151909-c4b3-45d3-8b95-40c647abbb46 tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] Getting quotas for user 28158ee3021f40d8baedca1f953d4da7 and project f7c3266916f645e0a50d6f110a749bb2. Resources: dict_keys(['metadata_items']) {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:02:22.994403 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-2e30827c-bf0c-46b3-aecd-02203e3a3228 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50f1d810ba34ef6a419d376f2b6c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82287f900aa34e05ba0e0cf7ba924585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:23.013701 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2e30827c-bf0c-46b3-aecd-02203e3a3228 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] 10.222.0.67 "GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8" status: 200 len: 1540 microversion: 2.1 time: 0.336387 Sep 16 13:02:23.014354 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1718/3537] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:22 2022] GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8 => generated 1540 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:23.056221 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c00fe851-7548-460e-9e5a-7efc7519d077 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:23.056731 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c00fe851-7548-460e-9e5a-7efc7519d077 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] [instance: 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:23.078206 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c00fe851-7548-460e-9e5a-7efc7519d077 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:23.080323 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c00fe851-7548-460e-9e5a-7efc7519d077 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:23.081484 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c00fe851-7548-460e-9e5a-7efc7519d077 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:23.086985 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c00fe851-7548-460e-9e5a-7efc7519d077 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:23.088388 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c00fe851-7548-460e-9e5a-7efc7519d077 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:23.089861 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c00fe851-7548-460e-9e5a-7efc7519d077 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:23.234655 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3e151909-c4b3-45d3-8b95-40c647abbb46 tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] 10.222.0.67 "PUT /compute/v2.1/images/e0e6bcef-c132-41cd-8e3f-18405c3e639d/metadata" status: 200 len: 61 microversion: 2.1 time: 0.384384 Sep 16 13:02:23.245645 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1820/3538] 10.222.0.67 () {60 vars in 1280 bytes} [Fri Sep 16 13:02:22 2022] PUT /compute/v2.1/images/e0e6bcef-c132-41cd-8e3f-18405c3e639d/metadata => generated 61 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:02:23.254350 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b3bf09fc-18d5-41fe-b3d3-eb9dec62f113 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:23.267381 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b3bf09fc-18d5-41fe-b3d3-eb9dec62f113 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:23.288494 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3bf09fc-18d5-41fe-b3d3-eb9dec62f113 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:23.288999 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3bf09fc-18d5-41fe-b3d3-eb9dec62f113 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:23.289446 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3bf09fc-18d5-41fe-b3d3-eb9dec62f113 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:23.290163 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3bf09fc-18d5-41fe-b3d3-eb9dec62f113 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:23.290626 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3bf09fc-18d5-41fe-b3d3-eb9dec62f113 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:23.291059 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3bf09fc-18d5-41fe-b3d3-eb9dec62f113 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:23.324290 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c00fe851-7548-460e-9e5a-7efc7519d077 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] 10.222.0.67 "GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.281675 Sep 16 13:02:23.325723 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1719/3539] 10.222.0.67 () {58 vars in 1275 bytes} [Fri Sep 16 13:02:23 2022] GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8/os-interface => generated 284 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:02:23.339875 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0f8c5bce-4a44-4eb6-9fba-442b8d7bc975 tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] Action: 'update_all', calling method: .version_select at 0x7f103499d5e0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:02:23.440208 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-0f8c5bce-4a44-4eb6-9fba-442b8d7bc975 tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] Getting quotas for project f7c3266916f645e0a50d6f110a749bb2. Resources: dict_keys(['metadata_items']) {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:02:23.448407 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-0f8c5bce-4a44-4eb6-9fba-442b8d7bc975 tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] Getting quotas for user 28158ee3021f40d8baedca1f953d4da7 and project f7c3266916f645e0a50d6f110a749bb2. Resources: dict_keys(['metadata_items']) {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:02:23.779362 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b3bf09fc-18d5-41fe-b3d3-eb9dec62f113 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:23.792220 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b3bf09fc-18d5-41fe-b3d3-eb9dec62f113 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c" status: 200 len: 1510 microversion: 2.1 time: 0.540495 Sep 16 13:02:23.794833 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1821/3540] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:23 2022] GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c => generated 1510 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:23.808110 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1c1a439c-f1c8-41fa-b4fb-6a3e5bc8d5cf tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:23.810045 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1c1a439c-f1c8-41fa-b4fb-6a3e5bc8d5cf tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:23.826986 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c1a439c-f1c8-41fa-b4fb-6a3e5bc8d5cf tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:23.827875 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c1a439c-f1c8-41fa-b4fb-6a3e5bc8d5cf tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:23.828595 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c1a439c-f1c8-41fa-b4fb-6a3e5bc8d5cf tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:23.832174 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c1a439c-f1c8-41fa-b4fb-6a3e5bc8d5cf tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:23.833244 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c1a439c-f1c8-41fa-b4fb-6a3e5bc8d5cf tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:23.835595 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c1a439c-f1c8-41fa-b4fb-6a3e5bc8d5cf tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:24.342152 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0f8c5bce-4a44-4eb6-9fba-442b8d7bc975 tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] 10.222.0.67 "PUT /compute/v2.1/images/e0e6bcef-c132-41cd-8e3f-18405c3e639d/metadata" status: 200 len: 64 microversion: 2.1 time: 1.012008 Sep 16 13:02:24.342891 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1720/3541] 10.222.0.67 () {60 vars in 1280 bytes} [Fri Sep 16 13:02:23 2022] PUT /compute/v2.1/images/e0e6bcef-c132-41cd-8e3f-18405c3e639d/metadata => generated 64 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:02:24.351943 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-f8070f8b-5bee-4d4d-a3ae-f956c5714b1c req-3ba25b5a-82ea-47d0-8cea-05aee185ebfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "defaddc3-3750-4d8a-b18a-dd6fdce1dbbf", "name": "network-vif-plugged", "status": "completed", "tag": "96ec0261-1181-470b-971b-163682a9e81d"}, {"server_uuid": "defaddc3-3750-4d8a-b18a-dd6fdce1dbbf", "name": "network-vif-plugged", "status": "completed", "tag": "8874748b-6030-4aea-9e6b-79db8c8d555d"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:02:24.364885 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=100 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:02:24.376730 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-f8070f8b-5bee-4d4d-a3ae-f956c5714b1c req-3ba25b5a-82ea-47d0-8cea-05aee185ebfd service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:24.380797 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-f8070f8b-5bee-4d4d-a3ae-f956c5714b1c req-3ba25b5a-82ea-47d0-8cea-05aee185ebfd service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:24.383786 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-f8070f8b-5bee-4d4d-a3ae-f956c5714b1c req-3ba25b5a-82ea-47d0-8cea-05aee185ebfd service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:24.386425 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1c1a439c-f1c8-41fa-b4fb-6a3e5bc8d5cf tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:24.405883 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1c1a439c-f1c8-41fa-b4fb-6a3e5bc8d5cf tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:24.411471 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1c1a439c-f1c8-41fa-b4fb-6a3e5bc8d5cf tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:24.413024 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1c1a439c-f1c8-41fa-b4fb-6a3e5bc8d5cf tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1873 microversion: 2.42 time: 0.616936 Sep 16 13:02:24.415491 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-f8070f8b-5bee-4d4d-a3ae-f956c5714b1c req-3ba25b5a-82ea-47d0-8cea-05aee185ebfd service nova] Creating event network-vif-plugged:96ec0261-1181-470b-971b-163682a9e81d for instance defaddc3-3750-4d8a-b18a-dd6fdce1dbbf on n-h1-858094-4 Sep 16 13:02:24.416528 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-f8070f8b-5bee-4d4d-a3ae-f956c5714b1c req-3ba25b5a-82ea-47d0-8cea-05aee185ebfd service nova] Creating event network-vif-plugged:8874748b-6030-4aea-9e6b-79db8c8d555d for instance defaddc3-3750-4d8a-b18a-dd6fdce1dbbf on n-h1-858094-4 Sep 16 13:02:24.422511 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1822/3542] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:02:23 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1873 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:02:24.427865 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-f8070f8b-5bee-4d4d-a3ae-f956c5714b1c req-3ba25b5a-82ea-47d0-8cea-05aee185ebfd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.083381 Sep 16 13:02:24.435130 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1721/3543] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:02:24.436756 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ed1e896f-b13e-4c34-aa8c-8f58d0e60e7b tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] Calling method '.version_select at 0x7f1035681700>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:24.515269 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ed1e896f-b13e-4c34-aa8c-8f58d0e60e7b tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] 10.222.0.67 "GET /compute/v2.1/images/e0e6bcef-c132-41cd-8e3f-18405c3e639d/metadata" status: 200 len: 64 microversion: 2.1 time: 0.091547 Sep 16 13:02:24.515850 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1823/3544] 10.222.0.67 () {58 vars in 1260 bytes} [Fri Sep 16 13:02:24 2022] GET /compute/v2.1/images/e0e6bcef-c132-41cd-8e3f-18405c3e639d/metadata => generated 64 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:02:24.527462 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8f9fe61b-03df-463d-96eb-bb3c2569ea42 tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] Action: 'update_all', calling method: .version_select at 0x7f10348e4820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:02:24.607903 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-8f9fe61b-03df-463d-96eb-bb3c2569ea42 tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] Getting quotas for project f7c3266916f645e0a50d6f110a749bb2. Resources: dict_keys(['metadata_items']) {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:02:24.626011 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-8f9fe61b-03df-463d-96eb-bb3c2569ea42 tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] Getting quotas for user 28158ee3021f40d8baedca1f953d4da7 and project f7c3266916f645e0a50d6f110a749bb2. Resources: dict_keys(['metadata_items']) {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:02:24.818482 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-07d92b61-1cb1-414e-9dd8-e144eef3e8ba tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:24.818738 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-07d92b61-1cb1-414e-9dd8-e144eef3e8ba tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:24.846106 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07d92b61-1cb1-414e-9dd8-e144eef3e8ba tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:24.848928 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07d92b61-1cb1-414e-9dd8-e144eef3e8ba tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:24.851087 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07d92b61-1cb1-414e-9dd8-e144eef3e8ba tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:24.852051 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07d92b61-1cb1-414e-9dd8-e144eef3e8ba tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:24.853757 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07d92b61-1cb1-414e-9dd8-e144eef3e8ba tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:24.854203 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07d92b61-1cb1-414e-9dd8-e144eef3e8ba tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:25.197143 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8f9fe61b-03df-463d-96eb-bb3c2569ea42 tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] 10.222.0.67 "PUT /compute/v2.1/images/e0e6bcef-c132-41cd-8e3f-18405c3e639d/metadata" status: 200 len: 61 microversion: 2.1 time: 0.672575 Sep 16 13:02:25.198355 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1722/3545] 10.222.0.67 () {60 vars in 1280 bytes} [Fri Sep 16 13:02:24 2022] PUT /compute/v2.1/images/e0e6bcef-c132-41cd-8e3f-18405c3e639d/metadata => generated 61 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:02:25.210777 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-678b679d-1560-4778-87d7-0e4a9609e170 tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] Action: 'update', calling method: .version_select at 0x7f1034947ca0>, body: {"meta": {"os_version": "alt"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:02:25.303307 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-678b679d-1560-4778-87d7-0e4a9609e170 tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] Getting quotas for project f7c3266916f645e0a50d6f110a749bb2. Resources: dict_keys(['metadata_items']) {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:02:25.313447 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-678b679d-1560-4778-87d7-0e4a9609e170 tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] Getting quotas for user 28158ee3021f40d8baedca1f953d4da7 and project f7c3266916f645e0a50d6f110a749bb2. Resources: dict_keys(['metadata_items']) {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:02:25.672296 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-07d92b61-1cb1-414e-9dd8-e144eef3e8ba tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:25.681886 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-07d92b61-1cb1-414e-9dd8-e144eef3e8ba tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c" status: 200 len: 1510 microversion: 2.1 time: 0.868097 Sep 16 13:02:25.693255 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1824/3546] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:24 2022] GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c => generated 1510 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:02:25.698381 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-22d9ca42-e8c2-446f-912a-6fa90cf66430 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:25.699245 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-22d9ca42-e8c2-446f-912a-6fa90cf66430 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:25.713882 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22d9ca42-e8c2-446f-912a-6fa90cf66430 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:25.718874 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22d9ca42-e8c2-446f-912a-6fa90cf66430 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:25.719721 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22d9ca42-e8c2-446f-912a-6fa90cf66430 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:25.720765 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22d9ca42-e8c2-446f-912a-6fa90cf66430 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:25.721505 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22d9ca42-e8c2-446f-912a-6fa90cf66430 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:25.722161 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22d9ca42-e8c2-446f-912a-6fa90cf66430 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:26.065495 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-678b679d-1560-4778-87d7-0e4a9609e170 tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] 10.222.0.67 "PUT /compute/v2.1/images/e0e6bcef-c132-41cd-8e3f-18405c3e639d/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.859097 Sep 16 13:02:26.067067 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1723/3547] 10.222.0.67 () {60 vars in 1313 bytes} [Fri Sep 16 13:02:25 2022] PUT /compute/v2.1/images/e0e6bcef-c132-41cd-8e3f-18405c3e639d/metadata/os_version => generated 31 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:02:26.079005 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-af6da4cf-0499-49d0-adbd-e519b9eb8f88 req-47366c4b-acbe-450e-a4fd-787b4e6cf774 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64cebb2a-47ea-4fac-ac5d-24bb6311d8e8", "tag": "b7230234-bb6e-4e87-88c3-bcd278e26f85"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:02:26.115959 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-af6da4cf-0499-49d0-adbd-e519b9eb8f88 req-47366c4b-acbe-450e-a4fd-787b4e6cf774 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:26.117412 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-af6da4cf-0499-49d0-adbd-e519b9eb8f88 req-47366c4b-acbe-450e-a4fd-787b4e6cf774 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:26.117944 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-af6da4cf-0499-49d0-adbd-e519b9eb8f88 req-47366c4b-acbe-450e-a4fd-787b4e6cf774 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:26.161737 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-af6da4cf-0499-49d0-adbd-e519b9eb8f88 req-47366c4b-acbe-450e-a4fd-787b4e6cf774 service nova] Creating event network-changed:b7230234-bb6e-4e87-88c3-bcd278e26f85 for instance 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8 on n-h1-858094-4 Sep 16 13:02:26.193727 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-af6da4cf-0499-49d0-adbd-e519b9eb8f88 req-47366c4b-acbe-450e-a4fd-787b4e6cf774 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125295 Sep 16 13:02:26.195454 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1724/3548] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:02:26.205392 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-92eefc85-5bca-48e3-a1b0-a858239228ae tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] Calling method '.version_select at 0x7f10348ea5e0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:26.330158 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-92eefc85-5bca-48e3-a1b0-a858239228ae tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] 10.222.0.67 "GET /compute/v2.1/images/e0e6bcef-c132-41cd-8e3f-18405c3e639d/metadata" status: 200 len: 58 microversion: 2.1 time: 0.132980 Sep 16 13:02:26.347553 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1725/3549] 10.222.0.67 () {58 vars in 1260 bytes} [Fri Sep 16 13:02:26 2022] GET /compute/v2.1/images/e0e6bcef-c132-41cd-8e3f-18405c3e639d/metadata => generated 58 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:02:26.370563 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f550b1fb-d120-4ae1-83c7-26c27c0f6b3f tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] Action: 'update_all', calling method: .version_select at 0x7f10348e3a60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:02:26.452496 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-22d9ca42-e8c2-446f-912a-6fa90cf66430 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:26.464037 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-22d9ca42-e8c2-446f-912a-6fa90cf66430 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:26.478239 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-22d9ca42-e8c2-446f-912a-6fa90cf66430 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:26.482240 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-22d9ca42-e8c2-446f-912a-6fa90cf66430 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1873 microversion: 2.42 time: 0.785265 Sep 16 13:02:26.510088 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1825/3550] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:02:25 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1873 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:02:26.542400 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-f550b1fb-d120-4ae1-83c7-26c27c0f6b3f tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] Getting quotas for project f7c3266916f645e0a50d6f110a749bb2. Resources: dict_keys(['metadata_items']) {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:02:26.556758 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-f550b1fb-d120-4ae1-83c7-26c27c0f6b3f tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] Getting quotas for user 28158ee3021f40d8baedca1f953d4da7 and project f7c3266916f645e0a50d6f110a749bb2. Resources: dict_keys(['metadata_items']) {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:02:26.727725 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7b29360f-c74e-4a31-8cd5-ad88b2fe6ff6 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:26.728381 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7b29360f-c74e-4a31-8cd5-ad88b2fe6ff6 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:26.742985 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b29360f-c74e-4a31-8cd5-ad88b2fe6ff6 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:26.743804 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b29360f-c74e-4a31-8cd5-ad88b2fe6ff6 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:26.756201 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b29360f-c74e-4a31-8cd5-ad88b2fe6ff6 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:26.760327 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b29360f-c74e-4a31-8cd5-ad88b2fe6ff6 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:26.762916 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b29360f-c74e-4a31-8cd5-ad88b2fe6ff6 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:26.764106 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b29360f-c74e-4a31-8cd5-ad88b2fe6ff6 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:27.229952 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7b29360f-c74e-4a31-8cd5-ad88b2fe6ff6 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:27.260191 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7b29360f-c74e-4a31-8cd5-ad88b2fe6ff6 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c" status: 200 len: 1510 microversion: 2.1 time: 0.541422 Sep 16 13:02:27.273847 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1826/3551] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:26 2022] GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c => generated 1510 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:02:27.480092 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f550b1fb-d120-4ae1-83c7-26c27c0f6b3f tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] 10.222.0.67 "PUT /compute/v2.1/images/e0e6bcef-c132-41cd-8e3f-18405c3e639d/metadata" status: 200 len: 61 microversion: 2.1 time: 1.125493 Sep 16 13:02:27.488503 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1726/3552] 10.222.0.67 () {60 vars in 1280 bytes} [Fri Sep 16 13:02:26 2022] PUT /compute/v2.1/images/e0e6bcef-c132-41cd-8e3f-18405c3e639d/metadata => generated 61 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:02:27.489552 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2a5ecbc8-b067-45fe-8c30-155c6fd677df tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] Action: 'create', calling method: .version_select at 0x7f10356cdd30>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:02:27.519418 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3bf17e93-655a-4c30-8a53-20222ee95dbf tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:27.520878 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3bf17e93-655a-4c30-8a53-20222ee95dbf tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:27.545573 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3bf17e93-655a-4c30-8a53-20222ee95dbf tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:27.547193 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3bf17e93-655a-4c30-8a53-20222ee95dbf tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:27.548409 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3bf17e93-655a-4c30-8a53-20222ee95dbf tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:27.549516 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3bf17e93-655a-4c30-8a53-20222ee95dbf tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:27.550151 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3bf17e93-655a-4c30-8a53-20222ee95dbf tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:27.550777 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3bf17e93-655a-4c30-8a53-20222ee95dbf tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:27.578730 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-2a5ecbc8-b067-45fe-8c30-155c6fd677df tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] Getting quotas for project f7c3266916f645e0a50d6f110a749bb2. Resources: dict_keys(['metadata_items']) {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:02:27.595220 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-2a5ecbc8-b067-45fe-8c30-155c6fd677df tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] Getting quotas for user 28158ee3021f40d8baedca1f953d4da7 and project f7c3266916f645e0a50d6f110a749bb2. Resources: dict_keys(['metadata_items']) {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:02:28.306167 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2a5ecbc8-b067-45fe-8c30-155c6fd677df tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] 10.222.0.67 "POST /compute/v2.1/images/e0e6bcef-c132-41cd-8e3f-18405c3e639d/metadata" status: 200 len: 85 microversion: 2.1 time: 0.821293 Sep 16 13:02:28.306878 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1827/3553] 10.222.0.67 () {60 vars in 1281 bytes} [Fri Sep 16 13:02:27 2022] POST /compute/v2.1/images/e0e6bcef-c132-41cd-8e3f-18405c3e639d/metadata => generated 85 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:02:28.311835 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ade6d257-1c40-42c9-b1b1-aad946f6ef5a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:28.312620 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ade6d257-1c40-42c9-b1b1-aad946f6ef5a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:28.332143 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ade6d257-1c40-42c9-b1b1-aad946f6ef5a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:28.335170 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ade6d257-1c40-42c9-b1b1-aad946f6ef5a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:28.335767 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ade6d257-1c40-42c9-b1b1-aad946f6ef5a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:28.336742 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ade6d257-1c40-42c9-b1b1-aad946f6ef5a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:28.338097 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ade6d257-1c40-42c9-b1b1-aad946f6ef5a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:28.339080 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ade6d257-1c40-42c9-b1b1-aad946f6ef5a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:28.374983 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3bf17e93-655a-4c30-8a53-20222ee95dbf tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:28.385629 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3bf17e93-655a-4c30-8a53-20222ee95dbf tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:28.388539 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3bf17e93-655a-4c30-8a53-20222ee95dbf tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:28.390533 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3bf17e93-655a-4c30-8a53-20222ee95dbf tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 2829 microversion: 2.42 time: 0.876862 Sep 16 13:02:28.405295 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1727/3554] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:02:27 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 2829 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:02:28.419779 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b5e51c33-4e4c-40db-8ae1-2450c496fb12 tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] Calling method '.version_select at 0x7f10349473a0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:28.516358 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b5e51c33-4e4c-40db-8ae1-2450c496fb12 tempest-ImagesMetadataTestJSON-1120098889 tempest-ImagesMetadataTestJSON-1120098889-project] 10.222.0.67 "GET /compute/v2.1/images/e0e6bcef-c132-41cd-8e3f-18405c3e639d/metadata" status: 200 len: 85 microversion: 2.1 time: 0.109794 Sep 16 13:02:28.529805 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1728/3555] 10.222.0.67 () {58 vars in 1260 bytes} [Fri Sep 16 13:02:28 2022] GET /compute/v2.1/images/e0e6bcef-c132-41cd-8e3f-18405c3e639d/metadata => generated 85 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:02:28.542349 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-cc3e5f14-e0b7-47ad-bc9b-9c0298002d56 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:28.542859 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-cc3e5f14-e0b7-47ad-bc9b-9c0298002d56 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:28.567095 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cc3e5f14-e0b7-47ad-bc9b-9c0298002d56 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:28.571372 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cc3e5f14-e0b7-47ad-bc9b-9c0298002d56 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:28.573330 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cc3e5f14-e0b7-47ad-bc9b-9c0298002d56 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:28.576873 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cc3e5f14-e0b7-47ad-bc9b-9c0298002d56 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:28.577635 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cc3e5f14-e0b7-47ad-bc9b-9c0298002d56 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:28.580409 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cc3e5f14-e0b7-47ad-bc9b-9c0298002d56 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:29.885553 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-cc3e5f14-e0b7-47ad-bc9b-9c0298002d56 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf/os-interface" status: 200 len: 1830 microversion: 2.42 time: 1.353786 Sep 16 13:02:29.888571 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1729/3556] 10.222.0.67 () {60 vars in 1316 bytes} [Fri Sep 16 13:02:28 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf/os-interface => generated 1830 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:02:29.893664 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-956c328f-ae81-4b66-90ec-6beda3d68d31 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:29.894944 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-956c328f-ae81-4b66-90ec-6beda3d68d31 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:29.913743 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-956c328f-ae81-4b66-90ec-6beda3d68d31 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:29.914525 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-956c328f-ae81-4b66-90ec-6beda3d68d31 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:29.916349 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-956c328f-ae81-4b66-90ec-6beda3d68d31 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:29.918043 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-956c328f-ae81-4b66-90ec-6beda3d68d31 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:29.921037 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-956c328f-ae81-4b66-90ec-6beda3d68d31 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:29.921546 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-956c328f-ae81-4b66-90ec-6beda3d68d31 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:29.926108 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ade6d257-1c40-42c9-b1b1-aad946f6ef5a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:29.937620 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ade6d257-1c40-42c9-b1b1-aad946f6ef5a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c" status: 200 len: 1510 microversion: 2.1 time: 1.629467 Sep 16 13:02:29.943557 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1828/3557] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:28 2022] GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c => generated 1510 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:29.992009 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-956c328f-ae81-4b66-90ec-6beda3d68d31 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44/ips" status: 200 len: 153 microversion: 2.20 time: 0.102083 Sep 16 13:02:29.992994 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1730/3558] 10.222.0.67 () {60 vars in 1289 bytes} [Fri Sep 16 13:02:29 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44/ips => generated 153 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:02:30.968945 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5b1c077c-86cc-495c-921f-3c5add1e59fe tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:30.969721 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5b1c077c-86cc-495c-921f-3c5add1e59fe tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:30.983573 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b1c077c-86cc-495c-921f-3c5add1e59fe tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:30.984847 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b1c077c-86cc-495c-921f-3c5add1e59fe tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:30.988772 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b1c077c-86cc-495c-921f-3c5add1e59fe tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:30.989757 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b1c077c-86cc-495c-921f-3c5add1e59fe tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:30.990671 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b1c077c-86cc-495c-921f-3c5add1e59fe tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:30.991273 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b1c077c-86cc-495c-921f-3c5add1e59fe tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:31.895137 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5b1c077c-86cc-495c-921f-3c5add1e59fe tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:31.927902 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5b1c077c-86cc-495c-921f-3c5add1e59fe tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c" status: 200 len: 1510 microversion: 2.1 time: 0.962648 Sep 16 13:02:31.928459 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1829/3559] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:30 2022] GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c => generated 1510 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:32.955916 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4fc78a4a-17b8-4504-b896-d4c1278f1d22 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:32.956553 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-4fc78a4a-17b8-4504-b896-d4c1278f1d22 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:32.969436 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4fc78a4a-17b8-4504-b896-d4c1278f1d22 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:32.971380 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4fc78a4a-17b8-4504-b896-d4c1278f1d22 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:32.972410 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4fc78a4a-17b8-4504-b896-d4c1278f1d22 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:32.973898 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4fc78a4a-17b8-4504-b896-d4c1278f1d22 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:32.976712 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4fc78a4a-17b8-4504-b896-d4c1278f1d22 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:32.978100 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4fc78a4a-17b8-4504-b896-d4c1278f1d22 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:33.036805 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-2672f50c-36e2-45b6-a174-7f2dffda63b5 req-c9faf1dc-37ff-450c-9223-38dfc92bff32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "defaddc3-3750-4d8a-b18a-dd6fdce1dbbf", "tag": "8a23d825-e263-4839-8617-11f3b05818ce"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:02:33.083559 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2672f50c-36e2-45b6-a174-7f2dffda63b5 req-c9faf1dc-37ff-450c-9223-38dfc92bff32 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:33.084952 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2672f50c-36e2-45b6-a174-7f2dffda63b5 req-c9faf1dc-37ff-450c-9223-38dfc92bff32 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:33.086674 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2672f50c-36e2-45b6-a174-7f2dffda63b5 req-c9faf1dc-37ff-450c-9223-38dfc92bff32 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:33.133377 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-2672f50c-36e2-45b6-a174-7f2dffda63b5 req-c9faf1dc-37ff-450c-9223-38dfc92bff32 service nova] Creating event network-changed:8a23d825-e263-4839-8617-11f3b05818ce for instance defaddc3-3750-4d8a-b18a-dd6fdce1dbbf on n-h1-858094-4 Sep 16 13:02:33.154696 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-2672f50c-36e2-45b6-a174-7f2dffda63b5 req-c9faf1dc-37ff-450c-9223-38dfc92bff32 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121040 Sep 16 13:02:33.159146 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1830/3560] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:02:33.391130 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-329118d4-80db-4c4a-9261-90efed41a62d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:02:33.392220 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-329118d4-80db-4c4a-9261-90efed41a62d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:33.402039 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-329118d4-80db-4c4a-9261-90efed41a62d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:33.407593 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-329118d4-80db-4c4a-9261-90efed41a62d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:33.408050 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-329118d4-80db-4c4a-9261-90efed41a62d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:33.412095 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-329118d4-80db-4c4a-9261-90efed41a62d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:33.412816 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-329118d4-80db-4c4a-9261-90efed41a62d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:33.414244 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-329118d4-80db-4c4a-9261-90efed41a62d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:33.495258 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-329118d4-80db-4c4a-9261-90efed41a62d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lazy-loading 'flavor' on Instance uuid 66413dbd-455f-45f6-b057-39a11a9f2d44 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:02:33.924650 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-329118d4-80db-4c4a-9261-90efed41a62d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "POST /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44/action" status: 202 len: 0 microversion: 2.20 time: 0.537940 Sep 16 13:02:33.924928 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4fc78a4a-17b8-4504-b896-d4c1278f1d22 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:33.925778 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1831/3561] 10.222.0.67 () {62 vars in 1319 bytes} [Fri Sep 16 13:02:33 2022] POST /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44/action => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 16 13:02:33.936152 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-53abf6df-0fde-4686-a9a5-2727d684433d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:33.941970 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-53abf6df-0fde-4686-a9a5-2727d684433d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:33.961980 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4fc78a4a-17b8-4504-b896-d4c1278f1d22 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c" status: 200 len: 1510 microversion: 2.1 time: 1.010796 Sep 16 13:02:33.972195 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1731/3562] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:32 2022] GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c => generated 1510 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:33.976274 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53abf6df-0fde-4686-a9a5-2727d684433d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:33.977381 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53abf6df-0fde-4686-a9a5-2727d684433d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:33.977983 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53abf6df-0fde-4686-a9a5-2727d684433d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:33.984824 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53abf6df-0fde-4686-a9a5-2727d684433d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:33.985642 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53abf6df-0fde-4686-a9a5-2727d684433d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:33.986992 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53abf6df-0fde-4686-a9a5-2727d684433d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:34.560575 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-53abf6df-0fde-4686-a9a5-2727d684433d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:34.576720 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-53abf6df-0fde-4686-a9a5-2727d684433d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:34.578206 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-53abf6df-0fde-4686-a9a5-2727d684433d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:34.579457 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-53abf6df-0fde-4686-a9a5-2727d684433d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1725 microversion: 2.20 time: 0.648588 Sep 16 13:02:34.593286 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1832/3563] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:02:33 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1725 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:02:35.461054 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4a1bb24b-d64f-46c8-95ba-7eada4983a73 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:35.461677 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-4a1bb24b-d64f-46c8-95ba-7eada4983a73 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:35.471903 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4a1bb24b-d64f-46c8-95ba-7eada4983a73 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:35.472446 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4a1bb24b-d64f-46c8-95ba-7eada4983a73 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:35.472926 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4a1bb24b-d64f-46c8-95ba-7eada4983a73 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:35.473792 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4a1bb24b-d64f-46c8-95ba-7eada4983a73 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:35.474279 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4a1bb24b-d64f-46c8-95ba-7eada4983a73 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:35.478262 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4a1bb24b-d64f-46c8-95ba-7eada4983a73 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:35.611200 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-97a6a60e-af18-4b21-b12e-976be8bdb712 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:35.612028 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-97a6a60e-af18-4b21-b12e-976be8bdb712 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:35.636325 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97a6a60e-af18-4b21-b12e-976be8bdb712 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:35.636325 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97a6a60e-af18-4b21-b12e-976be8bdb712 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:35.636325 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97a6a60e-af18-4b21-b12e-976be8bdb712 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:35.636325 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97a6a60e-af18-4b21-b12e-976be8bdb712 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:35.636325 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97a6a60e-af18-4b21-b12e-976be8bdb712 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:35.639139 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97a6a60e-af18-4b21-b12e-976be8bdb712 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:35.988574 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4a1bb24b-d64f-46c8-95ba-7eada4983a73 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:36.008551 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4a1bb24b-d64f-46c8-95ba-7eada4983a73 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c" status: 200 len: 1487 microversion: 2.1 time: 1.024348 Sep 16 13:02:36.020149 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1732/3564] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:34 2022] GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c => generated 1487 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:36.048923 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-97a6a60e-af18-4b21-b12e-976be8bdb712 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:36.055306 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-15f90ee3-4f78-4541-8279-bafdc2e15b15 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:36.056876 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-15f90ee3-4f78-4541-8279-bafdc2e15b15 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:36.066156 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-97a6a60e-af18-4b21-b12e-976be8bdb712 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:36.067897 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-97a6a60e-af18-4b21-b12e-976be8bdb712 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:36.070142 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-97a6a60e-af18-4b21-b12e-976be8bdb712 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1725 microversion: 2.20 time: 0.466187 Sep 16 13:02:36.073612 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-15f90ee3-4f78-4541-8279-bafdc2e15b15 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:36.073908 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1833/3565] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:02:35 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1725 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:02:36.076472 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-15f90ee3-4f78-4541-8279-bafdc2e15b15 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:36.081568 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-15f90ee3-4f78-4541-8279-bafdc2e15b15 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:36.082760 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-15f90ee3-4f78-4541-8279-bafdc2e15b15 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:36.084185 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-15f90ee3-4f78-4541-8279-bafdc2e15b15 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:36.085541 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-15f90ee3-4f78-4541-8279-bafdc2e15b15 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:36.162608 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-15f90ee3-4f78-4541-8279-bafdc2e15b15 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:02:36.352051 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-15f90ee3-4f78-4541-8279-bafdc2e15b15 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "DELETE /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c" status: 204 len: 0 microversion: 2.1 time: 0.308927 Sep 16 13:02:36.355005 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1733/3566] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 13:02:36 2022] DELETE /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:02:36.364842 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f3032a80-daa4-4a5f-bc06-aa94765618e3 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:36.366017 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f3032a80-daa4-4a5f-bc06-aa94765618e3 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:36.375981 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3032a80-daa4-4a5f-bc06-aa94765618e3 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:36.376721 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3032a80-daa4-4a5f-bc06-aa94765618e3 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:36.377613 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3032a80-daa4-4a5f-bc06-aa94765618e3 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:36.378702 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3032a80-daa4-4a5f-bc06-aa94765618e3 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:36.379447 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3032a80-daa4-4a5f-bc06-aa94765618e3 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:36.380513 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3032a80-daa4-4a5f-bc06-aa94765618e3 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:36.706410 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f3032a80-daa4-4a5f-bc06-aa94765618e3 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:36.734391 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f3032a80-daa4-4a5f-bc06-aa94765618e3 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c" status: 200 len: 1493 microversion: 2.1 time: 0.372988 Sep 16 13:02:36.737842 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1834/3567] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:36 2022] GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c => generated 1493 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:37.107703 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4e8032f9-b322-49b2-9608-123e652facd5 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:37.108448 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-4e8032f9-b322-49b2-9608-123e652facd5 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:37.119168 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=28 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:02:37.130079 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4e8032f9-b322-49b2-9608-123e652facd5 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:37.131567 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4e8032f9-b322-49b2-9608-123e652facd5 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:37.133609 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4e8032f9-b322-49b2-9608-123e652facd5 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:37.134680 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4e8032f9-b322-49b2-9608-123e652facd5 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:37.135670 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4e8032f9-b322-49b2-9608-123e652facd5 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:37.138010 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4e8032f9-b322-49b2-9608-123e652facd5 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:37.765960 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-880c4029-66da-461e-a168-fe8d076856e4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:37.766581 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-880c4029-66da-461e-a168-fe8d076856e4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:37.768972 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=8 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:02:37.783127 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-880c4029-66da-461e-a168-fe8d076856e4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:37.791806 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-880c4029-66da-461e-a168-fe8d076856e4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:37.792623 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-880c4029-66da-461e-a168-fe8d076856e4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:37.794383 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-880c4029-66da-461e-a168-fe8d076856e4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:37.795054 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-880c4029-66da-461e-a168-fe8d076856e4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:37.795673 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-880c4029-66da-461e-a168-fe8d076856e4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:38.051465 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4e8032f9-b322-49b2-9608-123e652facd5 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:38.071460 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4e8032f9-b322-49b2-9608-123e652facd5 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:38.072965 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4e8032f9-b322-49b2-9608-123e652facd5 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:38.074187 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4e8032f9-b322-49b2-9608-123e652facd5 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1725 microversion: 2.20 time: 0.972734 Sep 16 13:02:38.079616 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1734/3568] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:02:37 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1725 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:02:38.133134 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-880c4029-66da-461e-a168-fe8d076856e4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:38.165082 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-880c4029-66da-461e-a168-fe8d076856e4 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c" status: 200 len: 1493 microversion: 2.1 time: 0.403294 Sep 16 13:02:38.175187 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1835/3569] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:37 2022] GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c => generated 1493 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:38.276094 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-02b81ba3-b78e-4803-bab4-24d26247a24d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:38.276741 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-02b81ba3-b78e-4803-bab4-24d26247a24d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:38.305438 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-02b81ba3-b78e-4803-bab4-24d26247a24d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:38.312497 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-02b81ba3-b78e-4803-bab4-24d26247a24d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:38.312957 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-02b81ba3-b78e-4803-bab4-24d26247a24d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:38.313714 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-02b81ba3-b78e-4803-bab4-24d26247a24d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:38.314177 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-02b81ba3-b78e-4803-bab4-24d26247a24d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:38.314608 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-02b81ba3-b78e-4803-bab4-24d26247a24d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:39.056897 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-02b81ba3-b78e-4803-bab4-24d26247a24d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:39.079997 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-02b81ba3-b78e-4803-bab4-24d26247a24d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1665 microversion: 2.1 time: 0.812429 Sep 16 13:02:39.081410 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1735/3570] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:38 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1665 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:39.116883 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ae559ff3-40f9-4e66-96dc-ac05d6b869a4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:39.117453 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ae559ff3-40f9-4e66-96dc-ac05d6b869a4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:39.126084 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ee2eacf5-00e9-466b-a3f3-0f7fc3885b73 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-820276532"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:02:39.133353 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ee2eacf5-00e9-466b-a3f3-0f7fc3885b73 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:39.143945 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ee2eacf5-00e9-466b-a3f3-0f7fc3885b73 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:39.145484 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ee2eacf5-00e9-466b-a3f3-0f7fc3885b73 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:39.146474 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ee2eacf5-00e9-466b-a3f3-0f7fc3885b73 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:39.148696 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae559ff3-40f9-4e66-96dc-ac05d6b869a4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:39.150226 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ee2eacf5-00e9-466b-a3f3-0f7fc3885b73 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:39.150640 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae559ff3-40f9-4e66-96dc-ac05d6b869a4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:39.150932 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ee2eacf5-00e9-466b-a3f3-0f7fc3885b73 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:39.151729 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae559ff3-40f9-4e66-96dc-ac05d6b869a4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:39.152877 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ee2eacf5-00e9-466b-a3f3-0f7fc3885b73 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:39.155213 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae559ff3-40f9-4e66-96dc-ac05d6b869a4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:39.155904 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae559ff3-40f9-4e66-96dc-ac05d6b869a4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:39.158793 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae559ff3-40f9-4e66-96dc-ac05d6b869a4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:39.560182 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ee2eacf5-00e9-466b-a3f3-0f7fc3885b73 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "POST /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771/action" status: 202 len: 0 microversion: 2.1 time: 0.446650 Sep 16 13:02:39.571550 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1736/3571] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 13:02:39 2022] POST /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771/action => generated 0 bytes in 459 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 16 13:02:39.578278 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-297de96a-f290-401a-873c-9ee0154292e2 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:39.579135 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-297de96a-f290-401a-873c-9ee0154292e2 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:39.605939 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-297de96a-f290-401a-873c-9ee0154292e2 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:39.606724 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-297de96a-f290-401a-873c-9ee0154292e2 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:39.607466 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-297de96a-f290-401a-873c-9ee0154292e2 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:39.608590 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-297de96a-f290-401a-873c-9ee0154292e2 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:39.609357 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-297de96a-f290-401a-873c-9ee0154292e2 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:39.609958 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-297de96a-f290-401a-873c-9ee0154292e2 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:39.812106 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-297de96a-f290-401a-873c-9ee0154292e2 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:39.828440 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-297de96a-f290-401a-873c-9ee0154292e2 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c" status: 200 len: 1451 microversion: 2.1 time: 0.255249 Sep 16 13:02:39.829256 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1737/3572] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:39 2022] GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c => generated 1451 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:40.305593 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ae559ff3-40f9-4e66-96dc-ac05d6b869a4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:40.333602 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ae559ff3-40f9-4e66-96dc-ac05d6b869a4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:40.335940 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ae559ff3-40f9-4e66-96dc-ac05d6b869a4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:40.337218 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ae559ff3-40f9-4e66-96dc-ac05d6b869a4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1725 microversion: 2.20 time: 1.231577 Sep 16 13:02:40.339185 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1836/3573] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:02:39 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1725 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:02:40.376230 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-e20cad0f-f36c-4d23-b051-dd9fa850fc3e req-0171d1ed-b209-4e42-9844-d0ef66baa143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2074945c-006a-4c9a-91db-b3029d04112c", "name": "network-vif-deleted", "tag": "8ed61b00-7040-4c1a-8607-f72eeebb12d5"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:02:40.400607 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-e20cad0f-f36c-4d23-b051-dd9fa850fc3e req-0171d1ed-b209-4e42-9844-d0ef66baa143 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:40.401091 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-e20cad0f-f36c-4d23-b051-dd9fa850fc3e req-0171d1ed-b209-4e42-9844-d0ef66baa143 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:40.401546 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-e20cad0f-f36c-4d23-b051-dd9fa850fc3e req-0171d1ed-b209-4e42-9844-d0ef66baa143 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:40.452204 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-e20cad0f-f36c-4d23-b051-dd9fa850fc3e req-0171d1ed-b209-4e42-9844-d0ef66baa143 service nova] Creating event network-vif-deleted:8ed61b00-7040-4c1a-8607-f72eeebb12d5 for instance 2074945c-006a-4c9a-91db-b3029d04112c on n-h2-858094-4 Sep 16 13:02:40.479109 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-e20cad0f-f36c-4d23-b051-dd9fa850fc3e req-0171d1ed-b209-4e42-9844-d0ef66baa143 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116118 Sep 16 13:02:40.480709 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1738/3574] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:02:40.853508 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e293d1d4-b13d-43b4-b904-40ada6c824ab tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:40.854134 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e293d1d4-b13d-43b4-b904-40ada6c824ab tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:40.862292 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e293d1d4-b13d-43b4-b904-40ada6c824ab tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:40.863280 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e293d1d4-b13d-43b4-b904-40ada6c824ab tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:40.864191 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e293d1d4-b13d-43b4-b904-40ada6c824ab tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:40.865181 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e293d1d4-b13d-43b4-b904-40ada6c824ab tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:40.866329 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e293d1d4-b13d-43b4-b904-40ada6c824ab tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:40.867000 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e293d1d4-b13d-43b4-b904-40ada6c824ab tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:40.872912 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:02:40.911680 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e293d1d4-b13d-43b4-b904-40ada6c824ab tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:40.912611 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e293d1d4-b13d-43b4-b904-40ada6c824ab tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:40.913288 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e293d1d4-b13d-43b4-b904-40ada6c824ab tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:40.914062 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-e293d1d4-b13d-43b4-b904-40ada6c824ab tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lazy-loading 'fault' on Instance uuid 2074945c-006a-4c9a-91db-b3029d04112c {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:02:41.047568 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e293d1d4-b13d-43b4-b904-40ada6c824ab tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:41.062997 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e293d1d4-b13d-43b4-b904-40ada6c824ab tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c" status: 200 len: 1304 microversion: 2.1 time: 0.213022 Sep 16 13:02:41.063923 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1837/3575] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:40 2022] GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c => generated 1304 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:41.373779 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9141b135-3ade-4400-8dcd-acfe8f40781d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:41.374502 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9141b135-3ade-4400-8dcd-acfe8f40781d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:41.385636 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9141b135-3ade-4400-8dcd-acfe8f40781d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:41.390462 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9141b135-3ade-4400-8dcd-acfe8f40781d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:41.391733 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9141b135-3ade-4400-8dcd-acfe8f40781d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:41.395296 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9141b135-3ade-4400-8dcd-acfe8f40781d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:41.396268 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9141b135-3ade-4400-8dcd-acfe8f40781d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:41.396959 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9141b135-3ade-4400-8dcd-acfe8f40781d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:42.087018 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8140297e-8922-41dd-bdde-f4c23d98bf8f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:42.087784 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8140297e-8922-41dd-bdde-f4c23d98bf8f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:42.110206 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8140297e-8922-41dd-bdde-f4c23d98bf8f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:42.110613 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8140297e-8922-41dd-bdde-f4c23d98bf8f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:42.111037 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8140297e-8922-41dd-bdde-f4c23d98bf8f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:42.112193 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8140297e-8922-41dd-bdde-f4c23d98bf8f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:42.112832 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8140297e-8922-41dd-bdde-f4c23d98bf8f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:42.113443 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8140297e-8922-41dd-bdde-f4c23d98bf8f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:42.138770 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-8140297e-8922-41dd-bdde-f4c23d98bf8f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] HTTP exception thrown: Instance 2074945c-006a-4c9a-91db-b3029d04112c could not be found. Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8140297e-8922-41dd-bdde-f4c23d98bf8f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Request method failure captured: Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c HTTP/1.1 Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHK-ai74OxrHHqL5ZA97hOvy32Q6xIReVrKhZIj6PEPyQ_UB4rFs-7hdJCkozKZ5clo_9DaVkBFgsUmiSN_gmVaPdL8FT-f5QYKPk-CE61XDTK1RMhpnQkeVMlba4E4KaPfDCDA8WSNup3uH3mzkxsd2kp-OesctbTYQkqWqHnAvC3I Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_cfe82d8dd4fb42cbb054a6f069424c57", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-DeleteServersTestJSON-1385458479-project Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 2e531a7026054c34b2a78a1c484cbe02 Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-DeleteServersTestJSON-1385458479-project Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 2074945c-006a-4c9a-91db-b3029d04112c could not be found. Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '2074945c-006a-4c9a-91db-b3029d04112c'} Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2074945c-006a-4c9a-91db-b3029d04112c could not be found. Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2074945c-006a-4c9a-91db-b3029d04112c could not be found. Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:02:42.140536 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:02:42.145993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:02:42.145993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:02:42.145993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:02:42.145993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:02:42.145993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:02:42.145993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2074945c-006a-4c9a-91db-b3029d04112c could not be found. Sep 16 13:02:42.145993 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:02:42.145993 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8140297e-8922-41dd-bdde-f4c23d98bf8f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Returning 404 to user: Instance 2074945c-006a-4c9a-91db-b3029d04112c could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:02:42.153135 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8140297e-8922-41dd-bdde-f4c23d98bf8f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c" status: 404 len: 111 microversion: 2.1 time: 0.070182 Sep 16 13:02:42.153736 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1838/3576] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:42 2022] GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 13:02:42.160730 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-480823c0-0d4d-48fe-934f-a28a46f3dc69 req-95324a2f-b862-41c4-9763-f860b1f41e38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af5e660b-de79-42ca-a8de-fe06738b9771", "name": "network-vif-unplugged", "status": "completed", "tag": "3af800e8-0d1f-497b-bca5-8901587cb91c"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:02:42.190565 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-480823c0-0d4d-48fe-934f-a28a46f3dc69 req-95324a2f-b862-41c4-9763-f860b1f41e38 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:42.191950 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-480823c0-0d4d-48fe-934f-a28a46f3dc69 req-95324a2f-b862-41c4-9763-f860b1f41e38 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:42.192670 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-480823c0-0d4d-48fe-934f-a28a46f3dc69 req-95324a2f-b862-41c4-9763-f860b1f41e38 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:42.222916 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-480823c0-0d4d-48fe-934f-a28a46f3dc69 req-95324a2f-b862-41c4-9763-f860b1f41e38 service nova] Creating event network-vif-unplugged:3af800e8-0d1f-497b-bca5-8901587cb91c for instance af5e660b-de79-42ca-a8de-fe06738b9771 on n-h2-858094-4 Sep 16 13:02:42.239983 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-480823c0-0d4d-48fe-934f-a28a46f3dc69 req-95324a2f-b862-41c4-9763-f860b1f41e38 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084734 Sep 16 13:02:42.249321 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1839/3577] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:02:42.357089 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dacb62a7-3f9b-4d68-8336-1fde58840bd1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1014884493", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": [{"uuid": "4c6a423f-0493-4448-999c-84f17e899760"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:02:42.453470 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-dacb62a7-3f9b-4d68-8336-1fde58840bd1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] validate_networks() for [('4c6a423f-0493-4448-999c-84f17e899760', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:02:42.805696 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9141b135-3ade-4400-8dcd-acfe8f40781d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:42.812728 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:02:42.819490 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9141b135-3ade-4400-8dcd-acfe8f40781d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:42.824812 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9141b135-3ade-4400-8dcd-acfe8f40781d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:42.825725 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9141b135-3ade-4400-8dcd-acfe8f40781d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1725 microversion: 2.20 time: 1.456585 Sep 16 13:02:42.829682 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1739/3578] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:02:41 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1725 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:02:43.802195 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-dacb62a7-3f9b-4d68-8336-1fde58840bd1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:02:43.803233 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-dacb62a7-3f9b-4d68-8336-1fde58840bd1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:02:43.803832 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-dacb62a7-3f9b-4d68-8336-1fde58840bd1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:02:43.805186 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-dacb62a7-3f9b-4d68-8336-1fde58840bd1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:02:43.805700 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-dacb62a7-3f9b-4d68-8336-1fde58840bd1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:02:43.825054 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dacb62a7-3f9b-4d68-8336-1fde58840bd1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:43.827450 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dacb62a7-3f9b-4d68-8336-1fde58840bd1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:43.828266 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dacb62a7-3f9b-4d68-8336-1fde58840bd1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:43.829495 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dacb62a7-3f9b-4d68-8336-1fde58840bd1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:43.832634 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dacb62a7-3f9b-4d68-8336-1fde58840bd1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:43.833387 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dacb62a7-3f9b-4d68-8336-1fde58840bd1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:43.855301 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-cdda6c42-b6de-4683-9c36-63dad1201479 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:43.856268 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-cdda6c42-b6de-4683-9c36-63dad1201479 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:43.883108 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cdda6c42-b6de-4683-9c36-63dad1201479 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:43.888238 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cdda6c42-b6de-4683-9c36-63dad1201479 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:43.891348 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cdda6c42-b6de-4683-9c36-63dad1201479 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:43.892348 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cdda6c42-b6de-4683-9c36-63dad1201479 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:43.892958 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cdda6c42-b6de-4683-9c36-63dad1201479 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:43.897505 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cdda6c42-b6de-4683-9c36-63dad1201479 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:43.919072 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-dacb62a7-3f9b-4d68-8336-1fde58840bd1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Getting quotas for project cfe82d8dd4fb42cbb054a6f069424c57. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:02:43.941061 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-dacb62a7-3f9b-4d68-8336-1fde58840bd1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Getting quotas for user 2e531a7026054c34b2a78a1c484cbe02 and project cfe82d8dd4fb42cbb054a6f069424c57. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:02:43.988315 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dacb62a7-3f9b-4d68-8336-1fde58840bd1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:02:43.991154 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dacb62a7-3f9b-4d68-8336-1fde58840bd1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 8fc40271-fc32-41d6-ad15-257d0e7a7187] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:02:44.063755 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dacb62a7-3f9b-4d68-8336-1fde58840bd1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.711342 Sep 16 13:02:44.064655 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1840/3579] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 13:02:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 13:02:44.077741 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0fb40861-aa76-4c02-bd85-4645e5ec5d99 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:44.078372 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0fb40861-aa76-4c02-bd85-4645e5ec5d99 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 8fc40271-fc32-41d6-ad15-257d0e7a7187] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:44.229776 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0fb40861-aa76-4c02-bd85-4645e5ec5d99 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:44.241856 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0fb40861-aa76-4c02-bd85-4645e5ec5d99 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187" status: 200 len: 1215 microversion: 2.1 time: 0.167488 Sep 16 13:02:44.244204 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1841/3580] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:44 2022] GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187 => generated 1215 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:02:44.272421 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-cdda6c42-b6de-4683-9c36-63dad1201479 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:44.290937 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-cdda6c42-b6de-4683-9c36-63dad1201479 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:44.298883 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-cdda6c42-b6de-4683-9c36-63dad1201479 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:44.303390 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-cdda6c42-b6de-4683-9c36-63dad1201479 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1725 microversion: 2.20 time: 0.452038 Sep 16 13:02:44.306196 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1740/3581] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:02:43 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1725 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:02:45.269310 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e72a0799-6f7a-4ee7-a7d1-060732e15a69 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:45.272077 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e72a0799-6f7a-4ee7-a7d1-060732e15a69 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 8fc40271-fc32-41d6-ad15-257d0e7a7187] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:45.292820 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:02:45.303691 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e72a0799-6f7a-4ee7-a7d1-060732e15a69 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:45.304378 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e72a0799-6f7a-4ee7-a7d1-060732e15a69 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:45.316305 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e72a0799-6f7a-4ee7-a7d1-060732e15a69 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:45.317838 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e72a0799-6f7a-4ee7-a7d1-060732e15a69 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:45.318547 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e72a0799-6f7a-4ee7-a7d1-060732e15a69 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:45.321413 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e72a0799-6f7a-4ee7-a7d1-060732e15a69 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:45.331745 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fbcab912-0937-487a-8d8e-08e8ff5ef492 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:45.333709 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-fbcab912-0937-487a-8d8e-08e8ff5ef492 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:45.359812 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fbcab912-0937-487a-8d8e-08e8ff5ef492 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:45.361029 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fbcab912-0937-487a-8d8e-08e8ff5ef492 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:45.361883 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fbcab912-0937-487a-8d8e-08e8ff5ef492 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:45.364918 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fbcab912-0937-487a-8d8e-08e8ff5ef492 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:45.368407 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fbcab912-0937-487a-8d8e-08e8ff5ef492 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:45.368900 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fbcab912-0937-487a-8d8e-08e8ff5ef492 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:45.786257 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e72a0799-6f7a-4ee7-a7d1-060732e15a69 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:45.797832 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e72a0799-6f7a-4ee7-a7d1-060732e15a69 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187" status: 200 len: 1211 microversion: 2.1 time: 0.534025 Sep 16 13:02:45.798490 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1842/3582] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:45 2022] GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187 => generated 1211 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:45.822495 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-dc4f3ad3-5f29-4552-8c72-11a9f735a3ba req-a6774249-4825-435b-91b0-7e6abe01eacd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af5e660b-de79-42ca-a8de-fe06738b9771", "name": "network-vif-plugged", "status": "completed", "tag": "3af800e8-0d1f-497b-bca5-8901587cb91c"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:02:45.857198 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dc4f3ad3-5f29-4552-8c72-11a9f735a3ba req-a6774249-4825-435b-91b0-7e6abe01eacd service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:45.870248 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dc4f3ad3-5f29-4552-8c72-11a9f735a3ba req-a6774249-4825-435b-91b0-7e6abe01eacd service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:45.870853 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dc4f3ad3-5f29-4552-8c72-11a9f735a3ba req-a6774249-4825-435b-91b0-7e6abe01eacd service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:45.935831 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-dc4f3ad3-5f29-4552-8c72-11a9f735a3ba req-a6774249-4825-435b-91b0-7e6abe01eacd service nova] Creating event network-vif-plugged:3af800e8-0d1f-497b-bca5-8901587cb91c for instance af5e660b-de79-42ca-a8de-fe06738b9771 on n-h2-858094-4 Sep 16 13:02:45.976826 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-dc4f3ad3-5f29-4552-8c72-11a9f735a3ba req-a6774249-4825-435b-91b0-7e6abe01eacd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159975 Sep 16 13:02:45.984683 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1843/3583] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:02:46.332091 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-fbcab912-0937-487a-8d8e-08e8ff5ef492 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:46.343554 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-fbcab912-0937-487a-8d8e-08e8ff5ef492 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:46.356861 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-fbcab912-0937-487a-8d8e-08e8ff5ef492 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:46.361984 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-fbcab912-0937-487a-8d8e-08e8ff5ef492 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1725 microversion: 2.20 time: 1.034777 Sep 16 13:02:46.363826 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1741/3584] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:02:45 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1725 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:02:46.415251 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-99e6654b-11a7-47f5-98fc-2add534f3c80 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Action: 'create', calling method: .version_select at 0x7f10399e1700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-894032873", "description": "tempest-description-1116690458"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:02:46.827002 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a6d15787-0304-44bc-9395-32ba098887e9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:46.828220 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a6d15787-0304-44bc-9395-32ba098887e9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 8fc40271-fc32-41d6-ad15-257d0e7a7187] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:46.844427 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a6d15787-0304-44bc-9395-32ba098887e9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:46.845242 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a6d15787-0304-44bc-9395-32ba098887e9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:46.845846 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a6d15787-0304-44bc-9395-32ba098887e9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:46.847065 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a6d15787-0304-44bc-9395-32ba098887e9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:46.847689 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a6d15787-0304-44bc-9395-32ba098887e9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:46.848511 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a6d15787-0304-44bc-9395-32ba098887e9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:47.241450 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a6d15787-0304-44bc-9395-32ba098887e9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:47.252116 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a6d15787-0304-44bc-9395-32ba098887e9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187" status: 200 len: 1273 microversion: 2.1 time: 0.430156 Sep 16 13:02:47.252746 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1742/3585] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:46 2022] GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187 => generated 1273 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:02:47.394724 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-36b34f03-b4e4-495c-82c6-ec882fda4c3f tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:47.395423 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-36b34f03-b4e4-495c-82c6-ec882fda4c3f tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:47.402812 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-36b34f03-b4e4-495c-82c6-ec882fda4c3f tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:47.403297 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-36b34f03-b4e4-495c-82c6-ec882fda4c3f tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:47.416520 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-36b34f03-b4e4-495c-82c6-ec882fda4c3f tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:47.417523 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-36b34f03-b4e4-495c-82c6-ec882fda4c3f tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:47.419122 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-36b34f03-b4e4-495c-82c6-ec882fda4c3f tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:47.420018 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-36b34f03-b4e4-495c-82c6-ec882fda4c3f tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:47.621407 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-99e6654b-11a7-47f5-98fc-2add534f3c80 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.631279 Sep 16 13:02:47.634831 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1844/3586] 10.222.0.67 () {60 vars in 1180 bytes} [Fri Sep 16 13:02:45 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:02:47.641070 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f6abb3cb-30da-4cbc-b4ea-d456c3c50e6d tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Action: 'create', calling method: .version_select at 0x7f1035695dc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-444437611", "description": "tempest-description-1682211046"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:02:48.484939 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-36b34f03-b4e4-495c-82c6-ec882fda4c3f tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:48.504375 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-36b34f03-b4e4-495c-82c6-ec882fda4c3f tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:48.509172 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-36b34f03-b4e4-495c-82c6-ec882fda4c3f tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:48.511215 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-36b34f03-b4e4-495c-82c6-ec882fda4c3f tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1725 microversion: 2.20 time: 1.121194 Sep 16 13:02:48.513367 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1743/3587] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:02:47 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1725 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:02:48.538750 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-46c12ffe-85d1-45d7-bec3-39bac03ee51b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:48.564371 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-46c12ffe-85d1-45d7-bec3-39bac03ee51b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 8fc40271-fc32-41d6-ad15-257d0e7a7187] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:48.576167 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-46c12ffe-85d1-45d7-bec3-39bac03ee51b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:48.579285 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-46c12ffe-85d1-45d7-bec3-39bac03ee51b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:48.580102 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-46c12ffe-85d1-45d7-bec3-39bac03ee51b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:48.581474 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-46c12ffe-85d1-45d7-bec3-39bac03ee51b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:48.582177 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-46c12ffe-85d1-45d7-bec3-39bac03ee51b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:48.582965 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-46c12ffe-85d1-45d7-bec3-39bac03ee51b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:48.683150 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f6abb3cb-30da-4cbc-b4ea-d456c3c50e6d tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.046877 Sep 16 13:02:48.684484 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1845/3588] 10.222.0.67 () {60 vars in 1180 bytes} [Fri Sep 16 13:02:47 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:02:48.737234 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-46c12ffe-85d1-45d7-bec3-39bac03ee51b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:48.772881 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-46c12ffe-85d1-45d7-bec3-39bac03ee51b tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187" status: 200 len: 1273 microversion: 2.1 time: 0.252701 Sep 16 13:02:48.778174 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1744/3589] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:48 2022] GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187 => generated 1273 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:48.923668 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-54f7cf23-b628-4970-bd4d-61faf613074b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1811329447", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": [{"uuid": "56dd3a41-efae-420b-b361-8c953ab80e6c"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:02:49.051245 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-54f7cf23-b628-4970-bd4d-61faf613074b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] validate_networks() for [('56dd3a41-efae-420b-b361-8c953ab80e6c', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:02:49.544940 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4875c825-d353-43ef-be56-ec0210252774 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:49.545567 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-4875c825-d353-43ef-be56-ec0210252774 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:49.573439 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4875c825-d353-43ef-be56-ec0210252774 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:49.574069 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4875c825-d353-43ef-be56-ec0210252774 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:49.575101 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4875c825-d353-43ef-be56-ec0210252774 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:49.584813 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4875c825-d353-43ef-be56-ec0210252774 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:49.585505 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4875c825-d353-43ef-be56-ec0210252774 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:49.585958 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4875c825-d353-43ef-be56-ec0210252774 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:50.251810 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4875c825-d353-43ef-be56-ec0210252774 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:50.271483 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4875c825-d353-43ef-be56-ec0210252774 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:50.281639 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4875c825-d353-43ef-be56-ec0210252774 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:50.283423 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4875c825-d353-43ef-be56-ec0210252774 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1725 microversion: 2.20 time: 0.748167 Sep 16 13:02:50.285973 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1745/3590] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:02:49 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1725 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:02:50.297599 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-eef47dc3-e199-468b-b40f-5dc04ab6f475 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:50.300968 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-eef47dc3-e199-468b-b40f-5dc04ab6f475 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 8fc40271-fc32-41d6-ad15-257d0e7a7187] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:50.321365 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eef47dc3-e199-468b-b40f-5dc04ab6f475 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:50.325449 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eef47dc3-e199-468b-b40f-5dc04ab6f475 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:50.332705 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eef47dc3-e199-468b-b40f-5dc04ab6f475 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:50.333655 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eef47dc3-e199-468b-b40f-5dc04ab6f475 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:50.335794 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eef47dc3-e199-468b-b40f-5dc04ab6f475 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:50.346413 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eef47dc3-e199-468b-b40f-5dc04ab6f475 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:51.280499 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-eef47dc3-e199-468b-b40f-5dc04ab6f475 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:51.310507 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-eef47dc3-e199-468b-b40f-5dc04ab6f475 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187" status: 200 len: 1315 microversion: 2.1 time: 1.018481 Sep 16 13:02:51.315637 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1746/3591] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:50 2022] GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187 => generated 1315 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:51.323065 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-776b3029-0fbf-4268-b8d7-4d00ddd1ff2d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:51.329080 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-776b3029-0fbf-4268-b8d7-4d00ddd1ff2d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:51.346406 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-776b3029-0fbf-4268-b8d7-4d00ddd1ff2d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:51.347344 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-776b3029-0fbf-4268-b8d7-4d00ddd1ff2d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:51.352803 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-776b3029-0fbf-4268-b8d7-4d00ddd1ff2d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:51.353909 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-776b3029-0fbf-4268-b8d7-4d00ddd1ff2d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:51.354666 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-776b3029-0fbf-4268-b8d7-4d00ddd1ff2d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:51.356384 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-776b3029-0fbf-4268-b8d7-4d00ddd1ff2d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:51.670324 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-54f7cf23-b628-4970-bd4d-61faf613074b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:02:51.671121 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-54f7cf23-b628-4970-bd4d-61faf613074b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:02:51.671418 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-54f7cf23-b628-4970-bd4d-61faf613074b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:02:51.672054 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-54f7cf23-b628-4970-bd4d-61faf613074b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:02:51.672650 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-54f7cf23-b628-4970-bd4d-61faf613074b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:02:51.695806 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54f7cf23-b628-4970-bd4d-61faf613074b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:51.696878 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54f7cf23-b628-4970-bd4d-61faf613074b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:51.697490 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54f7cf23-b628-4970-bd4d-61faf613074b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:51.701569 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54f7cf23-b628-4970-bd4d-61faf613074b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:51.702306 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54f7cf23-b628-4970-bd4d-61faf613074b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:51.702928 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54f7cf23-b628-4970-bd4d-61faf613074b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:51.774469 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-54f7cf23-b628-4970-bd4d-61faf613074b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Getting quotas for project aaeff399942c4286a71ea3a0eab43280. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:02:51.791905 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-54f7cf23-b628-4970-bd4d-61faf613074b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Getting quotas for user 8ed69c96e39249f181eda742be229b97 and project aaeff399942c4286a71ea3a0eab43280. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:02:51.825363 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-54f7cf23-b628-4970-bd4d-61faf613074b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:02:51.833773 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-54f7cf23-b628-4970-bd4d-61faf613074b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 97f1168a-0491-4d97-8cc9-59e1b27ababe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:02:51.969122 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-54f7cf23-b628-4970-bd4d-61faf613074b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.044782 Sep 16 13:02:51.970007 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1846/3592] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 13:02:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 3052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 13:02:51.983172 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-95d71ca4-df63-4af8-8e6c-3c702cbd0951 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:51.984099 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-95d71ca4-df63-4af8-8e6c-3c702cbd0951 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 97f1168a-0491-4d97-8cc9-59e1b27ababe] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:52.521183 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-776b3029-0fbf-4268-b8d7-4d00ddd1ff2d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:52.536601 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-776b3029-0fbf-4268-b8d7-4d00ddd1ff2d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:52.548553 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-776b3029-0fbf-4268-b8d7-4d00ddd1ff2d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:52.553637 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-776b3029-0fbf-4268-b8d7-4d00ddd1ff2d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1746 microversion: 2.20 time: 1.234240 Sep 16 13:02:52.554560 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1747/3593] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:02:51 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1746 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:02:52.570064 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3087cf9f-5a66-41f9-80c0-4c92003ae411 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:52.573196 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3087cf9f-5a66-41f9-80c0-4c92003ae411 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 8fc40271-fc32-41d6-ad15-257d0e7a7187] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:52.574642 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-95d71ca4-df63-4af8-8e6c-3c702cbd0951 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed69c96e39249f181eda742be229b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeff399942c4286a71ea3a0eab43280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:52.588869 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-95d71ca4-df63-4af8-8e6c-3c702cbd0951 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe" status: 200 len: 1216 microversion: 2.1 time: 0.611063 Sep 16 13:02:52.593236 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1847/3594] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:51 2022] GET /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe => generated 1216 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:52.601491 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3087cf9f-5a66-41f9-80c0-4c92003ae411 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:52.606051 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3087cf9f-5a66-41f9-80c0-4c92003ae411 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:52.609189 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3087cf9f-5a66-41f9-80c0-4c92003ae411 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:52.614666 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3087cf9f-5a66-41f9-80c0-4c92003ae411 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:52.615378 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3087cf9f-5a66-41f9-80c0-4c92003ae411 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:52.617235 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3087cf9f-5a66-41f9-80c0-4c92003ae411 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:53.190666 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3087cf9f-5a66-41f9-80c0-4c92003ae411 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:53.200080 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3087cf9f-5a66-41f9-80c0-4c92003ae411 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187" status: 200 len: 1315 microversion: 2.1 time: 0.643717 Sep 16 13:02:53.247786 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1748/3595] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:52 2022] GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187 => generated 1315 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:53.591206 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f5367fdd-c34f-4c1b-9626-a1ca47678c04 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:53.592100 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f5367fdd-c34f-4c1b-9626-a1ca47678c04 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:53.619802 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5367fdd-c34f-4c1b-9626-a1ca47678c04 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:53.621413 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7722f46b-34ee-413d-abe7-be403b29e05e tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:53.623524 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7722f46b-34ee-413d-abe7-be403b29e05e tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 97f1168a-0491-4d97-8cc9-59e1b27ababe] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:53.627691 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5367fdd-c34f-4c1b-9626-a1ca47678c04 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:53.629993 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5367fdd-c34f-4c1b-9626-a1ca47678c04 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:53.631492 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5367fdd-c34f-4c1b-9626-a1ca47678c04 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:53.632355 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5367fdd-c34f-4c1b-9626-a1ca47678c04 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:53.633339 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5367fdd-c34f-4c1b-9626-a1ca47678c04 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:53.652109 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7722f46b-34ee-413d-abe7-be403b29e05e tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:53.661818 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7722f46b-34ee-413d-abe7-be403b29e05e tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:53.662401 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7722f46b-34ee-413d-abe7-be403b29e05e tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:53.667138 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7722f46b-34ee-413d-abe7-be403b29e05e tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:53.667644 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7722f46b-34ee-413d-abe7-be403b29e05e tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:53.679850 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7722f46b-34ee-413d-abe7-be403b29e05e tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:54.049926 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7722f46b-34ee-413d-abe7-be403b29e05e tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed69c96e39249f181eda742be229b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeff399942c4286a71ea3a0eab43280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:54.058849 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7722f46b-34ee-413d-abe7-be403b29e05e tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe" status: 200 len: 1268 microversion: 2.1 time: 0.442485 Sep 16 13:02:54.063779 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1749/3596] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:53 2022] GET /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe => generated 1268 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:02:54.072922 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-1b227b1a-7fbc-4927-94ff-67c964174a2b req-1d4520d7-ef95-4c50-9661-61581e5e9c45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fc40271-fc32-41d6-ad15-257d0e7a7187", "tag": "3cf4e4b2-bd6e-451e-ade5-fc4aeac4adf1"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:02:54.109849 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-1b227b1a-7fbc-4927-94ff-67c964174a2b req-1d4520d7-ef95-4c50-9661-61581e5e9c45 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:54.120707 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-1b227b1a-7fbc-4927-94ff-67c964174a2b req-1d4520d7-ef95-4c50-9661-61581e5e9c45 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:54.142132 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-1b227b1a-7fbc-4927-94ff-67c964174a2b req-1d4520d7-ef95-4c50-9661-61581e5e9c45 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:54.176606 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-1b227b1a-7fbc-4927-94ff-67c964174a2b req-1d4520d7-ef95-4c50-9661-61581e5e9c45 service nova] Creating event network-changed:3cf4e4b2-bd6e-451e-ade5-fc4aeac4adf1 for instance 8fc40271-fc32-41d6-ad15-257d0e7a7187 on n-h2-858094-4 Sep 16 13:02:54.188894 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-1b227b1a-7fbc-4927-94ff-67c964174a2b req-1d4520d7-ef95-4c50-9661-61581e5e9c45 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123273 Sep 16 13:02:54.189974 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1750/3597] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:02:54.249936 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e7a8300e-dd73-4047-bca7-5b28ac459816 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:54.250891 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e7a8300e-dd73-4047-bca7-5b28ac459816 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 8fc40271-fc32-41d6-ad15-257d0e7a7187] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:54.266443 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e7a8300e-dd73-4047-bca7-5b28ac459816 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:54.270205 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e7a8300e-dd73-4047-bca7-5b28ac459816 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:54.275022 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e7a8300e-dd73-4047-bca7-5b28ac459816 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:54.276112 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e7a8300e-dd73-4047-bca7-5b28ac459816 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:54.283074 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e7a8300e-dd73-4047-bca7-5b28ac459816 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:54.283746 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e7a8300e-dd73-4047-bca7-5b28ac459816 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:54.792241 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f5367fdd-c34f-4c1b-9626-a1ca47678c04 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:54.818716 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f5367fdd-c34f-4c1b-9626-a1ca47678c04 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:54.823302 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f5367fdd-c34f-4c1b-9626-a1ca47678c04 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:54.832820 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f5367fdd-c34f-4c1b-9626-a1ca47678c04 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1746 microversion: 2.20 time: 1.245873 Sep 16 13:02:54.835128 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1848/3598] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:02:53 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1746 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:02:55.089550 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e7a8300e-dd73-4047-bca7-5b28ac459816 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:55.094185 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6b4db9fb-b19b-43a9-a443-6c0c17cbdf9f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:55.096538 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6b4db9fb-b19b-43a9-a443-6c0c17cbdf9f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 97f1168a-0491-4d97-8cc9-59e1b27ababe] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:55.108187 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e7a8300e-dd73-4047-bca7-5b28ac459816 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187" status: 200 len: 1315 microversion: 2.1 time: 0.864624 Sep 16 13:02:55.110897 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1751/3599] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:54 2022] GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187 => generated 1315 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:02:55.117470 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b4db9fb-b19b-43a9-a443-6c0c17cbdf9f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:55.118009 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b4db9fb-b19b-43a9-a443-6c0c17cbdf9f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:55.124487 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b4db9fb-b19b-43a9-a443-6c0c17cbdf9f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:55.126040 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b4db9fb-b19b-43a9-a443-6c0c17cbdf9f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:55.128985 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b4db9fb-b19b-43a9-a443-6c0c17cbdf9f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:55.133773 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b4db9fb-b19b-43a9-a443-6c0c17cbdf9f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:55.303726 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6b4db9fb-b19b-43a9-a443-6c0c17cbdf9f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed69c96e39249f181eda742be229b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeff399942c4286a71ea3a0eab43280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:55.315557 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6b4db9fb-b19b-43a9-a443-6c0c17cbdf9f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe" status: 200 len: 1274 microversion: 2.1 time: 0.230650 Sep 16 13:02:55.316239 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1849/3600] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:55 2022] GET /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe => generated 1274 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:02:55.864598 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-05a10712-4f31-40da-a0e7-a166ac66f9be tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:55.866148 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-05a10712-4f31-40da-a0e7-a166ac66f9be tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:55.872949 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:02:55.891908 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-05a10712-4f31-40da-a0e7-a166ac66f9be tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:55.896464 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-05a10712-4f31-40da-a0e7-a166ac66f9be tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:55.898651 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-05a10712-4f31-40da-a0e7-a166ac66f9be tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:55.901441 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-05a10712-4f31-40da-a0e7-a166ac66f9be tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:55.902554 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-05a10712-4f31-40da-a0e7-a166ac66f9be tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:55.905848 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-05a10712-4f31-40da-a0e7-a166ac66f9be tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:56.140687 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-45636725-48cf-4b62-8f57-493a04421daa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:56.143499 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-45636725-48cf-4b62-8f57-493a04421daa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 8fc40271-fc32-41d6-ad15-257d0e7a7187] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:56.162073 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45636725-48cf-4b62-8f57-493a04421daa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:56.163280 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45636725-48cf-4b62-8f57-493a04421daa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:56.163725 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45636725-48cf-4b62-8f57-493a04421daa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:56.165824 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45636725-48cf-4b62-8f57-493a04421daa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:56.167429 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45636725-48cf-4b62-8f57-493a04421daa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:56.168732 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45636725-48cf-4b62-8f57-493a04421daa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:56.242518 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-05a10712-4f31-40da-a0e7-a166ac66f9be tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:56.259740 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-05a10712-4f31-40da-a0e7-a166ac66f9be tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:56.264522 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-05a10712-4f31-40da-a0e7-a166ac66f9be tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:56.276564 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-05a10712-4f31-40da-a0e7-a166ac66f9be tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1746 microversion: 2.20 time: 0.417258 Sep 16 13:02:56.280617 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1752/3601] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:02:55 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1746 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:02:56.347749 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fdc35ac2-4fcf-4348-b9e3-dc3a1fa49d2a tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:56.348525 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-fdc35ac2-4fcf-4348-b9e3-dc3a1fa49d2a tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 97f1168a-0491-4d97-8cc9-59e1b27ababe] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:56.362317 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fdc35ac2-4fcf-4348-b9e3-dc3a1fa49d2a tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:56.363040 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fdc35ac2-4fcf-4348-b9e3-dc3a1fa49d2a tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:56.364704 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fdc35ac2-4fcf-4348-b9e3-dc3a1fa49d2a tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:56.367283 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fdc35ac2-4fcf-4348-b9e3-dc3a1fa49d2a tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:56.368108 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fdc35ac2-4fcf-4348-b9e3-dc3a1fa49d2a tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:56.372729 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fdc35ac2-4fcf-4348-b9e3-dc3a1fa49d2a tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:56.734120 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-45636725-48cf-4b62-8f57-493a04421daa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:56.754383 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-45636725-48cf-4b62-8f57-493a04421daa tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187" status: 200 len: 1315 microversion: 2.1 time: 0.618724 Sep 16 13:02:56.757755 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1850/3602] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:56 2022] GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187 => generated 1315 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:02:56.772608 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-ef424113-e3b7-4db6-87ca-1177cf0d5adc req-82b72390-5d59-48d9-9906-4b55a5320325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66413dbd-455f-45f6-b057-39a11a9f2d44", "name": "network-vif-plugged", "status": "completed", "tag": "3a5b1f2b-2004-4cf4-93bd-f498b62488fe"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:02:56.805508 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ef424113-e3b7-4db6-87ca-1177cf0d5adc req-82b72390-5d59-48d9-9906-4b55a5320325 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:56.811007 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ef424113-e3b7-4db6-87ca-1177cf0d5adc req-82b72390-5d59-48d9-9906-4b55a5320325 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:56.811656 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ef424113-e3b7-4db6-87ca-1177cf0d5adc req-82b72390-5d59-48d9-9906-4b55a5320325 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:56.857892 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-ef424113-e3b7-4db6-87ca-1177cf0d5adc req-82b72390-5d59-48d9-9906-4b55a5320325 service nova] Creating event network-vif-plugged:3a5b1f2b-2004-4cf4-93bd-f498b62488fe for instance 66413dbd-455f-45f6-b057-39a11a9f2d44 on n-h1-858094-4 Sep 16 13:02:56.876368 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-ef424113-e3b7-4db6-87ca-1177cf0d5adc req-82b72390-5d59-48d9-9906-4b55a5320325 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116650 Sep 16 13:02:56.878800 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1851/3603] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:02:57.313474 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e7ccde95-6683-4dc4-9c64-80c96a07ae60 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:57.314810 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e7ccde95-6683-4dc4-9c64-80c96a07ae60 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:57.344398 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7ccde95-6683-4dc4-9c64-80c96a07ae60 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:57.350475 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7ccde95-6683-4dc4-9c64-80c96a07ae60 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:57.352185 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7ccde95-6683-4dc4-9c64-80c96a07ae60 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:57.354409 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7ccde95-6683-4dc4-9c64-80c96a07ae60 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:57.357067 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7ccde95-6683-4dc4-9c64-80c96a07ae60 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:57.357642 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7ccde95-6683-4dc4-9c64-80c96a07ae60 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:57.892778 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-fdc35ac2-4fcf-4348-b9e3-dc3a1fa49d2a tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed69c96e39249f181eda742be229b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeff399942c4286a71ea3a0eab43280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:57.905453 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-fdc35ac2-4fcf-4348-b9e3-dc3a1fa49d2a tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe" status: 200 len: 1316 microversion: 2.1 time: 1.562505 Sep 16 13:02:57.906737 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1753/3604] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:56 2022] GET /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe => generated 1316 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:02:57.911744 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fff3de31-7b1d-49e1-8beb-47e299420185 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:57.912693 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-fff3de31-7b1d-49e1-8beb-47e299420185 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 8fc40271-fc32-41d6-ad15-257d0e7a7187] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:57.920042 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fff3de31-7b1d-49e1-8beb-47e299420185 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:57.921554 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fff3de31-7b1d-49e1-8beb-47e299420185 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:57.922394 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fff3de31-7b1d-49e1-8beb-47e299420185 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:57.923453 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fff3de31-7b1d-49e1-8beb-47e299420185 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:57.924216 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fff3de31-7b1d-49e1-8beb-47e299420185 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:57.924855 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fff3de31-7b1d-49e1-8beb-47e299420185 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:58.736795 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e7ccde95-6683-4dc4-9c64-80c96a07ae60 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:58.755702 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e7ccde95-6683-4dc4-9c64-80c96a07ae60 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:58.765601 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e7ccde95-6683-4dc4-9c64-80c96a07ae60 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:02:58.767611 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e7ccde95-6683-4dc4-9c64-80c96a07ae60 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1741 microversion: 2.20 time: 1.459181 Sep 16 13:02:58.770858 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1852/3605] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:02:57 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1741 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:02:58.936822 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-40cf6090-244b-4113-9e26-ebd7026bfdad tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:02:58.937632 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-40cf6090-244b-4113-9e26-ebd7026bfdad tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 97f1168a-0491-4d97-8cc9-59e1b27ababe] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:02:58.949919 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40cf6090-244b-4113-9e26-ebd7026bfdad tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:58.954186 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40cf6090-244b-4113-9e26-ebd7026bfdad tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:58.957912 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40cf6090-244b-4113-9e26-ebd7026bfdad tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:02:58.959510 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40cf6090-244b-4113-9e26-ebd7026bfdad tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:02:58.961016 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40cf6090-244b-4113-9e26-ebd7026bfdad tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:02:58.964495 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40cf6090-244b-4113-9e26-ebd7026bfdad tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:00.497468 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-fff3de31-7b1d-49e1-8beb-47e299420185 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:00.497468 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-fff3de31-7b1d-49e1-8beb-47e299420185 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187" status: 200 len: 1315 microversion: 2.1 time: 2.577437 Sep 16 13:03:00.497468 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1754/3606] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:57 2022] GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187 => generated 1315 bytes in 2580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:00.518991 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4a8ecf68-0708-4eb1-ab07-209d981be200 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:00.519642 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-4a8ecf68-0708-4eb1-ab07-209d981be200 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:00.555436 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4a8ecf68-0708-4eb1-ab07-209d981be200 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:00.561041 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4a8ecf68-0708-4eb1-ab07-209d981be200 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:00.561662 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4a8ecf68-0708-4eb1-ab07-209d981be200 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:00.575372 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4a8ecf68-0708-4eb1-ab07-209d981be200 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:00.579701 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4a8ecf68-0708-4eb1-ab07-209d981be200 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:00.580592 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4a8ecf68-0708-4eb1-ab07-209d981be200 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:00.587390 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-40cf6090-244b-4113-9e26-ebd7026bfdad tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed69c96e39249f181eda742be229b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeff399942c4286a71ea3a0eab43280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:00.597633 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-40cf6090-244b-4113-9e26-ebd7026bfdad tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe" status: 200 len: 1316 microversion: 2.1 time: 1.666078 Sep 16 13:03:00.612014 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1853/3607] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:02:58 2022] GET /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe => generated 1316 bytes in 1681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:03:01.436730 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4a8ecf68-0708-4eb1-ab07-209d981be200 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:01.454924 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4a8ecf68-0708-4eb1-ab07-209d981be200 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:01.466180 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4a8ecf68-0708-4eb1-ab07-209d981be200 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:01.468089 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4a8ecf68-0708-4eb1-ab07-209d981be200 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1741 microversion: 2.20 time: 0.978906 Sep 16 13:03:01.499857 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1755/3608] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:03:00 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1741 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:03:01.519231 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d9638305-e6c6-47c1-8c82-18e3e48968b9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:01.520761 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d9638305-e6c6-47c1-8c82-18e3e48968b9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 8fc40271-fc32-41d6-ad15-257d0e7a7187] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:01.537062 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9638305-e6c6-47c1-8c82-18e3e48968b9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:01.538714 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9638305-e6c6-47c1-8c82-18e3e48968b9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:01.543388 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9638305-e6c6-47c1-8c82-18e3e48968b9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:01.544223 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9638305-e6c6-47c1-8c82-18e3e48968b9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:01.544761 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9638305-e6c6-47c1-8c82-18e3e48968b9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:01.545193 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9638305-e6c6-47c1-8c82-18e3e48968b9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:01.624574 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-dff687af-6b81-4edd-bb17-6453d1936772 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:01.625594 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-dff687af-6b81-4edd-bb17-6453d1936772 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 97f1168a-0491-4d97-8cc9-59e1b27ababe] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:01.649223 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dff687af-6b81-4edd-bb17-6453d1936772 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:01.661270 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dff687af-6b81-4edd-bb17-6453d1936772 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:01.664611 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dff687af-6b81-4edd-bb17-6453d1936772 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:01.670787 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dff687af-6b81-4edd-bb17-6453d1936772 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:01.674604 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dff687af-6b81-4edd-bb17-6453d1936772 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:01.677212 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dff687af-6b81-4edd-bb17-6453d1936772 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:01.754206 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:03:02.252029 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-dff687af-6b81-4edd-bb17-6453d1936772 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed69c96e39249f181eda742be229b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeff399942c4286a71ea3a0eab43280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:02.275726 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d9638305-e6c6-47c1-8c82-18e3e48968b9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:02.287716 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-dff687af-6b81-4edd-bb17-6453d1936772 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe" status: 200 len: 1316 microversion: 2.1 time: 0.647299 Sep 16 13:03:02.288448 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1756/3609] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:01 2022] GET /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe => generated 1316 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:02.291548 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d9638305-e6c6-47c1-8c82-18e3e48968b9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187" status: 200 len: 1315 microversion: 2.1 time: 0.776453 Sep 16 13:03:02.292140 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1854/3610] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:01 2022] GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187 => generated 1315 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:02.304987 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-58616664-bf29-4815-a3c3-9e10999f4bdb req-2b27ddb4-382c-482f-9627-60b109c8fc8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97f1168a-0491-4d97-8cc9-59e1b27ababe", "tag": "4c0896cf-3255-42ff-b580-d2a345dbb96d"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:03:02.340389 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-58616664-bf29-4815-a3c3-9e10999f4bdb req-2b27ddb4-382c-482f-9627-60b109c8fc8a service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:02.341281 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-58616664-bf29-4815-a3c3-9e10999f4bdb req-2b27ddb4-382c-482f-9627-60b109c8fc8a service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:02.341957 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-58616664-bf29-4815-a3c3-9e10999f4bdb req-2b27ddb4-382c-482f-9627-60b109c8fc8a service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:02.358226 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=100 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:03:02.431108 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-58616664-bf29-4815-a3c3-9e10999f4bdb req-2b27ddb4-382c-482f-9627-60b109c8fc8a service nova] Creating event network-changed:4c0896cf-3255-42ff-b580-d2a345dbb96d for instance 97f1168a-0491-4d97-8cc9-59e1b27ababe on n-h1-858094-4 Sep 16 13:03:02.475245 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-58616664-bf29-4815-a3c3-9e10999f4bdb req-2b27ddb4-382c-482f-9627-60b109c8fc8a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166875 Sep 16 13:03:02.482749 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1757/3611] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:03:02.504854 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5f325dcf-042e-4b29-a5ce-058d0aeac004 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:02.505558 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5f325dcf-042e-4b29-a5ce-058d0aeac004 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:02.538937 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f325dcf-042e-4b29-a5ce-058d0aeac004 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:02.539858 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f325dcf-042e-4b29-a5ce-058d0aeac004 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:02.539966 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f325dcf-042e-4b29-a5ce-058d0aeac004 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:02.540869 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f325dcf-042e-4b29-a5ce-058d0aeac004 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:02.541354 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f325dcf-042e-4b29-a5ce-058d0aeac004 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:02.541817 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f325dcf-042e-4b29-a5ce-058d0aeac004 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:02.619215 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=16 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:03:03.004365 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5f325dcf-042e-4b29-a5ce-058d0aeac004 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:03.018096 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5f325dcf-042e-4b29-a5ce-058d0aeac004 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:03.028998 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5f325dcf-042e-4b29-a5ce-058d0aeac004 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:03.035462 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5f325dcf-042e-4b29-a5ce-058d0aeac004 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1741 microversion: 2.20 time: 0.532689 Sep 16 13:03:03.036365 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1855/3612] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:03:02 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1741 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:03:03.319351 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ad5f7a86-286a-4673-b530-3737bbad9f1b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:03.320251 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ad5f7a86-286a-4673-b530-3737bbad9f1b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 97f1168a-0491-4d97-8cc9-59e1b27ababe] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:03.321334 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b7f7f65e-e167-4175-9e30-837bdb95d043 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:03.322199 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b7f7f65e-e167-4175-9e30-837bdb95d043 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 8fc40271-fc32-41d6-ad15-257d0e7a7187] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:03.339870 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ad5f7a86-286a-4673-b530-3737bbad9f1b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:03.343106 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7f7f65e-e167-4175-9e30-837bdb95d043 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:03.344619 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ad5f7a86-286a-4673-b530-3737bbad9f1b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:03.351400 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ad5f7a86-286a-4673-b530-3737bbad9f1b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:03.351661 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7f7f65e-e167-4175-9e30-837bdb95d043 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:03.352373 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7f7f65e-e167-4175-9e30-837bdb95d043 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:03.353291 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ad5f7a86-286a-4673-b530-3737bbad9f1b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:03.353433 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7f7f65e-e167-4175-9e30-837bdb95d043 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:03.353778 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ad5f7a86-286a-4673-b530-3737bbad9f1b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:03.354472 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7f7f65e-e167-4175-9e30-837bdb95d043 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:03.356382 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ad5f7a86-286a-4673-b530-3737bbad9f1b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:03.358464 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7f7f65e-e167-4175-9e30-837bdb95d043 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:04.482489 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ad5f7a86-286a-4673-b530-3737bbad9f1b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed69c96e39249f181eda742be229b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeff399942c4286a71ea3a0eab43280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:04.561432 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ad5f7a86-286a-4673-b530-3737bbad9f1b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe" status: 200 len: 1316 microversion: 2.1 time: 1.254164 Sep 16 13:03:04.595982 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b7f7f65e-e167-4175-9e30-837bdb95d043 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:04.597212 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1758/3613] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:03 2022] GET /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe => generated 1316 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:04.605010 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b7f7f65e-e167-4175-9e30-837bdb95d043 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187" status: 200 len: 1315 microversion: 2.1 time: 1.289898 Sep 16 13:03:04.609944 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1856/3614] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:03 2022] GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187 => generated 1315 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:04.617673 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-473b5313-2243-422d-877c-2c4ccc7a8af2 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:04.623293 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-473b5313-2243-422d-877c-2c4ccc7a8af2 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:04.641310 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-473b5313-2243-422d-877c-2c4ccc7a8af2 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:04.643481 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-473b5313-2243-422d-877c-2c4ccc7a8af2 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:04.644307 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-473b5313-2243-422d-877c-2c4ccc7a8af2 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:04.645417 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-8e418a1f-1f57-4074-bc02-e775c52562e3 req-70d5f256-d586-43ee-bcd2-1b03c65d243c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fc40271-fc32-41d6-ad15-257d0e7a7187", "name": "network-vif-plugged", "status": "completed", "tag": "3cf4e4b2-bd6e-451e-ade5-fc4aeac4adf1"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:03:04.646219 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-473b5313-2243-422d-877c-2c4ccc7a8af2 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:04.647589 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-473b5313-2243-422d-877c-2c4ccc7a8af2 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:04.650900 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-473b5313-2243-422d-877c-2c4ccc7a8af2 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:04.672012 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-8e418a1f-1f57-4074-bc02-e775c52562e3 req-70d5f256-d586-43ee-bcd2-1b03c65d243c service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:04.672922 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-8e418a1f-1f57-4074-bc02-e775c52562e3 req-70d5f256-d586-43ee-bcd2-1b03c65d243c service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:04.673566 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-8e418a1f-1f57-4074-bc02-e775c52562e3 req-70d5f256-d586-43ee-bcd2-1b03c65d243c service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:04.709601 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-8e418a1f-1f57-4074-bc02-e775c52562e3 req-70d5f256-d586-43ee-bcd2-1b03c65d243c service nova] Creating event network-vif-plugged:3cf4e4b2-bd6e-451e-ade5-fc4aeac4adf1 for instance 8fc40271-fc32-41d6-ad15-257d0e7a7187 on n-h2-858094-4 Sep 16 13:03:04.744672 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-8e418a1f-1f57-4074-bc02-e775c52562e3 req-70d5f256-d586-43ee-bcd2-1b03c65d243c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144798 Sep 16 13:03:04.751171 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1759/3615] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:03:05.271272 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-473b5313-2243-422d-877c-2c4ccc7a8af2 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:05.290176 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-473b5313-2243-422d-877c-2c4ccc7a8af2 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:05.294621 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-473b5313-2243-422d-877c-2c4ccc7a8af2 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:05.302820 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-473b5313-2243-422d-877c-2c4ccc7a8af2 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1741 microversion: 2.20 time: 0.691667 Sep 16 13:03:05.312571 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1857/3616] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:03:04 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1741 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:03:05.585449 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-93afe76a-cac8-4d37-a7d0-e5cd5d896f2b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:05.586819 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-93afe76a-cac8-4d37-a7d0-e5cd5d896f2b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 97f1168a-0491-4d97-8cc9-59e1b27ababe] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:05.602406 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-93afe76a-cac8-4d37-a7d0-e5cd5d896f2b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:05.603204 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-93afe76a-cac8-4d37-a7d0-e5cd5d896f2b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:05.603822 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-93afe76a-cac8-4d37-a7d0-e5cd5d896f2b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:05.610924 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-93afe76a-cac8-4d37-a7d0-e5cd5d896f2b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:05.611681 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-93afe76a-cac8-4d37-a7d0-e5cd5d896f2b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:05.612369 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-93afe76a-cac8-4d37-a7d0-e5cd5d896f2b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:05.634225 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-79fd2827-4b9c-493b-9b01-034e51cbbf14 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:05.635829 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-79fd2827-4b9c-493b-9b01-034e51cbbf14 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 8fc40271-fc32-41d6-ad15-257d0e7a7187] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:05.669963 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79fd2827-4b9c-493b-9b01-034e51cbbf14 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:05.671145 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79fd2827-4b9c-493b-9b01-034e51cbbf14 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:05.672623 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79fd2827-4b9c-493b-9b01-034e51cbbf14 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:05.674800 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79fd2827-4b9c-493b-9b01-034e51cbbf14 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:05.675304 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79fd2827-4b9c-493b-9b01-034e51cbbf14 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:05.678231 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79fd2827-4b9c-493b-9b01-034e51cbbf14 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:06.744184 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-93afe76a-cac8-4d37-a7d0-e5cd5d896f2b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed69c96e39249f181eda742be229b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeff399942c4286a71ea3a0eab43280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:06.755864 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-93afe76a-cac8-4d37-a7d0-e5cd5d896f2b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe" status: 200 len: 1316 microversion: 2.1 time: 1.174881 Sep 16 13:03:06.760621 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-79fd2827-4b9c-493b-9b01-034e51cbbf14 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:06.762305 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1760/3617] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:05 2022] GET /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe => generated 1316 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:06.770767 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-79fd2827-4b9c-493b-9b01-034e51cbbf14 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187" status: 200 len: 1315 microversion: 2.1 time: 1.142677 Sep 16 13:03:06.773976 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1858/3618] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:05 2022] GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187 => generated 1315 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:06.818973 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-bcc1e394-e3d6-42a7-9735-d3a39d761a3e tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:06.819625 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-bcc1e394-e3d6-42a7-9735-d3a39d761a3e tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:06.849020 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bcc1e394-e3d6-42a7-9735-d3a39d761a3e tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:06.849834 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bcc1e394-e3d6-42a7-9735-d3a39d761a3e tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:06.850014 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bcc1e394-e3d6-42a7-9735-d3a39d761a3e tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:06.850715 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bcc1e394-e3d6-42a7-9735-d3a39d761a3e tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:06.851192 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bcc1e394-e3d6-42a7-9735-d3a39d761a3e tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:06.867461 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bcc1e394-e3d6-42a7-9735-d3a39d761a3e tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:07.795789 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e14d611a-78a3-4c2b-9e60-bb7ef68c6f8a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:07.796764 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e14d611a-78a3-4c2b-9e60-bb7ef68c6f8a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 8fc40271-fc32-41d6-ad15-257d0e7a7187] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:07.819852 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e14d611a-78a3-4c2b-9e60-bb7ef68c6f8a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:07.827324 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e14d611a-78a3-4c2b-9e60-bb7ef68c6f8a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:07.827964 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e14d611a-78a3-4c2b-9e60-bb7ef68c6f8a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:07.829137 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e14d611a-78a3-4c2b-9e60-bb7ef68c6f8a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:07.831577 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e14d611a-78a3-4c2b-9e60-bb7ef68c6f8a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:07.832210 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e14d611a-78a3-4c2b-9e60-bb7ef68c6f8a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:09.305652 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e14d611a-78a3-4c2b-9e60-bb7ef68c6f8a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:09.319173 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e14d611a-78a3-4c2b-9e60-bb7ef68c6f8a tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187" status: 200 len: 1501 microversion: 2.1 time: 1.527381 Sep 16 13:03:09.324509 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1859/3619] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:07 2022] GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187 => generated 1501 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:03:09.338968 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3c21d0ee-b485-443c-81a2-b7ae9dbdfb62 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:09.341507 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3c21d0ee-b485-443c-81a2-b7ae9dbdfb62 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 97f1168a-0491-4d97-8cc9-59e1b27ababe] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:09.363599 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c21d0ee-b485-443c-81a2-b7ae9dbdfb62 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:09.364395 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c21d0ee-b485-443c-81a2-b7ae9dbdfb62 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:09.365214 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c21d0ee-b485-443c-81a2-b7ae9dbdfb62 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:09.366165 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c21d0ee-b485-443c-81a2-b7ae9dbdfb62 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:09.367087 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c21d0ee-b485-443c-81a2-b7ae9dbdfb62 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:09.367708 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c21d0ee-b485-443c-81a2-b7ae9dbdfb62 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:09.658995 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-bcc1e394-e3d6-42a7-9735-d3a39d761a3e tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:09.682134 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-bcc1e394-e3d6-42a7-9735-d3a39d761a3e tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:09.688369 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-bcc1e394-e3d6-42a7-9735-d3a39d761a3e tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:09.694618 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-bcc1e394-e3d6-42a7-9735-d3a39d761a3e tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1741 microversion: 2.20 time: 2.928858 Sep 16 13:03:09.706292 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1761/3620] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:03:06 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1741 bytes in 2934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:03:09.723706 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f2fca201-5dfd-49ae-a3ce-97b86002b749 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:09.725006 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f2fca201-5dfd-49ae-a3ce-97b86002b749 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:09.772605 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f2fca201-5dfd-49ae-a3ce-97b86002b749 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:09.773326 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f2fca201-5dfd-49ae-a3ce-97b86002b749 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:09.773892 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f2fca201-5dfd-49ae-a3ce-97b86002b749 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:09.774713 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f2fca201-5dfd-49ae-a3ce-97b86002b749 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:09.778460 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f2fca201-5dfd-49ae-a3ce-97b86002b749 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:09.787613 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f2fca201-5dfd-49ae-a3ce-97b86002b749 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:09.980051 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3c21d0ee-b485-443c-81a2-b7ae9dbdfb62 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed69c96e39249f181eda742be229b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeff399942c4286a71ea3a0eab43280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:10.005106 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3c21d0ee-b485-443c-81a2-b7ae9dbdfb62 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe" status: 200 len: 1316 microversion: 2.1 time: 0.679176 Sep 16 13:03:10.008259 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1860/3621] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:09 2022] GET /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe => generated 1316 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:10.031513 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f99efa9b-a612-41e6-a5c8-0d2bbcf13af3 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:03:10.036269 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f99efa9b-a612-41e6-a5c8-0d2bbcf13af3 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 8fc40271-fc32-41d6-ad15-257d0e7a7187] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:10.057189 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f99efa9b-a612-41e6-a5c8-0d2bbcf13af3 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:10.058205 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f99efa9b-a612-41e6-a5c8-0d2bbcf13af3 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:10.061050 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f99efa9b-a612-41e6-a5c8-0d2bbcf13af3 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:10.062616 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f99efa9b-a612-41e6-a5c8-0d2bbcf13af3 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:10.066614 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f99efa9b-a612-41e6-a5c8-0d2bbcf13af3 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:10.068440 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f99efa9b-a612-41e6-a5c8-0d2bbcf13af3 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:10.151442 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:03:10.163629 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-f99efa9b-a612-41e6-a5c8-0d2bbcf13af3 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lazy-loading 'flavor' on Instance uuid 8fc40271-fc32-41d6-ad15-257d0e7a7187 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:03:10.323739 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f99efa9b-a612-41e6-a5c8-0d2bbcf13af3 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "POST /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187/action" status: 202 len: 0 microversion: 2.1 time: 0.312059 Sep 16 13:03:10.327455 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1861/3622] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 13:03:10 2022] POST /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:03:10.351684 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1788f2d4-d3e8-493e-9215-2959722d6092 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:10.353055 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1788f2d4-d3e8-493e-9215-2959722d6092 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 8fc40271-fc32-41d6-ad15-257d0e7a7187] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:10.368545 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1788f2d4-d3e8-493e-9215-2959722d6092 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:10.371728 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1788f2d4-d3e8-493e-9215-2959722d6092 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:10.374070 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1788f2d4-d3e8-493e-9215-2959722d6092 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:10.374955 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1788f2d4-d3e8-493e-9215-2959722d6092 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:10.375723 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1788f2d4-d3e8-493e-9215-2959722d6092 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:10.376961 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1788f2d4-d3e8-493e-9215-2959722d6092 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:10.734618 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f2fca201-5dfd-49ae-a3ce-97b86002b749 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:10.752470 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f2fca201-5dfd-49ae-a3ce-97b86002b749 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1665 microversion: 2.1 time: 1.049656 Sep 16 13:03:10.753314 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1762/3623] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:09 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1665 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:10.778508 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-cee43345-c7ff-486c-810e-017637908db7 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:10.780016 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-cee43345-c7ff-486c-810e-017637908db7 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:10.787359 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cee43345-c7ff-486c-810e-017637908db7 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:10.788178 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cee43345-c7ff-486c-810e-017637908db7 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:10.788850 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cee43345-c7ff-486c-810e-017637908db7 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:10.790475 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cee43345-c7ff-486c-810e-017637908db7 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:10.791154 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cee43345-c7ff-486c-810e-017637908db7 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:10.791748 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cee43345-c7ff-486c-810e-017637908db7 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:10.851742 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1788f2d4-d3e8-493e-9215-2959722d6092 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:10.863012 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1788f2d4-d3e8-493e-9215-2959722d6092 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187" status: 200 len: 1509 microversion: 2.1 time: 0.528637 Sep 16 13:03:10.863971 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1862/3624] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:10 2022] GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187 => generated 1509 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:10.871765 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f9140a69-93cb-4bea-83ad-9463ea24ceb7 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1000790893"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:03:10.875660 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f9140a69-93cb-4bea-83ad-9463ea24ceb7 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:10.891686 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9140a69-93cb-4bea-83ad-9463ea24ceb7 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:10.892210 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9140a69-93cb-4bea-83ad-9463ea24ceb7 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:10.892652 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9140a69-93cb-4bea-83ad-9463ea24ceb7 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:10.895861 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9140a69-93cb-4bea-83ad-9463ea24ceb7 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:10.896645 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9140a69-93cb-4bea-83ad-9463ea24ceb7 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:10.897260 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9140a69-93cb-4bea-83ad-9463ea24ceb7 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:11.309385 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f9140a69-93cb-4bea-83ad-9463ea24ceb7 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "POST /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771/action" status: 202 len: 0 microversion: 2.1 time: 0.444005 Sep 16 13:03:11.310810 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1863/3625] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 13:03:10 2022] POST /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771/action => generated 0 bytes in 446 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 16 13:03:11.323176 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2f5cf7db-98b7-48de-8a14-41672f62fc63 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:11.324269 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2f5cf7db-98b7-48de-8a14-41672f62fc63 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 97f1168a-0491-4d97-8cc9-59e1b27ababe] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:11.339436 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f5cf7db-98b7-48de-8a14-41672f62fc63 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:11.340854 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f5cf7db-98b7-48de-8a14-41672f62fc63 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:11.341481 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f5cf7db-98b7-48de-8a14-41672f62fc63 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:11.344493 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f5cf7db-98b7-48de-8a14-41672f62fc63 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:11.345158 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f5cf7db-98b7-48de-8a14-41672f62fc63 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:11.345587 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f5cf7db-98b7-48de-8a14-41672f62fc63 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:11.359674 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-cee43345-c7ff-486c-810e-017637908db7 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:11.368545 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-cee43345-c7ff-486c-810e-017637908db7 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:11.369944 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-cee43345-c7ff-486c-810e-017637908db7 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:11.371358 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-cee43345-c7ff-486c-810e-017637908db7 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1741 microversion: 2.20 time: 0.599614 Sep 16 13:03:11.372090 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1763/3626] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:03:10 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1741 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:03:11.401230 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e1d2f1a1-461f-486f-9641-1224c7a3ca64 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:11.401870 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e1d2f1a1-461f-486f-9641-1224c7a3ca64 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:11.433345 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1d2f1a1-461f-486f-9641-1224c7a3ca64 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:11.434269 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1d2f1a1-461f-486f-9641-1224c7a3ca64 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:11.439917 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1d2f1a1-461f-486f-9641-1224c7a3ca64 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:11.441357 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1d2f1a1-461f-486f-9641-1224c7a3ca64 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:11.442005 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1d2f1a1-461f-486f-9641-1224c7a3ca64 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:11.442604 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1d2f1a1-461f-486f-9641-1224c7a3ca64 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:11.731451 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2f5cf7db-98b7-48de-8a14-41672f62fc63 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed69c96e39249f181eda742be229b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeff399942c4286a71ea3a0eab43280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:11.742886 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2f5cf7db-98b7-48de-8a14-41672f62fc63 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe" status: 200 len: 1316 microversion: 2.1 time: 0.428232 Sep 16 13:03:11.747254 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1864/3627] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:11 2022] GET /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe => generated 1316 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:11.790813 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e1d2f1a1-461f-486f-9641-1224c7a3ca64 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:11.802352 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e1d2f1a1-461f-486f-9641-1224c7a3ca64 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1675 microversion: 2.1 time: 0.412855 Sep 16 13:03:11.803847 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1764/3628] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:11 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1675 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:11.891614 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0faa0dc3-640e-4324-b88c-f93efcf37678 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:11.892265 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0faa0dc3-640e-4324-b88c-f93efcf37678 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 8fc40271-fc32-41d6-ad15-257d0e7a7187] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:11.902389 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0faa0dc3-640e-4324-b88c-f93efcf37678 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:11.902906 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0faa0dc3-640e-4324-b88c-f93efcf37678 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:11.903329 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0faa0dc3-640e-4324-b88c-f93efcf37678 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:11.904042 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0faa0dc3-640e-4324-b88c-f93efcf37678 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:11.904525 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0faa0dc3-640e-4324-b88c-f93efcf37678 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:11.915093 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0faa0dc3-640e-4324-b88c-f93efcf37678 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:12.105082 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0faa0dc3-640e-4324-b88c-f93efcf37678 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:12.114006 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0faa0dc3-640e-4324-b88c-f93efcf37678 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187" status: 200 len: 1492 microversion: 2.1 time: 0.226305 Sep 16 13:03:12.114593 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1865/3629] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:11 2022] GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187 => generated 1492 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:12.144427 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b0f7873e-b4f3-42dc-8067-214e35437135 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:12.144545 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b0f7873e-b4f3-42dc-8067-214e35437135 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 8fc40271-fc32-41d6-ad15-257d0e7a7187] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:12.164163 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b0f7873e-b4f3-42dc-8067-214e35437135 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:12.164937 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b0f7873e-b4f3-42dc-8067-214e35437135 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:12.165593 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b0f7873e-b4f3-42dc-8067-214e35437135 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:12.166502 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b0f7873e-b4f3-42dc-8067-214e35437135 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:12.167154 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b0f7873e-b4f3-42dc-8067-214e35437135 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:12.167857 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b0f7873e-b4f3-42dc-8067-214e35437135 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:12.244878 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b0f7873e-b4f3-42dc-8067-214e35437135 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 8fc40271-fc32-41d6-ad15-257d0e7a7187] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:03:12.401297 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7c58a0d0-0bf7-44b5-995b-cc792c9b3581 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:12.401873 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7c58a0d0-0bf7-44b5-995b-cc792c9b3581 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:12.420220 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c58a0d0-0bf7-44b5-995b-cc792c9b3581 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:12.420729 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c58a0d0-0bf7-44b5-995b-cc792c9b3581 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:12.424095 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c58a0d0-0bf7-44b5-995b-cc792c9b3581 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:12.425285 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c58a0d0-0bf7-44b5-995b-cc792c9b3581 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:12.427334 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c58a0d0-0bf7-44b5-995b-cc792c9b3581 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:12.428653 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c58a0d0-0bf7-44b5-995b-cc792c9b3581 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:12.510544 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b0f7873e-b4f3-42dc-8067-214e35437135 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "DELETE /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187" status: 204 len: 0 microversion: 2.1 time: 0.362481 Sep 16 13:03:12.532243 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1765/3630] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 13:03:12 2022] DELETE /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:03:12.565286 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-59d339a2-7029-409c-9786-69c2daa99621 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:12.566235 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-59d339a2-7029-409c-9786-69c2daa99621 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 8fc40271-fc32-41d6-ad15-257d0e7a7187] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:12.610929 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-59d339a2-7029-409c-9786-69c2daa99621 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:12.612951 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-59d339a2-7029-409c-9786-69c2daa99621 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:12.618324 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-59d339a2-7029-409c-9786-69c2daa99621 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:12.619426 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-59d339a2-7029-409c-9786-69c2daa99621 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:12.624361 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-59d339a2-7029-409c-9786-69c2daa99621 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:12.625225 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-59d339a2-7029-409c-9786-69c2daa99621 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:13.078993 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-59d339a2-7029-409c-9786-69c2daa99621 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:13.098399 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-59d339a2-7029-409c-9786-69c2daa99621 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187" status: 200 len: 1498 microversion: 2.1 time: 0.551096 Sep 16 13:03:13.100377 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1766/3631] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:12 2022] GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187 => generated 1498 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:13.105422 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c654eb06-d340-498d-9763-7cf073bb55ed tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:13.112677 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c654eb06-d340-498d-9763-7cf073bb55ed tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 97f1168a-0491-4d97-8cc9-59e1b27ababe] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:13.148341 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c654eb06-d340-498d-9763-7cf073bb55ed tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:13.149267 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c654eb06-d340-498d-9763-7cf073bb55ed tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:13.150107 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c654eb06-d340-498d-9763-7cf073bb55ed tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:13.151390 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c654eb06-d340-498d-9763-7cf073bb55ed tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:13.152079 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c654eb06-d340-498d-9763-7cf073bb55ed tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:13.152720 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c654eb06-d340-498d-9763-7cf073bb55ed tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:13.210259 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7c58a0d0-0bf7-44b5-995b-cc792c9b3581 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:13.227567 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7c58a0d0-0bf7-44b5-995b-cc792c9b3581 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:13.237174 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7c58a0d0-0bf7-44b5-995b-cc792c9b3581 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:13.238430 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7c58a0d0-0bf7-44b5-995b-cc792c9b3581 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1741 microversion: 2.20 time: 0.842082 Sep 16 13:03:13.239018 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1866/3632] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:03:12 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1741 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:03:13.278281 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e1224bc5-e2d1-48fb-8b06-d36481aa9f9f tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:13.281426 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e1224bc5-e2d1-48fb-8b06-d36481aa9f9f tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:13.294035 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1224bc5-e2d1-48fb-8b06-d36481aa9f9f tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:13.295896 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1224bc5-e2d1-48fb-8b06-d36481aa9f9f tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:13.298363 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1224bc5-e2d1-48fb-8b06-d36481aa9f9f tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:13.299379 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1224bc5-e2d1-48fb-8b06-d36481aa9f9f tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:13.300114 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1224bc5-e2d1-48fb-8b06-d36481aa9f9f tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:13.300758 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1224bc5-e2d1-48fb-8b06-d36481aa9f9f tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:13.579150 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e1224bc5-e2d1-48fb-8b06-d36481aa9f9f tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:13.591620 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e1224bc5-e2d1-48fb-8b06-d36481aa9f9f tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1675 microversion: 2.1 time: 0.319734 Sep 16 13:03:13.598848 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1867/3633] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:13 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1675 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:13.612919 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-dfe386a6-4fae-4c42-952c-cf4edac60118 req-66a596e8-3f80-46c9-84ca-7d5662a6f2fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97f1168a-0491-4d97-8cc9-59e1b27ababe", "name": "network-vif-plugged", "status": "completed", "tag": "4c0896cf-3255-42ff-b580-d2a345dbb96d"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:03:13.638039 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dfe386a6-4fae-4c42-952c-cf4edac60118 req-66a596e8-3f80-46c9-84ca-7d5662a6f2fb service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:13.640783 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dfe386a6-4fae-4c42-952c-cf4edac60118 req-66a596e8-3f80-46c9-84ca-7d5662a6f2fb service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:13.641450 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dfe386a6-4fae-4c42-952c-cf4edac60118 req-66a596e8-3f80-46c9-84ca-7d5662a6f2fb service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:13.648456 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c654eb06-d340-498d-9763-7cf073bb55ed tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed69c96e39249f181eda742be229b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeff399942c4286a71ea3a0eab43280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:13.658270 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c654eb06-d340-498d-9763-7cf073bb55ed tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe" status: 200 len: 1316 microversion: 2.1 time: 0.556533 Sep 16 13:03:13.665288 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1767/3634] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:13 2022] GET /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe => generated 1316 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:13.687822 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-dfe386a6-4fae-4c42-952c-cf4edac60118 req-66a596e8-3f80-46c9-84ca-7d5662a6f2fb service nova] Creating event network-vif-plugged:4c0896cf-3255-42ff-b580-d2a345dbb96d for instance 97f1168a-0491-4d97-8cc9-59e1b27ababe on n-h1-858094-4 Sep 16 13:03:13.695673 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-dfe386a6-4fae-4c42-952c-cf4edac60118 req-66a596e8-3f80-46c9-84ca-7d5662a6f2fb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095017 Sep 16 13:03:13.701121 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1868/3635] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:03:14.128936 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e5b94628-bb21-41b5-a463-3b740324eeb9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:14.130642 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e5b94628-bb21-41b5-a463-3b740324eeb9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 8fc40271-fc32-41d6-ad15-257d0e7a7187] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:14.144773 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e5b94628-bb21-41b5-a463-3b740324eeb9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:14.153693 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e5b94628-bb21-41b5-a463-3b740324eeb9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:14.154668 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e5b94628-bb21-41b5-a463-3b740324eeb9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:14.155576 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e5b94628-bb21-41b5-a463-3b740324eeb9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:14.167292 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e5b94628-bb21-41b5-a463-3b740324eeb9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:14.168400 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e5b94628-bb21-41b5-a463-3b740324eeb9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:14.273202 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-62ed935b-6412-4dc3-b0f4-54927d45cb99 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:14.274137 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-62ed935b-6412-4dc3-b0f4-54927d45cb99 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:14.292060 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62ed935b-6412-4dc3-b0f4-54927d45cb99 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:14.294029 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62ed935b-6412-4dc3-b0f4-54927d45cb99 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:14.298410 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62ed935b-6412-4dc3-b0f4-54927d45cb99 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:14.299530 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62ed935b-6412-4dc3-b0f4-54927d45cb99 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:14.300158 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62ed935b-6412-4dc3-b0f4-54927d45cb99 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:14.300737 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62ed935b-6412-4dc3-b0f4-54927d45cb99 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:14.450568 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e5b94628-bb21-41b5-a463-3b740324eeb9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:14.465890 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e5b94628-bb21-41b5-a463-3b740324eeb9 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187" status: 200 len: 1498 microversion: 2.1 time: 0.341225 Sep 16 13:03:14.466817 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1768/3636] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:14 2022] GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187 => generated 1498 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:14.625597 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9e154785-5951-4be6-a3be-3909a5faf47e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:14.626627 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9e154785-5951-4be6-a3be-3909a5faf47e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:14.640901 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9e154785-5951-4be6-a3be-3909a5faf47e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:14.641711 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9e154785-5951-4be6-a3be-3909a5faf47e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:14.642370 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9e154785-5951-4be6-a3be-3909a5faf47e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:14.649179 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9e154785-5951-4be6-a3be-3909a5faf47e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:14.649985 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9e154785-5951-4be6-a3be-3909a5faf47e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:14.650889 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9e154785-5951-4be6-a3be-3909a5faf47e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:14.846923 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-62ed935b-6412-4dc3-b0f4-54927d45cb99 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:14.862049 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-62ed935b-6412-4dc3-b0f4-54927d45cb99 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:14.874954 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-62ed935b-6412-4dc3-b0f4-54927d45cb99 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:14.877609 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-62ed935b-6412-4dc3-b0f4-54927d45cb99 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1741 microversion: 2.20 time: 0.610104 Sep 16 13:03:14.879495 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1869/3637] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:03:14 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1741 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:03:14.892499 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bc33d76c-fa7f-4ff1-ad0e-ce6d831a57b0 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:14.894543 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bc33d76c-fa7f-4ff1-ad0e-ce6d831a57b0 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 97f1168a-0491-4d97-8cc9-59e1b27ababe] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:14.914935 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc33d76c-fa7f-4ff1-ad0e-ce6d831a57b0 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:14.916737 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc33d76c-fa7f-4ff1-ad0e-ce6d831a57b0 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:14.922195 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc33d76c-fa7f-4ff1-ad0e-ce6d831a57b0 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:14.926186 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc33d76c-fa7f-4ff1-ad0e-ce6d831a57b0 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:14.927039 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc33d76c-fa7f-4ff1-ad0e-ce6d831a57b0 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:14.927729 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc33d76c-fa7f-4ff1-ad0e-ce6d831a57b0 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:14.987701 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9e154785-5951-4be6-a3be-3909a5faf47e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:14.997655 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9e154785-5951-4be6-a3be-3909a5faf47e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1683 microversion: 2.1 time: 0.375976 Sep 16 13:03:15.001443 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1769/3638] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:14 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1683 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:03:15.487425 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bc33d76c-fa7f-4ff1-ad0e-ce6d831a57b0 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed69c96e39249f181eda742be229b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeff399942c4286a71ea3a0eab43280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:15.498720 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-64acb8ea-65ab-471d-a967-36fb05680f86 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:15.500490 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-64acb8ea-65ab-471d-a967-36fb05680f86 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 8fc40271-fc32-41d6-ad15-257d0e7a7187] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:15.527281 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bc33d76c-fa7f-4ff1-ad0e-ce6d831a57b0 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe" status: 200 len: 1316 microversion: 2.1 time: 0.625295 Sep 16 13:03:15.531299 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1870/3639] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:14 2022] GET /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe => generated 1316 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:15.535999 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-64acb8ea-65ab-471d-a967-36fb05680f86 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:15.536800 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-64acb8ea-65ab-471d-a967-36fb05680f86 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:15.537507 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-64acb8ea-65ab-471d-a967-36fb05680f86 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:15.540858 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-64acb8ea-65ab-471d-a967-36fb05680f86 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:15.543714 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-64acb8ea-65ab-471d-a967-36fb05680f86 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:15.544752 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-64acb8ea-65ab-471d-a967-36fb05680f86 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:15.613517 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-9ca02bdd-14e7-4d41-96a3-c7037581e248 req-99a25c3d-bf24-48a6-8342-3ac0ce4e0a0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fc40271-fc32-41d6-ad15-257d0e7a7187", "name": "network-vif-deleted", "tag": "3cf4e4b2-bd6e-451e-ade5-fc4aeac4adf1"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:03:15.645740 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:03:15.657003 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9ca02bdd-14e7-4d41-96a3-c7037581e248 req-99a25c3d-bf24-48a6-8342-3ac0ce4e0a0f service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:15.660635 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9ca02bdd-14e7-4d41-96a3-c7037581e248 req-99a25c3d-bf24-48a6-8342-3ac0ce4e0a0f service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:15.663061 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9ca02bdd-14e7-4d41-96a3-c7037581e248 req-99a25c3d-bf24-48a6-8342-3ac0ce4e0a0f service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:15.723934 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-9ca02bdd-14e7-4d41-96a3-c7037581e248 req-99a25c3d-bf24-48a6-8342-3ac0ce4e0a0f service nova] Creating event network-vif-deleted:3cf4e4b2-bd6e-451e-ade5-fc4aeac4adf1 for instance 8fc40271-fc32-41d6-ad15-257d0e7a7187 on n-h2-858094-4 Sep 16 13:03:15.739947 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-9ca02bdd-14e7-4d41-96a3-c7037581e248 req-99a25c3d-bf24-48a6-8342-3ac0ce4e0a0f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126113 Sep 16 13:03:15.745517 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1871/3640] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:03:15.766488 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-52967e6d-46f0-4136-8b62-03d68b4971f8 req-297ba53f-dae1-48dc-9fab-b7c48f51bf7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af5e660b-de79-42ca-a8de-fe06738b9771", "name": "network-vif-unplugged", "status": "completed", "tag": "3af800e8-0d1f-497b-bca5-8901587cb91c"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:03:15.787019 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-64acb8ea-65ab-471d-a967-36fb05680f86 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e531a7026054c34b2a78a1c484cbe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe82d8dd4fb42cbb054a6f069424c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:15.798309 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-64acb8ea-65ab-471d-a967-36fb05680f86 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187" status: 200 len: 1456 microversion: 2.1 time: 0.309076 Sep 16 13:03:15.798645 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-52967e6d-46f0-4136-8b62-03d68b4971f8 req-297ba53f-dae1-48dc-9fab-b7c48f51bf7f service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:15.800335 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-52967e6d-46f0-4136-8b62-03d68b4971f8 req-297ba53f-dae1-48dc-9fab-b7c48f51bf7f service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:15.802428 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-52967e6d-46f0-4136-8b62-03d68b4971f8 req-297ba53f-dae1-48dc-9fab-b7c48f51bf7f service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:15.802946 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1770/3641] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:15 2022] GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187 => generated 1456 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:03:15.848842 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-52967e6d-46f0-4136-8b62-03d68b4971f8 req-297ba53f-dae1-48dc-9fab-b7c48f51bf7f service nova] Creating event network-vif-unplugged:3af800e8-0d1f-497b-bca5-8901587cb91c for instance af5e660b-de79-42ca-a8de-fe06738b9771 on n-h2-858094-4 Sep 16 13:03:15.865486 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-52967e6d-46f0-4136-8b62-03d68b4971f8 req-297ba53f-dae1-48dc-9fab-b7c48f51bf7f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116935 Sep 16 13:03:15.869402 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1872/3642] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:03:15.911394 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-16fb628e-b7ca-4036-bd5e-9ec4dc67f1d1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:15.912505 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-16fb628e-b7ca-4036-bd5e-9ec4dc67f1d1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:15.936476 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-16fb628e-b7ca-4036-bd5e-9ec4dc67f1d1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:15.937393 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-16fb628e-b7ca-4036-bd5e-9ec4dc67f1d1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:15.938716 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-16fb628e-b7ca-4036-bd5e-9ec4dc67f1d1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:15.941731 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-16fb628e-b7ca-4036-bd5e-9ec4dc67f1d1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:15.945643 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-16fb628e-b7ca-4036-bd5e-9ec4dc67f1d1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:15.948053 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-16fb628e-b7ca-4036-bd5e-9ec4dc67f1d1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:16.029936 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ea70eafd-1aaf-49fc-9563-326ac8387786 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:16.031078 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ea70eafd-1aaf-49fc-9563-326ac8387786 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:16.047092 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea70eafd-1aaf-49fc-9563-326ac8387786 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:16.049929 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea70eafd-1aaf-49fc-9563-326ac8387786 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:16.050675 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea70eafd-1aaf-49fc-9563-326ac8387786 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:16.051634 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea70eafd-1aaf-49fc-9563-326ac8387786 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:16.052383 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea70eafd-1aaf-49fc-9563-326ac8387786 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:16.053067 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea70eafd-1aaf-49fc-9563-326ac8387786 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:16.474641 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-16fb628e-b7ca-4036-bd5e-9ec4dc67f1d1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:16.484331 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-16fb628e-b7ca-4036-bd5e-9ec4dc67f1d1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:16.488177 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-16fb628e-b7ca-4036-bd5e-9ec4dc67f1d1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:16.489420 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-16fb628e-b7ca-4036-bd5e-9ec4dc67f1d1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1741 microversion: 2.20 time: 0.582481 Sep 16 13:03:16.495542 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1771/3643] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:03:15 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1741 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:03:16.554245 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-db352ce6-235e-4f70-af89-547602221bd4 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:16.555006 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-db352ce6-235e-4f70-af89-547602221bd4 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 97f1168a-0491-4d97-8cc9-59e1b27ababe] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:16.567841 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ea70eafd-1aaf-49fc-9563-326ac8387786 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:16.578590 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db352ce6-235e-4f70-af89-547602221bd4 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:16.601018 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db352ce6-235e-4f70-af89-547602221bd4 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:16.601470 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db352ce6-235e-4f70-af89-547602221bd4 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:16.602416 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db352ce6-235e-4f70-af89-547602221bd4 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:16.602839 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db352ce6-235e-4f70-af89-547602221bd4 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:16.603268 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-db352ce6-235e-4f70-af89-547602221bd4 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:16.612619 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ea70eafd-1aaf-49fc-9563-326ac8387786 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1683 microversion: 2.1 time: 0.570053 Sep 16 13:03:16.615254 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1873/3644] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:16 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1683 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:16.830254 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-32273fac-9769-43f7-8e43-9d89691a4df5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:16.830872 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-32273fac-9769-43f7-8e43-9d89691a4df5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 8fc40271-fc32-41d6-ad15-257d0e7a7187] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:16.846388 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32273fac-9769-43f7-8e43-9d89691a4df5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:16.846889 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32273fac-9769-43f7-8e43-9d89691a4df5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:16.847327 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32273fac-9769-43f7-8e43-9d89691a4df5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:16.848033 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32273fac-9769-43f7-8e43-9d89691a4df5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:16.858165 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32273fac-9769-43f7-8e43-9d89691a4df5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:16.860570 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32273fac-9769-43f7-8e43-9d89691a4df5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:16.909938 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-32273fac-9769-43f7-8e43-9d89691a4df5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] HTTP exception thrown: Instance 8fc40271-fc32-41d6-ad15-257d0e7a7187 could not be found. Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-32273fac-9769-43f7-8e43-9d89691a4df5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Request method failure captured: Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187 HTTP/1.1 Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHK-ai74OxrHHqL5ZA97hOvy32Q6xIReVrKhZIj6PEPyQ_UB4rFs-7hdJCkozKZ5clo_9DaVkBFgsUmiSN_gmVaPdL8FT-f5QYKPk-CE61XDTK1RMhpnQkeVMlba4E4KaPfDCDA8WSNup3uH3mzkxsd2kp-OesctbTYQkqWqHnAvC3I Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_cfe82d8dd4fb42cbb054a6f069424c57", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-DeleteServersTestJSON-1385458479-project Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 2e531a7026054c34b2a78a1c484cbe02 Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-DeleteServersTestJSON-1385458479-project Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 8fc40271-fc32-41d6-ad15-257d0e7a7187 could not be found. Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '8fc40271-fc32-41d6-ad15-257d0e7a7187'} Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fc40271-fc32-41d6-ad15-257d0e7a7187 could not be found. Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fc40271-fc32-41d6-ad15-257d0e7a7187 could not be found. Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:16.911613 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:16.916617 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:16.916617 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:03:16.916617 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:03:16.916617 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:03:16.916617 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:03:16.916617 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fc40271-fc32-41d6-ad15-257d0e7a7187 could not be found. Sep 16 13:03:16.916617 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:16.916617 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-32273fac-9769-43f7-8e43-9d89691a4df5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Returning 404 to user: Instance 8fc40271-fc32-41d6-ad15-257d0e7a7187 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:03:16.916617 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-32273fac-9769-43f7-8e43-9d89691a4df5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187" status: 404 len: 111 microversion: 2.1 time: 0.087028 Sep 16 13:03:16.921255 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1874/3645] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:16 2022] GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:03:16.944808 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4a401463-75a1-4ee1-99fb-9f15e06bfba1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:16.945346 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4a401463-75a1-4ee1-99fb-9f15e06bfba1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 8fc40271-fc32-41d6-ad15-257d0e7a7187] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:16.965472 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a401463-75a1-4ee1-99fb-9f15e06bfba1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:16.966384 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a401463-75a1-4ee1-99fb-9f15e06bfba1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:16.967071 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a401463-75a1-4ee1-99fb-9f15e06bfba1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:16.968112 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a401463-75a1-4ee1-99fb-9f15e06bfba1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:16.968931 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a401463-75a1-4ee1-99fb-9f15e06bfba1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:16.972766 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a401463-75a1-4ee1-99fb-9f15e06bfba1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:16.990757 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-db352ce6-235e-4f70-af89-547602221bd4 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed69c96e39249f181eda742be229b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeff399942c4286a71ea3a0eab43280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:16.999590 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-4a401463-75a1-4ee1-99fb-9f15e06bfba1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] HTTP exception thrown: Instance 8fc40271-fc32-41d6-ad15-257d0e7a7187 could not be found. Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4a401463-75a1-4ee1-99fb-9f15e06bfba1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Request method failure captured: Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187 HTTP/1.1 Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHK-ai74OxrHHqL5ZA97hOvy32Q6xIReVrKhZIj6PEPyQ_UB4rFs-7hdJCkozKZ5clo_9DaVkBFgsUmiSN_gmVaPdL8FT-f5QYKPk-CE61XDTK1RMhpnQkeVMlba4E4KaPfDCDA8WSNup3uH3mzkxsd2kp-OesctbTYQkqWqHnAvC3I Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_cfe82d8dd4fb42cbb054a6f069424c57", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-DeleteServersTestJSON-1385458479-project Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 2e531a7026054c34b2a78a1c484cbe02 Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-DeleteServersTestJSON-1385458479-project Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 8fc40271-fc32-41d6-ad15-257d0e7a7187 could not be found. Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '8fc40271-fc32-41d6-ad15-257d0e7a7187'} Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fc40271-fc32-41d6-ad15-257d0e7a7187 could not be found. Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:03:17.001840 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:03:17.007341 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fc40271-fc32-41d6-ad15-257d0e7a7187 could not be found. Sep 16 13:03:17.007341 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:17.007341 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:17.007341 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:17.007341 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:17.007341 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:03:17.007341 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:03:17.007341 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:03:17.007341 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:03:17.007341 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fc40271-fc32-41d6-ad15-257d0e7a7187 could not be found. Sep 16 13:03:17.007341 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:17.008845 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-db352ce6-235e-4f70-af89-547602221bd4 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe" status: 200 len: 1504 microversion: 2.1 time: 0.456720 Sep 16 13:03:17.010254 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4a401463-75a1-4ee1-99fb-9f15e06bfba1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Returning 404 to user: Instance 8fc40271-fc32-41d6-ad15-257d0e7a7187 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:03:17.011404 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4a401463-75a1-4ee1-99fb-9f15e06bfba1 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "DELETE /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187" status: 404 len: 111 microversion: 2.1 time: 0.086179 Sep 16 13:03:17.012646 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1875/3646] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 13:03:16 2022] DELETE /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:03:17.018022 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1772/3647] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:16 2022] GET /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe => generated 1504 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:17.039336 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cdcf6dfa-a6ab-4df7-8dbc-48ded76c0713 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:17.040452 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cdcf6dfa-a6ab-4df7-8dbc-48ded76c0713 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 8fc40271-fc32-41d6-ad15-257d0e7a7187] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:17.047163 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-48fbdca1-482c-40f0-b65a-97c8793655d8 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-894032873"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:03:17.060257 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-48fbdca1-482c-40f0-b65a-97c8793655d8 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 97f1168a-0491-4d97-8cc9-59e1b27ababe] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:17.071685 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cdcf6dfa-a6ab-4df7-8dbc-48ded76c0713 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:17.072688 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cdcf6dfa-a6ab-4df7-8dbc-48ded76c0713 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:17.073390 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cdcf6dfa-a6ab-4df7-8dbc-48ded76c0713 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:17.075322 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cdcf6dfa-a6ab-4df7-8dbc-48ded76c0713 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:17.076039 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-48fbdca1-482c-40f0-b65a-97c8793655d8 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:17.076203 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cdcf6dfa-a6ab-4df7-8dbc-48ded76c0713 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:17.076563 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-48fbdca1-482c-40f0-b65a-97c8793655d8 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:17.076994 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-48fbdca1-482c-40f0-b65a-97c8793655d8 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:17.077584 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cdcf6dfa-a6ab-4df7-8dbc-48ded76c0713 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:17.077710 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-48fbdca1-482c-40f0-b65a-97c8793655d8 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:17.078122 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-48fbdca1-482c-40f0-b65a-97c8793655d8 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:17.078537 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-48fbdca1-482c-40f0-b65a-97c8793655d8 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:17.147338 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:03:17.160267 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-cdcf6dfa-a6ab-4df7-8dbc-48ded76c0713 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] HTTP exception thrown: Instance 8fc40271-fc32-41d6-ad15-257d0e7a7187 could not be found. Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cdcf6dfa-a6ab-4df7-8dbc-48ded76c0713 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Request method failure captured: Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187 HTTP/1.1 Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHK-ai74OxrHHqL5ZA97hOvy32Q6xIReVrKhZIj6PEPyQ_UB4rFs-7hdJCkozKZ5clo_9DaVkBFgsUmiSN_gmVaPdL8FT-f5QYKPk-CE61XDTK1RMhpnQkeVMlba4E4KaPfDCDA8WSNup3uH3mzkxsd2kp-OesctbTYQkqWqHnAvC3I Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_cfe82d8dd4fb42cbb054a6f069424c57", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-DeleteServersTestJSON-1385458479-project Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 2e531a7026054c34b2a78a1c484cbe02 Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-DeleteServersTestJSON-1385458479-project Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 8fc40271-fc32-41d6-ad15-257d0e7a7187 could not be found. Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '8fc40271-fc32-41d6-ad15-257d0e7a7187'} Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fc40271-fc32-41d6-ad15-257d0e7a7187 could not be found. Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fc40271-fc32-41d6-ad15-257d0e7a7187 could not be found. Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:17.171269 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:17.177062 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:17.177062 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:03:17.177062 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:03:17.177062 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:03:17.177062 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:03:17.177062 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fc40271-fc32-41d6-ad15-257d0e7a7187 could not be found. Sep 16 13:03:17.177062 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:17.177062 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cdcf6dfa-a6ab-4df7-8dbc-48ded76c0713 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Returning 404 to user: Instance 8fc40271-fc32-41d6-ad15-257d0e7a7187 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:03:17.179360 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cdcf6dfa-a6ab-4df7-8dbc-48ded76c0713 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187" status: 404 len: 111 microversion: 2.1 time: 0.162787 Sep 16 13:03:17.186168 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1876/3648] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:17 2022] GET /compute/v2.1/servers/8fc40271-fc32-41d6-ad15-257d0e7a7187 => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:03:17.198244 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5506982c-b57e-499c-8d06-d4e5e6795f95 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:17.201670 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5506982c-b57e-499c-8d06-d4e5e6795f95 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:17.218588 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5506982c-b57e-499c-8d06-d4e5e6795f95 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:17.219545 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5506982c-b57e-499c-8d06-d4e5e6795f95 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:17.220415 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5506982c-b57e-499c-8d06-d4e5e6795f95 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:17.221325 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5506982c-b57e-499c-8d06-d4e5e6795f95 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:17.222172 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5506982c-b57e-499c-8d06-d4e5e6795f95 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:17.223207 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5506982c-b57e-499c-8d06-d4e5e6795f95 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:17.268077 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-5506982c-b57e-499c-8d06-d4e5e6795f95 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] HTTP exception thrown: Instance 2074945c-006a-4c9a-91db-b3029d04112c could not be found. Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5506982c-b57e-499c-8d06-d4e5e6795f95 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Request method failure captured: Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c HTTP/1.1 Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHK-ai74OxrHHqL5ZA97hOvy32Q6xIReVrKhZIj6PEPyQ_UB4rFs-7hdJCkozKZ5clo_9DaVkBFgsUmiSN_gmVaPdL8FT-f5QYKPk-CE61XDTK1RMhpnQkeVMlba4E4KaPfDCDA8WSNup3uH3mzkxsd2kp-OesctbTYQkqWqHnAvC3I Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_cfe82d8dd4fb42cbb054a6f069424c57", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-DeleteServersTestJSON-1385458479-project Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 2e531a7026054c34b2a78a1c484cbe02 Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-DeleteServersTestJSON-1385458479-project Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 2074945c-006a-4c9a-91db-b3029d04112c could not be found. Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '2074945c-006a-4c9a-91db-b3029d04112c'} Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2074945c-006a-4c9a-91db-b3029d04112c could not be found. Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:03:17.276640 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:03:17.284110 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2074945c-006a-4c9a-91db-b3029d04112c could not be found. Sep 16 13:03:17.284110 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:17.284110 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:17.284110 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:17.284110 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:17.284110 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:03:17.284110 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:03:17.284110 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:03:17.284110 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:03:17.284110 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2074945c-006a-4c9a-91db-b3029d04112c could not be found. Sep 16 13:03:17.284110 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:17.287237 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5506982c-b57e-499c-8d06-d4e5e6795f95 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Returning 404 to user: Instance 2074945c-006a-4c9a-91db-b3029d04112c could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:03:17.288393 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5506982c-b57e-499c-8d06-d4e5e6795f95 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "DELETE /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c" status: 404 len: 111 microversion: 2.1 time: 0.101171 Sep 16 13:03:17.289188 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1877/3649] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 13:03:17 2022] DELETE /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:03:17.299132 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-13e27e42-3e84-4a5b-80bb-b6a0841d14dd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:17.300421 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-13e27e42-3e84-4a5b-80bb-b6a0841d14dd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 2074945c-006a-4c9a-91db-b3029d04112c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:17.317153 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13e27e42-3e84-4a5b-80bb-b6a0841d14dd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:17.318051 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13e27e42-3e84-4a5b-80bb-b6a0841d14dd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:17.318711 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13e27e42-3e84-4a5b-80bb-b6a0841d14dd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:17.325556 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13e27e42-3e84-4a5b-80bb-b6a0841d14dd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:17.326384 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13e27e42-3e84-4a5b-80bb-b6a0841d14dd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:17.327045 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13e27e42-3e84-4a5b-80bb-b6a0841d14dd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:17.358087 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-13e27e42-3e84-4a5b-80bb-b6a0841d14dd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] HTTP exception thrown: Instance 2074945c-006a-4c9a-91db-b3029d04112c could not be found. Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-13e27e42-3e84-4a5b-80bb-b6a0841d14dd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Request method failure captured: Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c HTTP/1.1 Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHK-ai74OxrHHqL5ZA97hOvy32Q6xIReVrKhZIj6PEPyQ_UB4rFs-7hdJCkozKZ5clo_9DaVkBFgsUmiSN_gmVaPdL8FT-f5QYKPk-CE61XDTK1RMhpnQkeVMlba4E4KaPfDCDA8WSNup3uH3mzkxsd2kp-OesctbTYQkqWqHnAvC3I Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_cfe82d8dd4fb42cbb054a6f069424c57", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-DeleteServersTestJSON-1385458479-project Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 2e531a7026054c34b2a78a1c484cbe02 Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-DeleteServersTestJSON-1385458479-project Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 2074945c-006a-4c9a-91db-b3029d04112c could not be found. Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '2074945c-006a-4c9a-91db-b3029d04112c'} Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2074945c-006a-4c9a-91db-b3029d04112c could not be found. Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2074945c-006a-4c9a-91db-b3029d04112c could not be found. Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:17.366223 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:17.371535 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:17.371535 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:03:17.371535 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:03:17.371535 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:03:17.371535 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:03:17.371535 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2074945c-006a-4c9a-91db-b3029d04112c could not be found. Sep 16 13:03:17.371535 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:17.375572 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-13e27e42-3e84-4a5b-80bb-b6a0841d14dd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Returning 404 to user: Instance 2074945c-006a-4c9a-91db-b3029d04112c could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:03:17.377452 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-13e27e42-3e84-4a5b-80bb-b6a0841d14dd tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c" status: 404 len: 111 microversion: 2.1 time: 0.082124 Sep 16 13:03:17.378796 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1878/3650] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:17 2022] GET /compute/v2.1/servers/2074945c-006a-4c9a-91db-b3029d04112c => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 13:03:17.392628 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bb42664e-6e99-4340-92cd-e6b126c83d40 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:17.398376 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bb42664e-6e99-4340-92cd-e6b126c83d40 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:17.410054 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.network.security_group_api [None req-48fbdca1-482c-40f0-b65a-97c8793655d8 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Adding security group 0334b825-3168-491b-9d7c-628d6248aee3 to port 4c0896cf-3255-42ff-b580-d2a345dbb96d Sep 16 13:03:17.410753 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb42664e-6e99-4340-92cd-e6b126c83d40 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:17.412555 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb42664e-6e99-4340-92cd-e6b126c83d40 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:17.413967 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb42664e-6e99-4340-92cd-e6b126c83d40 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:17.416587 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb42664e-6e99-4340-92cd-e6b126c83d40 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:17.417498 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb42664e-6e99-4340-92cd-e6b126c83d40 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:17.419876 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb42664e-6e99-4340-92cd-e6b126c83d40 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:17.444828 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-bb42664e-6e99-4340-92cd-e6b126c83d40 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] HTTP exception thrown: Instance 464c1886-1201-4b29-b61a-727d5c9e22b6 could not be found. Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bb42664e-6e99-4340-92cd-e6b126c83d40 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Request method failure captured: Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 HTTP/1.1 Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHK-ai74OxrHHqL5ZA97hOvy32Q6xIReVrKhZIj6PEPyQ_UB4rFs-7hdJCkozKZ5clo_9DaVkBFgsUmiSN_gmVaPdL8FT-f5QYKPk-CE61XDTK1RMhpnQkeVMlba4E4KaPfDCDA8WSNup3uH3mzkxsd2kp-OesctbTYQkqWqHnAvC3I Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_cfe82d8dd4fb42cbb054a6f069424c57", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-DeleteServersTestJSON-1385458479-project Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 2e531a7026054c34b2a78a1c484cbe02 Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-DeleteServersTestJSON-1385458479-project Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 464c1886-1201-4b29-b61a-727d5c9e22b6 could not be found. Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '464c1886-1201-4b29-b61a-727d5c9e22b6'} Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 464c1886-1201-4b29-b61a-727d5c9e22b6 could not be found. Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:03:17.447661 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:03:17.455941 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 464c1886-1201-4b29-b61a-727d5c9e22b6 could not be found. Sep 16 13:03:17.455941 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:17.455941 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:17.455941 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:17.455941 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:17.455941 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:03:17.455941 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:03:17.455941 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:03:17.455941 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:03:17.455941 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 464c1886-1201-4b29-b61a-727d5c9e22b6 could not be found. Sep 16 13:03:17.455941 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:17.458660 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bb42664e-6e99-4340-92cd-e6b126c83d40 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Returning 404 to user: Instance 464c1886-1201-4b29-b61a-727d5c9e22b6 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:03:17.459797 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bb42664e-6e99-4340-92cd-e6b126c83d40 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "DELETE /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 404 len: 111 microversion: 2.1 time: 0.077059 Sep 16 13:03:17.460964 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1879/3651] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 13:03:17 2022] DELETE /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 13:03:17.470306 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-726326f5-bbaa-43c4-b7f2-2d591b832969 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:17.472136 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-726326f5-bbaa-43c4-b7f2-2d591b832969 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 464c1886-1201-4b29-b61a-727d5c9e22b6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:17.485874 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-726326f5-bbaa-43c4-b7f2-2d591b832969 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:17.487969 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-726326f5-bbaa-43c4-b7f2-2d591b832969 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:17.492622 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-726326f5-bbaa-43c4-b7f2-2d591b832969 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:17.494036 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-726326f5-bbaa-43c4-b7f2-2d591b832969 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:17.494746 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-726326f5-bbaa-43c4-b7f2-2d591b832969 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:17.495565 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-726326f5-bbaa-43c4-b7f2-2d591b832969 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:17.533274 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-726326f5-bbaa-43c4-b7f2-2d591b832969 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] HTTP exception thrown: Instance 464c1886-1201-4b29-b61a-727d5c9e22b6 could not be found. Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-726326f5-bbaa-43c4-b7f2-2d591b832969 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Request method failure captured: Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 HTTP/1.1 Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHK-ai74OxrHHqL5ZA97hOvy32Q6xIReVrKhZIj6PEPyQ_UB4rFs-7hdJCkozKZ5clo_9DaVkBFgsUmiSN_gmVaPdL8FT-f5QYKPk-CE61XDTK1RMhpnQkeVMlba4E4KaPfDCDA8WSNup3uH3mzkxsd2kp-OesctbTYQkqWqHnAvC3I Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_cfe82d8dd4fb42cbb054a6f069424c57", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-DeleteServersTestJSON-1385458479-project Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 2e531a7026054c34b2a78a1c484cbe02 Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-DeleteServersTestJSON-1385458479-project Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 464c1886-1201-4b29-b61a-727d5c9e22b6 could not be found. Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '464c1886-1201-4b29-b61a-727d5c9e22b6'} Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 464c1886-1201-4b29-b61a-727d5c9e22b6 could not be found. Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 464c1886-1201-4b29-b61a-727d5c9e22b6 could not be found. Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:17.535490 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:17.542319 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:17.542319 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:03:17.542319 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:03:17.542319 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:03:17.542319 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:03:17.542319 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 464c1886-1201-4b29-b61a-727d5c9e22b6 could not be found. Sep 16 13:03:17.542319 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:17.549715 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-726326f5-bbaa-43c4-b7f2-2d591b832969 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Returning 404 to user: Instance 464c1886-1201-4b29-b61a-727d5c9e22b6 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:03:17.555667 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-726326f5-bbaa-43c4-b7f2-2d591b832969 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6" status: 404 len: 111 microversion: 2.1 time: 0.085811 Sep 16 13:03:17.559741 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1880/3652] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:17 2022] GET /compute/v2.1/servers/464c1886-1201-4b29-b61a-727d5c9e22b6 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 13:03:17.568460 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7e69299a-d2ea-4d64-8c00-166fcea29c6b tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:17.569169 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7e69299a-d2ea-4d64-8c00-166fcea29c6b tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:17.578330 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e69299a-d2ea-4d64-8c00-166fcea29c6b tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:17.579213 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e69299a-d2ea-4d64-8c00-166fcea29c6b tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:17.579891 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e69299a-d2ea-4d64-8c00-166fcea29c6b tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:17.580967 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e69299a-d2ea-4d64-8c00-166fcea29c6b tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:17.581674 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e69299a-d2ea-4d64-8c00-166fcea29c6b tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:17.582435 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e69299a-d2ea-4d64-8c00-166fcea29c6b tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:18.713877 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7e69299a-d2ea-4d64-8c00-166fcea29c6b tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:18.719425 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:03:18.742000 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7e69299a-d2ea-4d64-8c00-166fcea29c6b tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:18.743851 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7e69299a-d2ea-4d64-8c00-166fcea29c6b tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:18.749278 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7e69299a-d2ea-4d64-8c00-166fcea29c6b tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1741 microversion: 2.20 time: 1.187670 Sep 16 13:03:18.750098 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1881/3653] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:03:17 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1741 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:03:18.760975 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c4e6a0bc-7d86-448e-9d7d-2a36940580e5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:18.767063 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c4e6a0bc-7d86-448e-9d7d-2a36940580e5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 45c75956-6533-4add-91e9-419a2043d9e1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:18.797499 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4e6a0bc-7d86-448e-9d7d-2a36940580e5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:18.799738 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4e6a0bc-7d86-448e-9d7d-2a36940580e5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:18.801772 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4e6a0bc-7d86-448e-9d7d-2a36940580e5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:18.804975 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4e6a0bc-7d86-448e-9d7d-2a36940580e5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:18.807632 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4e6a0bc-7d86-448e-9d7d-2a36940580e5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:18.810418 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4e6a0bc-7d86-448e-9d7d-2a36940580e5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:18.870156 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-c4e6a0bc-7d86-448e-9d7d-2a36940580e5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] HTTP exception thrown: Instance 45c75956-6533-4add-91e9-419a2043d9e1 could not be found. Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c4e6a0bc-7d86-448e-9d7d-2a36940580e5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Request method failure captured: Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1 HTTP/1.1 Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHK-ai74OxrHHqL5ZA97hOvy32Q6xIReVrKhZIj6PEPyQ_UB4rFs-7hdJCkozKZ5clo_9DaVkBFgsUmiSN_gmVaPdL8FT-f5QYKPk-CE61XDTK1RMhpnQkeVMlba4E4KaPfDCDA8WSNup3uH3mzkxsd2kp-OesctbTYQkqWqHnAvC3I Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_cfe82d8dd4fb42cbb054a6f069424c57", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-DeleteServersTestJSON-1385458479-project Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 2e531a7026054c34b2a78a1c484cbe02 Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-DeleteServersTestJSON-1385458479-project Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 45c75956-6533-4add-91e9-419a2043d9e1 could not be found. Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '45c75956-6533-4add-91e9-419a2043d9e1'} Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45c75956-6533-4add-91e9-419a2043d9e1 could not be found. Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:03:18.880839 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:03:18.887735 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45c75956-6533-4add-91e9-419a2043d9e1 could not be found. Sep 16 13:03:18.887735 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:18.887735 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:18.887735 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:18.887735 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:18.887735 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:03:18.887735 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:03:18.887735 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:03:18.887735 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:03:18.887735 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45c75956-6533-4add-91e9-419a2043d9e1 could not be found. Sep 16 13:03:18.887735 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:18.894855 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c4e6a0bc-7d86-448e-9d7d-2a36940580e5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Returning 404 to user: Instance 45c75956-6533-4add-91e9-419a2043d9e1 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:03:18.894855 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c4e6a0bc-7d86-448e-9d7d-2a36940580e5 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "DELETE /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1" status: 404 len: 111 microversion: 2.1 time: 0.140548 Sep 16 13:03:18.898624 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1882/3654] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 13:03:18 2022] DELETE /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:03:18.910695 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9bfd8fd6-011d-4eff-80be-00fe9f1f6346 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:18.916395 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9bfd8fd6-011d-4eff-80be-00fe9f1f6346 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:18.936074 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9bfd8fd6-011d-4eff-80be-00fe9f1f6346 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:18.945082 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9bfd8fd6-011d-4eff-80be-00fe9f1f6346 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:18.946038 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9bfd8fd6-011d-4eff-80be-00fe9f1f6346 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:18.947054 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9bfd8fd6-011d-4eff-80be-00fe9f1f6346 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:18.947756 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9bfd8fd6-011d-4eff-80be-00fe9f1f6346 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:18.950931 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9bfd8fd6-011d-4eff-80be-00fe9f1f6346 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:19.453177 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9bfd8fd6-011d-4eff-80be-00fe9f1f6346 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:19.475701 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9bfd8fd6-011d-4eff-80be-00fe9f1f6346 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1678 microversion: 2.1 time: 0.568600 Sep 16 13:03:19.482006 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1883/3655] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:18 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1678 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:19.494289 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-0cdfe1e4-5401-4581-9c1c-06fa888ca0de req-03273998-8fe9-4c87-a499-5138da1390cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af5e660b-de79-42ca-a8de-fe06738b9771", "name": "network-vif-plugged", "status": "completed", "tag": "3af800e8-0d1f-497b-bca5-8901587cb91c"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:03:19.506922 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0cdfe1e4-5401-4581-9c1c-06fa888ca0de req-03273998-8fe9-4c87-a499-5138da1390cc service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:19.507773 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0cdfe1e4-5401-4581-9c1c-06fa888ca0de req-03273998-8fe9-4c87-a499-5138da1390cc service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:19.508714 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0cdfe1e4-5401-4581-9c1c-06fa888ca0de req-03273998-8fe9-4c87-a499-5138da1390cc service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:19.522293 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-0cdfe1e4-5401-4581-9c1c-06fa888ca0de req-03273998-8fe9-4c87-a499-5138da1390cc service nova] Creating event network-vif-plugged:3af800e8-0d1f-497b-bca5-8901587cb91c for instance af5e660b-de79-42ca-a8de-fe06738b9771 on n-h2-858094-4 Sep 16 13:03:19.547614 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-0cdfe1e4-5401-4581-9c1c-06fa888ca0de req-03273998-8fe9-4c87-a499-5138da1390cc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063726 Sep 16 13:03:19.549164 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1884/3656] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:03:19.555399 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6f3d0996-1e29-4417-962a-8410489c1c71 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:19.570537 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6f3d0996-1e29-4417-962a-8410489c1c71 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: 45c75956-6533-4add-91e9-419a2043d9e1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:19.581995 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-48fbdca1-482c-40f0-b65a-97c8793655d8 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "POST /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe/action" status: 202 len: 0 microversion: 2.1 time: 2.539873 Sep 16 13:03:19.582639 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1773/3657] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 13:03:17 2022] POST /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe/action => generated 0 bytes in 2541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:03:19.584617 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f3d0996-1e29-4417-962a-8410489c1c71 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:19.586235 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f3d0996-1e29-4417-962a-8410489c1c71 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:19.587820 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f3d0996-1e29-4417-962a-8410489c1c71 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:19.588725 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f3d0996-1e29-4417-962a-8410489c1c71 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:19.590799 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f3d0996-1e29-4417-962a-8410489c1c71 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:19.591343 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f3d0996-1e29-4417-962a-8410489c1c71 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:19.592474 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-eb257a53-a3c8-4ec7-8455-13360a285f3f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-444437611"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:03:19.593393 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-eb257a53-a3c8-4ec7-8455-13360a285f3f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 97f1168a-0491-4d97-8cc9-59e1b27ababe] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:19.607879 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eb257a53-a3c8-4ec7-8455-13360a285f3f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:19.612011 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eb257a53-a3c8-4ec7-8455-13360a285f3f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:19.612656 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eb257a53-a3c8-4ec7-8455-13360a285f3f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:19.613771 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eb257a53-a3c8-4ec7-8455-13360a285f3f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:19.619594 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eb257a53-a3c8-4ec7-8455-13360a285f3f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:19.620449 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eb257a53-a3c8-4ec7-8455-13360a285f3f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:19.622719 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-6f3d0996-1e29-4417-962a-8410489c1c71 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] HTTP exception thrown: Instance 45c75956-6533-4add-91e9-419a2043d9e1 could not be found. Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6f3d0996-1e29-4417-962a-8410489c1c71 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Request method failure captured: Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1 HTTP/1.1 Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHK-ai74OxrHHqL5ZA97hOvy32Q6xIReVrKhZIj6PEPyQ_UB4rFs-7hdJCkozKZ5clo_9DaVkBFgsUmiSN_gmVaPdL8FT-f5QYKPk-CE61XDTK1RMhpnQkeVMlba4E4KaPfDCDA8WSNup3uH3mzkxsd2kp-OesctbTYQkqWqHnAvC3I Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_cfe82d8dd4fb42cbb054a6f069424c57", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-DeleteServersTestJSON-1385458479-project Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 2e531a7026054c34b2a78a1c484cbe02 Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-DeleteServersTestJSON-1385458479-project Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 45c75956-6533-4add-91e9-419a2043d9e1 could not be found. Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '45c75956-6533-4add-91e9-419a2043d9e1'} Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45c75956-6533-4add-91e9-419a2043d9e1 could not be found. Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45c75956-6533-4add-91e9-419a2043d9e1 could not be found. Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:19.625316 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:19.630660 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:19.630660 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:03:19.630660 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:03:19.630660 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:03:19.630660 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:03:19.630660 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45c75956-6533-4add-91e9-419a2043d9e1 could not be found. Sep 16 13:03:19.630660 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:19.630660 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6f3d0996-1e29-4417-962a-8410489c1c71 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Returning 404 to user: Instance 45c75956-6533-4add-91e9-419a2043d9e1 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:03:19.632957 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6f3d0996-1e29-4417-962a-8410489c1c71 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1" status: 404 len: 111 microversion: 2.1 time: 0.080731 Sep 16 13:03:19.639736 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1885/3658] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:19 2022] GET /compute/v2.1/servers/45c75956-6533-4add-91e9-419a2043d9e1 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:03:19.643911 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-4eef83d7-17d7-426f-8277-948ec44884ec req-4323a0a2-b67d-4ee3-a2d0-bbc2d7232189 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97f1168a-0491-4d97-8cc9-59e1b27ababe", "tag": "4c0896cf-3255-42ff-b580-d2a345dbb96d"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:03:19.669433 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4eef83d7-17d7-426f-8277-948ec44884ec req-4323a0a2-b67d-4ee3-a2d0-bbc2d7232189 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:19.669793 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4eef83d7-17d7-426f-8277-948ec44884ec req-4323a0a2-b67d-4ee3-a2d0-bbc2d7232189 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:19.670247 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4eef83d7-17d7-426f-8277-948ec44884ec req-4323a0a2-b67d-4ee3-a2d0-bbc2d7232189 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:19.710324 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-4eef83d7-17d7-426f-8277-948ec44884ec req-4323a0a2-b67d-4ee3-a2d0-bbc2d7232189 service nova] Creating event network-changed:4c0896cf-3255-42ff-b580-d2a345dbb96d for instance 97f1168a-0491-4d97-8cc9-59e1b27ababe on n-h1-858094-4 Sep 16 13:03:19.715903 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-4eef83d7-17d7-426f-8277-948ec44884ec req-4323a0a2-b67d-4ee3-a2d0-bbc2d7232189 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077173 Sep 16 13:03:19.722889 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1886/3659] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:03:19.735293 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4e0b3513-0e7d-49eb-bc68-4b965025c0be tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:19.736945 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4e0b3513-0e7d-49eb-bc68-4b965025c0be tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: f06d8960-bb68-4f5c-b54b-61cc10e342e3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:19.758729 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e0b3513-0e7d-49eb-bc68-4b965025c0be tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:19.762913 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e0b3513-0e7d-49eb-bc68-4b965025c0be tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:19.764501 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e0b3513-0e7d-49eb-bc68-4b965025c0be tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:19.765688 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e0b3513-0e7d-49eb-bc68-4b965025c0be tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:19.766165 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e0b3513-0e7d-49eb-bc68-4b965025c0be tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:19.771682 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e0b3513-0e7d-49eb-bc68-4b965025c0be tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:19.828646 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-4e0b3513-0e7d-49eb-bc68-4b965025c0be tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] HTTP exception thrown: Instance f06d8960-bb68-4f5c-b54b-61cc10e342e3 could not be found. Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4e0b3513-0e7d-49eb-bc68-4b965025c0be tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Request method failure captured: Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/f06d8960-bb68-4f5c-b54b-61cc10e342e3 HTTP/1.1 Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHK-ai74OxrHHqL5ZA97hOvy32Q6xIReVrKhZIj6PEPyQ_UB4rFs-7hdJCkozKZ5clo_9DaVkBFgsUmiSN_gmVaPdL8FT-f5QYKPk-CE61XDTK1RMhpnQkeVMlba4E4KaPfDCDA8WSNup3uH3mzkxsd2kp-OesctbTYQkqWqHnAvC3I Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_cfe82d8dd4fb42cbb054a6f069424c57", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-DeleteServersTestJSON-1385458479-project Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 2e531a7026054c34b2a78a1c484cbe02 Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-DeleteServersTestJSON-1385458479-project Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance f06d8960-bb68-4f5c-b54b-61cc10e342e3 could not be found. Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': 'f06d8960-bb68-4f5c-b54b-61cc10e342e3'} Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f06d8960-bb68-4f5c-b54b-61cc10e342e3 could not be found. Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:03:19.830652 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:03:19.836020 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f06d8960-bb68-4f5c-b54b-61cc10e342e3 could not be found. Sep 16 13:03:19.836020 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:19.836020 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:19.836020 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:19.836020 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:19.836020 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:03:19.836020 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:03:19.836020 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:03:19.836020 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:03:19.836020 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f06d8960-bb68-4f5c-b54b-61cc10e342e3 could not be found. Sep 16 13:03:19.836020 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:19.839184 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4e0b3513-0e7d-49eb-bc68-4b965025c0be tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Returning 404 to user: Instance f06d8960-bb68-4f5c-b54b-61cc10e342e3 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:03:19.840945 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4e0b3513-0e7d-49eb-bc68-4b965025c0be tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f06d8960-bb68-4f5c-b54b-61cc10e342e3" status: 404 len: 111 microversion: 2.1 time: 0.116868 Sep 16 13:03:19.860578 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1887/3660] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 13:03:19 2022] DELETE /compute/v2.1/servers/f06d8960-bb68-4f5c-b54b-61cc10e342e3 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:03:19.874724 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7e7960d7-6ee2-4dc3-ac53-5cf0b8bff1ec tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:19.875702 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7e7960d7-6ee2-4dc3-ac53-5cf0b8bff1ec tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:19.896232 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e7960d7-6ee2-4dc3-ac53-5cf0b8bff1ec tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:19.897119 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e7960d7-6ee2-4dc3-ac53-5cf0b8bff1ec tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:19.897754 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e7960d7-6ee2-4dc3-ac53-5cf0b8bff1ec tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:19.898732 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e7960d7-6ee2-4dc3-ac53-5cf0b8bff1ec tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:19.899431 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e7960d7-6ee2-4dc3-ac53-5cf0b8bff1ec tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:19.900026 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e7960d7-6ee2-4dc3-ac53-5cf0b8bff1ec tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:20.959013 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.network.security_group_api [None req-eb257a53-a3c8-4ec7-8455-13360a285f3f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Adding security group 4ed0efee-0a9a-4002-8fc8-71699bf983e9 to port 4c0896cf-3255-42ff-b580-d2a345dbb96d Sep 16 13:03:21.119633 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7e7960d7-6ee2-4dc3-ac53-5cf0b8bff1ec tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:21.163676 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7e7960d7-6ee2-4dc3-ac53-5cf0b8bff1ec tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:21.172741 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7e7960d7-6ee2-4dc3-ac53-5cf0b8bff1ec tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:21.178244 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7e7960d7-6ee2-4dc3-ac53-5cf0b8bff1ec tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1741 microversion: 2.20 time: 1.315584 Sep 16 13:03:21.202154 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1888/3661] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:03:19 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1741 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:03:21.215451 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b8124fcc-68fe-4e57-8804-614e115c908d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:21.220838 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b8124fcc-68fe-4e57-8804-614e115c908d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: f06d8960-bb68-4f5c-b54b-61cc10e342e3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:21.245032 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8124fcc-68fe-4e57-8804-614e115c908d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:21.246107 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8124fcc-68fe-4e57-8804-614e115c908d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:21.255196 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8124fcc-68fe-4e57-8804-614e115c908d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:21.256094 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8124fcc-68fe-4e57-8804-614e115c908d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:21.262295 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8124fcc-68fe-4e57-8804-614e115c908d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:21.262699 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8124fcc-68fe-4e57-8804-614e115c908d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:21.295116 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-b8124fcc-68fe-4e57-8804-614e115c908d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] HTTP exception thrown: Instance f06d8960-bb68-4f5c-b54b-61cc10e342e3 could not be found. Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b8124fcc-68fe-4e57-8804-614e115c908d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Request method failure captured: Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/f06d8960-bb68-4f5c-b54b-61cc10e342e3 HTTP/1.1 Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHK-ai74OxrHHqL5ZA97hOvy32Q6xIReVrKhZIj6PEPyQ_UB4rFs-7hdJCkozKZ5clo_9DaVkBFgsUmiSN_gmVaPdL8FT-f5QYKPk-CE61XDTK1RMhpnQkeVMlba4E4KaPfDCDA8WSNup3uH3mzkxsd2kp-OesctbTYQkqWqHnAvC3I Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_cfe82d8dd4fb42cbb054a6f069424c57", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-DeleteServersTestJSON-1385458479-project Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 2e531a7026054c34b2a78a1c484cbe02 Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-DeleteServersTestJSON-1385458479-project Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance f06d8960-bb68-4f5c-b54b-61cc10e342e3 could not be found. Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': 'f06d8960-bb68-4f5c-b54b-61cc10e342e3'} Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f06d8960-bb68-4f5c-b54b-61cc10e342e3 could not be found. Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f06d8960-bb68-4f5c-b54b-61cc10e342e3 could not be found. Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:21.296793 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:21.303460 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:21.303460 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:03:21.303460 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:03:21.303460 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:03:21.303460 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:03:21.303460 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f06d8960-bb68-4f5c-b54b-61cc10e342e3 could not be found. Sep 16 13:03:21.303460 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:21.303460 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b8124fcc-68fe-4e57-8804-614e115c908d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Returning 404 to user: Instance f06d8960-bb68-4f5c-b54b-61cc10e342e3 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:03:21.303460 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b8124fcc-68fe-4e57-8804-614e115c908d tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/f06d8960-bb68-4f5c-b54b-61cc10e342e3" status: 404 len: 111 microversion: 2.1 time: 0.098306 Sep 16 13:03:21.307102 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1889/3662] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:21 2022] GET /compute/v2.1/servers/f06d8960-bb68-4f5c-b54b-61cc10e342e3 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:03:21.342113 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2014e48a-4058-4e3f-aa90-606eb2338c30 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:21.342911 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2014e48a-4058-4e3f-aa90-606eb2338c30 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:21.374612 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2014e48a-4058-4e3f-aa90-606eb2338c30 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:21.375177 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2014e48a-4058-4e3f-aa90-606eb2338c30 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:21.375648 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2014e48a-4058-4e3f-aa90-606eb2338c30 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:21.376430 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2014e48a-4058-4e3f-aa90-606eb2338c30 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:21.376988 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2014e48a-4058-4e3f-aa90-606eb2338c30 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:21.377454 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2014e48a-4058-4e3f-aa90-606eb2338c30 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:22.060018 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2014e48a-4058-4e3f-aa90-606eb2338c30 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:22.071683 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2014e48a-4058-4e3f-aa90-606eb2338c30 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1678 microversion: 2.1 time: 0.763460 Sep 16 13:03:22.072742 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1890/3663] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:21 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1678 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:22.210716 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5560e47b-2aee-4527-8708-03163dc559f7 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:22.212039 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5560e47b-2aee-4527-8708-03163dc559f7 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:22.228096 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5560e47b-2aee-4527-8708-03163dc559f7 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:22.228933 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5560e47b-2aee-4527-8708-03163dc559f7 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:22.233982 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5560e47b-2aee-4527-8708-03163dc559f7 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:22.235132 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5560e47b-2aee-4527-8708-03163dc559f7 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:22.235780 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5560e47b-2aee-4527-8708-03163dc559f7 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:22.244290 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5560e47b-2aee-4527-8708-03163dc559f7 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:23.055003 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5560e47b-2aee-4527-8708-03163dc559f7 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:23.097121 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5560e47b-2aee-4527-8708-03163dc559f7 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:23.107115 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5560e47b-2aee-4527-8708-03163dc559f7 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:23.116232 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5560e47b-2aee-4527-8708-03163dc559f7 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1741 microversion: 2.20 time: 0.909329 Sep 16 13:03:23.117842 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1891/3664] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:03:22 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1741 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:03:23.138073 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-885a65c9-510d-4e60-92e9-c62372b02bdd tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:23.138997 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-885a65c9-510d-4e60-92e9-c62372b02bdd tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:23.147642 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-885a65c9-510d-4e60-92e9-c62372b02bdd tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:23.148421 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-885a65c9-510d-4e60-92e9-c62372b02bdd tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:23.149060 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-885a65c9-510d-4e60-92e9-c62372b02bdd tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:23.149759 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-885a65c9-510d-4e60-92e9-c62372b02bdd tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:23.150237 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-885a65c9-510d-4e60-92e9-c62372b02bdd tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:23.150627 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-885a65c9-510d-4e60-92e9-c62372b02bdd tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:23.521798 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-885a65c9-510d-4e60-92e9-c62372b02bdd tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:23.533693 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-885a65c9-510d-4e60-92e9-c62372b02bdd tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1678 microversion: 2.1 time: 0.414558 Sep 16 13:03:23.548590 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-eb257a53-a3c8-4ec7-8455-13360a285f3f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "POST /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe/action" status: 202 len: 0 microversion: 2.1 time: 3.952822 Sep 16 13:03:23.548590 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1774/3665] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 13:03:19 2022] POST /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe/action => generated 0 bytes in 3958 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 13:03:23.549762 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8c901098-19b1-4969-a98f-1da0aac0b907 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:23.550450 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8c901098-19b1-4969-a98f-1da0aac0b907 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 97f1168a-0491-4d97-8cc9-59e1b27ababe] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:23.555724 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1892/3666] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:23 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1678 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:23.563925 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8c901098-19b1-4969-a98f-1da0aac0b907 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:23.566242 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8c901098-19b1-4969-a98f-1da0aac0b907 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:23.566960 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8c901098-19b1-4969-a98f-1da0aac0b907 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:23.568933 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8c901098-19b1-4969-a98f-1da0aac0b907 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:23.570742 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8c901098-19b1-4969-a98f-1da0aac0b907 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:23.571370 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8c901098-19b1-4969-a98f-1da0aac0b907 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:23.625265 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-f2faa367-f44c-464d-9eda-2c5526715d19 req-d00e6984-7d14-4900-997c-87b58cba3c9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97f1168a-0491-4d97-8cc9-59e1b27ababe", "tag": "4c0896cf-3255-42ff-b580-d2a345dbb96d"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:03:23.649287 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f2faa367-f44c-464d-9eda-2c5526715d19 req-d00e6984-7d14-4900-997c-87b58cba3c9e service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:23.649768 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f2faa367-f44c-464d-9eda-2c5526715d19 req-d00e6984-7d14-4900-997c-87b58cba3c9e service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:23.650201 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f2faa367-f44c-464d-9eda-2c5526715d19 req-d00e6984-7d14-4900-997c-87b58cba3c9e service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:23.681916 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-f2faa367-f44c-464d-9eda-2c5526715d19 req-d00e6984-7d14-4900-997c-87b58cba3c9e service nova] Creating event network-changed:4c0896cf-3255-42ff-b580-d2a345dbb96d for instance 97f1168a-0491-4d97-8cc9-59e1b27ababe on n-h1-858094-4 Sep 16 13:03:23.708445 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-f2faa367-f44c-464d-9eda-2c5526715d19 req-d00e6984-7d14-4900-997c-87b58cba3c9e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079568 Sep 16 13:03:23.709342 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1893/3667] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:03:24.146848 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-43ff48c3-d2ac-4381-b097-26989fd659da tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:24.147836 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-43ff48c3-d2ac-4381-b097-26989fd659da tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:24.162122 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43ff48c3-d2ac-4381-b097-26989fd659da tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:24.168562 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43ff48c3-d2ac-4381-b097-26989fd659da tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:24.174386 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43ff48c3-d2ac-4381-b097-26989fd659da tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:24.176578 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43ff48c3-d2ac-4381-b097-26989fd659da tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:24.179800 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43ff48c3-d2ac-4381-b097-26989fd659da tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:24.181717 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43ff48c3-d2ac-4381-b097-26989fd659da tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:24.904979 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8c901098-19b1-4969-a98f-1da0aac0b907 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 1.359339 Sep 16 13:03:24.920110 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1775/3668] 10.222.0.67 () {58 vars in 1293 bytes} [Fri Sep 16 13:03:23 2022] GET /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe/os-security-groups => generated 1157 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:24.928520 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d4baad66-0434-4dc9-9967-5a8b9a643d23 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:24.929446 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d4baad66-0434-4dc9-9967-5a8b9a643d23 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:24.944096 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d4baad66-0434-4dc9-9967-5a8b9a643d23 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:24.945341 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d4baad66-0434-4dc9-9967-5a8b9a643d23 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:24.945960 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d4baad66-0434-4dc9-9967-5a8b9a643d23 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:24.947392 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d4baad66-0434-4dc9-9967-5a8b9a643d23 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:24.948028 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d4baad66-0434-4dc9-9967-5a8b9a643d23 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:24.949963 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d4baad66-0434-4dc9-9967-5a8b9a643d23 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:25.592045 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-43ff48c3-d2ac-4381-b097-26989fd659da tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:25.612597 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-43ff48c3-d2ac-4381-b097-26989fd659da tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:25.614682 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-43ff48c3-d2ac-4381-b097-26989fd659da tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:25.619764 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-43ff48c3-d2ac-4381-b097-26989fd659da tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1723 microversion: 2.20 time: 1.479955 Sep 16 13:03:25.623791 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1894/3669] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:03:24 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1723 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:03:25.638654 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c7a4302c-e975-4de9-88e6-5f220fd48043 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:25.644469 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c7a4302c-e975-4de9-88e6-5f220fd48043 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:25.672806 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c7a4302c-e975-4de9-88e6-5f220fd48043 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:25.678277 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c7a4302c-e975-4de9-88e6-5f220fd48043 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:25.680572 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c7a4302c-e975-4de9-88e6-5f220fd48043 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:25.682651 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c7a4302c-e975-4de9-88e6-5f220fd48043 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:25.684181 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c7a4302c-e975-4de9-88e6-5f220fd48043 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:25.686032 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c7a4302c-e975-4de9-88e6-5f220fd48043 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:25.844147 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d4baad66-0434-4dc9-9967-5a8b9a643d23 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:25.854361 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d4baad66-0434-4dc9-9967-5a8b9a643d23 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:25.862191 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d4baad66-0434-4dc9-9967-5a8b9a643d23 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:25.863907 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d4baad66-0434-4dc9-9967-5a8b9a643d23 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 2947 microversion: 2.42 time: 0.942396 Sep 16 13:03:25.872663 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1776/3670] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:03:24 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 2947 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:03:25.878044 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-42988a9f-d492-4495-895b-b280e89566e5 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Action: 'create', calling method: .version_select at 0x7f10348ba3a0>, body: {"security_group": {"name": " tempest-securitygroup -676451207 ", "description": "tempest-description-1367947869"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:03:26.526433 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-42988a9f-d492-4495-895b-b280e89566e5 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.652243 Sep 16 13:03:26.528067 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1777/3671] 10.222.0.67 () {60 vars in 1180 bytes} [Fri Sep 16 13:03:25 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:03:26.533553 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f3cb8885-4793-410f-a1cf-df6807231d1a tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:26.534350 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f3cb8885-4793-410f-a1cf-df6807231d1a tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:26.546072 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:03:26.547992 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f3cb8885-4793-410f-a1cf-df6807231d1a tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:26.552048 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f3cb8885-4793-410f-a1cf-df6807231d1a tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:26.553102 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f3cb8885-4793-410f-a1cf-df6807231d1a tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:26.554488 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f3cb8885-4793-410f-a1cf-df6807231d1a tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:26.555196 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f3cb8885-4793-410f-a1cf-df6807231d1a tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:26.555327 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c7a4302c-e975-4de9-88e6-5f220fd48043 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:26.555994 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f3cb8885-4793-410f-a1cf-df6807231d1a tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:26.574488 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c7a4302c-e975-4de9-88e6-5f220fd48043 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1678 microversion: 2.1 time: 0.947696 Sep 16 13:03:26.579445 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1895/3672] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:25 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1678 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:26.595626 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-4f1c79c0-9f3d-48c9-b97f-37dc18ffcf07 req-ea757647-56a5-4274-a9d6-ce2fc44db871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66413dbd-455f-45f6-b057-39a11a9f2d44", "name": "network-vif-unplugged", "status": "completed", "tag": "3a5b1f2b-2004-4cf4-93bd-f498b62488fe"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:03:26.633217 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4f1c79c0-9f3d-48c9-b97f-37dc18ffcf07 req-ea757647-56a5-4274-a9d6-ce2fc44db871 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:26.633696 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4f1c79c0-9f3d-48c9-b97f-37dc18ffcf07 req-ea757647-56a5-4274-a9d6-ce2fc44db871 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:26.634128 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4f1c79c0-9f3d-48c9-b97f-37dc18ffcf07 req-ea757647-56a5-4274-a9d6-ce2fc44db871 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:26.663911 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-4f1c79c0-9f3d-48c9-b97f-37dc18ffcf07 req-ea757647-56a5-4274-a9d6-ce2fc44db871 service nova] Creating event network-vif-unplugged:3a5b1f2b-2004-4cf4-93bd-f498b62488fe for instance 66413dbd-455f-45f6-b057-39a11a9f2d44 on n-h1-858094-4 Sep 16 13:03:26.675556 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-4f1c79c0-9f3d-48c9-b97f-37dc18ffcf07 req-ea757647-56a5-4274-a9d6-ce2fc44db871 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091312 Sep 16 13:03:26.679474 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1896/3673] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:03:26.688660 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0b48db8c-4a98-43f1-942f-633b9be696c5 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '.version_select at 0x7f103529a280>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:26.882467 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f3cb8885-4793-410f-a1cf-df6807231d1a tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.352812 Sep 16 13:03:26.883079 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1778/3674] 10.222.0.67 () {60 vars in 1316 bytes} [Fri Sep 16 13:03:26 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf/os-interface => generated 1830 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:03:26.888188 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8e59f9f6-dabc-431f-b7c3-b930009f7768 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:26.889015 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8e59f9f6-dabc-431f-b7c3-b930009f7768 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:26.905158 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8e59f9f6-dabc-431f-b7c3-b930009f7768 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:26.906043 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8e59f9f6-dabc-431f-b7c3-b930009f7768 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:26.906692 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8e59f9f6-dabc-431f-b7c3-b930009f7768 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:26.911305 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8e59f9f6-dabc-431f-b7c3-b930009f7768 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:26.912055 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8e59f9f6-dabc-431f-b7c3-b930009f7768 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:26.912728 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8e59f9f6-dabc-431f-b7c3-b930009f7768 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:26.923524 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0b48db8c-4a98-43f1-942f-633b9be696c5 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/os-security-groups/89246358-e52b-4a18-89dd-8ef81780d9b9" status: 200 len: 223 microversion: 2.1 time: 0.241384 Sep 16 13:03:26.924807 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1897/3675] 10.222.0.67 () {58 vars in 1269 bytes} [Fri Sep 16 13:03:26 2022] GET /compute/v2.1/os-security-groups/89246358-e52b-4a18-89dd-8ef81780d9b9 => generated 223 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:03:26.942521 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f491445b-7d67-4b50-a513-76924bbdb5eb tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '.version_select at 0x7f103558ea60>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:27.506196 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8e59f9f6-dabc-431f-b7c3-b930009f7768 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:27.520723 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8e59f9f6-dabc-431f-b7c3-b930009f7768 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:27.524551 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8e59f9f6-dabc-431f-b7c3-b930009f7768 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:27.529240 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8e59f9f6-dabc-431f-b7c3-b930009f7768 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1723 microversion: 2.20 time: 0.644891 Sep 16 13:03:27.532034 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1779/3676] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:03:26 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1723 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:03:27.603552 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e84b2574-d00b-4172-aeb7-278b99411d81 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:27.605573 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e84b2574-d00b-4172-aeb7-278b99411d81 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:27.624942 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e84b2574-d00b-4172-aeb7-278b99411d81 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:27.626041 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e84b2574-d00b-4172-aeb7-278b99411d81 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:27.626671 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e84b2574-d00b-4172-aeb7-278b99411d81 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:27.628917 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e84b2574-d00b-4172-aeb7-278b99411d81 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:27.630881 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e84b2574-d00b-4172-aeb7-278b99411d81 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:27.632473 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e84b2574-d00b-4172-aeb7-278b99411d81 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:28.073321 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e84b2574-d00b-4172-aeb7-278b99411d81 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:28.083263 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e84b2574-d00b-4172-aeb7-278b99411d81 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1678 microversion: 2.1 time: 0.485142 Sep 16 13:03:28.096358 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1780/3677] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:27 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1678 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:28.242946 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9b0eb6af-759b-48cf-9398-9beb48f33397 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:28.243923 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9b0eb6af-759b-48cf-9398-9beb48f33397 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: e8b6a81c-dbec-452e-bd82-a4c86b9c44fd] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:28.266638 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9b0eb6af-759b-48cf-9398-9beb48f33397 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:28.267650 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9b0eb6af-759b-48cf-9398-9beb48f33397 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:28.270097 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9b0eb6af-759b-48cf-9398-9beb48f33397 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:28.273988 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9b0eb6af-759b-48cf-9398-9beb48f33397 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:28.275835 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9b0eb6af-759b-48cf-9398-9beb48f33397 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:28.279906 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9b0eb6af-759b-48cf-9398-9beb48f33397 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:28.322361 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-9b0eb6af-759b-48cf-9398-9beb48f33397 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] HTTP exception thrown: Instance e8b6a81c-dbec-452e-bd82-a4c86b9c44fd could not be found. Sep 16 13:03:28.332206 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f491445b-7d67-4b50-a513-76924bbdb5eb tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/89246358-e52b-4a18-89dd-8ef81780d9b9" status: 202 len: 0 microversion: 2.1 time: 1.393585 Sep 16 13:03:28.332856 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1898/3678] 10.222.0.67 () {58 vars in 1272 bytes} [Fri Sep 16 13:03:26 2022] DELETE /compute/v2.1/os-security-groups/89246358-e52b-4a18-89dd-8ef81780d9b9 => generated 0 bytes in 1395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:03:28.342182 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3588e07f-e2b3-4c2e-87eb-f3bfcfa5226d tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '.version_select at 0x7f10359e5040>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9b0eb6af-759b-48cf-9398-9beb48f33397 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Request method failure captured: Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: request: DELETE /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd HTTP/1.1 Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHK-ai74OxrHHqL5ZA97hOvy32Q6xIReVrKhZIj6PEPyQ_UB4rFs-7hdJCkozKZ5clo_9DaVkBFgsUmiSN_gmVaPdL8FT-f5QYKPk-CE61XDTK1RMhpnQkeVMlba4E4KaPfDCDA8WSNup3uH3mzkxsd2kp-OesctbTYQkqWqHnAvC3I Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_cfe82d8dd4fb42cbb054a6f069424c57", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-DeleteServersTestJSON-1385458479-project Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 2e531a7026054c34b2a78a1c484cbe02 Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-DeleteServersTestJSON-1385458479-project Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance e8b6a81c-dbec-452e-bd82-a4c86b9c44fd could not be found. Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'e8b6a81c-dbec-452e-bd82-a4c86b9c44fd'} Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8b6a81c-dbec-452e-bd82-a4c86b9c44fd could not be found. Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:03:28.342911 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:03:28.347358 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8b6a81c-dbec-452e-bd82-a4c86b9c44fd could not be found. Sep 16 13:03:28.347358 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:03:28.347358 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:28.347358 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:03:28.347358 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:28.347358 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:03:28.347358 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:03:28.347358 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:03:28.347358 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:03:28.347358 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8b6a81c-dbec-452e-bd82-a4c86b9c44fd could not be found. Sep 16 13:03:28.347358 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:03:28.350183 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9b0eb6af-759b-48cf-9398-9beb48f33397 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Returning 404 to user: Instance e8b6a81c-dbec-452e-bd82-a4c86b9c44fd could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:03:28.351507 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9b0eb6af-759b-48cf-9398-9beb48f33397 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd" status: 404 len: 111 microversion: 2.1 time: 0.115126 Sep 16 13:03:28.352666 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1781/3679] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 13:03:28 2022] DELETE /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 13:03:28.362143 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-de513b12-6ff6-4943-8f76-cdb8dcefbf1e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:28.363266 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-de513b12-6ff6-4943-8f76-cdb8dcefbf1e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: e8b6a81c-dbec-452e-bd82-a4c86b9c44fd] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:28.371439 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-de513b12-6ff6-4943-8f76-cdb8dcefbf1e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:28.372473 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-de513b12-6ff6-4943-8f76-cdb8dcefbf1e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:28.373190 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-de513b12-6ff6-4943-8f76-cdb8dcefbf1e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:28.374380 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-de513b12-6ff6-4943-8f76-cdb8dcefbf1e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:28.375082 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-de513b12-6ff6-4943-8f76-cdb8dcefbf1e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:28.375758 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-de513b12-6ff6-4943-8f76-cdb8dcefbf1e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:28.411547 n-d-858094-4 devstack@n-api.service[128779]: DEBUG neutronclient.v2_0.client [None req-3588e07f-e2b3-4c2e-87eb-f3bfcfa5226d tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 89246358-e52b-4a18-89dd-8ef81780d9b9 does not exist", "detail": ""}} {{(pid=128779) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 13:03:28.411707 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-de513b12-6ff6-4943-8f76-cdb8dcefbf1e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] HTTP exception thrown: Instance e8b6a81c-dbec-452e-bd82-a4c86b9c44fd could not be found. Sep 16 13:03:28.412506 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.security_group_api [None req-3588e07f-e2b3-4c2e-87eb-f3bfcfa5226d tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Neutron security group 89246358-e52b-4a18-89dd-8ef81780d9b9 not found {{(pid=128779) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 16 13:03:28.413257 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-3588e07f-e2b3-4c2e-87eb-f3bfcfa5226d tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] HTTP exception thrown: Security group 89246358-e52b-4a18-89dd-8ef81780d9b9 does not exist Sep 16 13:03:28.413257 n-d-858094-4 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-bcbcdc48-43b0-4901-b689-3164df176880'] Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-de513b12-6ff6-4943-8f76-cdb8dcefbf1e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Request method failure captured: Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd HTTP/1.1 Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHK-ai74OxrHHqL5ZA97hOvy32Q6xIReVrKhZIj6PEPyQ_UB4rFs-7hdJCkozKZ5clo_9DaVkBFgsUmiSN_gmVaPdL8FT-f5QYKPk-CE61XDTK1RMhpnQkeVMlba4E4KaPfDCDA8WSNup3uH3mzkxsd2kp-OesctbTYQkqWqHnAvC3I Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_cfe82d8dd4fb42cbb054a6f069424c57", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-DeleteServersTestJSON-1385458479-project Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 2e531a7026054c34b2a78a1c484cbe02 Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-DeleteServersTestJSON-1385458479-project Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance e8b6a81c-dbec-452e-bd82-a4c86b9c44fd could not be found. Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'e8b6a81c-dbec-452e-bd82-a4c86b9c44fd'} Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8b6a81c-dbec-452e-bd82-a4c86b9c44fd could not be found. Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8b6a81c-dbec-452e-bd82-a4c86b9c44fd could not be found. Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:28.414818 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:03:28.421099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:28.421099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:03:28.421099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:03:28.421099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:03:28.421099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:03:28.421099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8b6a81c-dbec-452e-bd82-a4c86b9c44fd could not be found. Sep 16 13:03:28.421099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:03:28.421099 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-de513b12-6ff6-4943-8f76-cdb8dcefbf1e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Returning 404 to user: Instance e8b6a81c-dbec-452e-bd82-a4c86b9c44fd could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:03:28.422089 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-de513b12-6ff6-4943-8f76-cdb8dcefbf1e tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd" status: 404 len: 111 microversion: 2.1 time: 0.063994 Sep 16 13:03:28.423673 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1782/3680] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:28 2022] GET /compute/v2.1/servers/e8b6a81c-dbec-452e-bd82-a4c86b9c44fd => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3588e07f-e2b3-4c2e-87eb-f3bfcfa5226d tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Request method failure captured: Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/os-security-groups/89246358-e52b-4a18-89dd-8ef81780d9b9 HTTP/1.1 Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHP182fOoXAmmtyFT24t1WldG_-n_fUq_hYyF_kcX6BBuNdLFPJQpvv1Qbau8uBELlze_J0V8PSdv80EZFiSQVIXVTfCMdV7A-swstczuz_Ini1wPhpJqJ2_9Cvd9QLrJtnV-zdKbzeKde8qkyp_ruLhl8BqedA5EVFg3XozRh0MDPU Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: aaeff399942c4286a71ea3a0eab43280 Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_aaeff399942c4286a71ea3a0eab43280", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: aaeff399942c4286a71ea3a0eab43280 Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-SecurityGroupsTestJSON-210138271-project Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 8ed69c96e39249f181eda742be229b97 Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-SecurityGroupsTestJSON-210138271-project Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: exception: Security group 89246358-e52b-4a18-89dd-8ef81780d9b9 does not exist Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-bcbcdc48-43b0-4901-b689-3164df176880'] Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '89246358-e52b-4a18-89dd-8ef81780d9b9'} Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 13:03:28.431497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 89246358-e52b-4a18-89dd-8ef81780d9b9 does not exist Sep 16 13:03:28.439053 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bcbcdc48-43b0-4901-b689-3164df176880'] Sep 16 13:03:28.439053 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:28.439053 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:28.439053 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:28.439053 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:28.439053 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 16 13:03:28.439053 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 16 13:03:28.439053 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 16 13:03:28.439053 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 16 13:03:28.439053 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 89246358-e52b-4a18-89dd-8ef81780d9b9 does not exist Sep 16 13:03:28.439053 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bcbcdc48-43b0-4901-b689-3164df176880'] Sep 16 13:03:28.439053 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:28.439053 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:28.439053 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:28.439053 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:28.439053 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:03:28.439053 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:03:28.439053 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:03:28.439053 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:03:28.439053 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:03:28.439053 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:03:28.439053 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:03:28.439053 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:03:28.439053 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 16 13:03:28.439053 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 16 13:03:28.439053 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 89246358-e52b-4a18-89dd-8ef81780d9b9 does not exist Sep 16 13:03:28.439053 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bcbcdc48-43b0-4901-b689-3164df176880'] Sep 16 13:03:28.439053 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:28.439053 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:28.439053 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:28.439053 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:28.439053 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:03:28.439053 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:03:28.439053 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:03:28.439053 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:03:28.439053 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 89246358-e52b-4a18-89dd-8ef81780d9b9 does not exist Sep 16 13:03:28.439053 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bcbcdc48-43b0-4901-b689-3164df176880'] Sep 16 13:03:28.439053 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:28.447046 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3588e07f-e2b3-4c2e-87eb-f3bfcfa5226d tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Returning 404 to user: Security group 89246358-e52b-4a18-89dd-8ef81780d9b9 does not exist Sep 16 13:03:28.447046 n-d-858094-4 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-bcbcdc48-43b0-4901-b689-3164df176880'] {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:03:28.449565 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3588e07f-e2b3-4c2e-87eb-f3bfcfa5226d tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/os-security-groups/89246358-e52b-4a18-89dd-8ef81780d9b9" status: 404 len: 194 microversion: 2.1 time: 0.111649 Sep 16 13:03:28.450078 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9a3905c7-3d77-49b0-b9f1-ba08202fa108 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:28.451164 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9a3905c7-3d77-49b0-b9f1-ba08202fa108 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: cc79a200-5972-4bec-9322-503d99b7d85a] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:28.457136 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1899/3681] 10.222.0.67 () {58 vars in 1269 bytes} [Fri Sep 16 13:03:28 2022] GET /compute/v2.1/os-security-groups/89246358-e52b-4a18-89dd-8ef81780d9b9 => generated 194 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 13:03:28.459734 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9a3905c7-3d77-49b0-b9f1-ba08202fa108 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:28.460619 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9a3905c7-3d77-49b0-b9f1-ba08202fa108 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:28.461319 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9a3905c7-3d77-49b0-b9f1-ba08202fa108 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:28.462171 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9a3905c7-3d77-49b0-b9f1-ba08202fa108 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:28.462758 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9a3905c7-3d77-49b0-b9f1-ba08202fa108 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:28.463303 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9a3905c7-3d77-49b0-b9f1-ba08202fa108 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:28.473876 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b427fca5-87e2-48c3-813a-8408177ef35c tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Action: 'create', calling method: .version_select at 0x7f10359e5700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2042333074", "description": "tempest-description-1540632388"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:03:28.481787 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-9a3905c7-3d77-49b0-b9f1-ba08202fa108 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] HTTP exception thrown: Instance cc79a200-5972-4bec-9322-503d99b7d85a could not be found. Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9a3905c7-3d77-49b0-b9f1-ba08202fa108 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Request method failure captured: Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: request: DELETE /compute/v2.1/servers/cc79a200-5972-4bec-9322-503d99b7d85a HTTP/1.1 Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHK-ai74OxrHHqL5ZA97hOvy32Q6xIReVrKhZIj6PEPyQ_UB4rFs-7hdJCkozKZ5clo_9DaVkBFgsUmiSN_gmVaPdL8FT-f5QYKPk-CE61XDTK1RMhpnQkeVMlba4E4KaPfDCDA8WSNup3uH3mzkxsd2kp-OesctbTYQkqWqHnAvC3I Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_cfe82d8dd4fb42cbb054a6f069424c57", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-DeleteServersTestJSON-1385458479-project Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 2e531a7026054c34b2a78a1c484cbe02 Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-DeleteServersTestJSON-1385458479-project Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance cc79a200-5972-4bec-9322-503d99b7d85a could not be found. Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'cc79a200-5972-4bec-9322-503d99b7d85a'} Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc79a200-5972-4bec-9322-503d99b7d85a could not be found. Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:03:28.484099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:03:28.490066 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc79a200-5972-4bec-9322-503d99b7d85a could not be found. Sep 16 13:03:28.490066 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:03:28.490066 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:28.490066 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:03:28.490066 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:28.490066 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:03:28.490066 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:03:28.490066 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:03:28.490066 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:03:28.490066 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc79a200-5972-4bec-9322-503d99b7d85a could not be found. Sep 16 13:03:28.490066 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:03:28.490066 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9a3905c7-3d77-49b0-b9f1-ba08202fa108 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Returning 404 to user: Instance cc79a200-5972-4bec-9322-503d99b7d85a could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:03:28.492651 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9a3905c7-3d77-49b0-b9f1-ba08202fa108 tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "DELETE /compute/v2.1/servers/cc79a200-5972-4bec-9322-503d99b7d85a" status: 404 len: 111 microversion: 2.1 time: 0.062116 Sep 16 13:03:28.497072 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1783/3682] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 13:03:28 2022] DELETE /compute/v2.1/servers/cc79a200-5972-4bec-9322-503d99b7d85a => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:03:28.502711 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ffbd5282-8eb3-4bc9-94e7-61251333eb8f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:28.503476 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ffbd5282-8eb3-4bc9-94e7-61251333eb8f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] [instance: cc79a200-5972-4bec-9322-503d99b7d85a] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:28.510798 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ffbd5282-8eb3-4bc9-94e7-61251333eb8f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:28.511609 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ffbd5282-8eb3-4bc9-94e7-61251333eb8f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:28.512175 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ffbd5282-8eb3-4bc9-94e7-61251333eb8f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:28.513616 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ffbd5282-8eb3-4bc9-94e7-61251333eb8f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:28.514201 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ffbd5282-8eb3-4bc9-94e7-61251333eb8f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:28.514887 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ffbd5282-8eb3-4bc9-94e7-61251333eb8f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:28.532519 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-ffbd5282-8eb3-4bc9-94e7-61251333eb8f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] HTTP exception thrown: Instance cc79a200-5972-4bec-9322-503d99b7d85a could not be found. Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ffbd5282-8eb3-4bc9-94e7-61251333eb8f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Request method failure captured: Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/cc79a200-5972-4bec-9322-503d99b7d85a HTTP/1.1 Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHK-ai74OxrHHqL5ZA97hOvy32Q6xIReVrKhZIj6PEPyQ_UB4rFs-7hdJCkozKZ5clo_9DaVkBFgsUmiSN_gmVaPdL8FT-f5QYKPk-CE61XDTK1RMhpnQkeVMlba4E4KaPfDCDA8WSNup3uH3mzkxsd2kp-OesctbTYQkqWqHnAvC3I Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_cfe82d8dd4fb42cbb054a6f069424c57", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cfe82d8dd4fb42cbb054a6f069424c57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: cfe82d8dd4fb42cbb054a6f069424c57 Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-DeleteServersTestJSON-1385458479 Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-DeleteServersTestJSON-1385458479-project Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 2e531a7026054c34b2a78a1c484cbe02 Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-DeleteServersTestJSON-1385458479-project Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance cc79a200-5972-4bec-9322-503d99b7d85a could not be found. Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'cc79a200-5972-4bec-9322-503d99b7d85a'} Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc79a200-5972-4bec-9322-503d99b7d85a could not be found. Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc79a200-5972-4bec-9322-503d99b7d85a could not be found. Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:28.536201 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:03:28.544806 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:28.544806 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:03:28.544806 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:03:28.544806 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:03:28.544806 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:03:28.544806 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc79a200-5972-4bec-9322-503d99b7d85a could not be found. Sep 16 13:03:28.544806 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:03:28.548998 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ffbd5282-8eb3-4bc9-94e7-61251333eb8f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] Returning 404 to user: Instance cc79a200-5972-4bec-9322-503d99b7d85a could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:03:28.549965 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ffbd5282-8eb3-4bc9-94e7-61251333eb8f tempest-DeleteServersTestJSON-1385458479 tempest-DeleteServersTestJSON-1385458479-project] 10.222.0.67 "GET /compute/v2.1/servers/cc79a200-5972-4bec-9322-503d99b7d85a" status: 404 len: 111 microversion: 2.1 time: 0.051707 Sep 16 13:03:28.553845 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1784/3683] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:28 2022] GET /compute/v2.1/servers/cc79a200-5972-4bec-9322-503d99b7d85a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:03:28.562706 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-80657db5-c9f6-46fd-8c9e-f86d53b7cdd9 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:28.563320 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-80657db5-c9f6-46fd-8c9e-f86d53b7cdd9 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:28.607567 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-80657db5-c9f6-46fd-8c9e-f86d53b7cdd9 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:28.608061 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-80657db5-c9f6-46fd-8c9e-f86d53b7cdd9 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:28.608537 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-80657db5-c9f6-46fd-8c9e-f86d53b7cdd9 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:28.609261 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-80657db5-c9f6-46fd-8c9e-f86d53b7cdd9 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:28.609729 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-80657db5-c9f6-46fd-8c9e-f86d53b7cdd9 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:28.610160 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-80657db5-c9f6-46fd-8c9e-f86d53b7cdd9 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:29.436902 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-80657db5-c9f6-46fd-8c9e-f86d53b7cdd9 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:29.445694 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-80657db5-c9f6-46fd-8c9e-f86d53b7cdd9 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:29.447154 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-80657db5-c9f6-46fd-8c9e-f86d53b7cdd9 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:29.448388 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-80657db5-c9f6-46fd-8c9e-f86d53b7cdd9 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1666 microversion: 2.20 time: 0.890111 Sep 16 13:03:29.449104 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1785/3684] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:03:28 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1666 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:03:29.473794 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c90778d3-23d8-459c-8b4d-8ce92e69f093 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:29.477986 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c90778d3-23d8-459c-8b4d-8ce92e69f093 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:29.489800 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c90778d3-23d8-459c-8b4d-8ce92e69f093 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:29.496901 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c90778d3-23d8-459c-8b4d-8ce92e69f093 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:29.497645 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c90778d3-23d8-459c-8b4d-8ce92e69f093 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:29.498615 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c90778d3-23d8-459c-8b4d-8ce92e69f093 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:29.499297 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c90778d3-23d8-459c-8b4d-8ce92e69f093 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:29.499950 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c90778d3-23d8-459c-8b4d-8ce92e69f093 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:29.860265 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b427fca5-87e2-48c3-813a-8408177ef35c tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.401095 Sep 16 13:03:29.862347 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1900/3685] 10.222.0.67 () {60 vars in 1180 bytes} [Fri Sep 16 13:03:28 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:03:29.872396 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-47ecb8c5-b795-4600-9772-113a28acd4a1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73c6e108-268d-4aa7-8056-d5957bfff255"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:03:29.885909 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-47ecb8c5-b795-4600-9772-113a28acd4a1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:29.972170 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47ecb8c5-b795-4600-9772-113a28acd4a1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:29.977473 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47ecb8c5-b795-4600-9772-113a28acd4a1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:29.978364 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47ecb8c5-b795-4600-9772-113a28acd4a1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:29.987197 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47ecb8c5-b795-4600-9772-113a28acd4a1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:29.988233 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47ecb8c5-b795-4600-9772-113a28acd4a1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:29.989698 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47ecb8c5-b795-4600-9772-113a28acd4a1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:30.162899 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c90778d3-23d8-459c-8b4d-8ce92e69f093 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:30.173137 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c90778d3-23d8-459c-8b4d-8ce92e69f093 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1678 microversion: 2.1 time: 0.703199 Sep 16 13:03:30.179965 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1786/3686] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:29 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1678 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:30.198252 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4baecb34-334b-40fb-a6f9-0d7bb39b90c1 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Action: 'create', calling method: .version_select at 0x7f1034875550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1058067203", "description": "tempest-description-452412671"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:03:30.722169 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-47ecb8c5-b795-4600-9772-113a28acd4a1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "POST /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.858351 Sep 16 13:03:30.723563 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1901/3687] 10.222.0.67 () {62 vars in 1364 bytes} [Fri Sep 16 13:03:29 2022] POST /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44/os-volume_attachments => generated 188 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:03:30.993900 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4baecb34-334b-40fb-a6f9-0d7bb39b90c1 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.810754 Sep 16 13:03:30.994592 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1787/3688] 10.222.0.67 () {60 vars in 1180 bytes} [Fri Sep 16 13:03:30 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:03:31.008707 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8d622813-858a-4624-9015-f1eea772b65b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Action: 'create', calling method: .version_select at 0x7f103529a790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1158298770", "description": "tempest-description-1703559334"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:03:31.051094 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7b772e38-6f82-4909-b218-4891db6d04a1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:03:31.052051 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7b772e38-6f82-4909-b218-4891db6d04a1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:31.064762 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7b772e38-6f82-4909-b218-4891db6d04a1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:31.074896 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7b772e38-6f82-4909-b218-4891db6d04a1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:31.076015 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7b772e38-6f82-4909-b218-4891db6d04a1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:31.086511 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7b772e38-6f82-4909-b218-4891db6d04a1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:31.087158 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7b772e38-6f82-4909-b218-4891db6d04a1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:31.091203 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7b772e38-6f82-4909-b218-4891db6d04a1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:31.570339 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7b772e38-6f82-4909-b218-4891db6d04a1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128780) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 16 13:03:31.765101 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8d622813-858a-4624-9015-f1eea772b65b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.761378 Sep 16 13:03:31.767531 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1902/3689] 10.222.0.67 () {60 vars in 1180 bytes} [Fri Sep 16 13:03:31 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:03:31.772980 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-81a76e92-cd95-41bc-8d72-252969cad312 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:31.773909 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-81a76e92-cd95-41bc-8d72-252969cad312 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:31.826257 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7b772e38-6f82-4909-b218-4891db6d04a1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "POST /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44/action" status: 202 len: 0 microversion: 2.20 time: 0.778952 Sep 16 13:03:31.826886 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1788/3690] 10.222.0.67 () {62 vars in 1319 bytes} [Fri Sep 16 13:03:31 2022] POST /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44/action => generated 0 bytes in 780 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:03:31.831006 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81a76e92-cd95-41bc-8d72-252969cad312 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:31.831806 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81a76e92-cd95-41bc-8d72-252969cad312 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:31.840394 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81a76e92-cd95-41bc-8d72-252969cad312 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:31.844075 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81a76e92-cd95-41bc-8d72-252969cad312 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:31.844816 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81a76e92-cd95-41bc-8d72-252969cad312 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:31.846194 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81a76e92-cd95-41bc-8d72-252969cad312 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:31.857173 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-aa8c9b6b-8761-415a-abad-fdbbb4ddf62f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '.version_select at 0x7f10349224c0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:32.353508 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-81a76e92-cd95-41bc-8d72-252969cad312 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:32.410221 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-81a76e92-cd95-41bc-8d72-252969cad312 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1678 microversion: 2.1 time: 0.641115 Sep 16 13:03:32.411028 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1903/3691] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:31 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1678 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:32.436055 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d1b488bb-537c-45b6-b206-ea0ae4fa150c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:32.436708 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d1b488bb-537c-45b6-b206-ea0ae4fa150c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:32.457268 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1b488bb-537c-45b6-b206-ea0ae4fa150c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:32.457956 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1b488bb-537c-45b6-b206-ea0ae4fa150c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:32.458234 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1b488bb-537c-45b6-b206-ea0ae4fa150c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:32.458963 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1b488bb-537c-45b6-b206-ea0ae4fa150c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:32.459425 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1b488bb-537c-45b6-b206-ea0ae4fa150c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:32.459857 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1b488bb-537c-45b6-b206-ea0ae4fa150c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:33.697309 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d1b488bb-537c-45b6-b206-ea0ae4fa150c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:33.707623 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-aa8c9b6b-8761-415a-abad-fdbbb4ddf62f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/os-security-groups" status: 200 len: 1834 microversion: 2.1 time: 1.870161 Sep 16 13:03:33.709376 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1789/3692] 10.222.0.67 () {58 vars in 1158 bytes} [Fri Sep 16 13:03:31 2022] GET /compute/v2.1/os-security-groups => generated 1834 bytes in 1882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:33.712624 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d1b488bb-537c-45b6-b206-ea0ae4fa150c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:33.716785 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d1b488bb-537c-45b6-b206-ea0ae4fa150c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:33.726483 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a11f12eb-58ba-4ab5-bff9-593cc783350f tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:33.728582 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a11f12eb-58ba-4ab5-bff9-593cc783350f tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:33.742911 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d1b488bb-537c-45b6-b206-ea0ae4fa150c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1752 microversion: 2.20 time: 1.327405 Sep 16 13:03:33.760329 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1904/3693] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:03:32 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1752 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:03:33.760329 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b1223a41-d1dc-4e35-b34a-2b9d71d991c0 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '.version_select at 0x7f1035225040>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:33.762781 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a11f12eb-58ba-4ab5-bff9-593cc783350f tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:33.769169 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a11f12eb-58ba-4ab5-bff9-593cc783350f tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:33.773785 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a11f12eb-58ba-4ab5-bff9-593cc783350f tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:33.774821 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a11f12eb-58ba-4ab5-bff9-593cc783350f tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:33.775700 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a11f12eb-58ba-4ab5-bff9-593cc783350f tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:33.777301 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a11f12eb-58ba-4ab5-bff9-593cc783350f tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:34.288917 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a11f12eb-58ba-4ab5-bff9-593cc783350f tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:34.312662 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a11f12eb-58ba-4ab5-bff9-593cc783350f tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1678 microversion: 2.1 time: 0.601621 Sep 16 13:03:34.320660 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1790/3694] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:33 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1678 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:34.334934 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b1223a41-d1dc-4e35-b34a-2b9d71d991c0 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/9d6728b4-995a-4db4-aae5-d8373ab678f5" status: 202 len: 0 microversion: 2.1 time: 0.586239 Sep 16 13:03:34.336212 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1905/3695] 10.222.0.67 () {58 vars in 1272 bytes} [Fri Sep 16 13:03:33 2022] DELETE /compute/v2.1/os-security-groups/9d6728b4-995a-4db4-aae5-d8373ab678f5 => generated 0 bytes in 588 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:03:34.345512 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-37d443ce-eb28-4db4-8c4f-bbca34210b4d tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '.version_select at 0x7f10349d70d0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:34.391313 n-d-858094-4 devstack@n-api.service[128780]: DEBUG neutronclient.v2_0.client [None req-37d443ce-eb28-4db4-8c4f-bbca34210b4d tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9d6728b4-995a-4db4-aae5-d8373ab678f5 does not exist", "detail": ""}} {{(pid=128780) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 13:03:34.391931 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.security_group_api [None req-37d443ce-eb28-4db4-8c4f-bbca34210b4d tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Neutron security group 9d6728b4-995a-4db4-aae5-d8373ab678f5 not found {{(pid=128780) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 16 13:03:34.392581 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-37d443ce-eb28-4db4-8c4f-bbca34210b4d tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] HTTP exception thrown: Security group 9d6728b4-995a-4db4-aae5-d8373ab678f5 does not exist Sep 16 13:03:34.392581 n-d-858094-4 devstack@n-api.service[128780]: Neutron server returns request_ids: ['req-4f50fb8b-2bb2-4ef5-8d1b-48642dbc871b'] Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-37d443ce-eb28-4db4-8c4f-bbca34210b4d tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Request method failure captured: Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/os-security-groups/9d6728b4-995a-4db4-aae5-d8373ab678f5 HTTP/1.1 Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHP182fOoXAmmtyFT24t1WldG_-n_fUq_hYyF_kcX6BBuNdLFPJQpvv1Qbau8uBELlze_J0V8PSdv80EZFiSQVIXVTfCMdV7A-swstczuz_Ini1wPhpJqJ2_9Cvd9QLrJtnV-zdKbzeKde8qkyp_ruLhl8BqedA5EVFg3XozRh0MDPU Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: aaeff399942c4286a71ea3a0eab43280 Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_aaeff399942c4286a71ea3a0eab43280", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: aaeff399942c4286a71ea3a0eab43280 Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-SecurityGroupsTestJSON-210138271-project Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 8ed69c96e39249f181eda742be229b97 Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-SecurityGroupsTestJSON-210138271-project Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: exception: Security group 9d6728b4-995a-4db4-aae5-d8373ab678f5 does not exist Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: Neutron server returns request_ids: ['req-4f50fb8b-2bb2-4ef5-8d1b-48642dbc871b'] Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '9d6728b4-995a-4db4-aae5-d8373ab678f5'} Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 13:03:34.396681 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9d6728b4-995a-4db4-aae5-d8373ab678f5 does not exist Sep 16 13:03:34.402044 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4f50fb8b-2bb2-4ef5-8d1b-48642dbc871b'] Sep 16 13:03:34.402044 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:03:34.402044 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:34.402044 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:03:34.402044 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:34.402044 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 16 13:03:34.402044 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 16 13:03:34.402044 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 16 13:03:34.402044 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 16 13:03:34.402044 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9d6728b4-995a-4db4-aae5-d8373ab678f5 does not exist Sep 16 13:03:34.402044 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4f50fb8b-2bb2-4ef5-8d1b-48642dbc871b'] Sep 16 13:03:34.402044 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:03:34.402044 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:34.402044 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:03:34.402044 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:34.402044 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:03:34.402044 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:03:34.402044 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:03:34.402044 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:03:34.402044 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:03:34.402044 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:03:34.402044 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:03:34.402044 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:03:34.402044 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 16 13:03:34.402044 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 16 13:03:34.402044 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9d6728b4-995a-4db4-aae5-d8373ab678f5 does not exist Sep 16 13:03:34.402044 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4f50fb8b-2bb2-4ef5-8d1b-48642dbc871b'] Sep 16 13:03:34.402044 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:03:34.402044 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:34.402044 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:03:34.402044 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:34.402044 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:03:34.402044 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:03:34.402044 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:03:34.402044 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:03:34.402044 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9d6728b4-995a-4db4-aae5-d8373ab678f5 does not exist Sep 16 13:03:34.402044 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4f50fb8b-2bb2-4ef5-8d1b-48642dbc871b'] Sep 16 13:03:34.402044 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:03:34.408292 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-37d443ce-eb28-4db4-8c4f-bbca34210b4d tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Returning 404 to user: Security group 9d6728b4-995a-4db4-aae5-d8373ab678f5 does not exist Sep 16 13:03:34.408292 n-d-858094-4 devstack@n-api.service[128780]: Neutron server returns request_ids: ['req-4f50fb8b-2bb2-4ef5-8d1b-48642dbc871b'] {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:03:34.410825 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-37d443ce-eb28-4db4-8c4f-bbca34210b4d tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/os-security-groups/9d6728b4-995a-4db4-aae5-d8373ab678f5" status: 404 len: 194 microversion: 2.1 time: 0.070575 Sep 16 13:03:34.412691 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1791/3696] 10.222.0.67 () {58 vars in 1269 bytes} [Fri Sep 16 13:03:34 2022] GET /compute/v2.1/os-security-groups/9d6728b4-995a-4db4-aae5-d8373ab678f5 => generated 194 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:03:34.422739 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cd8cdded-701d-41d8-92fc-defca2395389 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '.version_select at 0x7f10351bd310>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:34.777296 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1ad66f90-ad20-481d-b5bd-2fe3d5d07d42 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:34.778643 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-1ad66f90-ad20-481d-b5bd-2fe3d5d07d42 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:34.801971 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1ad66f90-ad20-481d-b5bd-2fe3d5d07d42 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:34.803651 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1ad66f90-ad20-481d-b5bd-2fe3d5d07d42 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:34.804348 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1ad66f90-ad20-481d-b5bd-2fe3d5d07d42 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:34.809451 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1ad66f90-ad20-481d-b5bd-2fe3d5d07d42 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:34.811377 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1ad66f90-ad20-481d-b5bd-2fe3d5d07d42 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:34.813103 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1ad66f90-ad20-481d-b5bd-2fe3d5d07d42 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:34.829010 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cd8cdded-701d-41d8-92fc-defca2395389 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/54fc3599-fdb8-4090-bf2c-a856093a34d5" status: 202 len: 0 microversion: 2.1 time: 0.411405 Sep 16 13:03:34.831326 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1906/3697] 10.222.0.67 () {58 vars in 1272 bytes} [Fri Sep 16 13:03:34 2022] DELETE /compute/v2.1/os-security-groups/54fc3599-fdb8-4090-bf2c-a856093a34d5 => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:03:34.843356 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3fbf3e69-c090-4de8-8535-6b9d7722bb0e tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '.version_select at 0x7f10351bdd30>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:35.051827 n-d-858094-4 devstack@n-api.service[128779]: DEBUG neutronclient.v2_0.client [None req-3fbf3e69-c090-4de8-8535-6b9d7722bb0e tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 54fc3599-fdb8-4090-bf2c-a856093a34d5 does not exist", "detail": ""}} {{(pid=128779) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 13:03:35.052511 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.security_group_api [None req-3fbf3e69-c090-4de8-8535-6b9d7722bb0e tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Neutron security group 54fc3599-fdb8-4090-bf2c-a856093a34d5 not found {{(pid=128779) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 16 13:03:35.053342 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-3fbf3e69-c090-4de8-8535-6b9d7722bb0e tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] HTTP exception thrown: Security group 54fc3599-fdb8-4090-bf2c-a856093a34d5 does not exist Sep 16 13:03:35.053342 n-d-858094-4 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-e1db32b4-685f-467d-979c-ae6c7c2ca33b'] Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3fbf3e69-c090-4de8-8535-6b9d7722bb0e tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Request method failure captured: Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/os-security-groups/54fc3599-fdb8-4090-bf2c-a856093a34d5 HTTP/1.1 Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHP182fOoXAmmtyFT24t1WldG_-n_fUq_hYyF_kcX6BBuNdLFPJQpvv1Qbau8uBELlze_J0V8PSdv80EZFiSQVIXVTfCMdV7A-swstczuz_Ini1wPhpJqJ2_9Cvd9QLrJtnV-zdKbzeKde8qkyp_ruLhl8BqedA5EVFg3XozRh0MDPU Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: aaeff399942c4286a71ea3a0eab43280 Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_aaeff399942c4286a71ea3a0eab43280", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: aaeff399942c4286a71ea3a0eab43280 Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-SecurityGroupsTestJSON-210138271-project Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 8ed69c96e39249f181eda742be229b97 Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-SecurityGroupsTestJSON-210138271-project Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: exception: Security group 54fc3599-fdb8-4090-bf2c-a856093a34d5 does not exist Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-e1db32b4-685f-467d-979c-ae6c7c2ca33b'] Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '54fc3599-fdb8-4090-bf2c-a856093a34d5'} Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 13:03:35.055643 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 54fc3599-fdb8-4090-bf2c-a856093a34d5 does not exist Sep 16 13:03:35.060896 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1db32b4-685f-467d-979c-ae6c7c2ca33b'] Sep 16 13:03:35.060896 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:35.060896 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:35.060896 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:35.060896 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:35.060896 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 16 13:03:35.060896 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 16 13:03:35.060896 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 16 13:03:35.060896 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 16 13:03:35.060896 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 54fc3599-fdb8-4090-bf2c-a856093a34d5 does not exist Sep 16 13:03:35.060896 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1db32b4-685f-467d-979c-ae6c7c2ca33b'] Sep 16 13:03:35.060896 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:35.060896 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:35.060896 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:35.060896 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:35.060896 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:03:35.060896 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:03:35.060896 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:03:35.060896 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:03:35.060896 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:03:35.060896 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:03:35.060896 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:03:35.060896 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:03:35.060896 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 16 13:03:35.060896 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 16 13:03:35.060896 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 54fc3599-fdb8-4090-bf2c-a856093a34d5 does not exist Sep 16 13:03:35.060896 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1db32b4-685f-467d-979c-ae6c7c2ca33b'] Sep 16 13:03:35.060896 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:35.060896 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:35.060896 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:35.060896 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:35.060896 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:03:35.060896 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:03:35.060896 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:03:35.060896 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:03:35.060896 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 54fc3599-fdb8-4090-bf2c-a856093a34d5 does not exist Sep 16 13:03:35.060896 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1db32b4-685f-467d-979c-ae6c7c2ca33b'] Sep 16 13:03:35.060896 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:35.067691 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3fbf3e69-c090-4de8-8535-6b9d7722bb0e tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Returning 404 to user: Security group 54fc3599-fdb8-4090-bf2c-a856093a34d5 does not exist Sep 16 13:03:35.067691 n-d-858094-4 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-e1db32b4-685f-467d-979c-ae6c7c2ca33b'] {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:03:35.067691 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3fbf3e69-c090-4de8-8535-6b9d7722bb0e tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/os-security-groups/54fc3599-fdb8-4090-bf2c-a856093a34d5" status: 404 len: 194 microversion: 2.1 time: 0.231212 Sep 16 13:03:35.068443 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1907/3698] 10.222.0.67 () {58 vars in 1269 bytes} [Fri Sep 16 13:03:34 2022] GET /compute/v2.1/os-security-groups/54fc3599-fdb8-4090-bf2c-a856093a34d5 => generated 194 bytes in 233 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:03:35.081185 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-00262fec-f87f-4c0a-911d-f310a53cf027 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '.version_select at 0x7f10354e7550>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:35.434930 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1ad66f90-ad20-481d-b5bd-2fe3d5d07d42 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:35.454300 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1ad66f90-ad20-481d-b5bd-2fe3d5d07d42 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:35.455821 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1ad66f90-ad20-481d-b5bd-2fe3d5d07d42 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:35.457061 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1ad66f90-ad20-481d-b5bd-2fe3d5d07d42 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1754 microversion: 2.20 time: 0.684605 Sep 16 13:03:35.468696 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1792/3699] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:03:34 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1754 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:03:35.493966 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-cb910ed5-2695-4ac0-a47e-64e75f9e88a5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:35.498034 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-cb910ed5-2695-4ac0-a47e-64e75f9e88a5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:35.529397 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cb910ed5-2695-4ac0-a47e-64e75f9e88a5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:35.529912 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cb910ed5-2695-4ac0-a47e-64e75f9e88a5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:35.530359 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cb910ed5-2695-4ac0-a47e-64e75f9e88a5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:35.538393 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cb910ed5-2695-4ac0-a47e-64e75f9e88a5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:35.538393 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cb910ed5-2695-4ac0-a47e-64e75f9e88a5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:35.538393 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-cb910ed5-2695-4ac0-a47e-64e75f9e88a5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:36.774560 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-00262fec-f87f-4c0a-911d-f310a53cf027 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/36d20921-59f1-4f72-b163-c875dfa04ed8" status: 202 len: 0 microversion: 2.1 time: 1.701229 Sep 16 13:03:36.775161 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1908/3700] 10.222.0.67 () {58 vars in 1272 bytes} [Fri Sep 16 13:03:35 2022] DELETE /compute/v2.1/os-security-groups/36d20921-59f1-4f72-b163-c875dfa04ed8 => generated 0 bytes in 1704 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 13:03:36.781269 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-514d09b8-729a-427a-acf8-e1953b0407c4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:36.781895 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-514d09b8-729a-427a-acf8-e1953b0407c4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:36.807106 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-514d09b8-729a-427a-acf8-e1953b0407c4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:36.807616 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-514d09b8-729a-427a-acf8-e1953b0407c4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:36.812482 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-514d09b8-729a-427a-acf8-e1953b0407c4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:36.813596 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-514d09b8-729a-427a-acf8-e1953b0407c4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:36.818483 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-514d09b8-729a-427a-acf8-e1953b0407c4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:36.821280 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-514d09b8-729a-427a-acf8-e1953b0407c4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:36.900457 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-cb910ed5-2695-4ac0-a47e-64e75f9e88a5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:36.929186 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-cb910ed5-2695-4ac0-a47e-64e75f9e88a5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1678 microversion: 2.1 time: 1.446215 Sep 16 13:03:36.930368 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1793/3701] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:35 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1678 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:36.938913 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-312f4a3a-b71a-4c47-b34a-c867e84179ce tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '.version_select at 0x7f10349223a0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:37.194546 n-d-858094-4 devstack@n-api.service[128780]: DEBUG neutronclient.v2_0.client [None req-312f4a3a-b71a-4c47-b34a-c867e84179ce tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 36d20921-59f1-4f72-b163-c875dfa04ed8 does not exist", "detail": ""}} {{(pid=128780) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 13:03:37.199457 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.security_group_api [None req-312f4a3a-b71a-4c47-b34a-c867e84179ce tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Neutron security group 36d20921-59f1-4f72-b163-c875dfa04ed8 not found {{(pid=128780) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 16 13:03:37.201658 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-312f4a3a-b71a-4c47-b34a-c867e84179ce tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] HTTP exception thrown: Security group 36d20921-59f1-4f72-b163-c875dfa04ed8 does not exist Sep 16 13:03:37.201658 n-d-858094-4 devstack@n-api.service[128780]: Neutron server returns request_ids: ['req-bee07b36-8750-46b9-9640-bf8c7c0663e7'] Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-312f4a3a-b71a-4c47-b34a-c867e84179ce tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Request method failure captured: Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/os-security-groups/36d20921-59f1-4f72-b163-c875dfa04ed8 HTTP/1.1 Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHP182fOoXAmmtyFT24t1WldG_-n_fUq_hYyF_kcX6BBuNdLFPJQpvv1Qbau8uBELlze_J0V8PSdv80EZFiSQVIXVTfCMdV7A-swstczuz_Ini1wPhpJqJ2_9Cvd9QLrJtnV-zdKbzeKde8qkyp_ruLhl8BqedA5EVFg3XozRh0MDPU Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: aaeff399942c4286a71ea3a0eab43280 Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_aaeff399942c4286a71ea3a0eab43280", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: aaeff399942c4286a71ea3a0eab43280 Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-SecurityGroupsTestJSON-210138271-project Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 8ed69c96e39249f181eda742be229b97 Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-SecurityGroupsTestJSON-210138271-project Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: exception: Security group 36d20921-59f1-4f72-b163-c875dfa04ed8 does not exist Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: Neutron server returns request_ids: ['req-bee07b36-8750-46b9-9640-bf8c7c0663e7'] Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '36d20921-59f1-4f72-b163-c875dfa04ed8'} Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 13:03:37.208575 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 36d20921-59f1-4f72-b163-c875dfa04ed8 does not exist Sep 16 13:03:37.216948 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bee07b36-8750-46b9-9640-bf8c7c0663e7'] Sep 16 13:03:37.216948 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:03:37.216948 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:37.216948 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:03:37.216948 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:37.216948 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 16 13:03:37.216948 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 16 13:03:37.216948 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 16 13:03:37.216948 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 16 13:03:37.216948 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 36d20921-59f1-4f72-b163-c875dfa04ed8 does not exist Sep 16 13:03:37.216948 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bee07b36-8750-46b9-9640-bf8c7c0663e7'] Sep 16 13:03:37.216948 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:03:37.216948 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:37.216948 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:03:37.216948 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:37.216948 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:03:37.216948 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:03:37.216948 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:03:37.216948 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:03:37.216948 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:03:37.216948 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:03:37.216948 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:03:37.216948 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:03:37.216948 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 16 13:03:37.216948 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 16 13:03:37.216948 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 36d20921-59f1-4f72-b163-c875dfa04ed8 does not exist Sep 16 13:03:37.216948 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bee07b36-8750-46b9-9640-bf8c7c0663e7'] Sep 16 13:03:37.216948 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:03:37.216948 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:37.216948 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:03:37.216948 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:37.216948 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:03:37.216948 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:03:37.216948 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:03:37.216948 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:03:37.216948 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 36d20921-59f1-4f72-b163-c875dfa04ed8 does not exist Sep 16 13:03:37.216948 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bee07b36-8750-46b9-9640-bf8c7c0663e7'] Sep 16 13:03:37.216948 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:03:37.224788 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-312f4a3a-b71a-4c47-b34a-c867e84179ce tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Returning 404 to user: Security group 36d20921-59f1-4f72-b163-c875dfa04ed8 does not exist Sep 16 13:03:37.224788 n-d-858094-4 devstack@n-api.service[128780]: Neutron server returns request_ids: ['req-bee07b36-8750-46b9-9640-bf8c7c0663e7'] {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:03:37.224788 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-312f4a3a-b71a-4c47-b34a-c867e84179ce tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/os-security-groups/36d20921-59f1-4f72-b163-c875dfa04ed8" status: 404 len: 194 microversion: 2.1 time: 0.290308 Sep 16 13:03:37.226697 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1794/3702] 10.222.0.67 () {58 vars in 1269 bytes} [Fri Sep 16 13:03:36 2022] GET /compute/v2.1/os-security-groups/36d20921-59f1-4f72-b163-c875dfa04ed8 => generated 194 bytes in 295 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:03:37.244342 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-453cebae-ca28-4da0-9a1b-59837032b91e tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '.version_select at 0x7f1034863670>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:37.355329 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-514d09b8-729a-427a-acf8-e1953b0407c4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:37.372278 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-514d09b8-729a-427a-acf8-e1953b0407c4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:37.374292 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-514d09b8-729a-427a-acf8-e1953b0407c4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:37.382785 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-514d09b8-729a-427a-acf8-e1953b0407c4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1754 microversion: 2.20 time: 0.602815 Sep 16 13:03:37.384079 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1909/3703] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:03:36 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1754 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:03:37.895552 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-453cebae-ca28-4da0-9a1b-59837032b91e tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.665573 Sep 16 13:03:37.896217 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1795/3704] 10.222.0.67 () {58 vars in 1158 bytes} [Fri Sep 16 13:03:37 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:37.913678 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f82a1d19-6b42-4d6f-9a94-c40f8003f278 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Action: 'create', calling method: .version_select at 0x7f1035235430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1524358725", "description": "tempest-description-2059206133"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:03:37.971780 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-73f3ab2d-dd87-41a8-866f-8e91a60ab358 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:37.984452 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-73f3ab2d-dd87-41a8-866f-8e91a60ab358 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:38.002991 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-73f3ab2d-dd87-41a8-866f-8e91a60ab358 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:38.006945 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-73f3ab2d-dd87-41a8-866f-8e91a60ab358 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:38.008521 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-73f3ab2d-dd87-41a8-866f-8e91a60ab358 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:38.009634 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-73f3ab2d-dd87-41a8-866f-8e91a60ab358 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:38.011977 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-73f3ab2d-dd87-41a8-866f-8e91a60ab358 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:38.012736 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-73f3ab2d-dd87-41a8-866f-8e91a60ab358 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:38.547306 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-73f3ab2d-dd87-41a8-866f-8e91a60ab358 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:38.569645 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-73f3ab2d-dd87-41a8-866f-8e91a60ab358 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1678 microversion: 2.1 time: 0.606510 Sep 16 13:03:38.572741 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1796/3705] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:37 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1678 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:38.584641 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-912f3427-2930-4c51-8d82-9f23a310d390 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:38.584641 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-912f3427-2930-4c51-8d82-9f23a310d390 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:38.606518 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-912f3427-2930-4c51-8d82-9f23a310d390 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:38.611292 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-912f3427-2930-4c51-8d82-9f23a310d390 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:38.612021 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-912f3427-2930-4c51-8d82-9f23a310d390 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:38.613153 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-912f3427-2930-4c51-8d82-9f23a310d390 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:38.616514 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-912f3427-2930-4c51-8d82-9f23a310d390 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:38.617482 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-912f3427-2930-4c51-8d82-9f23a310d390 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:39.212464 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-912f3427-2930-4c51-8d82-9f23a310d390 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:39.222632 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-912f3427-2930-4c51-8d82-9f23a310d390 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:39.238529 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-912f3427-2930-4c51-8d82-9f23a310d390 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:39.240383 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-912f3427-2930-4c51-8d82-9f23a310d390 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1754 microversion: 2.20 time: 0.663682 Sep 16 13:03:39.241647 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1797/3706] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:03:38 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1754 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:03:39.271401 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f82a1d19-6b42-4d6f-9a94-c40f8003f278 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.362623 Sep 16 13:03:39.283020 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1910/3707] 10.222.0.67 () {60 vars in 1180 bytes} [Fri Sep 16 13:03:37 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:03:39.289330 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8db7bae6-4147-4b62-bc03-cebf78aa429f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Action: 'create', calling method: .version_select at 0x7f1034a5d040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-264247054", "description": "tempest-description-1823667827"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:03:39.605727 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-da79b50b-3e61-4d06-8520-4f7fc13e6f28 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:39.609347 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-da79b50b-3e61-4d06-8520-4f7fc13e6f28 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:39.669545 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da79b50b-3e61-4d06-8520-4f7fc13e6f28 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:39.673052 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da79b50b-3e61-4d06-8520-4f7fc13e6f28 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:39.677959 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da79b50b-3e61-4d06-8520-4f7fc13e6f28 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:39.681691 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da79b50b-3e61-4d06-8520-4f7fc13e6f28 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:39.685256 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da79b50b-3e61-4d06-8520-4f7fc13e6f28 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:39.688116 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da79b50b-3e61-4d06-8520-4f7fc13e6f28 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:39.705265 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:03:40.317990 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8db7bae6-4147-4b62-bc03-cebf78aa429f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.032706 Sep 16 13:03:40.320506 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1798/3708] 10.222.0.67 () {60 vars in 1180 bytes} [Fri Sep 16 13:03:39 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:03:40.326325 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9bd8a4ff-a87d-4cb5-8c01-5b45e70e2c96 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:40.327739 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9bd8a4ff-a87d-4cb5-8c01-5b45e70e2c96 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:40.349997 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9bd8a4ff-a87d-4cb5-8c01-5b45e70e2c96 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:40.354113 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9bd8a4ff-a87d-4cb5-8c01-5b45e70e2c96 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:40.357112 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9bd8a4ff-a87d-4cb5-8c01-5b45e70e2c96 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:40.358249 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9bd8a4ff-a87d-4cb5-8c01-5b45e70e2c96 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:40.359807 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9bd8a4ff-a87d-4cb5-8c01-5b45e70e2c96 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:40.360543 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9bd8a4ff-a87d-4cb5-8c01-5b45e70e2c96 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:41.818397 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-da79b50b-3e61-4d06-8520-4f7fc13e6f28 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:41.831686 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-da79b50b-3e61-4d06-8520-4f7fc13e6f28 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1678 microversion: 2.1 time: 2.236935 Sep 16 13:03:41.835409 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1911/3709] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:39 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1678 bytes in 2242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:41.845708 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2c2d6c5a-2429-4fad-82fa-1629ea01bce5 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-383827209", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": [{"uuid": "56dd3a41-efae-420b-b361-8c953ab80e6c"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:03:41.993043 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-2c2d6c5a-2429-4fad-82fa-1629ea01bce5 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] validate_networks() for [('56dd3a41-efae-420b-b361-8c953ab80e6c', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:03:42.150515 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9bd8a4ff-a87d-4cb5-8c01-5b45e70e2c96 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:42.163661 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9bd8a4ff-a87d-4cb5-8c01-5b45e70e2c96 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:42.165420 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9bd8a4ff-a87d-4cb5-8c01-5b45e70e2c96 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:42.166653 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9bd8a4ff-a87d-4cb5-8c01-5b45e70e2c96 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1754 microversion: 2.20 time: 1.844868 Sep 16 13:03:42.167274 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1799/3710] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:03:40 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1754 bytes in 1846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:03:42.192386 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a8726c1b-4049-4afa-95e7-81ccf3fa83f0 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:42.197376 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a8726c1b-4049-4afa-95e7-81ccf3fa83f0 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] [instance: 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:42.243915 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8726c1b-4049-4afa-95e7-81ccf3fa83f0 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:42.249281 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8726c1b-4049-4afa-95e7-81ccf3fa83f0 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:42.250002 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8726c1b-4049-4afa-95e7-81ccf3fa83f0 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:42.255079 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8726c1b-4049-4afa-95e7-81ccf3fa83f0 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:42.263823 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8726c1b-4049-4afa-95e7-81ccf3fa83f0 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:42.265171 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8726c1b-4049-4afa-95e7-81ccf3fa83f0 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:42.333593 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:03:42.356863 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a8726c1b-4049-4afa-95e7-81ccf3fa83f0 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] [instance: 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:03:42.570910 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a8726c1b-4049-4afa-95e7-81ccf3fa83f0 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] 10.222.0.67 "DELETE /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8" status: 204 len: 0 microversion: 2.1 time: 0.379359 Sep 16 13:03:42.581009 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1800/3711] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 13:03:42 2022] DELETE /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:03:42.602889 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a551796b-63ef-4eeb-87a6-d3d189fc3901 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:42.607194 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a551796b-63ef-4eeb-87a6-d3d189fc3901 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] [instance: 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:42.633574 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a551796b-63ef-4eeb-87a6-d3d189fc3901 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:42.638302 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a551796b-63ef-4eeb-87a6-d3d189fc3901 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:42.640224 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a551796b-63ef-4eeb-87a6-d3d189fc3901 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:42.642773 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a551796b-63ef-4eeb-87a6-d3d189fc3901 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:42.644492 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a551796b-63ef-4eeb-87a6-d3d189fc3901 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:42.646514 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a551796b-63ef-4eeb-87a6-d3d189fc3901 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:43.344094 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a551796b-63ef-4eeb-87a6-d3d189fc3901 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50f1d810ba34ef6a419d376f2b6c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82287f900aa34e05ba0e0cf7ba924585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:43.355692 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a551796b-63ef-4eeb-87a6-d3d189fc3901 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] 10.222.0.67 "GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8" status: 200 len: 1665 microversion: 2.1 time: 0.771772 Sep 16 13:03:43.363868 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1801/3712] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:42 2022] GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8 => generated 1665 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:43.393969 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-92e9f695-bc07-40c5-bba7-3df697c543ad tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:43.394889 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-92e9f695-bc07-40c5-bba7-3df697c543ad tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:43.413015 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92e9f695-bc07-40c5-bba7-3df697c543ad tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:43.413816 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92e9f695-bc07-40c5-bba7-3df697c543ad tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:43.416634 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92e9f695-bc07-40c5-bba7-3df697c543ad tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:43.419317 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92e9f695-bc07-40c5-bba7-3df697c543ad tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:43.423571 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92e9f695-bc07-40c5-bba7-3df697c543ad tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:43.424046 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92e9f695-bc07-40c5-bba7-3df697c543ad tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:44.004600 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-2c2d6c5a-2429-4fad-82fa-1629ea01bce5 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:03:44.005136 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-2c2d6c5a-2429-4fad-82fa-1629ea01bce5 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:03:44.005798 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-2c2d6c5a-2429-4fad-82fa-1629ea01bce5 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:03:44.006469 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-2c2d6c5a-2429-4fad-82fa-1629ea01bce5 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:03:44.006898 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-2c2d6c5a-2429-4fad-82fa-1629ea01bce5 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:03:44.033702 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2c2d6c5a-2429-4fad-82fa-1629ea01bce5 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:44.034307 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2c2d6c5a-2429-4fad-82fa-1629ea01bce5 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:44.034998 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2c2d6c5a-2429-4fad-82fa-1629ea01bce5 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:44.036158 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2c2d6c5a-2429-4fad-82fa-1629ea01bce5 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:44.036874 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2c2d6c5a-2429-4fad-82fa-1629ea01bce5 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:44.037559 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2c2d6c5a-2429-4fad-82fa-1629ea01bce5 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:44.059828 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-2c2d6c5a-2429-4fad-82fa-1629ea01bce5 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Getting quotas for project aaeff399942c4286a71ea3a0eab43280. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:03:44.067284 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-2c2d6c5a-2429-4fad-82fa-1629ea01bce5 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Getting quotas for user 8ed69c96e39249f181eda742be229b97 and project aaeff399942c4286a71ea3a0eab43280. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:03:44.103720 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2c2d6c5a-2429-4fad-82fa-1629ea01bce5 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:03:44.112780 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2c2d6c5a-2429-4fad-82fa-1629ea01bce5 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 17bd55c8-4d10-424e-a143-037b14585d31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:03:44.230687 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2c2d6c5a-2429-4fad-82fa-1629ea01bce5 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.393550 Sep 16 13:03:44.235425 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1912/3713] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 13:03:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2399 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 13:03:44.247512 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c9cc74d7-461b-4491-a346-804cb3a46105 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:44.248405 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c9cc74d7-461b-4491-a346-804cb3a46105 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:44.252568 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-92e9f695-bc07-40c5-bba7-3df697c543ad tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:44.264486 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9cc74d7-461b-4491-a346-804cb3a46105 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:44.267660 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9cc74d7-461b-4491-a346-804cb3a46105 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:44.269271 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9cc74d7-461b-4491-a346-804cb3a46105 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:44.270203 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9cc74d7-461b-4491-a346-804cb3a46105 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:44.272069 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-92e9f695-bc07-40c5-bba7-3df697c543ad tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1678 microversion: 2.1 time: 0.900980 Sep 16 13:03:44.273368 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9cc74d7-461b-4491-a346-804cb3a46105 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:44.273994 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9cc74d7-461b-4491-a346-804cb3a46105 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:44.276529 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1802/3714] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:43 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1678 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:44.290941 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e72ef32f-0837-457b-97b0-e759e76ef3bd tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:44.294028 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e72ef32f-0837-457b-97b0-e759e76ef3bd tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 17bd55c8-4d10-424e-a143-037b14585d31] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:44.654189 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e72ef32f-0837-457b-97b0-e759e76ef3bd tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed69c96e39249f181eda742be229b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeff399942c4286a71ea3a0eab43280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:44.662285 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e72ef32f-0837-457b-97b0-e759e76ef3bd tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31" status: 200 len: 1215 microversion: 2.1 time: 0.379258 Sep 16 13:03:44.664721 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1803/3715] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:44 2022] GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31 => generated 1215 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:44.680431 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d147e987-8f60-43d8-a71d-48eececd938a tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:44.693814 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d147e987-8f60-43d8-a71d-48eececd938a tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] [instance: 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:44.731128 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d147e987-8f60-43d8-a71d-48eececd938a tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:44.731688 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d147e987-8f60-43d8-a71d-48eececd938a tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:44.732180 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d147e987-8f60-43d8-a71d-48eececd938a tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:44.732857 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d147e987-8f60-43d8-a71d-48eececd938a tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:44.733307 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d147e987-8f60-43d8-a71d-48eececd938a tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:44.733730 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d147e987-8f60-43d8-a71d-48eececd938a tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:44.998153 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c9cc74d7-461b-4491-a346-804cb3a46105 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:45.008228 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c9cc74d7-461b-4491-a346-804cb3a46105 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:45.017028 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c9cc74d7-461b-4491-a346-804cb3a46105 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:45.018621 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c9cc74d7-461b-4491-a346-804cb3a46105 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1754 microversion: 2.20 time: 0.781574 Sep 16 13:03:45.026018 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1913/3716] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:03:44 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1754 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:03:45.297751 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c3496058-5bd5-4d74-8b3a-dbbf695f5d62 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:45.298589 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c3496058-5bd5-4d74-8b3a-dbbf695f5d62 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:45.312541 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3496058-5bd5-4d74-8b3a-dbbf695f5d62 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:45.313349 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3496058-5bd5-4d74-8b3a-dbbf695f5d62 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:45.313963 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3496058-5bd5-4d74-8b3a-dbbf695f5d62 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:45.315932 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3496058-5bd5-4d74-8b3a-dbbf695f5d62 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:45.317182 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3496058-5bd5-4d74-8b3a-dbbf695f5d62 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:45.319910 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3496058-5bd5-4d74-8b3a-dbbf695f5d62 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:45.652346 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d147e987-8f60-43d8-a71d-48eececd938a tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50f1d810ba34ef6a419d376f2b6c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82287f900aa34e05ba0e0cf7ba924585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:45.664633 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d147e987-8f60-43d8-a71d-48eececd938a tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] 10.222.0.67 "GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8" status: 200 len: 1665 microversion: 2.1 time: 0.994910 Sep 16 13:03:45.666575 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1804/3717] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:44 2022] GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8 => generated 1665 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:45.691724 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a30d6601-1c40-497a-a00c-e7267c02a4b0 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:45.692707 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a30d6601-1c40-497a-a00c-e7267c02a4b0 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 17bd55c8-4d10-424e-a143-037b14585d31] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:45.702444 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a30d6601-1c40-497a-a00c-e7267c02a4b0 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:45.703245 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a30d6601-1c40-497a-a00c-e7267c02a4b0 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:45.705013 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a30d6601-1c40-497a-a00c-e7267c02a4b0 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:45.710248 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a30d6601-1c40-497a-a00c-e7267c02a4b0 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:45.711214 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a30d6601-1c40-497a-a00c-e7267c02a4b0 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:45.711823 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a30d6601-1c40-497a-a00c-e7267c02a4b0 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:45.958018 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c3496058-5bd5-4d74-8b3a-dbbf695f5d62 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:45.972456 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c3496058-5bd5-4d74-8b3a-dbbf695f5d62 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1665 microversion: 2.1 time: 0.678621 Sep 16 13:03:45.973827 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1914/3718] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:45 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1665 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:46.020080 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a30d6601-1c40-497a-a00c-e7267c02a4b0 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed69c96e39249f181eda742be229b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeff399942c4286a71ea3a0eab43280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:46.051406 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a30d6601-1c40-497a-a00c-e7267c02a4b0 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31" status: 200 len: 1211 microversion: 2.1 time: 0.363594 Sep 16 13:03:46.057142 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1805/3719] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:45 2022] GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31 => generated 1211 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:03:46.062358 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-02f74877-af44-4661-a886-28eff43c586f tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:46.063731 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-02f74877-af44-4661-a886-28eff43c586f tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:46.066261 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:03:46.084266 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02f74877-af44-4661-a886-28eff43c586f tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:46.086380 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02f74877-af44-4661-a886-28eff43c586f tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:46.090012 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02f74877-af44-4661-a886-28eff43c586f tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:46.092022 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02f74877-af44-4661-a886-28eff43c586f tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:46.093323 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02f74877-af44-4661-a886-28eff43c586f tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:46.094799 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02f74877-af44-4661-a886-28eff43c586f tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:46.694179 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d9d3885a-3384-4959-9c88-3ece84a329af tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:46.695066 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d9d3885a-3384-4959-9c88-3ece84a329af tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] [instance: 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:46.709979 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d9d3885a-3384-4959-9c88-3ece84a329af tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:46.710540 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d9d3885a-3384-4959-9c88-3ece84a329af tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:46.710987 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d9d3885a-3384-4959-9c88-3ece84a329af tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:46.711703 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d9d3885a-3384-4959-9c88-3ece84a329af tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:46.715221 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d9d3885a-3384-4959-9c88-3ece84a329af tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:46.716668 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d9d3885a-3384-4959-9c88-3ece84a329af tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:46.739006 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-02f74877-af44-4661-a886-28eff43c586f tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:46.771360 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-02f74877-af44-4661-a886-28eff43c586f tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:46.781256 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-02f74877-af44-4661-a886-28eff43c586f tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:46.781977 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-02f74877-af44-4661-a886-28eff43c586f tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1754 microversion: 2.20 time: 0.730787 Sep 16 13:03:46.786271 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1915/3720] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:03:46 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1754 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:03:47.075518 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8674f049-33dd-4f40-a797-78a325066109 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:47.077047 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8674f049-33dd-4f40-a797-78a325066109 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 17bd55c8-4d10-424e-a143-037b14585d31] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:47.085345 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8674f049-33dd-4f40-a797-78a325066109 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:47.086592 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8674f049-33dd-4f40-a797-78a325066109 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:47.087296 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8674f049-33dd-4f40-a797-78a325066109 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:47.088959 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8674f049-33dd-4f40-a797-78a325066109 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:47.089926 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8674f049-33dd-4f40-a797-78a325066109 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:47.090790 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8674f049-33dd-4f40-a797-78a325066109 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:47.590200 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8674f049-33dd-4f40-a797-78a325066109 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed69c96e39249f181eda742be229b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeff399942c4286a71ea3a0eab43280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:47.600225 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8674f049-33dd-4f40-a797-78a325066109 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31" status: 200 len: 1273 microversion: 2.1 time: 0.529035 Sep 16 13:03:47.600898 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1916/3721] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:47 2022] GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31 => generated 1273 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:03:47.617356 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e7a6ee02-aaa8-4bb1-bd53-3902a3d21805 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:47.627112 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e7a6ee02-aaa8-4bb1-bd53-3902a3d21805 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:47.635229 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7a6ee02-aaa8-4bb1-bd53-3902a3d21805 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:47.637331 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7a6ee02-aaa8-4bb1-bd53-3902a3d21805 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:47.638243 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7a6ee02-aaa8-4bb1-bd53-3902a3d21805 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:47.639188 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7a6ee02-aaa8-4bb1-bd53-3902a3d21805 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:47.639857 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7a6ee02-aaa8-4bb1-bd53-3902a3d21805 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:47.641577 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7a6ee02-aaa8-4bb1-bd53-3902a3d21805 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:47.971896 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d9d3885a-3384-4959-9c88-3ece84a329af tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50f1d810ba34ef6a419d376f2b6c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82287f900aa34e05ba0e0cf7ba924585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:47.982834 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d9d3885a-3384-4959-9c88-3ece84a329af tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] 10.222.0.67 "GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8" status: 200 len: 1665 microversion: 2.1 time: 1.292754 Sep 16 13:03:48.003616 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1806/3722] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:46 2022] GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8 => generated 1665 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:03:48.013511 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1c962004-b975-4808-885a-5161aed7aa41 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:48.014461 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-1c962004-b975-4808-885a-5161aed7aa41 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:48.024258 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1c962004-b975-4808-885a-5161aed7aa41 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:48.025687 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1c962004-b975-4808-885a-5161aed7aa41 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:48.026365 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1c962004-b975-4808-885a-5161aed7aa41 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:48.028804 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1c962004-b975-4808-885a-5161aed7aa41 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:48.029750 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1c962004-b975-4808-885a-5161aed7aa41 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:48.030442 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1c962004-b975-4808-885a-5161aed7aa41 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:48.279702 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e7a6ee02-aaa8-4bb1-bd53-3902a3d21805 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:48.294449 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e7a6ee02-aaa8-4bb1-bd53-3902a3d21805 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1665 microversion: 2.1 time: 0.687459 Sep 16 13:03:48.295192 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1917/3723] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:47 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1665 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:48.649464 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-98e369f0-e6c4-489e-8a9b-34fb65813845 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:48.649991 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-98e369f0-e6c4-489e-8a9b-34fb65813845 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 17bd55c8-4d10-424e-a143-037b14585d31] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:48.662860 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98e369f0-e6c4-489e-8a9b-34fb65813845 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:48.663616 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98e369f0-e6c4-489e-8a9b-34fb65813845 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:48.663785 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98e369f0-e6c4-489e-8a9b-34fb65813845 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:48.671168 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98e369f0-e6c4-489e-8a9b-34fb65813845 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:48.673095 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98e369f0-e6c4-489e-8a9b-34fb65813845 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:48.674491 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98e369f0-e6c4-489e-8a9b-34fb65813845 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:48.715126 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1c962004-b975-4808-885a-5161aed7aa41 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:48.744090 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1c962004-b975-4808-885a-5161aed7aa41 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:48.755303 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1c962004-b975-4808-885a-5161aed7aa41 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:48.760783 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1c962004-b975-4808-885a-5161aed7aa41 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1810 microversion: 2.20 time: 0.753736 Sep 16 13:03:48.761585 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1807/3724] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:03:48 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1810 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:03:48.924187 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-98e369f0-e6c4-489e-8a9b-34fb65813845 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed69c96e39249f181eda742be229b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeff399942c4286a71ea3a0eab43280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:48.939585 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-98e369f0-e6c4-489e-8a9b-34fb65813845 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31" status: 200 len: 1273 microversion: 2.1 time: 0.312080 Sep 16 13:03:48.942418 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1918/3725] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:48 2022] GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31 => generated 1273 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:49.015657 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7630f6fb-3907-4a24-9436-5d57a339e9fe tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:49.020657 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7630f6fb-3907-4a24-9436-5d57a339e9fe tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] [instance: 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:49.031323 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7630f6fb-3907-4a24-9436-5d57a339e9fe tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:49.032155 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7630f6fb-3907-4a24-9436-5d57a339e9fe tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:49.032763 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7630f6fb-3907-4a24-9436-5d57a339e9fe tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:49.035170 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7630f6fb-3907-4a24-9436-5d57a339e9fe tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:49.036552 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7630f6fb-3907-4a24-9436-5d57a339e9fe tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:49.039329 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7630f6fb-3907-4a24-9436-5d57a339e9fe tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:49.215131 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7630f6fb-3907-4a24-9436-5d57a339e9fe tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50f1d810ba34ef6a419d376f2b6c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82287f900aa34e05ba0e0cf7ba924585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:49.244244 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7630f6fb-3907-4a24-9436-5d57a339e9fe tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] 10.222.0.67 "GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8" status: 200 len: 1597 microversion: 2.1 time: 0.235145 Sep 16 13:03:49.246027 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1808/3726] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:49 2022] GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8 => generated 1597 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:49.618101 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-7369703c-cd6e-4adc-af6b-d85907303d2f req-85c57b88-f5e8-4597-af4c-0fe97c8fa2d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af5e660b-de79-42ca-a8de-fe06738b9771", "name": "network-vif-unplugged", "status": "completed", "tag": "3af800e8-0d1f-497b-bca5-8901587cb91c"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:03:49.682017 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7369703c-cd6e-4adc-af6b-d85907303d2f req-85c57b88-f5e8-4597-af4c-0fe97c8fa2d7 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:49.682533 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7369703c-cd6e-4adc-af6b-d85907303d2f req-85c57b88-f5e8-4597-af4c-0fe97c8fa2d7 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:49.684616 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7369703c-cd6e-4adc-af6b-d85907303d2f req-85c57b88-f5e8-4597-af4c-0fe97c8fa2d7 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:49.738040 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-7369703c-cd6e-4adc-af6b-d85907303d2f req-85c57b88-f5e8-4597-af4c-0fe97c8fa2d7 service nova] Creating event network-vif-unplugged:3af800e8-0d1f-497b-bca5-8901587cb91c for instance af5e660b-de79-42ca-a8de-fe06738b9771 on n-h2-858094-4 Sep 16 13:03:49.768514 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-7369703c-cd6e-4adc-af6b-d85907303d2f req-85c57b88-f5e8-4597-af4c-0fe97c8fa2d7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.157764 Sep 16 13:03:49.770761 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1919/3727] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:03:49.791506 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1916a40a-5eca-4659-ac0a-11fe996a83d0 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:49.792729 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-1916a40a-5eca-4659-ac0a-11fe996a83d0 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:49.810667 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-f0f8969b-b9a4-4753-9c18-6186edf512e0 req-f3f02892-14f8-4540-bd02-848cf1ce242a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64cebb2a-47ea-4fac-ac5d-24bb6311d8e8", "name": "network-vif-deleted", "tag": "b7230234-bb6e-4e87-88c3-bcd278e26f85"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:03:49.819702 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1916a40a-5eca-4659-ac0a-11fe996a83d0 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:49.820586 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1916a40a-5eca-4659-ac0a-11fe996a83d0 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:49.822244 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1916a40a-5eca-4659-ac0a-11fe996a83d0 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:49.825881 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1916a40a-5eca-4659-ac0a-11fe996a83d0 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:49.829789 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1916a40a-5eca-4659-ac0a-11fe996a83d0 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:49.830485 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1916a40a-5eca-4659-ac0a-11fe996a83d0 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:49.845742 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f0f8969b-b9a4-4753-9c18-6186edf512e0 req-f3f02892-14f8-4540-bd02-848cf1ce242a service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:49.846248 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f0f8969b-b9a4-4753-9c18-6186edf512e0 req-f3f02892-14f8-4540-bd02-848cf1ce242a service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:49.846687 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f0f8969b-b9a4-4753-9c18-6186edf512e0 req-f3f02892-14f8-4540-bd02-848cf1ce242a service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:49.890413 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-f0f8969b-b9a4-4753-9c18-6186edf512e0 req-f3f02892-14f8-4540-bd02-848cf1ce242a service nova] Creating event network-vif-deleted:b7230234-bb6e-4e87-88c3-bcd278e26f85 for instance 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8 on n-h1-858094-4 Sep 16 13:03:49.900568 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-f0f8969b-b9a4-4753-9c18-6186edf512e0 req-f3f02892-14f8-4540-bd02-848cf1ce242a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105086 Sep 16 13:03:49.905862 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1920/3728] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:03:49.972766 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9f9c39f8-ee40-43c2-9759-a942fa365210 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:49.973914 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9f9c39f8-ee40-43c2-9759-a942fa365210 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 17bd55c8-4d10-424e-a143-037b14585d31] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:50.004467 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f9c39f8-ee40-43c2-9759-a942fa365210 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:50.004974 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f9c39f8-ee40-43c2-9759-a942fa365210 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:50.012060 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f9c39f8-ee40-43c2-9759-a942fa365210 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:50.014506 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f9c39f8-ee40-43c2-9759-a942fa365210 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:50.015050 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f9c39f8-ee40-43c2-9759-a942fa365210 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:50.015498 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f9c39f8-ee40-43c2-9759-a942fa365210 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:50.132262 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9f9c39f8-ee40-43c2-9759-a942fa365210 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed69c96e39249f181eda742be229b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeff399942c4286a71ea3a0eab43280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:50.141125 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9f9c39f8-ee40-43c2-9759-a942fa365210 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31" status: 200 len: 1273 microversion: 2.1 time: 0.174435 Sep 16 13:03:50.146003 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1921/3729] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:49 2022] GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31 => generated 1273 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:50.150774 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ca300765-4576-4867-8fb4-a19f11b89571 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:50.151496 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ca300765-4576-4867-8fb4-a19f11b89571 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:50.167498 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca300765-4576-4867-8fb4-a19f11b89571 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:50.175192 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca300765-4576-4867-8fb4-a19f11b89571 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:50.175689 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca300765-4576-4867-8fb4-a19f11b89571 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:50.176697 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca300765-4576-4867-8fb4-a19f11b89571 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:50.177352 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca300765-4576-4867-8fb4-a19f11b89571 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:50.177945 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca300765-4576-4867-8fb4-a19f11b89571 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:50.451858 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1916a40a-5eca-4659-ac0a-11fe996a83d0 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:50.471897 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1916a40a-5eca-4659-ac0a-11fe996a83d0 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:50.474009 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1916a40a-5eca-4659-ac0a-11fe996a83d0 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:50.477537 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1916a40a-5eca-4659-ac0a-11fe996a83d0 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1810 microversion: 2.20 time: 0.690711 Sep 16 13:03:50.480211 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1809/3730] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:03:49 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1810 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:03:50.485456 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1f14f6e6-3f9f-4851-8c23-30345ee08ae6 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:50.493197 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-1f14f6e6-3f9f-4851-8c23-30345ee08ae6 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] [instance: 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:50.514468 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1f14f6e6-3f9f-4851-8c23-30345ee08ae6 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:50.515839 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1f14f6e6-3f9f-4851-8c23-30345ee08ae6 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:50.517181 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1f14f6e6-3f9f-4851-8c23-30345ee08ae6 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:50.518959 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1f14f6e6-3f9f-4851-8c23-30345ee08ae6 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:50.521545 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1f14f6e6-3f9f-4851-8c23-30345ee08ae6 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:50.522731 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1f14f6e6-3f9f-4851-8c23-30345ee08ae6 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:50.586359 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ca300765-4576-4867-8fb4-a19f11b89571 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:50.594703 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ca300765-4576-4867-8fb4-a19f11b89571 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1665 microversion: 2.1 time: 0.447559 Sep 16 13:03:50.608478 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1922/3731] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:50 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1665 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:50.621123 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d2b8cc07-9522-4ce9-8a16-449caec326ad tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:50.621811 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d2b8cc07-9522-4ce9-8a16-449caec326ad tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:50.625364 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1f14f6e6-3f9f-4851-8c23-30345ee08ae6 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:50.625872 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1f14f6e6-3f9f-4851-8c23-30345ee08ae6 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:50.626319 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1f14f6e6-3f9f-4851-8c23-30345ee08ae6 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:50.626789 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-1f14f6e6-3f9f-4851-8c23-30345ee08ae6 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lazy-loading 'fault' on Instance uuid 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8 {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:03:50.642130 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2b8cc07-9522-4ce9-8a16-449caec326ad tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:50.642643 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2b8cc07-9522-4ce9-8a16-449caec326ad tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:50.643088 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2b8cc07-9522-4ce9-8a16-449caec326ad tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:50.643815 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2b8cc07-9522-4ce9-8a16-449caec326ad tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:50.644311 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2b8cc07-9522-4ce9-8a16-449caec326ad tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:50.644743 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2b8cc07-9522-4ce9-8a16-449caec326ad tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:50.980656 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1f14f6e6-3f9f-4851-8c23-30345ee08ae6 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50f1d810ba34ef6a419d376f2b6c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82287f900aa34e05ba0e0cf7ba924585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:50.990950 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1f14f6e6-3f9f-4851-8c23-30345ee08ae6 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] 10.222.0.67 "GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8" status: 200 len: 1314 microversion: 2.1 time: 0.509063 Sep 16 13:03:50.991416 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1810/3732] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:50 2022] GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8 => generated 1314 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:51.170053 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-58f9e543-b0b4-44a1-8a01-e7e3b5ee1012 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:51.170053 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-58f9e543-b0b4-44a1-8a01-e7e3b5ee1012 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 17bd55c8-4d10-424e-a143-037b14585d31] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:51.175807 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-58f9e543-b0b4-44a1-8a01-e7e3b5ee1012 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:51.176632 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-58f9e543-b0b4-44a1-8a01-e7e3b5ee1012 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:51.177258 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-58f9e543-b0b4-44a1-8a01-e7e3b5ee1012 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:51.178151 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-58f9e543-b0b4-44a1-8a01-e7e3b5ee1012 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:51.178784 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-58f9e543-b0b4-44a1-8a01-e7e3b5ee1012 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:51.179380 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-58f9e543-b0b4-44a1-8a01-e7e3b5ee1012 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:51.602088 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d2b8cc07-9522-4ce9-8a16-449caec326ad tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:51.611188 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d2b8cc07-9522-4ce9-8a16-449caec326ad tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1665 microversion: 2.1 time: 0.995836 Sep 16 13:03:51.612394 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1923/3733] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:50 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1665 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:03:51.618227 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-55e13c5d-a11f-4a13-8dc5-3bae4ad6d163 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:51.619066 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-55e13c5d-a11f-4a13-8dc5-3bae4ad6d163 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:51.626160 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-55e13c5d-a11f-4a13-8dc5-3bae4ad6d163 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:51.627488 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-55e13c5d-a11f-4a13-8dc5-3bae4ad6d163 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:51.628250 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-55e13c5d-a11f-4a13-8dc5-3bae4ad6d163 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:51.629322 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-55e13c5d-a11f-4a13-8dc5-3bae4ad6d163 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:51.630813 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-55e13c5d-a11f-4a13-8dc5-3bae4ad6d163 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:51.631418 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-55e13c5d-a11f-4a13-8dc5-3bae4ad6d163 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:52.016055 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-58f9e543-b0b4-44a1-8a01-e7e3b5ee1012 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed69c96e39249f181eda742be229b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeff399942c4286a71ea3a0eab43280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:52.035022 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-58f9e543-b0b4-44a1-8a01-e7e3b5ee1012 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31" status: 200 len: 1315 microversion: 2.1 time: 0.871629 Sep 16 13:03:52.036218 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1811/3734] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:51 2022] GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31 => generated 1315 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:03:52.042795 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fcf9906f-d709-4cfc-95ed-a50bb8e84e24 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:52.043993 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-fcf9906f-d709-4cfc-95ed-a50bb8e84e24 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:52.063487 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fcf9906f-d709-4cfc-95ed-a50bb8e84e24 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:52.064976 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fcf9906f-d709-4cfc-95ed-a50bb8e84e24 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:52.065774 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fcf9906f-d709-4cfc-95ed-a50bb8e84e24 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:52.066830 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fcf9906f-d709-4cfc-95ed-a50bb8e84e24 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:52.068361 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fcf9906f-d709-4cfc-95ed-a50bb8e84e24 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:52.069063 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fcf9906f-d709-4cfc-95ed-a50bb8e84e24 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:52.148762 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-55e13c5d-a11f-4a13-8dc5-3bae4ad6d163 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:52.168158 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-55e13c5d-a11f-4a13-8dc5-3bae4ad6d163 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:52.169595 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-55e13c5d-a11f-4a13-8dc5-3bae4ad6d163 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:52.172229 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-55e13c5d-a11f-4a13-8dc5-3bae4ad6d163 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1810 microversion: 2.20 time: 0.558496 Sep 16 13:03:52.173770 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1924/3735] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:03:51 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1810 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:03:52.186610 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-979e9706-e2c8-4718-9a39-d633ac69d7ea req-71d6914a-5fb3-4c01-86f8-1f52f72bccb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66413dbd-455f-45f6-b057-39a11a9f2d44", "tag": "3a5b1f2b-2004-4cf4-93bd-f498b62488fe"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:03:52.211771 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-979e9706-e2c8-4718-9a39-d633ac69d7ea req-71d6914a-5fb3-4c01-86f8-1f52f72bccb1 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:52.215492 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-979e9706-e2c8-4718-9a39-d633ac69d7ea req-71d6914a-5fb3-4c01-86f8-1f52f72bccb1 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:52.229067 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-979e9706-e2c8-4718-9a39-d633ac69d7ea req-71d6914a-5fb3-4c01-86f8-1f52f72bccb1 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:52.271666 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-979e9706-e2c8-4718-9a39-d633ac69d7ea req-71d6914a-5fb3-4c01-86f8-1f52f72bccb1 service nova] Creating event network-changed:3a5b1f2b-2004-4cf4-93bd-f498b62488fe for instance 66413dbd-455f-45f6-b057-39a11a9f2d44 on n-h2-858094-4 Sep 16 13:03:52.280106 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-979e9706-e2c8-4718-9a39-d633ac69d7ea req-71d6914a-5fb3-4c01-86f8-1f52f72bccb1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103028 Sep 16 13:03:52.282012 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1925/3736] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:03:52.288185 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-df190213-a192-4954-85e3-b38af0de7cab tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:52.289188 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-df190213-a192-4954-85e3-b38af0de7cab tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] [instance: 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:52.296958 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df190213-a192-4954-85e3-b38af0de7cab tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:52.297836 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df190213-a192-4954-85e3-b38af0de7cab tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:52.298517 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df190213-a192-4954-85e3-b38af0de7cab tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:52.299453 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df190213-a192-4954-85e3-b38af0de7cab tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:52.300161 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df190213-a192-4954-85e3-b38af0de7cab tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:52.300811 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df190213-a192-4954-85e3-b38af0de7cab tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:52.317443 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-df190213-a192-4954-85e3-b38af0de7cab tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] HTTP exception thrown: Instance 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8 could not be found. Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-df190213-a192-4954-85e3-b38af0de7cab tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Request method failure captured: Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8 HTTP/1.1 Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHO2SKAZPo9nzZdXUldfuOvHfvIgA5U2I9dy4QhkGtw1DqEzH6yKQEWwXvBPrd_ApBYY7-PzBo8XdXZrVIIgI9Um_YxlRA03n_7Ec1ZdthLoROTPN2cClGbDuWnq-94gc78WB6cKNZhFJ6_wcS1-21MioLSqGz15O2X2DB6Htew7EFs Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 82287f900aa34e05ba0e0cf7ba924585 Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersTestFqdnHostnames-1315877957 Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/82287f900aa34e05ba0e0cf7ba924585"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/82287f900aa34e05ba0e0cf7ba924585"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_82287f900aa34e05ba0e0cf7ba924585", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/82287f900aa34e05ba0e0cf7ba924585"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ServersTestFqdnHostnames-1315877957 Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 82287f900aa34e05ba0e0cf7ba924585 Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1315877957 Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ServersTestFqdnHostnames-1315877957-project Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: d50f1d810ba34ef6a419d376f2b6c9bf Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ServersTestFqdnHostnames-1315877957-project Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8 could not be found. Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '64cebb2a-47ea-4fac-ac5d-24bb6311d8e8'} Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8 could not be found. Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8 could not be found. Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:03:52.319544 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:52.325442 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:03:52.325442 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:03:52.325442 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:03:52.325442 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:03:52.325442 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:03:52.325442 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8 could not be found. Sep 16 13:03:52.325442 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:03:52.328802 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-df190213-a192-4954-85e3-b38af0de7cab tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Returning 404 to user: Instance 64cebb2a-47ea-4fac-ac5d-24bb6311d8e8 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:03:52.329940 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-df190213-a192-4954-85e3-b38af0de7cab tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] 10.222.0.67 "GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8" status: 404 len: 111 microversion: 2.1 time: 0.046582 Sep 16 13:03:52.330753 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1926/3737] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:52 2022] GET /compute/v2.1/servers/64cebb2a-47ea-4fac-ac5d-24bb6311d8e8 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:03:52.340778 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b7692cb4-9939-428e-b449-795f689d80f2 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] Calling method '.version_select at 0x7f10399e1d30>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:52.364202 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b7692cb4-9939-428e-b449-795f689d80f2 tempest-ServersTestFqdnHostnames-1315877957 tempest-ServersTestFqdnHostnames-1315877957-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-28586967" status: 202 len: 0 microversion: 2.1 time: 0.028114 Sep 16 13:03:52.365365 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1927/3738] 10.222.0.67 () {58 vars in 1215 bytes} [Fri Sep 16 13:03:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-28586967 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 13:03:52.653383 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-fcf9906f-d709-4cfc-95ed-a50bb8e84e24 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:52.678038 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-fcf9906f-d709-4cfc-95ed-a50bb8e84e24 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1665 microversion: 2.1 time: 0.640367 Sep 16 13:03:52.680459 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1812/3739] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:52 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1665 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:52.702680 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-da2354d0-dfcd-4da3-985d-f239c6c89aa0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:03:52.705621 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-da2354d0-dfcd-4da3-985d-f239c6c89aa0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:52.713788 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da2354d0-dfcd-4da3-985d-f239c6c89aa0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:52.714605 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da2354d0-dfcd-4da3-985d-f239c6c89aa0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:52.715220 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da2354d0-dfcd-4da3-985d-f239c6c89aa0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:52.716158 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da2354d0-dfcd-4da3-985d-f239c6c89aa0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:52.716778 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da2354d0-dfcd-4da3-985d-f239c6c89aa0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:52.717374 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da2354d0-dfcd-4da3-985d-f239c6c89aa0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:52.822275 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-da2354d0-dfcd-4da3-985d-f239c6c89aa0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "POST /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771/action" status: 202 len: 0 microversion: 2.1 time: 0.123450 Sep 16 13:03:52.824409 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1928/3740] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 13:03:52 2022] POST /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:03:52.834029 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-86dad890-6b11-4cdd-903c-6709870b76eb tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:52.834965 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-86dad890-6b11-4cdd-903c-6709870b76eb tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:52.848506 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-86dad890-6b11-4cdd-903c-6709870b76eb tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:52.849876 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-86dad890-6b11-4cdd-903c-6709870b76eb tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:52.850509 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-86dad890-6b11-4cdd-903c-6709870b76eb tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:52.851443 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-86dad890-6b11-4cdd-903c-6709870b76eb tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:52.851992 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-86dad890-6b11-4cdd-903c-6709870b76eb tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:52.858707 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-86dad890-6b11-4cdd-903c-6709870b76eb tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:53.059558 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2f9e53b6-19f2-4392-9a54-288cd90ac4d7 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:53.060597 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2f9e53b6-19f2-4392-9a54-288cd90ac4d7 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 17bd55c8-4d10-424e-a143-037b14585d31] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:53.071665 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f9e53b6-19f2-4392-9a54-288cd90ac4d7 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:53.073811 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f9e53b6-19f2-4392-9a54-288cd90ac4d7 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:53.076458 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f9e53b6-19f2-4392-9a54-288cd90ac4d7 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:53.077410 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f9e53b6-19f2-4392-9a54-288cd90ac4d7 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:53.078049 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f9e53b6-19f2-4392-9a54-288cd90ac4d7 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:53.080698 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f9e53b6-19f2-4392-9a54-288cd90ac4d7 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:53.326801 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-86dad890-6b11-4cdd-903c-6709870b76eb tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:53.341074 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-86dad890-6b11-4cdd-903c-6709870b76eb tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1667 microversion: 2.1 time: 0.510483 Sep 16 13:03:53.358097 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1813/3741] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:52 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1667 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:53.373415 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-4a833da3-ece3-4994-a08f-5938332315d2 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:53.374331 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-4a833da3-ece3-4994-a08f-5938332315d2 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:53.388776 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4a833da3-ece3-4994-a08f-5938332315d2 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:53.390508 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4a833da3-ece3-4994-a08f-5938332315d2 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:53.390952 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4a833da3-ece3-4994-a08f-5938332315d2 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:53.391743 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4a833da3-ece3-4994-a08f-5938332315d2 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:53.392218 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4a833da3-ece3-4994-a08f-5938332315d2 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:53.395935 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-4a833da3-ece3-4994-a08f-5938332315d2 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:53.556753 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2f9e53b6-19f2-4392-9a54-288cd90ac4d7 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed69c96e39249f181eda742be229b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeff399942c4286a71ea3a0eab43280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:53.572934 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2f9e53b6-19f2-4392-9a54-288cd90ac4d7 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31" status: 200 len: 1315 microversion: 2.1 time: 0.512255 Sep 16 13:03:53.573991 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1929/3742] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:53 2022] GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31 => generated 1315 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:54.371859 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-25598ff5-4017-4648-a6bd-38ae3ef72a54 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:54.372777 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-25598ff5-4017-4648-a6bd-38ae3ef72a54 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:54.375966 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:03:54.376683 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:03:54.392043 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25598ff5-4017-4648-a6bd-38ae3ef72a54 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:54.396870 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25598ff5-4017-4648-a6bd-38ae3ef72a54 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:54.397593 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25598ff5-4017-4648-a6bd-38ae3ef72a54 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:54.398522 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25598ff5-4017-4648-a6bd-38ae3ef72a54 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:54.399141 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25598ff5-4017-4648-a6bd-38ae3ef72a54 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:54.399770 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25598ff5-4017-4648-a6bd-38ae3ef72a54 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:54.504152 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4a833da3-ece3-4994-a08f-5938332315d2 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:54.515098 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4a833da3-ece3-4994-a08f-5938332315d2 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:54.517475 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-4a833da3-ece3-4994-a08f-5938332315d2 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:54.522754 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-4a833da3-ece3-4994-a08f-5938332315d2 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1810 microversion: 2.20 time: 1.163456 Sep 16 13:03:54.523917 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1814/3743] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:03:53 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1810 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:03:54.532148 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-79ee7290-e426-4804-aa71-2b11fea155e2 req-c3560274-9cbc-4605-be3e-223dbd50c882 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17bd55c8-4d10-424e-a143-037b14585d31", "tag": "e7480e72-f883-4315-9905-ecaed73586e8"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:03:54.562229 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-79ee7290-e426-4804-aa71-2b11fea155e2 req-c3560274-9cbc-4605-be3e-223dbd50c882 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:54.562985 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-79ee7290-e426-4804-aa71-2b11fea155e2 req-c3560274-9cbc-4605-be3e-223dbd50c882 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:54.565897 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-79ee7290-e426-4804-aa71-2b11fea155e2 req-c3560274-9cbc-4605-be3e-223dbd50c882 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:54.596144 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-79ee7290-e426-4804-aa71-2b11fea155e2 req-c3560274-9cbc-4605-be3e-223dbd50c882 service nova] Creating event network-changed:e7480e72-f883-4315-9905-ecaed73586e8 for instance 17bd55c8-4d10-424e-a143-037b14585d31 on n-h2-858094-4 Sep 16 13:03:54.605410 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-79ee7290-e426-4804-aa71-2b11fea155e2 req-c3560274-9cbc-4605-be3e-223dbd50c882 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078849 Sep 16 13:03:54.606336 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1815/3744] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:03:54.623831 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7c9f469d-034a-4ee8-920b-323138e01909 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:54.626095 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7c9f469d-034a-4ee8-920b-323138e01909 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 17bd55c8-4d10-424e-a143-037b14585d31] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:54.645538 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7c9f469d-034a-4ee8-920b-323138e01909 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:54.646493 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7c9f469d-034a-4ee8-920b-323138e01909 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:54.648190 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7c9f469d-034a-4ee8-920b-323138e01909 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:54.651049 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7c9f469d-034a-4ee8-920b-323138e01909 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:54.654228 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7c9f469d-034a-4ee8-920b-323138e01909 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:54.654930 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7c9f469d-034a-4ee8-920b-323138e01909 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:54.699951 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:03:54.709105 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:03:55.207877 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-25598ff5-4017-4648-a6bd-38ae3ef72a54 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:55.223310 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-25598ff5-4017-4648-a6bd-38ae3ef72a54 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1667 microversion: 2.1 time: 0.854491 Sep 16 13:03:55.225440 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1930/3745] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:54 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1667 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:55.400285 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7c9f469d-034a-4ee8-920b-323138e01909 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed69c96e39249f181eda742be229b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeff399942c4286a71ea3a0eab43280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:55.421862 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7c9f469d-034a-4ee8-920b-323138e01909 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31" status: 200 len: 1315 microversion: 2.1 time: 0.809986 Sep 16 13:03:55.424062 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1816/3746] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:54 2022] GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31 => generated 1315 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:55.554280 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6480ed91-5e80-4782-8c38-1c90f2d9646c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:55.555936 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6480ed91-5e80-4782-8c38-1c90f2d9646c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:55.576477 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6480ed91-5e80-4782-8c38-1c90f2d9646c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:55.577292 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6480ed91-5e80-4782-8c38-1c90f2d9646c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:55.582347 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6480ed91-5e80-4782-8c38-1c90f2d9646c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:55.583664 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6480ed91-5e80-4782-8c38-1c90f2d9646c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:55.584360 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6480ed91-5e80-4782-8c38-1c90f2d9646c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:55.585000 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6480ed91-5e80-4782-8c38-1c90f2d9646c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:55.600114 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:03:56.253947 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f2707800-0648-49bd-a7c4-91668041e0c2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:56.255572 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f2707800-0648-49bd-a7c4-91668041e0c2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:56.275316 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f2707800-0648-49bd-a7c4-91668041e0c2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:56.277208 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f2707800-0648-49bd-a7c4-91668041e0c2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:56.277896 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f2707800-0648-49bd-a7c4-91668041e0c2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:56.278809 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f2707800-0648-49bd-a7c4-91668041e0c2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:56.279860 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f2707800-0648-49bd-a7c4-91668041e0c2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:56.281723 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f2707800-0648-49bd-a7c4-91668041e0c2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:56.444479 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6480ed91-5e80-4782-8c38-1c90f2d9646c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:56.464664 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6480ed91-5e80-4782-8c38-1c90f2d9646c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:56.469955 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6480ed91-5e80-4782-8c38-1c90f2d9646c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:56.474167 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6480ed91-5e80-4782-8c38-1c90f2d9646c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1810 microversion: 2.20 time: 0.925757 Sep 16 13:03:56.476453 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1931/3747] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:03:55 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1810 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:03:56.487155 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-67f2489c-508d-4359-9c16-33756c50a3c3 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:56.489055 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-67f2489c-508d-4359-9c16-33756c50a3c3 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 17bd55c8-4d10-424e-a143-037b14585d31] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:56.523775 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67f2489c-508d-4359-9c16-33756c50a3c3 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:56.524769 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67f2489c-508d-4359-9c16-33756c50a3c3 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:56.525414 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67f2489c-508d-4359-9c16-33756c50a3c3 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:56.526970 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67f2489c-508d-4359-9c16-33756c50a3c3 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:56.527664 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67f2489c-508d-4359-9c16-33756c50a3c3 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:56.528330 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67f2489c-508d-4359-9c16-33756c50a3c3 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:56.629132 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f2707800-0648-49bd-a7c4-91668041e0c2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:56.638585 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f2707800-0648-49bd-a7c4-91668041e0c2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1667 microversion: 2.1 time: 0.389718 Sep 16 13:03:56.639720 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1817/3748] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:56 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1667 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:03:56.892700 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-67f2489c-508d-4359-9c16-33756c50a3c3 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed69c96e39249f181eda742be229b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeff399942c4286a71ea3a0eab43280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:56.911637 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-67f2489c-508d-4359-9c16-33756c50a3c3 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31" status: 200 len: 1315 microversion: 2.1 time: 0.433781 Sep 16 13:03:56.913024 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1932/3749] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:56 2022] GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31 => generated 1315 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:03:57.504969 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f3dbada9-3a70-48b5-a9a2-01f1bf686913 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:57.506549 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f3dbada9-3a70-48b5-a9a2-01f1bf686913 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:57.522236 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:03:57.534668 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f3dbada9-3a70-48b5-a9a2-01f1bf686913 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:57.537472 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f3dbada9-3a70-48b5-a9a2-01f1bf686913 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:57.540717 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f3dbada9-3a70-48b5-a9a2-01f1bf686913 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:57.541743 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f3dbada9-3a70-48b5-a9a2-01f1bf686913 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:57.542442 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f3dbada9-3a70-48b5-a9a2-01f1bf686913 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:57.544205 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f3dbada9-3a70-48b5-a9a2-01f1bf686913 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:57.665031 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4d5348a3-8ad0-43bf-9719-ca814db44fb0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:57.666411 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4d5348a3-8ad0-43bf-9719-ca814db44fb0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:57.689056 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d5348a3-8ad0-43bf-9719-ca814db44fb0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:57.689538 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d5348a3-8ad0-43bf-9719-ca814db44fb0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:57.690006 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d5348a3-8ad0-43bf-9719-ca814db44fb0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:57.697450 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d5348a3-8ad0-43bf-9719-ca814db44fb0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:57.697974 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d5348a3-8ad0-43bf-9719-ca814db44fb0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:57.700577 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d5348a3-8ad0-43bf-9719-ca814db44fb0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:59.353935 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4d5348a3-8ad0-43bf-9719-ca814db44fb0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:59.369526 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4d5348a3-8ad0-43bf-9719-ca814db44fb0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1667 microversion: 2.1 time: 1.708513 Sep 16 13:03:59.372074 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1933/3750] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:57 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1667 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:03:59.377184 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f3dbada9-3a70-48b5-a9a2-01f1bf686913 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:59.387121 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f3dbada9-3a70-48b5-a9a2-01f1bf686913 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:59.397594 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-09d26e63-dba4-48e5-b7b9-9044750a114f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:03:59.399930 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f3dbada9-3a70-48b5-a9a2-01f1bf686913 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:03:59.401747 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f3dbada9-3a70-48b5-a9a2-01f1bf686913 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1810 microversion: 2.20 time: 1.900285 Sep 16 13:03:59.402335 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1818/3751] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:03:57 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1810 bytes in 1902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:03:59.404934 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-09d26e63-dba4-48e5-b7b9-9044750a114f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 17bd55c8-4d10-424e-a143-037b14585d31] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:03:59.420161 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09d26e63-dba4-48e5-b7b9-9044750a114f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:59.422901 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09d26e63-dba4-48e5-b7b9-9044750a114f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:59.425007 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09d26e63-dba4-48e5-b7b9-9044750a114f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:03:59.426811 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09d26e63-dba4-48e5-b7b9-9044750a114f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:03:59.428152 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09d26e63-dba4-48e5-b7b9-9044750a114f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:03:59.429578 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09d26e63-dba4-48e5-b7b9-9044750a114f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:00.390617 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-09d26e63-dba4-48e5-b7b9-9044750a114f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed69c96e39249f181eda742be229b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeff399942c4286a71ea3a0eab43280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:00.435892 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-09d26e63-dba4-48e5-b7b9-9044750a114f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31" status: 200 len: 1315 microversion: 2.1 time: 1.062201 Sep 16 13:04:00.437581 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1934/3752] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:03:59 2022] GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31 => generated 1315 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:00.467914 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2323092b-4855-413b-ab2a-7bf43bf51bd7 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:00.469386 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2323092b-4855-413b-ab2a-7bf43bf51bd7 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:00.494035 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2323092b-4855-413b-ab2a-7bf43bf51bd7 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:00.499151 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2323092b-4855-413b-ab2a-7bf43bf51bd7 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:00.501943 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2323092b-4855-413b-ab2a-7bf43bf51bd7 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:00.506561 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2323092b-4855-413b-ab2a-7bf43bf51bd7 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:00.507754 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2323092b-4855-413b-ab2a-7bf43bf51bd7 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:00.508540 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2323092b-4855-413b-ab2a-7bf43bf51bd7 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:00.761024 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-36de8c4a-fff2-45aa-b1a8-11590de52a2d tempest-ServerGroup264TestJSON-193177613 tempest-ServerGroup264TestJSON-193177613-project] Action: 'create', calling method: .version_select at 0x7f10348e3d30>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:04:00.802495 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-36de8c4a-fff2-45aa-b1a8-11590de52a2d tempest-ServerGroup264TestJSON-193177613 tempest-ServerGroup264TestJSON-193177613-project] Getting quotas for project eb6bf90ce3cc45fe8cee3b47d24da01f. Resources: {'server_groups'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:04:00.814333 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-36de8c4a-fff2-45aa-b1a8-11590de52a2d tempest-ServerGroup264TestJSON-193177613 tempest-ServerGroup264TestJSON-193177613-project] Getting quotas for user b51df0f01a5e4be9908a471368480d03 and project eb6bf90ce3cc45fe8cee3b47d24da01f. Resources: {'server_groups'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:04:00.930725 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-36de8c4a-fff2-45aa-b1a8-11590de52a2d tempest-ServerGroup264TestJSON-193177613 tempest-ServerGroup264TestJSON-193177613-project] Getting quotas for project eb6bf90ce3cc45fe8cee3b47d24da01f. Resources: {'server_groups'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:04:00.949244 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-36de8c4a-fff2-45aa-b1a8-11590de52a2d tempest-ServerGroup264TestJSON-193177613 tempest-ServerGroup264TestJSON-193177613-project] Getting quotas for user b51df0f01a5e4be9908a471368480d03 and project eb6bf90ce3cc45fe8cee3b47d24da01f. Resources: {'server_groups'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:04:00.989034 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-36de8c4a-fff2-45aa-b1a8-11590de52a2d tempest-ServerGroup264TestJSON-193177613 tempest-ServerGroup264TestJSON-193177613-project] 10.222.0.67 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.644055 Sep 16 13:04:01.000588 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1819/3753] 10.222.0.67 () {62 vars in 1214 bytes} [Fri Sep 16 13:04:00 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:04:01.005255 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-79943222-2521-466b-9daf-7992b8547ff9 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:01.005879 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-79943222-2521-466b-9daf-7992b8547ff9 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:01.046114 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-79943222-2521-466b-9daf-7992b8547ff9 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:01.048187 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-79943222-2521-466b-9daf-7992b8547ff9 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:01.049660 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-79943222-2521-466b-9daf-7992b8547ff9 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:01.051897 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-79943222-2521-466b-9daf-7992b8547ff9 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:01.052447 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-79943222-2521-466b-9daf-7992b8547ff9 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:01.053341 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-79943222-2521-466b-9daf-7992b8547ff9 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:01.602648 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2323092b-4855-413b-ab2a-7bf43bf51bd7 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:01.622347 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2323092b-4855-413b-ab2a-7bf43bf51bd7 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1665 microversion: 2.1 time: 1.162907 Sep 16 13:04:01.623199 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1935/3754] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:00 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1665 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:01.631568 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-db480187-6352-4050-a22d-6ae87c0973b3 tempest-ServerGroup264TestJSON-193177613 tempest-ServerGroup264TestJSON-193177613-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:01.679667 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-db480187-6352-4050-a22d-6ae87c0973b3 tempest-ServerGroup264TestJSON-193177613 tempest-ServerGroup264TestJSON-193177613-project] 10.222.0.67 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.051739 Sep 16 13:04:01.681917 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1936/3755] 10.222.0.67 () {60 vars in 1193 bytes} [Fri Sep 16 13:04:01 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:04:01.701047 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-79943222-2521-466b-9daf-7992b8547ff9 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:01.703015 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-d8142737-41a9-4f68-9ac1-411d2c147277 req-2c3c9bc9-7b3f-4d7b-8590-ba4dd0333f19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17bd55c8-4d10-424e-a143-037b14585d31", "name": "network-vif-plugged", "status": "completed", "tag": "e7480e72-f883-4315-9905-ecaed73586e8"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:04:01.717904 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-79943222-2521-466b-9daf-7992b8547ff9 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:01.719689 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-79943222-2521-466b-9daf-7992b8547ff9 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:01.721148 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-79943222-2521-466b-9daf-7992b8547ff9 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1810 microversion: 2.20 time: 0.726646 Sep 16 13:04:01.723119 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1820/3756] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:04:00 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1810 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:04:01.753908 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d8142737-41a9-4f68-9ac1-411d2c147277 req-2c3c9bc9-7b3f-4d7b-8590-ba4dd0333f19 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:01.758226 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-76a8c7e4-edef-4e96-b58b-b0494bdcbe42 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:01.760017 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-76a8c7e4-edef-4e96-b58b-b0494bdcbe42 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 17bd55c8-4d10-424e-a143-037b14585d31] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:01.761718 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d8142737-41a9-4f68-9ac1-411d2c147277 req-2c3c9bc9-7b3f-4d7b-8590-ba4dd0333f19 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:01.762111 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d8142737-41a9-4f68-9ac1-411d2c147277 req-2c3c9bc9-7b3f-4d7b-8590-ba4dd0333f19 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:01.776043 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-76a8c7e4-edef-4e96-b58b-b0494bdcbe42 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:01.781876 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-76a8c7e4-edef-4e96-b58b-b0494bdcbe42 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:01.782768 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-76a8c7e4-edef-4e96-b58b-b0494bdcbe42 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:01.783883 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-76a8c7e4-edef-4e96-b58b-b0494bdcbe42 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:01.786224 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-76a8c7e4-edef-4e96-b58b-b0494bdcbe42 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:01.788407 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-76a8c7e4-edef-4e96-b58b-b0494bdcbe42 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:01.808839 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-d8142737-41a9-4f68-9ac1-411d2c147277 req-2c3c9bc9-7b3f-4d7b-8590-ba4dd0333f19 service nova] Creating event network-vif-plugged:e7480e72-f883-4315-9905-ecaed73586e8 for instance 17bd55c8-4d10-424e-a143-037b14585d31 on n-h2-858094-4 Sep 16 13:04:01.837262 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-d8142737-41a9-4f68-9ac1-411d2c147277 req-2c3c9bc9-7b3f-4d7b-8590-ba4dd0333f19 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147089 Sep 16 13:04:01.837883 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1937/3757] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:04:01.850677 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-acc38f7b-95d5-4fcf-bef9-98902c26a7c6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:04:01.853139 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-acc38f7b-95d5-4fcf-bef9-98902c26a7c6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:01.891880 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-acc38f7b-95d5-4fcf-bef9-98902c26a7c6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:01.892399 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-acc38f7b-95d5-4fcf-bef9-98902c26a7c6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:01.892835 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-acc38f7b-95d5-4fcf-bef9-98902c26a7c6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:01.893550 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-acc38f7b-95d5-4fcf-bef9-98902c26a7c6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:01.893998 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-acc38f7b-95d5-4fcf-bef9-98902c26a7c6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:01.894420 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-acc38f7b-95d5-4fcf-bef9-98902c26a7c6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:02.148712 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-acc38f7b-95d5-4fcf-bef9-98902c26a7c6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "POST /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771/action" status: 200 len: 322 microversion: 2.1 time: 0.308735 Sep 16 13:04:02.150053 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1938/3758] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 13:04:01 2022] POST /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771/action => generated 322 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:04:02.157869 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ef75de63-703b-402d-91d5-c88af2445dee tempest-ServerGroup264TestJSON-193177613 tempest-ServerGroup264TestJSON-193177613-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:02.172463 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ef75de63-703b-402d-91d5-c88af2445dee tempest-ServerGroup264TestJSON-193177613 tempest-ServerGroup264TestJSON-193177613-project] 10.222.0.67 "GET /compute/v2.1/os-server-groups/394b96e8-b58c-4501-8aec-eeff82dc8196" status: 200 len: 235 microversion: 2.64 time: 0.020918 Sep 16 13:04:02.174998 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1939/3759] 10.222.0.67 () {60 vars in 1304 bytes} [Fri Sep 16 13:04:02 2022] GET /compute/v2.1/os-server-groups/394b96e8-b58c-4501-8aec-eeff82dc8196 => generated 235 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:04:02.180830 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8907ab15-85bf-4995-9540-5f69ab0126e6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:02.181633 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8907ab15-85bf-4995-9540-5f69ab0126e6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:02.192345 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8907ab15-85bf-4995-9540-5f69ab0126e6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:02.193506 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8907ab15-85bf-4995-9540-5f69ab0126e6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:02.194080 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8907ab15-85bf-4995-9540-5f69ab0126e6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:02.195053 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8907ab15-85bf-4995-9540-5f69ab0126e6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:02.195524 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8907ab15-85bf-4995-9540-5f69ab0126e6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:02.196011 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8907ab15-85bf-4995-9540-5f69ab0126e6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:02.396861 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-76a8c7e4-edef-4e96-b58b-b0494bdcbe42 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed69c96e39249f181eda742be229b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeff399942c4286a71ea3a0eab43280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:02.407919 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-76a8c7e4-edef-4e96-b58b-b0494bdcbe42 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31" status: 200 len: 1315 microversion: 2.1 time: 0.668272 Sep 16 13:04:02.424455 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1821/3760] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:01 2022] GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31 => generated 1315 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:02.424455 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-769c5838-8e95-4bf8-86cb-5c3f752baaa7 tempest-ServerGroup264TestJSON-193177613 tempest-ServerGroup264TestJSON-193177613-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:02.500601 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-769c5838-8e95-4bf8-86cb-5c3f752baaa7 tempest-ServerGroup264TestJSON-193177613 tempest-ServerGroup264TestJSON-193177613-project] 10.222.0.67 "DELETE /compute/v2.1/os-server-groups/394b96e8-b58c-4501-8aec-eeff82dc8196" status: 204 len: 0 microversion: 2.64 time: 0.085557 Sep 16 13:04:02.504418 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1822/3761] 10.222.0.67 () {60 vars in 1307 bytes} [Fri Sep 16 13:04:02 2022] DELETE /compute/v2.1/os-server-groups/394b96e8-b58c-4501-8aec-eeff82dc8196 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 13:04:02.521724 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7ea15a28-3adf-4459-9379-23f6b10a56b1 tempest-ServerGroup264TestJSON-193177613 tempest-ServerGroup264TestJSON-193177613-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:02.540028 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-7ea15a28-3adf-4459-9379-23f6b10a56b1 tempest-ServerGroup264TestJSON-193177613 tempest-ServerGroup264TestJSON-193177613-project] HTTP exception thrown: Instance group 394b96e8-b58c-4501-8aec-eeff82dc8196 could not be found. Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7ea15a28-3adf-4459-9379-23f6b10a56b1 tempest-ServerGroup264TestJSON-193177613 tempest-ServerGroup264TestJSON-193177613-project] Request method failure captured: Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: request: DELETE /compute/v2.1/os-server-groups/394b96e8-b58c-4501-8aec-eeff82dc8196 HTTP/1.1 Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHRAo7r3ExXzIRJW65A7McYmW83vQU3lttxPH-s2aFYFCNZrg7D0oqHylUdY4G4umMYLJD6W4wWf6TJC9_GNB29Xbsegvb_GEmZUYMR5FhNH8ykNv0gWbQVdWZNRe7y9QH2ZFE6a4OprKwOfQlat_KYJXx79P81l2mXkrQs4Ob2pAYM Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: X-Openstack-Nova-Api-Version: 2.64 Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: eb6bf90ce3cc45fe8cee3b47d24da01f Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ServerGroup264TestJSON-193177613 Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eb6bf90ce3cc45fe8cee3b47d24da01f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/eb6bf90ce3cc45fe8cee3b47d24da01f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_eb6bf90ce3cc45fe8cee3b47d24da01f", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eb6bf90ce3cc45fe8cee3b47d24da01f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ServerGroup264TestJSON-193177613 Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: eb6bf90ce3cc45fe8cee3b47d24da01f Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ServerGroup264TestJSON-193177613 Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ServerGroup264TestJSON-193177613-project Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: b51df0f01a5e4be9908a471368480d03 Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ServerGroup264TestJSON-193177613-project Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance group 394b96e8-b58c-4501-8aec-eeff82dc8196 could not be found. Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '394b96e8-b58c-4501-8aec-eeff82dc8196'} Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 394b96e8-b58c-4501-8aec-eeff82dc8196 could not be found. Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 394b96e8-b58c-4501-8aec-eeff82dc8196 could not be found. Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:04:02.545268 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:02.551852 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:04:02.551852 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:04:02.551852 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:04:02.551852 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:04:02.551852 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 394b96e8-b58c-4501-8aec-eeff82dc8196 could not be found. Sep 16 13:04:02.551852 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:04:02.554173 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7ea15a28-3adf-4459-9379-23f6b10a56b1 tempest-ServerGroup264TestJSON-193177613 tempest-ServerGroup264TestJSON-193177613-project] Returning 404 to user: Instance group 394b96e8-b58c-4501-8aec-eeff82dc8196 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:04:02.555814 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7ea15a28-3adf-4459-9379-23f6b10a56b1 tempest-ServerGroup264TestJSON-193177613 tempest-ServerGroup264TestJSON-193177613-project] 10.222.0.67 "DELETE /compute/v2.1/os-server-groups/394b96e8-b58c-4501-8aec-eeff82dc8196" status: 404 len: 117 microversion: 2.64 time: 0.044664 Sep 16 13:04:02.557145 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1823/3762] 10.222.0.67 () {60 vars in 1307 bytes} [Fri Sep 16 13:04:02 2022] DELETE /compute/v2.1/os-server-groups/394b96e8-b58c-4501-8aec-eeff82dc8196 => generated 117 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 16 13:04:02.758051 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8ec1591e-09c7-43e0-bfeb-dad1045a0c4d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:02.758976 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8ec1591e-09c7-43e0-bfeb-dad1045a0c4d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:02.774427 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8ec1591e-09c7-43e0-bfeb-dad1045a0c4d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:02.778502 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8ec1591e-09c7-43e0-bfeb-dad1045a0c4d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:02.779254 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8907ab15-85bf-4995-9540-5f69ab0126e6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:02.781040 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8ec1591e-09c7-43e0-bfeb-dad1045a0c4d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:02.784075 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8ec1591e-09c7-43e0-bfeb-dad1045a0c4d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:02.784893 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8ec1591e-09c7-43e0-bfeb-dad1045a0c4d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:02.785341 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8ec1591e-09c7-43e0-bfeb-dad1045a0c4d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:02.796953 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8907ab15-85bf-4995-9540-5f69ab0126e6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1665 microversion: 2.1 time: 0.617085 Sep 16 13:04:02.797746 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1940/3763] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:02 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1665 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:02.826376 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-da1f002e-e4ea-4af8-a0c0-9d00ec7d7443 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:02.827300 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-da1f002e-e4ea-4af8-a0c0-9d00ec7d7443 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:02.835832 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da1f002e-e4ea-4af8-a0c0-9d00ec7d7443 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:02.836247 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da1f002e-e4ea-4af8-a0c0-9d00ec7d7443 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:02.836698 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da1f002e-e4ea-4af8-a0c0-9d00ec7d7443 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:02.837421 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da1f002e-e4ea-4af8-a0c0-9d00ec7d7443 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:02.837882 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da1f002e-e4ea-4af8-a0c0-9d00ec7d7443 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:02.838318 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da1f002e-e4ea-4af8-a0c0-9d00ec7d7443 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:04.005042 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-da1f002e-e4ea-4af8-a0c0-9d00ec7d7443 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:04.018201 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-da1f002e-e4ea-4af8-a0c0-9d00ec7d7443 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1665 microversion: 2.1 time: 1.196970 Sep 16 13:04:04.019657 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1941/3764] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:02 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1665 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:04.036093 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3c8e77ef-927e-4d2b-93e6-5412e9410592 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:04.047776 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3c8e77ef-927e-4d2b-93e6-5412e9410592 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 17bd55c8-4d10-424e-a143-037b14585d31] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:04.073185 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c8e77ef-927e-4d2b-93e6-5412e9410592 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:04.074086 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c8e77ef-927e-4d2b-93e6-5412e9410592 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:04.074739 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c8e77ef-927e-4d2b-93e6-5412e9410592 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:04.075694 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c8e77ef-927e-4d2b-93e6-5412e9410592 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:04.076381 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c8e77ef-927e-4d2b-93e6-5412e9410592 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:04.078491 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c8e77ef-927e-4d2b-93e6-5412e9410592 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:04.395029 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8ec1591e-09c7-43e0-bfeb-dad1045a0c4d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:04.423884 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8ec1591e-09c7-43e0-bfeb-dad1045a0c4d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:04.428289 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8ec1591e-09c7-43e0-bfeb-dad1045a0c4d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:04.429702 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8ec1591e-09c7-43e0-bfeb-dad1045a0c4d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1810 microversion: 2.20 time: 1.677602 Sep 16 13:04:04.437441 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1824/3765] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:04:02 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1810 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:04:04.442991 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-76f0d199-05fa-4604-9be3-0412155d3949 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:04.446442 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-76f0d199-05fa-4604-9be3-0412155d3949 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:04.463227 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-76f0d199-05fa-4604-9be3-0412155d3949 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:04.467979 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-76f0d199-05fa-4604-9be3-0412155d3949 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:04.468973 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-76f0d199-05fa-4604-9be3-0412155d3949 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:04.470080 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-76f0d199-05fa-4604-9be3-0412155d3949 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:04.471025 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-76f0d199-05fa-4604-9be3-0412155d3949 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:04.471658 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-76f0d199-05fa-4604-9be3-0412155d3949 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:04.685672 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3c8e77ef-927e-4d2b-93e6-5412e9410592 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed69c96e39249f181eda742be229b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeff399942c4286a71ea3a0eab43280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:04.704379 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3c8e77ef-927e-4d2b-93e6-5412e9410592 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31" status: 200 len: 1315 microversion: 2.1 time: 0.667768 Sep 16 13:04:04.705326 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1942/3766] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:04 2022] GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31 => generated 1315 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:05.263251 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-76f0d199-05fa-4604-9be3-0412155d3949 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:05.308307 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-76f0d199-05fa-4604-9be3-0412155d3949 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1665 microversion: 2.1 time: 0.868571 Sep 16 13:04:05.313124 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1825/3767] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:04 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1665 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:05.338987 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-def5c210-2fa3-4407-8bf3-0d44cade8a10 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:05.340524 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-def5c210-2fa3-4407-8bf3-0d44cade8a10 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:05.361822 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-def5c210-2fa3-4407-8bf3-0d44cade8a10 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:05.362067 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-def5c210-2fa3-4407-8bf3-0d44cade8a10 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:05.364782 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-def5c210-2fa3-4407-8bf3-0d44cade8a10 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:05.367809 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-def5c210-2fa3-4407-8bf3-0d44cade8a10 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:05.370668 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-def5c210-2fa3-4407-8bf3-0d44cade8a10 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:05.392969 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-def5c210-2fa3-4407-8bf3-0d44cade8a10 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:05.465481 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-bc68f0c8-f0c0-467a-b05d-6d8815c92f95 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:05.466482 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-bc68f0c8-f0c0-467a-b05d-6d8815c92f95 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:05.482399 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bc68f0c8-f0c0-467a-b05d-6d8815c92f95 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:05.483403 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bc68f0c8-f0c0-467a-b05d-6d8815c92f95 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:05.485168 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bc68f0c8-f0c0-467a-b05d-6d8815c92f95 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:05.487549 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bc68f0c8-f0c0-467a-b05d-6d8815c92f95 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:05.489552 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bc68f0c8-f0c0-467a-b05d-6d8815c92f95 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:05.490347 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bc68f0c8-f0c0-467a-b05d-6d8815c92f95 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:06.368526 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-def5c210-2fa3-4407-8bf3-0d44cade8a10 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:06.383803 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-def5c210-2fa3-4407-8bf3-0d44cade8a10 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1665 microversion: 2.1 time: 1.045527 Sep 16 13:04:06.387371 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1943/3768] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:05 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1665 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:06.398964 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1c58fd11-0abe-492a-b3a6-1f8df048b493 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:06.404571 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1c58fd11-0abe-492a-b3a6-1f8df048b493 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 17bd55c8-4d10-424e-a143-037b14585d31] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:06.424680 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c58fd11-0abe-492a-b3a6-1f8df048b493 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:06.425190 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c58fd11-0abe-492a-b3a6-1f8df048b493 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:06.425639 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c58fd11-0abe-492a-b3a6-1f8df048b493 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:06.426367 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c58fd11-0abe-492a-b3a6-1f8df048b493 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:06.426830 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c58fd11-0abe-492a-b3a6-1f8df048b493 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:06.434639 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c58fd11-0abe-492a-b3a6-1f8df048b493 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:06.441560 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-bc68f0c8-f0c0-467a-b05d-6d8815c92f95 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:06.453095 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-bc68f0c8-f0c0-467a-b05d-6d8815c92f95 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:06.461767 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-bc68f0c8-f0c0-467a-b05d-6d8815c92f95 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:06.474141 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-bc68f0c8-f0c0-467a-b05d-6d8815c92f95 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1810 microversion: 2.20 time: 1.014379 Sep 16 13:04:06.476894 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1826/3769] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:04:05 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1810 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:04:06.645283 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7c2372bb-7507-4683-be00-ec78656217b4 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-52627558", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": [{"uuid": "9af47dcf-ef82-4350-bfb1-14c70158aca5"}]}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:04:06.775348 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-7c2372bb-7507-4683-be00-ec78656217b4 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] validate_networks() for [('9af47dcf-ef82-4350-bfb1-14c70158aca5', None, None, None, None, None)] {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:04:07.662205 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1c58fd11-0abe-492a-b3a6-1f8df048b493 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed69c96e39249f181eda742be229b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeff399942c4286a71ea3a0eab43280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:07.677791 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1c58fd11-0abe-492a-b3a6-1f8df048b493 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31" status: 200 len: 1504 microversion: 2.1 time: 1.288644 Sep 16 13:04:07.693283 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1944/3770] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:06 2022] GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31 => generated 1504 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:07.702837 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e420b85a-1926-493c-9d4d-661b88fc2f5d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:07.705040 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e420b85a-1926-493c-9d4d-661b88fc2f5d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:07.732568 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e420b85a-1926-493c-9d4d-661b88fc2f5d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:07.734316 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e420b85a-1926-493c-9d4d-661b88fc2f5d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:07.738036 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e420b85a-1926-493c-9d4d-661b88fc2f5d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:07.738887 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e420b85a-1926-493c-9d4d-661b88fc2f5d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:07.739335 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e420b85a-1926-493c-9d4d-661b88fc2f5d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:07.748925 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e420b85a-1926-493c-9d4d-661b88fc2f5d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:08.434662 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e420b85a-1926-493c-9d4d-661b88fc2f5d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:08.464229 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e420b85a-1926-493c-9d4d-661b88fc2f5d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:08.466236 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e420b85a-1926-493c-9d4d-661b88fc2f5d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:08.469776 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e420b85a-1926-493c-9d4d-661b88fc2f5d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1810 microversion: 2.20 time: 0.785979 Sep 16 13:04:08.493064 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1945/3771] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:04:07 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1810 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:04:08.506076 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-27c399db-fca7-48d1-9c22-7910cb1aed18 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1524358725"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:04:08.511469 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-27c399db-fca7-48d1-9c22-7910cb1aed18 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 17bd55c8-4d10-424e-a143-037b14585d31] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:08.522788 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27c399db-fca7-48d1-9c22-7910cb1aed18 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:08.523546 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27c399db-fca7-48d1-9c22-7910cb1aed18 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:08.524237 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27c399db-fca7-48d1-9c22-7910cb1aed18 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:08.525142 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27c399db-fca7-48d1-9c22-7910cb1aed18 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:08.525758 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27c399db-fca7-48d1-9c22-7910cb1aed18 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:08.527736 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27c399db-fca7-48d1-9c22-7910cb1aed18 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:09.474017 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-7c2372bb-7507-4683-be00-ec78656217b4 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:04:09.474580 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-7c2372bb-7507-4683-be00-ec78656217b4 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:04:09.474913 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-7c2372bb-7507-4683-be00-ec78656217b4 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:04:09.475333 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-7c2372bb-7507-4683-be00-ec78656217b4 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:04:09.475741 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-7c2372bb-7507-4683-be00-ec78656217b4 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:04:09.487638 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7c2372bb-7507-4683-be00-ec78656217b4 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:09.488402 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7c2372bb-7507-4683-be00-ec78656217b4 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:09.488845 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7c2372bb-7507-4683-be00-ec78656217b4 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:09.489756 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7c2372bb-7507-4683-be00-ec78656217b4 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:09.490357 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7c2372bb-7507-4683-be00-ec78656217b4 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:09.490946 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7c2372bb-7507-4683-be00-ec78656217b4 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:09.518927 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-7c2372bb-7507-4683-be00-ec78656217b4 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Getting quotas for project 337bc9a50c6846ada58b194c94d0f193. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:04:09.525477 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-7c2372bb-7507-4683-be00-ec78656217b4 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Getting quotas for user 968cbe62235f472fb9002171f19e1375 and project 337bc9a50c6846ada58b194c94d0f193. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:04:09.543601 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7c2372bb-7507-4683-be00-ec78656217b4 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:04:09.546474 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7c2372bb-7507-4683-be00-ec78656217b4 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:04:09.607266 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.network.security_group_api [None req-27c399db-fca7-48d1-9c22-7910cb1aed18 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Adding security group 171162a5-7b15-4d9a-b046-5c75ef6c9ab9 to port e7480e72-f883-4315-9905-ecaed73586e8 Sep 16 13:04:09.625951 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7c2372bb-7507-4683-be00-ec78656217b4 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.984607 Sep 16 13:04:09.627288 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1827/3772] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 13:04:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 13:04:09.632113 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7cc92c7b-c7a8-4479-99d3-a4605bbc6e44 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:09.633064 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7cc92c7b-c7a8-4479-99d3-a4605bbc6e44 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:09.641813 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7cc92c7b-c7a8-4479-99d3-a4605bbc6e44 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:09.642395 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7cc92c7b-c7a8-4479-99d3-a4605bbc6e44 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:09.642938 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7cc92c7b-c7a8-4479-99d3-a4605bbc6e44 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:09.643711 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7cc92c7b-c7a8-4479-99d3-a4605bbc6e44 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:09.644420 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7cc92c7b-c7a8-4479-99d3-a4605bbc6e44 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:09.644922 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7cc92c7b-c7a8-4479-99d3-a4605bbc6e44 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:10.173933 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7cc92c7b-c7a8-4479-99d3-a4605bbc6e44 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:10.184577 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7cc92c7b-c7a8-4479-99d3-a4605bbc6e44 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:10.190045 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7cc92c7b-c7a8-4479-99d3-a4605bbc6e44 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:10.191278 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7cc92c7b-c7a8-4479-99d3-a4605bbc6e44 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1810 microversion: 2.20 time: 0.562851 Sep 16 13:04:10.200356 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1828/3773] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:04:09 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1810 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:04:10.208780 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0170a424-d811-4c32-91f1-a3ea948f3c52 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:10.209411 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0170a424-d811-4c32-91f1-a3ea948f3c52 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:10.391046 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0170a424-d811-4c32-91f1-a3ea948f3c52 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:10.416340 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0170a424-d811-4c32-91f1-a3ea948f3c52 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d" status: 200 len: 1213 microversion: 2.1 time: 0.209898 Sep 16 13:04:10.428336 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1829/3774] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:10 2022] GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d => generated 1213 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:11.231132 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f78bec13-9221-4ca0-bbc8-47bdc57788c3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:11.232038 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f78bec13-9221-4ca0-bbc8-47bdc57788c3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:11.252804 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f78bec13-9221-4ca0-bbc8-47bdc57788c3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:11.253356 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f78bec13-9221-4ca0-bbc8-47bdc57788c3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:11.253803 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f78bec13-9221-4ca0-bbc8-47bdc57788c3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:11.257543 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-27c399db-fca7-48d1-9c22-7910cb1aed18 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "POST /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31/action" status: 202 len: 0 microversion: 2.1 time: 2.759069 Sep 16 13:04:11.258164 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f78bec13-9221-4ca0-bbc8-47bdc57788c3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:11.258909 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f78bec13-9221-4ca0-bbc8-47bdc57788c3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:11.259590 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f78bec13-9221-4ca0-bbc8-47bdc57788c3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:11.260786 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1946/3775] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 13:04:08 2022] POST /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31/action => generated 0 bytes in 2767 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:04:11.270712 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-00c02f5d-ff09-4e33-9d9c-0880fa3d65c3 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '.version_select at 0x7f103514faf0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:12.000257 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f78bec13-9221-4ca0-bbc8-47bdc57788c3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:12.011090 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f78bec13-9221-4ca0-bbc8-47bdc57788c3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:12.019864 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f78bec13-9221-4ca0-bbc8-47bdc57788c3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:12.021365 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f78bec13-9221-4ca0-bbc8-47bdc57788c3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1810 microversion: 2.20 time: 0.797111 Sep 16 13:04:12.024276 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1830/3776] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:04:11 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1810 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:04:12.040954 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-03538770-5a32-47e6-bf2a-7e33bfe9b4d5 req-f31523f3-17f9-43b0-83c8-d34bc9056e19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17bd55c8-4d10-424e-a143-037b14585d31", "tag": "e7480e72-f883-4315-9905-ecaed73586e8"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:04:12.046430 n-d-858094-4 devstack@n-api.service[128779]: DEBUG neutronclient.v2_0.client [None req-00c02f5d-ff09-4e33-9d9c-0880fa3d65c3 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 171162a5-7b15-4d9a-b046-5c75ef6c9ab9 in use.", "detail": ""}} {{(pid=128779) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 13:04:12.047231 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-00c02f5d-ff09-4e33-9d9c-0880fa3d65c3 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] HTTP exception thrown: Security Group 171162a5-7b15-4d9a-b046-5c75ef6c9ab9 in use. Sep 16 13:04:12.047231 n-d-858094-4 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-2ba19666-3556-4b67-bd75-2ab309298208'] Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-00c02f5d-ff09-4e33-9d9c-0880fa3d65c3 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Request method failure captured: Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/os-security-groups/171162a5-7b15-4d9a-b046-5c75ef6c9ab9 HTTP/1.1 Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHP182fOoXAmmtyFT24t1WldG_-n_fUq_hYyF_kcX6BBuNdLFPJQpvv1Qbau8uBELlze_J0V8PSdv80EZFiSQVIXVTfCMdV7A-swstczuz_Ini1wPhpJqJ2_9Cvd9QLrJtnV-zdKbzeKde8qkyp_ruLhl8BqedA5EVFg3XozRh0MDPU Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: aaeff399942c4286a71ea3a0eab43280 Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_aaeff399942c4286a71ea3a0eab43280", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: aaeff399942c4286a71ea3a0eab43280 Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-SecurityGroupsTestJSON-210138271-project Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 8ed69c96e39249f181eda742be229b97 Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-SecurityGroupsTestJSON-210138271-project Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: exception: Security Group 171162a5-7b15-4d9a-b046-5c75ef6c9ab9 in use. Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-2ba19666-3556-4b67-bd75-2ab309298208'] Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '171162a5-7b15-4d9a-b046-5c75ef6c9ab9'} Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 13:04:12.053627 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 171162a5-7b15-4d9a-b046-5c75ef6c9ab9 in use. Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ba19666-3556-4b67-bd75-2ab309298208'] Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 171162a5-7b15-4d9a-b046-5c75ef6c9ab9 in use. Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ba19666-3556-4b67-bd75-2ab309298208'] Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 171162a5-7b15-4d9a-b046-5c75ef6c9ab9 in use. Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ba19666-3556-4b67-bd75-2ab309298208'] Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 171162a5-7b15-4d9a-b046-5c75ef6c9ab9 in use. Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ba19666-3556-4b67-bd75-2ab309298208'] Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-00c02f5d-ff09-4e33-9d9c-0880fa3d65c3 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Returning 400 to user: Security Group 171162a5-7b15-4d9a-b046-5c75ef6c9ab9 in use. Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-2ba19666-3556-4b67-bd75-2ab309298208'] {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-00c02f5d-ff09-4e33-9d9c-0880fa3d65c3 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/171162a5-7b15-4d9a-b046-5c75ef6c9ab9" status: 400 len: 185 microversion: 2.1 time: 0.790175 Sep 16 13:04:12.056578 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1947/3777] 10.222.0.67 () {58 vars in 1272 bytes} [Fri Sep 16 13:04:11 2022] DELETE /compute/v2.1/os-security-groups/171162a5-7b15-4d9a-b046-5c75ef6c9ab9 => generated 185 bytes in 791 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 13:04:12.065778 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f1a6e3b5-57be-42e1-9139-912be2a9ffae tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:12.070520 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f1a6e3b5-57be-42e1-9139-912be2a9ffae tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:12.074480 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-03538770-5a32-47e6-bf2a-7e33bfe9b4d5 req-f31523f3-17f9-43b0-83c8-d34bc9056e19 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:12.078487 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-03538770-5a32-47e6-bf2a-7e33bfe9b4d5 req-f31523f3-17f9-43b0-83c8-d34bc9056e19 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:12.079186 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-03538770-5a32-47e6-bf2a-7e33bfe9b4d5 req-f31523f3-17f9-43b0-83c8-d34bc9056e19 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:12.089250 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1a6e3b5-57be-42e1-9139-912be2a9ffae tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:12.092859 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1a6e3b5-57be-42e1-9139-912be2a9ffae tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:12.093475 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1a6e3b5-57be-42e1-9139-912be2a9ffae tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:12.097161 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-03538770-5a32-47e6-bf2a-7e33bfe9b4d5 req-f31523f3-17f9-43b0-83c8-d34bc9056e19 service nova] Creating event network-changed:e7480e72-f883-4315-9905-ecaed73586e8 for instance 17bd55c8-4d10-424e-a143-037b14585d31 on n-h2-858094-4 Sep 16 13:04:12.097353 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1a6e3b5-57be-42e1-9139-912be2a9ffae tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:12.097875 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1a6e3b5-57be-42e1-9139-912be2a9ffae tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:12.098320 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1a6e3b5-57be-42e1-9139-912be2a9ffae tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:12.104701 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-03538770-5a32-47e6-bf2a-7e33bfe9b4d5 req-f31523f3-17f9-43b0-83c8-d34bc9056e19 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075858 Sep 16 13:04:12.107022 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1831/3778] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:04:12.127476 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b8844f3c-2e3c-463f-9a3e-5d419540edad tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:04:12.134798 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b8844f3c-2e3c-463f-9a3e-5d419540edad tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 17bd55c8-4d10-424e-a143-037b14585d31] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:12.145028 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b8844f3c-2e3c-463f-9a3e-5d419540edad tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:12.145913 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b8844f3c-2e3c-463f-9a3e-5d419540edad tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:12.146708 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b8844f3c-2e3c-463f-9a3e-5d419540edad tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:12.147697 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b8844f3c-2e3c-463f-9a3e-5d419540edad tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:12.148747 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b8844f3c-2e3c-463f-9a3e-5d419540edad tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:12.149386 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b8844f3c-2e3c-463f-9a3e-5d419540edad tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:12.249265 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b8844f3c-2e3c-463f-9a3e-5d419540edad tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "POST /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31/action" status: 202 len: 0 microversion: 2.1 time: 0.139561 Sep 16 13:04:12.251118 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1832/3779] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 13:04:12 2022] POST /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:04:12.263990 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-14dfa83c-2f35-458f-88b7-3696049f742f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:12.267138 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-14dfa83c-2f35-458f-88b7-3696049f742f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 17bd55c8-4d10-424e-a143-037b14585d31] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:12.275716 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14dfa83c-2f35-458f-88b7-3696049f742f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:12.277665 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14dfa83c-2f35-458f-88b7-3696049f742f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:12.278668 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14dfa83c-2f35-458f-88b7-3696049f742f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:12.281061 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14dfa83c-2f35-458f-88b7-3696049f742f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:12.281918 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14dfa83c-2f35-458f-88b7-3696049f742f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:12.283026 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14dfa83c-2f35-458f-88b7-3696049f742f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:12.451136 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f1a6e3b5-57be-42e1-9139-912be2a9ffae tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:12.466558 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f1a6e3b5-57be-42e1-9139-912be2a9ffae tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d" status: 200 len: 1271 microversion: 2.1 time: 0.407930 Sep 16 13:04:12.499429 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1948/3780] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:12 2022] GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d => generated 1271 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:12.914643 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-14dfa83c-2f35-458f-88b7-3696049f742f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed69c96e39249f181eda742be229b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeff399942c4286a71ea3a0eab43280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:12.925212 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-14dfa83c-2f35-458f-88b7-3696049f742f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31" status: 200 len: 1575 microversion: 2.1 time: 0.669194 Sep 16 13:04:12.926434 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1833/3781] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:12 2022] GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31 => generated 1575 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:13.062462 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c27f1ed5-1651-474c-9378-8a08975f0b81 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:13.063403 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c27f1ed5-1651-474c-9378-8a08975f0b81 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:13.080599 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c27f1ed5-1651-474c-9378-8a08975f0b81 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:13.081721 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c27f1ed5-1651-474c-9378-8a08975f0b81 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:13.082441 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c27f1ed5-1651-474c-9378-8a08975f0b81 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:13.084631 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c27f1ed5-1651-474c-9378-8a08975f0b81 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:13.085838 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c27f1ed5-1651-474c-9378-8a08975f0b81 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:13.088025 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c27f1ed5-1651-474c-9378-8a08975f0b81 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:13.495719 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-01735c4b-3d7c-4a11-ae56-532fe387cd4a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:13.496359 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-01735c4b-3d7c-4a11-ae56-532fe387cd4a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:13.503020 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-01735c4b-3d7c-4a11-ae56-532fe387cd4a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:13.510131 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-01735c4b-3d7c-4a11-ae56-532fe387cd4a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:13.511149 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-01735c4b-3d7c-4a11-ae56-532fe387cd4a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:13.513424 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-01735c4b-3d7c-4a11-ae56-532fe387cd4a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:13.514246 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-01735c4b-3d7c-4a11-ae56-532fe387cd4a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:13.514697 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-01735c4b-3d7c-4a11-ae56-532fe387cd4a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:13.772395 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-01735c4b-3d7c-4a11-ae56-532fe387cd4a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:13.782148 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-01735c4b-3d7c-4a11-ae56-532fe387cd4a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d" status: 200 len: 1271 microversion: 2.1 time: 0.291136 Sep 16 13:04:13.799453 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1834/3782] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:13 2022] GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d => generated 1271 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:04:13.949450 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-71b869ec-fe82-4735-b3ff-c5081d1c3c97 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:13.950080 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-71b869ec-fe82-4735-b3ff-c5081d1c3c97 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 17bd55c8-4d10-424e-a143-037b14585d31] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:13.963977 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c27f1ed5-1651-474c-9378-8a08975f0b81 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:13.968999 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-71b869ec-fe82-4735-b3ff-c5081d1c3c97 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:13.969548 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-71b869ec-fe82-4735-b3ff-c5081d1c3c97 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:13.970045 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-71b869ec-fe82-4735-b3ff-c5081d1c3c97 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:13.970789 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-71b869ec-fe82-4735-b3ff-c5081d1c3c97 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:13.971744 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-71b869ec-fe82-4735-b3ff-c5081d1c3c97 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:13.973115 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-71b869ec-fe82-4735-b3ff-c5081d1c3c97 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:13.977120 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c27f1ed5-1651-474c-9378-8a08975f0b81 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:13.979729 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c27f1ed5-1651-474c-9378-8a08975f0b81 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:13.981473 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c27f1ed5-1651-474c-9378-8a08975f0b81 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1810 microversion: 2.20 time: 0.927205 Sep 16 13:04:13.997464 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1949/3783] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:04:13 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1810 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:04:14.474781 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-71b869ec-fe82-4735-b3ff-c5081d1c3c97 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed69c96e39249f181eda742be229b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeff399942c4286a71ea3a0eab43280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:14.492314 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-71b869ec-fe82-4735-b3ff-c5081d1c3c97 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31" status: 200 len: 1575 microversion: 2.1 time: 0.546839 Sep 16 13:04:14.493194 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1835/3784] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:13 2022] GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31 => generated 1575 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:04:14.809929 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-69f6248b-4e1f-4bc4-8905-0cc7b957f8a5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:14.810561 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-69f6248b-4e1f-4bc4-8905-0cc7b957f8a5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:14.822645 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-69f6248b-4e1f-4bc4-8905-0cc7b957f8a5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:14.823199 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-69f6248b-4e1f-4bc4-8905-0cc7b957f8a5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:14.823779 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-69f6248b-4e1f-4bc4-8905-0cc7b957f8a5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:14.824577 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-69f6248b-4e1f-4bc4-8905-0cc7b957f8a5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:14.824963 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-69f6248b-4e1f-4bc4-8905-0cc7b957f8a5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:14.825382 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-69f6248b-4e1f-4bc4-8905-0cc7b957f8a5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:15.011417 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b92ccdf8-00dd-4351-8600-dd08ba87fe68 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:15.012666 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b92ccdf8-00dd-4351-8600-dd08ba87fe68 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:15.029261 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b92ccdf8-00dd-4351-8600-dd08ba87fe68 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:15.029977 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b92ccdf8-00dd-4351-8600-dd08ba87fe68 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:15.030564 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b92ccdf8-00dd-4351-8600-dd08ba87fe68 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:15.031415 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b92ccdf8-00dd-4351-8600-dd08ba87fe68 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:15.037296 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b92ccdf8-00dd-4351-8600-dd08ba87fe68 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:15.037745 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b92ccdf8-00dd-4351-8600-dd08ba87fe68 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:15.463072 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-69f6248b-4e1f-4bc4-8905-0cc7b957f8a5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:15.491934 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-69f6248b-4e1f-4bc4-8905-0cc7b957f8a5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d" status: 200 len: 1313 microversion: 2.1 time: 0.686082 Sep 16 13:04:15.496734 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1950/3785] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:14 2022] GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d => generated 1313 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:15.520738 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d9659e6d-711c-4c29-9f08-62b942864f09 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:15.522537 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d9659e6d-711c-4c29-9f08-62b942864f09 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 17bd55c8-4d10-424e-a143-037b14585d31] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:15.535292 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9659e6d-711c-4c29-9f08-62b942864f09 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:15.536188 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9659e6d-711c-4c29-9f08-62b942864f09 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:15.537004 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9659e6d-711c-4c29-9f08-62b942864f09 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:15.538072 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9659e6d-711c-4c29-9f08-62b942864f09 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:15.538927 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9659e6d-711c-4c29-9f08-62b942864f09 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:15.539914 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9659e6d-711c-4c29-9f08-62b942864f09 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:15.629072 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-b92ccdf8-00dd-4351-8600-dd08ba87fe68 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:15.642783 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-b92ccdf8-00dd-4351-8600-dd08ba87fe68 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:15.645094 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-b92ccdf8-00dd-4351-8600-dd08ba87fe68 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:15.646723 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b92ccdf8-00dd-4351-8600-dd08ba87fe68 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1810 microversion: 2.20 time: 0.640595 Sep 16 13:04:15.648070 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1836/3786] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:04:15 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1810 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:04:16.113133 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d9659e6d-711c-4c29-9f08-62b942864f09 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed69c96e39249f181eda742be229b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeff399942c4286a71ea3a0eab43280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:16.128725 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d9659e6d-711c-4c29-9f08-62b942864f09 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31" status: 200 len: 1575 microversion: 2.1 time: 0.612831 Sep 16 13:04:16.146427 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1951/3787] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:15 2022] GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31 => generated 1575 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:04:16.522042 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7cf8d7e3-3ac3-4f19-9139-375699ed3dbf tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:16.523222 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7cf8d7e3-3ac3-4f19-9139-375699ed3dbf tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:16.533802 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7cf8d7e3-3ac3-4f19-9139-375699ed3dbf tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:16.534300 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7cf8d7e3-3ac3-4f19-9139-375699ed3dbf tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:16.535820 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7cf8d7e3-3ac3-4f19-9139-375699ed3dbf tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:16.540070 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7cf8d7e3-3ac3-4f19-9139-375699ed3dbf tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:16.540807 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7cf8d7e3-3ac3-4f19-9139-375699ed3dbf tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:16.542207 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7cf8d7e3-3ac3-4f19-9139-375699ed3dbf tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:16.586636 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:04:16.678064 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6e1b33b9-dae4-42c3-a9b7-88c1907debab tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:16.678679 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6e1b33b9-dae4-42c3-a9b7-88c1907debab tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:16.680919 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:04:16.691400 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e1b33b9-dae4-42c3-a9b7-88c1907debab tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:16.694714 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e1b33b9-dae4-42c3-a9b7-88c1907debab tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:16.695373 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e1b33b9-dae4-42c3-a9b7-88c1907debab tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:16.696559 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e1b33b9-dae4-42c3-a9b7-88c1907debab tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:16.699978 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e1b33b9-dae4-42c3-a9b7-88c1907debab tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:16.701707 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e1b33b9-dae4-42c3-a9b7-88c1907debab tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:16.732238 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:04:17.206618 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7cf8d7e3-3ac3-4f19-9139-375699ed3dbf tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:17.215242 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7cf8d7e3-3ac3-4f19-9139-375699ed3dbf tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d" status: 200 len: 1313 microversion: 2.1 time: 0.700104 Sep 16 13:04:17.215859 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1837/3788] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:16 2022] GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d => generated 1313 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:17.228768 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a2a333c0-f16b-47d6-ad00-44e4feec7e57 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:17.233424 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a2a333c0-f16b-47d6-ad00-44e4feec7e57 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 17bd55c8-4d10-424e-a143-037b14585d31] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:17.247008 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a2a333c0-f16b-47d6-ad00-44e4feec7e57 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:17.247502 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a2a333c0-f16b-47d6-ad00-44e4feec7e57 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:17.253870 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a2a333c0-f16b-47d6-ad00-44e4feec7e57 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:17.254862 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a2a333c0-f16b-47d6-ad00-44e4feec7e57 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:17.255493 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a2a333c0-f16b-47d6-ad00-44e4feec7e57 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:17.255927 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a2a333c0-f16b-47d6-ad00-44e4feec7e57 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:17.274799 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6e1b33b9-dae4-42c3-a9b7-88c1907debab tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:17.293310 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6e1b33b9-dae4-42c3-a9b7-88c1907debab tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:17.294885 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6e1b33b9-dae4-42c3-a9b7-88c1907debab tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:17.296148 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6e1b33b9-dae4-42c3-a9b7-88c1907debab tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1810 microversion: 2.20 time: 0.622418 Sep 16 13:04:17.310529 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1952/3789] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:04:16 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1810 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:04:17.314658 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-0e6acd3f-7555-4bbf-a759-44217368abb6 req-6726f004-a132-4a31-b51c-268d276aeb19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d", "tag": "d408043a-8807-412e-bac0-ea9a50061ee1"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:04:17.353521 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0e6acd3f-7555-4bbf-a759-44217368abb6 req-6726f004-a132-4a31-b51c-268d276aeb19 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:17.361719 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0e6acd3f-7555-4bbf-a759-44217368abb6 req-6726f004-a132-4a31-b51c-268d276aeb19 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:17.362362 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0e6acd3f-7555-4bbf-a759-44217368abb6 req-6726f004-a132-4a31-b51c-268d276aeb19 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:17.389287 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-0e6acd3f-7555-4bbf-a759-44217368abb6 req-6726f004-a132-4a31-b51c-268d276aeb19 service nova] Creating event network-changed:d408043a-8807-412e-bac0-ea9a50061ee1 for instance 17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d on n-h1-858094-4 Sep 16 13:04:17.394496 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-0e6acd3f-7555-4bbf-a759-44217368abb6 req-6726f004-a132-4a31-b51c-268d276aeb19 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083392 Sep 16 13:04:17.396062 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1953/3790] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:04:17.712382 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a2a333c0-f16b-47d6-ad00-44e4feec7e57 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed69c96e39249f181eda742be229b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeff399942c4286a71ea3a0eab43280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:17.725590 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a2a333c0-f16b-47d6-ad00-44e4feec7e57 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31" status: 200 len: 1580 microversion: 2.1 time: 0.504480 Sep 16 13:04:17.726188 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1838/3791] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:17 2022] GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31 => generated 1580 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:18.245320 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-90d6e897-232e-4ab8-bd50-fcb19daefe8d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:18.247653 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-90d6e897-232e-4ab8-bd50-fcb19daefe8d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:18.263566 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90d6e897-232e-4ab8-bd50-fcb19daefe8d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:18.264762 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90d6e897-232e-4ab8-bd50-fcb19daefe8d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:18.265560 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90d6e897-232e-4ab8-bd50-fcb19daefe8d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:18.267566 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90d6e897-232e-4ab8-bd50-fcb19daefe8d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:18.268530 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90d6e897-232e-4ab8-bd50-fcb19daefe8d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:18.269274 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90d6e897-232e-4ab8-bd50-fcb19daefe8d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:18.328971 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-77854a54-c974-4511-81bd-43d8a5691f72 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:18.331574 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-77854a54-c974-4511-81bd-43d8a5691f72 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:18.343021 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-77854a54-c974-4511-81bd-43d8a5691f72 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:18.390153 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-77854a54-c974-4511-81bd-43d8a5691f72 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:18.399423 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-77854a54-c974-4511-81bd-43d8a5691f72 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.039s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:18.402963 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-77854a54-c974-4511-81bd-43d8a5691f72 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:18.405112 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-77854a54-c974-4511-81bd-43d8a5691f72 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:18.406921 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-77854a54-c974-4511-81bd-43d8a5691f72 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:18.662261 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-90d6e897-232e-4ab8-bd50-fcb19daefe8d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:18.681868 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-90d6e897-232e-4ab8-bd50-fcb19daefe8d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d" status: 200 len: 1313 microversion: 2.1 time: 0.438807 Sep 16 13:04:18.682721 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1954/3792] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:18 2022] GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d => generated 1313 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:18.739317 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-77854a54-c974-4511-81bd-43d8a5691f72 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:18.751591 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-77854a54-c974-4511-81bd-43d8a5691f72 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:18.753325 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b2504cf4-e72e-41fb-91b7-948a06528146 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:18.753964 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b2504cf4-e72e-41fb-91b7-948a06528146 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 17bd55c8-4d10-424e-a143-037b14585d31] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:18.754311 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-77854a54-c974-4511-81bd-43d8a5691f72 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:18.756645 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-77854a54-c974-4511-81bd-43d8a5691f72 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1810 microversion: 2.20 time: 0.435025 Sep 16 13:04:18.758426 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1839/3793] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:04:18 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1810 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:04:18.768921 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2504cf4-e72e-41fb-91b7-948a06528146 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:18.774299 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2504cf4-e72e-41fb-91b7-948a06528146 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:18.775047 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2504cf4-e72e-41fb-91b7-948a06528146 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:18.776365 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2504cf4-e72e-41fb-91b7-948a06528146 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:18.777298 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2504cf4-e72e-41fb-91b7-948a06528146 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:18.779114 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2504cf4-e72e-41fb-91b7-948a06528146 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:19.070258 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b2504cf4-e72e-41fb-91b7-948a06528146 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed69c96e39249f181eda742be229b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeff399942c4286a71ea3a0eab43280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:19.080988 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b2504cf4-e72e-41fb-91b7-948a06528146 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31" status: 200 len: 1573 microversion: 2.1 time: 0.333301 Sep 16 13:04:19.092180 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1955/3794] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:18 2022] GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31 => generated 1573 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:19.107889 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-513c6364-054f-4090-abe5-3f504fd6b098 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-264247054"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:04:19.120260 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-513c6364-054f-4090-abe5-3f504fd6b098 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 17bd55c8-4d10-424e-a143-037b14585d31] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:19.145437 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-513c6364-054f-4090-abe5-3f504fd6b098 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:19.146294 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-513c6364-054f-4090-abe5-3f504fd6b098 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:19.147129 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-513c6364-054f-4090-abe5-3f504fd6b098 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:19.148116 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-513c6364-054f-4090-abe5-3f504fd6b098 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:19.148811 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-513c6364-054f-4090-abe5-3f504fd6b098 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:19.149449 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-513c6364-054f-4090-abe5-3f504fd6b098 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:19.407685 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.network.security_group_api [None req-513c6364-054f-4090-abe5-3f504fd6b098 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Adding security group 8ee7e4f8-3252-4678-a0b1-ce4987e5d9cb to port e7480e72-f883-4315-9905-ecaed73586e8 Sep 16 13:04:19.509545 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:04:19.706945 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9a701466-6df2-4511-b9ef-7c7e499bdd62 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:19.707731 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9a701466-6df2-4511-b9ef-7c7e499bdd62 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:19.718145 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a701466-6df2-4511-b9ef-7c7e499bdd62 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:19.724794 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a701466-6df2-4511-b9ef-7c7e499bdd62 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:19.725778 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a701466-6df2-4511-b9ef-7c7e499bdd62 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:19.726713 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a701466-6df2-4511-b9ef-7c7e499bdd62 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:19.728534 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a701466-6df2-4511-b9ef-7c7e499bdd62 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:19.729176 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a701466-6df2-4511-b9ef-7c7e499bdd62 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:20.412503 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=16 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:04:20.648766 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9a701466-6df2-4511-b9ef-7c7e499bdd62 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:20.660681 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9a701466-6df2-4511-b9ef-7c7e499bdd62 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d" status: 200 len: 1313 microversion: 2.1 time: 0.958132 Sep 16 13:04:20.662410 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1956/3795] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:19 2022] GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d => generated 1313 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:20.680098 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fa20d9e2-7249-4cc1-aac7-b8bf5c7f9ee0 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:20.680943 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fa20d9e2-7249-4cc1-aac7-b8bf5c7f9ee0 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:20.688879 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa20d9e2-7249-4cc1-aac7-b8bf5c7f9ee0 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:20.700997 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa20d9e2-7249-4cc1-aac7-b8bf5c7f9ee0 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:20.701771 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa20d9e2-7249-4cc1-aac7-b8bf5c7f9ee0 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:20.702714 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa20d9e2-7249-4cc1-aac7-b8bf5c7f9ee0 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:20.703367 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa20d9e2-7249-4cc1-aac7-b8bf5c7f9ee0 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:20.703982 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa20d9e2-7249-4cc1-aac7-b8bf5c7f9ee0 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:20.988340 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-513c6364-054f-4090-abe5-3f504fd6b098 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "POST /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31/action" status: 202 len: 0 microversion: 2.1 time: 1.886641 Sep 16 13:04:20.992516 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1840/3796] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 13:04:19 2022] POST /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31/action => generated 0 bytes in 1892 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:04:20.999008 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-a5a6c18d-d246-43ff-aa54-ba11444c99f1 req-73c6e8eb-3699-4c26-9a44-0262c26b82f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66413dbd-455f-45f6-b057-39a11a9f2d44", "name": "network-vif-plugged", "status": "completed", "tag": "3a5b1f2b-2004-4cf4-93bd-f498b62488fe"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:04:21.021457 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-a5a6c18d-d246-43ff-aa54-ba11444c99f1 req-73c6e8eb-3699-4c26-9a44-0262c26b82f7 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:21.022228 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-a5a6c18d-d246-43ff-aa54-ba11444c99f1 req-73c6e8eb-3699-4c26-9a44-0262c26b82f7 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:21.022938 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-a5a6c18d-d246-43ff-aa54-ba11444c99f1 req-73c6e8eb-3699-4c26-9a44-0262c26b82f7 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:21.035784 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-a5a6c18d-d246-43ff-aa54-ba11444c99f1 req-73c6e8eb-3699-4c26-9a44-0262c26b82f7 service nova] Creating event network-vif-plugged:3a5b1f2b-2004-4cf4-93bd-f498b62488fe for instance 66413dbd-455f-45f6-b057-39a11a9f2d44 on n-h2-858094-4 Sep 16 13:04:21.041478 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-a5a6c18d-d246-43ff-aa54-ba11444c99f1 req-73c6e8eb-3699-4c26-9a44-0262c26b82f7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046926 Sep 16 13:04:21.042544 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1841/3797] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:04:21.056367 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e7c0e85c-bb55-4278-956a-f783b7c52a2c tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '.version_select at 0x7f1039a4a820>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:22.037565 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fa20d9e2-7249-4cc1-aac7-b8bf5c7f9ee0 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:22.054586 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fa20d9e2-7249-4cc1-aac7-b8bf5c7f9ee0 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:22.061237 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fa20d9e2-7249-4cc1-aac7-b8bf5c7f9ee0 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:22.065547 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fa20d9e2-7249-4cc1-aac7-b8bf5c7f9ee0 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1810 microversion: 2.20 time: 1.400789 Sep 16 13:04:22.067001 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1957/3798] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:04:20 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1810 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:04:22.079735 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-d2c3bfcc-728a-49dc-a37b-6d24fd3a8909 req-4adb971f-5e1f-4990-a537-ef58e90e2aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17bd55c8-4d10-424e-a143-037b14585d31", "tag": "e7480e72-f883-4315-9905-ecaed73586e8"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:04:22.107736 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d2c3bfcc-728a-49dc-a37b-6d24fd3a8909 req-4adb971f-5e1f-4990-a537-ef58e90e2aa8 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:22.110269 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d2c3bfcc-728a-49dc-a37b-6d24fd3a8909 req-4adb971f-5e1f-4990-a537-ef58e90e2aa8 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:22.111584 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d2c3bfcc-728a-49dc-a37b-6d24fd3a8909 req-4adb971f-5e1f-4990-a537-ef58e90e2aa8 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:22.158149 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-d2c3bfcc-728a-49dc-a37b-6d24fd3a8909 req-4adb971f-5e1f-4990-a537-ef58e90e2aa8 service nova] Creating event network-changed:e7480e72-f883-4315-9905-ecaed73586e8 for instance 17bd55c8-4d10-424e-a143-037b14585d31 on n-h2-858094-4 Sep 16 13:04:22.186471 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-d2c3bfcc-728a-49dc-a37b-6d24fd3a8909 req-4adb971f-5e1f-4990-a537-ef58e90e2aa8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112807 Sep 16 13:04:22.187905 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1958/3799] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:04:22.204723 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5ee1cd49-29ea-41f6-93ab-14616e0a1505 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:22.207757 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5ee1cd49-29ea-41f6-93ab-14616e0a1505 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:22.218151 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ee1cd49-29ea-41f6-93ab-14616e0a1505 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:22.219437 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ee1cd49-29ea-41f6-93ab-14616e0a1505 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:22.220151 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ee1cd49-29ea-41f6-93ab-14616e0a1505 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:22.221656 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ee1cd49-29ea-41f6-93ab-14616e0a1505 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:22.223117 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ee1cd49-29ea-41f6-93ab-14616e0a1505 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:22.223988 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ee1cd49-29ea-41f6-93ab-14616e0a1505 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:22.311798 n-d-858094-4 devstack@n-api.service[128780]: DEBUG neutronclient.v2_0.client [None req-e7c0e85c-bb55-4278-956a-f783b7c52a2c tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 8ee7e4f8-3252-4678-a0b1-ce4987e5d9cb in use.", "detail": ""}} {{(pid=128780) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 13:04:22.312546 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-e7c0e85c-bb55-4278-956a-f783b7c52a2c tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] HTTP exception thrown: Security Group 8ee7e4f8-3252-4678-a0b1-ce4987e5d9cb in use. Sep 16 13:04:22.312546 n-d-858094-4 devstack@n-api.service[128780]: Neutron server returns request_ids: ['req-cac28dc1-7cd2-4880-86cd-c8995401e1ae'] Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e7c0e85c-bb55-4278-956a-f783b7c52a2c tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Request method failure captured: Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: request: DELETE /compute/v2.1/os-security-groups/8ee7e4f8-3252-4678-a0b1-ce4987e5d9cb HTTP/1.1 Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHP182fOoXAmmtyFT24t1WldG_-n_fUq_hYyF_kcX6BBuNdLFPJQpvv1Qbau8uBELlze_J0V8PSdv80EZFiSQVIXVTfCMdV7A-swstczuz_Ini1wPhpJqJ2_9Cvd9QLrJtnV-zdKbzeKde8qkyp_ruLhl8BqedA5EVFg3XozRh0MDPU Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: aaeff399942c4286a71ea3a0eab43280 Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_aaeff399942c4286a71ea3a0eab43280", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: aaeff399942c4286a71ea3a0eab43280 Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-SecurityGroupsTestJSON-210138271-project Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 8ed69c96e39249f181eda742be229b97 Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-SecurityGroupsTestJSON-210138271-project Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: exception: Security Group 8ee7e4f8-3252-4678-a0b1-ce4987e5d9cb in use. Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: Neutron server returns request_ids: ['req-cac28dc1-7cd2-4880-86cd-c8995401e1ae'] Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '8ee7e4f8-3252-4678-a0b1-ce4987e5d9cb'} Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 13:04:22.314845 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 8ee7e4f8-3252-4678-a0b1-ce4987e5d9cb in use. Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cac28dc1-7cd2-4880-86cd-c8995401e1ae'] Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 8ee7e4f8-3252-4678-a0b1-ce4987e5d9cb in use. Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cac28dc1-7cd2-4880-86cd-c8995401e1ae'] Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 8ee7e4f8-3252-4678-a0b1-ce4987e5d9cb in use. Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cac28dc1-7cd2-4880-86cd-c8995401e1ae'] Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 8ee7e4f8-3252-4678-a0b1-ce4987e5d9cb in use. Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cac28dc1-7cd2-4880-86cd-c8995401e1ae'] Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e7c0e85c-bb55-4278-956a-f783b7c52a2c tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Returning 400 to user: Security Group 8ee7e4f8-3252-4678-a0b1-ce4987e5d9cb in use. Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: Neutron server returns request_ids: ['req-cac28dc1-7cd2-4880-86cd-c8995401e1ae'] {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:04:22.318035 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e7c0e85c-bb55-4278-956a-f783b7c52a2c tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/8ee7e4f8-3252-4678-a0b1-ce4987e5d9cb" status: 400 len: 185 microversion: 2.1 time: 1.273760 Sep 16 13:04:22.323752 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1842/3800] 10.222.0.67 () {58 vars in 1272 bytes} [Fri Sep 16 13:04:21 2022] DELETE /compute/v2.1/os-security-groups/8ee7e4f8-3252-4678-a0b1-ce4987e5d9cb => generated 185 bytes in 1279 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 13:04:22.335077 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d48f689c-3d89-43f5-86be-227e20d36bde tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:22.336505 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d48f689c-3d89-43f5-86be-227e20d36bde tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 17bd55c8-4d10-424e-a143-037b14585d31] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:22.355021 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d48f689c-3d89-43f5-86be-227e20d36bde tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:22.355538 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d48f689c-3d89-43f5-86be-227e20d36bde tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:22.355990 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d48f689c-3d89-43f5-86be-227e20d36bde tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:22.363090 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d48f689c-3d89-43f5-86be-227e20d36bde tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:22.363613 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d48f689c-3d89-43f5-86be-227e20d36bde tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:22.364073 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d48f689c-3d89-43f5-86be-227e20d36bde tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:22.423310 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d48f689c-3d89-43f5-86be-227e20d36bde tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 17bd55c8-4d10-424e-a143-037b14585d31] Going to try to terminate instance {{(pid=128780) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:04:22.656031 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:04:22.661900 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d48f689c-3d89-43f5-86be-227e20d36bde tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "DELETE /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31" status: 204 len: 0 microversion: 2.1 time: 0.337334 Sep 16 13:04:22.663019 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1843/3801] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 13:04:22 2022] DELETE /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:04:22.678517 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f92bd941-74cc-4730-b6c8-ff73466c3fb6 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:22.679508 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f92bd941-74cc-4730-b6c8-ff73466c3fb6 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 17bd55c8-4d10-424e-a143-037b14585d31] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:22.692136 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f92bd941-74cc-4730-b6c8-ff73466c3fb6 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:22.692664 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f92bd941-74cc-4730-b6c8-ff73466c3fb6 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:22.699994 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f92bd941-74cc-4730-b6c8-ff73466c3fb6 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:22.700358 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f92bd941-74cc-4730-b6c8-ff73466c3fb6 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:22.700840 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f92bd941-74cc-4730-b6c8-ff73466c3fb6 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:22.701273 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f92bd941-74cc-4730-b6c8-ff73466c3fb6 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:23.149333 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5ee1cd49-29ea-41f6-93ab-14616e0a1505 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:23.247215 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5ee1cd49-29ea-41f6-93ab-14616e0a1505 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d" status: 200 len: 1313 microversion: 2.1 time: 1.057459 Sep 16 13:04:23.249338 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1959/3802] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:22 2022] GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d => generated 1313 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:23.279583 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dc62e435-dafb-41d8-b711-77e8f481ca6d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:23.281720 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dc62e435-dafb-41d8-b711-77e8f481ca6d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:23.294592 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc62e435-dafb-41d8-b711-77e8f481ca6d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:23.295528 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc62e435-dafb-41d8-b711-77e8f481ca6d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:23.296310 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc62e435-dafb-41d8-b711-77e8f481ca6d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:23.297516 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc62e435-dafb-41d8-b711-77e8f481ca6d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:23.298243 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc62e435-dafb-41d8-b711-77e8f481ca6d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:23.299000 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc62e435-dafb-41d8-b711-77e8f481ca6d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:23.486503 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f92bd941-74cc-4730-b6c8-ff73466c3fb6 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed69c96e39249f181eda742be229b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeff399942c4286a71ea3a0eab43280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:23.500214 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f92bd941-74cc-4730-b6c8-ff73466c3fb6 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31" status: 200 len: 1647 microversion: 2.1 time: 0.832414 Sep 16 13:04:23.502260 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1844/3803] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:22 2022] GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31 => generated 1647 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:23.933657 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dc62e435-dafb-41d8-b711-77e8f481ca6d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:23.959160 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dc62e435-dafb-41d8-b711-77e8f481ca6d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:23.961374 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dc62e435-dafb-41d8-b711-77e8f481ca6d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:23.976817 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dc62e435-dafb-41d8-b711-77e8f481ca6d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1810 microversion: 2.20 time: 0.725982 Sep 16 13:04:23.978216 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1960/3804] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:04:23 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1810 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:04:24.273169 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e39c17ea-f832-4989-b47f-9d25753b4b2a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:24.274157 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e39c17ea-f832-4989-b47f-9d25753b4b2a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:24.284433 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e39c17ea-f832-4989-b47f-9d25753b4b2a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:24.285434 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e39c17ea-f832-4989-b47f-9d25753b4b2a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:24.286128 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e39c17ea-f832-4989-b47f-9d25753b4b2a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:24.287054 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e39c17ea-f832-4989-b47f-9d25753b4b2a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:24.287724 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e39c17ea-f832-4989-b47f-9d25753b4b2a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:24.288385 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e39c17ea-f832-4989-b47f-9d25753b4b2a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:24.527458 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a8b1c147-f181-4470-b48f-cfc48e390e4b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:24.528080 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a8b1c147-f181-4470-b48f-cfc48e390e4b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 17bd55c8-4d10-424e-a143-037b14585d31] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:24.544267 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8b1c147-f181-4470-b48f-cfc48e390e4b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:24.550971 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8b1c147-f181-4470-b48f-cfc48e390e4b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:24.551697 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8b1c147-f181-4470-b48f-cfc48e390e4b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:24.552636 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8b1c147-f181-4470-b48f-cfc48e390e4b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:24.554349 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8b1c147-f181-4470-b48f-cfc48e390e4b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:24.554946 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8b1c147-f181-4470-b48f-cfc48e390e4b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:24.762952 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e39c17ea-f832-4989-b47f-9d25753b4b2a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:24.777990 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e39c17ea-f832-4989-b47f-9d25753b4b2a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d" status: 200 len: 1313 microversion: 2.1 time: 0.509372 Sep 16 13:04:24.779216 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1845/3805] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:24 2022] GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d => generated 1313 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:25.008772 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a03b453b-7472-454c-a2ba-691a56dd6573 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:25.010062 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a03b453b-7472-454c-a2ba-691a56dd6573 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:25.031917 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a03b453b-7472-454c-a2ba-691a56dd6573 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:25.037225 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a03b453b-7472-454c-a2ba-691a56dd6573 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:25.039262 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a03b453b-7472-454c-a2ba-691a56dd6573 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:25.044303 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a03b453b-7472-454c-a2ba-691a56dd6573 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:25.053261 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a03b453b-7472-454c-a2ba-691a56dd6573 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:25.062399 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a03b453b-7472-454c-a2ba-691a56dd6573 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:25.724943 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a8b1c147-f181-4470-b48f-cfc48e390e4b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed69c96e39249f181eda742be229b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeff399942c4286a71ea3a0eab43280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:25.760892 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a8b1c147-f181-4470-b48f-cfc48e390e4b tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31" status: 200 len: 1647 microversion: 2.1 time: 1.225840 Sep 16 13:04:25.768558 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1961/3806] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:24 2022] GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31 => generated 1647 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:04:25.787705 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-b1383cec-a770-4bf6-a30d-b28dadbeef82 req-25a8b3b4-1caf-46d8-9205-aa5fd90f182f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d", "name": "network-vif-plugged", "status": "completed", "tag": "d408043a-8807-412e-bac0-ea9a50061ee1"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:04:25.809640 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b1383cec-a770-4bf6-a30d-b28dadbeef82 req-25a8b3b4-1caf-46d8-9205-aa5fd90f182f service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:25.810441 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b1383cec-a770-4bf6-a30d-b28dadbeef82 req-25a8b3b4-1caf-46d8-9205-aa5fd90f182f service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:25.811036 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b1383cec-a770-4bf6-a30d-b28dadbeef82 req-25a8b3b4-1caf-46d8-9205-aa5fd90f182f service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:25.830611 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-b1383cec-a770-4bf6-a30d-b28dadbeef82 req-25a8b3b4-1caf-46d8-9205-aa5fd90f182f service nova] Creating event network-vif-plugged:d408043a-8807-412e-bac0-ea9a50061ee1 for instance 17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d on n-h1-858094-4 Sep 16 13:04:25.845360 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-b1383cec-a770-4bf6-a30d-b28dadbeef82 req-25a8b3b4-1caf-46d8-9205-aa5fd90f182f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074072 Sep 16 13:04:25.850922 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1962/3807] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:04:25.863365 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b6612e88-4dc1-44da-899c-0fe3ced57ad1 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:25.864805 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b6612e88-4dc1-44da-899c-0fe3ced57ad1 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:25.873807 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b6612e88-4dc1-44da-899c-0fe3ced57ad1 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:25.874607 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b6612e88-4dc1-44da-899c-0fe3ced57ad1 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:25.875260 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b6612e88-4dc1-44da-899c-0fe3ced57ad1 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:25.876068 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b6612e88-4dc1-44da-899c-0fe3ced57ad1 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:25.876777 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b6612e88-4dc1-44da-899c-0fe3ced57ad1 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:25.877434 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b6612e88-4dc1-44da-899c-0fe3ced57ad1 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:25.985133 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a03b453b-7472-454c-a2ba-691a56dd6573 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:26.015532 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a03b453b-7472-454c-a2ba-691a56dd6573 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:26.031767 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a03b453b-7472-454c-a2ba-691a56dd6573 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:26.039458 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a03b453b-7472-454c-a2ba-691a56dd6573 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1810 microversion: 2.20 time: 1.030771 Sep 16 13:04:26.040141 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1846/3808] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:04:25 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1810 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:04:26.793580 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d556ae10-ba7b-49a4-976e-4f5a072f6d5c tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:26.797345 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d556ae10-ba7b-49a4-976e-4f5a072f6d5c tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 17bd55c8-4d10-424e-a143-037b14585d31] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:26.808421 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d556ae10-ba7b-49a4-976e-4f5a072f6d5c tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:26.817830 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d556ae10-ba7b-49a4-976e-4f5a072f6d5c tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:26.818304 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d556ae10-ba7b-49a4-976e-4f5a072f6d5c tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:26.825033 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d556ae10-ba7b-49a4-976e-4f5a072f6d5c tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:26.825642 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d556ae10-ba7b-49a4-976e-4f5a072f6d5c tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:26.826095 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d556ae10-ba7b-49a4-976e-4f5a072f6d5c tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:26.839695 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b6612e88-4dc1-44da-899c-0fe3ced57ad1 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:26.859196 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b6612e88-4dc1-44da-899c-0fe3ced57ad1 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d" status: 200 len: 1313 microversion: 2.1 time: 1.006639 Sep 16 13:04:26.862034 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1963/3809] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:25 2022] GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d => generated 1313 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:27.045951 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-c2afa5dd-5311-43ab-95ba-2ed9a6fe6aee req-b07316e0-d910-4aad-aa51-3672536d10ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17bd55c8-4d10-424e-a143-037b14585d31", "name": "network-vif-deleted", "tag": "e7480e72-f883-4315-9905-ecaed73586e8"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:04:27.068829 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c2afa5dd-5311-43ab-95ba-2ed9a6fe6aee req-b07316e0-d910-4aad-aa51-3672536d10ed service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:27.071664 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c2afa5dd-5311-43ab-95ba-2ed9a6fe6aee req-b07316e0-d910-4aad-aa51-3672536d10ed service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:27.072249 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c2afa5dd-5311-43ab-95ba-2ed9a6fe6aee req-b07316e0-d910-4aad-aa51-3672536d10ed service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:27.086098 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-c2afa5dd-5311-43ab-95ba-2ed9a6fe6aee req-b07316e0-d910-4aad-aa51-3672536d10ed service nova] Creating event network-vif-deleted:e7480e72-f883-4315-9905-ecaed73586e8 for instance 17bd55c8-4d10-424e-a143-037b14585d31 on n-h2-858094-4 Sep 16 13:04:27.092692 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-c2afa5dd-5311-43ab-95ba-2ed9a6fe6aee req-b07316e0-d910-4aad-aa51-3672536d10ed service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052012 Sep 16 13:04:27.093824 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1964/3810] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:04:27.099277 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8d94f4ac-075a-47cf-9693-89276ce32978 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:27.100559 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8d94f4ac-075a-47cf-9693-89276ce32978 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:27.109234 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d94f4ac-075a-47cf-9693-89276ce32978 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:27.110053 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d94f4ac-075a-47cf-9693-89276ce32978 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:27.110724 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d94f4ac-075a-47cf-9693-89276ce32978 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:27.111657 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d94f4ac-075a-47cf-9693-89276ce32978 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:27.112367 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d94f4ac-075a-47cf-9693-89276ce32978 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:27.112997 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d94f4ac-075a-47cf-9693-89276ce32978 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:27.158562 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d556ae10-ba7b-49a4-976e-4f5a072f6d5c tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed69c96e39249f181eda742be229b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeff399942c4286a71ea3a0eab43280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:27.173386 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d556ae10-ba7b-49a4-976e-4f5a072f6d5c tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31" status: 200 len: 1468 microversion: 2.1 time: 0.384042 Sep 16 13:04:27.188167 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1847/3811] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:26 2022] GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31 => generated 1468 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:27.673195 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8d94f4ac-075a-47cf-9693-89276ce32978 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:27.695046 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8d94f4ac-075a-47cf-9693-89276ce32978 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:27.697655 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8d94f4ac-075a-47cf-9693-89276ce32978 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:27.699314 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8d94f4ac-075a-47cf-9693-89276ce32978 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1797 microversion: 2.20 time: 0.604152 Sep 16 13:04:27.729729 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1965/3812] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:04:27 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1797 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:04:27.891695 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ea595d9d-be29-403f-83df-05162f9955af tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:27.892718 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ea595d9d-be29-403f-83df-05162f9955af tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:27.903991 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ea595d9d-be29-403f-83df-05162f9955af tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:27.906469 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ea595d9d-be29-403f-83df-05162f9955af tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:27.907057 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ea595d9d-be29-403f-83df-05162f9955af tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:27.907908 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ea595d9d-be29-403f-83df-05162f9955af tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:27.916664 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ea595d9d-be29-403f-83df-05162f9955af tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:27.917341 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ea595d9d-be29-403f-83df-05162f9955af tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:28.198179 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-118029f4-8078-43e5-9824-780d8536fe2a tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:28.198860 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-118029f4-8078-43e5-9824-780d8536fe2a tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 17bd55c8-4d10-424e-a143-037b14585d31] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:28.207303 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-118029f4-8078-43e5-9824-780d8536fe2a tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:28.208083 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-118029f4-8078-43e5-9824-780d8536fe2a tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:28.208823 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-118029f4-8078-43e5-9824-780d8536fe2a tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:28.209741 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-118029f4-8078-43e5-9824-780d8536fe2a tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:28.210410 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-118029f4-8078-43e5-9824-780d8536fe2a tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:28.210938 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-118029f4-8078-43e5-9824-780d8536fe2a tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:28.226257 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-118029f4-8078-43e5-9824-780d8536fe2a tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] HTTP exception thrown: Instance 17bd55c8-4d10-424e-a143-037b14585d31 could not be found. Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-118029f4-8078-43e5-9824-780d8536fe2a tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Request method failure captured: Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31 HTTP/1.1 Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHP182fOoXAmmtyFT24t1WldG_-n_fUq_hYyF_kcX6BBuNdLFPJQpvv1Qbau8uBELlze_J0V8PSdv80EZFiSQVIXVTfCMdV7A-swstczuz_Ini1wPhpJqJ2_9Cvd9QLrJtnV-zdKbzeKde8qkyp_ruLhl8BqedA5EVFg3XozRh0MDPU Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: aaeff399942c4286a71ea3a0eab43280 Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_aaeff399942c4286a71ea3a0eab43280", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: aaeff399942c4286a71ea3a0eab43280 Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-SecurityGroupsTestJSON-210138271-project Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 8ed69c96e39249f181eda742be229b97 Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-SecurityGroupsTestJSON-210138271-project Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 17bd55c8-4d10-424e-a143-037b14585d31 could not be found. Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '17bd55c8-4d10-424e-a143-037b14585d31'} Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17bd55c8-4d10-424e-a143-037b14585d31 could not be found. Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17bd55c8-4d10-424e-a143-037b14585d31 could not be found. Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:28.228350 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:28.232299 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:28.232299 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:04:28.232299 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:04:28.232299 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:04:28.232299 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:04:28.232299 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17bd55c8-4d10-424e-a143-037b14585d31 could not be found. Sep 16 13:04:28.232299 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:28.234168 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-118029f4-8078-43e5-9824-780d8536fe2a tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Returning 404 to user: Instance 17bd55c8-4d10-424e-a143-037b14585d31 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:04:28.235554 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-118029f4-8078-43e5-9824-780d8536fe2a tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31" status: 404 len: 111 microversion: 2.1 time: 0.041333 Sep 16 13:04:28.236321 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1966/3813] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:28 2022] GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 13:04:28.248047 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-061fd86e-1483-4fb9-88e9-091393a8f4a9 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '.version_select at 0x7f1035225820>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:28.272991 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ea595d9d-be29-403f-83df-05162f9955af tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:28.282457 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ea595d9d-be29-403f-83df-05162f9955af tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d" status: 200 len: 1313 microversion: 2.1 time: 0.394685 Sep 16 13:04:28.283054 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1848/3814] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:27 2022] GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d => generated 1313 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:28.626242 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-061fd86e-1483-4fb9-88e9-091393a8f4a9 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/171162a5-7b15-4d9a-b046-5c75ef6c9ab9" status: 202 len: 0 microversion: 2.1 time: 0.384622 Sep 16 13:04:28.626895 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1967/3815] 10.222.0.67 () {58 vars in 1272 bytes} [Fri Sep 16 13:04:28 2022] DELETE /compute/v2.1/os-security-groups/171162a5-7b15-4d9a-b046-5c75ef6c9ab9 => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:04:28.639771 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e55f8164-80ec-4efa-9513-c621f43cdbc7 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '.version_select at 0x7f103571e0d0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:28.814786 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b17c11d9-96ae-4126-97b3-067c6669f799 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Action: 'create', calling method: .version_select at 0x7f1034915160>, body: {"keypair": {"name": "tempest-keypair-316883394", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCVoE8A3GMc+YANQJblvEN304LOpuV/TT0Uf75B0X615CEBtjPjxVfPEQ68klrJ/Jq/DkdSyWqfFbdZmMtdM9AB2IjnvIdZEtVwUn+uSEnkh6Q/e1txD/hEF/dwKCAV7DA=="}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:04:28.870145 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-b17c11d9-96ae-4126-97b3-067c6669f799 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Getting quotas for project d2628c648b2e4465821bdcdf4330fb4e. Resources: {'key_pairs'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:04:28.886805 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-b17c11d9-96ae-4126-97b3-067c6669f799 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Getting quotas for user 59081fb246d34546980d57493efae40b and project d2628c648b2e4465821bdcdf4330fb4e. Resources: {'key_pairs'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:04:28.955795 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b17c11d9-96ae-4126-97b3-067c6669f799 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.450946 Sep 16 13:04:28.956388 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1849/3816] 10.222.0.67 () {60 vars in 1159 bytes} [Fri Sep 16 13:04:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:04:29.311500 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-df2b00db-20d9-4e02-945e-e7478b9854e2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:29.312108 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-df2b00db-20d9-4e02-945e-e7478b9854e2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:29.326440 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-df2b00db-20d9-4e02-945e-e7478b9854e2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:29.327090 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-df2b00db-20d9-4e02-945e-e7478b9854e2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:29.331547 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-df2b00db-20d9-4e02-945e-e7478b9854e2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:29.332579 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-df2b00db-20d9-4e02-945e-e7478b9854e2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:29.333120 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-df2b00db-20d9-4e02-945e-e7478b9854e2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:29.333622 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-df2b00db-20d9-4e02-945e-e7478b9854e2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:29.545817 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e55f8164-80ec-4efa-9513-c621f43cdbc7 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/8ee7e4f8-3252-4678-a0b1-ce4987e5d9cb" status: 202 len: 0 microversion: 2.1 time: 0.913232 Sep 16 13:04:29.546446 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1968/3817] 10.222.0.67 () {58 vars in 1272 bytes} [Fri Sep 16 13:04:28 2022] DELETE /compute/v2.1/os-security-groups/8ee7e4f8-3252-4678-a0b1-ce4987e5d9cb => generated 0 bytes in 915 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:04:29.572397 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7212f1d4-0883-41ae-857d-22a626de840c tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Action: 'create', calling method: .version_select at 0x7f1034a7c550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-419534468", "description": "tempest-description-1588297197"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:04:29.686618 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-df2b00db-20d9-4e02-945e-e7478b9854e2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:29.702943 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-df2b00db-20d9-4e02-945e-e7478b9854e2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d" status: 200 len: 1500 microversion: 2.1 time: 0.399871 Sep 16 13:04:29.710665 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1850/3818] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:29 2022] GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d => generated 1500 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:29.727587 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-eb3ae656-74d9-48c9-a507-abd1dedacd74 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:04:29.740720 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eb3ae656-74d9-48c9-a507-abd1dedacd74 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:29.742204 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eb3ae656-74d9-48c9-a507-abd1dedacd74 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:29.742659 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-eb3ae656-74d9-48c9-a507-abd1dedacd74 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:29.795909 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-eb3ae656-74d9-48c9-a507-abd1dedacd74 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d] Going to try to stop instance {{(pid=128780) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 16 13:04:29.885288 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-eb3ae656-74d9-48c9-a507-abd1dedacd74 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "POST /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d/action" status: 202 len: 0 microversion: 2.1 time: 0.160277 Sep 16 13:04:29.901762 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1851/3819] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 13:04:29 2022] POST /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:04:29.917829 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2eb093a6-ab14-489a-b68c-64525bce818a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:29.918641 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-2eb093a6-ab14-489a-b68c-64525bce818a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:29.937334 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2eb093a6-ab14-489a-b68c-64525bce818a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:29.939692 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2eb093a6-ab14-489a-b68c-64525bce818a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:29.940370 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2eb093a6-ab14-489a-b68c-64525bce818a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:29.942547 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2eb093a6-ab14-489a-b68c-64525bce818a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:29.944095 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2eb093a6-ab14-489a-b68c-64525bce818a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:29.945295 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2eb093a6-ab14-489a-b68c-64525bce818a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:30.082666 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7212f1d4-0883-41ae-857d-22a626de840c tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.526614 Sep 16 13:04:30.083442 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1969/3820] 10.222.0.67 () {60 vars in 1180 bytes} [Fri Sep 16 13:04:29 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:04:30.097831 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cf62f4ae-3b3e-4001-bff8-ea13aad7c9e1 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Action: 'update', calling method: .version_select at 0x7f103541a160>, body: {"security_group": {"name": "tempest-sg-hth-1788301851", "description": "tempest-description-hth-525605564"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:04:30.497837 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-2eb093a6-ab14-489a-b68c-64525bce818a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:30.509554 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2eb093a6-ab14-489a-b68c-64525bce818a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d" status: 200 len: 1510 microversion: 2.1 time: 0.604886 Sep 16 13:04:30.512945 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1852/3821] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:29 2022] GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d => generated 1510 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:04:30.700086 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cf62f4ae-3b3e-4001-bff8-ea13aad7c9e1 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "PUT /compute/v2.1/os-security-groups/b7d8b16b-1d24-411e-ac7a-b75d70ea3878" status: 200 len: 217 microversion: 2.1 time: 0.606480 Sep 16 13:04:30.702831 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1970/3822] 10.222.0.67 () {60 vars in 1290 bytes} [Fri Sep 16 13:04:30 2022] PUT /compute/v2.1/os-security-groups/b7d8b16b-1d24-411e-ac7a-b75d70ea3878 => generated 217 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:04:30.717040 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-dd003d43-4462-4683-bc18-919c0af2e510 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '.version_select at 0x7f10349b6280>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:30.862073 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-dd003d43-4462-4683-bc18-919c0af2e510 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/os-security-groups/b7d8b16b-1d24-411e-ac7a-b75d70ea3878" status: 200 len: 217 microversion: 2.1 time: 0.149429 Sep 16 13:04:30.862774 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1853/3823] 10.222.0.67 () {58 vars in 1269 bytes} [Fri Sep 16 13:04:30 2022] GET /compute/v2.1/os-security-groups/b7d8b16b-1d24-411e-ac7a-b75d70ea3878 => generated 217 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:04:30.890214 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d0139e64-fe00-4bfa-b63c-f38e2fc898e1 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '.version_select at 0x7f10355a9ca0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:31.537534 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a65d0c24-d557-44be-91d4-e118220b4498 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:31.538161 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a65d0c24-d557-44be-91d4-e118220b4498 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:31.544567 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a65d0c24-d557-44be-91d4-e118220b4498 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:31.544935 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a65d0c24-d557-44be-91d4-e118220b4498 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:31.545691 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a65d0c24-d557-44be-91d4-e118220b4498 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:31.547014 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a65d0c24-d557-44be-91d4-e118220b4498 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:31.547634 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a65d0c24-d557-44be-91d4-e118220b4498 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:31.548065 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a65d0c24-d557-44be-91d4-e118220b4498 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:31.608365 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d0139e64-fe00-4bfa-b63c-f38e2fc898e1 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/b7d8b16b-1d24-411e-ac7a-b75d70ea3878" status: 202 len: 0 microversion: 2.1 time: 0.732468 Sep 16 13:04:31.611003 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1971/3824] 10.222.0.67 () {58 vars in 1272 bytes} [Fri Sep 16 13:04:30 2022] DELETE /compute/v2.1/os-security-groups/b7d8b16b-1d24-411e-ac7a-b75d70ea3878 => generated 0 bytes in 738 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:04:31.623776 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a630fc93-6a0d-442b-8c36-9fdbe30db4b3 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:31.624333 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a630fc93-6a0d-442b-8c36-9fdbe30db4b3 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 17bd55c8-4d10-424e-a143-037b14585d31] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:31.640699 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a630fc93-6a0d-442b-8c36-9fdbe30db4b3 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:31.641716 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a630fc93-6a0d-442b-8c36-9fdbe30db4b3 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:31.642338 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a630fc93-6a0d-442b-8c36-9fdbe30db4b3 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:31.643218 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a630fc93-6a0d-442b-8c36-9fdbe30db4b3 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:31.643882 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a630fc93-6a0d-442b-8c36-9fdbe30db4b3 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:31.644535 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a630fc93-6a0d-442b-8c36-9fdbe30db4b3 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:31.700696 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-a630fc93-6a0d-442b-8c36-9fdbe30db4b3 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] HTTP exception thrown: Instance 17bd55c8-4d10-424e-a143-037b14585d31 could not be found. Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a630fc93-6a0d-442b-8c36-9fdbe30db4b3 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Request method failure captured: Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31 HTTP/1.1 Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHP182fOoXAmmtyFT24t1WldG_-n_fUq_hYyF_kcX6BBuNdLFPJQpvv1Qbau8uBELlze_J0V8PSdv80EZFiSQVIXVTfCMdV7A-swstczuz_Ini1wPhpJqJ2_9Cvd9QLrJtnV-zdKbzeKde8qkyp_ruLhl8BqedA5EVFg3XozRh0MDPU Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: aaeff399942c4286a71ea3a0eab43280 Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_aaeff399942c4286a71ea3a0eab43280", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: aaeff399942c4286a71ea3a0eab43280 Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-SecurityGroupsTestJSON-210138271-project Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 8ed69c96e39249f181eda742be229b97 Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-SecurityGroupsTestJSON-210138271-project Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 17bd55c8-4d10-424e-a143-037b14585d31 could not be found. Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '17bd55c8-4d10-424e-a143-037b14585d31'} Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17bd55c8-4d10-424e-a143-037b14585d31 could not be found. Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:04:31.706898 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:04:31.711165 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17bd55c8-4d10-424e-a143-037b14585d31 could not be found. Sep 16 13:04:31.711165 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:31.711165 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:31.711165 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:31.711165 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:31.711165 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:04:31.711165 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:04:31.711165 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:04:31.711165 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:04:31.711165 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17bd55c8-4d10-424e-a143-037b14585d31 could not be found. Sep 16 13:04:31.711165 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:31.730393 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a630fc93-6a0d-442b-8c36-9fdbe30db4b3 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Returning 404 to user: Instance 17bd55c8-4d10-424e-a143-037b14585d31 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:04:31.731564 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a630fc93-6a0d-442b-8c36-9fdbe30db4b3 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "DELETE /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31" status: 404 len: 111 microversion: 2.1 time: 0.115991 Sep 16 13:04:31.736892 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1972/3825] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 13:04:31 2022] DELETE /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:04:31.743570 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-18e7b508-e809-4966-8750-0ca0e44e2f27 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:31.745045 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-18e7b508-e809-4966-8750-0ca0e44e2f27 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 17bd55c8-4d10-424e-a143-037b14585d31] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:31.756478 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18e7b508-e809-4966-8750-0ca0e44e2f27 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:31.757393 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18e7b508-e809-4966-8750-0ca0e44e2f27 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:31.757977 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18e7b508-e809-4966-8750-0ca0e44e2f27 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:31.759836 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18e7b508-e809-4966-8750-0ca0e44e2f27 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:31.761321 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18e7b508-e809-4966-8750-0ca0e44e2f27 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:31.762111 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18e7b508-e809-4966-8750-0ca0e44e2f27 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:31.823773 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-18e7b508-e809-4966-8750-0ca0e44e2f27 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] HTTP exception thrown: Instance 17bd55c8-4d10-424e-a143-037b14585d31 could not be found. Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-18e7b508-e809-4966-8750-0ca0e44e2f27 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Request method failure captured: Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31 HTTP/1.1 Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHP182fOoXAmmtyFT24t1WldG_-n_fUq_hYyF_kcX6BBuNdLFPJQpvv1Qbau8uBELlze_J0V8PSdv80EZFiSQVIXVTfCMdV7A-swstczuz_Ini1wPhpJqJ2_9Cvd9QLrJtnV-zdKbzeKde8qkyp_ruLhl8BqedA5EVFg3XozRh0MDPU Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: aaeff399942c4286a71ea3a0eab43280 Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_aaeff399942c4286a71ea3a0eab43280", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: aaeff399942c4286a71ea3a0eab43280 Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-SecurityGroupsTestJSON-210138271-project Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 8ed69c96e39249f181eda742be229b97 Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-SecurityGroupsTestJSON-210138271-project Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 17bd55c8-4d10-424e-a143-037b14585d31 could not be found. Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '17bd55c8-4d10-424e-a143-037b14585d31'} Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17bd55c8-4d10-424e-a143-037b14585d31 could not be found. Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17bd55c8-4d10-424e-a143-037b14585d31 could not be found. Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:31.827704 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:31.831835 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:31.831835 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:04:31.831835 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:04:31.831835 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:04:31.831835 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:04:31.831835 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17bd55c8-4d10-424e-a143-037b14585d31 could not be found. Sep 16 13:04:31.831835 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:31.831835 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-18e7b508-e809-4966-8750-0ca0e44e2f27 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Returning 404 to user: Instance 17bd55c8-4d10-424e-a143-037b14585d31 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:04:31.835329 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-18e7b508-e809-4966-8750-0ca0e44e2f27 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31" status: 404 len: 111 microversion: 2.1 time: 0.096992 Sep 16 13:04:31.848456 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1973/3826] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:31 2022] GET /compute/v2.1/servers/17bd55c8-4d10-424e-a143-037b14585d31 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:04:31.858464 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3bd1c9e7-324b-47ca-92da-064cf1d0137f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '.version_select at 0x7f103529a1f0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:32.009372 n-d-858094-4 devstack@n-api.service[128779]: DEBUG neutronclient.v2_0.client [None req-3bd1c9e7-324b-47ca-92da-064cf1d0137f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8ee7e4f8-3252-4678-a0b1-ce4987e5d9cb does not exist", "detail": ""}} {{(pid=128779) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 13:04:32.011034 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.security_group_api [None req-3bd1c9e7-324b-47ca-92da-064cf1d0137f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Neutron security group 8ee7e4f8-3252-4678-a0b1-ce4987e5d9cb not found {{(pid=128779) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 16 13:04:32.012112 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-3bd1c9e7-324b-47ca-92da-064cf1d0137f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] HTTP exception thrown: Security group 8ee7e4f8-3252-4678-a0b1-ce4987e5d9cb does not exist Sep 16 13:04:32.012112 n-d-858094-4 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-3673b3c8-fd38-4b6d-aec4-bf2bce347b53'] Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3bd1c9e7-324b-47ca-92da-064cf1d0137f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Request method failure captured: Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/os-security-groups/8ee7e4f8-3252-4678-a0b1-ce4987e5d9cb HTTP/1.1 Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHP182fOoXAmmtyFT24t1WldG_-n_fUq_hYyF_kcX6BBuNdLFPJQpvv1Qbau8uBELlze_J0V8PSdv80EZFiSQVIXVTfCMdV7A-swstczuz_Ini1wPhpJqJ2_9Cvd9QLrJtnV-zdKbzeKde8qkyp_ruLhl8BqedA5EVFg3XozRh0MDPU Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: aaeff399942c4286a71ea3a0eab43280 Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_aaeff399942c4286a71ea3a0eab43280", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: aaeff399942c4286a71ea3a0eab43280 Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-SecurityGroupsTestJSON-210138271-project Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 8ed69c96e39249f181eda742be229b97 Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-SecurityGroupsTestJSON-210138271-project Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: exception: Security group 8ee7e4f8-3252-4678-a0b1-ce4987e5d9cb does not exist Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-3673b3c8-fd38-4b6d-aec4-bf2bce347b53'] Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '8ee7e4f8-3252-4678-a0b1-ce4987e5d9cb'} Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 13:04:32.014618 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8ee7e4f8-3252-4678-a0b1-ce4987e5d9cb does not exist Sep 16 13:04:32.018483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3673b3c8-fd38-4b6d-aec4-bf2bce347b53'] Sep 16 13:04:32.018483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:32.018483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:32.018483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:32.018483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:32.018483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 16 13:04:32.018483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 16 13:04:32.018483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 16 13:04:32.018483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 16 13:04:32.018483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8ee7e4f8-3252-4678-a0b1-ce4987e5d9cb does not exist Sep 16 13:04:32.018483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3673b3c8-fd38-4b6d-aec4-bf2bce347b53'] Sep 16 13:04:32.018483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:32.018483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:32.018483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:32.018483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:32.018483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:04:32.018483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:04:32.018483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:04:32.018483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:04:32.018483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:04:32.018483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:04:32.018483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:04:32.018483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:04:32.018483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 16 13:04:32.018483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 16 13:04:32.018483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8ee7e4f8-3252-4678-a0b1-ce4987e5d9cb does not exist Sep 16 13:04:32.018483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3673b3c8-fd38-4b6d-aec4-bf2bce347b53'] Sep 16 13:04:32.018483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:32.018483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:32.018483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:32.018483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:32.018483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:04:32.018483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:04:32.018483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:04:32.018483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:04:32.018483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8ee7e4f8-3252-4678-a0b1-ce4987e5d9cb does not exist Sep 16 13:04:32.018483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3673b3c8-fd38-4b6d-aec4-bf2bce347b53'] Sep 16 13:04:32.018483 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:32.021995 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3bd1c9e7-324b-47ca-92da-064cf1d0137f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Returning 404 to user: Security group 8ee7e4f8-3252-4678-a0b1-ce4987e5d9cb does not exist Sep 16 13:04:32.021995 n-d-858094-4 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-3673b3c8-fd38-4b6d-aec4-bf2bce347b53'] {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:04:32.023257 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3bd1c9e7-324b-47ca-92da-064cf1d0137f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/8ee7e4f8-3252-4678-a0b1-ce4987e5d9cb" status: 404 len: 194 microversion: 2.1 time: 0.173436 Sep 16 13:04:32.028720 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1974/3827] 10.222.0.67 () {58 vars in 1272 bytes} [Fri Sep 16 13:04:31 2022] DELETE /compute/v2.1/os-security-groups/8ee7e4f8-3252-4678-a0b1-ce4987e5d9cb => generated 194 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:04:32.034327 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-88f386d0-afe5-41fa-b946-81dc09fc64f8 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '.version_select at 0x7f1035681820>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:32.210069 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a65d0c24-d557-44be-91d4-e118220b4498 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:32.218961 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a65d0c24-d557-44be-91d4-e118220b4498 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d" status: 200 len: 1510 microversion: 2.1 time: 0.686433 Sep 16 13:04:32.220082 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1854/3828] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:31 2022] GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d => generated 1510 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:32.231622 n-d-858094-4 devstack@n-api.service[128779]: DEBUG neutronclient.v2_0.client [None req-88f386d0-afe5-41fa-b946-81dc09fc64f8 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 171162a5-7b15-4d9a-b046-5c75ef6c9ab9 does not exist", "detail": ""}} {{(pid=128779) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 13:04:32.233624 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.security_group_api [None req-88f386d0-afe5-41fa-b946-81dc09fc64f8 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Neutron security group 171162a5-7b15-4d9a-b046-5c75ef6c9ab9 not found {{(pid=128779) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 16 13:04:32.234314 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-88f386d0-afe5-41fa-b946-81dc09fc64f8 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] HTTP exception thrown: Security group 171162a5-7b15-4d9a-b046-5c75ef6c9ab9 does not exist Sep 16 13:04:32.234314 n-d-858094-4 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-ca49f69e-21ed-4321-8baf-b66828aaa80a'] Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-88f386d0-afe5-41fa-b946-81dc09fc64f8 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Request method failure captured: Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/os-security-groups/171162a5-7b15-4d9a-b046-5c75ef6c9ab9 HTTP/1.1 Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHP182fOoXAmmtyFT24t1WldG_-n_fUq_hYyF_kcX6BBuNdLFPJQpvv1Qbau8uBELlze_J0V8PSdv80EZFiSQVIXVTfCMdV7A-swstczuz_Ini1wPhpJqJ2_9Cvd9QLrJtnV-zdKbzeKde8qkyp_ruLhl8BqedA5EVFg3XozRh0MDPU Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: aaeff399942c4286a71ea3a0eab43280 Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_aaeff399942c4286a71ea3a0eab43280", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: aaeff399942c4286a71ea3a0eab43280 Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-SecurityGroupsTestJSON-210138271-project Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 8ed69c96e39249f181eda742be229b97 Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-SecurityGroupsTestJSON-210138271-project Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: exception: Security group 171162a5-7b15-4d9a-b046-5c75ef6c9ab9 does not exist Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-ca49f69e-21ed-4321-8baf-b66828aaa80a'] Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '171162a5-7b15-4d9a-b046-5c75ef6c9ab9'} Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 13:04:32.236527 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 171162a5-7b15-4d9a-b046-5c75ef6c9ab9 does not exist Sep 16 13:04:32.240042 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca49f69e-21ed-4321-8baf-b66828aaa80a'] Sep 16 13:04:32.240042 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:32.240042 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:32.240042 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:32.240042 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:32.240042 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 16 13:04:32.240042 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 16 13:04:32.240042 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 16 13:04:32.240042 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 16 13:04:32.240042 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 171162a5-7b15-4d9a-b046-5c75ef6c9ab9 does not exist Sep 16 13:04:32.240042 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca49f69e-21ed-4321-8baf-b66828aaa80a'] Sep 16 13:04:32.240042 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:32.240042 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:32.240042 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:32.240042 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:32.240042 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:04:32.240042 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:04:32.240042 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:04:32.240042 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:04:32.240042 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:04:32.240042 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:04:32.240042 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:04:32.240042 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:04:32.240042 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 16 13:04:32.240042 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 16 13:04:32.240042 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 171162a5-7b15-4d9a-b046-5c75ef6c9ab9 does not exist Sep 16 13:04:32.240042 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca49f69e-21ed-4321-8baf-b66828aaa80a'] Sep 16 13:04:32.240042 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:32.240042 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:32.240042 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:32.240042 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:32.240042 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:04:32.240042 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:04:32.240042 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:04:32.240042 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:04:32.240042 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 171162a5-7b15-4d9a-b046-5c75ef6c9ab9 does not exist Sep 16 13:04:32.240042 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca49f69e-21ed-4321-8baf-b66828aaa80a'] Sep 16 13:04:32.240042 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:32.244451 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-88f386d0-afe5-41fa-b946-81dc09fc64f8 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Returning 404 to user: Security group 171162a5-7b15-4d9a-b046-5c75ef6c9ab9 does not exist Sep 16 13:04:32.244451 n-d-858094-4 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-ca49f69e-21ed-4321-8baf-b66828aaa80a'] {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:04:32.245967 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-88f386d0-afe5-41fa-b946-81dc09fc64f8 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/171162a5-7b15-4d9a-b046-5c75ef6c9ab9" status: 404 len: 194 microversion: 2.1 time: 0.215923 Sep 16 13:04:32.246922 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1975/3829] 10.222.0.67 () {58 vars in 1272 bytes} [Fri Sep 16 13:04:32 2022] DELETE /compute/v2.1/os-security-groups/171162a5-7b15-4d9a-b046-5c75ef6c9ab9 => generated 194 bytes in 217 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:04:32.257855 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d39b0a36-fbe6-4b31-8e5a-a48a4f2f3114 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '.version_select at 0x7f1034915ee0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:32.825811 n-d-858094-4 devstack@n-api.service[128780]: DEBUG neutronclient.v2_0.client [None req-d39b0a36-fbe6-4b31-8e5a-a48a4f2f3114 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 36d20921-59f1-4f72-b163-c875dfa04ed8 does not exist", "detail": ""}} {{(pid=128780) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 13:04:32.826562 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.security_group_api [None req-d39b0a36-fbe6-4b31-8e5a-a48a4f2f3114 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Neutron security group 36d20921-59f1-4f72-b163-c875dfa04ed8 not found {{(pid=128780) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 16 13:04:32.827210 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-d39b0a36-fbe6-4b31-8e5a-a48a4f2f3114 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] HTTP exception thrown: Security group 36d20921-59f1-4f72-b163-c875dfa04ed8 does not exist Sep 16 13:04:32.827210 n-d-858094-4 devstack@n-api.service[128780]: Neutron server returns request_ids: ['req-5305e443-5d58-4401-8e9a-92f097b4e8b7'] Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d39b0a36-fbe6-4b31-8e5a-a48a4f2f3114 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Request method failure captured: Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: request: DELETE /compute/v2.1/os-security-groups/36d20921-59f1-4f72-b163-c875dfa04ed8 HTTP/1.1 Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHP182fOoXAmmtyFT24t1WldG_-n_fUq_hYyF_kcX6BBuNdLFPJQpvv1Qbau8uBELlze_J0V8PSdv80EZFiSQVIXVTfCMdV7A-swstczuz_Ini1wPhpJqJ2_9Cvd9QLrJtnV-zdKbzeKde8qkyp_ruLhl8BqedA5EVFg3XozRh0MDPU Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: aaeff399942c4286a71ea3a0eab43280 Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_aaeff399942c4286a71ea3a0eab43280", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: aaeff399942c4286a71ea3a0eab43280 Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-SecurityGroupsTestJSON-210138271-project Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 8ed69c96e39249f181eda742be229b97 Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-SecurityGroupsTestJSON-210138271-project Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: exception: Security group 36d20921-59f1-4f72-b163-c875dfa04ed8 does not exist Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: Neutron server returns request_ids: ['req-5305e443-5d58-4401-8e9a-92f097b4e8b7'] Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '36d20921-59f1-4f72-b163-c875dfa04ed8'} Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 13:04:32.829471 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 36d20921-59f1-4f72-b163-c875dfa04ed8 does not exist Sep 16 13:04:32.833229 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5305e443-5d58-4401-8e9a-92f097b4e8b7'] Sep 16 13:04:32.833229 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:04:32.833229 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:32.833229 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:04:32.833229 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:32.833229 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 16 13:04:32.833229 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 16 13:04:32.833229 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 16 13:04:32.833229 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 16 13:04:32.833229 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 36d20921-59f1-4f72-b163-c875dfa04ed8 does not exist Sep 16 13:04:32.833229 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5305e443-5d58-4401-8e9a-92f097b4e8b7'] Sep 16 13:04:32.833229 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:04:32.833229 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:32.833229 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:04:32.833229 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:32.833229 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:04:32.833229 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:04:32.833229 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:04:32.833229 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:04:32.833229 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:04:32.833229 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:04:32.833229 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:04:32.833229 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:04:32.833229 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 16 13:04:32.833229 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 16 13:04:32.833229 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 36d20921-59f1-4f72-b163-c875dfa04ed8 does not exist Sep 16 13:04:32.833229 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5305e443-5d58-4401-8e9a-92f097b4e8b7'] Sep 16 13:04:32.833229 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:04:32.833229 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:32.833229 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:04:32.833229 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:32.833229 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:04:32.833229 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:04:32.833229 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:04:32.833229 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:04:32.833229 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 36d20921-59f1-4f72-b163-c875dfa04ed8 does not exist Sep 16 13:04:32.833229 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5305e443-5d58-4401-8e9a-92f097b4e8b7'] Sep 16 13:04:32.833229 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:04:32.836916 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d39b0a36-fbe6-4b31-8e5a-a48a4f2f3114 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Returning 404 to user: Security group 36d20921-59f1-4f72-b163-c875dfa04ed8 does not exist Sep 16 13:04:32.836916 n-d-858094-4 devstack@n-api.service[128780]: Neutron server returns request_ids: ['req-5305e443-5d58-4401-8e9a-92f097b4e8b7'] {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:04:32.836916 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d39b0a36-fbe6-4b31-8e5a-a48a4f2f3114 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/36d20921-59f1-4f72-b163-c875dfa04ed8" status: 404 len: 194 microversion: 2.1 time: 0.583041 Sep 16 13:04:32.838770 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1855/3830] 10.222.0.67 () {58 vars in 1272 bytes} [Fri Sep 16 13:04:32 2022] DELETE /compute/v2.1/os-security-groups/36d20921-59f1-4f72-b163-c875dfa04ed8 => generated 194 bytes in 587 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:04:32.847042 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-462b19e0-0c1a-4bbc-a9fb-edb850062674 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '.version_select at 0x7f1034a7c550>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:32.990282 n-d-858094-4 devstack@n-api.service[128779]: DEBUG neutronclient.v2_0.client [None req-462b19e0-0c1a-4bbc-a9fb-edb850062674 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 54fc3599-fdb8-4090-bf2c-a856093a34d5 does not exist", "detail": ""}} {{(pid=128779) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 13:04:32.990878 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.security_group_api [None req-462b19e0-0c1a-4bbc-a9fb-edb850062674 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Neutron security group 54fc3599-fdb8-4090-bf2c-a856093a34d5 not found {{(pid=128779) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 16 13:04:32.991389 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-462b19e0-0c1a-4bbc-a9fb-edb850062674 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] HTTP exception thrown: Security group 54fc3599-fdb8-4090-bf2c-a856093a34d5 does not exist Sep 16 13:04:32.991389 n-d-858094-4 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-97c1d580-aa52-40dd-a668-a569c6205ae9'] Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-462b19e0-0c1a-4bbc-a9fb-edb850062674 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Request method failure captured: Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/os-security-groups/54fc3599-fdb8-4090-bf2c-a856093a34d5 HTTP/1.1 Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHP182fOoXAmmtyFT24t1WldG_-n_fUq_hYyF_kcX6BBuNdLFPJQpvv1Qbau8uBELlze_J0V8PSdv80EZFiSQVIXVTfCMdV7A-swstczuz_Ini1wPhpJqJ2_9Cvd9QLrJtnV-zdKbzeKde8qkyp_ruLhl8BqedA5EVFg3XozRh0MDPU Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: aaeff399942c4286a71ea3a0eab43280 Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_aaeff399942c4286a71ea3a0eab43280", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: aaeff399942c4286a71ea3a0eab43280 Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-SecurityGroupsTestJSON-210138271-project Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 8ed69c96e39249f181eda742be229b97 Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-SecurityGroupsTestJSON-210138271-project Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: exception: Security group 54fc3599-fdb8-4090-bf2c-a856093a34d5 does not exist Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-97c1d580-aa52-40dd-a668-a569c6205ae9'] Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '54fc3599-fdb8-4090-bf2c-a856093a34d5'} Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 13:04:32.994927 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 54fc3599-fdb8-4090-bf2c-a856093a34d5 does not exist Sep 16 13:04:32.998758 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97c1d580-aa52-40dd-a668-a569c6205ae9'] Sep 16 13:04:32.998758 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:32.998758 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:32.998758 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:32.998758 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:32.998758 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 16 13:04:32.998758 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 16 13:04:32.998758 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 16 13:04:32.998758 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 16 13:04:32.998758 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 54fc3599-fdb8-4090-bf2c-a856093a34d5 does not exist Sep 16 13:04:32.998758 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97c1d580-aa52-40dd-a668-a569c6205ae9'] Sep 16 13:04:32.998758 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:32.998758 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:32.998758 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:32.998758 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:32.998758 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:04:32.998758 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:04:32.998758 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:04:32.998758 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:04:32.998758 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:04:32.998758 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:04:32.998758 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:04:32.998758 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:04:32.998758 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 16 13:04:32.998758 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 16 13:04:32.998758 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 54fc3599-fdb8-4090-bf2c-a856093a34d5 does not exist Sep 16 13:04:32.998758 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97c1d580-aa52-40dd-a668-a569c6205ae9'] Sep 16 13:04:32.998758 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:32.998758 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:32.998758 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:32.998758 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:32.998758 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:04:32.998758 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:04:32.998758 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:04:32.998758 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:04:32.998758 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 54fc3599-fdb8-4090-bf2c-a856093a34d5 does not exist Sep 16 13:04:32.998758 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97c1d580-aa52-40dd-a668-a569c6205ae9'] Sep 16 13:04:32.998758 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:33.002097 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-462b19e0-0c1a-4bbc-a9fb-edb850062674 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Returning 404 to user: Security group 54fc3599-fdb8-4090-bf2c-a856093a34d5 does not exist Sep 16 13:04:33.002097 n-d-858094-4 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-97c1d580-aa52-40dd-a668-a569c6205ae9'] {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:04:33.003184 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-462b19e0-0c1a-4bbc-a9fb-edb850062674 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/54fc3599-fdb8-4090-bf2c-a856093a34d5" status: 404 len: 194 microversion: 2.1 time: 0.160541 Sep 16 13:04:33.006768 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1976/3831] 10.222.0.67 () {58 vars in 1272 bytes} [Fri Sep 16 13:04:32 2022] DELETE /compute/v2.1/os-security-groups/54fc3599-fdb8-4090-bf2c-a856093a34d5 => generated 194 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:04:33.012050 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9f8c6bc0-de18-4b86-908b-97710ab1c6fe tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '.version_select at 0x7f103490f1f0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:33.132366 n-d-858094-4 devstack@n-api.service[128780]: DEBUG neutronclient.v2_0.client [None req-9f8c6bc0-de18-4b86-908b-97710ab1c6fe tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9d6728b4-995a-4db4-aae5-d8373ab678f5 does not exist", "detail": ""}} {{(pid=128780) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 13:04:33.141807 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.security_group_api [None req-9f8c6bc0-de18-4b86-908b-97710ab1c6fe tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Neutron security group 9d6728b4-995a-4db4-aae5-d8373ab678f5 not found {{(pid=128780) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 16 13:04:33.142867 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-9f8c6bc0-de18-4b86-908b-97710ab1c6fe tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] HTTP exception thrown: Security group 9d6728b4-995a-4db4-aae5-d8373ab678f5 does not exist Sep 16 13:04:33.142867 n-d-858094-4 devstack@n-api.service[128780]: Neutron server returns request_ids: ['req-f6d383b3-77e9-42c3-a19e-126230b93625'] Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9f8c6bc0-de18-4b86-908b-97710ab1c6fe tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Request method failure captured: Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: request: DELETE /compute/v2.1/os-security-groups/9d6728b4-995a-4db4-aae5-d8373ab678f5 HTTP/1.1 Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHP182fOoXAmmtyFT24t1WldG_-n_fUq_hYyF_kcX6BBuNdLFPJQpvv1Qbau8uBELlze_J0V8PSdv80EZFiSQVIXVTfCMdV7A-swstczuz_Ini1wPhpJqJ2_9Cvd9QLrJtnV-zdKbzeKde8qkyp_ruLhl8BqedA5EVFg3XozRh0MDPU Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: aaeff399942c4286a71ea3a0eab43280 Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_aaeff399942c4286a71ea3a0eab43280", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: aaeff399942c4286a71ea3a0eab43280 Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-SecurityGroupsTestJSON-210138271-project Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 8ed69c96e39249f181eda742be229b97 Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-SecurityGroupsTestJSON-210138271-project Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: method: Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: exception: Security group 9d6728b4-995a-4db4-aae5-d8373ab678f5 does not exist Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: Neutron server returns request_ids: ['req-f6d383b3-77e9-42c3-a19e-126230b93625'] Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '9d6728b4-995a-4db4-aae5-d8373ab678f5'} Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 13:04:33.145151 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9d6728b4-995a-4db4-aae5-d8373ab678f5 does not exist Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f6d383b3-77e9-42c3-a19e-126230b93625'] Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9d6728b4-995a-4db4-aae5-d8373ab678f5 does not exist Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f6d383b3-77e9-42c3-a19e-126230b93625'] Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9d6728b4-995a-4db4-aae5-d8373ab678f5 does not exist Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f6d383b3-77e9-42c3-a19e-126230b93625'] Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9d6728b4-995a-4db4-aae5-d8373ab678f5 does not exist Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f6d383b3-77e9-42c3-a19e-126230b93625'] Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9f8c6bc0-de18-4b86-908b-97710ab1c6fe tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Returning 404 to user: Security group 9d6728b4-995a-4db4-aae5-d8373ab678f5 does not exist Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: Neutron server returns request_ids: ['req-f6d383b3-77e9-42c3-a19e-126230b93625'] {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9f8c6bc0-de18-4b86-908b-97710ab1c6fe tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/9d6728b4-995a-4db4-aae5-d8373ab678f5" status: 404 len: 194 microversion: 2.1 time: 0.139265 Sep 16 13:04:33.149059 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1856/3832] 10.222.0.67 () {58 vars in 1272 bytes} [Fri Sep 16 13:04:33 2022] DELETE /compute/v2.1/os-security-groups/9d6728b4-995a-4db4-aae5-d8373ab678f5 => generated 194 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:04:33.157347 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-15f76efb-9b2a-4b73-b167-5e8679bf0545 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '.version_select at 0x7f1035186700>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:33.241570 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-387a1da2-9732-452e-b852-d54fed67b3f6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:33.242536 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-387a1da2-9732-452e-b852-d54fed67b3f6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:33.253743 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-387a1da2-9732-452e-b852-d54fed67b3f6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:33.255680 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-387a1da2-9732-452e-b852-d54fed67b3f6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:33.256441 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-387a1da2-9732-452e-b852-d54fed67b3f6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:33.259153 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-387a1da2-9732-452e-b852-d54fed67b3f6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:33.259892 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-387a1da2-9732-452e-b852-d54fed67b3f6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:33.261237 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-387a1da2-9732-452e-b852-d54fed67b3f6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:33.272593 n-d-858094-4 devstack@n-api.service[128779]: DEBUG neutronclient.v2_0.client [None req-15f76efb-9b2a-4b73-b167-5e8679bf0545 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 89246358-e52b-4a18-89dd-8ef81780d9b9 does not exist", "detail": ""}} {{(pid=128779) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 13:04:33.273442 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.security_group_api [None req-15f76efb-9b2a-4b73-b167-5e8679bf0545 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Neutron security group 89246358-e52b-4a18-89dd-8ef81780d9b9 not found {{(pid=128779) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 16 13:04:33.276751 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-15f76efb-9b2a-4b73-b167-5e8679bf0545 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] HTTP exception thrown: Security group 89246358-e52b-4a18-89dd-8ef81780d9b9 does not exist Sep 16 13:04:33.276751 n-d-858094-4 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-cfc8a42a-95e3-4861-b3ce-b83fdc878850'] Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-15f76efb-9b2a-4b73-b167-5e8679bf0545 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Request method failure captured: Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/os-security-groups/89246358-e52b-4a18-89dd-8ef81780d9b9 HTTP/1.1 Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHP182fOoXAmmtyFT24t1WldG_-n_fUq_hYyF_kcX6BBuNdLFPJQpvv1Qbau8uBELlze_J0V8PSdv80EZFiSQVIXVTfCMdV7A-swstczuz_Ini1wPhpJqJ2_9Cvd9QLrJtnV-zdKbzeKde8qkyp_ruLhl8BqedA5EVFg3XozRh0MDPU Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: aaeff399942c4286a71ea3a0eab43280 Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_aaeff399942c4286a71ea3a0eab43280", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: aaeff399942c4286a71ea3a0eab43280 Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-SecurityGroupsTestJSON-210138271-project Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 8ed69c96e39249f181eda742be229b97 Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-SecurityGroupsTestJSON-210138271-project Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: method: Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: exception: Security group 89246358-e52b-4a18-89dd-8ef81780d9b9 does not exist Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-cfc8a42a-95e3-4861-b3ce-b83fdc878850'] Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '89246358-e52b-4a18-89dd-8ef81780d9b9'} Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 13:04:33.278954 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 89246358-e52b-4a18-89dd-8ef81780d9b9 does not exist Sep 16 13:04:33.282625 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cfc8a42a-95e3-4861-b3ce-b83fdc878850'] Sep 16 13:04:33.282625 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:33.282625 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:33.282625 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:33.282625 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:33.282625 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 16 13:04:33.282625 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 16 13:04:33.282625 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 16 13:04:33.282625 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 16 13:04:33.282625 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 89246358-e52b-4a18-89dd-8ef81780d9b9 does not exist Sep 16 13:04:33.282625 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cfc8a42a-95e3-4861-b3ce-b83fdc878850'] Sep 16 13:04:33.282625 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:33.282625 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:33.282625 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:33.282625 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:33.282625 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:04:33.282625 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:04:33.282625 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:04:33.282625 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:04:33.282625 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:04:33.282625 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:04:33.282625 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:04:33.282625 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:04:33.282625 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 16 13:04:33.282625 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 16 13:04:33.282625 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 89246358-e52b-4a18-89dd-8ef81780d9b9 does not exist Sep 16 13:04:33.282625 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cfc8a42a-95e3-4861-b3ce-b83fdc878850'] Sep 16 13:04:33.282625 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:33.282625 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:33.282625 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:33.282625 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:33.282625 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:04:33.282625 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:04:33.282625 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:04:33.282625 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:04:33.282625 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 89246358-e52b-4a18-89dd-8ef81780d9b9 does not exist Sep 16 13:04:33.282625 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cfc8a42a-95e3-4861-b3ce-b83fdc878850'] Sep 16 13:04:33.282625 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:33.282625 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-15f76efb-9b2a-4b73-b167-5e8679bf0545 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Returning 404 to user: Security group 89246358-e52b-4a18-89dd-8ef81780d9b9 does not exist Sep 16 13:04:33.282625 n-d-858094-4 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-cfc8a42a-95e3-4861-b3ce-b83fdc878850'] {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:04:33.285400 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-15f76efb-9b2a-4b73-b167-5e8679bf0545 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/89246358-e52b-4a18-89dd-8ef81780d9b9" status: 404 len: 194 microversion: 2.1 time: 0.132402 Sep 16 13:04:33.291706 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1977/3833] 10.222.0.67 () {58 vars in 1272 bytes} [Fri Sep 16 13:04:33 2022] DELETE /compute/v2.1/os-security-groups/89246358-e52b-4a18-89dd-8ef81780d9b9 => generated 194 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:04:33.314774 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ac035daf-9537-4984-99bc-efc69af3340a tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:33.315534 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ac035daf-9537-4984-99bc-efc69af3340a tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 97f1168a-0491-4d97-8cc9-59e1b27ababe] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:33.335659 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac035daf-9537-4984-99bc-efc69af3340a tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:33.337366 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac035daf-9537-4984-99bc-efc69af3340a tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:33.337832 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac035daf-9537-4984-99bc-efc69af3340a tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:33.349095 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac035daf-9537-4984-99bc-efc69af3340a tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:33.349825 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac035daf-9537-4984-99bc-efc69af3340a tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:33.350534 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac035daf-9537-4984-99bc-efc69af3340a tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:33.365117 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:04:33.400813 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ac035daf-9537-4984-99bc-efc69af3340a tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 97f1168a-0491-4d97-8cc9-59e1b27ababe] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:04:33.537558 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ac035daf-9537-4984-99bc-efc69af3340a tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "DELETE /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe" status: 204 len: 0 microversion: 2.1 time: 0.243405 Sep 16 13:04:33.538477 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1978/3834] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 13:04:33 2022] DELETE /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:04:33.547964 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a7742087-ef4d-4b49-8326-3f6b8e585a76 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:33.549212 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a7742087-ef4d-4b49-8326-3f6b8e585a76 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 97f1168a-0491-4d97-8cc9-59e1b27ababe] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:33.557512 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7742087-ef4d-4b49-8326-3f6b8e585a76 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:33.558028 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7742087-ef4d-4b49-8326-3f6b8e585a76 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:33.558475 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7742087-ef4d-4b49-8326-3f6b8e585a76 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:33.559193 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7742087-ef4d-4b49-8326-3f6b8e585a76 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:33.560925 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7742087-ef4d-4b49-8326-3f6b8e585a76 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:33.561375 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7742087-ef4d-4b49-8326-3f6b8e585a76 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:33.826122 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-387a1da2-9732-452e-b852-d54fed67b3f6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:33.835221 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-387a1da2-9732-452e-b852-d54fed67b3f6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d" status: 200 len: 1510 microversion: 2.1 time: 0.597420 Sep 16 13:04:33.836357 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1857/3835] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:33 2022] GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d => generated 1510 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:04:34.065781 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a7742087-ef4d-4b49-8326-3f6b8e585a76 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed69c96e39249f181eda742be229b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeff399942c4286a71ea3a0eab43280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:34.080438 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a7742087-ef4d-4b49-8326-3f6b8e585a76 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe" status: 200 len: 1646 microversion: 2.1 time: 0.535996 Sep 16 13:04:34.081274 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1979/3836] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:33 2022] GET /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe => generated 1646 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:34.632232 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-30eb0e73-b4ed-4870-a8e5-b1518fdd11ce tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-824758009", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "8add36eb-29cb-4c92-8149-fffc1787dd77"}], "security_groups": [{"name": "tempest-securitygroup--995552854"}], "key_name": "tempest-keypair-316883394", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:04:34.880414 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-30eb0e73-b4ed-4870-a8e5-b1518fdd11ce tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] validate_networks() for [('8add36eb-29cb-4c92-8149-fffc1787dd77', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:04:35.087495 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-164c9c43-d013-49a9-aae1-4bdeb31087d8 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-718425280", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "ec7d99db-29cf-4b25-8dc4-5bad41f23052"}]}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:04:35.203499 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-164c9c43-d013-49a9-aae1-4bdeb31087d8 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] validate_networks() for [('ec7d99db-29cf-4b25-8dc4-5bad41f23052', None, None, None, None, None)] {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:04:35.894817 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-30eb0e73-b4ed-4870-a8e5-b1518fdd11ce tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Getting quotas for project d2628c648b2e4465821bdcdf4330fb4e. Resources: dict_keys(['metadata_items']) {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:04:35.901517 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-30eb0e73-b4ed-4870-a8e5-b1518fdd11ce tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Getting quotas for user 59081fb246d34546980d57493efae40b and project d2628c648b2e4465821bdcdf4330fb4e. Resources: dict_keys(['metadata_items']) {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:04:35.916732 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-30eb0e73-b4ed-4870-a8e5-b1518fdd11ce tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:04:35.917507 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-30eb0e73-b4ed-4870-a8e5-b1518fdd11ce tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:04:35.918513 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-30eb0e73-b4ed-4870-a8e5-b1518fdd11ce tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:04:35.919220 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-30eb0e73-b4ed-4870-a8e5-b1518fdd11ce tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:04:35.919840 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-30eb0e73-b4ed-4870-a8e5-b1518fdd11ce tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:04:35.929352 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30eb0e73-b4ed-4870-a8e5-b1518fdd11ce tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:35.930228 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30eb0e73-b4ed-4870-a8e5-b1518fdd11ce tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:35.930986 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30eb0e73-b4ed-4870-a8e5-b1518fdd11ce tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:35.932093 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30eb0e73-b4ed-4870-a8e5-b1518fdd11ce tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:35.933113 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30eb0e73-b4ed-4870-a8e5-b1518fdd11ce tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:35.933761 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30eb0e73-b4ed-4870-a8e5-b1518fdd11ce tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:35.954233 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-30eb0e73-b4ed-4870-a8e5-b1518fdd11ce tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Getting quotas for project d2628c648b2e4465821bdcdf4330fb4e. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:04:35.960434 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-30eb0e73-b4ed-4870-a8e5-b1518fdd11ce tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Getting quotas for user 59081fb246d34546980d57493efae40b and project d2628c648b2e4465821bdcdf4330fb4e. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:04:35.975014 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-30eb0e73-b4ed-4870-a8e5-b1518fdd11ce tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:04:35.977979 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-30eb0e73-b4ed-4870-a8e5-b1518fdd11ce tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] [instance: a11bbd81-4323-466b-9d10-6f2d6c1913e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:04:36.055305 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-30eb0e73-b4ed-4870-a8e5-b1518fdd11ce tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.428920 Sep 16 13:04:36.057620 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1980/3837] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 13:04:34 2022] POST /compute/v2.1/servers => generated 408 bytes in 1433 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 13:04:36.069671 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1dda70cd-2f32-4a81-8504-dea8b959d90e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:36.070672 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1dda70cd-2f32-4a81-8504-dea8b959d90e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:36.082552 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dda70cd-2f32-4a81-8504-dea8b959d90e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:36.084019 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dda70cd-2f32-4a81-8504-dea8b959d90e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:36.086507 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dda70cd-2f32-4a81-8504-dea8b959d90e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:36.088184 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dda70cd-2f32-4a81-8504-dea8b959d90e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:36.089085 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dda70cd-2f32-4a81-8504-dea8b959d90e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:36.090086 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dda70cd-2f32-4a81-8504-dea8b959d90e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:36.115341 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:04:36.556703 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1dda70cd-2f32-4a81-8504-dea8b959d90e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:36.566176 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1dda70cd-2f32-4a81-8504-dea8b959d90e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d" status: 200 len: 1510 microversion: 2.1 time: 0.507036 Sep 16 13:04:36.570612 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1981/3838] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:36 2022] GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d => generated 1510 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:36.584851 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-164c9c43-d013-49a9-aae1-4bdeb31087d8 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:04:36.584851 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-164c9c43-d013-49a9-aae1-4bdeb31087d8 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:04:36.584851 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-164c9c43-d013-49a9-aae1-4bdeb31087d8 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:04:36.584851 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-164c9c43-d013-49a9-aae1-4bdeb31087d8 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:04:36.584851 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-164c9c43-d013-49a9-aae1-4bdeb31087d8 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:04:36.585644 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fd1182d7-33b6-4df2-95f1-33ed9a950ea0 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:36.585644 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fd1182d7-33b6-4df2-95f1-33ed9a950ea0 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 97f1168a-0491-4d97-8cc9-59e1b27ababe] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:36.585644 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd1182d7-33b6-4df2-95f1-33ed9a950ea0 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:36.585644 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd1182d7-33b6-4df2-95f1-33ed9a950ea0 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:36.585644 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd1182d7-33b6-4df2-95f1-33ed9a950ea0 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:36.585644 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd1182d7-33b6-4df2-95f1-33ed9a950ea0 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:36.585990 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd1182d7-33b6-4df2-95f1-33ed9a950ea0 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:36.586674 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd1182d7-33b6-4df2-95f1-33ed9a950ea0 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:36.602363 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-164c9c43-d013-49a9-aae1-4bdeb31087d8 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:36.602923 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-164c9c43-d013-49a9-aae1-4bdeb31087d8 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:36.603349 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-164c9c43-d013-49a9-aae1-4bdeb31087d8 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:36.604822 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-164c9c43-d013-49a9-aae1-4bdeb31087d8 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:36.605289 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-164c9c43-d013-49a9-aae1-4bdeb31087d8 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:36.606050 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-164c9c43-d013-49a9-aae1-4bdeb31087d8 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:36.641948 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-164c9c43-d013-49a9-aae1-4bdeb31087d8 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Getting quotas for project 20800c45135443888e60144c602a8429. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:04:36.653628 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-164c9c43-d013-49a9-aae1-4bdeb31087d8 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Getting quotas for user 45d7195f3c52474d96533d3f7df3642c and project 20800c45135443888e60144c602a8429. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:04:36.654140 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd1182d7-33b6-4df2-95f1-33ed9a950ea0 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:36.655582 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd1182d7-33b6-4df2-95f1-33ed9a950ea0 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:36.656635 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd1182d7-33b6-4df2-95f1-33ed9a950ea0 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:36.658828 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-fd1182d7-33b6-4df2-95f1-33ed9a950ea0 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lazy-loading 'fault' on Instance uuid 97f1168a-0491-4d97-8cc9-59e1b27ababe {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:04:36.670136 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-164c9c43-d013-49a9-aae1-4bdeb31087d8 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:04:36.673334 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-164c9c43-d013-49a9-aae1-4bdeb31087d8 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] [instance: c4052f17-eb91-4b32-ac5a-5464ba10c0a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:04:36.746333 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fd1182d7-33b6-4df2-95f1-33ed9a950ea0 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed69c96e39249f181eda742be229b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeff399942c4286a71ea3a0eab43280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:36.763398 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fd1182d7-33b6-4df2-95f1-33ed9a950ea0 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe" status: 200 len: 1306 microversion: 2.1 time: 0.190359 Sep 16 13:04:36.776206 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1982/3839] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:36 2022] GET /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe => generated 1306 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:36.776206 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-041edb85-3aec-4a99-9192-e9a291475bad tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:36.776874 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-041edb85-3aec-4a99-9192-e9a291475bad tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] [instance: a11bbd81-4323-466b-9d10-6f2d6c1913e4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:36.797963 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-164c9c43-d013-49a9-aae1-4bdeb31087d8 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.266014 Sep 16 13:04:36.799234 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1858/3840] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 13:04:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2268 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 13:04:36.804462 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-0dfd8df1-567a-4ebf-8a56-cfa1c1f7c6e3 req-04eb3264-4f4e-4d9e-bac2-6e21063251fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97f1168a-0491-4d97-8cc9-59e1b27ababe", "name": "network-vif-deleted", "tag": "4c0896cf-3255-42ff-b580-d2a345dbb96d"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:04:36.821929 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-0dfd8df1-567a-4ebf-8a56-cfa1c1f7c6e3 req-04eb3264-4f4e-4d9e-bac2-6e21063251fb service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:36.824683 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-0dfd8df1-567a-4ebf-8a56-cfa1c1f7c6e3 req-04eb3264-4f4e-4d9e-bac2-6e21063251fb service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:36.826836 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-0dfd8df1-567a-4ebf-8a56-cfa1c1f7c6e3 req-04eb3264-4f4e-4d9e-bac2-6e21063251fb service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:36.862922 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-0dfd8df1-567a-4ebf-8a56-cfa1c1f7c6e3 req-04eb3264-4f4e-4d9e-bac2-6e21063251fb service nova] Creating event network-vif-deleted:4c0896cf-3255-42ff-b580-d2a345dbb96d for instance 97f1168a-0491-4d97-8cc9-59e1b27ababe on n-h1-858094-4 Sep 16 13:04:36.883309 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-0dfd8df1-567a-4ebf-8a56-cfa1c1f7c6e3 req-04eb3264-4f4e-4d9e-bac2-6e21063251fb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081282 Sep 16 13:04:36.885414 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1859/3841] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:04:36.896295 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1a1ee6e6-b1e2-4dfe-abab-b8b5c48b9771 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:36.898445 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-1a1ee6e6-b1e2-4dfe-abab-b8b5c48b9771 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] [instance: c4052f17-eb91-4b32-ac5a-5464ba10c0a4] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:36.917246 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-041edb85-3aec-4a99-9192-e9a291475bad tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59081fb246d34546980d57493efae40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2628c648b2e4465821bdcdf4330fb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:36.928437 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-041edb85-3aec-4a99-9192-e9a291475bad tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] 10.222.0.67 "GET /compute/v2.1/servers/a11bbd81-4323-466b-9d10-6f2d6c1913e4" status: 200 len: 1276 microversion: 2.1 time: 0.160731 Sep 16 13:04:36.942106 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1983/3842] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:36 2022] GET /compute/v2.1/servers/a11bbd81-4323-466b-9d10-6f2d6c1913e4 => generated 1276 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:37.007390 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1a1ee6e6-b1e2-4dfe-abab-b8b5c48b9771 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d7195f3c52474d96533d3f7df3642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20800c45135443888e60144c602a8429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:37.023508 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1a1ee6e6-b1e2-4dfe-abab-b8b5c48b9771 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] 10.222.0.67 "GET /compute/v2.1/servers/c4052f17-eb91-4b32-ac5a-5464ba10c0a4" status: 200 len: 1223 microversion: 2.1 time: 0.135347 Sep 16 13:04:37.028508 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1860/3843] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:36 2022] GET /compute/v2.1/servers/c4052f17-eb91-4b32-ac5a-5464ba10c0a4 => generated 1223 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:37.597078 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-200ff747-45e0-4936-b699-86ed07936078 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:37.598031 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-200ff747-45e0-4936-b699-86ed07936078 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:37.614249 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-200ff747-45e0-4936-b699-86ed07936078 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:37.616026 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-200ff747-45e0-4936-b699-86ed07936078 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:37.616675 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-200ff747-45e0-4936-b699-86ed07936078 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:37.620598 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-200ff747-45e0-4936-b699-86ed07936078 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:37.621375 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-200ff747-45e0-4936-b699-86ed07936078 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:37.622021 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-200ff747-45e0-4936-b699-86ed07936078 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:37.792253 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f1bdcccc-d5c5-4927-8693-0ccf45d5570f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:37.793630 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f1bdcccc-d5c5-4927-8693-0ccf45d5570f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] [instance: 97f1168a-0491-4d97-8cc9-59e1b27ababe] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:37.806668 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f1bdcccc-d5c5-4927-8693-0ccf45d5570f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:37.812001 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f1bdcccc-d5c5-4927-8693-0ccf45d5570f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:37.812603 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f1bdcccc-d5c5-4927-8693-0ccf45d5570f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:37.814401 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f1bdcccc-d5c5-4927-8693-0ccf45d5570f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:37.817702 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f1bdcccc-d5c5-4927-8693-0ccf45d5570f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:37.818855 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f1bdcccc-d5c5-4927-8693-0ccf45d5570f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:37.886976 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-f1bdcccc-d5c5-4927-8693-0ccf45d5570f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] HTTP exception thrown: Instance 97f1168a-0491-4d97-8cc9-59e1b27ababe could not be found. Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f1bdcccc-d5c5-4927-8693-0ccf45d5570f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Request method failure captured: Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe HTTP/1.1 Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHP182fOoXAmmtyFT24t1WldG_-n_fUq_hYyF_kcX6BBuNdLFPJQpvv1Qbau8uBELlze_J0V8PSdv80EZFiSQVIXVTfCMdV7A-swstczuz_Ini1wPhpJqJ2_9Cvd9QLrJtnV-zdKbzeKde8qkyp_ruLhl8BqedA5EVFg3XozRh0MDPU Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: aaeff399942c4286a71ea3a0eab43280 Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_aaeff399942c4286a71ea3a0eab43280", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/aaeff399942c4286a71ea3a0eab43280"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: aaeff399942c4286a71ea3a0eab43280 Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-210138271 Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-SecurityGroupsTestJSON-210138271-project Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 8ed69c96e39249f181eda742be229b97 Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-SecurityGroupsTestJSON-210138271-project Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance 97f1168a-0491-4d97-8cc9-59e1b27ababe could not be found. Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '97f1168a-0491-4d97-8cc9-59e1b27ababe'} Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97f1168a-0491-4d97-8cc9-59e1b27ababe could not be found. Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97f1168a-0491-4d97-8cc9-59e1b27ababe could not be found. Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:37.889276 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:04:37.892836 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:37.892836 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:04:37.892836 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:04:37.892836 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:04:37.892836 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:04:37.892836 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97f1168a-0491-4d97-8cc9-59e1b27ababe could not be found. Sep 16 13:04:37.892836 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:04:37.916740 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f1bdcccc-d5c5-4927-8693-0ccf45d5570f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Returning 404 to user: Instance 97f1168a-0491-4d97-8cc9-59e1b27ababe could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:04:37.918034 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f1bdcccc-d5c5-4927-8693-0ccf45d5570f tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "GET /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe" status: 404 len: 111 microversion: 2.1 time: 0.131001 Sep 16 13:04:37.918806 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1861/3844] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:37 2022] GET /compute/v2.1/servers/97f1168a-0491-4d97-8cc9-59e1b27ababe => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:04:37.931192 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-da56acb7-e796-487b-aaaa-e4692fab80d1 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '.version_select at 0x7f10399f6ca0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:38.060569 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-200ff747-45e0-4936-b699-86ed07936078 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:38.069889 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-200ff747-45e0-4936-b699-86ed07936078 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d" status: 200 len: 1510 microversion: 2.1 time: 0.477005 Sep 16 13:04:38.087082 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1984/3845] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:37 2022] GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d => generated 1510 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:38.093860 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1a289b09-b34c-4889-a868-23a01141622d tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:38.094233 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1a289b09-b34c-4889-a868-23a01141622d tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] [instance: a11bbd81-4323-466b-9d10-6f2d6c1913e4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:38.101921 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a289b09-b34c-4889-a868-23a01141622d tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:38.102749 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a289b09-b34c-4889-a868-23a01141622d tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:38.103341 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a289b09-b34c-4889-a868-23a01141622d tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:38.105366 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a289b09-b34c-4889-a868-23a01141622d tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:38.106078 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a289b09-b34c-4889-a868-23a01141622d tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:38.106668 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a289b09-b34c-4889-a868-23a01141622d tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:38.331928 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1a289b09-b34c-4889-a868-23a01141622d tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59081fb246d34546980d57493efae40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2628c648b2e4465821bdcdf4330fb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:38.360419 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1a289b09-b34c-4889-a868-23a01141622d tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] 10.222.0.67 "GET /compute/v2.1/servers/a11bbd81-4323-466b-9d10-6f2d6c1913e4" status: 200 len: 1328 microversion: 2.1 time: 0.267365 Sep 16 13:04:38.361781 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1985/3846] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:38 2022] GET /compute/v2.1/servers/a11bbd81-4323-466b-9d10-6f2d6c1913e4 => generated 1328 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:38.379703 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f98d21dd-20af-4673-bd91-2f8ee711aeb4 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:38.386392 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f98d21dd-20af-4673-bd91-2f8ee711aeb4 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] [instance: c4052f17-eb91-4b32-ac5a-5464ba10c0a4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:38.403703 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f98d21dd-20af-4673-bd91-2f8ee711aeb4 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:38.405471 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f98d21dd-20af-4673-bd91-2f8ee711aeb4 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:38.416451 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f98d21dd-20af-4673-bd91-2f8ee711aeb4 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:38.417953 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f98d21dd-20af-4673-bd91-2f8ee711aeb4 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:38.423222 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f98d21dd-20af-4673-bd91-2f8ee711aeb4 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:38.423941 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f98d21dd-20af-4673-bd91-2f8ee711aeb4 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:38.649472 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f98d21dd-20af-4673-bd91-2f8ee711aeb4 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d7195f3c52474d96533d3f7df3642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20800c45135443888e60144c602a8429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:38.665361 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f98d21dd-20af-4673-bd91-2f8ee711aeb4 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] 10.222.0.67 "GET /compute/v2.1/servers/c4052f17-eb91-4b32-ac5a-5464ba10c0a4" status: 200 len: 1275 microversion: 2.1 time: 0.301834 Sep 16 13:04:38.666868 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1986/3847] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:38 2022] GET /compute/v2.1/servers/c4052f17-eb91-4b32-ac5a-5464ba10c0a4 => generated 1275 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:39.097249 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4a16ebda-5420-4f15-9068-25eda66c7389 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:39.097910 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4a16ebda-5420-4f15-9068-25eda66c7389 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:39.112330 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a16ebda-5420-4f15-9068-25eda66c7389 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:39.112974 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a16ebda-5420-4f15-9068-25eda66c7389 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:39.114497 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a16ebda-5420-4f15-9068-25eda66c7389 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:39.115992 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a16ebda-5420-4f15-9068-25eda66c7389 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:39.121242 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a16ebda-5420-4f15-9068-25eda66c7389 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:39.126393 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a16ebda-5420-4f15-9068-25eda66c7389 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:39.314118 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-da56acb7-e796-487b-aaaa-e4692fab80d1 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/4ed0efee-0a9a-4002-8fc8-71699bf983e9" status: 202 len: 0 microversion: 2.1 time: 1.387421 Sep 16 13:04:39.315372 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1862/3848] 10.222.0.67 () {58 vars in 1272 bytes} [Fri Sep 16 13:04:37 2022] DELETE /compute/v2.1/os-security-groups/4ed0efee-0a9a-4002-8fc8-71699bf983e9 => generated 0 bytes in 1390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:04:39.324733 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a8556a1e-401a-41ed-a370-e748d357aba4 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] Calling method '.version_select at 0x7f1034e66280>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:39.689398 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4a16ebda-5420-4f15-9068-25eda66c7389 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:39.697153 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4a16ebda-5420-4f15-9068-25eda66c7389 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d" status: 200 len: 1510 microversion: 2.1 time: 0.603840 Sep 16 13:04:39.698237 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1987/3849] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:39 2022] GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d => generated 1510 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:04:39.724473 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6af4c9dc-876f-49be-aa31-32add22393ca tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:39.725254 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6af4c9dc-876f-49be-aa31-32add22393ca tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] [instance: a11bbd81-4323-466b-9d10-6f2d6c1913e4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:39.733913 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6af4c9dc-876f-49be-aa31-32add22393ca tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:39.734903 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6af4c9dc-876f-49be-aa31-32add22393ca tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:39.735405 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6af4c9dc-876f-49be-aa31-32add22393ca tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:39.736235 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6af4c9dc-876f-49be-aa31-32add22393ca tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:39.736761 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6af4c9dc-876f-49be-aa31-32add22393ca tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:39.737268 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6af4c9dc-876f-49be-aa31-32add22393ca tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:39.909961 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6af4c9dc-876f-49be-aa31-32add22393ca tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59081fb246d34546980d57493efae40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2628c648b2e4465821bdcdf4330fb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:39.920082 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6af4c9dc-876f-49be-aa31-32add22393ca tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] 10.222.0.67 "GET /compute/v2.1/servers/a11bbd81-4323-466b-9d10-6f2d6c1913e4" status: 200 len: 1334 microversion: 2.1 time: 0.200470 Sep 16 13:04:39.921069 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1988/3850] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:39 2022] GET /compute/v2.1/servers/a11bbd81-4323-466b-9d10-6f2d6c1913e4 => generated 1334 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:39.942045 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7d6e12e1-f523-41a6-b715-c42034101ba6 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:39.943777 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7d6e12e1-f523-41a6-b715-c42034101ba6 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] [instance: c4052f17-eb91-4b32-ac5a-5464ba10c0a4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:39.951266 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d6e12e1-f523-41a6-b715-c42034101ba6 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:39.952054 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d6e12e1-f523-41a6-b715-c42034101ba6 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:39.952275 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d6e12e1-f523-41a6-b715-c42034101ba6 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:39.952982 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d6e12e1-f523-41a6-b715-c42034101ba6 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:39.953586 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d6e12e1-f523-41a6-b715-c42034101ba6 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:39.954952 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d6e12e1-f523-41a6-b715-c42034101ba6 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:40.082346 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7d6e12e1-f523-41a6-b715-c42034101ba6 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d7195f3c52474d96533d3f7df3642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20800c45135443888e60144c602a8429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:40.091297 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7d6e12e1-f523-41a6-b715-c42034101ba6 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] 10.222.0.67 "GET /compute/v2.1/servers/c4052f17-eb91-4b32-ac5a-5464ba10c0a4" status: 200 len: 1281 microversion: 2.1 time: 0.153990 Sep 16 13:04:40.099284 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1989/3851] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:39 2022] GET /compute/v2.1/servers/c4052f17-eb91-4b32-ac5a-5464ba10c0a4 => generated 1281 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:40.396426 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a8556a1e-401a-41ed-a370-e748d357aba4 tempest-SecurityGroupsTestJSON-210138271 tempest-SecurityGroupsTestJSON-210138271-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/0334b825-3168-491b-9d7c-628d6248aee3" status: 202 len: 0 microversion: 2.1 time: 1.076474 Sep 16 13:04:40.404528 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1863/3852] 10.222.0.67 () {58 vars in 1272 bytes} [Fri Sep 16 13:04:39 2022] DELETE /compute/v2.1/os-security-groups/0334b825-3168-491b-9d7c-628d6248aee3 => generated 0 bytes in 1085 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:04:40.721958 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d08137ce-f17b-4f2a-a1ec-b2d8fc742f05 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:40.723486 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d08137ce-f17b-4f2a-a1ec-b2d8fc742f05 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:40.735224 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d08137ce-f17b-4f2a-a1ec-b2d8fc742f05 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:40.735814 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d08137ce-f17b-4f2a-a1ec-b2d8fc742f05 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:40.736505 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d08137ce-f17b-4f2a-a1ec-b2d8fc742f05 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:40.737263 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d08137ce-f17b-4f2a-a1ec-b2d8fc742f05 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:40.737856 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d08137ce-f17b-4f2a-a1ec-b2d8fc742f05 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:40.738410 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d08137ce-f17b-4f2a-a1ec-b2d8fc742f05 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:40.944095 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0c300df2-1e6a-4435-9f01-25ef7f47d321 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:40.944841 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0c300df2-1e6a-4435-9f01-25ef7f47d321 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] [instance: a11bbd81-4323-466b-9d10-6f2d6c1913e4] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:40.962964 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0c300df2-1e6a-4435-9f01-25ef7f47d321 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:40.964086 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0c300df2-1e6a-4435-9f01-25ef7f47d321 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:40.964798 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0c300df2-1e6a-4435-9f01-25ef7f47d321 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:40.966608 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0c300df2-1e6a-4435-9f01-25ef7f47d321 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:40.967476 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0c300df2-1e6a-4435-9f01-25ef7f47d321 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:40.968144 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0c300df2-1e6a-4435-9f01-25ef7f47d321 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:41.116472 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0c300df2-1e6a-4435-9f01-25ef7f47d321 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59081fb246d34546980d57493efae40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2628c648b2e4465821bdcdf4330fb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:41.132239 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0c300df2-1e6a-4435-9f01-25ef7f47d321 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] 10.222.0.67 "GET /compute/v2.1/servers/a11bbd81-4323-466b-9d10-6f2d6c1913e4" status: 200 len: 1334 microversion: 2.1 time: 0.192962 Sep 16 13:04:41.144455 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1864/3853] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:40 2022] GET /compute/v2.1/servers/a11bbd81-4323-466b-9d10-6f2d6c1913e4 => generated 1334 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:41.144455 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0077a783-df93-4779-b186-f2e2fd91a42b tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:41.144455 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0077a783-df93-4779-b186-f2e2fd91a42b tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] [instance: c4052f17-eb91-4b32-ac5a-5464ba10c0a4] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:41.154591 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0077a783-df93-4779-b186-f2e2fd91a42b tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:41.155245 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0077a783-df93-4779-b186-f2e2fd91a42b tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:41.155833 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0077a783-df93-4779-b186-f2e2fd91a42b tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:41.156726 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0077a783-df93-4779-b186-f2e2fd91a42b tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:41.157536 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0077a783-df93-4779-b186-f2e2fd91a42b tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:41.158253 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0077a783-df93-4779-b186-f2e2fd91a42b tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:41.266133 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d08137ce-f17b-4f2a-a1ec-b2d8fc742f05 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:41.274766 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d08137ce-f17b-4f2a-a1ec-b2d8fc742f05 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d" status: 200 len: 1510 microversion: 2.1 time: 0.556849 Sep 16 13:04:41.298059 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1990/3854] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:40 2022] GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d => generated 1510 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:41.578704 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0077a783-df93-4779-b186-f2e2fd91a42b tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d7195f3c52474d96533d3f7df3642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20800c45135443888e60144c602a8429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:41.587122 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0077a783-df93-4779-b186-f2e2fd91a42b tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] 10.222.0.67 "GET /compute/v2.1/servers/c4052f17-eb91-4b32-ac5a-5464ba10c0a4" status: 200 len: 1323 microversion: 2.1 time: 0.452843 Sep 16 13:04:41.591669 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1865/3855] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:41 2022] GET /compute/v2.1/servers/c4052f17-eb91-4b32-ac5a-5464ba10c0a4 => generated 1323 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:42.165453 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7f62d91b-46af-411f-a9b6-744868d3ff17 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:42.166114 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7f62d91b-46af-411f-a9b6-744868d3ff17 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] [instance: a11bbd81-4323-466b-9d10-6f2d6c1913e4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:42.180162 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f62d91b-46af-411f-a9b6-744868d3ff17 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:42.181078 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f62d91b-46af-411f-a9b6-744868d3ff17 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:42.182821 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f62d91b-46af-411f-a9b6-744868d3ff17 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:42.184401 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f62d91b-46af-411f-a9b6-744868d3ff17 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:42.185650 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f62d91b-46af-411f-a9b6-744868d3ff17 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:42.186476 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f62d91b-46af-411f-a9b6-744868d3ff17 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:42.306232 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d18d7b08-adc4-4ba2-b00c-f7ffe53883ba tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:42.306348 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d18d7b08-adc4-4ba2-b00c-f7ffe53883ba tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:42.318494 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d18d7b08-adc4-4ba2-b00c-f7ffe53883ba tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:42.319349 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d18d7b08-adc4-4ba2-b00c-f7ffe53883ba tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:42.320805 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d18d7b08-adc4-4ba2-b00c-f7ffe53883ba tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:42.321801 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d18d7b08-adc4-4ba2-b00c-f7ffe53883ba tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:42.323196 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d18d7b08-adc4-4ba2-b00c-f7ffe53883ba tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:42.323873 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d18d7b08-adc4-4ba2-b00c-f7ffe53883ba tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:43.103227 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7f62d91b-46af-411f-a9b6-744868d3ff17 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59081fb246d34546980d57493efae40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2628c648b2e4465821bdcdf4330fb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:43.136099 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7f62d91b-46af-411f-a9b6-744868d3ff17 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] 10.222.0.67 "GET /compute/v2.1/servers/a11bbd81-4323-466b-9d10-6f2d6c1913e4" status: 200 len: 1401 microversion: 2.1 time: 0.973451 Sep 16 13:04:43.136795 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1991/3856] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:42 2022] GET /compute/v2.1/servers/a11bbd81-4323-466b-9d10-6f2d6c1913e4 => generated 1401 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:43.143061 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e28c361d-1513-4b53-aafa-7ab0ce5cbb92 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:43.143933 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e28c361d-1513-4b53-aafa-7ab0ce5cbb92 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] [instance: c4052f17-eb91-4b32-ac5a-5464ba10c0a4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:43.154306 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e28c361d-1513-4b53-aafa-7ab0ce5cbb92 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:43.155140 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e28c361d-1513-4b53-aafa-7ab0ce5cbb92 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:43.155809 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e28c361d-1513-4b53-aafa-7ab0ce5cbb92 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:43.160974 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d18d7b08-adc4-4ba2-b00c-f7ffe53883ba tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:43.168974 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e28c361d-1513-4b53-aafa-7ab0ce5cbb92 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:43.173878 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e28c361d-1513-4b53-aafa-7ab0ce5cbb92 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:43.177031 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e28c361d-1513-4b53-aafa-7ab0ce5cbb92 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:43.183161 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d18d7b08-adc4-4ba2-b00c-f7ffe53883ba tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d" status: 200 len: 1510 microversion: 2.1 time: 0.882888 Sep 16 13:04:43.184493 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1866/3857] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:42 2022] GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d => generated 1510 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:04:43.592684 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e28c361d-1513-4b53-aafa-7ab0ce5cbb92 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d7195f3c52474d96533d3f7df3642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20800c45135443888e60144c602a8429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:43.601687 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e28c361d-1513-4b53-aafa-7ab0ce5cbb92 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] 10.222.0.67 "GET /compute/v2.1/servers/c4052f17-eb91-4b32-ac5a-5464ba10c0a4" status: 200 len: 1323 microversion: 2.1 time: 0.463670 Sep 16 13:04:43.602359 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1992/3858] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:43 2022] GET /compute/v2.1/servers/c4052f17-eb91-4b32-ac5a-5464ba10c0a4 => generated 1323 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:43.863962 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-374dcc69-8ca4-4eab-b489-81e88ee8e13e req-8b427084-8322-4ee6-9f51-bcde82a3d6de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4052f17-eb91-4b32-ac5a-5464ba10c0a4", "tag": "05cfdbd1-f34b-468d-a8ad-b77eeac8c622"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:04:43.887396 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-374dcc69-8ca4-4eab-b489-81e88ee8e13e req-8b427084-8322-4ee6-9f51-bcde82a3d6de service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:43.887974 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-374dcc69-8ca4-4eab-b489-81e88ee8e13e req-8b427084-8322-4ee6-9f51-bcde82a3d6de service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:43.888700 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-374dcc69-8ca4-4eab-b489-81e88ee8e13e req-8b427084-8322-4ee6-9f51-bcde82a3d6de service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:43.904399 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-374dcc69-8ca4-4eab-b489-81e88ee8e13e req-8b427084-8322-4ee6-9f51-bcde82a3d6de service nova] Creating event network-changed:05cfdbd1-f34b-468d-a8ad-b77eeac8c622 for instance c4052f17-eb91-4b32-ac5a-5464ba10c0a4 on n-h2-858094-4 Sep 16 13:04:43.912597 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-374dcc69-8ca4-4eab-b489-81e88ee8e13e req-8b427084-8322-4ee6-9f51-bcde82a3d6de service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059073 Sep 16 13:04:43.913841 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1867/3859] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:04:44.129286 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-629269d7-a659-4616-a17e-38fa45177f1d req-faca9e2e-36d0-4431-94f2-7a3a8304a7b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a11bbd81-4323-466b-9d10-6f2d6c1913e4", "tag": "c40c0347-2b42-4346-a6fd-c898430328a0"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:04:44.152106 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-629269d7-a659-4616-a17e-38fa45177f1d req-faca9e2e-36d0-4431-94f2-7a3a8304a7b7 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:44.161626 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-629269d7-a659-4616-a17e-38fa45177f1d req-faca9e2e-36d0-4431-94f2-7a3a8304a7b7 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:44.164474 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-629269d7-a659-4616-a17e-38fa45177f1d req-faca9e2e-36d0-4431-94f2-7a3a8304a7b7 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:44.177429 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1540d167-482a-4128-95b3-6d8c6229f497 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:44.178153 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-1540d167-482a-4128-95b3-6d8c6229f497 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] [instance: a11bbd81-4323-466b-9d10-6f2d6c1913e4] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:44.194135 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1540d167-482a-4128-95b3-6d8c6229f497 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:44.194400 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-629269d7-a659-4616-a17e-38fa45177f1d req-faca9e2e-36d0-4431-94f2-7a3a8304a7b7 service nova] Creating event network-changed:c40c0347-2b42-4346-a6fd-c898430328a0 for instance a11bbd81-4323-466b-9d10-6f2d6c1913e4 on n-h2-858094-4 Sep 16 13:04:44.195269 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1540d167-482a-4128-95b3-6d8c6229f497 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:44.195868 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1540d167-482a-4128-95b3-6d8c6229f497 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:44.197088 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1540d167-482a-4128-95b3-6d8c6229f497 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:44.197739 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1540d167-482a-4128-95b3-6d8c6229f497 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:44.198928 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1540d167-482a-4128-95b3-6d8c6229f497 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:44.201595 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-629269d7-a659-4616-a17e-38fa45177f1d req-faca9e2e-36d0-4431-94f2-7a3a8304a7b7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077810 Sep 16 13:04:44.202746 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1993/3860] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:04:44.213911 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-01c79150-996b-4e26-b788-422b334b1d89 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:44.215177 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-01c79150-996b-4e26-b788-422b334b1d89 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:44.226192 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:04:44.230264 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01c79150-996b-4e26-b788-422b334b1d89 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:44.231006 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01c79150-996b-4e26-b788-422b334b1d89 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:44.231632 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01c79150-996b-4e26-b788-422b334b1d89 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:44.233263 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01c79150-996b-4e26-b788-422b334b1d89 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:44.234062 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01c79150-996b-4e26-b788-422b334b1d89 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:44.234898 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01c79150-996b-4e26-b788-422b334b1d89 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:44.683717 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1540d167-482a-4128-95b3-6d8c6229f497 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59081fb246d34546980d57493efae40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2628c648b2e4465821bdcdf4330fb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:44.702506 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1540d167-482a-4128-95b3-6d8c6229f497 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] 10.222.0.67 "GET /compute/v2.1/servers/a11bbd81-4323-466b-9d10-6f2d6c1913e4" status: 200 len: 1401 microversion: 2.1 time: 0.531525 Sep 16 13:04:44.707784 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1868/3861] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:44 2022] GET /compute/v2.1/servers/a11bbd81-4323-466b-9d10-6f2d6c1913e4 => generated 1401 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:44.713697 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c1c478ac-b535-4f35-8c22-ec4876f294fa tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:44.714666 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c1c478ac-b535-4f35-8c22-ec4876f294fa tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] [instance: c4052f17-eb91-4b32-ac5a-5464ba10c0a4] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:44.722497 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c1c478ac-b535-4f35-8c22-ec4876f294fa tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:44.723268 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c1c478ac-b535-4f35-8c22-ec4876f294fa tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:44.723989 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c1c478ac-b535-4f35-8c22-ec4876f294fa tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:44.724951 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c1c478ac-b535-4f35-8c22-ec4876f294fa tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:44.725615 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c1c478ac-b535-4f35-8c22-ec4876f294fa tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:44.726202 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c1c478ac-b535-4f35-8c22-ec4876f294fa tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:44.911961 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-01c79150-996b-4e26-b788-422b334b1d89 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:44.921997 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-01c79150-996b-4e26-b788-422b334b1d89 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d" status: 200 len: 1510 microversion: 2.1 time: 0.712017 Sep 16 13:04:44.923197 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1994/3862] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:44 2022] GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d => generated 1510 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:45.223774 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c1c478ac-b535-4f35-8c22-ec4876f294fa tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d7195f3c52474d96533d3f7df3642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20800c45135443888e60144c602a8429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:45.235059 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c1c478ac-b535-4f35-8c22-ec4876f294fa tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] 10.222.0.67 "GET /compute/v2.1/servers/c4052f17-eb91-4b32-ac5a-5464ba10c0a4" status: 200 len: 1323 microversion: 2.1 time: 0.525391 Sep 16 13:04:45.235981 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1869/3863] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:44 2022] GET /compute/v2.1/servers/c4052f17-eb91-4b32-ac5a-5464ba10c0a4 => generated 1323 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:45.729164 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5dd5d50d-e828-4f7f-a5fe-454222636228 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:45.730546 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5dd5d50d-e828-4f7f-a5fe-454222636228 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] [instance: a11bbd81-4323-466b-9d10-6f2d6c1913e4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:45.738358 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5dd5d50d-e828-4f7f-a5fe-454222636228 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:45.739075 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5dd5d50d-e828-4f7f-a5fe-454222636228 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:45.739740 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5dd5d50d-e828-4f7f-a5fe-454222636228 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:45.740744 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5dd5d50d-e828-4f7f-a5fe-454222636228 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:45.741364 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5dd5d50d-e828-4f7f-a5fe-454222636228 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:45.741948 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5dd5d50d-e828-4f7f-a5fe-454222636228 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:45.943974 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:04:45.948625 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-154d4326-c492-4c03-897a-5e0942d61c42 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:45.949465 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-154d4326-c492-4c03-897a-5e0942d61c42 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:45.956416 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-154d4326-c492-4c03-897a-5e0942d61c42 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:45.956910 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-154d4326-c492-4c03-897a-5e0942d61c42 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:45.957350 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-154d4326-c492-4c03-897a-5e0942d61c42 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:45.958059 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-154d4326-c492-4c03-897a-5e0942d61c42 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:45.965140 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-154d4326-c492-4c03-897a-5e0942d61c42 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:45.965697 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-154d4326-c492-4c03-897a-5e0942d61c42 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:46.629942 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:04:46.651384 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5dd5d50d-e828-4f7f-a5fe-454222636228 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59081fb246d34546980d57493efae40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2628c648b2e4465821bdcdf4330fb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:46.661367 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5dd5d50d-e828-4f7f-a5fe-454222636228 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] 10.222.0.67 "GET /compute/v2.1/servers/a11bbd81-4323-466b-9d10-6f2d6c1913e4" status: 200 len: 1401 microversion: 2.1 time: 0.936574 Sep 16 13:04:46.677895 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1995/3864] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:45 2022] GET /compute/v2.1/servers/a11bbd81-4323-466b-9d10-6f2d6c1913e4 => generated 1401 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:46.690304 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c85289a8-92b3-44c9-8cb2-89e8db8f4552 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:46.693658 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c85289a8-92b3-44c9-8cb2-89e8db8f4552 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] [instance: c4052f17-eb91-4b32-ac5a-5464ba10c0a4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:46.702284 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c85289a8-92b3-44c9-8cb2-89e8db8f4552 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:46.703484 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c85289a8-92b3-44c9-8cb2-89e8db8f4552 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:46.704793 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c85289a8-92b3-44c9-8cb2-89e8db8f4552 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:46.705797 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c85289a8-92b3-44c9-8cb2-89e8db8f4552 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:46.706408 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c85289a8-92b3-44c9-8cb2-89e8db8f4552 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:46.707274 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c85289a8-92b3-44c9-8cb2-89e8db8f4552 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:46.761970 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-154d4326-c492-4c03-897a-5e0942d61c42 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:46.801524 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-154d4326-c492-4c03-897a-5e0942d61c42 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d" status: 200 len: 1510 microversion: 2.1 time: 0.856870 Sep 16 13:04:46.802390 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1870/3865] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:45 2022] GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d => generated 1510 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:04:46.927600 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=12 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:04:47.122444 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c85289a8-92b3-44c9-8cb2-89e8db8f4552 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d7195f3c52474d96533d3f7df3642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20800c45135443888e60144c602a8429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:47.146167 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c85289a8-92b3-44c9-8cb2-89e8db8f4552 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] 10.222.0.67 "GET /compute/v2.1/servers/c4052f17-eb91-4b32-ac5a-5464ba10c0a4" status: 200 len: 1323 microversion: 2.1 time: 0.461187 Sep 16 13:04:47.147017 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1996/3866] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:46 2022] GET /compute/v2.1/servers/c4052f17-eb91-4b32-ac5a-5464ba10c0a4 => generated 1323 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:47.691007 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0328b76b-561a-4bb5-bb37-cbe569ae35a1 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:47.691615 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0328b76b-561a-4bb5-bb37-cbe569ae35a1 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] [instance: a11bbd81-4323-466b-9d10-6f2d6c1913e4] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:47.694993 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=12 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:04:47.714045 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0328b76b-561a-4bb5-bb37-cbe569ae35a1 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:47.724412 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0328b76b-561a-4bb5-bb37-cbe569ae35a1 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:47.726826 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0328b76b-561a-4bb5-bb37-cbe569ae35a1 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:47.732378 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0328b76b-561a-4bb5-bb37-cbe569ae35a1 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:47.732918 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0328b76b-561a-4bb5-bb37-cbe569ae35a1 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:47.733948 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0328b76b-561a-4bb5-bb37-cbe569ae35a1 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:47.830513 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d2ea8c69-b3cf-4880-9c09-ebbecd071119 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:47.831145 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d2ea8c69-b3cf-4880-9c09-ebbecd071119 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:47.843331 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2ea8c69-b3cf-4880-9c09-ebbecd071119 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:47.843823 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2ea8c69-b3cf-4880-9c09-ebbecd071119 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:47.848630 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2ea8c69-b3cf-4880-9c09-ebbecd071119 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:47.849709 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2ea8c69-b3cf-4880-9c09-ebbecd071119 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:47.850414 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2ea8c69-b3cf-4880-9c09-ebbecd071119 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:47.851139 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2ea8c69-b3cf-4880-9c09-ebbecd071119 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:48.179822 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0328b76b-561a-4bb5-bb37-cbe569ae35a1 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59081fb246d34546980d57493efae40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2628c648b2e4465821bdcdf4330fb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:48.191877 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0328b76b-561a-4bb5-bb37-cbe569ae35a1 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] 10.222.0.67 "GET /compute/v2.1/servers/a11bbd81-4323-466b-9d10-6f2d6c1913e4" status: 200 len: 1401 microversion: 2.1 time: 0.504614 Sep 16 13:04:48.192743 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1871/3867] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:47 2022] GET /compute/v2.1/servers/a11bbd81-4323-466b-9d10-6f2d6c1913e4 => generated 1401 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:48.235553 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-768c7176-1b09-427c-ab28-7a367b45f6b7 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:48.239305 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-768c7176-1b09-427c-ab28-7a367b45f6b7 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] [instance: c4052f17-eb91-4b32-ac5a-5464ba10c0a4] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:48.272393 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-768c7176-1b09-427c-ab28-7a367b45f6b7 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:48.272898 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-768c7176-1b09-427c-ab28-7a367b45f6b7 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:48.273342 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-768c7176-1b09-427c-ab28-7a367b45f6b7 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:48.273756 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d2ea8c69-b3cf-4880-9c09-ebbecd071119 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:48.274216 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-768c7176-1b09-427c-ab28-7a367b45f6b7 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:48.278247 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-768c7176-1b09-427c-ab28-7a367b45f6b7 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:48.278769 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-768c7176-1b09-427c-ab28-7a367b45f6b7 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:48.300873 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d2ea8c69-b3cf-4880-9c09-ebbecd071119 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d" status: 200 len: 1510 microversion: 2.1 time: 0.474750 Sep 16 13:04:48.301469 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1997/3868] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:47 2022] GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d => generated 1510 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:48.505760 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-768c7176-1b09-427c-ab28-7a367b45f6b7 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d7195f3c52474d96533d3f7df3642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20800c45135443888e60144c602a8429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:48.516162 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-768c7176-1b09-427c-ab28-7a367b45f6b7 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] 10.222.0.67 "GET /compute/v2.1/servers/c4052f17-eb91-4b32-ac5a-5464ba10c0a4" status: 200 len: 1323 microversion: 2.1 time: 0.320225 Sep 16 13:04:48.517087 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1872/3869] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:48 2022] GET /compute/v2.1/servers/c4052f17-eb91-4b32-ac5a-5464ba10c0a4 => generated 1323 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:49.222809 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-76ff59be-a4a0-4b49-bf65-be22da5d3436 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:49.223715 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-76ff59be-a4a0-4b49-bf65-be22da5d3436 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] [instance: a11bbd81-4323-466b-9d10-6f2d6c1913e4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:49.236040 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76ff59be-a4a0-4b49-bf65-be22da5d3436 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:49.237204 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76ff59be-a4a0-4b49-bf65-be22da5d3436 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:49.237863 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76ff59be-a4a0-4b49-bf65-be22da5d3436 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:49.238868 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76ff59be-a4a0-4b49-bf65-be22da5d3436 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:49.239567 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76ff59be-a4a0-4b49-bf65-be22da5d3436 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:49.240325 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76ff59be-a4a0-4b49-bf65-be22da5d3436 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:49.323121 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-62e325ca-5156-409a-95bf-6bd4da6ca170 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:49.323882 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-62e325ca-5156-409a-95bf-6bd4da6ca170 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:49.342387 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62e325ca-5156-409a-95bf-6bd4da6ca170 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:49.343295 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62e325ca-5156-409a-95bf-6bd4da6ca170 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:49.343970 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62e325ca-5156-409a-95bf-6bd4da6ca170 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:49.344940 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62e325ca-5156-409a-95bf-6bd4da6ca170 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:49.345609 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62e325ca-5156-409a-95bf-6bd4da6ca170 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:49.346249 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-62e325ca-5156-409a-95bf-6bd4da6ca170 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:49.536445 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-76ff59be-a4a0-4b49-bf65-be22da5d3436 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59081fb246d34546980d57493efae40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2628c648b2e4465821bdcdf4330fb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:49.551422 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-76ff59be-a4a0-4b49-bf65-be22da5d3436 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] 10.222.0.67 "GET /compute/v2.1/servers/a11bbd81-4323-466b-9d10-6f2d6c1913e4" status: 200 len: 1401 microversion: 2.1 time: 0.332896 Sep 16 13:04:49.552028 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1998/3870] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:49 2022] GET /compute/v2.1/servers/a11bbd81-4323-466b-9d10-6f2d6c1913e4 => generated 1401 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:49.556891 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cca18429-cee8-431f-ae66-b875cf1c686f tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:49.557961 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cca18429-cee8-431f-ae66-b875cf1c686f tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] [instance: c4052f17-eb91-4b32-ac5a-5464ba10c0a4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:49.564379 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cca18429-cee8-431f-ae66-b875cf1c686f tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:49.565064 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cca18429-cee8-431f-ae66-b875cf1c686f tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:49.566599 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cca18429-cee8-431f-ae66-b875cf1c686f tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:49.567502 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cca18429-cee8-431f-ae66-b875cf1c686f tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:49.568148 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cca18429-cee8-431f-ae66-b875cf1c686f tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:49.568733 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cca18429-cee8-431f-ae66-b875cf1c686f tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:49.591332 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:04:49.737233 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-62e325ca-5156-409a-95bf-6bd4da6ca170 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:49.747517 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-62e325ca-5156-409a-95bf-6bd4da6ca170 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d" status: 200 len: 1510 microversion: 2.1 time: 0.428256 Sep 16 13:04:49.748600 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1873/3871] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:49 2022] GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d => generated 1510 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:49.856136 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cca18429-cee8-431f-ae66-b875cf1c686f tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d7195f3c52474d96533d3f7df3642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20800c45135443888e60144c602a8429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:49.864682 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cca18429-cee8-431f-ae66-b875cf1c686f tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] 10.222.0.67 "GET /compute/v2.1/servers/c4052f17-eb91-4b32-ac5a-5464ba10c0a4" status: 200 len: 1323 microversion: 2.1 time: 0.311061 Sep 16 13:04:49.865834 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1999/3872] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:49 2022] GET /compute/v2.1/servers/c4052f17-eb91-4b32-ac5a-5464ba10c0a4 => generated 1323 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:50.542175 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-5dc86dba-8fee-44b4-9089-3d5091e49702 req-52f673f5-068d-470d-b9dc-a2adc3536c52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a11bbd81-4323-466b-9d10-6f2d6c1913e4", "name": "network-vif-plugged", "status": "completed", "tag": "c40c0347-2b42-4346-a6fd-c898430328a0"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:04:50.566210 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-5dc86dba-8fee-44b4-9089-3d5091e49702 req-52f673f5-068d-470d-b9dc-a2adc3536c52 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:50.567270 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-5dc86dba-8fee-44b4-9089-3d5091e49702 req-52f673f5-068d-470d-b9dc-a2adc3536c52 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:50.567926 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-5dc86dba-8fee-44b4-9089-3d5091e49702 req-52f673f5-068d-470d-b9dc-a2adc3536c52 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:50.577382 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5ed1757f-3698-4e12-946f-ed0a0bdae148 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:50.578728 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5ed1757f-3698-4e12-946f-ed0a0bdae148 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] [instance: a11bbd81-4323-466b-9d10-6f2d6c1913e4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:50.605095 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ed1757f-3698-4e12-946f-ed0a0bdae148 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:50.607879 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ed1757f-3698-4e12-946f-ed0a0bdae148 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:50.611772 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ed1757f-3698-4e12-946f-ed0a0bdae148 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:50.613716 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ed1757f-3698-4e12-946f-ed0a0bdae148 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:50.615687 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ed1757f-3698-4e12-946f-ed0a0bdae148 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:50.616643 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ed1757f-3698-4e12-946f-ed0a0bdae148 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:50.622659 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-5dc86dba-8fee-44b4-9089-3d5091e49702 req-52f673f5-068d-470d-b9dc-a2adc3536c52 service nova] Creating event network-vif-plugged:c40c0347-2b42-4346-a6fd-c898430328a0 for instance a11bbd81-4323-466b-9d10-6f2d6c1913e4 on n-h2-858094-4 Sep 16 13:04:50.636748 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-5dc86dba-8fee-44b4-9089-3d5091e49702 req-52f673f5-068d-470d-b9dc-a2adc3536c52 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099125 Sep 16 13:04:50.641974 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1874/3873] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:04:50.772981 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-92bd8b77-7dfa-405a-86c2-819a074563ce tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:50.774102 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-92bd8b77-7dfa-405a-86c2-819a074563ce tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:50.793894 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92bd8b77-7dfa-405a-86c2-819a074563ce tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:50.796045 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92bd8b77-7dfa-405a-86c2-819a074563ce tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:50.796747 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92bd8b77-7dfa-405a-86c2-819a074563ce tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:50.798351 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92bd8b77-7dfa-405a-86c2-819a074563ce tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:50.801325 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92bd8b77-7dfa-405a-86c2-819a074563ce tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:50.803489 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-92bd8b77-7dfa-405a-86c2-819a074563ce tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:50.867722 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5ed1757f-3698-4e12-946f-ed0a0bdae148 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59081fb246d34546980d57493efae40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2628c648b2e4465821bdcdf4330fb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:50.882575 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5ed1757f-3698-4e12-946f-ed0a0bdae148 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] 10.222.0.67 "GET /compute/v2.1/servers/a11bbd81-4323-466b-9d10-6f2d6c1913e4" status: 200 len: 1401 microversion: 2.1 time: 0.307656 Sep 16 13:04:50.889990 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2000/3874] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:50 2022] GET /compute/v2.1/servers/a11bbd81-4323-466b-9d10-6f2d6c1913e4 => generated 1401 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:50.911342 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e2c97e76-1602-496d-9ce1-036ebd54fe0a tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:50.912417 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e2c97e76-1602-496d-9ce1-036ebd54fe0a tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] [instance: c4052f17-eb91-4b32-ac5a-5464ba10c0a4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:50.930776 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2c97e76-1602-496d-9ce1-036ebd54fe0a tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:50.939229 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2c97e76-1602-496d-9ce1-036ebd54fe0a tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:50.940002 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2c97e76-1602-496d-9ce1-036ebd54fe0a tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:50.943341 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2c97e76-1602-496d-9ce1-036ebd54fe0a tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:50.944193 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2c97e76-1602-496d-9ce1-036ebd54fe0a tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:50.946906 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2c97e76-1602-496d-9ce1-036ebd54fe0a tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:51.395775 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e2c97e76-1602-496d-9ce1-036ebd54fe0a tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d7195f3c52474d96533d3f7df3642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20800c45135443888e60144c602a8429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:51.404001 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e2c97e76-1602-496d-9ce1-036ebd54fe0a tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] 10.222.0.67 "GET /compute/v2.1/servers/c4052f17-eb91-4b32-ac5a-5464ba10c0a4" status: 200 len: 1323 microversion: 2.1 time: 0.512465 Sep 16 13:04:51.417755 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2001/3875] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:50 2022] GET /compute/v2.1/servers/c4052f17-eb91-4b32-ac5a-5464ba10c0a4 => generated 1323 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:51.437143 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-92bd8b77-7dfa-405a-86c2-819a074563ce tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:51.451800 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-92bd8b77-7dfa-405a-86c2-819a074563ce tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d" status: 200 len: 1510 microversion: 2.1 time: 0.683709 Sep 16 13:04:51.453138 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1875/3876] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:50 2022] GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d => generated 1510 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:51.923790 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-45cf0e5a-5322-4166-96e9-9cf9161d2baa tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:51.925174 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-45cf0e5a-5322-4166-96e9-9cf9161d2baa tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] [instance: a11bbd81-4323-466b-9d10-6f2d6c1913e4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:51.934850 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45cf0e5a-5322-4166-96e9-9cf9161d2baa tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:51.936750 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45cf0e5a-5322-4166-96e9-9cf9161d2baa tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:51.937553 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45cf0e5a-5322-4166-96e9-9cf9161d2baa tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:51.938499 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45cf0e5a-5322-4166-96e9-9cf9161d2baa tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:51.939204 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45cf0e5a-5322-4166-96e9-9cf9161d2baa tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:51.939699 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45cf0e5a-5322-4166-96e9-9cf9161d2baa tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:52.249707 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-45cf0e5a-5322-4166-96e9-9cf9161d2baa tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59081fb246d34546980d57493efae40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2628c648b2e4465821bdcdf4330fb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:52.263780 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-45cf0e5a-5322-4166-96e9-9cf9161d2baa tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] 10.222.0.67 "GET /compute/v2.1/servers/a11bbd81-4323-466b-9d10-6f2d6c1913e4" status: 200 len: 1401 microversion: 2.1 time: 0.343407 Sep 16 13:04:52.277390 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2002/3877] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:51 2022] GET /compute/v2.1/servers/a11bbd81-4323-466b-9d10-6f2d6c1913e4 => generated 1401 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:52.435842 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b8466c39-0ddf-4940-a10b-1703ff72498c tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:52.438830 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b8466c39-0ddf-4940-a10b-1703ff72498c tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] [instance: c4052f17-eb91-4b32-ac5a-5464ba10c0a4] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:52.453209 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b8466c39-0ddf-4940-a10b-1703ff72498c tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:52.454316 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b8466c39-0ddf-4940-a10b-1703ff72498c tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:52.455829 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b8466c39-0ddf-4940-a10b-1703ff72498c tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:52.457861 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b8466c39-0ddf-4940-a10b-1703ff72498c tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:52.459183 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b8466c39-0ddf-4940-a10b-1703ff72498c tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:52.459870 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b8466c39-0ddf-4940-a10b-1703ff72498c tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:52.477492 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cc21bc96-648a-4047-b2b1-67ffa5a7f6d5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:52.478429 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cc21bc96-648a-4047-b2b1-67ffa5a7f6d5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:52.488259 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc21bc96-648a-4047-b2b1-67ffa5a7f6d5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:52.491022 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc21bc96-648a-4047-b2b1-67ffa5a7f6d5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:52.491688 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc21bc96-648a-4047-b2b1-67ffa5a7f6d5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:52.495205 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc21bc96-648a-4047-b2b1-67ffa5a7f6d5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:52.495783 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc21bc96-648a-4047-b2b1-67ffa5a7f6d5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:52.496639 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc21bc96-648a-4047-b2b1-67ffa5a7f6d5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:53.441972 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cc21bc96-648a-4047-b2b1-67ffa5a7f6d5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:53.445756 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-b8466c39-0ddf-4940-a10b-1703ff72498c tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d7195f3c52474d96533d3f7df3642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20800c45135443888e60144c602a8429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:53.460376 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b8466c39-0ddf-4940-a10b-1703ff72498c tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] 10.222.0.67 "GET /compute/v2.1/servers/c4052f17-eb91-4b32-ac5a-5464ba10c0a4" status: 200 len: 1323 microversion: 2.1 time: 1.028222 Sep 16 13:04:53.461012 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1876/3878] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:52 2022] GET /compute/v2.1/servers/c4052f17-eb91-4b32-ac5a-5464ba10c0a4 => generated 1323 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:53.462199 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cc21bc96-648a-4047-b2b1-67ffa5a7f6d5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d" status: 200 len: 1510 microversion: 2.1 time: 0.988478 Sep 16 13:04:53.464704 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2003/3879] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:52 2022] GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d => generated 1510 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:04:53.470689 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-4c1b10f1-baae-44dd-afab-a071fec52fb5 req-aabfe731-05b2-4b76-ab50-ae65e4a380cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4052f17-eb91-4b32-ac5a-5464ba10c0a4", "name": "network-vif-plugged", "status": "completed", "tag": "05cfdbd1-f34b-468d-a8ad-b77eeac8c622"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:04:53.472705 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ae6723af-89a5-44e2-9fc8-80730300ac83 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:53.474466 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ae6723af-89a5-44e2-9fc8-80730300ac83 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] [instance: a11bbd81-4323-466b-9d10-6f2d6c1913e4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:53.486549 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae6723af-89a5-44e2-9fc8-80730300ac83 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:53.487466 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae6723af-89a5-44e2-9fc8-80730300ac83 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:53.488180 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae6723af-89a5-44e2-9fc8-80730300ac83 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:53.489298 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae6723af-89a5-44e2-9fc8-80730300ac83 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:53.489971 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae6723af-89a5-44e2-9fc8-80730300ac83 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:53.490861 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae6723af-89a5-44e2-9fc8-80730300ac83 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:53.496617 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:04:53.499819 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-4c1b10f1-baae-44dd-afab-a071fec52fb5 req-aabfe731-05b2-4b76-ab50-ae65e4a380cc service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:53.501139 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-4c1b10f1-baae-44dd-afab-a071fec52fb5 req-aabfe731-05b2-4b76-ab50-ae65e4a380cc service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:53.501611 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-4c1b10f1-baae-44dd-afab-a071fec52fb5 req-aabfe731-05b2-4b76-ab50-ae65e4a380cc service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:53.527996 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-4c1b10f1-baae-44dd-afab-a071fec52fb5 req-aabfe731-05b2-4b76-ab50-ae65e4a380cc service nova] Creating event network-vif-plugged:05cfdbd1-f34b-468d-a8ad-b77eeac8c622 for instance c4052f17-eb91-4b32-ac5a-5464ba10c0a4 on n-h2-858094-4 Sep 16 13:04:53.547297 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-4c1b10f1-baae-44dd-afab-a071fec52fb5 req-aabfe731-05b2-4b76-ab50-ae65e4a380cc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081324 Sep 16 13:04:53.548106 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1877/3880] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:04:53.757924 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ae6723af-89a5-44e2-9fc8-80730300ac83 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59081fb246d34546980d57493efae40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2628c648b2e4465821bdcdf4330fb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:53.773022 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ae6723af-89a5-44e2-9fc8-80730300ac83 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] 10.222.0.67 "GET /compute/v2.1/servers/a11bbd81-4323-466b-9d10-6f2d6c1913e4" status: 200 len: 1586 microversion: 2.1 time: 0.305669 Sep 16 13:04:53.773989 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2004/3881] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:53 2022] GET /compute/v2.1/servers/a11bbd81-4323-466b-9d10-6f2d6c1913e4 => generated 1586 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:53.797049 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-bb8d8217-b0aa-41e6-ade4-5e171cbffa1a tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:53.797925 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-bb8d8217-b0aa-41e6-ade4-5e171cbffa1a tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] [instance: a11bbd81-4323-466b-9d10-6f2d6c1913e4] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:53.806718 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bb8d8217-b0aa-41e6-ade4-5e171cbffa1a tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:53.807583 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bb8d8217-b0aa-41e6-ade4-5e171cbffa1a tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:53.808034 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bb8d8217-b0aa-41e6-ade4-5e171cbffa1a tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:53.808952 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bb8d8217-b0aa-41e6-ade4-5e171cbffa1a tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:53.809570 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bb8d8217-b0aa-41e6-ade4-5e171cbffa1a tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:53.810154 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bb8d8217-b0aa-41e6-ade4-5e171cbffa1a tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:53.952059 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-bb8d8217-b0aa-41e6-ade4-5e171cbffa1a tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] 10.222.0.67 "GET /compute/v2.1/servers/a11bbd81-4323-466b-9d10-6f2d6c1913e4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.159376 Sep 16 13:04:53.954030 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1878/3882] 10.222.0.67 () {58 vars in 1275 bytes} [Fri Sep 16 13:04:53 2022] GET /compute/v2.1/servers/a11bbd81-4323-466b-9d10-6f2d6c1913e4/os-interface => generated 284 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:04:54.487413 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-683fc1b1-09a9-43ab-8943-d2f258b935f1 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:54.488745 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-683fc1b1-09a9-43ab-8943-d2f258b935f1 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] [instance: c4052f17-eb91-4b32-ac5a-5464ba10c0a4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:54.491738 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5357a3d8-d57b-4f82-8ba0-73fb82b7055b tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:54.492392 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5357a3d8-d57b-4f82-8ba0-73fb82b7055b tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:54.504398 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-683fc1b1-09a9-43ab-8943-d2f258b935f1 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:54.506810 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-683fc1b1-09a9-43ab-8943-d2f258b935f1 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:54.507618 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-683fc1b1-09a9-43ab-8943-d2f258b935f1 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:54.508637 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-683fc1b1-09a9-43ab-8943-d2f258b935f1 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:54.509264 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-683fc1b1-09a9-43ab-8943-d2f258b935f1 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:54.509996 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-683fc1b1-09a9-43ab-8943-d2f258b935f1 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:54.511876 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5357a3d8-d57b-4f82-8ba0-73fb82b7055b tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:54.512431 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5357a3d8-d57b-4f82-8ba0-73fb82b7055b tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:54.512875 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5357a3d8-d57b-4f82-8ba0-73fb82b7055b tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:54.513646 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5357a3d8-d57b-4f82-8ba0-73fb82b7055b tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:54.514268 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5357a3d8-d57b-4f82-8ba0-73fb82b7055b tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:54.514846 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5357a3d8-d57b-4f82-8ba0-73fb82b7055b tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:54.893873 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5357a3d8-d57b-4f82-8ba0-73fb82b7055b tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:54.916896 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5357a3d8-d57b-4f82-8ba0-73fb82b7055b tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d" status: 200 len: 1510 microversion: 2.1 time: 0.429075 Sep 16 13:04:54.918123 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1879/3883] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:54 2022] GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d => generated 1510 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:04:54.934479 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-683fc1b1-09a9-43ab-8943-d2f258b935f1 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d7195f3c52474d96533d3f7df3642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20800c45135443888e60144c602a8429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:54.949737 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-683fc1b1-09a9-43ab-8943-d2f258b935f1 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] 10.222.0.67 "GET /compute/v2.1/servers/c4052f17-eb91-4b32-ac5a-5464ba10c0a4" status: 200 len: 1323 microversion: 2.1 time: 0.468141 Sep 16 13:04:54.951519 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2005/3884] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:54 2022] GET /compute/v2.1/servers/c4052f17-eb91-4b32-ac5a-5464ba10c0a4 => generated 1323 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:55.532726 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-84491b54-dfce-4225-983d-75085e76741d req-97331002-aa98-4938-9775-99549878b737 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a11bbd81-4323-466b-9d10-6f2d6c1913e4", "tag": "c40c0347-2b42-4346-a6fd-c898430328a0"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:04:55.533975 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a0f9d7d8-7651-4520-9927-ce6e44c1aee7 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:55.534772 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a0f9d7d8-7651-4520-9927-ce6e44c1aee7 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] [instance: a11bbd81-4323-466b-9d10-6f2d6c1913e4] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:55.547188 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-84491b54-dfce-4225-983d-75085e76741d req-97331002-aa98-4938-9775-99549878b737 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:55.547899 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-84491b54-dfce-4225-983d-75085e76741d req-97331002-aa98-4938-9775-99549878b737 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:55.548728 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-84491b54-dfce-4225-983d-75085e76741d req-97331002-aa98-4938-9775-99549878b737 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:55.555625 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a0f9d7d8-7651-4520-9927-ce6e44c1aee7 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:55.556152 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a0f9d7d8-7651-4520-9927-ce6e44c1aee7 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:55.557435 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a0f9d7d8-7651-4520-9927-ce6e44c1aee7 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:55.558478 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a0f9d7d8-7651-4520-9927-ce6e44c1aee7 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:55.559703 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a0f9d7d8-7651-4520-9927-ce6e44c1aee7 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:55.561713 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a0f9d7d8-7651-4520-9927-ce6e44c1aee7 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:55.577739 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-84491b54-dfce-4225-983d-75085e76741d req-97331002-aa98-4938-9775-99549878b737 service nova] Creating event network-changed:c40c0347-2b42-4346-a6fd-c898430328a0 for instance a11bbd81-4323-466b-9d10-6f2d6c1913e4 on n-h2-858094-4 Sep 16 13:04:55.586552 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-84491b54-dfce-4225-983d-75085e76741d req-97331002-aa98-4938-9775-99549878b737 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059479 Sep 16 13:04:55.587863 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2006/3885] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:04:55.778465 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a0f9d7d8-7651-4520-9927-ce6e44c1aee7 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59081fb246d34546980d57493efae40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2628c648b2e4465821bdcdf4330fb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:55.787289 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a0f9d7d8-7651-4520-9927-ce6e44c1aee7 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] 10.222.0.67 "GET /compute/v2.1/servers/a11bbd81-4323-466b-9d10-6f2d6c1913e4" status: 200 len: 1586 microversion: 2.1 time: 0.263581 Sep 16 13:04:55.800151 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1880/3886] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:55 2022] GET /compute/v2.1/servers/a11bbd81-4323-466b-9d10-6f2d6c1913e4 => generated 1586 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:55.943855 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ba6484e8-a7cf-442e-8be6-e1c1d70c1d8d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:55.945375 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ba6484e8-a7cf-442e-8be6-e1c1d70c1d8d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:55.952962 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba6484e8-a7cf-442e-8be6-e1c1d70c1d8d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:55.953992 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba6484e8-a7cf-442e-8be6-e1c1d70c1d8d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:55.954780 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba6484e8-a7cf-442e-8be6-e1c1d70c1d8d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:55.957261 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba6484e8-a7cf-442e-8be6-e1c1d70c1d8d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:55.957947 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba6484e8-a7cf-442e-8be6-e1c1d70c1d8d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:55.958571 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba6484e8-a7cf-442e-8be6-e1c1d70c1d8d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:55.977466 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8bbd0f01-a829-421e-9025-148e73c9d252 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:55.978985 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8bbd0f01-a829-421e-9025-148e73c9d252 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] [instance: c4052f17-eb91-4b32-ac5a-5464ba10c0a4] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:55.990066 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bbd0f01-a829-421e-9025-148e73c9d252 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:55.990579 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bbd0f01-a829-421e-9025-148e73c9d252 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:55.991025 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bbd0f01-a829-421e-9025-148e73c9d252 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:55.997126 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bbd0f01-a829-421e-9025-148e73c9d252 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:55.997126 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bbd0f01-a829-421e-9025-148e73c9d252 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:55.997523 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bbd0f01-a829-421e-9025-148e73c9d252 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:56.038038 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=100 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:04:56.229623 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ba6484e8-a7cf-442e-8be6-e1c1d70c1d8d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:56.240067 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ba6484e8-a7cf-442e-8be6-e1c1d70c1d8d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d" status: 200 len: 1487 microversion: 2.1 time: 0.300234 Sep 16 13:04:56.246740 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2007/3887] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:55 2022] GET /compute/v2.1/servers/17ed9fd4-313b-4cd7-8897-0f2a7bd20c1d => generated 1487 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:56.264800 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8bbd0f01-a829-421e-9025-148e73c9d252 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d7195f3c52474d96533d3f7df3642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20800c45135443888e60144c602a8429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:56.271316 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-19b51b26-d7b7-4662-b547-f88135cd37e9 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:04:56.274814 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-19b51b26-d7b7-4662-b547-f88135cd37e9 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:56.282249 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19b51b26-d7b7-4662-b547-f88135cd37e9 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:56.283130 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19b51b26-d7b7-4662-b547-f88135cd37e9 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:56.283813 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19b51b26-d7b7-4662-b547-f88135cd37e9 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:56.284040 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8bbd0f01-a829-421e-9025-148e73c9d252 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] 10.222.0.67 "GET /compute/v2.1/servers/c4052f17-eb91-4b32-ac5a-5464ba10c0a4" status: 200 len: 1519 microversion: 2.1 time: 0.310722 Sep 16 13:04:56.284869 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19b51b26-d7b7-4662-b547-f88135cd37e9 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:56.285543 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19b51b26-d7b7-4662-b547-f88135cd37e9 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:56.286293 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19b51b26-d7b7-4662-b547-f88135cd37e9 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:56.297966 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1881/3888] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:55 2022] GET /compute/v2.1/servers/c4052f17-eb91-4b32-ac5a-5464ba10c0a4 => generated 1519 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:04:56.404042 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-19b51b26-d7b7-4662-b547-f88135cd37e9 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "POST /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771/action" status: 200 len: 182 microversion: 2.1 time: 0.136798 Sep 16 13:04:56.410536 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2008/3889] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 13:04:56 2022] POST /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771/action => generated 182 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:04:56.417699 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-15d3e10a-3f5c-4e00-9ee7-360cd69ab7e9 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:56.418742 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-15d3e10a-3f5c-4e00-9ee7-360cd69ab7e9 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:56.436162 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-15d3e10a-3f5c-4e00-9ee7-360cd69ab7e9 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:56.441291 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-15d3e10a-3f5c-4e00-9ee7-360cd69ab7e9 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:56.445219 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-15d3e10a-3f5c-4e00-9ee7-360cd69ab7e9 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:56.449481 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-15d3e10a-3f5c-4e00-9ee7-360cd69ab7e9 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:56.451142 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-15d3e10a-3f5c-4e00-9ee7-360cd69ab7e9 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:56.452361 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-15d3e10a-3f5c-4e00-9ee7-360cd69ab7e9 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:56.608166 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f75a4a91-41c2-450d-af90-61e12846dd15 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-976783218", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "ec7d99db-29cf-4b25-8dc4-5bad41f23052"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f75a4a91-41c2-450d-af90-61e12846dd15 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Request method failure captured: Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 242 Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHRims7ushihsRbCCTfwH-hSig0shJRldi5v-Rtpin8I5cJ2bWAiCa4UsV7ObfgYKz2J66vjwLcrD1hVFwt1SEYi7jTADZObiVc-qpjHAYFJqe3lS4npetNK_vJi_LqGAoNoBzu5pxbKizh7ElH4ZbKyja1ldkbkMHaN4R7c202Mv4g Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 20800c45135443888e60144c602a8429 Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-857940296 Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/20800c45135443888e60144c602a8429"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/20800c45135443888e60144c602a8429"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_20800c45135443888e60144c602a8429", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/20800c45135443888e60144c602a8429"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-857940296 Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 20800c45135443888e60144c602a8429 Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-857940296 Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ServerMetadataNegativeTestJSON-857940296-project Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 45d7195f3c52474d96533d3f7df3642c Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-857940296-project Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-976783218", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "ec7d99db-29cf-4b25-8dc4-5bad41f23052"}]}} Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-976783218', 'imageRef': '7df4548b-8809-4742-80bd-4e4e6dcafc91', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'ec7d99db-29cf-4b25-8dc4-5bad41f23052'}]}}} Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise error Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi {'': 'data1'} Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:04:56.613282 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:04:56.617906 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 13:04:56.617906 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 13:04:56.617906 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 13:04:56.617906 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 13:04:56.617906 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 13:04:56.617906 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 13:04:56.617906 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 13:04:56.617906 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:56.617906 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:56.617906 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:56.617906 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:56.617906 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:04:56.617906 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:04:56.617906 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 13:04:56.617906 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 13:04:56.617906 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 13:04:56.617906 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:56.624253 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f75a4a91-41c2-450d-af90-61e12846dd15 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:04:56.625434 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f75a4a91-41c2-450d-af90-61e12846dd15 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.022141 Sep 16 13:04:56.629549 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2009/3890] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 13:04:56 2022] POST /compute/v2.1/servers => generated 175 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 16 13:04:56.640896 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-307c9622-d37a-4973-87db-8ad00b2d6b95 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:56.641528 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-307c9622-d37a-4973-87db-8ad00b2d6b95 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] [instance: 84423e2d-2385-43c2-ae3b-2a4ac3e31788] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:56.659175 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-307c9622-d37a-4973-87db-8ad00b2d6b95 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] HTTP exception thrown: Instance 84423e2d-2385-43c2-ae3b-2a4ac3e31788 could not be found. Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-307c9622-d37a-4973-87db-8ad00b2d6b95 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Request method failure captured: Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/84423e2d-2385-43c2-ae3b-2a4ac3e31788/metadata HTTP/1.1 Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHRims7ushihsRbCCTfwH-hSig0shJRldi5v-Rtpin8I5cJ2bWAiCa4UsV7ObfgYKz2J66vjwLcrD1hVFwt1SEYi7jTADZObiVc-qpjHAYFJqe3lS4npetNK_vJi_LqGAoNoBzu5pxbKizh7ElH4ZbKyja1ldkbkMHaN4R7c202Mv4g Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 20800c45135443888e60144c602a8429 Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-857940296 Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/20800c45135443888e60144c602a8429"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/20800c45135443888e60144c602a8429"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_20800c45135443888e60144c602a8429", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/20800c45135443888e60144c602a8429"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-857940296 Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 20800c45135443888e60144c602a8429 Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-857940296 Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ServerMetadataNegativeTestJSON-857940296-project Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 45d7195f3c52474d96533d3f7df3642c Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-857940296-project Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 84423e2d-2385-43c2-ae3b-2a4ac3e31788 could not be found. Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'server_id': '84423e2d-2385-43c2-ae3b-2a4ac3e31788'} Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84423e2d-2385-43c2-ae3b-2a4ac3e31788 could not be found. Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84423e2d-2385-43c2-ae3b-2a4ac3e31788 could not be found. Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:04:56.677773 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:04:56.682284 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:04:56.682284 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:04:56.682284 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84423e2d-2385-43c2-ae3b-2a4ac3e31788 could not be found. Sep 16 13:04:56.682284 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:56.682284 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-307c9622-d37a-4973-87db-8ad00b2d6b95 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Returning 404 to user: Instance 84423e2d-2385-43c2-ae3b-2a4ac3e31788 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:04:56.682284 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-307c9622-d37a-4973-87db-8ad00b2d6b95 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] 10.222.0.67 "GET /compute/v2.1/servers/84423e2d-2385-43c2-ae3b-2a4ac3e31788/metadata" status: 404 len: 111 microversion: 2.1 time: 0.043648 Sep 16 13:04:56.682284 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2010/3891] 10.222.0.67 () {58 vars in 1263 bytes} [Fri Sep 16 13:04:56 2022] GET /compute/v2.1/servers/84423e2d-2385-43c2-ae3b-2a4ac3e31788/metadata => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 13:04:56.779178 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a2cd7e78-2561-4dc1-9ad7-f17b6694ac51 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-354316066", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ec7d99db-29cf-4b25-8dc4-5bad41f23052"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a2cd7e78-2561-4dc1-9ad7-f17b6694ac51 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Request method failure captured: Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 498 Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHRims7ushihsRbCCTfwH-hSig0shJRldi5v-Rtpin8I5cJ2bWAiCa4UsV7ObfgYKz2J66vjwLcrD1hVFwt1SEYi7jTADZObiVc-qpjHAYFJqe3lS4npetNK_vJi_LqGAoNoBzu5pxbKizh7ElH4ZbKyja1ldkbkMHaN4R7c202Mv4g Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 20800c45135443888e60144c602a8429 Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-857940296 Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/20800c45135443888e60144c602a8429"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/20800c45135443888e60144c602a8429"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_20800c45135443888e60144c602a8429", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/20800c45135443888e60144c602a8429"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-857940296 Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 20800c45135443888e60144c602a8429 Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-857940296 Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ServerMetadataNegativeTestJSON-857940296-project Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 45d7195f3c52474d96533d3f7df3642c Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-857940296-project Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-354316066", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ec7d99db-29cf-4b25-8dc4-5bad41f23052"}]}} Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-354316066', 'imageRef': '7df4548b-8809-4742-80bd-4e4e6dcafc91', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'ec7d99db-29cf-4b25-8dc4-5bad41f23052'}]}}} Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise error Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 16 13:04:56.784845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 16 13:04:56.787967 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 16 13:04:56.787967 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:56.787967 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 16 13:04:56.787967 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 16 13:04:56.787967 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:56.787967 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:56.787967 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:56.787967 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:56.787967 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:04:56.787967 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:04:56.787967 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:04:56.787967 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:04:56.787967 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:04:56.787967 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:04:56.787967 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:04:56.787967 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:04:56.787967 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 13:04:56.787967 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 13:04:56.787967 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 13:04:56.787967 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 13:04:56.787967 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 13:04:56.787967 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 13:04:56.787967 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 13:04:56.787967 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:56.787967 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:56.787967 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:56.787967 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:56.787967 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:04:56.787967 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:04:56.787967 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 13:04:56.787967 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 13:04:56.787967 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 13:04:56.787967 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:56.794729 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a2cd7e78-2561-4dc1-9ad7-f17b6694ac51 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:04:56.795884 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a2cd7e78-2561-4dc1-9ad7-f17b6694ac51 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.021258 Sep 16 13:04:56.800840 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2011/3892] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 13:04:56 2022] POST /compute/v2.1/servers => generated 687 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 16 13:04:56.872887 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ac7309a2-2227-4f9e-8a56-9fd2ddd18954 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-760251824", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ec7d99db-29cf-4b25-8dc4-5bad41f23052"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ac7309a2-2227-4f9e-8a56-9fd2ddd18954 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Request method failure captured: Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 499 Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHRims7ushihsRbCCTfwH-hSig0shJRldi5v-Rtpin8I5cJ2bWAiCa4UsV7ObfgYKz2J66vjwLcrD1hVFwt1SEYi7jTADZObiVc-qpjHAYFJqe3lS4npetNK_vJi_LqGAoNoBzu5pxbKizh7ElH4ZbKyja1ldkbkMHaN4R7c202Mv4g Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 20800c45135443888e60144c602a8429 Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-857940296 Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/20800c45135443888e60144c602a8429"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/20800c45135443888e60144c602a8429"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_20800c45135443888e60144c602a8429", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/20800c45135443888e60144c602a8429"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-857940296 Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 20800c45135443888e60144c602a8429 Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-857940296 Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ServerMetadataNegativeTestJSON-857940296-project Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 45d7195f3c52474d96533d3f7df3642c Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-857940296-project Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-760251824", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ec7d99db-29cf-4b25-8dc4-5bad41f23052"}]}} Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-760251824', 'imageRef': '7df4548b-8809-4742-80bd-4e4e6dcafc91', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'ec7d99db-29cf-4b25-8dc4-5bad41f23052'}]}}} Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise error Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 16 13:04:56.885839 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 16 13:04:56.888871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 16 13:04:56.888871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:56.888871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 16 13:04:56.888871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 16 13:04:56.888871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:56.888871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:56.888871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:56.888871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:56.888871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:04:56.888871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:04:56.888871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:04:56.888871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:04:56.888871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:04:56.888871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:04:56.888871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:04:56.888871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:04:56.888871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 13:04:56.888871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 13:04:56.888871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 13:04:56.888871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 13:04:56.888871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 13:04:56.888871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 13:04:56.888871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 13:04:56.888871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:56.888871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:56.888871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:56.888871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:56.888871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:04:56.888871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:04:56.888871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 13:04:56.888871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 13:04:56.888871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 13:04:56.888871 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:56.888871 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ac7309a2-2227-4f9e-8a56-9fd2ddd18954 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:04:56.892773 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ac7309a2-2227-4f9e-8a56-9fd2ddd18954 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.026016 Sep 16 13:04:56.896394 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2012/3893] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 13:04:56 2022] POST /compute/v2.1/servers => generated 689 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 13:04:56.973295 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0058d8cc-f58e-47b6-adf4-f9e59831e153 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-496257548", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ec7d99db-29cf-4b25-8dc4-5bad41f23052"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:04:56.979714 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0058d8cc-f58e-47b6-adf4-f9e59831e153 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Request method failure captured: Sep 16 13:04:56.979714 n-d-858094-4 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 16 13:04:56.979714 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:04:56.979714 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:04:56.979714 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:04:56.979714 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 753 Sep 16 13:04:56.979714 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:04:56.979714 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:04:56.979714 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:04:56.979714 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:04:56.979714 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHRims7ushihsRbCCTfwH-hSig0shJRldi5v-Rtpin8I5cJ2bWAiCa4UsV7ObfgYKz2J66vjwLcrD1hVFwt1SEYi7jTADZObiVc-qpjHAYFJqe3lS4npetNK_vJi_LqGAoNoBzu5pxbKizh7ElH4ZbKyja1ldkbkMHaN4R7c202Mv4g Sep 16 13:04:56.979714 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:04:56.979714 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:04:56.979714 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:04:56.979714 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:04:56.979714 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:04:56.979714 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:04:56.979714 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 20800c45135443888e60144c602a8429 Sep 16 13:04:56.979714 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-857940296 Sep 16 13:04:56.979714 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:04:56.979714 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:04:56.979714 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/20800c45135443888e60144c602a8429"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/20800c45135443888e60144c602a8429"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_20800c45135443888e60144c602a8429", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/20800c45135443888e60144c602a8429"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:04:56.979714 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-857940296 Sep 16 13:04:56.979714 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 20800c45135443888e60144c602a8429 Sep 16 13:04:56.979714 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-857940296 Sep 16 13:04:56.979714 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ServerMetadataNegativeTestJSON-857940296-project Sep 16 13:04:56.979714 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:04:56.979714 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:04:56.979714 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 45d7195f3c52474d96533d3f7df3642c Sep 16 13:04:56.979714 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-857940296-project Sep 16 13:04:56.979714 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 13:04:56.979714 n-d-858094-4 devstack@n-api.service[128779]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-496257548", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ec7d99db-29cf-4b25-8dc4-5bad41f23052"}]}} Sep 16 13:04:56.979714 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 13:04:56.979714 n-d-858094-4 devstack@n-api.service[128779]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 13:04:56.979714 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-496257548', 'imageRef': '7df4548b-8809-4742-80bd-4e4e6dcafc91', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'ec7d99db-29cf-4b25-8dc4-5bad41f23052'}]}}} Sep 16 13:04:56.979714 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:04:56.979714 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:56.979714 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 13:04:56.979714 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 13:04:56.979714 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 13:04:56.982211 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise error Sep 16 13:04:56.982211 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 13:04:56.982211 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:56.982211 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 16 13:04:56.982211 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 16 13:04:56.982211 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 16 13:04:56.982211 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 16 13:04:56.982211 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 16 13:04:56.982211 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:56.982211 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 16 13:04:56.982211 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 16 13:04:56.982211 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:56.982211 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:56.982211 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:56.982211 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:56.982211 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:04:56.982211 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:04:56.982211 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:04:56.982211 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:04:56.982211 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:04:56.982211 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:04:56.982211 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:04:56.982211 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:04:56.982211 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 13:04:56.982211 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 13:04:56.982211 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 13:04:56.982211 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 13:04:56.982211 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 13:04:56.982211 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 13:04:56.982211 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 13:04:56.982211 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:56.982211 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:56.982211 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:56.982211 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:56.982211 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:04:56.982211 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:04:56.982211 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 13:04:56.982211 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 13:04:56.986923 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 13:04:56.986923 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:56.986923 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0058d8cc-f58e-47b6-adf4-f9e59831e153 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:04:56.986923 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0058d8cc-f58e-47b6-adf4-f9e59831e153 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.013117 Sep 16 13:04:56.987677 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2013/3894] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 13:04:56 2022] POST /compute/v2.1/servers => generated 1197 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Sep 16 13:04:57.067493 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-adc1b488-8345-4d95-9e9f-ebac5a90c49b tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1473962687", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ec7d99db-29cf-4b25-8dc4-5bad41f23052"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:04:57.073979 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-adc1b488-8345-4d95-9e9f-ebac5a90c49b tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Request method failure captured: Sep 16 13:04:57.073979 n-d-858094-4 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 16 13:04:57.073979 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:04:57.073979 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:04:57.073979 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:04:57.073979 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 1266 Sep 16 13:04:57.073979 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:04:57.073979 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:04:57.073979 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:04:57.073979 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:04:57.073979 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHRims7ushihsRbCCTfwH-hSig0shJRldi5v-Rtpin8I5cJ2bWAiCa4UsV7ObfgYKz2J66vjwLcrD1hVFwt1SEYi7jTADZObiVc-qpjHAYFJqe3lS4npetNK_vJi_LqGAoNoBzu5pxbKizh7ElH4ZbKyja1ldkbkMHaN4R7c202Mv4g Sep 16 13:04:57.073979 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:04:57.073979 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:04:57.073979 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:04:57.073979 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:04:57.073979 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:04:57.073979 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:04:57.073979 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 20800c45135443888e60144c602a8429 Sep 16 13:04:57.073979 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-857940296 Sep 16 13:04:57.073979 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:04:57.073979 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:04:57.073979 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/20800c45135443888e60144c602a8429"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/20800c45135443888e60144c602a8429"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_20800c45135443888e60144c602a8429", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/20800c45135443888e60144c602a8429"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:04:57.073979 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-857940296 Sep 16 13:04:57.073979 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 20800c45135443888e60144c602a8429 Sep 16 13:04:57.073979 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-857940296 Sep 16 13:04:57.073979 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ServerMetadataNegativeTestJSON-857940296-project Sep 16 13:04:57.073979 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:04:57.073979 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:04:57.073979 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 45d7195f3c52474d96533d3f7df3642c Sep 16 13:04:57.073979 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-857940296-project Sep 16 13:04:57.073979 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 13:04:57.073979 n-d-858094-4 devstack@n-api.service[128779]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1473962687", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ec7d99db-29cf-4b25-8dc4-5bad41f23052"}]}} Sep 16 13:04:57.073979 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 13:04:57.075872 n-d-858094-4 devstack@n-api.service[128779]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 13:04:57.075872 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1473962687', 'imageRef': '7df4548b-8809-4742-80bd-4e4e6dcafc91', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'ec7d99db-29cf-4b25-8dc4-5bad41f23052'}]}}} Sep 16 13:04:57.075872 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:04:57.075872 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:57.075872 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 13:04:57.075872 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 13:04:57.075872 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 13:04:57.075872 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise error Sep 16 13:04:57.075872 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 13:04:57.075872 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:57.075872 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 16 13:04:57.075872 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 16 13:04:57.075872 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 16 13:04:57.075872 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 16 13:04:57.075872 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 16 13:04:57.075872 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:57.075872 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 16 13:04:57.076845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 16 13:04:57.076845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:57.076845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:57.076845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:57.076845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:57.076845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:04:57.076845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:04:57.076845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:04:57.076845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:04:57.076845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:04:57.076845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:04:57.076845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:04:57.076845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:04:57.076845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 13:04:57.076845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 13:04:57.076845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 13:04:57.076845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 13:04:57.076845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 13:04:57.076845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 13:04:57.076845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 13:04:57.076845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:57.076845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:57.076845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:57.076845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:57.076845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:04:57.076845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:04:57.076845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 13:04:57.076845 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 13:04:57.078286 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 13:04:57.078286 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:57.078286 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-adc1b488-8345-4d95-9e9f-ebac5a90c49b tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:04:57.078286 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-adc1b488-8345-4d95-9e9f-ebac5a90c49b tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.013495 Sep 16 13:04:57.078286 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2014/3895] 10.222.0.67 () {60 vars in 1148 bytes} [Fri Sep 16 13:04:57 2022] POST /compute/v2.1/servers => generated 2221 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Sep 16 13:04:57.111355 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-da79f3fa-ba62-4c3b-a7ab-3407791c0e32 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:57.120244 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-da79f3fa-ba62-4c3b-a7ab-3407791c0e32 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] [instance: f08db368-7d8a-4a66-afdb-a4370aa34e0c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:57.126932 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-da79f3fa-ba62-4c3b-a7ab-3407791c0e32 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] HTTP exception thrown: Instance f08db368-7d8a-4a66-afdb-a4370aa34e0c could not be found. Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-da79f3fa-ba62-4c3b-a7ab-3407791c0e32 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Request method failure captured: Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/f08db368-7d8a-4a66-afdb-a4370aa34e0c/metadata/test2 HTTP/1.1 Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHRims7ushihsRbCCTfwH-hSig0shJRldi5v-Rtpin8I5cJ2bWAiCa4UsV7ObfgYKz2J66vjwLcrD1hVFwt1SEYi7jTADZObiVc-qpjHAYFJqe3lS4npetNK_vJi_LqGAoNoBzu5pxbKizh7ElH4ZbKyja1ldkbkMHaN4R7c202Mv4g Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 20800c45135443888e60144c602a8429 Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-857940296 Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/20800c45135443888e60144c602a8429"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/20800c45135443888e60144c602a8429"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_20800c45135443888e60144c602a8429", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/20800c45135443888e60144c602a8429"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-857940296 Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 20800c45135443888e60144c602a8429 Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-857940296 Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ServerMetadataNegativeTestJSON-857940296-project Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 45d7195f3c52474d96533d3f7df3642c Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-857940296-project Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance f08db368-7d8a-4a66-afdb-a4370aa34e0c could not be found. Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'server_id': 'f08db368-7d8a-4a66-afdb-a4370aa34e0c', 'id': 'test2'} Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f08db368-7d8a-4a66-afdb-a4370aa34e0c could not be found. Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f08db368-7d8a-4a66-afdb-a4370aa34e0c could not be found. Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:04:57.134112 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:04:57.138621 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:04:57.138621 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:04:57.138621 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f08db368-7d8a-4a66-afdb-a4370aa34e0c could not be found. Sep 16 13:04:57.138621 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:04:57.143765 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-da79f3fa-ba62-4c3b-a7ab-3407791c0e32 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Returning 404 to user: Instance f08db368-7d8a-4a66-afdb-a4370aa34e0c could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:04:57.144861 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-da79f3fa-ba62-4c3b-a7ab-3407791c0e32 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] 10.222.0.67 "GET /compute/v2.1/servers/f08db368-7d8a-4a66-afdb-a4370aa34e0c/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.057946 Sep 16 13:04:57.145584 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2015/3896] 10.222.0.67 () {58 vars in 1281 bytes} [Fri Sep 16 13:04:57 2022] GET /compute/v2.1/servers/f08db368-7d8a-4a66-afdb-a4370aa34e0c/metadata/test2 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:04:57.160764 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8d6188a0-b1b4-4896-90de-170ff20418e3 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:57.170374 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8d6188a0-b1b4-4896-90de-170ff20418e3 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] [instance: c4052f17-eb91-4b32-ac5a-5464ba10c0a4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:57.189198 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d6188a0-b1b4-4896-90de-170ff20418e3 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:57.190095 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d6188a0-b1b4-4896-90de-170ff20418e3 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:57.190810 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d6188a0-b1b4-4896-90de-170ff20418e3 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:57.192808 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d6188a0-b1b4-4896-90de-170ff20418e3 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:57.193538 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d6188a0-b1b4-4896-90de-170ff20418e3 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:57.194199 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d6188a0-b1b4-4896-90de-170ff20418e3 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:57.229048 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8d6188a0-b1b4-4896-90de-170ff20418e3 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] [instance: c4052f17-eb91-4b32-ac5a-5464ba10c0a4] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:04:57.316100 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-15d3e10a-3f5c-4e00-9ee7-360cd69ab7e9 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:57.328568 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-15d3e10a-3f5c-4e00-9ee7-360cd69ab7e9 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1665 microversion: 2.1 time: 0.915703 Sep 16 13:04:57.331290 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1882/3897] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:56 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1665 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:57.370331 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5597b9bc-c0d4-44f2-9a4d-ef1ad271da53 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:57.371566 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5597b9bc-c0d4-44f2-9a4d-ef1ad271da53 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:57.372949 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8d6188a0-b1b4-4896-90de-170ff20418e3 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c4052f17-eb91-4b32-ac5a-5464ba10c0a4" status: 204 len: 0 microversion: 2.1 time: 0.215788 Sep 16 13:04:57.377489 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2016/3898] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 13:04:57 2022] DELETE /compute/v2.1/servers/c4052f17-eb91-4b32-ac5a-5464ba10c0a4 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:04:57.390651 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-41b0f526-09b9-4e6d-8a36-4ba8f5ac4f4f tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:57.392033 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-41b0f526-09b9-4e6d-8a36-4ba8f5ac4f4f tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] [instance: c4052f17-eb91-4b32-ac5a-5464ba10c0a4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:57.393452 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5597b9bc-c0d4-44f2-9a4d-ef1ad271da53 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:57.393948 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5597b9bc-c0d4-44f2-9a4d-ef1ad271da53 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:57.394375 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5597b9bc-c0d4-44f2-9a4d-ef1ad271da53 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:57.395240 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5597b9bc-c0d4-44f2-9a4d-ef1ad271da53 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:57.395836 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5597b9bc-c0d4-44f2-9a4d-ef1ad271da53 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:57.396440 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5597b9bc-c0d4-44f2-9a4d-ef1ad271da53 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:57.399761 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41b0f526-09b9-4e6d-8a36-4ba8f5ac4f4f tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:57.400594 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41b0f526-09b9-4e6d-8a36-4ba8f5ac4f4f tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:57.402723 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41b0f526-09b9-4e6d-8a36-4ba8f5ac4f4f tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:57.403954 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41b0f526-09b9-4e6d-8a36-4ba8f5ac4f4f tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:57.404530 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41b0f526-09b9-4e6d-8a36-4ba8f5ac4f4f tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:57.405838 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41b0f526-09b9-4e6d-8a36-4ba8f5ac4f4f tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:58.029173 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-41b0f526-09b9-4e6d-8a36-4ba8f5ac4f4f tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d7195f3c52474d96533d3f7df3642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20800c45135443888e60144c602a8429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:58.049489 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-41b0f526-09b9-4e6d-8a36-4ba8f5ac4f4f tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] 10.222.0.67 "GET /compute/v2.1/servers/c4052f17-eb91-4b32-ac5a-5464ba10c0a4" status: 200 len: 1525 microversion: 2.1 time: 0.661723 Sep 16 13:04:58.050585 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2017/3899] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:57 2022] GET /compute/v2.1/servers/c4052f17-eb91-4b32-ac5a-5464ba10c0a4 => generated 1525 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:58.117223 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5597b9bc-c0d4-44f2-9a4d-ef1ad271da53 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:58.145064 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5597b9bc-c0d4-44f2-9a4d-ef1ad271da53 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1665 microversion: 2.1 time: 0.783339 Sep 16 13:04:58.152106 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1883/3900] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:57 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1665 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:58.179307 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d4515c7f-a91a-4c84-b3d5-0e8da2162fb0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:58.179826 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d4515c7f-a91a-4c84-b3d5-0e8da2162fb0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:58.202154 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4515c7f-a91a-4c84-b3d5-0e8da2162fb0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:58.202664 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4515c7f-a91a-4c84-b3d5-0e8da2162fb0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:58.203250 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4515c7f-a91a-4c84-b3d5-0e8da2162fb0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:58.204046 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4515c7f-a91a-4c84-b3d5-0e8da2162fb0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:58.204625 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4515c7f-a91a-4c84-b3d5-0e8da2162fb0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:58.205066 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4515c7f-a91a-4c84-b3d5-0e8da2162fb0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:58.652485 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d4515c7f-a91a-4c84-b3d5-0e8da2162fb0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:58.662920 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d4515c7f-a91a-4c84-b3d5-0e8da2162fb0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1665 microversion: 2.1 time: 0.487561 Sep 16 13:04:58.663512 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2018/3901] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:58 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1665 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:04:58.686592 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-42a77353-1db8-4322-98d4-150968808e2d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:58.687851 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-42a77353-1db8-4322-98d4-150968808e2d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:58.728342 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-42a77353-1db8-4322-98d4-150968808e2d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:58.730567 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-42a77353-1db8-4322-98d4-150968808e2d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:58.735368 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-42a77353-1db8-4322-98d4-150968808e2d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:58.736572 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-42a77353-1db8-4322-98d4-150968808e2d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:58.740917 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-42a77353-1db8-4322-98d4-150968808e2d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:58.752635 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-42a77353-1db8-4322-98d4-150968808e2d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:59.074553 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f94cac13-ffc4-43b7-89ff-e5a20a486fad tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:04:59.075190 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f94cac13-ffc4-43b7-89ff-e5a20a486fad tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] [instance: c4052f17-eb91-4b32-ac5a-5464ba10c0a4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:04:59.086266 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f94cac13-ffc4-43b7-89ff-e5a20a486fad tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:59.087085 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f94cac13-ffc4-43b7-89ff-e5a20a486fad tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:59.090502 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f94cac13-ffc4-43b7-89ff-e5a20a486fad tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:59.091517 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f94cac13-ffc4-43b7-89ff-e5a20a486fad tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:04:59.092193 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f94cac13-ffc4-43b7-89ff-e5a20a486fad tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:04:59.092944 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f94cac13-ffc4-43b7-89ff-e5a20a486fad tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:04:59.789102 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f94cac13-ffc4-43b7-89ff-e5a20a486fad tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d7195f3c52474d96533d3f7df3642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20800c45135443888e60144c602a8429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:04:59.799090 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f94cac13-ffc4-43b7-89ff-e5a20a486fad tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] 10.222.0.67 "GET /compute/v2.1/servers/c4052f17-eb91-4b32-ac5a-5464ba10c0a4" status: 200 len: 1525 microversion: 2.1 time: 0.728878 Sep 16 13:04:59.817037 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2019/3902] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:59 2022] GET /compute/v2.1/servers/c4052f17-eb91-4b32-ac5a-5464ba10c0a4 => generated 1525 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:05:00.460845 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-42a77353-1db8-4322-98d4-150968808e2d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:00.488024 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-42a77353-1db8-4322-98d4-150968808e2d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1665 microversion: 2.1 time: 1.805181 Sep 16 13:05:00.512152 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1884/3903] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:04:58 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1665 bytes in 1830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:05:00.634276 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-01d22d16-aec5-4611-8542-e4bf2537d5ff tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:00.637439 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-01d22d16-aec5-4611-8542-e4bf2537d5ff tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:00.654950 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01d22d16-aec5-4611-8542-e4bf2537d5ff tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:00.655521 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01d22d16-aec5-4611-8542-e4bf2537d5ff tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:00.656242 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01d22d16-aec5-4611-8542-e4bf2537d5ff tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:00.657360 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01d22d16-aec5-4611-8542-e4bf2537d5ff tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:00.658608 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01d22d16-aec5-4611-8542-e4bf2537d5ff tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:00.659433 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01d22d16-aec5-4611-8542-e4bf2537d5ff tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:00.724359 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-01d22d16-aec5-4611-8542-e4bf2537d5ff tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44/os-volume_attachments/73c6e108-268d-4aa7-8056-d5957bfff255" status: 200 len: 194 microversion: 2.20 time: 0.096096 Sep 16 13:05:00.730545 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b3a9cf44-6d80-4431-9868-01209c18e705 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-307626118", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": [{"uuid": "9af47dcf-ef82-4350-bfb1-14c70158aca5"}]}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:05:00.732344 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2020/3904] 10.222.0.67 () {60 vars in 1454 bytes} [Fri Sep 16 13:05:00 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44/os-volume_attachments/73c6e108-268d-4aa7-8056-d5957bfff255 => generated 194 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:05:00.838031 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-93b427bf-5bd5-4a4d-bd80-8949b3d49edd tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:00.838586 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-93b427bf-5bd5-4a4d-bd80-8949b3d49edd tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] [instance: c4052f17-eb91-4b32-ac5a-5464ba10c0a4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:00.855954 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-b3a9cf44-6d80-4431-9868-01209c18e705 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] validate_networks() for [('9af47dcf-ef82-4350-bfb1-14c70158aca5', None, None, None, None, None)] {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:05:00.869965 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93b427bf-5bd5-4a4d-bd80-8949b3d49edd tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:00.875170 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93b427bf-5bd5-4a4d-bd80-8949b3d49edd tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:00.875625 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93b427bf-5bd5-4a4d-bd80-8949b3d49edd tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:00.876403 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93b427bf-5bd5-4a4d-bd80-8949b3d49edd tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:00.882162 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93b427bf-5bd5-4a4d-bd80-8949b3d49edd tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:00.882786 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93b427bf-5bd5-4a4d-bd80-8949b3d49edd tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:01.379711 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-93b427bf-5bd5-4a4d-bd80-8949b3d49edd tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d7195f3c52474d96533d3f7df3642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20800c45135443888e60144c602a8429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:01.390989 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-93b427bf-5bd5-4a4d-bd80-8949b3d49edd tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] 10.222.0.67 "GET /compute/v2.1/servers/c4052f17-eb91-4b32-ac5a-5464ba10c0a4" status: 200 len: 1525 microversion: 2.1 time: 0.572797 Sep 16 13:05:01.410288 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2021/3905] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:05:00 2022] GET /compute/v2.1/servers/c4052f17-eb91-4b32-ac5a-5464ba10c0a4 => generated 1525 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:05:01.416747 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3c3c2c89-9230-4f0d-b9fe-13064c323111 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:01.417257 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3c3c2c89-9230-4f0d-b9fe-13064c323111 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:01.432096 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c3c2c89-9230-4f0d-b9fe-13064c323111 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:01.436860 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c3c2c89-9230-4f0d-b9fe-13064c323111 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:01.438738 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c3c2c89-9230-4f0d-b9fe-13064c323111 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:01.439519 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c3c2c89-9230-4f0d-b9fe-13064c323111 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:01.439995 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c3c2c89-9230-4f0d-b9fe-13064c323111 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:01.440454 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c3c2c89-9230-4f0d-b9fe-13064c323111 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:01.473007 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:05:01.564863 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-3c3c2c89-9230-4f0d-b9fe-13064c323111 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lazy-loading 'services' on Instance uuid 66413dbd-455f-45f6-b057-39a11a9f2d44 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:05:01.658837 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3c3c2c89-9230-4f0d-b9fe-13064c323111 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "DELETE /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44/os-volume_attachments/73c6e108-268d-4aa7-8056-d5957bfff255" status: 202 len: 0 microversion: 2.20 time: 0.247135 Sep 16 13:05:01.659480 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2022/3906] 10.222.0.67 () {60 vars in 1457 bytes} [Fri Sep 16 13:05:01 2022] DELETE /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44/os-volume_attachments/73c6e108-268d-4aa7-8056-d5957bfff255 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:05:01.851554 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-25fe81ca-7ead-4fff-9732-5cc9b5892a9c tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Action: 'create', calling method: .version_select at 0x7f103563d700>, body: {"keypair": {"name": "tempest-keypair-130891515", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRKDweUF859rua0M5TXCfykxWpTE/Y1SwJeLyvx4IfUs9Ql1xwiEcgWB0QjbaM4FJWJiRVV7YlGQ5+kIoo1U/QthkZouLmPOyrKBtXjioPzTJYSB2w37FFfcld9reLV/A=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:05:01.869679 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-25fe81ca-7ead-4fff-9732-5cc9b5892a9c tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Getting quotas for project 069d839f047b4c38a1dae0ff8d692230. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:05:01.875775 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-25fe81ca-7ead-4fff-9732-5cc9b5892a9c tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Getting quotas for user aa734086fec1432d88be79bc2fb0ec91 and project 069d839f047b4c38a1dae0ff8d692230. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:05:01.905734 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-25fe81ca-7ead-4fff-9732-5cc9b5892a9c tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.244979 Sep 16 13:05:01.906659 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2023/3907] 10.222.0.67 () {60 vars in 1159 bytes} [Fri Sep 16 13:05:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:05:01.911844 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-089b80d6-1393-443d-ada4-26ec50cf7009 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:01.915032 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-089b80d6-1393-443d-ada4-26ec50cf7009 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:01.922630 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-089b80d6-1393-443d-ada4-26ec50cf7009 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:01.923484 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-089b80d6-1393-443d-ada4-26ec50cf7009 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:01.924164 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-089b80d6-1393-443d-ada4-26ec50cf7009 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:01.925154 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-089b80d6-1393-443d-ada4-26ec50cf7009 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:01.925761 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-089b80d6-1393-443d-ada4-26ec50cf7009 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:01.926641 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-089b80d6-1393-443d-ada4-26ec50cf7009 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:01.995456 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-089b80d6-1393-443d-ada4-26ec50cf7009 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.087472 Sep 16 13:05:02.000213 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2024/3908] 10.222.0.67 () {60 vars in 1343 bytes} [Fri Sep 16 13:05:01 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:05:02.005421 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-1f1f6b6c-5ce9-41d8-bca0-f261dfdd4076 req-f1e2c0ca-07dc-412a-82a8-0af727e47020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4052f17-eb91-4b32-ac5a-5464ba10c0a4", "name": "network-vif-deleted", "tag": "05cfdbd1-f34b-468d-a8ad-b77eeac8c622"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:05:02.016197 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1f1f6b6c-5ce9-41d8-bca0-f261dfdd4076 req-f1e2c0ca-07dc-412a-82a8-0af727e47020 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:02.017039 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1f1f6b6c-5ce9-41d8-bca0-f261dfdd4076 req-f1e2c0ca-07dc-412a-82a8-0af727e47020 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:02.017574 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1f1f6b6c-5ce9-41d8-bca0-f261dfdd4076 req-f1e2c0ca-07dc-412a-82a8-0af727e47020 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:02.031817 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-1f1f6b6c-5ce9-41d8-bca0-f261dfdd4076 req-f1e2c0ca-07dc-412a-82a8-0af727e47020 service nova] Creating event network-vif-deleted:05cfdbd1-f34b-468d-a8ad-b77eeac8c622 for instance c4052f17-eb91-4b32-ac5a-5464ba10c0a4 on n-h2-858094-4 Sep 16 13:05:02.037838 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-1f1f6b6c-5ce9-41d8-bca0-f261dfdd4076 req-f1e2c0ca-07dc-412a-82a8-0af727e47020 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035984 Sep 16 13:05:02.039036 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2025/3909] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:05:02.399611 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-b3a9cf44-6d80-4431-9868-01209c18e705 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:05:02.401241 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-b3a9cf44-6d80-4431-9868-01209c18e705 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:05:02.401907 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-b3a9cf44-6d80-4431-9868-01209c18e705 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:05:02.402499 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-b3a9cf44-6d80-4431-9868-01209c18e705 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:05:02.403260 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-b3a9cf44-6d80-4431-9868-01209c18e705 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:05:02.422062 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4f0538bb-2565-4c16-a98f-17e7375ca847 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:02.423134 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4f0538bb-2565-4c16-a98f-17e7375ca847 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] [instance: c4052f17-eb91-4b32-ac5a-5464ba10c0a4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:02.433443 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b3a9cf44-6d80-4431-9868-01209c18e705 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:02.438815 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b3a9cf44-6d80-4431-9868-01209c18e705 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:02.443552 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b3a9cf44-6d80-4431-9868-01209c18e705 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:02.444917 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f0538bb-2565-4c16-a98f-17e7375ca847 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:02.446753 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b3a9cf44-6d80-4431-9868-01209c18e705 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:02.448472 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f0538bb-2565-4c16-a98f-17e7375ca847 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:02.449032 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f0538bb-2565-4c16-a98f-17e7375ca847 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:02.449784 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f0538bb-2565-4c16-a98f-17e7375ca847 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:02.450542 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f0538bb-2565-4c16-a98f-17e7375ca847 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:02.450976 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f0538bb-2565-4c16-a98f-17e7375ca847 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:02.454628 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b3a9cf44-6d80-4431-9868-01209c18e705 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:02.455210 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b3a9cf44-6d80-4431-9868-01209c18e705 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:02.523752 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-b3a9cf44-6d80-4431-9868-01209c18e705 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Getting quotas for project 337bc9a50c6846ada58b194c94d0f193. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:05:02.538845 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f0538bb-2565-4c16-a98f-17e7375ca847 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:02.542579 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f0538bb-2565-4c16-a98f-17e7375ca847 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:02.543281 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f0538bb-2565-4c16-a98f-17e7375ca847 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:02.544078 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-4f0538bb-2565-4c16-a98f-17e7375ca847 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lazy-loading 'fault' on Instance uuid c4052f17-eb91-4b32-ac5a-5464ba10c0a4 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:05:02.557591 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-b3a9cf44-6d80-4431-9868-01209c18e705 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Getting quotas for user 968cbe62235f472fb9002171f19e1375 and project 337bc9a50c6846ada58b194c94d0f193. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:05:02.576665 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b3a9cf44-6d80-4431-9868-01209c18e705 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:05:02.580689 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b3a9cf44-6d80-4431-9868-01209c18e705 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 261a8ed1-8a0c-4a83-a4e4-f3094ad3824c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:05:02.648393 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b3a9cf44-6d80-4431-9868-01209c18e705 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.923380 Sep 16 13:05:02.649700 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1885/3910] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 13:05:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 13:05:02.667840 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-28e07d27-c7dd-4c9c-a9f7-839cbae116ff tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:02.668793 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-28e07d27-c7dd-4c9c-a9f7-839cbae116ff tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 261a8ed1-8a0c-4a83-a4e4-f3094ad3824c] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:02.905246 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4f0538bb-2565-4c16-a98f-17e7375ca847 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d7195f3c52474d96533d3f7df3642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20800c45135443888e60144c602a8429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:02.936718 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4f0538bb-2565-4c16-a98f-17e7375ca847 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] 10.222.0.67 "GET /compute/v2.1/servers/c4052f17-eb91-4b32-ac5a-5464ba10c0a4" status: 200 len: 1313 microversion: 2.1 time: 0.523067 Sep 16 13:05:02.940844 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2026/3911] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:05:02 2022] GET /compute/v2.1/servers/c4052f17-eb91-4b32-ac5a-5464ba10c0a4 => generated 1313 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:05:03.015584 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5cddf284-c73e-4dde-ae35-e90ff65c58dd tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:03.018023 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5cddf284-c73e-4dde-ae35-e90ff65c58dd tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:03.038433 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5cddf284-c73e-4dde-ae35-e90ff65c58dd tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:03.038868 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5cddf284-c73e-4dde-ae35-e90ff65c58dd tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:03.039311 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5cddf284-c73e-4dde-ae35-e90ff65c58dd tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:03.040030 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5cddf284-c73e-4dde-ae35-e90ff65c58dd tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:03.040548 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5cddf284-c73e-4dde-ae35-e90ff65c58dd tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:03.040982 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5cddf284-c73e-4dde-ae35-e90ff65c58dd tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:03.073813 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-28e07d27-c7dd-4c9c-a9f7-839cbae116ff tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:03.081681 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-28e07d27-c7dd-4c9c-a9f7-839cbae116ff tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c" status: 200 len: 1214 microversion: 2.1 time: 0.424605 Sep 16 13:05:03.093154 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1886/3912] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:05:02 2022] GET /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c => generated 1214 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:05:03.145322 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5cddf284-c73e-4dde-ae35-e90ff65c58dd tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.136454 Sep 16 13:05:03.145919 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2027/3913] 10.222.0.67 () {60 vars in 1343 bytes} [Fri Sep 16 13:05:03 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 13:05:03.969478 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-81a34876-2daa-4f17-851a-f9ea5cecde25 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:03.972051 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-81a34876-2daa-4f17-851a-f9ea5cecde25 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] [instance: c4052f17-eb91-4b32-ac5a-5464ba10c0a4] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:03.997347 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-81a34876-2daa-4f17-851a-f9ea5cecde25 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:03.998325 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-81a34876-2daa-4f17-851a-f9ea5cecde25 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:04.001428 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-81a34876-2daa-4f17-851a-f9ea5cecde25 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:04.006913 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-81a34876-2daa-4f17-851a-f9ea5cecde25 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:04.008396 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-81a34876-2daa-4f17-851a-f9ea5cecde25 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:04.010545 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-81a34876-2daa-4f17-851a-f9ea5cecde25 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:04.049710 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-81a34876-2daa-4f17-851a-f9ea5cecde25 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] HTTP exception thrown: Instance c4052f17-eb91-4b32-ac5a-5464ba10c0a4 could not be found. Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-81a34876-2daa-4f17-851a-f9ea5cecde25 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Request method failure captured: Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: request: GET /compute/v2.1/servers/c4052f17-eb91-4b32-ac5a-5464ba10c0a4 HTTP/1.1 Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 0 Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHRims7ushihsRbCCTfwH-hSig0shJRldi5v-Rtpin8I5cJ2bWAiCa4UsV7ObfgYKz2J66vjwLcrD1hVFwt1SEYi7jTADZObiVc-qpjHAYFJqe3lS4npetNK_vJi_LqGAoNoBzu5pxbKizh7ElH4ZbKyja1ldkbkMHaN4R7c202Mv4g Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 20800c45135443888e60144c602a8429 Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-857940296 Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/20800c45135443888e60144c602a8429"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/20800c45135443888e60144c602a8429"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_20800c45135443888e60144c602a8429", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/20800c45135443888e60144c602a8429"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-857940296 Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 20800c45135443888e60144c602a8429 Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-857940296 Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ServerMetadataNegativeTestJSON-857940296-project Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 45d7195f3c52474d96533d3f7df3642c Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-857940296-project Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance c4052f17-eb91-4b32-ac5a-5464ba10c0a4 could not be found. Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': 'c4052f17-eb91-4b32-ac5a-5464ba10c0a4'} Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4052f17-eb91-4b32-ac5a-5464ba10c0a4 could not be found. Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4052f17-eb91-4b32-ac5a-5464ba10c0a4 could not be found. Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:05:04.051812 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:05:04.055403 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:05:04.055403 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:05:04.055403 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:05:04.055403 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:05:04.055403 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:05:04.055403 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:05:04.055403 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4052f17-eb91-4b32-ac5a-5464ba10c0a4 could not be found. Sep 16 13:05:04.055403 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:05:04.058852 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-81a34876-2daa-4f17-851a-f9ea5cecde25 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] Returning 404 to user: Instance c4052f17-eb91-4b32-ac5a-5464ba10c0a4 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:05:04.060201 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-81a34876-2daa-4f17-851a-f9ea5cecde25 tempest-ServerMetadataNegativeTestJSON-857940296 tempest-ServerMetadataNegativeTestJSON-857940296-project] 10.222.0.67 "GET /compute/v2.1/servers/c4052f17-eb91-4b32-ac5a-5464ba10c0a4" status: 404 len: 111 microversion: 2.1 time: 0.099069 Sep 16 13:05:04.061350 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1887/3914] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:05:03 2022] GET /compute/v2.1/servers/c4052f17-eb91-4b32-ac5a-5464ba10c0a4 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:05:04.117187 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-442cff3e-0944-458b-a8f7-7b131350f052 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:04.120007 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-442cff3e-0944-458b-a8f7-7b131350f052 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 261a8ed1-8a0c-4a83-a4e4-f3094ad3824c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:04.147360 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-442cff3e-0944-458b-a8f7-7b131350f052 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:04.148716 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-442cff3e-0944-458b-a8f7-7b131350f052 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:04.152550 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-442cff3e-0944-458b-a8f7-7b131350f052 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:04.158836 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d559a218-02cf-4b6a-a122-586d5b551aa4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:04.161797 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d559a218-02cf-4b6a-a122-586d5b551aa4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:04.164609 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-442cff3e-0944-458b-a8f7-7b131350f052 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:04.166967 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-442cff3e-0944-458b-a8f7-7b131350f052 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:04.169772 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-442cff3e-0944-458b-a8f7-7b131350f052 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:04.181032 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d559a218-02cf-4b6a-a122-586d5b551aa4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:04.182607 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d559a218-02cf-4b6a-a122-586d5b551aa4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:04.185174 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d559a218-02cf-4b6a-a122-586d5b551aa4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:04.186997 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d559a218-02cf-4b6a-a122-586d5b551aa4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:04.191036 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d559a218-02cf-4b6a-a122-586d5b551aa4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:04.191915 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d559a218-02cf-4b6a-a122-586d5b551aa4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:04.278618 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d559a218-02cf-4b6a-a122-586d5b551aa4 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.122577 Sep 16 13:05:04.281350 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1888/3915] 10.222.0.67 () {60 vars in 1343 bytes} [Fri Sep 16 13:05:04 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 13:05:04.430845 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-442cff3e-0944-458b-a8f7-7b131350f052 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:04.485478 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-442cff3e-0944-458b-a8f7-7b131350f052 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c" status: 200 len: 1266 microversion: 2.1 time: 0.380291 Sep 16 13:05:04.491541 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2028/3916] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:05:04 2022] GET /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c => generated 1266 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:05:05.294207 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-da5df8e2-acdf-4716-84f0-27a800b83eca tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:05.309820 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-da5df8e2-acdf-4716-84f0-27a800b83eca tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:05.325684 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-da5df8e2-acdf-4716-84f0-27a800b83eca tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:05.328410 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-da5df8e2-acdf-4716-84f0-27a800b83eca tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:05.331242 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-da5df8e2-acdf-4716-84f0-27a800b83eca tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:05.338239 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-da5df8e2-acdf-4716-84f0-27a800b83eca tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:05.339312 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-da5df8e2-acdf-4716-84f0-27a800b83eca tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:05.339956 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-da5df8e2-acdf-4716-84f0-27a800b83eca tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:05.397269 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-da5df8e2-acdf-4716-84f0-27a800b83eca tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.107238 Sep 16 13:05:05.408588 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1889/3917] 10.222.0.67 () {60 vars in 1343 bytes} [Fri Sep 16 13:05:05 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:05:05.515067 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f542c510-0f43-413b-bb50-70076db308fb tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:05.516498 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f542c510-0f43-413b-bb50-70076db308fb tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 261a8ed1-8a0c-4a83-a4e4-f3094ad3824c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:05.529328 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f542c510-0f43-413b-bb50-70076db308fb tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:05.530324 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f542c510-0f43-413b-bb50-70076db308fb tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:05.530933 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f542c510-0f43-413b-bb50-70076db308fb tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:05.531804 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f542c510-0f43-413b-bb50-70076db308fb tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:05.532394 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f542c510-0f43-413b-bb50-70076db308fb tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:05.532871 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f542c510-0f43-413b-bb50-70076db308fb tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:05.736040 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f542c510-0f43-413b-bb50-70076db308fb tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:05.745976 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f542c510-0f43-413b-bb50-70076db308fb tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c" status: 200 len: 1272 microversion: 2.1 time: 0.237263 Sep 16 13:05:05.747152 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2029/3918] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:05:05 2022] GET /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c => generated 1272 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:05:06.412206 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-79421b3a-4f8d-4a99-ae35-c06c9bd87ff2 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:06.416205 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-79421b3a-4f8d-4a99-ae35-c06c9bd87ff2 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:06.429779 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-79421b3a-4f8d-4a99-ae35-c06c9bd87ff2 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:06.430740 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-79421b3a-4f8d-4a99-ae35-c06c9bd87ff2 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:06.432219 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-79421b3a-4f8d-4a99-ae35-c06c9bd87ff2 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:06.433190 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-79421b3a-4f8d-4a99-ae35-c06c9bd87ff2 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:06.434534 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-79421b3a-4f8d-4a99-ae35-c06c9bd87ff2 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:06.435074 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-79421b3a-4f8d-4a99-ae35-c06c9bd87ff2 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:06.478765 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-79421b3a-4f8d-4a99-ae35-c06c9bd87ff2 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.071235 Sep 16 13:05:06.479925 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1890/3919] 10.222.0.67 () {60 vars in 1343 bytes} [Fri Sep 16 13:05:06 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:05:06.770840 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ef2c8068-72f3-4223-9cc4-6506f92c73ec tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:06.772648 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ef2c8068-72f3-4223-9cc4-6506f92c73ec tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 261a8ed1-8a0c-4a83-a4e4-f3094ad3824c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:06.781767 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef2c8068-72f3-4223-9cc4-6506f92c73ec tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:06.782650 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef2c8068-72f3-4223-9cc4-6506f92c73ec tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:06.783501 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef2c8068-72f3-4223-9cc4-6506f92c73ec tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:06.784384 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef2c8068-72f3-4223-9cc4-6506f92c73ec tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:06.785206 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef2c8068-72f3-4223-9cc4-6506f92c73ec tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:06.785774 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef2c8068-72f3-4223-9cc4-6506f92c73ec tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:06.991283 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ef2c8068-72f3-4223-9cc4-6506f92c73ec tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:07.014472 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ef2c8068-72f3-4223-9cc4-6506f92c73ec tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c" status: 200 len: 1272 microversion: 2.1 time: 0.242613 Sep 16 13:05:07.019707 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2030/3920] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:05:06 2022] GET /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c => generated 1272 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:05:07.511842 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-14bf83bd-b1ca-4f75-af4c-0a4b1f452603 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:07.519170 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-14bf83bd-b1ca-4f75-af4c-0a4b1f452603 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:07.544606 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14bf83bd-b1ca-4f75-af4c-0a4b1f452603 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:07.545617 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14bf83bd-b1ca-4f75-af4c-0a4b1f452603 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:07.546592 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14bf83bd-b1ca-4f75-af4c-0a4b1f452603 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:07.550254 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14bf83bd-b1ca-4f75-af4c-0a4b1f452603 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:07.550944 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14bf83bd-b1ca-4f75-af4c-0a4b1f452603 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:07.551792 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-14bf83bd-b1ca-4f75-af4c-0a4b1f452603 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:07.593623 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-14bf83bd-b1ca-4f75-af4c-0a4b1f452603 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.105595 Sep 16 13:05:07.594680 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1891/3921] 10.222.0.67 () {60 vars in 1343 bytes} [Fri Sep 16 13:05:07 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:05:08.038831 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3b01a19d-2567-45c5-8c60-e50bcc7297d6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:08.040262 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3b01a19d-2567-45c5-8c60-e50bcc7297d6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 261a8ed1-8a0c-4a83-a4e4-f3094ad3824c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:08.055798 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b01a19d-2567-45c5-8c60-e50bcc7297d6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:08.057167 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b01a19d-2567-45c5-8c60-e50bcc7297d6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:08.064974 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b01a19d-2567-45c5-8c60-e50bcc7297d6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:08.065998 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b01a19d-2567-45c5-8c60-e50bcc7297d6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:08.066893 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b01a19d-2567-45c5-8c60-e50bcc7297d6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:08.067487 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b01a19d-2567-45c5-8c60-e50bcc7297d6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:08.607438 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5746e955-7978-4dc2-be06-f69a0a86b48d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:08.610106 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5746e955-7978-4dc2-be06-f69a0a86b48d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:08.627976 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5746e955-7978-4dc2-be06-f69a0a86b48d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:08.628908 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5746e955-7978-4dc2-be06-f69a0a86b48d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:08.629890 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5746e955-7978-4dc2-be06-f69a0a86b48d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:08.631791 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5746e955-7978-4dc2-be06-f69a0a86b48d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:08.636645 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5746e955-7978-4dc2-be06-f69a0a86b48d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:08.637485 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5746e955-7978-4dc2-be06-f69a0a86b48d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:08.731022 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5746e955-7978-4dc2-be06-f69a0a86b48d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.124773 Sep 16 13:05:08.733531 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1892/3922] 10.222.0.67 () {60 vars in 1343 bytes} [Fri Sep 16 13:05:08 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:05:08.908653 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3b01a19d-2567-45c5-8c60-e50bcc7297d6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:08.921713 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3b01a19d-2567-45c5-8c60-e50bcc7297d6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c" status: 200 len: 1314 microversion: 2.1 time: 0.886562 Sep 16 13:05:08.925007 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2031/3923] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:05:08 2022] GET /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c => generated 1314 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:05:09.746146 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0a9f6edd-73f4-4ed7-9a47-1b73e7f9a170 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:09.748565 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0a9f6edd-73f4-4ed7-9a47-1b73e7f9a170 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:09.757515 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0a9f6edd-73f4-4ed7-9a47-1b73e7f9a170 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:09.758316 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0a9f6edd-73f4-4ed7-9a47-1b73e7f9a170 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:09.758992 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0a9f6edd-73f4-4ed7-9a47-1b73e7f9a170 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:09.759977 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0a9f6edd-73f4-4ed7-9a47-1b73e7f9a170 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:09.760683 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0a9f6edd-73f4-4ed7-9a47-1b73e7f9a170 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:09.761648 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0a9f6edd-73f4-4ed7-9a47-1b73e7f9a170 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:09.798452 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0a9f6edd-73f4-4ed7-9a47-1b73e7f9a170 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.057533 Sep 16 13:05:09.803739 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1893/3924] 10.222.0.67 () {60 vars in 1343 bytes} [Fri Sep 16 13:05:09 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:05:09.886992 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f5ef442a-d9c8-4555-8a7b-01b94746dd77 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:09.888428 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f5ef442a-d9c8-4555-8a7b-01b94746dd77 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:09.896826 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5ef442a-d9c8-4555-8a7b-01b94746dd77 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:09.897793 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5ef442a-d9c8-4555-8a7b-01b94746dd77 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:09.898649 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5ef442a-d9c8-4555-8a7b-01b94746dd77 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:09.900470 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5ef442a-d9c8-4555-8a7b-01b94746dd77 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:09.901296 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5ef442a-d9c8-4555-8a7b-01b94746dd77 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:09.902536 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5ef442a-d9c8-4555-8a7b-01b94746dd77 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:09.943228 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f5ef442a-d9c8-4555-8a7b-01b94746dd77 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:05:09.955949 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fe21207b-5d56-4e05-872d-40ba98c5a3bf tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:09.957476 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-fe21207b-5d56-4e05-872d-40ba98c5a3bf tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 261a8ed1-8a0c-4a83-a4e4-f3094ad3824c] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:09.969010 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe21207b-5d56-4e05-872d-40ba98c5a3bf tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:09.972790 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe21207b-5d56-4e05-872d-40ba98c5a3bf tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:09.974473 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe21207b-5d56-4e05-872d-40ba98c5a3bf tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:09.975658 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe21207b-5d56-4e05-872d-40ba98c5a3bf tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:09.976441 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe21207b-5d56-4e05-872d-40ba98c5a3bf tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:09.977169 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe21207b-5d56-4e05-872d-40ba98c5a3bf tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:10.149147 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f5ef442a-d9c8-4555-8a7b-01b94746dd77 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "DELETE /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 204 len: 0 microversion: 2.20 time: 0.267256 Sep 16 13:05:10.152736 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2032/3925] 10.222.0.67 () {60 vars in 1280 bytes} [Fri Sep 16 13:05:09 2022] DELETE /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 13:05:10.165067 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-12162389-bc93-4413-9bdf-e6531098457a tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:10.167724 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-12162389-bc93-4413-9bdf-e6531098457a tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:10.179248 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12162389-bc93-4413-9bdf-e6531098457a tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:10.179941 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12162389-bc93-4413-9bdf-e6531098457a tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:10.180563 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12162389-bc93-4413-9bdf-e6531098457a tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:10.181417 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12162389-bc93-4413-9bdf-e6531098457a tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:10.182090 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12162389-bc93-4413-9bdf-e6531098457a tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:10.182867 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12162389-bc93-4413-9bdf-e6531098457a tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:10.405007 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-fe21207b-5d56-4e05-872d-40ba98c5a3bf tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:10.435439 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-fe21207b-5d56-4e05-872d-40ba98c5a3bf tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c" status: 200 len: 1314 microversion: 2.1 time: 0.486625 Sep 16 13:05:10.437890 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1894/3926] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:05:09 2022] GET /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c => generated 1314 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:05:10.625882 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-12162389-bc93-4413-9bdf-e6531098457a tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:10.648097 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-12162389-bc93-4413-9bdf-e6531098457a tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:10.656726 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-12162389-bc93-4413-9bdf-e6531098457a tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:10.658707 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-12162389-bc93-4413-9bdf-e6531098457a tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1725 microversion: 2.20 time: 0.500155 Sep 16 13:05:10.659994 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2033/3927] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:05:10 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1725 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:05:11.083123 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-6a246d8c-bcfe-4da3-9e1c-cece76a05a97 req-26cf3a07-0ba0-4530-9cd7-9a5096950f7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "261a8ed1-8a0c-4a83-a4e4-f3094ad3824c", "tag": "c8c32251-350f-4099-952e-3f7b216c4b3d"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:05:11.113191 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-6a246d8c-bcfe-4da3-9e1c-cece76a05a97 req-26cf3a07-0ba0-4530-9cd7-9a5096950f7f service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:11.117619 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-6a246d8c-bcfe-4da3-9e1c-cece76a05a97 req-26cf3a07-0ba0-4530-9cd7-9a5096950f7f service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:11.119782 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-6a246d8c-bcfe-4da3-9e1c-cece76a05a97 req-26cf3a07-0ba0-4530-9cd7-9a5096950f7f service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:11.169689 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-6a246d8c-bcfe-4da3-9e1c-cece76a05a97 req-26cf3a07-0ba0-4530-9cd7-9a5096950f7f service nova] Creating event network-changed:c8c32251-350f-4099-952e-3f7b216c4b3d for instance 261a8ed1-8a0c-4a83-a4e4-f3094ad3824c on n-h1-858094-4 Sep 16 13:05:11.186190 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-6a246d8c-bcfe-4da3-9e1c-cece76a05a97 req-26cf3a07-0ba0-4530-9cd7-9a5096950f7f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108938 Sep 16 13:05:11.190521 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1895/3928] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:05:11.461140 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-aab9d9e6-a084-418d-bf3f-490ddda1caf9 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:11.461918 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-aab9d9e6-a084-418d-bf3f-490ddda1caf9 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 261a8ed1-8a0c-4a83-a4e4-f3094ad3824c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:11.475271 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aab9d9e6-a084-418d-bf3f-490ddda1caf9 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:11.478886 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aab9d9e6-a084-418d-bf3f-490ddda1caf9 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:11.481838 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aab9d9e6-a084-418d-bf3f-490ddda1caf9 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:11.482886 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aab9d9e6-a084-418d-bf3f-490ddda1caf9 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:11.483752 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aab9d9e6-a084-418d-bf3f-490ddda1caf9 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:11.484992 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aab9d9e6-a084-418d-bf3f-490ddda1caf9 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:11.695566 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1608f782-ca66-49d0-a38b-3571020e0b0a tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:11.698759 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-1608f782-ca66-49d0-a38b-3571020e0b0a tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:11.718334 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1608f782-ca66-49d0-a38b-3571020e0b0a tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:11.719175 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1608f782-ca66-49d0-a38b-3571020e0b0a tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:11.719800 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1608f782-ca66-49d0-a38b-3571020e0b0a tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:11.722770 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1608f782-ca66-49d0-a38b-3571020e0b0a tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:11.723526 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1608f782-ca66-49d0-a38b-3571020e0b0a tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:11.724466 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1608f782-ca66-49d0-a38b-3571020e0b0a tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:11.883676 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:05:12.428268 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-aab9d9e6-a084-418d-bf3f-490ddda1caf9 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:12.444960 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-aab9d9e6-a084-418d-bf3f-490ddda1caf9 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c" status: 200 len: 1314 microversion: 2.1 time: 0.988026 Sep 16 13:05:12.445642 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1608f782-ca66-49d0-a38b-3571020e0b0a tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:12.446096 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2034/3929] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:05:11 2022] GET /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c => generated 1314 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:05:12.463960 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1608f782-ca66-49d0-a38b-3571020e0b0a tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:12.468649 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1608f782-ca66-49d0-a38b-3571020e0b0a tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:12.477280 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1608f782-ca66-49d0-a38b-3571020e0b0a tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1725 microversion: 2.20 time: 0.793279 Sep 16 13:05:12.480303 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1896/3930] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:05:11 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1725 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:05:13.479478 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-856882b8-4da5-4fed-a29d-880431fb3733 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:13.480967 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-856882b8-4da5-4fed-a29d-880431fb3733 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 261a8ed1-8a0c-4a83-a4e4-f3094ad3824c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:13.510049 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3d8ca224-c045-48bb-ad45-88021c4b85df tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:13.510770 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3d8ca224-c045-48bb-ad45-88021c4b85df tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:13.510975 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-856882b8-4da5-4fed-a29d-880431fb3733 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:13.514122 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:05:13.515372 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-856882b8-4da5-4fed-a29d-880431fb3733 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:13.517124 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=8 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:05:13.519388 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-856882b8-4da5-4fed-a29d-880431fb3733 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:13.520869 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-856882b8-4da5-4fed-a29d-880431fb3733 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:13.521499 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-856882b8-4da5-4fed-a29d-880431fb3733 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:13.522423 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-856882b8-4da5-4fed-a29d-880431fb3733 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:13.530406 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3d8ca224-c045-48bb-ad45-88021c4b85df tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:13.537322 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3d8ca224-c045-48bb-ad45-88021c4b85df tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:13.537935 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3d8ca224-c045-48bb-ad45-88021c4b85df tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:13.539818 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3d8ca224-c045-48bb-ad45-88021c4b85df tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:13.539818 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3d8ca224-c045-48bb-ad45-88021c4b85df tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:13.539818 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3d8ca224-c045-48bb-ad45-88021c4b85df tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:13.712622 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3d8ca224-c045-48bb-ad45-88021c4b85df tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:13.724227 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3d8ca224-c045-48bb-ad45-88021c4b85df tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:13.729828 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3d8ca224-c045-48bb-ad45-88021c4b85df tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:13.731358 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3d8ca224-c045-48bb-ad45-88021c4b85df tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1658 microversion: 2.20 time: 0.226991 Sep 16 13:05:13.738190 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1897/3931] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:05:13 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1658 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:05:14.506594 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-856882b8-4da5-4fed-a29d-880431fb3733 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:14.520191 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-856882b8-4da5-4fed-a29d-880431fb3733 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c" status: 200 len: 1314 microversion: 2.1 time: 1.053029 Sep 16 13:05:14.523066 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2035/3932] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:05:13 2022] GET /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c => generated 1314 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:05:14.765804 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-bb9cd344-6ed3-4a2e-a8db-8ec0bc09b465 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:14.766524 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-bb9cd344-6ed3-4a2e-a8db-8ec0bc09b465 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:14.782532 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bb9cd344-6ed3-4a2e-a8db-8ec0bc09b465 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:14.783805 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bb9cd344-6ed3-4a2e-a8db-8ec0bc09b465 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:14.784484 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bb9cd344-6ed3-4a2e-a8db-8ec0bc09b465 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:14.785415 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bb9cd344-6ed3-4a2e-a8db-8ec0bc09b465 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:14.785954 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bb9cd344-6ed3-4a2e-a8db-8ec0bc09b465 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:14.786453 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bb9cd344-6ed3-4a2e-a8db-8ec0bc09b465 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:14.913290 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-bb9cd344-6ed3-4a2e-a8db-8ec0bc09b465 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:14.926952 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-bb9cd344-6ed3-4a2e-a8db-8ec0bc09b465 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:14.928619 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-bb9cd344-6ed3-4a2e-a8db-8ec0bc09b465 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:14.938940 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-bb9cd344-6ed3-4a2e-a8db-8ec0bc09b465 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 200 len: 1658 microversion: 2.20 time: 0.177642 Sep 16 13:05:14.940161 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1898/3933] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:05:14 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 1658 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:05:15.051332 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-73c05f87-76b6-466d-a579-5dcc7293f362 req-bc836187-1dcf-4ef5-a413-726ba7e9de65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66413dbd-455f-45f6-b057-39a11a9f2d44", "name": "network-vif-deleted", "tag": "3a5b1f2b-2004-4cf4-93bd-f498b62488fe"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:05:15.063295 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:05:15.066366 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-73c05f87-76b6-466d-a579-5dcc7293f362 req-bc836187-1dcf-4ef5-a413-726ba7e9de65 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:15.067104 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-73c05f87-76b6-466d-a579-5dcc7293f362 req-bc836187-1dcf-4ef5-a413-726ba7e9de65 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:15.067721 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-73c05f87-76b6-466d-a579-5dcc7293f362 req-bc836187-1dcf-4ef5-a413-726ba7e9de65 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:15.098571 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-73c05f87-76b6-466d-a579-5dcc7293f362 req-bc836187-1dcf-4ef5-a413-726ba7e9de65 service nova] Creating event network-vif-deleted:3a5b1f2b-2004-4cf4-93bd-f498b62488fe for instance 66413dbd-455f-45f6-b057-39a11a9f2d44 on n-h2-858094-4 Sep 16 13:05:15.108693 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-73c05f87-76b6-466d-a579-5dcc7293f362 req-bc836187-1dcf-4ef5-a413-726ba7e9de65 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060958 Sep 16 13:05:15.111871 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2036/3934] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:05:15.545865 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fb5954f0-a591-4137-8683-eefffadddf20 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:15.547003 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-fb5954f0-a591-4137-8683-eefffadddf20 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 261a8ed1-8a0c-4a83-a4e4-f3094ad3824c] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:15.558541 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fb5954f0-a591-4137-8683-eefffadddf20 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:15.561327 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fb5954f0-a591-4137-8683-eefffadddf20 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:15.561967 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fb5954f0-a591-4137-8683-eefffadddf20 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:15.565983 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fb5954f0-a591-4137-8683-eefffadddf20 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:15.566724 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fb5954f0-a591-4137-8683-eefffadddf20 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:15.567330 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fb5954f0-a591-4137-8683-eefffadddf20 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:15.959035 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-fb5954f0-a591-4137-8683-eefffadddf20 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:15.968938 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f40d6c66-d23e-4576-9532-729a8ec67297 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:15.970255 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f40d6c66-d23e-4576-9532-729a8ec67297 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: 66413dbd-455f-45f6-b057-39a11a9f2d44] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:15.971682 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-fb5954f0-a591-4137-8683-eefffadddf20 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c" status: 200 len: 1314 microversion: 2.1 time: 0.429711 Sep 16 13:05:15.972709 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1899/3935] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:05:15 2022] GET /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:05:15.982790 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f40d6c66-d23e-4576-9532-729a8ec67297 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:15.983997 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f40d6c66-d23e-4576-9532-729a8ec67297 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:15.984609 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f40d6c66-d23e-4576-9532-729a8ec67297 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:15.985952 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f40d6c66-d23e-4576-9532-729a8ec67297 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:15.986575 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f40d6c66-d23e-4576-9532-729a8ec67297 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:15.987155 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f40d6c66-d23e-4576-9532-729a8ec67297 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:16.014673 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-f40d6c66-d23e-4576-9532-729a8ec67297 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] HTTP exception thrown: Instance 66413dbd-455f-45f6-b057-39a11a9f2d44 could not be found. Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f40d6c66-d23e-4576-9532-729a8ec67297 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Request method failure captured: Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 HTTP/1.1 Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHNx0ttCNfyJYFcC5jvmp6vmNhc02EktAi5pBpWNQgUiQARDHY98T0CQvAX5Ck6mBNZ6l0dAbi1_t00jRb4IsR3m7Q7fWZO3YEr5Z3HxiAQoIDwLuZ5drPDSXwKzPOBJTNFZUaR4rLPg6AIVmbhSLMPCV9IBgztCMDU1rz1D2P_uEVQ Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: X-Openstack-Nova-Api-Version: 2.20 Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: e3f3ad027f264333a95500ef691b7815 Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2054141611 Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e3f3ad027f264333a95500ef691b7815"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e3f3ad027f264333a95500ef691b7815"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e3f3ad027f264333a95500ef691b7815", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e3f3ad027f264333a95500ef691b7815"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2054141611 Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: e3f3ad027f264333a95500ef691b7815 Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2054141611 Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-AttachVolumeShelveTestJSON-2054141611-project Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: ba5727658d094c049054160852163cee Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2054141611-project Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 66413dbd-455f-45f6-b057-39a11a9f2d44 could not be found. Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '66413dbd-455f-45f6-b057-39a11a9f2d44'} Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66413dbd-455f-45f6-b057-39a11a9f2d44 could not be found. Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66413dbd-455f-45f6-b057-39a11a9f2d44 could not be found. Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:05:16.016709 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:05:16.029066 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:05:16.029066 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:05:16.029066 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:05:16.029066 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:05:16.029066 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:05:16.029066 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:05:16.029066 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66413dbd-455f-45f6-b057-39a11a9f2d44 could not be found. Sep 16 13:05:16.029066 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:05:16.029066 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f40d6c66-d23e-4576-9532-729a8ec67297 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Returning 404 to user: Instance 66413dbd-455f-45f6-b057-39a11a9f2d44 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:05:16.029066 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f40d6c66-d23e-4576-9532-729a8ec67297 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44" status: 404 len: 111 microversion: 2.20 time: 0.055755 Sep 16 13:05:16.029066 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2037/3936] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:05:15 2022] GET /compute/v2.1/servers/66413dbd-455f-45f6-b057-39a11a9f2d44 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 13:05:16.034942 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ca35f5d5-6021-4c8b-a03a-ffa0ecb993da tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '.version_select at 0x7f10399f6af0>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:16.066552 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ca35f5d5-6021-4c8b-a03a-ffa0ecb993da tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1492500719" status: 204 len: 0 microversion: 2.20 time: 0.042732 Sep 16 13:05:16.071112 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1900/3937] 10.222.0.67 () {60 vars in 1262 bytes} [Fri Sep 16 13:05:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1492500719 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 16 13:05:16.997691 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6756c8dc-6fcc-46c7-8154-ef2117463b33 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:16.998335 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6756c8dc-6fcc-46c7-8154-ef2117463b33 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 261a8ed1-8a0c-4a83-a4e4-f3094ad3824c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:17.029704 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6756c8dc-6fcc-46c7-8154-ef2117463b33 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:17.034080 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6756c8dc-6fcc-46c7-8154-ef2117463b33 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:17.034855 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6756c8dc-6fcc-46c7-8154-ef2117463b33 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:17.036169 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6756c8dc-6fcc-46c7-8154-ef2117463b33 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:17.036637 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6756c8dc-6fcc-46c7-8154-ef2117463b33 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:17.037260 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6756c8dc-6fcc-46c7-8154-ef2117463b33 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:17.541455 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6756c8dc-6fcc-46c7-8154-ef2117463b33 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:17.555030 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6756c8dc-6fcc-46c7-8154-ef2117463b33 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c" status: 200 len: 1314 microversion: 2.1 time: 0.562724 Sep 16 13:05:17.555609 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2038/3938] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:05:16 2022] GET /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c => generated 1314 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:05:17.819579 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-231b5e1c-09fd-4481-9a30-acd216abffdf tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Action: 'create', calling method: .version_select at 0x7f103997ba60>, body: {"keypair": {"name": "tempest-keypair-142868510", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBTM1em2TBq+aL/d5LsKkp3JDd1Zw/lqqpxxVB2Hiwe/hkDzcx41ml11iF+5LtLi9NDFQ4d5EMCzJBm8FwUHVerE2Gc5Dfi1d/2QPrlZ3ulHMyoyGiSkXeaGiQPqwNOQg=="}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:05:17.843051 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-231b5e1c-09fd-4481-9a30-acd216abffdf tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Getting quotas for project e3f3ad027f264333a95500ef691b7815. Resources: {'key_pairs'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:05:17.848828 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-231b5e1c-09fd-4481-9a30-acd216abffdf tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Getting quotas for user ba5727658d094c049054160852163cee and project e3f3ad027f264333a95500ef691b7815. Resources: {'key_pairs'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:05:17.880298 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-231b5e1c-09fd-4481-9a30-acd216abffdf tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.064612 Sep 16 13:05:17.881266 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1901/3939] 10.222.0.67 () {62 vars in 1200 bytes} [Fri Sep 16 13:05:17 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 66 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 16 13:05:18.584783 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2dda722a-14cc-4640-8111-6bc2eee07ea0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:18.586127 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2dda722a-14cc-4640-8111-6bc2eee07ea0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 261a8ed1-8a0c-4a83-a4e4-f3094ad3824c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:18.606091 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2dda722a-14cc-4640-8111-6bc2eee07ea0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:18.606601 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2dda722a-14cc-4640-8111-6bc2eee07ea0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:18.608085 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2dda722a-14cc-4640-8111-6bc2eee07ea0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:18.608843 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2dda722a-14cc-4640-8111-6bc2eee07ea0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:18.611460 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2dda722a-14cc-4640-8111-6bc2eee07ea0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:18.611796 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2dda722a-14cc-4640-8111-6bc2eee07ea0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:18.678915 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:05:18.978840 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2dda722a-14cc-4640-8111-6bc2eee07ea0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:18.991389 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2dda722a-14cc-4640-8111-6bc2eee07ea0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c" status: 200 len: 1314 microversion: 2.1 time: 0.412691 Sep 16 13:05:18.996427 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2039/3940] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:05:18 2022] GET /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:05:19.295239 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-a55a7ef7-7a3d-412b-bfdb-507d8f055e31 req-cf9a899a-24ec-4ae3-886c-bb2f0a6e9c84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "261a8ed1-8a0c-4a83-a4e4-f3094ad3824c", "name": "network-vif-plugged", "status": "completed", "tag": "c8c32251-350f-4099-952e-3f7b216c4b3d"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:05:19.319736 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-a55a7ef7-7a3d-412b-bfdb-507d8f055e31 req-cf9a899a-24ec-4ae3-886c-bb2f0a6e9c84 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:19.324802 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-a55a7ef7-7a3d-412b-bfdb-507d8f055e31 req-cf9a899a-24ec-4ae3-886c-bb2f0a6e9c84 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:19.325552 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-a55a7ef7-7a3d-412b-bfdb-507d8f055e31 req-cf9a899a-24ec-4ae3-886c-bb2f0a6e9c84 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:19.385474 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-a55a7ef7-7a3d-412b-bfdb-507d8f055e31 req-cf9a899a-24ec-4ae3-886c-bb2f0a6e9c84 service nova] Creating event network-vif-plugged:c8c32251-350f-4099-952e-3f7b216c4b3d for instance 261a8ed1-8a0c-4a83-a4e4-f3094ad3824c on n-h1-858094-4 Sep 16 13:05:19.398025 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-a55a7ef7-7a3d-412b-bfdb-507d8f055e31 req-cf9a899a-24ec-4ae3-886c-bb2f0a6e9c84 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108797 Sep 16 13:05:19.404113 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1902/3941] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:05:20.018934 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-414a9815-b3fe-45c2-9b34-e2c96f086816 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:20.020215 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-414a9815-b3fe-45c2-9b34-e2c96f086816 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 261a8ed1-8a0c-4a83-a4e4-f3094ad3824c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:20.027746 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-414a9815-b3fe-45c2-9b34-e2c96f086816 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:20.028505 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-414a9815-b3fe-45c2-9b34-e2c96f086816 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:20.029100 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-414a9815-b3fe-45c2-9b34-e2c96f086816 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:20.029973 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-414a9815-b3fe-45c2-9b34-e2c96f086816 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:20.030576 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-414a9815-b3fe-45c2-9b34-e2c96f086816 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:20.031158 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-414a9815-b3fe-45c2-9b34-e2c96f086816 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:20.331298 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-414a9815-b3fe-45c2-9b34-e2c96f086816 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:20.348394 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-414a9815-b3fe-45c2-9b34-e2c96f086816 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c" status: 200 len: 1314 microversion: 2.1 time: 0.332837 Sep 16 13:05:20.349969 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2040/3942] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:05:20 2022] GET /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:05:20.473866 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2d937943-469b-4daa-88bd-c7d05d3badc3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-930926662", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9c660356-b242-47cf-8b53-5c05af82a4ce"}], "security_groups": [{"name": "tempest-securitygroup--711671789"}], "key_name": "tempest-keypair-142868510", "user_data": "}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:05:20.826142 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-2d937943-469b-4daa-88bd-c7d05d3badc3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] validate_networks() for [('9c660356-b242-47cf-8b53-5c05af82a4ce', None, None, None, None, None)] {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:05:21.378066 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-05cf3336-4207-4bc8-b128-511411647bce tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:21.378697 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-05cf3336-4207-4bc8-b128-511411647bce tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 261a8ed1-8a0c-4a83-a4e4-f3094ad3824c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:21.395457 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05cf3336-4207-4bc8-b128-511411647bce tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:21.396085 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05cf3336-4207-4bc8-b128-511411647bce tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:21.396564 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05cf3336-4207-4bc8-b128-511411647bce tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:21.397310 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05cf3336-4207-4bc8-b128-511411647bce tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:21.401464 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05cf3336-4207-4bc8-b128-511411647bce tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:21.402804 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05cf3336-4207-4bc8-b128-511411647bce tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:21.513719 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-2d937943-469b-4daa-88bd-c7d05d3badc3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:05:21.514187 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-2d937943-469b-4daa-88bd-c7d05d3badc3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:05:21.514626 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-2d937943-469b-4daa-88bd-c7d05d3badc3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:05:21.515033 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-2d937943-469b-4daa-88bd-c7d05d3badc3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:05:21.515712 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-2d937943-469b-4daa-88bd-c7d05d3badc3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:05:21.535680 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2d937943-469b-4daa-88bd-c7d05d3badc3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:21.535914 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2d937943-469b-4daa-88bd-c7d05d3badc3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:21.536495 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2d937943-469b-4daa-88bd-c7d05d3badc3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:21.537059 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2d937943-469b-4daa-88bd-c7d05d3badc3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:21.537521 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2d937943-469b-4daa-88bd-c7d05d3badc3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:21.537945 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2d937943-469b-4daa-88bd-c7d05d3badc3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:21.593815 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-2d937943-469b-4daa-88bd-c7d05d3badc3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Getting quotas for project e3f3ad027f264333a95500ef691b7815. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:05:21.601605 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-2d937943-469b-4daa-88bd-c7d05d3badc3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Getting quotas for user ba5727658d094c049054160852163cee and project e3f3ad027f264333a95500ef691b7815. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:05:21.615935 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-2d937943-469b-4daa-88bd-c7d05d3badc3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:05:21.619232 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-2d937943-469b-4daa-88bd-c7d05d3badc3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: b76bc3fa-0395-4782-8a87-ec5cfc6da641] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:05:21.673617 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2d937943-469b-4daa-88bd-c7d05d3badc3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.205386 Sep 16 13:05:21.674639 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1903/3943] 10.222.0.67 () {62 vars in 1188 bytes} [Fri Sep 16 13:05:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 1208 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 16 13:05:21.689240 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f42bcb71-4cd1-402e-8e0a-89fc19766965 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:21.690119 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f42bcb71-4cd1-402e-8e0a-89fc19766965 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: b76bc3fa-0395-4782-8a87-ec5cfc6da641] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:21.701014 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:05:21.910592 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f42bcb71-4cd1-402e-8e0a-89fc19766965 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:21.920618 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f42bcb71-4cd1-402e-8e0a-89fc19766965 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:21.922387 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f42bcb71-4cd1-402e-8e0a-89fc19766965 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:21.928744 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f42bcb71-4cd1-402e-8e0a-89fc19766965 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641" status: 200 len: 1280 microversion: 2.20 time: 0.245313 Sep 16 13:05:21.945367 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1904/3944] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:05:21 2022] GET /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641 => generated 1280 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:05:21.965792 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-05cf3336-4207-4bc8-b128-511411647bce tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:21.977309 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-05cf3336-4207-4bc8-b128-511411647bce tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c" status: 200 len: 1502 microversion: 2.1 time: 0.606063 Sep 16 13:05:21.978153 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2041/3945] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:05:21 2022] GET /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c => generated 1502 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:05:22.009411 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-88f8d23e-9122-4e27-a725-25a5692f066e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:05:22.011866 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-88f8d23e-9122-4e27-a725-25a5692f066e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 261a8ed1-8a0c-4a83-a4e4-f3094ad3824c] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:22.034361 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-88f8d23e-9122-4e27-a725-25a5692f066e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:22.035241 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-88f8d23e-9122-4e27-a725-25a5692f066e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:22.036031 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-88f8d23e-9122-4e27-a725-25a5692f066e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:22.040593 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-88f8d23e-9122-4e27-a725-25a5692f066e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:22.041451 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-88f8d23e-9122-4e27-a725-25a5692f066e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:22.041829 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-88f8d23e-9122-4e27-a725-25a5692f066e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:22.076350 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=100 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:05:22.144296 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-88f8d23e-9122-4e27-a725-25a5692f066e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "POST /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c/action" status: 200 len: 14 microversion: 2.1 time: 0.139208 Sep 16 13:05:22.145313 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1905/3946] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 13:05:22 2022] POST /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:05:22.959460 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-51a7e3cb-10f9-4496-aa67-a01c8d996da3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:22.960289 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-51a7e3cb-10f9-4496-aa67-a01c8d996da3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: b76bc3fa-0395-4782-8a87-ec5cfc6da641] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:22.991528 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-51a7e3cb-10f9-4496-aa67-a01c8d996da3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:23.003866 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-51a7e3cb-10f9-4496-aa67-a01c8d996da3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:23.005238 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-51a7e3cb-10f9-4496-aa67-a01c8d996da3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:23.009664 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-51a7e3cb-10f9-4496-aa67-a01c8d996da3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:23.012803 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-51a7e3cb-10f9-4496-aa67-a01c8d996da3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:23.013260 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-51a7e3cb-10f9-4496-aa67-a01c8d996da3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:23.163752 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-73894678-ce12-4c02-8551-2915c549cb7f tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:05:23.169939 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-73894678-ce12-4c02-8551-2915c549cb7f tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 261a8ed1-8a0c-4a83-a4e4-f3094ad3824c] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:23.182416 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-73894678-ce12-4c02-8551-2915c549cb7f tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:23.183284 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-73894678-ce12-4c02-8551-2915c549cb7f tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:23.183994 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-73894678-ce12-4c02-8551-2915c549cb7f tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:23.185077 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-73894678-ce12-4c02-8551-2915c549cb7f tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:23.185760 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-73894678-ce12-4c02-8551-2915c549cb7f tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:23.186647 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-73894678-ce12-4c02-8551-2915c549cb7f tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:23.203286 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-51a7e3cb-10f9-4496-aa67-a01c8d996da3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:23.226355 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-51a7e3cb-10f9-4496-aa67-a01c8d996da3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:23.231571 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-51a7e3cb-10f9-4496-aa67-a01c8d996da3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:23.234346 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-51a7e3cb-10f9-4496-aa67-a01c8d996da3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641" status: 200 len: 1276 microversion: 2.20 time: 0.279804 Sep 16 13:05:23.238879 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2042/3947] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:05:22 2022] GET /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641 => generated 1276 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:05:23.263429 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-73894678-ce12-4c02-8551-2915c549cb7f tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "POST /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c/action" status: 200 len: 14 microversion: 2.1 time: 0.110720 Sep 16 13:05:23.265338 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1906/3948] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 13:05:23 2022] POST /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:05:24.263772 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4b16205b-66b2-4934-9ed7-7392e7eb801c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:24.264979 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4b16205b-66b2-4934-9ed7-7392e7eb801c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: b76bc3fa-0395-4782-8a87-ec5cfc6da641] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:24.280341 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-02456be3-c242-471c-8319-80a22ddd91b0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:05:24.283514 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-02456be3-c242-471c-8319-80a22ddd91b0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 261a8ed1-8a0c-4a83-a4e4-f3094ad3824c] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:24.289495 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b16205b-66b2-4934-9ed7-7392e7eb801c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:24.290824 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b16205b-66b2-4934-9ed7-7392e7eb801c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:24.295879 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b16205b-66b2-4934-9ed7-7392e7eb801c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:24.296855 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b16205b-66b2-4934-9ed7-7392e7eb801c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:24.299583 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b16205b-66b2-4934-9ed7-7392e7eb801c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:24.301541 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-02456be3-c242-471c-8319-80a22ddd91b0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:24.301812 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b16205b-66b2-4934-9ed7-7392e7eb801c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:24.308380 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-02456be3-c242-471c-8319-80a22ddd91b0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:24.309032 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-02456be3-c242-471c-8319-80a22ddd91b0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:24.309950 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-02456be3-c242-471c-8319-80a22ddd91b0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:24.310584 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-02456be3-c242-471c-8319-80a22ddd91b0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:24.311798 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-02456be3-c242-471c-8319-80a22ddd91b0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:24.411875 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-02456be3-c242-471c-8319-80a22ddd91b0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "POST /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c/action" status: 200 len: 14 microversion: 2.1 time: 0.138175 Sep 16 13:05:24.416788 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1907/3949] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 13:05:24 2022] POST /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 16 13:05:24.434208 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4b16205b-66b2-4934-9ed7-7392e7eb801c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:24.449509 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4b16205b-66b2-4934-9ed7-7392e7eb801c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:24.451833 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4b16205b-66b2-4934-9ed7-7392e7eb801c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:24.453478 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4b16205b-66b2-4934-9ed7-7392e7eb801c tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641" status: 200 len: 1338 microversion: 2.20 time: 0.194573 Sep 16 13:05:24.459839 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2043/3950] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:05:24 2022] GET /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641 => generated 1338 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:05:25.425334 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-12227b41-41d4-4cb0-971f-b84688e0e6b6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:05:25.427747 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-12227b41-41d4-4cb0-971f-b84688e0e6b6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 261a8ed1-8a0c-4a83-a4e4-f3094ad3824c] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:25.448163 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-12227b41-41d4-4cb0-971f-b84688e0e6b6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:25.448681 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-12227b41-41d4-4cb0-971f-b84688e0e6b6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:25.449124 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-12227b41-41d4-4cb0-971f-b84688e0e6b6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:25.455627 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-12227b41-41d4-4cb0-971f-b84688e0e6b6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:25.456196 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-12227b41-41d4-4cb0-971f-b84688e0e6b6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:25.456648 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-12227b41-41d4-4cb0-971f-b84688e0e6b6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:25.491676 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5ca33570-bcb2-4024-99cd-ce72b2727b79 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:25.492391 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5ca33570-bcb2-4024-99cd-ce72b2727b79 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: b76bc3fa-0395-4782-8a87-ec5cfc6da641] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:25.515661 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ca33570-bcb2-4024-99cd-ce72b2727b79 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:25.520879 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ca33570-bcb2-4024-99cd-ce72b2727b79 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:25.521336 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ca33570-bcb2-4024-99cd-ce72b2727b79 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:25.528209 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ca33570-bcb2-4024-99cd-ce72b2727b79 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:25.530765 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ca33570-bcb2-4024-99cd-ce72b2727b79 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:25.531215 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ca33570-bcb2-4024-99cd-ce72b2727b79 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:25.629457 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-12227b41-41d4-4cb0-971f-b84688e0e6b6 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "POST /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c/action" status: 200 len: 14 microversion: 2.1 time: 0.206251 Sep 16 13:05:25.632420 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1908/3951] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 13:05:25 2022] POST /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c/action => generated 14 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:05:25.804267 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5ca33570-bcb2-4024-99cd-ce72b2727b79 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:25.831047 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5ca33570-bcb2-4024-99cd-ce72b2727b79 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:25.835587 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5ca33570-bcb2-4024-99cd-ce72b2727b79 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:25.839077 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5ca33570-bcb2-4024-99cd-ce72b2727b79 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641" status: 200 len: 1338 microversion: 2.20 time: 0.352194 Sep 16 13:05:25.841828 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2044/3952] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:05:25 2022] GET /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641 => generated 1338 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:05:26.650770 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e8fdae12-7f9d-409e-8134-5f995f3ba745 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:05:26.658492 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e8fdae12-7f9d-409e-8134-5f995f3ba745 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 261a8ed1-8a0c-4a83-a4e4-f3094ad3824c] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:26.676604 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e8fdae12-7f9d-409e-8134-5f995f3ba745 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:26.677272 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e8fdae12-7f9d-409e-8134-5f995f3ba745 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:26.679467 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e8fdae12-7f9d-409e-8134-5f995f3ba745 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:26.680401 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e8fdae12-7f9d-409e-8134-5f995f3ba745 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:26.681663 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e8fdae12-7f9d-409e-8134-5f995f3ba745 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:26.687052 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e8fdae12-7f9d-409e-8134-5f995f3ba745 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:26.847842 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e8fdae12-7f9d-409e-8134-5f995f3ba745 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "POST /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c/action" status: 200 len: 14 microversion: 2.1 time: 0.207024 Sep 16 13:05:26.851740 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1909/3953] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 13:05:26 2022] POST /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c/action => generated 14 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:05:26.887958 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fcf08524-6c1c-45c7-9885-518bb45412f9 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:26.890729 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fcf08524-6c1c-45c7-9885-518bb45412f9 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: b76bc3fa-0395-4782-8a87-ec5cfc6da641] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:26.905247 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcf08524-6c1c-45c7-9885-518bb45412f9 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:26.919241 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcf08524-6c1c-45c7-9885-518bb45412f9 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:26.924056 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcf08524-6c1c-45c7-9885-518bb45412f9 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:26.933243 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcf08524-6c1c-45c7-9885-518bb45412f9 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:26.936759 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcf08524-6c1c-45c7-9885-518bb45412f9 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:26.957269 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcf08524-6c1c-45c7-9885-518bb45412f9 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:27.732828 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fcf08524-6c1c-45c7-9885-518bb45412f9 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:27.773482 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fcf08524-6c1c-45c7-9885-518bb45412f9 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:27.794313 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fcf08524-6c1c-45c7-9885-518bb45412f9 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:27.800362 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fcf08524-6c1c-45c7-9885-518bb45412f9 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641" status: 200 len: 1405 microversion: 2.20 time: 0.932575 Sep 16 13:05:27.805035 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2045/3954] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:05:26 2022] GET /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641 => generated 1405 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:05:27.864364 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3ee37702-38cb-46d6-b9d9-efc2261bf2d2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:05:27.866378 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3ee37702-38cb-46d6-b9d9-efc2261bf2d2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 261a8ed1-8a0c-4a83-a4e4-f3094ad3824c] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:27.895357 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3ee37702-38cb-46d6-b9d9-efc2261bf2d2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:27.895868 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3ee37702-38cb-46d6-b9d9-efc2261bf2d2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:27.896735 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3ee37702-38cb-46d6-b9d9-efc2261bf2d2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:27.897728 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3ee37702-38cb-46d6-b9d9-efc2261bf2d2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:27.898430 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3ee37702-38cb-46d6-b9d9-efc2261bf2d2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:27.899111 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3ee37702-38cb-46d6-b9d9-efc2261bf2d2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:28.034686 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3ee37702-38cb-46d6-b9d9-efc2261bf2d2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "POST /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c/action" status: 200 len: 14 microversion: 2.1 time: 0.177533 Sep 16 13:05:28.035390 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1910/3955] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 13:05:27 2022] POST /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c/action => generated 14 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:05:28.834399 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4c642e88-0807-40f7-b32c-bcaef372e5ae tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:28.835105 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4c642e88-0807-40f7-b32c-bcaef372e5ae tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: b76bc3fa-0395-4782-8a87-ec5cfc6da641] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:28.846591 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c642e88-0807-40f7-b32c-bcaef372e5ae tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:28.847088 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c642e88-0807-40f7-b32c-bcaef372e5ae tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:28.854830 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c642e88-0807-40f7-b32c-bcaef372e5ae tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:28.859852 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c642e88-0807-40f7-b32c-bcaef372e5ae tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:28.861630 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c642e88-0807-40f7-b32c-bcaef372e5ae tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:28.862272 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c642e88-0807-40f7-b32c-bcaef372e5ae tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:29.049002 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b1d548e3-c310-4e13-9c7e-3a64a4ecad4a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:05:29.052204 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b1d548e3-c310-4e13-9c7e-3a64a4ecad4a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 261a8ed1-8a0c-4a83-a4e4-f3094ad3824c] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:29.073373 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b1d548e3-c310-4e13-9c7e-3a64a4ecad4a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:29.074838 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b1d548e3-c310-4e13-9c7e-3a64a4ecad4a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:29.077928 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b1d548e3-c310-4e13-9c7e-3a64a4ecad4a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:29.081482 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b1d548e3-c310-4e13-9c7e-3a64a4ecad4a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:29.082262 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b1d548e3-c310-4e13-9c7e-3a64a4ecad4a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:29.084778 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b1d548e3-c310-4e13-9c7e-3a64a4ecad4a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:29.219162 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b1d548e3-c310-4e13-9c7e-3a64a4ecad4a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "POST /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c/action" status: 200 len: 14 microversion: 2.1 time: 0.174633 Sep 16 13:05:29.220375 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1911/3956] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 13:05:29 2022] POST /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c/action => generated 14 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:05:29.447744 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4c642e88-0807-40f7-b32c-bcaef372e5ae tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:29.461909 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4c642e88-0807-40f7-b32c-bcaef372e5ae tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:29.467510 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4c642e88-0807-40f7-b32c-bcaef372e5ae tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:29.470653 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4c642e88-0807-40f7-b32c-bcaef372e5ae tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641" status: 200 len: 1405 microversion: 2.20 time: 0.641241 Sep 16 13:05:29.476555 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2046/3957] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:05:28 2022] GET /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641 => generated 1405 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:05:30.232856 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6d9de0d4-137a-4d8f-a437-1efd606b6106 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:05:30.240315 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6d9de0d4-137a-4d8f-a437-1efd606b6106 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 261a8ed1-8a0c-4a83-a4e4-f3094ad3824c] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:30.254489 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6d9de0d4-137a-4d8f-a437-1efd606b6106 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:30.286009 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6d9de0d4-137a-4d8f-a437-1efd606b6106 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:30.292872 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6d9de0d4-137a-4d8f-a437-1efd606b6106 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:30.295650 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6d9de0d4-137a-4d8f-a437-1efd606b6106 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:30.304907 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6d9de0d4-137a-4d8f-a437-1efd606b6106 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:30.305656 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6d9de0d4-137a-4d8f-a437-1efd606b6106 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:30.310119 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-729e6193-7c6e-4eca-9c32-e2d2a2cbeae7 req-cfa3eb7c-0099-44d2-9af9-d544abd2766c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b76bc3fa-0395-4782-8a87-ec5cfc6da641", "tag": "8a68040c-b0d1-432e-b8a2-3698222d82ee"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:05:30.334664 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-729e6193-7c6e-4eca-9c32-e2d2a2cbeae7 req-cfa3eb7c-0099-44d2-9af9-d544abd2766c service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:30.340336 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-729e6193-7c6e-4eca-9c32-e2d2a2cbeae7 req-cfa3eb7c-0099-44d2-9af9-d544abd2766c service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:30.341619 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-729e6193-7c6e-4eca-9c32-e2d2a2cbeae7 req-cfa3eb7c-0099-44d2-9af9-d544abd2766c service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:30.388605 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-729e6193-7c6e-4eca-9c32-e2d2a2cbeae7 req-cfa3eb7c-0099-44d2-9af9-d544abd2766c service nova] Creating event network-changed:8a68040c-b0d1-432e-b8a2-3698222d82ee for instance b76bc3fa-0395-4782-8a87-ec5cfc6da641 on n-h2-858094-4 Sep 16 13:05:30.400853 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-729e6193-7c6e-4eca-9c32-e2d2a2cbeae7 req-cfa3eb7c-0099-44d2-9af9-d544abd2766c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094475 Sep 16 13:05:30.403025 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2047/3958] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:05:30.464458 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6d9de0d4-137a-4d8f-a437-1efd606b6106 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "POST /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c/action" status: 200 len: 14 microversion: 2.1 time: 0.236850 Sep 16 13:05:30.468944 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1912/3959] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 13:05:30 2022] POST /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c/action => generated 14 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:05:30.503608 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ba9b9310-bce2-4f62-932d-1467536694c6 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:30.505884 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ba9b9310-bce2-4f62-932d-1467536694c6 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: b76bc3fa-0395-4782-8a87-ec5cfc6da641] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:30.518849 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba9b9310-bce2-4f62-932d-1467536694c6 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:30.519703 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba9b9310-bce2-4f62-932d-1467536694c6 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:30.520498 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba9b9310-bce2-4f62-932d-1467536694c6 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:30.522215 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba9b9310-bce2-4f62-932d-1467536694c6 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:30.524821 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba9b9310-bce2-4f62-932d-1467536694c6 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:30.533880 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba9b9310-bce2-4f62-932d-1467536694c6 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:30.841817 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7cef60f6-9a39-4f72-a7f5-10e694fe5d69 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:30.849540 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7cef60f6-9a39-4f72-a7f5-10e694fe5d69 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '59081fb246d34546980d57493efae40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2628c648b2e4465821bdcdf4330fb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:30.850369 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7cef60f6-9a39-4f72-a7f5-10e694fe5d69 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Searching by: {'deleted': False, 'project_id': 'd2628c648b2e4465821bdcdf4330fb4e'} {{(pid=128780) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 13:05:30.879308 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7cef60f6-9a39-4f72-a7f5-10e694fe5d69 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:30.880025 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7cef60f6-9a39-4f72-a7f5-10e694fe5d69 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:30.880916 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7cef60f6-9a39-4f72-a7f5-10e694fe5d69 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:30.881758 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7cef60f6-9a39-4f72-a7f5-10e694fe5d69 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:30.884181 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7cef60f6-9a39-4f72-a7f5-10e694fe5d69 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:30.887034 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7cef60f6-9a39-4f72-a7f5-10e694fe5d69 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:30.989299 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.multi_cell_list [None req-7cef60f6-9a39-4f72-a7f5-10e694fe5d69 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128780) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 13:05:31.112455 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7cef60f6-9a39-4f72-a7f5-10e694fe5d69 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.275258 Sep 16 13:05:31.113993 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1913/3960] 10.222.0.67 () {58 vars in 1125 bytes} [Fri Sep 16 13:05:30 2022] GET /compute/v2.1/servers => generated 339 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:05:31.128397 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c6c74a43-d67a-48d9-ba31-2806bf8902b2 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:31.138171 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c6c74a43-d67a-48d9-ba31-2806bf8902b2 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '59081fb246d34546980d57493efae40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2628c648b2e4465821bdcdf4330fb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:31.138953 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c6c74a43-d67a-48d9-ba31-2806bf8902b2 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Searching by: {'deleted': False, 'project_id': 'd2628c648b2e4465821bdcdf4330fb4e'} {{(pid=128780) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 13:05:31.155140 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c6c74a43-d67a-48d9-ba31-2806bf8902b2 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:31.155630 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c6c74a43-d67a-48d9-ba31-2806bf8902b2 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:31.156068 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c6c74a43-d67a-48d9-ba31-2806bf8902b2 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:31.165860 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c6c74a43-d67a-48d9-ba31-2806bf8902b2 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:31.166703 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c6c74a43-d67a-48d9-ba31-2806bf8902b2 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:31.167150 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c6c74a43-d67a-48d9-ba31-2806bf8902b2 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:31.225236 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.multi_cell_list [None req-c6c74a43-d67a-48d9-ba31-2806bf8902b2 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128780) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 13:05:31.301965 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ba9b9310-bce2-4f62-932d-1467536694c6 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:31.315051 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c6c74a43-d67a-48d9-ba31-2806bf8902b2 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59081fb246d34546980d57493efae40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2628c648b2e4465821bdcdf4330fb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:31.318920 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ba9b9310-bce2-4f62-932d-1467536694c6 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:31.324224 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c6c74a43-d67a-48d9-ba31-2806bf8902b2 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:31.324716 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c6c74a43-d67a-48d9-ba31-2806bf8902b2 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:31.325151 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c6c74a43-d67a-48d9-ba31-2806bf8902b2 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:31.326291 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ba9b9310-bce2-4f62-932d-1467536694c6 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:31.332008 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ba9b9310-bce2-4f62-932d-1467536694c6 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641" status: 200 len: 1405 microversion: 2.20 time: 0.832761 Sep 16 13:05:31.334803 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2048/3961] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:05:30 2022] GET /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641 => generated 1405 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:05:31.475542 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c59e5c13-44fd-4dc7-9026-94d91afd6a66 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:05:31.479312 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c59e5c13-44fd-4dc7-9026-94d91afd6a66 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 261a8ed1-8a0c-4a83-a4e4-f3094ad3824c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:31.503319 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c59e5c13-44fd-4dc7-9026-94d91afd6a66 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:31.508370 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c59e5c13-44fd-4dc7-9026-94d91afd6a66 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:31.510008 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c59e5c13-44fd-4dc7-9026-94d91afd6a66 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:31.526937 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c59e5c13-44fd-4dc7-9026-94d91afd6a66 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:31.528066 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c59e5c13-44fd-4dc7-9026-94d91afd6a66 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:31.530395 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c59e5c13-44fd-4dc7-9026-94d91afd6a66 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:31.642920 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c59e5c13-44fd-4dc7-9026-94d91afd6a66 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "POST /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c/action" status: 200 len: 14 microversion: 2.1 time: 0.171657 Sep 16 13:05:31.644090 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2049/3962] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 13:05:31 2022] POST /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c/action => generated 14 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:05:32.361260 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c6c74a43-d67a-48d9-ba31-2806bf8902b2 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] 10.222.0.67 "GET /compute/v2.1/servers/detail" status: 200 len: 1707 microversion: 2.1 time: 1.237022 Sep 16 13:05:32.362413 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1914/3963] 10.222.0.67 () {58 vars in 1146 bytes} [Fri Sep 16 13:05:31 2022] GET /compute/v2.1/servers/detail => generated 1707 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:05:32.390767 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8bc27c32-69ad-4cfb-8145-2debf368e04d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:32.392360 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8bc27c32-69ad-4cfb-8145-2debf368e04d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: b76bc3fa-0395-4782-8a87-ec5cfc6da641] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:32.413607 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bc27c32-69ad-4cfb-8145-2debf368e04d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:32.416351 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bc27c32-69ad-4cfb-8145-2debf368e04d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:32.417904 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bc27c32-69ad-4cfb-8145-2debf368e04d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:32.421013 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bc27c32-69ad-4cfb-8145-2debf368e04d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:32.422862 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bc27c32-69ad-4cfb-8145-2debf368e04d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:32.425024 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8bc27c32-69ad-4cfb-8145-2debf368e04d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:32.728771 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-22d26477-2ecf-4450-8dbb-b477b821e020 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:32.730802 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-22d26477-2ecf-4450-8dbb-b477b821e020 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:32.746761 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22d26477-2ecf-4450-8dbb-b477b821e020 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:32.747811 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22d26477-2ecf-4450-8dbb-b477b821e020 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:32.754317 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22d26477-2ecf-4450-8dbb-b477b821e020 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:32.756164 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22d26477-2ecf-4450-8dbb-b477b821e020 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:32.759185 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22d26477-2ecf-4450-8dbb-b477b821e020 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:32.762889 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22d26477-2ecf-4450-8dbb-b477b821e020 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:32.836034 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-22d26477-2ecf-4450-8dbb-b477b821e020 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:05:32.875144 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8bc27c32-69ad-4cfb-8145-2debf368e04d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:32.891682 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8bc27c32-69ad-4cfb-8145-2debf368e04d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:32.894642 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8bc27c32-69ad-4cfb-8145-2debf368e04d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:32.895922 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8bc27c32-69ad-4cfb-8145-2debf368e04d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641" status: 200 len: 1405 microversion: 2.20 time: 0.517891 Sep 16 13:05:32.909348 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1915/3964] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:05:32 2022] GET /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641 => generated 1405 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:05:32.934004 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8afd5018-68a2-4c76-b0a4-276d97ee560f tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:32.951522 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8afd5018-68a2-4c76-b0a4-276d97ee560f tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.040742 Sep 16 13:05:32.963354 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1916/3965] 10.222.0.67 () {58 vars in 1137 bytes} [Fri Sep 16 13:05:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:05:32.975603 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-74e53fdc-1205-4733-ba0c-8fe44bd57a2b tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:05:32.988645 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-74e53fdc-1205-4733-ba0c-8fe44bd57a2b tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: 261a8ed1-8a0c-4a83-a4e4-f3094ad3824c] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:33.029774 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-74e53fdc-1205-4733-ba0c-8fe44bd57a2b tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:33.030678 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-74e53fdc-1205-4733-ba0c-8fe44bd57a2b tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:33.031160 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-74e53fdc-1205-4733-ba0c-8fe44bd57a2b tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:33.031988 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-74e53fdc-1205-4733-ba0c-8fe44bd57a2b tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:33.032488 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-74e53fdc-1205-4733-ba0c-8fe44bd57a2b tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:33.032922 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-74e53fdc-1205-4733-ba0c-8fe44bd57a2b tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:33.045901 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-22d26477-2ecf-4450-8dbb-b477b821e020 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "DELETE /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 204 len: 0 microversion: 2.42 time: 0.981066 Sep 16 13:05:33.047056 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2050/3966] 10.222.0.67 () {60 vars in 1280 bytes} [Fri Sep 16 13:05:32 2022] DELETE /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 0 bytes in 983 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 13:05:33.063421 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4aa1ed15-3f9a-4775-a044-bd3b0dfac2e6 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:33.066581 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4aa1ed15-3f9a-4775-a044-bd3b0dfac2e6 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:33.086349 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4aa1ed15-3f9a-4775-a044-bd3b0dfac2e6 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:33.087098 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4aa1ed15-3f9a-4775-a044-bd3b0dfac2e6 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:33.087709 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4aa1ed15-3f9a-4775-a044-bd3b0dfac2e6 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:33.088715 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4aa1ed15-3f9a-4775-a044-bd3b0dfac2e6 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:33.091512 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4aa1ed15-3f9a-4775-a044-bd3b0dfac2e6 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:33.092270 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4aa1ed15-3f9a-4775-a044-bd3b0dfac2e6 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:34.335301 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4aa1ed15-3f9a-4775-a044-bd3b0dfac2e6 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:34.380624 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4aa1ed15-3f9a-4775-a044-bd3b0dfac2e6 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:34.382268 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4aa1ed15-3f9a-4775-a044-bd3b0dfac2e6 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:34.383631 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4aa1ed15-3f9a-4775-a044-bd3b0dfac2e6 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 2953 microversion: 2.42 time: 1.331644 Sep 16 13:05:34.398754 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2051/3967] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:05:33 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 2953 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:05:34.426777 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4061164d-79a4-40ba-9217-fa9588ad2d2c tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:34.430184 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4061164d-79a4-40ba-9217-fa9588ad2d2c tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] [instance: a11bbd81-4323-466b-9d10-6f2d6c1913e4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:34.445080 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4061164d-79a4-40ba-9217-fa9588ad2d2c tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:34.445513 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4061164d-79a4-40ba-9217-fa9588ad2d2c tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:34.445967 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4061164d-79a4-40ba-9217-fa9588ad2d2c tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:34.446965 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4061164d-79a4-40ba-9217-fa9588ad2d2c tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:34.447423 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4061164d-79a4-40ba-9217-fa9588ad2d2c tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:34.447852 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4061164d-79a4-40ba-9217-fa9588ad2d2c tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:34.509991 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4061164d-79a4-40ba-9217-fa9588ad2d2c tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] [instance: a11bbd81-4323-466b-9d10-6f2d6c1913e4] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:05:34.733563 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4061164d-79a4-40ba-9217-fa9588ad2d2c tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a11bbd81-4323-466b-9d10-6f2d6c1913e4" status: 204 len: 0 microversion: 2.1 time: 0.328714 Sep 16 13:05:34.734239 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2052/3968] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 13:05:34 2022] DELETE /compute/v2.1/servers/a11bbd81-4323-466b-9d10-6f2d6c1913e4 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:05:35.224372 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-74e53fdc-1205-4733-ba0c-8fe44bd57a2b tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "POST /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c/action" status: 200 len: 16399 microversion: 2.1 time: 2.259275 Sep 16 13:05:35.237360 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1917/3969] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 13:05:32 2022] POST /compute/v2.1/servers/261a8ed1-8a0c-4a83-a4e4-f3094ad3824c/action => generated 16399 bytes in 2262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:05:35.237360 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fe46a0cf-8a29-498a-b961-8c8c3992682a tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:35.237360 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-fe46a0cf-8a29-498a-b961-8c8c3992682a tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] [instance: a11bbd81-4323-466b-9d10-6f2d6c1913e4] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:35.255452 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe46a0cf-8a29-498a-b961-8c8c3992682a tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:35.256205 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe46a0cf-8a29-498a-b961-8c8c3992682a tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:35.256812 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe46a0cf-8a29-498a-b961-8c8c3992682a tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:35.257779 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe46a0cf-8a29-498a-b961-8c8c3992682a tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:35.262483 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe46a0cf-8a29-498a-b961-8c8c3992682a tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:35.263199 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fe46a0cf-8a29-498a-b961-8c8c3992682a tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:35.284612 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-af1e1960-ee51-46d5-b4fc-9bf017b7c5c1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:35.285322 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-af1e1960-ee51-46d5-b4fc-9bf017b7c5c1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: b76bc3fa-0395-4782-8a87-ec5cfc6da641] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:35.293743 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af1e1960-ee51-46d5-b4fc-9bf017b7c5c1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:35.295463 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af1e1960-ee51-46d5-b4fc-9bf017b7c5c1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:35.296085 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af1e1960-ee51-46d5-b4fc-9bf017b7c5c1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:35.296986 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af1e1960-ee51-46d5-b4fc-9bf017b7c5c1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:35.297581 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af1e1960-ee51-46d5-b4fc-9bf017b7c5c1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:35.298140 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af1e1960-ee51-46d5-b4fc-9bf017b7c5c1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:36.382684 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-fe46a0cf-8a29-498a-b961-8c8c3992682a tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59081fb246d34546980d57493efae40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2628c648b2e4465821bdcdf4330fb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:36.415629 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-fe46a0cf-8a29-498a-b961-8c8c3992682a tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] 10.222.0.67 "GET /compute/v2.1/servers/a11bbd81-4323-466b-9d10-6f2d6c1913e4" status: 200 len: 1710 microversion: 2.1 time: 1.187924 Sep 16 13:05:36.416491 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1918/3970] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:05:35 2022] GET /compute/v2.1/servers/a11bbd81-4323-466b-9d10-6f2d6c1913e4 => generated 1710 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:05:36.422720 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9ea90383-4bf6-4320-955e-3a8ebbeab068 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:36.423694 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9ea90383-4bf6-4320-955e-3a8ebbeab068 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:36.437111 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9ea90383-4bf6-4320-955e-3a8ebbeab068 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:36.437973 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9ea90383-4bf6-4320-955e-3a8ebbeab068 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:36.438661 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9ea90383-4bf6-4320-955e-3a8ebbeab068 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:36.439639 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9ea90383-4bf6-4320-955e-3a8ebbeab068 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:36.440436 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9ea90383-4bf6-4320-955e-3a8ebbeab068 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:36.441394 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9ea90383-4bf6-4320-955e-3a8ebbeab068 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:36.447300 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-af1e1960-ee51-46d5-b4fc-9bf017b7c5c1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:36.451418 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:05:36.474123 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-af1e1960-ee51-46d5-b4fc-9bf017b7c5c1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:36.486208 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-af1e1960-ee51-46d5-b4fc-9bf017b7c5c1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:36.487448 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-af1e1960-ee51-46d5-b4fc-9bf017b7c5c1 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641" status: 200 len: 1405 microversion: 2.20 time: 1.750283 Sep 16 13:05:36.488034 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2053/3971] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:05:34 2022] GET /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641 => generated 1405 bytes in 1753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:05:36.509646 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0c5a7995-6222-4922-a830-eced45e8abad tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:36.514143 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0c5a7995-6222-4922-a830-eced45e8abad tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:36.534586 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c5a7995-6222-4922-a830-eced45e8abad tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:36.538777 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c5a7995-6222-4922-a830-eced45e8abad tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:36.539492 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c5a7995-6222-4922-a830-eced45e8abad tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:36.544789 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c5a7995-6222-4922-a830-eced45e8abad tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:36.545464 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c5a7995-6222-4922-a830-eced45e8abad tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:36.550344 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c5a7995-6222-4922-a830-eced45e8abad tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:38.579777 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9ea90383-4bf6-4320-955e-3a8ebbeab068 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:38.585618 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0c5a7995-6222-4922-a830-eced45e8abad tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:38.594653 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9ea90383-4bf6-4320-955e-3a8ebbeab068 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1665 microversion: 2.1 time: 2.175707 Sep 16 13:05:38.605997 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1919/3972] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:05:36 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1665 bytes in 2189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:05:38.610463 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0c5a7995-6222-4922-a830-eced45e8abad tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:38.616693 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0c5a7995-6222-4922-a830-eced45e8abad tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:38.624082 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0c5a7995-6222-4922-a830-eced45e8abad tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 2953 microversion: 2.42 time: 2.133778 Sep 16 13:05:38.625353 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2054/3973] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:05:36 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 2953 bytes in 2135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:05:38.644410 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5dfdd7f8-4fbd-4622-9575-162c4e7287ad tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:38.645299 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5dfdd7f8-4fbd-4622-9575-162c4e7287ad tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] [instance: a11bbd81-4323-466b-9d10-6f2d6c1913e4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:38.650706 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a52312a7-7e5f-4304-aea6-edaa5e9f06be tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-116009996", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "c8f0423b-8f95-4074-9a6e-229fa6e975d1"}], "security_groups": [{"name": "tempest-securitygroup--317551808"}], "key_name": "tempest-keypair-130891515", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "bb6ed6f3-1c2f-4338-8a86-981c50c456b6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:05:38.656038 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5dfdd7f8-4fbd-4622-9575-162c4e7287ad tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:38.656758 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5dfdd7f8-4fbd-4622-9575-162c4e7287ad tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:38.658279 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5dfdd7f8-4fbd-4622-9575-162c4e7287ad tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:38.659335 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5dfdd7f8-4fbd-4622-9575-162c4e7287ad tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:38.660660 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5dfdd7f8-4fbd-4622-9575-162c4e7287ad tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:38.663147 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5dfdd7f8-4fbd-4622-9575-162c4e7287ad tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:38.804016 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5dfdd7f8-4fbd-4622-9575-162c4e7287ad tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:38.804792 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5dfdd7f8-4fbd-4622-9575-162c4e7287ad tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:38.805910 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5dfdd7f8-4fbd-4622-9575-162c4e7287ad tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:38.806520 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-5dfdd7f8-4fbd-4622-9575-162c4e7287ad tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lazy-loading 'fault' on Instance uuid a11bbd81-4323-466b-9d10-6f2d6c1913e4 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:05:39.075852 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5dfdd7f8-4fbd-4622-9575-162c4e7287ad tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59081fb246d34546980d57493efae40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2628c648b2e4465821bdcdf4330fb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:39.084171 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5dfdd7f8-4fbd-4622-9575-162c4e7287ad tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] 10.222.0.67 "GET /compute/v2.1/servers/a11bbd81-4323-466b-9d10-6f2d6c1913e4" status: 200 len: 1366 microversion: 2.1 time: 0.457529 Sep 16 13:05:39.116529 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2055/3974] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:05:38 2022] GET /compute/v2.1/servers/a11bbd81-4323-466b-9d10-6f2d6c1913e4 => generated 1366 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:05:39.145184 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-13bddfec-bf9c-47cc-908f-4805c3fbab0d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:39.146020 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-13bddfec-bf9c-47cc-908f-4805c3fbab0d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: b76bc3fa-0395-4782-8a87-ec5cfc6da641] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:39.153580 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13bddfec-bf9c-47cc-908f-4805c3fbab0d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:39.154328 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13bddfec-bf9c-47cc-908f-4805c3fbab0d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:39.155003 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13bddfec-bf9c-47cc-908f-4805c3fbab0d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:39.155889 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13bddfec-bf9c-47cc-908f-4805c3fbab0d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:39.156533 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13bddfec-bf9c-47cc-908f-4805c3fbab0d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:39.157107 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13bddfec-bf9c-47cc-908f-4805c3fbab0d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:39.419134 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.network.neutron [None req-a52312a7-7e5f-4304-aea6-edaa5e9f06be tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] validate_networks() for [('c8f0423b-8f95-4074-9a6e-229fa6e975d1', None, None, None, None, None)] {{(pid=128780) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:05:39.966815 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-13bddfec-bf9c-47cc-908f-4805c3fbab0d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:39.983194 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-13bddfec-bf9c-47cc-908f-4805c3fbab0d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:39.991361 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-13bddfec-bf9c-47cc-908f-4805c3fbab0d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:39.996464 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-13bddfec-bf9c-47cc-908f-4805c3fbab0d tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641" status: 200 len: 1405 microversion: 2.20 time: 0.878592 Sep 16 13:05:39.997292 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2056/3975] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:05:39 2022] GET /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641 => generated 1405 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:05:40.004740 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-e302460a-67dd-47ce-b39f-51080d51402f req-9509129a-c938-4450-a7c1-e2e491eb1c78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a11bbd81-4323-466b-9d10-6f2d6c1913e4", "name": "network-vif-deleted", "tag": "c40c0347-2b42-4346-a6fd-c898430328a0"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:05:40.017306 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e302460a-67dd-47ce-b39f-51080d51402f req-9509129a-c938-4450-a7c1-e2e491eb1c78 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:40.017982 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e302460a-67dd-47ce-b39f-51080d51402f req-9509129a-c938-4450-a7c1-e2e491eb1c78 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:40.018569 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e302460a-67dd-47ce-b39f-51080d51402f req-9509129a-c938-4450-a7c1-e2e491eb1c78 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:40.037275 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-e302460a-67dd-47ce-b39f-51080d51402f req-9509129a-c938-4450-a7c1-e2e491eb1c78 service nova] Creating event network-vif-deleted:c40c0347-2b42-4346-a6fd-c898430328a0 for instance a11bbd81-4323-466b-9d10-6f2d6c1913e4 on n-h2-858094-4 Sep 16 13:05:40.044954 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-e302460a-67dd-47ce-b39f-51080d51402f req-9509129a-c938-4450-a7c1-e2e491eb1c78 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046018 Sep 16 13:05:40.046118 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2057/3976] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:05:40.052030 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9132c266-1eaf-43a0-8874-fa191347acbe tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:40.053515 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9132c266-1eaf-43a0-8874-fa191347acbe tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:40.064978 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9132c266-1eaf-43a0-8874-fa191347acbe tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:40.064978 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9132c266-1eaf-43a0-8874-fa191347acbe tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:40.064978 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9132c266-1eaf-43a0-8874-fa191347acbe tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:40.065488 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9132c266-1eaf-43a0-8874-fa191347acbe tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:40.066191 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9132c266-1eaf-43a0-8874-fa191347acbe tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:40.067025 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9132c266-1eaf-43a0-8874-fa191347acbe tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:40.785000 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9132c266-1eaf-43a0-8874-fa191347acbe tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:40.799759 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9132c266-1eaf-43a0-8874-fa191347acbe tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1665 microversion: 2.1 time: 0.751200 Sep 16 13:05:40.804162 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2058/3977] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:05:40 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1665 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:05:40.812410 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fa56997f-876e-4702-aae2-75a15bf4ff0c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:40.813812 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fa56997f-876e-4702-aae2-75a15bf4ff0c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:40.824689 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa56997f-876e-4702-aae2-75a15bf4ff0c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:40.825606 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa56997f-876e-4702-aae2-75a15bf4ff0c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:40.826259 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa56997f-876e-4702-aae2-75a15bf4ff0c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:40.827185 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa56997f-876e-4702-aae2-75a15bf4ff0c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:40.827875 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa56997f-876e-4702-aae2-75a15bf4ff0c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:40.828553 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa56997f-876e-4702-aae2-75a15bf4ff0c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:41.174200 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=6 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:05:41.313876 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=14 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:05:41.926501 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fa56997f-876e-4702-aae2-75a15bf4ff0c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:41.941326 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fa56997f-876e-4702-aae2-75a15bf4ff0c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:41.950778 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fa56997f-876e-4702-aae2-75a15bf4ff0c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:41.952645 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fa56997f-876e-4702-aae2-75a15bf4ff0c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 2953 microversion: 2.42 time: 1.147041 Sep 16 13:05:41.958967 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2059/3978] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:05:40 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 2953 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:05:41.982491 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-f49a6b85-e772-41c1-874d-2f05d660bda0 req-06172aaf-3a5c-4bbd-8095-0d2f33dd70a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b76bc3fa-0395-4782-8a87-ec5cfc6da641", "name": "network-vif-plugged", "status": "completed", "tag": "8a68040c-b0d1-432e-b8a2-3698222d82ee"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:05:42.013893 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f49a6b85-e772-41c1-874d-2f05d660bda0 req-06172aaf-3a5c-4bbd-8095-0d2f33dd70a8 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:42.016084 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f49a6b85-e772-41c1-874d-2f05d660bda0 req-06172aaf-3a5c-4bbd-8095-0d2f33dd70a8 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:42.016555 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f49a6b85-e772-41c1-874d-2f05d660bda0 req-06172aaf-3a5c-4bbd-8095-0d2f33dd70a8 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:42.040193 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-f49a6b85-e772-41c1-874d-2f05d660bda0 req-06172aaf-3a5c-4bbd-8095-0d2f33dd70a8 service nova] Creating event network-vif-plugged:8a68040c-b0d1-432e-b8a2-3698222d82ee for instance b76bc3fa-0395-4782-8a87-ec5cfc6da641 on n-h2-858094-4 Sep 16 13:05:42.047598 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-f49a6b85-e772-41c1-874d-2f05d660bda0 req-06172aaf-3a5c-4bbd-8095-0d2f33dd70a8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087143 Sep 16 13:05:42.048881 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2060/3979] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:05:42.073741 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-da860cd5-3798-40dd-a705-b72064c51ee3 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:42.074748 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-da860cd5-3798-40dd-a705-b72064c51ee3 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] [instance: a11bbd81-4323-466b-9d10-6f2d6c1913e4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:42.082168 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da860cd5-3798-40dd-a705-b72064c51ee3 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:42.082902 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da860cd5-3798-40dd-a705-b72064c51ee3 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:42.083502 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da860cd5-3798-40dd-a705-b72064c51ee3 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:42.084445 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da860cd5-3798-40dd-a705-b72064c51ee3 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:42.085083 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da860cd5-3798-40dd-a705-b72064c51ee3 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:42.085798 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da860cd5-3798-40dd-a705-b72064c51ee3 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:42.113906 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-da860cd5-3798-40dd-a705-b72064c51ee3 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] HTTP exception thrown: Instance a11bbd81-4323-466b-9d10-6f2d6c1913e4 could not be found. Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-da860cd5-3798-40dd-a705-b72064c51ee3 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Request method failure captured: Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/a11bbd81-4323-466b-9d10-6f2d6c1913e4 HTTP/1.1 Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHRc8E4RHK1vyqI1Pr9hY5VsE1b4r5dEllJLCYpB2UaMtLpWFxOZrDASFDCnsJw1JQ3Nb2ZvfNlJNLtC5XVqoi1eIwZ2CP7O1kJmyvWdRCH3UvjFRamcLj6JxdlQ2WR_JrpPwnHIJMiGgErraM5tDHIlpF-FB1U-5i_1VFe7--pHAjU Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: d2628c648b2e4465821bdcdf4330fb4e Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersTestManualDisk-385085741 Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d2628c648b2e4465821bdcdf4330fb4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d2628c648b2e4465821bdcdf4330fb4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d2628c648b2e4465821bdcdf4330fb4e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d2628c648b2e4465821bdcdf4330fb4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ServersTestManualDisk-385085741 Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: d2628c648b2e4465821bdcdf4330fb4e Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersTestManualDisk-385085741 Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ServersTestManualDisk-385085741-project Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 59081fb246d34546980d57493efae40b Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ServersTestManualDisk-385085741-project Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance a11bbd81-4323-466b-9d10-6f2d6c1913e4 could not be found. Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': 'a11bbd81-4323-466b-9d10-6f2d6c1913e4'} Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a11bbd81-4323-466b-9d10-6f2d6c1913e4 could not be found. Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a11bbd81-4323-466b-9d10-6f2d6c1913e4 could not be found. Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:05:42.117401 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:05:42.122068 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:05:42.122068 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:05:42.122068 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:05:42.122068 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:05:42.122068 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:05:42.122068 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a11bbd81-4323-466b-9d10-6f2d6c1913e4 could not be found. Sep 16 13:05:42.122068 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:05:42.123674 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-da860cd5-3798-40dd-a705-b72064c51ee3 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Returning 404 to user: Instance a11bbd81-4323-466b-9d10-6f2d6c1913e4 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:05:42.124862 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-da860cd5-3798-40dd-a705-b72064c51ee3 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] 10.222.0.67 "GET /compute/v2.1/servers/a11bbd81-4323-466b-9d10-6f2d6c1913e4" status: 404 len: 111 microversion: 2.1 time: 0.061199 Sep 16 13:05:42.129619 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2061/3980] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:05:42 2022] GET /compute/v2.1/servers/a11bbd81-4323-466b-9d10-6f2d6c1913e4 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:05:42.419063 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5d1d3f3c-be09-4578-a0d1-309b242d92b1 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:42.420549 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5d1d3f3c-be09-4578-a0d1-309b242d92b1 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:42.441096 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d1d3f3c-be09-4578-a0d1-309b242d92b1 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:42.441096 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d1d3f3c-be09-4578-a0d1-309b242d92b1 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:42.441683 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d1d3f3c-be09-4578-a0d1-309b242d92b1 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:42.442420 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d1d3f3c-be09-4578-a0d1-309b242d92b1 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:42.442887 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d1d3f3c-be09-4578-a0d1-309b242d92b1 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:42.443318 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d1d3f3c-be09-4578-a0d1-309b242d92b1 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:42.518185 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-a52312a7-7e5f-4304-aea6-edaa5e9f06be tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Getting quotas for project 069d839f047b4c38a1dae0ff8d692230. Resources: dict_keys(['metadata_items']) {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:05:42.531806 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-a52312a7-7e5f-4304-aea6-edaa5e9f06be tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Getting quotas for user aa734086fec1432d88be79bc2fb0ec91 and project 069d839f047b4c38a1dae0ff8d692230. Resources: dict_keys(['metadata_items']) {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:05:42.569938 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-a52312a7-7e5f-4304-aea6-edaa5e9f06be tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Flavor limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:05:42.571771 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-a52312a7-7e5f-4304-aea6-edaa5e9f06be tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Image limits 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:05:42.574917 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-a52312a7-7e5f-4304-aea6-edaa5e9f06be tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Flavor pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:05:42.575598 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-a52312a7-7e5f-4304-aea6-edaa5e9f06be tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Image pref 0:0:0 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:05:42.576263 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.virt.hardware [None req-a52312a7-7e5f-4304-aea6-edaa5e9f06be tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:05:42.600658 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a52312a7-7e5f-4304-aea6-edaa5e9f06be tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:42.601495 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a52312a7-7e5f-4304-aea6-edaa5e9f06be tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:42.612788 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a52312a7-7e5f-4304-aea6-edaa5e9f06be tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:42.614067 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a52312a7-7e5f-4304-aea6-edaa5e9f06be tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:42.616511 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a52312a7-7e5f-4304-aea6-edaa5e9f06be tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:42.630315 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a52312a7-7e5f-4304-aea6-edaa5e9f06be tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:42.702396 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-a52312a7-7e5f-4304-aea6-edaa5e9f06be tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Getting quotas for project 069d839f047b4c38a1dae0ff8d692230. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:05:42.729972 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.quota [None req-a52312a7-7e5f-4304-aea6-edaa5e9f06be tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Getting quotas for user aa734086fec1432d88be79bc2fb0ec91 and project 069d839f047b4c38a1dae0ff8d692230. Resources: {'cores', 'instances', 'ram'} {{(pid=128780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:05:42.851453 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a52312a7-7e5f-4304-aea6-edaa5e9f06be tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Going to run 1 instances... {{(pid=128780) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:05:42.854554 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a52312a7-7e5f-4304-aea6-edaa5e9f06be tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] [instance: 6b0851db-8113-49aa-abe4-e5cd1b345b9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bb6ed6f3-1c2f-4338-8a86-981c50c456b6',volume_size=None,volume_type=None)] {{(pid=128780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:05:43.089312 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a52312a7-7e5f-4304-aea6-edaa5e9f06be tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 4.481918 Sep 16 13:05:43.098922 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1920/3981] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 13:05:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 4492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 13:05:43.108422 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-522df872-1639-4099-8b8e-9dd9454fe278 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:43.109651 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-522df872-1639-4099-8b8e-9dd9454fe278 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: b76bc3fa-0395-4782-8a87-ec5cfc6da641] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:43.134669 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-522df872-1639-4099-8b8e-9dd9454fe278 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:43.137529 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-522df872-1639-4099-8b8e-9dd9454fe278 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:43.139623 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-522df872-1639-4099-8b8e-9dd9454fe278 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:43.140898 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-522df872-1639-4099-8b8e-9dd9454fe278 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:43.142580 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-522df872-1639-4099-8b8e-9dd9454fe278 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:43.143381 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-522df872-1639-4099-8b8e-9dd9454fe278 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:43.631175 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5d1d3f3c-be09-4578-a0d1-309b242d92b1 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:43.641021 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5d1d3f3c-be09-4578-a0d1-309b242d92b1 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1665 microversion: 2.1 time: 1.509744 Sep 16 13:05:43.641803 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2062/3982] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:05:42 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1665 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:05:43.661171 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-52dc0165-9df0-405e-aa0c-8ea5320e3299 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] Calling method '.version_select at 0x7f1034a35e50>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:43.684458 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-52dc0165-9df0-405e-aa0c-8ea5320e3299 tempest-ServersTestManualDisk-385085741 tempest-ServersTestManualDisk-385085741-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-316883394" status: 202 len: 0 microversion: 2.1 time: 0.041058 Sep 16 13:05:43.688603 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2063/3983] 10.222.0.67 () {58 vars in 1218 bytes} [Fri Sep 16 13:05:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-316883394 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:05:43.694224 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fde66d4b-b2f9-4be5-97e1-9b1a15fd60cb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:43.695107 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fde66d4b-b2f9-4be5-97e1-9b1a15fd60cb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:43.702759 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fde66d4b-b2f9-4be5-97e1-9b1a15fd60cb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:43.703341 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fde66d4b-b2f9-4be5-97e1-9b1a15fd60cb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:43.703762 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fde66d4b-b2f9-4be5-97e1-9b1a15fd60cb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:43.704535 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fde66d4b-b2f9-4be5-97e1-9b1a15fd60cb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:43.705158 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fde66d4b-b2f9-4be5-97e1-9b1a15fd60cb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:43.705743 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fde66d4b-b2f9-4be5-97e1-9b1a15fd60cb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:43.779434 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-522df872-1639-4099-8b8e-9dd9454fe278 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:43.790001 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-522df872-1639-4099-8b8e-9dd9454fe278 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:43.795123 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-522df872-1639-4099-8b8e-9dd9454fe278 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:43.797258 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-522df872-1639-4099-8b8e-9dd9454fe278 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641" status: 200 len: 1405 microversion: 2.20 time: 0.695457 Sep 16 13:05:43.808207 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1921/3984] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:05:43 2022] GET /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641 => generated 1405 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:05:43.808207 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f7a47ee6-880a-48ea-9c4f-189017183ccb tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:43.808558 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f7a47ee6-880a-48ea-9c4f-189017183ccb tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] [instance: 6b0851db-8113-49aa-abe4-e5cd1b345b9b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:44.081188 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f7a47ee6-880a-48ea-9c4f-189017183ccb tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa734086fec1432d88be79bc2fb0ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069d839f047b4c38a1dae0ff8d692230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:44.117009 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f7a47ee6-880a-48ea-9c4f-189017183ccb tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] 10.222.0.67 "GET /compute/v2.1/servers/6b0851db-8113-49aa-abe4-e5cd1b345b9b" status: 200 len: 1120 microversion: 2.1 time: 0.292263 Sep 16 13:05:44.118232 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1922/3985] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:05:43 2022] GET /compute/v2.1/servers/6b0851db-8113-49aa-abe4-e5cd1b345b9b => generated 1120 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:05:44.133378 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-56e30ba0-e5ce-4b56-956b-a678897b49cc tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:44.135249 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-56e30ba0-e5ce-4b56-956b-a678897b49cc tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:44.158935 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-56e30ba0-e5ce-4b56-956b-a678897b49cc tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:44.159458 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-56e30ba0-e5ce-4b56-956b-a678897b49cc tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:44.160037 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-56e30ba0-e5ce-4b56-956b-a678897b49cc tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:44.160669 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-56e30ba0-e5ce-4b56-956b-a678897b49cc tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:44.161464 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-56e30ba0-e5ce-4b56-956b-a678897b49cc tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:44.161615 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-56e30ba0-e5ce-4b56-956b-a678897b49cc tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:44.710437 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fde66d4b-b2f9-4be5-97e1-9b1a15fd60cb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:44.722193 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fde66d4b-b2f9-4be5-97e1-9b1a15fd60cb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:44.724009 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fde66d4b-b2f9-4be5-97e1-9b1a15fd60cb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:44.725574 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fde66d4b-b2f9-4be5-97e1-9b1a15fd60cb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 2932 microversion: 2.42 time: 1.035975 Sep 16 13:05:44.726804 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2064/3986] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:05:43 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 2932 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:05:44.733910 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-947527f4-04f1-4c73-a903-9fae37c3b512 req-0676e91a-516f-47f6-8b78-b6bf53182b65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "defaddc3-3750-4d8a-b18a-dd6fdce1dbbf", "name": "network-vif-unplugged", "status": "completed", "tag": "9b032a10-f56e-47fc-b941-54f12778f01c"}, {"server_uuid": "defaddc3-3750-4d8a-b18a-dd6fdce1dbbf", "name": "network-vif-unplugged", "status": "completed", "tag": "8c121ccb-eba9-4b08-98af-afba73327fcc"}, {"server_uuid": "defaddc3-3750-4d8a-b18a-dd6fdce1dbbf", "name": "network-vif-unplugged", "status": "completed", "tag": "328ce2f8-022c-446e-b388-06295b8c63e7"}, {"server_uuid": "defaddc3-3750-4d8a-b18a-dd6fdce1dbbf", "name": "network-vif-unplugged", "status": "completed", "tag": "8a23d825-e263-4839-8617-11f3b05818ce"}, {"server_uuid": "defaddc3-3750-4d8a-b18a-dd6fdce1dbbf", "name": "network-vif-unplugged", "status": "completed", "tag": "c7eb5869-5d95-47b8-9539-2bec50eb4428"}, {"server_uuid": "defaddc3-3750-4d8a-b18a-dd6fdce1dbbf", "name": "network-vif-unplugged", "status": "completed", "tag": "96ec0261-1181-470b-971b-163682a9e81d"}, {"server_uuid": "defaddc3-3750-4d8a-b18a-dd6fdce1dbbf", "name": "network-vif-unplugged", "status": "completed", "tag": "8874748b-6030-4aea-9e6b-79db8c8d555d"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:05:44.747638 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-947527f4-04f1-4c73-a903-9fae37c3b512 req-0676e91a-516f-47f6-8b78-b6bf53182b65 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:44.748777 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-947527f4-04f1-4c73-a903-9fae37c3b512 req-0676e91a-516f-47f6-8b78-b6bf53182b65 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:44.749619 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-947527f4-04f1-4c73-a903-9fae37c3b512 req-0676e91a-516f-47f6-8b78-b6bf53182b65 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:44.777081 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-947527f4-04f1-4c73-a903-9fae37c3b512 req-0676e91a-516f-47f6-8b78-b6bf53182b65 service nova] Creating event network-vif-unplugged:9b032a10-f56e-47fc-b941-54f12778f01c for instance defaddc3-3750-4d8a-b18a-dd6fdce1dbbf on n-h1-858094-4 Sep 16 13:05:44.778017 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-947527f4-04f1-4c73-a903-9fae37c3b512 req-0676e91a-516f-47f6-8b78-b6bf53182b65 service nova] Creating event network-vif-unplugged:8c121ccb-eba9-4b08-98af-afba73327fcc for instance defaddc3-3750-4d8a-b18a-dd6fdce1dbbf on n-h1-858094-4 Sep 16 13:05:44.779158 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-947527f4-04f1-4c73-a903-9fae37c3b512 req-0676e91a-516f-47f6-8b78-b6bf53182b65 service nova] Creating event network-vif-unplugged:328ce2f8-022c-446e-b388-06295b8c63e7 for instance defaddc3-3750-4d8a-b18a-dd6fdce1dbbf on n-h1-858094-4 Sep 16 13:05:44.779933 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-947527f4-04f1-4c73-a903-9fae37c3b512 req-0676e91a-516f-47f6-8b78-b6bf53182b65 service nova] Creating event network-vif-unplugged:8a23d825-e263-4839-8617-11f3b05818ce for instance defaddc3-3750-4d8a-b18a-dd6fdce1dbbf on n-h1-858094-4 Sep 16 13:05:44.780730 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-947527f4-04f1-4c73-a903-9fae37c3b512 req-0676e91a-516f-47f6-8b78-b6bf53182b65 service nova] Creating event network-vif-unplugged:c7eb5869-5d95-47b8-9539-2bec50eb4428 for instance defaddc3-3750-4d8a-b18a-dd6fdce1dbbf on n-h1-858094-4 Sep 16 13:05:44.781465 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-947527f4-04f1-4c73-a903-9fae37c3b512 req-0676e91a-516f-47f6-8b78-b6bf53182b65 service nova] Creating event network-vif-unplugged:96ec0261-1181-470b-971b-163682a9e81d for instance defaddc3-3750-4d8a-b18a-dd6fdce1dbbf on n-h1-858094-4 Sep 16 13:05:44.782217 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-947527f4-04f1-4c73-a903-9fae37c3b512 req-0676e91a-516f-47f6-8b78-b6bf53182b65 service nova] Creating event network-vif-unplugged:8874748b-6030-4aea-9e6b-79db8c8d555d for instance defaddc3-3750-4d8a-b18a-dd6fdce1dbbf on n-h1-858094-4 Sep 16 13:05:44.790185 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-947527f4-04f1-4c73-a903-9fae37c3b512 req-0676e91a-516f-47f6-8b78-b6bf53182b65 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1223 microversion: 2.1 time: 0.059910 Sep 16 13:05:44.791979 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2065/3987] 10.222.0.67 () {64 vars in 1318 bytes} [Fri Sep 16 13:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 1223 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:05:44.826381 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f8c88404-e970-4a91-a179-8fdeca2eec02 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:44.827717 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f8c88404-e970-4a91-a179-8fdeca2eec02 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: b76bc3fa-0395-4782-8a87-ec5cfc6da641] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:44.841169 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8c88404-e970-4a91-a179-8fdeca2eec02 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:44.842003 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8c88404-e970-4a91-a179-8fdeca2eec02 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:44.842452 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8c88404-e970-4a91-a179-8fdeca2eec02 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:44.842861 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8c88404-e970-4a91-a179-8fdeca2eec02 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:44.843315 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8c88404-e970-4a91-a179-8fdeca2eec02 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:44.843746 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8c88404-e970-4a91-a179-8fdeca2eec02 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:45.051471 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-56e30ba0-e5ce-4b56-956b-a678897b49cc tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:45.072108 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-56e30ba0-e5ce-4b56-956b-a678897b49cc tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1665 microversion: 2.1 time: 0.952672 Sep 16 13:05:45.075774 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1923/3988] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:05:44 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1665 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:05:45.110236 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-dc23eb68-dd4a-49f7-89ff-bac155f16453 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:05:45.121500 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-dc23eb68-dd4a-49f7-89ff-bac155f16453 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:45.152936 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dc23eb68-dd4a-49f7-89ff-bac155f16453 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:45.153806 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dc23eb68-dd4a-49f7-89ff-bac155f16453 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:45.154476 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dc23eb68-dd4a-49f7-89ff-bac155f16453 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:45.155542 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dc23eb68-dd4a-49f7-89ff-bac155f16453 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:45.156263 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dc23eb68-dd4a-49f7-89ff-bac155f16453 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:45.156972 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dc23eb68-dd4a-49f7-89ff-bac155f16453 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:45.247525 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-dc23eb68-dd4a-49f7-89ff-bac155f16453 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Locking {{(pid=128780) lock /opt/stack/nova/nova/compute/api.py:4845}} Sep 16 13:05:45.330956 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:05:45.341697 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-dc23eb68-dd4a-49f7-89ff-bac155f16453 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "POST /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771/action" status: 202 len: 0 microversion: 2.1 time: 0.246900 Sep 16 13:05:45.342865 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1924/3989] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 13:05:45 2022] POST /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 13:05:45.351649 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c8b272cf-1df7-4164-9210-5928e61a9872 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:45.353778 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c8b272cf-1df7-4164-9210-5928e61a9872 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] [instance: 6b0851db-8113-49aa-abe4-e5cd1b345b9b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:45.362974 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c8b272cf-1df7-4164-9210-5928e61a9872 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:45.363867 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c8b272cf-1df7-4164-9210-5928e61a9872 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:45.364565 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c8b272cf-1df7-4164-9210-5928e61a9872 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:45.365543 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c8b272cf-1df7-4164-9210-5928e61a9872 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:45.366270 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c8b272cf-1df7-4164-9210-5928e61a9872 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:45.366932 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c8b272cf-1df7-4164-9210-5928e61a9872 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:46.330899 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c8b272cf-1df7-4164-9210-5928e61a9872 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa734086fec1432d88be79bc2fb0ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069d839f047b4c38a1dae0ff8d692230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:46.350409 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c8b272cf-1df7-4164-9210-5928e61a9872 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] 10.222.0.67 "GET /compute/v2.1/servers/6b0851db-8113-49aa-abe4-e5cd1b345b9b" status: 200 len: 1236 microversion: 2.1 time: 1.004093 Sep 16 13:05:46.352494 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1925/3990] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:05:45 2022] GET /compute/v2.1/servers/6b0851db-8113-49aa-abe4-e5cd1b345b9b => generated 1236 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:05:46.379627 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a0eb44d9-0f9e-4fe2-8c7f-9689fa178629 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:46.385277 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a0eb44d9-0f9e-4fe2-8c7f-9689fa178629 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:46.401207 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a0eb44d9-0f9e-4fe2-8c7f-9689fa178629 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:46.401709 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a0eb44d9-0f9e-4fe2-8c7f-9689fa178629 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:46.402158 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a0eb44d9-0f9e-4fe2-8c7f-9689fa178629 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:46.407429 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a0eb44d9-0f9e-4fe2-8c7f-9689fa178629 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:46.408982 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a0eb44d9-0f9e-4fe2-8c7f-9689fa178629 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:46.409463 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a0eb44d9-0f9e-4fe2-8c7f-9689fa178629 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:47.116364 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f8c88404-e970-4a91-a179-8fdeca2eec02 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:47.136200 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f8c88404-e970-4a91-a179-8fdeca2eec02 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:47.139592 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f8c88404-e970-4a91-a179-8fdeca2eec02 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:47.140856 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f8c88404-e970-4a91-a179-8fdeca2eec02 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641" status: 200 len: 1598 microversion: 2.20 time: 2.319914 Sep 16 13:05:47.141418 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2066/3991] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:05:44 2022] GET /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641 => generated 1598 bytes in 2322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:05:47.160458 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2f566c78-8475-4ad6-bd71-d24b05370b02 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:47.161573 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2f566c78-8475-4ad6-bd71-d24b05370b02 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:47.164709 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:05:47.172240 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f566c78-8475-4ad6-bd71-d24b05370b02 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:47.173020 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f566c78-8475-4ad6-bd71-d24b05370b02 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:47.173642 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f566c78-8475-4ad6-bd71-d24b05370b02 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:47.174528 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f566c78-8475-4ad6-bd71-d24b05370b02 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:47.175161 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f566c78-8475-4ad6-bd71-d24b05370b02 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:47.175847 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f566c78-8475-4ad6-bd71-d24b05370b02 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:47.757910 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a0eb44d9-0f9e-4fe2-8c7f-9689fa178629 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:47.769486 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a0eb44d9-0f9e-4fe2-8c7f-9689fa178629 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1665 microversion: 2.1 time: 1.401401 Sep 16 13:05:47.771078 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1926/3992] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:05:46 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1665 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:05:47.776353 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ecd4f935-490d-4c98-b2e2-092743a6ccc0 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:47.780424 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ecd4f935-490d-4c98-b2e2-092743a6ccc0 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: b76bc3fa-0395-4782-8a87-ec5cfc6da641] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:47.800270 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ecd4f935-490d-4c98-b2e2-092743a6ccc0 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:47.800701 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ecd4f935-490d-4c98-b2e2-092743a6ccc0 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:47.801146 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ecd4f935-490d-4c98-b2e2-092743a6ccc0 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:47.804840 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ecd4f935-490d-4c98-b2e2-092743a6ccc0 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:47.805934 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ecd4f935-490d-4c98-b2e2-092743a6ccc0 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:47.806382 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ecd4f935-490d-4c98-b2e2-092743a6ccc0 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:48.266288 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ecd4f935-490d-4c98-b2e2-092743a6ccc0 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.494092 Sep 16 13:05:48.267169 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1927/3993] 10.222.0.67 () {60 vars in 1316 bytes} [Fri Sep 16 13:05:47 2022] GET /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641/os-interface => generated 285 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:05:48.271922 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-34b51f66-73d1-432a-a45a-2cf20d33b88f tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:48.272990 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-34b51f66-73d1-432a-a45a-2cf20d33b88f tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] [instance: 6b0851db-8113-49aa-abe4-e5cd1b345b9b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:48.303933 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-34b51f66-73d1-432a-a45a-2cf20d33b88f tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:48.304782 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-34b51f66-73d1-432a-a45a-2cf20d33b88f tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:48.305526 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-34b51f66-73d1-432a-a45a-2cf20d33b88f tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:48.306429 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-34b51f66-73d1-432a-a45a-2cf20d33b88f tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:48.307964 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-34b51f66-73d1-432a-a45a-2cf20d33b88f tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:48.308594 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-34b51f66-73d1-432a-a45a-2cf20d33b88f tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:48.619837 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2f566c78-8475-4ad6-bd71-d24b05370b02 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:48.653590 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2f566c78-8475-4ad6-bd71-d24b05370b02 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:48.666829 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2f566c78-8475-4ad6-bd71-d24b05370b02 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:48.669239 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2f566c78-8475-4ad6-bd71-d24b05370b02 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 2911 microversion: 2.42 time: 1.519956 Sep 16 13:05:48.669848 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2067/3994] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:05:47 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 2911 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:05:48.692463 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6dc16967-d2a9-4e54-b256-55647902ffff tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:05:48.701842 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6dc16967-d2a9-4e54-b256-55647902ffff tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:48.703375 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6dc16967-d2a9-4e54-b256-55647902ffff tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:48.703966 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6dc16967-d2a9-4e54-b256-55647902ffff tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:48.738055 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-6dc16967-d2a9-4e54-b256-55647902ffff tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] HTTP exception thrown: Instance af5e660b-de79-42ca-a8de-fe06738b9771 is locked Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6dc16967-d2a9-4e54-b256-55647902ffff tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Request method failure captured: Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771/action HTTP/1.1 Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 15 Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHN4H0mqbRKG4kwyN719lB-rlkupTwvsmrn4ox_ngpaxNRJ-b5Wg_DW6HmyTZu5V16vyo6QU8JzCPoU-O3_i69q4MBrgBBTfsSGMQQu4VzZeuFSAPoetdlDSc_sp88sFOuHN8WnjYEnAZyJG0HnHrfJ0vfcYBd7E0zzpQPhfuCR_ZU4 Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 337bc9a50c6846ada58b194c94d0f193 Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerActionsTestJSON-415461531 Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/337bc9a50c6846ada58b194c94d0f193"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/337bc9a50c6846ada58b194c94d0f193"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_337bc9a50c6846ada58b194c94d0f193", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/337bc9a50c6846ada58b194c94d0f193"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ServerActionsTestJSON-415461531 Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 337bc9a50c6846ada58b194c94d0f193 Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerActionsTestJSON-415461531 Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ServerActionsTestJSON-415461531-project Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 968cbe62235f472fb9002171f19e1375 Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ServerActionsTestJSON-415461531-project Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: {"os-stop": {}} Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance af5e660b-de79-42ca-a8de-fe06738b9771 is locked Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': 'af5e660b-de79-42ca-a8de-fe06738b9771', 'body': {'os-stop': {}}} Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance af5e660b-de79-42ca-a8de-fe06738b9771 is locked Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance af5e660b-de79-42ca-a8de-fe06738b9771 is locked Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af5e660b-de79-42ca-a8de-fe06738b9771 is locked Sep 16 13:05:48.740886 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:05:48.748269 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6dc16967-d2a9-4e54-b256-55647902ffff tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Returning 409 to user: Instance af5e660b-de79-42ca-a8de-fe06738b9771 is locked {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:05:48.756494 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6dc16967-d2a9-4e54-b256-55647902ffff tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "POST /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771/action" status: 409 len: 107 microversion: 2.1 time: 0.080373 Sep 16 13:05:48.763919 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2068/3995] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 13:05:48 2022] POST /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771/action => generated 107 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 16 13:05:48.775503 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-bfd0ee77-45f0-4a8d-b817-77c9fc7a211d req-93f214b9-d9dc-45d8-bbfe-8c2ba6c2db05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b0851db-8113-49aa-abe4-e5cd1b345b9b", "tag": "f97b74c9-9b69-40fb-b7ec-2e8f5d0f5b69"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:05:48.810253 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bfd0ee77-45f0-4a8d-b817-77c9fc7a211d req-93f214b9-d9dc-45d8-bbfe-8c2ba6c2db05 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:48.812821 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bfd0ee77-45f0-4a8d-b817-77c9fc7a211d req-93f214b9-d9dc-45d8-bbfe-8c2ba6c2db05 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:48.814272 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bfd0ee77-45f0-4a8d-b817-77c9fc7a211d req-93f214b9-d9dc-45d8-bbfe-8c2ba6c2db05 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:48.844213 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-bfd0ee77-45f0-4a8d-b817-77c9fc7a211d req-93f214b9-d9dc-45d8-bbfe-8c2ba6c2db05 service nova] Creating event network-changed:f97b74c9-9b69-40fb-b7ec-2e8f5d0f5b69 for instance 6b0851db-8113-49aa-abe4-e5cd1b345b9b on n-h2-858094-4 Sep 16 13:05:48.858617 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-bfd0ee77-45f0-4a8d-b817-77c9fc7a211d req-93f214b9-d9dc-45d8-bbfe-8c2ba6c2db05 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095990 Sep 16 13:05:48.860029 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2069/3996] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:05:48.868316 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e2adc255-a61d-4490-a401-33e043759e3e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:05:48.869865 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e2adc255-a61d-4490-a401-33e043759e3e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:48.881710 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2adc255-a61d-4490-a401-33e043759e3e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:48.885354 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2adc255-a61d-4490-a401-33e043759e3e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:48.885928 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2adc255-a61d-4490-a401-33e043759e3e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:48.886956 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2adc255-a61d-4490-a401-33e043759e3e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:48.890473 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2adc255-a61d-4490-a401-33e043759e3e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:48.891058 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2adc255-a61d-4490-a401-33e043759e3e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:48.969914 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e2adc255-a61d-4490-a401-33e043759e3e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Unlocking {{(pid=128779) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 16 13:05:49.079620 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e2adc255-a61d-4490-a401-33e043759e3e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "POST /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771/action" status: 202 len: 0 microversion: 2.1 time: 0.217934 Sep 16 13:05:49.080785 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2070/3997] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 13:05:48 2022] POST /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:05:49.089664 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2fb3b9c3-18de-49b7-8ced-cbb11178c854 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:05:49.105582 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2fb3b9c3-18de-49b7-8ced-cbb11178c854 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:49.105994 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2fb3b9c3-18de-49b7-8ced-cbb11178c854 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:49.106887 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2fb3b9c3-18de-49b7-8ced-cbb11178c854 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:49.182923 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2fb3b9c3-18de-49b7-8ced-cbb11178c854 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Going to try to stop instance {{(pid=128779) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 16 13:05:49.267248 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=5 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:05:49.308758 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2fb3b9c3-18de-49b7-8ced-cbb11178c854 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "POST /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771/action" status: 202 len: 0 microversion: 2.1 time: 0.221564 Sep 16 13:05:49.311727 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2071/3998] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 13:05:49 2022] POST /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 13:05:49.324776 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fd9c3390-2eac-4410-a47a-d0a759aa619d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:49.325493 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fd9c3390-2eac-4410-a47a-d0a759aa619d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:49.343218 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd9c3390-2eac-4410-a47a-d0a759aa619d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:49.344921 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd9c3390-2eac-4410-a47a-d0a759aa619d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:49.345397 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd9c3390-2eac-4410-a47a-d0a759aa619d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:49.348546 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd9c3390-2eac-4410-a47a-d0a759aa619d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:49.349039 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd9c3390-2eac-4410-a47a-d0a759aa619d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:49.349482 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd9c3390-2eac-4410-a47a-d0a759aa619d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:49.679142 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-34b51f66-73d1-432a-a45a-2cf20d33b88f tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa734086fec1432d88be79bc2fb0ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069d839f047b4c38a1dae0ff8d692230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:49.713931 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-34b51f66-73d1-432a-a45a-2cf20d33b88f tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] 10.222.0.67 "GET /compute/v2.1/servers/6b0851db-8113-49aa-abe4-e5cd1b345b9b" status: 200 len: 1303 microversion: 2.1 time: 1.440247 Sep 16 13:05:49.716246 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1928/3999] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:05:48 2022] GET /compute/v2.1/servers/6b0851db-8113-49aa-abe4-e5cd1b345b9b => generated 1303 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:05:49.733395 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-04e7ab9d-4291-48fd-bcaa-d7181d0ef9e2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:49.734039 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-04e7ab9d-4291-48fd-bcaa-d7181d0ef9e2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:49.748095 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-04e7ab9d-4291-48fd-bcaa-d7181d0ef9e2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:49.750178 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-04e7ab9d-4291-48fd-bcaa-d7181d0ef9e2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:49.750913 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-04e7ab9d-4291-48fd-bcaa-d7181d0ef9e2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:49.751980 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-04e7ab9d-4291-48fd-bcaa-d7181d0ef9e2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:49.752666 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-04e7ab9d-4291-48fd-bcaa-d7181d0ef9e2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:49.753264 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-04e7ab9d-4291-48fd-bcaa-d7181d0ef9e2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:51.469538 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fd9c3390-2eac-4410-a47a-d0a759aa619d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:51.485916 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fd9c3390-2eac-4410-a47a-d0a759aa619d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1675 microversion: 2.1 time: 2.169733 Sep 16 13:05:51.500597 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2072/4000] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:05:49 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1675 bytes in 2185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:05:51.508274 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f148e286-eb29-494e-9515-3b2f146cccc2 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:51.509086 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f148e286-eb29-494e-9515-3b2f146cccc2 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] [instance: 6b0851db-8113-49aa-abe4-e5cd1b345b9b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:51.518805 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f148e286-eb29-494e-9515-3b2f146cccc2 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:51.519314 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f148e286-eb29-494e-9515-3b2f146cccc2 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:51.519760 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f148e286-eb29-494e-9515-3b2f146cccc2 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:51.520719 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f148e286-eb29-494e-9515-3b2f146cccc2 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:51.521335 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f148e286-eb29-494e-9515-3b2f146cccc2 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:51.521922 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f148e286-eb29-494e-9515-3b2f146cccc2 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:52.005455 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-04e7ab9d-4291-48fd-bcaa-d7181d0ef9e2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:52.026242 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-04e7ab9d-4291-48fd-bcaa-d7181d0ef9e2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:52.030272 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-04e7ab9d-4291-48fd-bcaa-d7181d0ef9e2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:52.072818 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f148e286-eb29-494e-9515-3b2f146cccc2 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa734086fec1432d88be79bc2fb0ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069d839f047b4c38a1dae0ff8d692230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:52.083671 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-04e7ab9d-4291-48fd-bcaa-d7181d0ef9e2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 2911 microversion: 2.42 time: 2.362810 Sep 16 13:05:52.099998 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1929/4001] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:05:49 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 2911 bytes in 2380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:05:52.102712 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f148e286-eb29-494e-9515-3b2f146cccc2 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] 10.222.0.67 "GET /compute/v2.1/servers/6b0851db-8113-49aa-abe4-e5cd1b345b9b" status: 200 len: 1303 microversion: 2.1 time: 0.598161 Sep 16 13:05:52.105229 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2073/4002] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:05:51 2022] GET /compute/v2.1/servers/6b0851db-8113-49aa-abe4-e5cd1b345b9b => generated 1303 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:05:52.270685 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-56d27d7b-0aa2-4878-9e34-4616e9488918 req-e3b1ba0d-3f81-40eb-a740-b7a5f2bb2ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "defaddc3-3750-4d8a-b18a-dd6fdce1dbbf", "name": "network-vif-deleted", "tag": "328ce2f8-022c-446e-b388-06295b8c63e7"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:05:52.276409 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:05:52.320538 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-56d27d7b-0aa2-4878-9e34-4616e9488918 req-e3b1ba0d-3f81-40eb-a740-b7a5f2bb2ec7 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:52.324039 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-56d27d7b-0aa2-4878-9e34-4616e9488918 req-e3b1ba0d-3f81-40eb-a740-b7a5f2bb2ec7 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:52.325626 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-56d27d7b-0aa2-4878-9e34-4616e9488918 req-e3b1ba0d-3f81-40eb-a740-b7a5f2bb2ec7 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:52.355549 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-56d27d7b-0aa2-4878-9e34-4616e9488918 req-e3b1ba0d-3f81-40eb-a740-b7a5f2bb2ec7 service nova] Creating event network-vif-deleted:328ce2f8-022c-446e-b388-06295b8c63e7 for instance defaddc3-3750-4d8a-b18a-dd6fdce1dbbf on n-h1-858094-4 Sep 16 13:05:52.369915 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-56d27d7b-0aa2-4878-9e34-4616e9488918 req-e3b1ba0d-3f81-40eb-a740-b7a5f2bb2ec7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103881 Sep 16 13:05:52.375552 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1930/4003] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:05:52.513205 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4d32395c-bd6d-4aef-80ec-78f8d8b2ec26 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:52.513971 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4d32395c-bd6d-4aef-80ec-78f8d8b2ec26 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:52.534797 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d32395c-bd6d-4aef-80ec-78f8d8b2ec26 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:52.535327 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d32395c-bd6d-4aef-80ec-78f8d8b2ec26 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:52.539929 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d32395c-bd6d-4aef-80ec-78f8d8b2ec26 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:52.544933 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d32395c-bd6d-4aef-80ec-78f8d8b2ec26 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:52.547535 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d32395c-bd6d-4aef-80ec-78f8d8b2ec26 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:52.550773 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d32395c-bd6d-4aef-80ec-78f8d8b2ec26 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:53.136409 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-07982a88-1d97-408e-9fe4-d2e4b9d7fc39 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:53.137762 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-07982a88-1d97-408e-9fe4-d2e4b9d7fc39 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] [instance: 6b0851db-8113-49aa-abe4-e5cd1b345b9b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:53.151263 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:05:53.171993 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-07982a88-1d97-408e-9fe4-d2e4b9d7fc39 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:53.180311 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-07982a88-1d97-408e-9fe4-d2e4b9d7fc39 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:53.180959 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-07982a88-1d97-408e-9fe4-d2e4b9d7fc39 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:53.186716 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-07982a88-1d97-408e-9fe4-d2e4b9d7fc39 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:53.187462 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-07982a88-1d97-408e-9fe4-d2e4b9d7fc39 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:53.188083 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-07982a88-1d97-408e-9fe4-d2e4b9d7fc39 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:53.821961 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4d32395c-bd6d-4aef-80ec-78f8d8b2ec26 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:53.835826 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4d32395c-bd6d-4aef-80ec-78f8d8b2ec26 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1675 microversion: 2.1 time: 1.328201 Sep 16 13:05:53.837945 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2074/4004] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:05:52 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1675 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:05:53.850206 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ab410628-c281-4e69-af4c-0a4ab5433f56 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:53.854252 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ab410628-c281-4e69-af4c-0a4ab5433f56 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:53.873605 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab410628-c281-4e69-af4c-0a4ab5433f56 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:53.877846 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab410628-c281-4e69-af4c-0a4ab5433f56 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:53.878408 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab410628-c281-4e69-af4c-0a4ab5433f56 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:53.880542 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab410628-c281-4e69-af4c-0a4ab5433f56 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:53.883685 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab410628-c281-4e69-af4c-0a4ab5433f56 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:53.884691 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab410628-c281-4e69-af4c-0a4ab5433f56 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:54.087019 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=12 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:05:54.337905 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-07982a88-1d97-408e-9fe4-d2e4b9d7fc39 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa734086fec1432d88be79bc2fb0ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069d839f047b4c38a1dae0ff8d692230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:54.350917 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-07982a88-1d97-408e-9fe4-d2e4b9d7fc39 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] 10.222.0.67 "GET /compute/v2.1/servers/6b0851db-8113-49aa-abe4-e5cd1b345b9b" status: 200 len: 1303 microversion: 2.1 time: 1.224548 Sep 16 13:05:54.363342 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1931/4005] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:05:53 2022] GET /compute/v2.1/servers/6b0851db-8113-49aa-abe4-e5cd1b345b9b => generated 1303 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:05:54.589178 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-0118a0ec-d258-437d-a353-876741445479 req-8a70c0ee-319e-46d1-8629-e1b4d6210238 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b76bc3fa-0395-4782-8a87-ec5cfc6da641", "tag": "8a68040c-b0d1-432e-b8a2-3698222d82ee"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:05:54.604864 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-0118a0ec-d258-437d-a353-876741445479 req-8a70c0ee-319e-46d1-8629-e1b4d6210238 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:54.605436 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-0118a0ec-d258-437d-a353-876741445479 req-8a70c0ee-319e-46d1-8629-e1b4d6210238 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:54.606124 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-0118a0ec-d258-437d-a353-876741445479 req-8a70c0ee-319e-46d1-8629-e1b4d6210238 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:54.653034 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-0118a0ec-d258-437d-a353-876741445479 req-8a70c0ee-319e-46d1-8629-e1b4d6210238 service nova] Creating event network-changed:8a68040c-b0d1-432e-b8a2-3698222d82ee for instance b76bc3fa-0395-4782-8a87-ec5cfc6da641 on n-h2-858094-4 Sep 16 13:05:54.668432 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-0118a0ec-d258-437d-a353-876741445479 req-8a70c0ee-319e-46d1-8629-e1b4d6210238 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083891 Sep 16 13:05:54.674756 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1932/4006] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:05:54.786629 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ab410628-c281-4e69-af4c-0a4ab5433f56 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:54.824775 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ab410628-c281-4e69-af4c-0a4ab5433f56 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:54.827068 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ab410628-c281-4e69-af4c-0a4ab5433f56 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:54.829634 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ab410628-c281-4e69-af4c-0a4ab5433f56 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 2751 microversion: 2.42 time: 0.988264 Sep 16 13:05:54.833815 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2075/4007] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:05:53 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 2751 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:05:54.862946 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0bfd1ae3-5593-43f2-8bb7-10c1e73f44a0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:54.863661 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0bfd1ae3-5593-43f2-8bb7-10c1e73f44a0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:54.873580 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0bfd1ae3-5593-43f2-8bb7-10c1e73f44a0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:54.874444 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0bfd1ae3-5593-43f2-8bb7-10c1e73f44a0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:54.875196 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0bfd1ae3-5593-43f2-8bb7-10c1e73f44a0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:54.881309 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0bfd1ae3-5593-43f2-8bb7-10c1e73f44a0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:54.882068 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0bfd1ae3-5593-43f2-8bb7-10c1e73f44a0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:54.883181 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0bfd1ae3-5593-43f2-8bb7-10c1e73f44a0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:55.377514 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3421a54d-c369-47b0-95f4-7e83e8ce5a63 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:55.378141 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3421a54d-c369-47b0-95f4-7e83e8ce5a63 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] [instance: 6b0851db-8113-49aa-abe4-e5cd1b345b9b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:55.396464 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3421a54d-c369-47b0-95f4-7e83e8ce5a63 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:55.396966 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3421a54d-c369-47b0-95f4-7e83e8ce5a63 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:55.397400 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3421a54d-c369-47b0-95f4-7e83e8ce5a63 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:55.398405 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3421a54d-c369-47b0-95f4-7e83e8ce5a63 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:55.399581 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3421a54d-c369-47b0-95f4-7e83e8ce5a63 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:55.400015 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3421a54d-c369-47b0-95f4-7e83e8ce5a63 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:55.996346 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0bfd1ae3-5593-43f2-8bb7-10c1e73f44a0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:56.009891 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0bfd1ae3-5593-43f2-8bb7-10c1e73f44a0 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1675 microversion: 2.1 time: 1.149710 Sep 16 13:05:56.012606 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1933/4008] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:05:54 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1675 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:05:56.019205 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0bb6ea0a-623b-4543-874b-2132699673d8 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:56.020498 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0bb6ea0a-623b-4543-874b-2132699673d8 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:56.028930 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0bb6ea0a-623b-4543-874b-2132699673d8 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:56.029431 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0bb6ea0a-623b-4543-874b-2132699673d8 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:56.030220 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0bb6ea0a-623b-4543-874b-2132699673d8 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:56.031024 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0bb6ea0a-623b-4543-874b-2132699673d8 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:56.031665 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0bb6ea0a-623b-4543-874b-2132699673d8 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:56.032229 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0bb6ea0a-623b-4543-874b-2132699673d8 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:56.064947 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3421a54d-c369-47b0-95f4-7e83e8ce5a63 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa734086fec1432d88be79bc2fb0ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069d839f047b4c38a1dae0ff8d692230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:56.081893 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3421a54d-c369-47b0-95f4-7e83e8ce5a63 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] 10.222.0.67 "GET /compute/v2.1/servers/6b0851db-8113-49aa-abe4-e5cd1b345b9b" status: 200 len: 1291 microversion: 2.1 time: 0.706884 Sep 16 13:05:56.083299 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2076/4009] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:05:55 2022] GET /compute/v2.1/servers/6b0851db-8113-49aa-abe4-e5cd1b345b9b => generated 1291 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:05:56.665533 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0bb6ea0a-623b-4543-874b-2132699673d8 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:56.694721 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0bb6ea0a-623b-4543-874b-2132699673d8 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:56.711024 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0bb6ea0a-623b-4543-874b-2132699673d8 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:56.717462 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0bb6ea0a-623b-4543-874b-2132699673d8 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 2705 microversion: 2.42 time: 0.701676 Sep 16 13:05:56.736285 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1934/4010] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:05:56 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 2705 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:05:56.979049 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-aeef6db4-6df7-4303-b7ff-5bae67f87b2f req-e6cc538d-1d43-406c-9f81-73502acc6103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "defaddc3-3750-4d8a-b18a-dd6fdce1dbbf", "name": "network-vif-deleted", "tag": "8a23d825-e263-4839-8617-11f3b05818ce"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:05:57.002405 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-aeef6db4-6df7-4303-b7ff-5bae67f87b2f req-e6cc538d-1d43-406c-9f81-73502acc6103 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:57.002898 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-aeef6db4-6df7-4303-b7ff-5bae67f87b2f req-e6cc538d-1d43-406c-9f81-73502acc6103 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:57.003336 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-aeef6db4-6df7-4303-b7ff-5bae67f87b2f req-e6cc538d-1d43-406c-9f81-73502acc6103 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:57.028317 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-aeef6db4-6df7-4303-b7ff-5bae67f87b2f req-e6cc538d-1d43-406c-9f81-73502acc6103 service nova] Creating event network-vif-deleted:8a23d825-e263-4839-8617-11f3b05818ce for instance defaddc3-3750-4d8a-b18a-dd6fdce1dbbf on n-h1-858094-4 Sep 16 13:05:57.035893 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1ccca005-7b6d-40be-b035-2c313ff3914e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:57.036998 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-1ccca005-7b6d-40be-b035-2c313ff3914e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:57.039862 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-aeef6db4-6df7-4303-b7ff-5bae67f87b2f req-e6cc538d-1d43-406c-9f81-73502acc6103 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063909 Sep 16 13:05:57.040542 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2077/4011] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:05:57.047866 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1ccca005-7b6d-40be-b035-2c313ff3914e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:57.054558 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1ccca005-7b6d-40be-b035-2c313ff3914e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:57.055638 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1ccca005-7b6d-40be-b035-2c313ff3914e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:57.056685 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1ccca005-7b6d-40be-b035-2c313ff3914e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:57.057339 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1ccca005-7b6d-40be-b035-2c313ff3914e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:57.081687 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1ccca005-7b6d-40be-b035-2c313ff3914e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:57.106662 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4ea40493-4120-4c5f-b29e-36f67637ed47 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:57.107374 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4ea40493-4120-4c5f-b29e-36f67637ed47 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] [instance: 6b0851db-8113-49aa-abe4-e5cd1b345b9b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:57.117651 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ea40493-4120-4c5f-b29e-36f67637ed47 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:57.119917 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ea40493-4120-4c5f-b29e-36f67637ed47 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:57.124204 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ea40493-4120-4c5f-b29e-36f67637ed47 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:57.125572 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ea40493-4120-4c5f-b29e-36f67637ed47 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:57.126537 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ea40493-4120-4c5f-b29e-36f67637ed47 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:57.127284 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ea40493-4120-4c5f-b29e-36f67637ed47 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:57.948350 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1ccca005-7b6d-40be-b035-2c313ff3914e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:57.965497 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1ccca005-7b6d-40be-b035-2c313ff3914e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1675 microversion: 2.1 time: 0.934394 Sep 16 13:05:57.967924 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1935/4012] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:05:57 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1675 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:05:57.988229 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1d797baa-87e0-49e7-b523-1f5a3ef23b22 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:57.991924 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-1d797baa-87e0-49e7-b523-1f5a3ef23b22 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:58.005948 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1d797baa-87e0-49e7-b523-1f5a3ef23b22 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:58.008171 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1d797baa-87e0-49e7-b523-1f5a3ef23b22 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:58.011498 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1d797baa-87e0-49e7-b523-1f5a3ef23b22 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:58.012536 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1d797baa-87e0-49e7-b523-1f5a3ef23b22 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:58.014271 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1d797baa-87e0-49e7-b523-1f5a3ef23b22 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:58.015413 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1d797baa-87e0-49e7-b523-1f5a3ef23b22 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:58.178447 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4ea40493-4120-4c5f-b29e-36f67637ed47 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa734086fec1432d88be79bc2fb0ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069d839f047b4c38a1dae0ff8d692230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:58.201475 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4ea40493-4120-4c5f-b29e-36f67637ed47 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] 10.222.0.67 "GET /compute/v2.1/servers/6b0851db-8113-49aa-abe4-e5cd1b345b9b" status: 200 len: 1291 microversion: 2.1 time: 1.093735 Sep 16 13:05:58.202981 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2078/4013] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:05:57 2022] GET /compute/v2.1/servers/6b0851db-8113-49aa-abe4-e5cd1b345b9b => generated 1291 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:05:58.304152 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1d797baa-87e0-49e7-b523-1f5a3ef23b22 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:58.331190 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1d797baa-87e0-49e7-b523-1f5a3ef23b22 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:58.333585 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1d797baa-87e0-49e7-b523-1f5a3ef23b22 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:58.348535 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1d797baa-87e0-49e7-b523-1f5a3ef23b22 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 2415 microversion: 2.42 time: 0.378260 Sep 16 13:05:58.351732 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1936/4014] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:05:57 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 2415 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:05:58.960522 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bee3e781-bcf1-4f69-9258-b59023434756 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1831511284", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": [{"uuid": "9d7d5071-0347-4378-bf6e-e5e9f9be69b0"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:05:58.993829 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5ee9d52b-98bb-46d4-bf49-5b8ed4adb92a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:05:58.994923 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5ee9d52b-98bb-46d4-bf49-5b8ed4adb92a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:05:59.012620 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5ee9d52b-98bb-46d4-bf49-5b8ed4adb92a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:59.015456 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5ee9d52b-98bb-46d4-bf49-5b8ed4adb92a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:59.016264 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5ee9d52b-98bb-46d4-bf49-5b8ed4adb92a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:59.018052 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5ee9d52b-98bb-46d4-bf49-5b8ed4adb92a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:05:59.019436 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5ee9d52b-98bb-46d4-bf49-5b8ed4adb92a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:05:59.020416 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5ee9d52b-98bb-46d4-bf49-5b8ed4adb92a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:05:59.112989 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-bee3e781-bcf1-4f69-9258-b59023434756 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] validate_networks() for [('9d7d5071-0347-4378-bf6e-e5e9f9be69b0', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:05:59.847838 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5ee9d52b-98bb-46d4-bf49-5b8ed4adb92a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:05:59.859174 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5ee9d52b-98bb-46d4-bf49-5b8ed4adb92a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1675 microversion: 2.1 time: 0.871432 Sep 16 13:05:59.859868 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1937/4015] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:05:58 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1675 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:00.307451 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-b24cf646-8f12-4b46-aa60-d72ff2ceb85d req-bf92cee9-fbd2-4d71-a388-675512afc6fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "defaddc3-3750-4d8a-b18a-dd6fdce1dbbf", "name": "network-vif-deleted", "tag": "8c121ccb-eba9-4b08-98af-afba73327fcc"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:06:00.332397 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-b24cf646-8f12-4b46-aa60-d72ff2ceb85d req-bf92cee9-fbd2-4d71-a388-675512afc6fb service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:00.332905 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-b24cf646-8f12-4b46-aa60-d72ff2ceb85d req-bf92cee9-fbd2-4d71-a388-675512afc6fb service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:00.333357 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-b24cf646-8f12-4b46-aa60-d72ff2ceb85d req-bf92cee9-fbd2-4d71-a388-675512afc6fb service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:00.361637 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-b24cf646-8f12-4b46-aa60-d72ff2ceb85d req-bf92cee9-fbd2-4d71-a388-675512afc6fb service nova] Creating event network-vif-deleted:8c121ccb-eba9-4b08-98af-afba73327fcc for instance defaddc3-3750-4d8a-b18a-dd6fdce1dbbf on n-h1-858094-4 Sep 16 13:06:00.376929 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-b24cf646-8f12-4b46-aa60-d72ff2ceb85d req-bf92cee9-fbd2-4d71-a388-675512afc6fb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.515358 Sep 16 13:06:00.378146 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1938/4016] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:06:00.384278 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-dda19c20-6aa9-4c59-abf7-af00f4021880 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:00.389692 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-dda19c20-6aa9-4c59-abf7-af00f4021880 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] [instance: 6b0851db-8113-49aa-abe4-e5cd1b345b9b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:00.406691 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dda19c20-6aa9-4c59-abf7-af00f4021880 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:00.407546 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dda19c20-6aa9-4c59-abf7-af00f4021880 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:00.408156 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dda19c20-6aa9-4c59-abf7-af00f4021880 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:00.409069 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dda19c20-6aa9-4c59-abf7-af00f4021880 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:00.409683 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dda19c20-6aa9-4c59-abf7-af00f4021880 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:00.410277 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-dda19c20-6aa9-4c59-abf7-af00f4021880 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:00.952289 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-dda19c20-6aa9-4c59-abf7-af00f4021880 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa734086fec1432d88be79bc2fb0ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069d839f047b4c38a1dae0ff8d692230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:00.964377 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-dda19c20-6aa9-4c59-abf7-af00f4021880 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] 10.222.0.67 "GET /compute/v2.1/servers/6b0851db-8113-49aa-abe4-e5cd1b345b9b" status: 200 len: 1291 microversion: 2.1 time: 0.584790 Sep 16 13:06:00.968582 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1939/4017] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:00 2022] GET /compute/v2.1/servers/6b0851db-8113-49aa-abe4-e5cd1b345b9b => generated 1291 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:00.988000 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ff58f384-be6f-425c-96ea-9688bad06814 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:00.988951 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ff58f384-be6f-425c-96ea-9688bad06814 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:00.999672 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ff58f384-be6f-425c-96ea-9688bad06814 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:01.000598 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ff58f384-be6f-425c-96ea-9688bad06814 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:01.001282 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ff58f384-be6f-425c-96ea-9688bad06814 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:01.002275 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ff58f384-be6f-425c-96ea-9688bad06814 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:01.002949 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ff58f384-be6f-425c-96ea-9688bad06814 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:01.003593 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ff58f384-be6f-425c-96ea-9688bad06814 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:01.054651 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-bee3e781-bcf1-4f69-9258-b59023434756 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:06:01.058267 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-bee3e781-bcf1-4f69-9258-b59023434756 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:06:01.059674 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-bee3e781-bcf1-4f69-9258-b59023434756 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:06:01.060348 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-bee3e781-bcf1-4f69-9258-b59023434756 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:06:01.060995 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-bee3e781-bcf1-4f69-9258-b59023434756 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:06:01.077756 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bee3e781-bcf1-4f69-9258-b59023434756 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:01.079796 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bee3e781-bcf1-4f69-9258-b59023434756 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:01.080784 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bee3e781-bcf1-4f69-9258-b59023434756 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:01.081866 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bee3e781-bcf1-4f69-9258-b59023434756 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:01.082641 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bee3e781-bcf1-4f69-9258-b59023434756 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:01.083273 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bee3e781-bcf1-4f69-9258-b59023434756 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:01.108361 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-bee3e781-bcf1-4f69-9258-b59023434756 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Getting quotas for project ee3bf83ac16540a7a1f4e5f4ea13a3a7. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:06:01.116485 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-bee3e781-bcf1-4f69-9258-b59023434756 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Getting quotas for user 1d4d4e5bc37e4abc8475ff21d44c2ff2 and project ee3bf83ac16540a7a1f4e5f4ea13a3a7. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:06:01.138298 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bee3e781-bcf1-4f69-9258-b59023434756 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:06:01.143906 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bee3e781-bcf1-4f69-9258-b59023434756 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] [instance: 90c273f5-cec8-4644-90fb-f6ff80af0d77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:06:01.329120 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bee3e781-bcf1-4f69-9258-b59023434756 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.629914 Sep 16 13:06:01.339814 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2079/4018] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 13:05:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 13:06:01.345832 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-eba8660d-f8aa-4aa8-a747-4f96ae223ab7 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:01.346934 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-eba8660d-f8aa-4aa8-a747-4f96ae223ab7 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:01.404493 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eba8660d-f8aa-4aa8-a747-4f96ae223ab7 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:01.406981 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eba8660d-f8aa-4aa8-a747-4f96ae223ab7 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:01.407777 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eba8660d-f8aa-4aa8-a747-4f96ae223ab7 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:01.410478 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eba8660d-f8aa-4aa8-a747-4f96ae223ab7 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:01.411358 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eba8660d-f8aa-4aa8-a747-4f96ae223ab7 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:01.413237 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eba8660d-f8aa-4aa8-a747-4f96ae223ab7 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:01.493464 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ff58f384-be6f-425c-96ea-9688bad06814 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:01.520323 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ff58f384-be6f-425c-96ea-9688bad06814 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:01.522940 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ff58f384-be6f-425c-96ea-9688bad06814 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:01.534544 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ff58f384-be6f-425c-96ea-9688bad06814 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 2166 microversion: 2.42 time: 0.563293 Sep 16 13:06:01.535142 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1940/4019] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:06:00 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 2166 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:06:01.563687 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-10496dc7-173b-4951-a824-3c3e6aeb8374 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:01.596400 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-10496dc7-173b-4951-a824-3c3e6aeb8374 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] [instance: 90c273f5-cec8-4644-90fb-f6ff80af0d77] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:01.754370 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-eba8660d-f8aa-4aa8-a747-4f96ae223ab7 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:01.787913 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-eba8660d-f8aa-4aa8-a747-4f96ae223ab7 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1652 microversion: 2.1 time: 0.445820 Sep 16 13:06:01.790301 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2080/4020] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:01 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1652 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:01.825488 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-10496dc7-173b-4951-a824-3c3e6aeb8374 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d4e5bc37e4abc8475ff21d44c2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3bf83ac16540a7a1f4e5f4ea13a3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:01.829100 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-41100c1b-a0c4-469f-bbc3-bbee33caa898 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:06:01.845935 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41100c1b-a0c4-469f-bbc3-bbee33caa898 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:01.850745 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41100c1b-a0c4-469f-bbc3-bbee33caa898 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:01.851278 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-10496dc7-173b-4951-a824-3c3e6aeb8374 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] 10.222.0.67 "GET /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77" status: 200 len: 1228 microversion: 2.1 time: 0.304821 Sep 16 13:06:01.852399 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41100c1b-a0c4-469f-bbc3-bbee33caa898 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:01.872272 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1941/4021] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:01 2022] GET /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77 => generated 1228 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:01.945228 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-41100c1b-a0c4-469f-bbc3-bbee33caa898 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Going to try to start instance {{(pid=128779) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 16 13:06:02.013509 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3dff7cd0-6e98-4f04-90c4-8105d71275bd tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:02.017317 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3dff7cd0-6e98-4f04-90c4-8105d71275bd tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] [instance: 6b0851db-8113-49aa-abe4-e5cd1b345b9b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:02.065850 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3dff7cd0-6e98-4f04-90c4-8105d71275bd tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:02.066589 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3dff7cd0-6e98-4f04-90c4-8105d71275bd tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:02.067373 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3dff7cd0-6e98-4f04-90c4-8105d71275bd tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:02.072222 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3dff7cd0-6e98-4f04-90c4-8105d71275bd tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:02.077090 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3dff7cd0-6e98-4f04-90c4-8105d71275bd tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:02.086011 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3dff7cd0-6e98-4f04-90c4-8105d71275bd tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:02.145686 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-41100c1b-a0c4-469f-bbc3-bbee33caa898 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "POST /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771/action" status: 202 len: 0 microversion: 2.1 time: 0.333371 Sep 16 13:06:02.148866 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2081/4022] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 13:06:01 2022] POST /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:06:02.159262 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5c824194-124d-4832-a2df-dd3222a0c6f3 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:02.166602 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5c824194-124d-4832-a2df-dd3222a0c6f3 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:02.188733 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c824194-124d-4832-a2df-dd3222a0c6f3 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:02.191412 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c824194-124d-4832-a2df-dd3222a0c6f3 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:02.192181 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c824194-124d-4832-a2df-dd3222a0c6f3 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:02.194901 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c824194-124d-4832-a2df-dd3222a0c6f3 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:02.197140 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c824194-124d-4832-a2df-dd3222a0c6f3 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:02.204264 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c824194-124d-4832-a2df-dd3222a0c6f3 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:02.743429 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5c824194-124d-4832-a2df-dd3222a0c6f3 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:02.757031 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5c824194-124d-4832-a2df-dd3222a0c6f3 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1661 microversion: 2.1 time: 0.604559 Sep 16 13:06:02.763012 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2082/4023] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:02 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1661 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:02.776075 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3dff7cd0-6e98-4f04-90c4-8105d71275bd tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa734086fec1432d88be79bc2fb0ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069d839f047b4c38a1dae0ff8d692230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:02.790317 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-32e378b1-a83a-4d22-98b7-6861dfe2b371 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:02.794373 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3dff7cd0-6e98-4f04-90c4-8105d71275bd tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] 10.222.0.67 "GET /compute/v2.1/servers/6b0851db-8113-49aa-abe4-e5cd1b345b9b" status: 200 len: 1291 microversion: 2.1 time: 0.802083 Sep 16 13:06:02.798485 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-32e378b1-a83a-4d22-98b7-6861dfe2b371 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:02.799005 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1942/4024] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:01 2022] GET /compute/v2.1/servers/6b0851db-8113-49aa-abe4-e5cd1b345b9b => generated 1291 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:02.815409 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-0494b446-c281-4f11-88a6-c5a614c107d7 req-8e17c0e1-e67f-4701-a4ad-7bc1cf357fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "defaddc3-3750-4d8a-b18a-dd6fdce1dbbf", "name": "network-vif-deleted", "tag": "8874748b-6030-4aea-9e6b-79db8c8d555d"}, {"server_uuid": "defaddc3-3750-4d8a-b18a-dd6fdce1dbbf", "name": "network-vif-deleted", "tag": "c7eb5869-5d95-47b8-9539-2bec50eb4428"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:06:02.823886 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32e378b1-a83a-4d22-98b7-6861dfe2b371 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:02.825439 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32e378b1-a83a-4d22-98b7-6861dfe2b371 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:02.850727 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32e378b1-a83a-4d22-98b7-6861dfe2b371 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:02.852000 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32e378b1-a83a-4d22-98b7-6861dfe2b371 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:02.853072 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32e378b1-a83a-4d22-98b7-6861dfe2b371 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:02.853806 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32e378b1-a83a-4d22-98b7-6861dfe2b371 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:02.866536 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-0494b446-c281-4f11-88a6-c5a614c107d7 req-8e17c0e1-e67f-4701-a4ad-7bc1cf357fa3 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:02.867025 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-0494b446-c281-4f11-88a6-c5a614c107d7 req-8e17c0e1-e67f-4701-a4ad-7bc1cf357fa3 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:02.868027 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-0494b446-c281-4f11-88a6-c5a614c107d7 req-8e17c0e1-e67f-4701-a4ad-7bc1cf357fa3 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:02.915905 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-0494b446-c281-4f11-88a6-c5a614c107d7 req-8e17c0e1-e67f-4701-a4ad-7bc1cf357fa3 service nova] Creating event network-vif-deleted:8874748b-6030-4aea-9e6b-79db8c8d555d for instance defaddc3-3750-4d8a-b18a-dd6fdce1dbbf on n-h1-858094-4 Sep 16 13:06:02.919767 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-0494b446-c281-4f11-88a6-c5a614c107d7 req-8e17c0e1-e67f-4701-a4ad-7bc1cf357fa3 service nova] Creating event network-vif-deleted:c7eb5869-5d95-47b8-9539-2bec50eb4428 for instance defaddc3-3750-4d8a-b18a-dd6fdce1dbbf on n-h1-858094-4 Sep 16 13:06:02.939190 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-0494b446-c281-4f11-88a6-c5a614c107d7 req-8e17c0e1-e67f-4701-a4ad-7bc1cf357fa3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.138609 Sep 16 13:06:02.939902 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1943/4025] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:06:02.959014 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fdfb99c1-9f9b-48ef-9a29-c761dc4f2999 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:02.959401 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-fdfb99c1-9f9b-48ef-9a29-c761dc4f2999 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] [instance: 90c273f5-cec8-4644-90fb-f6ff80af0d77] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:02.972162 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fdfb99c1-9f9b-48ef-9a29-c761dc4f2999 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:02.972902 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fdfb99c1-9f9b-48ef-9a29-c761dc4f2999 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:02.973351 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fdfb99c1-9f9b-48ef-9a29-c761dc4f2999 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:02.974102 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fdfb99c1-9f9b-48ef-9a29-c761dc4f2999 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:02.974511 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fdfb99c1-9f9b-48ef-9a29-c761dc4f2999 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:02.974943 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fdfb99c1-9f9b-48ef-9a29-c761dc4f2999 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:03.093127 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-32e378b1-a83a-4d22-98b7-6861dfe2b371 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:03.109939 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-32e378b1-a83a-4d22-98b7-6861dfe2b371 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:03.111374 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-32e378b1-a83a-4d22-98b7-6861dfe2b371 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:03.116933 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-32e378b1-a83a-4d22-98b7-6861dfe2b371 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1603 microversion: 2.42 time: 0.352549 Sep 16 13:06:03.120024 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2083/4026] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:06:02 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1603 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:06:03.207600 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-fdfb99c1-9f9b-48ef-9a29-c761dc4f2999 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d4e5bc37e4abc8475ff21d44c2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3bf83ac16540a7a1f4e5f4ea13a3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:03.224315 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-fdfb99c1-9f9b-48ef-9a29-c761dc4f2999 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] 10.222.0.67 "GET /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77" status: 200 len: 1224 microversion: 2.1 time: 0.278785 Sep 16 13:06:03.225065 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1944/4027] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:02 2022] GET /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77 => generated 1224 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:03.814113 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f3ad693e-e775-4db1-90b5-a9025b97afee tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:03.814764 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f3ad693e-e775-4db1-90b5-a9025b97afee tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:03.825060 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-1a58eb4d-e26d-43bc-a6d4-6795f64df5a5 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:03.826986 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-1a58eb4d-e26d-43bc-a6d4-6795f64df5a5 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] [instance: 6b0851db-8113-49aa-abe4-e5cd1b345b9b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:03.836718 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1a58eb4d-e26d-43bc-a6d4-6795f64df5a5 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:03.837443 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3ad693e-e775-4db1-90b5-a9025b97afee tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:03.839541 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1a58eb4d-e26d-43bc-a6d4-6795f64df5a5 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:03.840744 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1a58eb4d-e26d-43bc-a6d4-6795f64df5a5 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:03.846155 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1a58eb4d-e26d-43bc-a6d4-6795f64df5a5 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:03.847078 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1a58eb4d-e26d-43bc-a6d4-6795f64df5a5 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:03.847941 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-1a58eb4d-e26d-43bc-a6d4-6795f64df5a5 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:03.852308 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3ad693e-e775-4db1-90b5-a9025b97afee tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:03.856896 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:06:03.858145 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3ad693e-e775-4db1-90b5-a9025b97afee tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:03.861112 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3ad693e-e775-4db1-90b5-a9025b97afee tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:03.861850 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3ad693e-e775-4db1-90b5-a9025b97afee tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:03.864707 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3ad693e-e775-4db1-90b5-a9025b97afee tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:04.996586 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f3ad693e-e775-4db1-90b5-a9025b97afee tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:05.004758 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-1a58eb4d-e26d-43bc-a6d4-6795f64df5a5 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa734086fec1432d88be79bc2fb0ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069d839f047b4c38a1dae0ff8d692230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:05.012718 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f3ad693e-e775-4db1-90b5-a9025b97afee tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1661 microversion: 2.1 time: 1.204770 Sep 16 13:06:05.013895 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2084/4028] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:03 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1661 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:05.019786 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-1a58eb4d-e26d-43bc-a6d4-6795f64df5a5 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] 10.222.0.67 "GET /compute/v2.1/servers/6b0851db-8113-49aa-abe4-e5cd1b345b9b" status: 200 len: 1291 microversion: 2.1 time: 1.200729 Sep 16 13:06:05.022266 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6e4df309-ab0b-4dc5-9f4d-720c3f7388d4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:05.025057 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6e4df309-ab0b-4dc5-9f4d-720c3f7388d4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:05.038308 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e4df309-ab0b-4dc5-9f4d-720c3f7388d4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:05.041070 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1945/4029] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:03 2022] GET /compute/v2.1/servers/6b0851db-8113-49aa-abe4-e5cd1b345b9b => generated 1291 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:05.042183 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e4df309-ab0b-4dc5-9f4d-720c3f7388d4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:05.042922 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e4df309-ab0b-4dc5-9f4d-720c3f7388d4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:05.043815 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e4df309-ab0b-4dc5-9f4d-720c3f7388d4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:05.044569 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e4df309-ab0b-4dc5-9f4d-720c3f7388d4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:05.045759 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e4df309-ab0b-4dc5-9f4d-720c3f7388d4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:05.049264 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-560446ca-c553-458e-b55d-a0851cf49bc0 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:05.049896 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-560446ca-c553-458e-b55d-a0851cf49bc0 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] [instance: 90c273f5-cec8-4644-90fb-f6ff80af0d77] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:05.066430 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-560446ca-c553-458e-b55d-a0851cf49bc0 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:05.074733 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-560446ca-c553-458e-b55d-a0851cf49bc0 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:05.075441 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-560446ca-c553-458e-b55d-a0851cf49bc0 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:05.076384 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-560446ca-c553-458e-b55d-a0851cf49bc0 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:05.084588 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-560446ca-c553-458e-b55d-a0851cf49bc0 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:05.085282 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-560446ca-c553-458e-b55d-a0851cf49bc0 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:05.377469 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-560446ca-c553-458e-b55d-a0851cf49bc0 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d4e5bc37e4abc8475ff21d44c2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3bf83ac16540a7a1f4e5f4ea13a3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:05.394799 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-560446ca-c553-458e-b55d-a0851cf49bc0 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] 10.222.0.67 "GET /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77" status: 200 len: 1286 microversion: 2.1 time: 0.352462 Sep 16 13:06:05.398570 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1946/4030] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:05 2022] GET /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77 => generated 1286 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:05.464863 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6e4df309-ab0b-4dc5-9f4d-720c3f7388d4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:05.480088 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6e4df309-ab0b-4dc5-9f4d-720c3f7388d4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:05.482147 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6e4df309-ab0b-4dc5-9f4d-720c3f7388d4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:05.486916 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6e4df309-ab0b-4dc5-9f4d-720c3f7388d4 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1603 microversion: 2.42 time: 0.470509 Sep 16 13:06:05.490956 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2085/4031] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:06:05 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1603 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:06:06.041574 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d3aacb4e-647f-49d7-a28a-7d23b432031d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:06.042778 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d3aacb4e-647f-49d7-a28a-7d23b432031d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:06.054192 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e548adfd-25f1-4f14-acb7-ae698cca7fc4 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:06.056299 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e548adfd-25f1-4f14-acb7-ae698cca7fc4 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] [instance: 6b0851db-8113-49aa-abe4-e5cd1b345b9b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:06.058740 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d3aacb4e-647f-49d7-a28a-7d23b432031d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:06.059246 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d3aacb4e-647f-49d7-a28a-7d23b432031d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:06.073232 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e548adfd-25f1-4f14-acb7-ae698cca7fc4 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:06.074540 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e548adfd-25f1-4f14-acb7-ae698cca7fc4 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:06.075483 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e548adfd-25f1-4f14-acb7-ae698cca7fc4 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:06.075780 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d3aacb4e-647f-49d7-a28a-7d23b432031d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:06.076836 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d3aacb4e-647f-49d7-a28a-7d23b432031d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:06.077677 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e548adfd-25f1-4f14-acb7-ae698cca7fc4 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:06.078377 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d3aacb4e-647f-49d7-a28a-7d23b432031d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:06.079205 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e548adfd-25f1-4f14-acb7-ae698cca7fc4 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:06.079887 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d3aacb4e-647f-49d7-a28a-7d23b432031d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:06.080846 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e548adfd-25f1-4f14-acb7-ae698cca7fc4 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:06.799739 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e548adfd-25f1-4f14-acb7-ae698cca7fc4 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa734086fec1432d88be79bc2fb0ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069d839f047b4c38a1dae0ff8d692230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:06.811717 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e548adfd-25f1-4f14-acb7-ae698cca7fc4 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] 10.222.0.67 "GET /compute/v2.1/servers/6b0851db-8113-49aa-abe4-e5cd1b345b9b" status: 200 len: 1291 microversion: 2.1 time: 0.762156 Sep 16 13:06:06.829210 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2086/4032] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:06 2022] GET /compute/v2.1/servers/6b0851db-8113-49aa-abe4-e5cd1b345b9b => generated 1291 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:06.839475 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b0cd762c-c18a-48ca-aabf-fe926157e516 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:06.840695 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b0cd762c-c18a-48ca-aabf-fe926157e516 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] [instance: 90c273f5-cec8-4644-90fb-f6ff80af0d77] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:06.847708 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0cd762c-c18a-48ca-aabf-fe926157e516 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:06.848585 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0cd762c-c18a-48ca-aabf-fe926157e516 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:06.849650 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0cd762c-c18a-48ca-aabf-fe926157e516 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:06.850813 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0cd762c-c18a-48ca-aabf-fe926157e516 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:06.852026 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0cd762c-c18a-48ca-aabf-fe926157e516 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:06.852721 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0cd762c-c18a-48ca-aabf-fe926157e516 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:07.029704 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d3aacb4e-647f-49d7-a28a-7d23b432031d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:07.039773 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d3aacb4e-647f-49d7-a28a-7d23b432031d tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1665 microversion: 2.1 time: 1.002378 Sep 16 13:06:07.053037 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1947/4033] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:06 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1665 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:07.058960 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e0ea6d8c-123e-4904-bea4-d519bac79b06 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:07.059917 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e0ea6d8c-123e-4904-bea4-d519bac79b06 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:07.072868 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e0ea6d8c-123e-4904-bea4-d519bac79b06 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:07.073736 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e0ea6d8c-123e-4904-bea4-d519bac79b06 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:07.078988 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e0ea6d8c-123e-4904-bea4-d519bac79b06 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:07.080112 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e0ea6d8c-123e-4904-bea4-d519bac79b06 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:07.080836 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e0ea6d8c-123e-4904-bea4-d519bac79b06 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:07.081496 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e0ea6d8c-123e-4904-bea4-d519bac79b06 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:07.280320 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e0ea6d8c-123e-4904-bea4-d519bac79b06 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:07.291674 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e0ea6d8c-123e-4904-bea4-d519bac79b06 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:07.302408 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e0ea6d8c-123e-4904-bea4-d519bac79b06 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:07.307684 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e0ea6d8c-123e-4904-bea4-d519bac79b06 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1603 microversion: 2.42 time: 0.249326 Sep 16 13:06:07.308637 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1948/4034] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:06:07 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1603 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:06:07.634880 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-1baadeda-1357-4892-bcc9-83bee7039e5a req-b2e42bf0-5557-455a-9163-dc9ce808a954 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b0851db-8113-49aa-abe4-e5cd1b345b9b", "name": "network-vif-plugged", "status": "completed", "tag": "f97b74c9-9b69-40fb-b7ec-2e8f5d0f5b69"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:06:07.664115 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-1baadeda-1357-4892-bcc9-83bee7039e5a req-b2e42bf0-5557-455a-9163-dc9ce808a954 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:07.676639 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-1baadeda-1357-4892-bcc9-83bee7039e5a req-b2e42bf0-5557-455a-9163-dc9ce808a954 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:07.677781 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-1baadeda-1357-4892-bcc9-83bee7039e5a req-b2e42bf0-5557-455a-9163-dc9ce808a954 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:07.708499 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-1baadeda-1357-4892-bcc9-83bee7039e5a req-b2e42bf0-5557-455a-9163-dc9ce808a954 service nova] Creating event network-vif-plugged:f97b74c9-9b69-40fb-b7ec-2e8f5d0f5b69 for instance 6b0851db-8113-49aa-abe4-e5cd1b345b9b on n-h2-858094-4 Sep 16 13:06:07.729013 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-1baadeda-1357-4892-bcc9-83bee7039e5a req-b2e42bf0-5557-455a-9163-dc9ce808a954 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.418791 Sep 16 13:06:07.730148 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1949/4035] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:06:07.745492 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-8273439b-6da1-4f0a-ad00-ebd01742c119 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:07.746703 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-8273439b-6da1-4f0a-ad00-ebd01742c119 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:07.760558 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8273439b-6da1-4f0a-ad00-ebd01742c119 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:07.764885 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8273439b-6da1-4f0a-ad00-ebd01742c119 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:07.765658 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8273439b-6da1-4f0a-ad00-ebd01742c119 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:07.766635 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8273439b-6da1-4f0a-ad00-ebd01742c119 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:07.768700 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8273439b-6da1-4f0a-ad00-ebd01742c119 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:07.769379 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-8273439b-6da1-4f0a-ad00-ebd01742c119 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:07.795532 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b0cd762c-c18a-48ca-aabf-fe926157e516 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d4e5bc37e4abc8475ff21d44c2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3bf83ac16540a7a1f4e5f4ea13a3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:07.803598 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b0cd762c-c18a-48ca-aabf-fe926157e516 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] 10.222.0.67 "GET /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77" status: 200 len: 1328 microversion: 2.1 time: 0.972782 Sep 16 13:06:07.811106 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2087/4036] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:06 2022] GET /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77 => generated 1328 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:07.841786 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fb6ff2a2-d210-42ae-aff0-7d5f2dd4f80d tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:07.842856 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fb6ff2a2-d210-42ae-aff0-7d5f2dd4f80d tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] [instance: 6b0851db-8113-49aa-abe4-e5cd1b345b9b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:07.850726 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb6ff2a2-d210-42ae-aff0-7d5f2dd4f80d tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:07.861153 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb6ff2a2-d210-42ae-aff0-7d5f2dd4f80d tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:07.864939 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb6ff2a2-d210-42ae-aff0-7d5f2dd4f80d tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:07.870062 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb6ff2a2-d210-42ae-aff0-7d5f2dd4f80d tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:07.870864 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb6ff2a2-d210-42ae-aff0-7d5f2dd4f80d tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:07.873173 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb6ff2a2-d210-42ae-aff0-7d5f2dd4f80d tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:07.943629 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:06:08.283596 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-8273439b-6da1-4f0a-ad00-ebd01742c119 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:08.296557 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-8273439b-6da1-4f0a-ad00-ebd01742c119 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1665 microversion: 2.1 time: 0.564207 Sep 16 13:06:08.323027 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1950/4037] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:07 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1665 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:08.335351 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5aa73030-1c64-4a1d-9922-02ba55bd910c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:08.336114 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5aa73030-1c64-4a1d-9922-02ba55bd910c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:08.352385 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5aa73030-1c64-4a1d-9922-02ba55bd910c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:08.352887 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5aa73030-1c64-4a1d-9922-02ba55bd910c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:08.354404 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5aa73030-1c64-4a1d-9922-02ba55bd910c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:08.355156 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5aa73030-1c64-4a1d-9922-02ba55bd910c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:08.355619 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5aa73030-1c64-4a1d-9922-02ba55bd910c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:08.356050 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5aa73030-1c64-4a1d-9922-02ba55bd910c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:08.598992 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5aa73030-1c64-4a1d-9922-02ba55bd910c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:08.615930 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fb6ff2a2-d210-42ae-aff0-7d5f2dd4f80d tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa734086fec1432d88be79bc2fb0ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069d839f047b4c38a1dae0ff8d692230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:08.622805 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5aa73030-1c64-4a1d-9922-02ba55bd910c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:08.624930 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fb6ff2a2-d210-42ae-aff0-7d5f2dd4f80d tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] 10.222.0.67 "GET /compute/v2.1/servers/6b0851db-8113-49aa-abe4-e5cd1b345b9b" status: 200 len: 1291 microversion: 2.1 time: 0.787004 Sep 16 13:06:08.627547 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5aa73030-1c64-4a1d-9922-02ba55bd910c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:08.630591 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5aa73030-1c64-4a1d-9922-02ba55bd910c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1603 microversion: 2.42 time: 0.300099 Sep 16 13:06:08.631812 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2088/4038] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:07 2022] GET /compute/v2.1/servers/6b0851db-8113-49aa-abe4-e5cd1b345b9b => generated 1291 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:08.634983 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1951/4039] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:06:08 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1603 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:06:08.667036 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-94436ec3-c1e2-4284-8cd3-b3b50ceb8492 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:06:08.667452 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-94436ec3-c1e2-4284-8cd3-b3b50ceb8492 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:08.696472 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94436ec3-c1e2-4284-8cd3-b3b50ceb8492 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:08.697269 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94436ec3-c1e2-4284-8cd3-b3b50ceb8492 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:08.697877 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94436ec3-c1e2-4284-8cd3-b3b50ceb8492 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:08.698767 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94436ec3-c1e2-4284-8cd3-b3b50ceb8492 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:08.699476 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94436ec3-c1e2-4284-8cd3-b3b50ceb8492 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:08.700068 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94436ec3-c1e2-4284-8cd3-b3b50ceb8492 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:08.750378 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-94436ec3-c1e2-4284-8cd3-b3b50ceb8492 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Unlocking {{(pid=128779) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 16 13:06:08.807108 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-94436ec3-c1e2-4284-8cd3-b3b50ceb8492 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "POST /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771/action" status: 202 len: 0 microversion: 2.1 time: 0.173735 Sep 16 13:06:08.808427 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2089/4040] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 13:06:08 2022] POST /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:06:08.821198 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ed3e54a2-de8c-4858-847d-72716f3711e5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:08.823554 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ed3e54a2-de8c-4858-847d-72716f3711e5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:08.842629 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-47d3286a-10c6-4256-ac81-d0f2dace9ee4 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:08.846135 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ed3e54a2-de8c-4858-847d-72716f3711e5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:08.846654 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ed3e54a2-de8c-4858-847d-72716f3711e5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:08.847088 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ed3e54a2-de8c-4858-847d-72716f3711e5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:08.847820 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ed3e54a2-de8c-4858-847d-72716f3711e5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:08.848507 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ed3e54a2-de8c-4858-847d-72716f3711e5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:08.849097 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ed3e54a2-de8c-4858-847d-72716f3711e5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:08.849460 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-47d3286a-10c6-4256-ac81-d0f2dace9ee4 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] [instance: 90c273f5-cec8-4644-90fb-f6ff80af0d77] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:08.875623 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47d3286a-10c6-4256-ac81-d0f2dace9ee4 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:08.883299 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47d3286a-10c6-4256-ac81-d0f2dace9ee4 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:08.884010 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47d3286a-10c6-4256-ac81-d0f2dace9ee4 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:08.884951 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47d3286a-10c6-4256-ac81-d0f2dace9ee4 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:08.885674 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47d3286a-10c6-4256-ac81-d0f2dace9ee4 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:08.886278 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47d3286a-10c6-4256-ac81-d0f2dace9ee4 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:10.226724 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ed3e54a2-de8c-4858-847d-72716f3711e5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:10.245162 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ed3e54a2-de8c-4858-847d-72716f3711e5 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1665 microversion: 2.1 time: 1.429608 Sep 16 13:06:10.260217 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1952/4041] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:08 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1665 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:10.265385 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5760a29a-14e4-4ce2-8b68-b2aff0d7c4ac tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:10.266015 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5760a29a-14e4-4ce2-8b68-b2aff0d7c4ac tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:10.301863 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5760a29a-14e4-4ce2-8b68-b2aff0d7c4ac tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:10.311251 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5760a29a-14e4-4ce2-8b68-b2aff0d7c4ac tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:10.312108 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5760a29a-14e4-4ce2-8b68-b2aff0d7c4ac tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:10.314749 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5760a29a-14e4-4ce2-8b68-b2aff0d7c4ac tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:10.318282 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5760a29a-14e4-4ce2-8b68-b2aff0d7c4ac tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:10.318943 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5760a29a-14e4-4ce2-8b68-b2aff0d7c4ac tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:10.529000 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-47d3286a-10c6-4256-ac81-d0f2dace9ee4 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d4e5bc37e4abc8475ff21d44c2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3bf83ac16540a7a1f4e5f4ea13a3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:10.542235 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5760a29a-14e4-4ce2-8b68-b2aff0d7c4ac tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:10.543808 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-47d3286a-10c6-4256-ac81-d0f2dace9ee4 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] 10.222.0.67 "GET /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77" status: 200 len: 1328 microversion: 2.1 time: 1.707927 Sep 16 13:06:10.558374 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5760a29a-14e4-4ce2-8b68-b2aff0d7c4ac tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:10.560602 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5760a29a-14e4-4ce2-8b68-b2aff0d7c4ac tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:10.563911 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5760a29a-14e4-4ce2-8b68-b2aff0d7c4ac tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1603 microversion: 2.42 time: 0.302551 Sep 16 13:06:10.566095 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2090/4042] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:08 2022] GET /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77 => generated 1328 bytes in 1723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:10.567271 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1953/4043] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:06:10 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1603 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:06:10.572528 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5266bc7e-fa35-468c-be6f-d32bad7e16f5 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:10.573149 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5266bc7e-fa35-468c-be6f-d32bad7e16f5 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] [instance: 6b0851db-8113-49aa-abe4-e5cd1b345b9b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:10.590930 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-627e2d64-bb69-4d31-a662-7ec1696c5dd9 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:10.591803 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-627e2d64-bb69-4d31-a662-7ec1696c5dd9 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:10.594220 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5266bc7e-fa35-468c-be6f-d32bad7e16f5 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:10.594724 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5266bc7e-fa35-468c-be6f-d32bad7e16f5 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:10.595175 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5266bc7e-fa35-468c-be6f-d32bad7e16f5 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:10.595880 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5266bc7e-fa35-468c-be6f-d32bad7e16f5 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:10.598856 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5266bc7e-fa35-468c-be6f-d32bad7e16f5 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:10.599305 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-627e2d64-bb69-4d31-a662-7ec1696c5dd9 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:10.599812 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-627e2d64-bb69-4d31-a662-7ec1696c5dd9 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:10.600957 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5266bc7e-fa35-468c-be6f-d32bad7e16f5 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:10.603581 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-627e2d64-bb69-4d31-a662-7ec1696c5dd9 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:10.604407 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-627e2d64-bb69-4d31-a662-7ec1696c5dd9 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:10.604886 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-627e2d64-bb69-4d31-a662-7ec1696c5dd9 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:10.605325 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-627e2d64-bb69-4d31-a662-7ec1696c5dd9 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:11.096748 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:06:11.131096 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:06:11.183666 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5266bc7e-fa35-468c-be6f-d32bad7e16f5 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa734086fec1432d88be79bc2fb0ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069d839f047b4c38a1dae0ff8d692230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:11.191954 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5266bc7e-fa35-468c-be6f-d32bad7e16f5 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] 10.222.0.67 "GET /compute/v2.1/servers/6b0851db-8113-49aa-abe4-e5cd1b345b9b" status: 200 len: 1481 microversion: 2.1 time: 0.624693 Sep 16 13:06:11.192827 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2091/4044] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:10 2022] GET /compute/v2.1/servers/6b0851db-8113-49aa-abe4-e5cd1b345b9b => generated 1481 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:11.232916 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-627e2d64-bb69-4d31-a662-7ec1696c5dd9 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:11.257180 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-627e2d64-bb69-4d31-a662-7ec1696c5dd9 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1665 microversion: 2.1 time: 0.688196 Sep 16 13:06:11.263735 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1954/4045] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:10 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1665 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:11.278177 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-740ebee3-7f71-47bb-8be9-58c3473271e5 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:11.278694 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-740ebee3-7f71-47bb-8be9-58c3473271e5 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] [instance: 6b0851db-8113-49aa-abe4-e5cd1b345b9b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:11.307228 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-740ebee3-7f71-47bb-8be9-58c3473271e5 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:11.307746 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-740ebee3-7f71-47bb-8be9-58c3473271e5 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:11.308245 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-740ebee3-7f71-47bb-8be9-58c3473271e5 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:11.308970 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-740ebee3-7f71-47bb-8be9-58c3473271e5 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:11.309438 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-740ebee3-7f71-47bb-8be9-58c3473271e5 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:11.309865 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-740ebee3-7f71-47bb-8be9-58c3473271e5 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:11.323805 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4162f372-5190-4d28-b302-2587e60334d3 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1968484941", "imageRef": "7df4548b-8809-4742-80bd-4e4e6dcafc91", "flavorRef": "452", "networks": [{"uuid": "5fe9603d-9b47-4832-ae2f-4bb235881e13"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:06:11.423194 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-4162f372-5190-4d28-b302-2587e60334d3 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] validate_networks() for [('5fe9603d-9b47-4832-ae2f-4bb235881e13', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:06:11.833023 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:06:11.996566 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-740ebee3-7f71-47bb-8be9-58c3473271e5 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] 10.222.0.67 "GET /compute/v2.1/servers/6b0851db-8113-49aa-abe4-e5cd1b345b9b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.731859 Sep 16 13:06:12.005463 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1955/4046] 10.222.0.67 () {58 vars in 1275 bytes} [Fri Sep 16 13:06:11 2022] GET /compute/v2.1/servers/6b0851db-8113-49aa-abe4-e5cd1b345b9b/os-interface => generated 284 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:06:12.005463 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0a7f6d9a-2eed-4fbe-ac01-e0a577d7f50a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:12.005463 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0a7f6d9a-2eed-4fbe-ac01-e0a577d7f50a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:12.020541 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0a7f6d9a-2eed-4fbe-ac01-e0a577d7f50a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:12.021064 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0a7f6d9a-2eed-4fbe-ac01-e0a577d7f50a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:12.021531 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0a7f6d9a-2eed-4fbe-ac01-e0a577d7f50a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:12.024830 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0a7f6d9a-2eed-4fbe-ac01-e0a577d7f50a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:12.025330 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0a7f6d9a-2eed-4fbe-ac01-e0a577d7f50a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:12.025786 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0a7f6d9a-2eed-4fbe-ac01-e0a577d7f50a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:12.845525 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0a7f6d9a-2eed-4fbe-ac01-e0a577d7f50a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:12.864565 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0a7f6d9a-2eed-4fbe-ac01-e0a577d7f50a tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1665 microversion: 2.1 time: 0.855955 Sep 16 13:06:12.865835 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1956/4047] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:11 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1665 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:12.871831 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-ffa9d2fb-ba36-43a6-ab39-14cc4851bba3 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:12.885157 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-ffa9d2fb-ba36-43a6-ab39-14cc4851bba3 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] [instance: 90c273f5-cec8-4644-90fb-f6ff80af0d77] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:12.892900 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ffa9d2fb-ba36-43a6-ab39-14cc4851bba3 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:12.893613 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ffa9d2fb-ba36-43a6-ab39-14cc4851bba3 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:12.894492 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ffa9d2fb-ba36-43a6-ab39-14cc4851bba3 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:12.895485 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ffa9d2fb-ba36-43a6-ab39-14cc4851bba3 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:12.896195 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ffa9d2fb-ba36-43a6-ab39-14cc4851bba3 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:12.896833 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-ffa9d2fb-ba36-43a6-ab39-14cc4851bba3 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:13.060254 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-4162f372-5190-4d28-b302-2587e60334d3 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:06:13.060796 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-4162f372-5190-4d28-b302-2587e60334d3 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:06:13.061140 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-4162f372-5190-4d28-b302-2587e60334d3 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:06:13.061587 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-4162f372-5190-4d28-b302-2587e60334d3 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:06:13.061995 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-4162f372-5190-4d28-b302-2587e60334d3 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:06:13.095191 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4162f372-5190-4d28-b302-2587e60334d3 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:13.095691 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4162f372-5190-4d28-b302-2587e60334d3 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:13.096161 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4162f372-5190-4d28-b302-2587e60334d3 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:13.096891 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4162f372-5190-4d28-b302-2587e60334d3 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:13.097343 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4162f372-5190-4d28-b302-2587e60334d3 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:13.097773 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4162f372-5190-4d28-b302-2587e60334d3 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:13.163447 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-4162f372-5190-4d28-b302-2587e60334d3 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Getting quotas for project 487c6b2edfb74e6d91d4443cfeb437a1. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:06:13.166659 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.quota [None req-4162f372-5190-4d28-b302-2587e60334d3 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Getting quotas for user c74da3fbb98846b69a1fef50a56dddf1 and project 487c6b2edfb74e6d91d4443cfeb437a1. Resources: {'cores', 'instances', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:06:13.196966 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4162f372-5190-4d28-b302-2587e60334d3 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:06:13.199376 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4162f372-5190-4d28-b302-2587e60334d3 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] [instance: b54b9ae7-c0ae-41e1-8da3-21152fb66aed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df4548b-8809-4742-80bd-4e4e6dcafc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:06:13.301539 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4162f372-5190-4d28-b302-2587e60334d3 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.087771 Sep 16 13:06:13.313752 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-ffa9d2fb-ba36-43a6-ab39-14cc4851bba3 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d4e5bc37e4abc8475ff21d44c2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3bf83ac16540a7a1f4e5f4ea13a3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:13.317960 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2092/4048] 10.222.0.67 () {60 vars in 1147 bytes} [Fri Sep 16 13:06:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 13:06:13.330010 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-ffa9d2fb-ba36-43a6-ab39-14cc4851bba3 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] 10.222.0.67 "GET /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77" status: 200 len: 1328 microversion: 2.1 time: 0.462860 Sep 16 13:06:13.331430 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1957/4049] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:12 2022] GET /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77 => generated 1328 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:13.335217 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0e4560fe-aa64-4785-93fe-0c14f44291b5 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:13.336483 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0e4560fe-aa64-4785-93fe-0c14f44291b5 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:13.349316 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-6dcd6846-02f5-4808-b9c9-5139d3b6d79d req-595390a7-6ba8-4457-bf2e-eba9833eca33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90c273f5-cec8-4644-90fb-f6ff80af0d77", "tag": "5d3e13d6-1350-42fb-92c3-316857c47ac8"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:06:13.359343 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e4560fe-aa64-4785-93fe-0c14f44291b5 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:13.360152 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e4560fe-aa64-4785-93fe-0c14f44291b5 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:13.360869 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e4560fe-aa64-4785-93fe-0c14f44291b5 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:13.361748 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e4560fe-aa64-4785-93fe-0c14f44291b5 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:13.363993 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e4560fe-aa64-4785-93fe-0c14f44291b5 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:13.365955 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e4560fe-aa64-4785-93fe-0c14f44291b5 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:13.379244 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-6dcd6846-02f5-4808-b9c9-5139d3b6d79d req-595390a7-6ba8-4457-bf2e-eba9833eca33 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:13.382318 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-6dcd6846-02f5-4808-b9c9-5139d3b6d79d req-595390a7-6ba8-4457-bf2e-eba9833eca33 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:13.382973 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-6dcd6846-02f5-4808-b9c9-5139d3b6d79d req-595390a7-6ba8-4457-bf2e-eba9833eca33 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:13.418204 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-6dcd6846-02f5-4808-b9c9-5139d3b6d79d req-595390a7-6ba8-4457-bf2e-eba9833eca33 service nova] Creating event network-changed:5d3e13d6-1350-42fb-92c3-316857c47ac8 for instance 90c273f5-cec8-4644-90fb-f6ff80af0d77 on n-h1-858094-4 Sep 16 13:06:13.432213 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-6dcd6846-02f5-4808-b9c9-5139d3b6d79d req-595390a7-6ba8-4457-bf2e-eba9833eca33 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098073 Sep 16 13:06:13.436327 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1958/4050] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:06:13.449888 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-57089942-df90-458c-bf07-0d09d7847af8 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:06:13.453063 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-57089942-df90-458c-bf07-0d09d7847af8 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:13.467011 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-57089942-df90-458c-bf07-0d09d7847af8 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:13.468004 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-57089942-df90-458c-bf07-0d09d7847af8 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:13.468485 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-57089942-df90-458c-bf07-0d09d7847af8 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:13.469203 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-57089942-df90-458c-bf07-0d09d7847af8 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:13.469666 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-57089942-df90-458c-bf07-0d09d7847af8 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:13.470094 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-57089942-df90-458c-bf07-0d09d7847af8 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:13.645953 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-57089942-df90-458c-bf07-0d09d7847af8 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "POST /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771/action" status: 202 len: 0 microversion: 2.1 time: 0.204909 Sep 16 13:06:13.661964 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1959/4051] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 13:06:13 2022] POST /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:06:13.694165 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3f020a6a-e42e-4a2c-bfa7-f45619f153ad tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:13.698516 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3f020a6a-e42e-4a2c-bfa7-f45619f153ad tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] [instance: b54b9ae7-c0ae-41e1-8da3-21152fb66aed] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:13.708492 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0e4560fe-aa64-4785-93fe-0c14f44291b5 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:13.747005 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0e4560fe-aa64-4785-93fe-0c14f44291b5 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:13.751349 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0e4560fe-aa64-4785-93fe-0c14f44291b5 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:13.752781 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0e4560fe-aa64-4785-93fe-0c14f44291b5 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1603 microversion: 2.42 time: 0.433594 Sep 16 13:06:13.765913 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2093/4052] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:06:13 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1603 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:06:13.783330 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e7b92b24-97d6-4220-be34-46bb62005158 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:13.789994 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e7b92b24-97d6-4220-be34-46bb62005158 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:13.802687 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7b92b24-97d6-4220-be34-46bb62005158 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:13.802903 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7b92b24-97d6-4220-be34-46bb62005158 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:13.803333 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7b92b24-97d6-4220-be34-46bb62005158 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:13.804060 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7b92b24-97d6-4220-be34-46bb62005158 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:13.804999 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7b92b24-97d6-4220-be34-46bb62005158 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:13.805296 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7b92b24-97d6-4220-be34-46bb62005158 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:13.885814 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3f020a6a-e42e-4a2c-bfa7-f45619f153ad tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74da3fbb98846b69a1fef50a56dddf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487c6b2edfb74e6d91d4443cfeb437a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:13.902869 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3f020a6a-e42e-4a2c-bfa7-f45619f153ad tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] 10.222.0.67 "GET /compute/v2.1/servers/b54b9ae7-c0ae-41e1-8da3-21152fb66aed" status: 200 len: 1218 microversion: 2.1 time: 0.236903 Sep 16 13:06:13.907778 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1960/4053] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:13 2022] GET /compute/v2.1/servers/b54b9ae7-c0ae-41e1-8da3-21152fb66aed => generated 1218 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:14.360338 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-9471152c-216e-4ed0-91c5-eb6c69c61a11 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:14.361037 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-9471152c-216e-4ed0-91c5-eb6c69c61a11 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] [instance: 90c273f5-cec8-4644-90fb-f6ff80af0d77] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:14.375334 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9471152c-216e-4ed0-91c5-eb6c69c61a11 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:14.390855 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9471152c-216e-4ed0-91c5-eb6c69c61a11 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:14.391782 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9471152c-216e-4ed0-91c5-eb6c69c61a11 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:14.397041 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9471152c-216e-4ed0-91c5-eb6c69c61a11 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:14.401442 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9471152c-216e-4ed0-91c5-eb6c69c61a11 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:14.404580 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-9471152c-216e-4ed0-91c5-eb6c69c61a11 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:14.885343 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-9471152c-216e-4ed0-91c5-eb6c69c61a11 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d4e5bc37e4abc8475ff21d44c2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3bf83ac16540a7a1f4e5f4ea13a3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:14.900794 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-9471152c-216e-4ed0-91c5-eb6c69c61a11 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] 10.222.0.67 "GET /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77" status: 200 len: 1328 microversion: 2.1 time: 0.546231 Sep 16 13:06:14.903940 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1961/4054] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:14 2022] GET /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77 => generated 1328 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:14.937910 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-c394c834-13d1-4862-89f6-1125a22d9500 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:14.939857 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-c394c834-13d1-4862-89f6-1125a22d9500 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] [instance: 6b0851db-8113-49aa-abe4-e5cd1b345b9b] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:14.955543 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c394c834-13d1-4862-89f6-1125a22d9500 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:14.958113 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c394c834-13d1-4862-89f6-1125a22d9500 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:14.961637 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c394c834-13d1-4862-89f6-1125a22d9500 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:14.963652 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c394c834-13d1-4862-89f6-1125a22d9500 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:14.964748 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c394c834-13d1-4862-89f6-1125a22d9500 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:14.965197 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-c394c834-13d1-4862-89f6-1125a22d9500 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:15.629425 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e7b92b24-97d6-4220-be34-46bb62005158 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:15.655038 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e7b92b24-97d6-4220-be34-46bb62005158 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1670 microversion: 2.1 time: 1.887105 Sep 16 13:06:15.655850 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2094/4055] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:13 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1670 bytes in 1888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:15.664806 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9924291d-4be0-4787-b304-ba30f70a5152 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:15.665674 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9924291d-4be0-4787-b304-ba30f70a5152 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:15.677339 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9924291d-4be0-4787-b304-ba30f70a5152 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:15.677832 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9924291d-4be0-4787-b304-ba30f70a5152 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:15.678269 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9924291d-4be0-4787-b304-ba30f70a5152 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:15.678968 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9924291d-4be0-4787-b304-ba30f70a5152 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:15.679983 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9924291d-4be0-4787-b304-ba30f70a5152 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:15.684891 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9924291d-4be0-4787-b304-ba30f70a5152 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:15.847464 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9924291d-4be0-4787-b304-ba30f70a5152 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:15.865322 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9924291d-4be0-4787-b304-ba30f70a5152 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:15.870557 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9924291d-4be0-4787-b304-ba30f70a5152 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:15.872059 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9924291d-4be0-4787-b304-ba30f70a5152 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1603 microversion: 2.42 time: 0.215440 Sep 16 13:06:15.872925 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2095/4056] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:06:15 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1603 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:06:15.877763 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-10c619cf-087b-4ef5-9c8b-edc13917309f req-9aacf7ac-1e37-43b3-8dc1-723e363e3ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b0851db-8113-49aa-abe4-e5cd1b345b9b", "tag": "f97b74c9-9b69-40fb-b7ec-2e8f5d0f5b69"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:06:15.892832 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-10c619cf-087b-4ef5-9c8b-edc13917309f req-9aacf7ac-1e37-43b3-8dc1-723e363e3ea0 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:15.893658 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-10c619cf-087b-4ef5-9c8b-edc13917309f req-9aacf7ac-1e37-43b3-8dc1-723e363e3ea0 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:15.894097 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-10c619cf-087b-4ef5-9c8b-edc13917309f req-9aacf7ac-1e37-43b3-8dc1-723e363e3ea0 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:15.918515 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-10c619cf-087b-4ef5-9c8b-edc13917309f req-9aacf7ac-1e37-43b3-8dc1-723e363e3ea0 service nova] Creating event network-changed:f97b74c9-9b69-40fb-b7ec-2e8f5d0f5b69 for instance 6b0851db-8113-49aa-abe4-e5cd1b345b9b on n-h2-858094-4 Sep 16 13:06:15.931909 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-c394c834-13d1-4862-89f6-1125a22d9500 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa734086fec1432d88be79bc2fb0ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069d839f047b4c38a1dae0ff8d692230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:15.942256 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-10c619cf-087b-4ef5-9c8b-edc13917309f req-9aacf7ac-1e37-43b3-8dc1-723e363e3ea0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067843 Sep 16 13:06:15.943164 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2096/4057] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:06:15.946422 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-c394c834-13d1-4862-89f6-1125a22d9500 tempest-ServersTestBootFromVolume-2046606479 tempest-ServersTestBootFromVolume-2046606479-project] 10.222.0.67 "GET /compute/v2.1/servers/6b0851db-8113-49aa-abe4-e5cd1b345b9b" status: 200 len: 1481 microversion: 2.1 time: 1.041313 Sep 16 13:06:15.952454 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1962/4058] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:14 2022] GET /compute/v2.1/servers/6b0851db-8113-49aa-abe4-e5cd1b345b9b => generated 1481 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:15.961233 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6807243c-d434-4a42-8a82-5eec649ec81a tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:15.964153 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6807243c-d434-4a42-8a82-5eec649ec81a tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] [instance: 90c273f5-cec8-4644-90fb-f6ff80af0d77] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:15.972699 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d999ab11-4eac-4dbd-bc23-4eae3894a3e4 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:15.973538 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d999ab11-4eac-4dbd-bc23-4eae3894a3e4 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] [instance: b54b9ae7-c0ae-41e1-8da3-21152fb66aed] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:15.987789 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6807243c-d434-4a42-8a82-5eec649ec81a tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:15.988052 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d999ab11-4eac-4dbd-bc23-4eae3894a3e4 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:15.988755 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6807243c-d434-4a42-8a82-5eec649ec81a tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:15.989271 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6807243c-d434-4a42-8a82-5eec649ec81a tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:15.989790 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d999ab11-4eac-4dbd-bc23-4eae3894a3e4 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:15.990143 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6807243c-d434-4a42-8a82-5eec649ec81a tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:15.990670 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6807243c-d434-4a42-8a82-5eec649ec81a tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:15.991170 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6807243c-d434-4a42-8a82-5eec649ec81a tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:15.998983 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d999ab11-4eac-4dbd-bc23-4eae3894a3e4 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:16.000137 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d999ab11-4eac-4dbd-bc23-4eae3894a3e4 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:16.000842 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d999ab11-4eac-4dbd-bc23-4eae3894a3e4 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:16.001509 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d999ab11-4eac-4dbd-bc23-4eae3894a3e4 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:16.044824 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:06:16.140056 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d999ab11-4eac-4dbd-bc23-4eae3894a3e4 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74da3fbb98846b69a1fef50a56dddf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487c6b2edfb74e6d91d4443cfeb437a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:16.161110 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d999ab11-4eac-4dbd-bc23-4eae3894a3e4 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] 10.222.0.67 "GET /compute/v2.1/servers/b54b9ae7-c0ae-41e1-8da3-21152fb66aed" status: 200 len: 1270 microversion: 2.1 time: 0.208407 Sep 16 13:06:16.162079 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2097/4059] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:15 2022] GET /compute/v2.1/servers/b54b9ae7-c0ae-41e1-8da3-21152fb66aed => generated 1270 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:16.313412 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6807243c-d434-4a42-8a82-5eec649ec81a tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d4e5bc37e4abc8475ff21d44c2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3bf83ac16540a7a1f4e5f4ea13a3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:16.326989 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6807243c-d434-4a42-8a82-5eec649ec81a tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] 10.222.0.67 "GET /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77" status: 200 len: 1328 microversion: 2.1 time: 0.372716 Sep 16 13:06:16.327988 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1963/4060] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:15 2022] GET /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77 => generated 1328 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:16.680490 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-aa276a24-7d1c-4ee5-af30-46feb753fbe2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:16.681754 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-aa276a24-7d1c-4ee5-af30-46feb753fbe2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:16.690757 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa276a24-7d1c-4ee5-af30-46feb753fbe2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:16.691605 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa276a24-7d1c-4ee5-af30-46feb753fbe2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:16.692345 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa276a24-7d1c-4ee5-af30-46feb753fbe2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:16.693551 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa276a24-7d1c-4ee5-af30-46feb753fbe2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:16.694638 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa276a24-7d1c-4ee5-af30-46feb753fbe2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:16.697794 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa276a24-7d1c-4ee5-af30-46feb753fbe2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:16.904260 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5d766371-5a5f-48c7-b2a5-b50c69100872 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:16.905272 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5d766371-5a5f-48c7-b2a5-b50c69100872 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:16.944842 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5d766371-5a5f-48c7-b2a5-b50c69100872 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:16.950978 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5d766371-5a5f-48c7-b2a5-b50c69100872 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:16.964326 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5d766371-5a5f-48c7-b2a5-b50c69100872 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:16.965164 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5d766371-5a5f-48c7-b2a5-b50c69100872 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:16.965659 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5d766371-5a5f-48c7-b2a5-b50c69100872 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:16.966104 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5d766371-5a5f-48c7-b2a5-b50c69100872 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:17.219528 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5d766371-5a5f-48c7-b2a5-b50c69100872 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:17.227718 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-aa276a24-7d1c-4ee5-af30-46feb753fbe2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:17.239964 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-aa276a24-7d1c-4ee5-af30-46feb753fbe2 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1650 microversion: 2.1 time: 0.559873 Sep 16 13:06:17.240656 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2098/4061] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:16 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1650 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:17.247638 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5d766371-5a5f-48c7-b2a5-b50c69100872 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:17.251423 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fca7a74c-c283-49a8-a013-5f4874693ee0 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:17.252051 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fca7a74c-c283-49a8-a013-5f4874693ee0 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] [instance: b54b9ae7-c0ae-41e1-8da3-21152fb66aed] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:17.252887 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5d766371-5a5f-48c7-b2a5-b50c69100872 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:17.257321 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5d766371-5a5f-48c7-b2a5-b50c69100872 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1603 microversion: 2.42 time: 0.359225 Sep 16 13:06:17.258657 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1964/4062] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:06:16 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1603 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:06:17.275363 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-60cafbcf-4fff-407f-9976-3103b248f856 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:06:17.277499 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-60cafbcf-4fff-407f-9976-3103b248f856 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:17.279602 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:06:17.298055 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fca7a74c-c283-49a8-a013-5f4874693ee0 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:17.298668 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-60cafbcf-4fff-407f-9976-3103b248f856 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:17.299691 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fca7a74c-c283-49a8-a013-5f4874693ee0 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:17.301468 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-60cafbcf-4fff-407f-9976-3103b248f856 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:17.302836 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fca7a74c-c283-49a8-a013-5f4874693ee0 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:17.303649 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fca7a74c-c283-49a8-a013-5f4874693ee0 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:17.304157 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fca7a74c-c283-49a8-a013-5f4874693ee0 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:17.307878 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fca7a74c-c283-49a8-a013-5f4874693ee0 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:17.317300 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-60cafbcf-4fff-407f-9976-3103b248f856 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:17.327289 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-60cafbcf-4fff-407f-9976-3103b248f856 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:17.329953 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-60cafbcf-4fff-407f-9976-3103b248f856 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:17.330674 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-60cafbcf-4fff-407f-9976-3103b248f856 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:17.562372 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-60cafbcf-4fff-407f-9976-3103b248f856 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "POST /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771/action" status: 202 len: 0 microversion: 2.1 time: 0.298763 Sep 16 13:06:17.564844 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1965/4063] 10.222.0.67 () {60 vars in 1278 bytes} [Fri Sep 16 13:06:17 2022] POST /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:06:17.612711 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-a8d8cd56-f867-4a24-90ea-890810b4f88c tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:17.615642 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-a8d8cd56-f867-4a24-90ea-890810b4f88c tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] [instance: 90c273f5-cec8-4644-90fb-f6ff80af0d77] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:17.623876 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fca7a74c-c283-49a8-a013-5f4874693ee0 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74da3fbb98846b69a1fef50a56dddf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487c6b2edfb74e6d91d4443cfeb437a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:17.631307 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8d8cd56-f867-4a24-90ea-890810b4f88c tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:17.632102 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8d8cd56-f867-4a24-90ea-890810b4f88c tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:17.633201 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fca7a74c-c283-49a8-a013-5f4874693ee0 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] 10.222.0.67 "GET /compute/v2.1/servers/b54b9ae7-c0ae-41e1-8da3-21152fb66aed" status: 200 len: 1270 microversion: 2.1 time: 0.390907 Sep 16 13:06:17.633932 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8d8cd56-f867-4a24-90ea-890810b4f88c tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:17.634816 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8d8cd56-f867-4a24-90ea-890810b4f88c tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:17.635615 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8d8cd56-f867-4a24-90ea-890810b4f88c tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:17.636218 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-a8d8cd56-f867-4a24-90ea-890810b4f88c tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:17.636474 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2099/4064] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:17 2022] GET /compute/v2.1/servers/b54b9ae7-c0ae-41e1-8da3-21152fb66aed => generated 1270 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:17.647319 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-be2aa5e1-5fb6-4b41-b9fd-f6b338b1317c tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:17.654917 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-be2aa5e1-5fb6-4b41-b9fd-f6b338b1317c tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:17.679115 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be2aa5e1-5fb6-4b41-b9fd-f6b338b1317c tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:17.680407 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be2aa5e1-5fb6-4b41-b9fd-f6b338b1317c tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:17.688934 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be2aa5e1-5fb6-4b41-b9fd-f6b338b1317c tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:17.692741 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be2aa5e1-5fb6-4b41-b9fd-f6b338b1317c tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:17.693395 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be2aa5e1-5fb6-4b41-b9fd-f6b338b1317c tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:17.693990 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be2aa5e1-5fb6-4b41-b9fd-f6b338b1317c tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:18.337715 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-a8d8cd56-f867-4a24-90ea-890810b4f88c tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d4e5bc37e4abc8475ff21d44c2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3bf83ac16540a7a1f4e5f4ea13a3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:18.349653 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-a8d8cd56-f867-4a24-90ea-890810b4f88c tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] 10.222.0.67 "GET /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77" status: 200 len: 1328 microversion: 2.1 time: 0.762000 Sep 16 13:06:18.364576 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1966/4065] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:17 2022] GET /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77 => generated 1328 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:18.373396 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-f32a1ad5-0eb6-4593-a087-6630f6268933 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:18.374009 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-f32a1ad5-0eb6-4593-a087-6630f6268933 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:18.387987 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f32a1ad5-0eb6-4593-a087-6630f6268933 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:18.389180 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f32a1ad5-0eb6-4593-a087-6630f6268933 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:18.389885 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f32a1ad5-0eb6-4593-a087-6630f6268933 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:18.390622 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f32a1ad5-0eb6-4593-a087-6630f6268933 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:18.391041 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f32a1ad5-0eb6-4593-a087-6630f6268933 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:18.391630 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-f32a1ad5-0eb6-4593-a087-6630f6268933 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:18.427491 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-be2aa5e1-5fb6-4b41-b9fd-f6b338b1317c tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:18.442128 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-be2aa5e1-5fb6-4b41-b9fd-f6b338b1317c tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1657 microversion: 2.1 time: 0.804024 Sep 16 13:06:18.442982 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2100/4066] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:17 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1657 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:18.572036 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f32a1ad5-0eb6-4593-a087-6630f6268933 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:18.585180 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f32a1ad5-0eb6-4593-a087-6630f6268933 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:18.598439 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-f32a1ad5-0eb6-4593-a087-6630f6268933 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:18.599896 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-f32a1ad5-0eb6-4593-a087-6630f6268933 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1603 microversion: 2.42 time: 0.234201 Sep 16 13:06:18.600727 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1967/4067] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:06:18 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1603 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:06:18.664833 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e63eaeb1-c42f-4688-abe6-d3031ed3be92 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:18.665463 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e63eaeb1-c42f-4688-abe6-d3031ed3be92 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] [instance: b54b9ae7-c0ae-41e1-8da3-21152fb66aed] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:18.675404 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e63eaeb1-c42f-4688-abe6-d3031ed3be92 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:18.675911 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e63eaeb1-c42f-4688-abe6-d3031ed3be92 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:18.676387 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e63eaeb1-c42f-4688-abe6-d3031ed3be92 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:18.677112 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e63eaeb1-c42f-4688-abe6-d3031ed3be92 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:18.677571 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e63eaeb1-c42f-4688-abe6-d3031ed3be92 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:18.678001 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e63eaeb1-c42f-4688-abe6-d3031ed3be92 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:18.850641 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e63eaeb1-c42f-4688-abe6-d3031ed3be92 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74da3fbb98846b69a1fef50a56dddf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487c6b2edfb74e6d91d4443cfeb437a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:18.864536 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e63eaeb1-c42f-4688-abe6-d3031ed3be92 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] 10.222.0.67 "GET /compute/v2.1/servers/b54b9ae7-c0ae-41e1-8da3-21152fb66aed" status: 200 len: 1276 microversion: 2.1 time: 0.204384 Sep 16 13:06:18.867895 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2101/4068] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:18 2022] GET /compute/v2.1/servers/b54b9ae7-c0ae-41e1-8da3-21152fb66aed => generated 1276 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:19.378584 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-04d64c73-631e-4459-9b21-cf95d6784d7c tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:19.379743 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-04d64c73-631e-4459-9b21-cf95d6784d7c tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] [instance: 90c273f5-cec8-4644-90fb-f6ff80af0d77] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:19.396990 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-04d64c73-631e-4459-9b21-cf95d6784d7c tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:19.397490 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-04d64c73-631e-4459-9b21-cf95d6784d7c tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:19.397932 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-04d64c73-631e-4459-9b21-cf95d6784d7c tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:19.398988 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-04d64c73-631e-4459-9b21-cf95d6784d7c tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:19.399327 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-04d64c73-631e-4459-9b21-cf95d6784d7c tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:19.403760 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-04d64c73-631e-4459-9b21-cf95d6784d7c tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:19.492995 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7ffe28dc-af1b-46c3-aabf-b63c76782b3e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:19.493345 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7ffe28dc-af1b-46c3-aabf-b63c76782b3e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:19.516693 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ffe28dc-af1b-46c3-aabf-b63c76782b3e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:19.517610 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ffe28dc-af1b-46c3-aabf-b63c76782b3e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:19.518287 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ffe28dc-af1b-46c3-aabf-b63c76782b3e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:19.519337 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ffe28dc-af1b-46c3-aabf-b63c76782b3e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:19.521467 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ffe28dc-af1b-46c3-aabf-b63c76782b3e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:19.522197 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ffe28dc-af1b-46c3-aabf-b63c76782b3e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:19.956738 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-04d64c73-631e-4459-9b21-cf95d6784d7c tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d4e5bc37e4abc8475ff21d44c2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3bf83ac16540a7a1f4e5f4ea13a3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:19.969416 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-04d64c73-631e-4459-9b21-cf95d6784d7c tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] 10.222.0.67 "GET /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77" status: 200 len: 1328 microversion: 2.1 time: 0.594710 Sep 16 13:06:19.973641 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1968/4069] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:19 2022] GET /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77 => generated 1328 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:19.982599 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e1e51484-a5f5-4760-8ff0-12e69f189620 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:19.984814 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e1e51484-a5f5-4760-8ff0-12e69f189620 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:20.002329 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1e51484-a5f5-4760-8ff0-12e69f189620 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:20.002759 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1e51484-a5f5-4760-8ff0-12e69f189620 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:20.003214 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1e51484-a5f5-4760-8ff0-12e69f189620 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:20.005299 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1e51484-a5f5-4760-8ff0-12e69f189620 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:20.005806 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1e51484-a5f5-4760-8ff0-12e69f189620 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:20.006447 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e1e51484-a5f5-4760-8ff0-12e69f189620 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:20.051384 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7ffe28dc-af1b-46c3-aabf-b63c76782b3e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:20.065990 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7ffe28dc-af1b-46c3-aabf-b63c76782b3e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1665 microversion: 2.1 time: 0.578678 Sep 16 13:06:20.070909 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2102/4070] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:19 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1665 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:20.082859 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c834e664-3daf-4439-b719-886d19c6ea8f tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:20.084886 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c834e664-3daf-4439-b719-886d19c6ea8f tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] [instance: b54b9ae7-c0ae-41e1-8da3-21152fb66aed] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:20.106360 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c834e664-3daf-4439-b719-886d19c6ea8f tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:20.107322 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c834e664-3daf-4439-b719-886d19c6ea8f tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:20.109141 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c834e664-3daf-4439-b719-886d19c6ea8f tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:20.111141 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c834e664-3daf-4439-b719-886d19c6ea8f tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:20.113129 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c834e664-3daf-4439-b719-886d19c6ea8f tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:20.113791 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c834e664-3daf-4439-b719-886d19c6ea8f tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:20.157557 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e1e51484-a5f5-4760-8ff0-12e69f189620 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:20.177572 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e1e51484-a5f5-4760-8ff0-12e69f189620 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:20.182258 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e1e51484-a5f5-4760-8ff0-12e69f189620 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:20.187127 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e1e51484-a5f5-4760-8ff0-12e69f189620 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1603 microversion: 2.42 time: 0.212192 Sep 16 13:06:20.188861 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1969/4071] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:06:19 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1603 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:06:20.207356 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0fc049ab-5bdb-4a0a-9f39-c6c19394f8cf tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:20.208748 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0fc049ab-5bdb-4a0a-9f39-c6c19394f8cf tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:20.231341 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0fc049ab-5bdb-4a0a-9f39-c6c19394f8cf tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:20.232028 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0fc049ab-5bdb-4a0a-9f39-c6c19394f8cf tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:20.233699 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0fc049ab-5bdb-4a0a-9f39-c6c19394f8cf tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:20.238434 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0fc049ab-5bdb-4a0a-9f39-c6c19394f8cf tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:20.239188 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0fc049ab-5bdb-4a0a-9f39-c6c19394f8cf tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:20.241301 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0fc049ab-5bdb-4a0a-9f39-c6c19394f8cf tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:20.728347 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c834e664-3daf-4439-b719-886d19c6ea8f tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74da3fbb98846b69a1fef50a56dddf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487c6b2edfb74e6d91d4443cfeb437a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:20.733279 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:06:20.760091 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c834e664-3daf-4439-b719-886d19c6ea8f tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] 10.222.0.67 "GET /compute/v2.1/servers/b54b9ae7-c0ae-41e1-8da3-21152fb66aed" status: 200 len: 1318 microversion: 2.1 time: 0.687888 Sep 16 13:06:20.763736 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2103/4072] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:20 2022] GET /compute/v2.1/servers/b54b9ae7-c0ae-41e1-8da3-21152fb66aed => generated 1318 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:20.789018 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-12888e83-f5f8-419c-bada-aa29968a77f8 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:20.794877 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-12888e83-f5f8-419c-bada-aa29968a77f8 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: b76bc3fa-0395-4782-8a87-ec5cfc6da641] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:20.815948 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12888e83-f5f8-419c-bada-aa29968a77f8 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:20.819174 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12888e83-f5f8-419c-bada-aa29968a77f8 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:20.821090 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12888e83-f5f8-419c-bada-aa29968a77f8 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:20.823062 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12888e83-f5f8-419c-bada-aa29968a77f8 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:20.823888 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12888e83-f5f8-419c-bada-aa29968a77f8 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:20.825548 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12888e83-f5f8-419c-bada-aa29968a77f8 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:20.911313 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-12888e83-f5f8-419c-bada-aa29968a77f8 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641/ips" status: 200 len: 152 microversion: 2.20 time: 0.145485 Sep 16 13:06:20.915942 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2104/4073] 10.222.0.67 () {60 vars in 1289 bytes} [Fri Sep 16 13:06:20 2022] GET /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641/ips => generated 152 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:06:20.927995 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-c21f7153-edcc-4256-9bbb-703e39f35ade req-d8e8e2e5-5269-4c93-b9da-aa591409cee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90c273f5-cec8-4644-90fb-f6ff80af0d77", "name": "network-vif-plugged", "status": "completed", "tag": "5d3e13d6-1350-42fb-92c3-316857c47ac8"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:06:20.957733 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c21f7153-edcc-4256-9bbb-703e39f35ade req-d8e8e2e5-5269-4c93-b9da-aa591409cee5 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:20.960045 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c21f7153-edcc-4256-9bbb-703e39f35ade req-d8e8e2e5-5269-4c93-b9da-aa591409cee5 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:20.960839 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c21f7153-edcc-4256-9bbb-703e39f35ade req-d8e8e2e5-5269-4c93-b9da-aa591409cee5 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:20.987229 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0fc049ab-5bdb-4a0a-9f39-c6c19394f8cf tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:20.999360 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-c21f7153-edcc-4256-9bbb-703e39f35ade req-d8e8e2e5-5269-4c93-b9da-aa591409cee5 service nova] Creating event network-vif-plugged:5d3e13d6-1350-42fb-92c3-316857c47ac8 for instance 90c273f5-cec8-4644-90fb-f6ff80af0d77 on n-h1-858094-4 Sep 16 13:06:21.005003 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0fc049ab-5bdb-4a0a-9f39-c6c19394f8cf tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1665 microversion: 2.1 time: 0.814575 Sep 16 13:06:21.005625 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1970/4074] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:20 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1665 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:21.019295 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-c21f7153-edcc-4256-9bbb-703e39f35ade req-d8e8e2e5-5269-4c93-b9da-aa591409cee5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099312 Sep 16 13:06:21.021598 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-0ff69bb8-6781-43c5-b423-4d2c95c6819a tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:21.022252 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-0ff69bb8-6781-43c5-b423-4d2c95c6819a tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] [instance: 90c273f5-cec8-4644-90fb-f6ff80af0d77] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:21.025050 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2105/4075] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:06:21.048955 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-31e1ed79-4ff7-4064-9213-30e22d2a1999 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:21.052733 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-31e1ed79-4ff7-4064-9213-30e22d2a1999 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:21.063361 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0ff69bb8-6781-43c5-b423-4d2c95c6819a tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:21.063872 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0ff69bb8-6781-43c5-b423-4d2c95c6819a tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:21.068152 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0ff69bb8-6781-43c5-b423-4d2c95c6819a tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:21.070286 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0ff69bb8-6781-43c5-b423-4d2c95c6819a tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:21.077864 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0ff69bb8-6781-43c5-b423-4d2c95c6819a tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:21.078414 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-0ff69bb8-6781-43c5-b423-4d2c95c6819a tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:21.098609 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31e1ed79-4ff7-4064-9213-30e22d2a1999 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:21.099889 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31e1ed79-4ff7-4064-9213-30e22d2a1999 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:21.100711 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31e1ed79-4ff7-4064-9213-30e22d2a1999 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:21.105140 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31e1ed79-4ff7-4064-9213-30e22d2a1999 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:21.114746 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31e1ed79-4ff7-4064-9213-30e22d2a1999 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:21.115258 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31e1ed79-4ff7-4064-9213-30e22d2a1999 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:21.859545 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-31e1ed79-4ff7-4064-9213-30e22d2a1999 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:21.871364 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-31e1ed79-4ff7-4064-9213-30e22d2a1999 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1665 microversion: 2.1 time: 0.836007 Sep 16 13:06:21.871976 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2106/4076] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:21 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1665 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:21.884426 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-45acfb0a-5b1e-4580-8cb7-23f0e739e308 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:21.886015 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-45acfb0a-5b1e-4580-8cb7-23f0e739e308 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:21.902630 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45acfb0a-5b1e-4580-8cb7-23f0e739e308 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:21.903137 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45acfb0a-5b1e-4580-8cb7-23f0e739e308 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:21.903582 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45acfb0a-5b1e-4580-8cb7-23f0e739e308 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:21.904344 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45acfb0a-5b1e-4580-8cb7-23f0e739e308 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:21.905360 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45acfb0a-5b1e-4580-8cb7-23f0e739e308 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:21.909614 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-0ff69bb8-6781-43c5-b423-4d2c95c6819a tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d4e5bc37e4abc8475ff21d44c2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3bf83ac16540a7a1f4e5f4ea13a3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:21.913270 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45acfb0a-5b1e-4580-8cb7-23f0e739e308 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:21.920612 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-0ff69bb8-6781-43c5-b423-4d2c95c6819a tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] 10.222.0.67 "GET /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77" status: 200 len: 1328 microversion: 2.1 time: 0.908482 Sep 16 13:06:21.925401 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1971/4077] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:21 2022] GET /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77 => generated 1328 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:21.945434 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-b2993057-d5b4-4308-b6ab-01bdc26b731d tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:21.953305 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-b2993057-d5b4-4308-b6ab-01bdc26b731d tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] [instance: b54b9ae7-c0ae-41e1-8da3-21152fb66aed] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:21.967411 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b2993057-d5b4-4308-b6ab-01bdc26b731d tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:21.969386 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b2993057-d5b4-4308-b6ab-01bdc26b731d tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:21.969866 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b2993057-d5b4-4308-b6ab-01bdc26b731d tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:21.970606 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b2993057-d5b4-4308-b6ab-01bdc26b731d tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:21.971073 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b2993057-d5b4-4308-b6ab-01bdc26b731d tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:21.971506 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-b2993057-d5b4-4308-b6ab-01bdc26b731d tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:22.298152 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-45acfb0a-5b1e-4580-8cb7-23f0e739e308 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:22.316351 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-45acfb0a-5b1e-4580-8cb7-23f0e739e308 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:22.320323 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-45acfb0a-5b1e-4580-8cb7-23f0e739e308 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:22.324310 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-45acfb0a-5b1e-4580-8cb7-23f0e739e308 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1603 microversion: 2.42 time: 0.451131 Sep 16 13:06:22.342767 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2107/4078] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:06:21 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1603 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:06:22.374425 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2711c185-69e9-43a6-a4fe-9838ef5e7105 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:22.375430 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2711c185-69e9-43a6-a4fe-9838ef5e7105 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:22.386278 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2711c185-69e9-43a6-a4fe-9838ef5e7105 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:22.387850 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2711c185-69e9-43a6-a4fe-9838ef5e7105 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:22.388729 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2711c185-69e9-43a6-a4fe-9838ef5e7105 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:22.389757 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2711c185-69e9-43a6-a4fe-9838ef5e7105 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:22.390427 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2711c185-69e9-43a6-a4fe-9838ef5e7105 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:22.392404 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2711c185-69e9-43a6-a4fe-9838ef5e7105 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:22.524685 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-b2993057-d5b4-4308-b6ab-01bdc26b731d tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74da3fbb98846b69a1fef50a56dddf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487c6b2edfb74e6d91d4443cfeb437a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:22.534297 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-b2993057-d5b4-4308-b6ab-01bdc26b731d tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] 10.222.0.67 "GET /compute/v2.1/servers/b54b9ae7-c0ae-41e1-8da3-21152fb66aed" status: 200 len: 1318 microversion: 2.1 time: 0.607063 Sep 16 13:06:22.539782 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1972/4079] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:21 2022] GET /compute/v2.1/servers/b54b9ae7-c0ae-41e1-8da3-21152fb66aed => generated 1318 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:22.675647 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2711c185-69e9-43a6-a4fe-9838ef5e7105 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:22.688379 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2711c185-69e9-43a6-a4fe-9838ef5e7105 tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1665 microversion: 2.1 time: 0.326531 Sep 16 13:06:22.690714 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2108/4080] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:22 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1665 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:22.716894 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-6c8775b1-d2d2-40b3-bb78-2f171cb461df tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:22.717843 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-6c8775b1-d2d2-40b3-bb78-2f171cb461df tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:22.729945 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=90 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:06:22.732115 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6c8775b1-d2d2-40b3-bb78-2f171cb461df tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:22.732854 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6c8775b1-d2d2-40b3-bb78-2f171cb461df tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:22.733778 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6c8775b1-d2d2-40b3-bb78-2f171cb461df tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:22.736924 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6c8775b1-d2d2-40b3-bb78-2f171cb461df tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:22.737560 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6c8775b1-d2d2-40b3-bb78-2f171cb461df tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:22.745060 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-6c8775b1-d2d2-40b3-bb78-2f171cb461df tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:22.981285 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3ee1d538-a969-44cd-a099-b4c1d7218d8c tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:22.982814 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3ee1d538-a969-44cd-a099-b4c1d7218d8c tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] [instance: 90c273f5-cec8-4644-90fb-f6ff80af0d77] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:23.011330 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ee1d538-a969-44cd-a099-b4c1d7218d8c tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:23.012054 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ee1d538-a969-44cd-a099-b4c1d7218d8c tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:23.014327 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ee1d538-a969-44cd-a099-b4c1d7218d8c tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:23.017769 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ee1d538-a969-44cd-a099-b4c1d7218d8c tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:23.021807 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ee1d538-a969-44cd-a099-b4c1d7218d8c tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:23.022430 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ee1d538-a969-44cd-a099-b4c1d7218d8c tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:23.143428 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:06:23.177145 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-6c8775b1-d2d2-40b3-bb78-2f171cb461df tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:23.185180 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:06:23.190126 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-6c8775b1-d2d2-40b3-bb78-2f171cb461df tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1665 microversion: 2.1 time: 0.477271 Sep 16 13:06:23.193861 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1973/4081] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:22 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1665 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:23.224892 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-bf327ace-ba52-4bbd-880c-0ef637e8629e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:23.228895 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-bf327ace-ba52-4bbd-880c-0ef637e8629e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] [instance: af5e660b-de79-42ca-a8de-fe06738b9771] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:23.247527 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bf327ace-ba52-4bbd-880c-0ef637e8629e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:23.250106 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bf327ace-ba52-4bbd-880c-0ef637e8629e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:23.250731 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bf327ace-ba52-4bbd-880c-0ef637e8629e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:23.254063 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bf327ace-ba52-4bbd-880c-0ef637e8629e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:23.254773 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bf327ace-ba52-4bbd-880c-0ef637e8629e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:23.255618 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-bf327ace-ba52-4bbd-880c-0ef637e8629e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:23.504166 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3ee1d538-a969-44cd-a099-b4c1d7218d8c tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d4e5bc37e4abc8475ff21d44c2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3bf83ac16540a7a1f4e5f4ea13a3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:23.515015 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3ee1d538-a969-44cd-a099-b4c1d7218d8c tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] 10.222.0.67 "GET /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77" status: 200 len: 1328 microversion: 2.1 time: 0.563978 Sep 16 13:06:23.517199 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2109/4082] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:22 2022] GET /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77 => generated 1328 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:23.533778 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f6d0cd29-a97f-478a-bae2-b803829b3129 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:23.534841 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f6d0cd29-a97f-478a-bae2-b803829b3129 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:23.545513 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6d0cd29-a97f-478a-bae2-b803829b3129 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:23.546301 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6d0cd29-a97f-478a-bae2-b803829b3129 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:23.547128 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6d0cd29-a97f-478a-bae2-b803829b3129 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:23.548049 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6d0cd29-a97f-478a-bae2-b803829b3129 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:23.549083 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6d0cd29-a97f-478a-bae2-b803829b3129 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:23.550118 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6d0cd29-a97f-478a-bae2-b803829b3129 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:23.680103 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f6d0cd29-a97f-478a-bae2-b803829b3129 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:23.694155 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f6d0cd29-a97f-478a-bae2-b803829b3129 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:23.698292 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f6d0cd29-a97f-478a-bae2-b803829b3129 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:23.700466 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f6d0cd29-a97f-478a-bae2-b803829b3129 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1603 microversion: 2.42 time: 0.181926 Sep 16 13:06:23.702073 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2110/4083] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:06:23 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1603 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:06:23.709513 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d168011d-526c-4eeb-b51d-6f924ef540d4 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:23.711541 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d168011d-526c-4eeb-b51d-6f924ef540d4 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] [instance: b54b9ae7-c0ae-41e1-8da3-21152fb66aed] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:23.720807 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d168011d-526c-4eeb-b51d-6f924ef540d4 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:23.721648 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d168011d-526c-4eeb-b51d-6f924ef540d4 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:23.722271 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d168011d-526c-4eeb-b51d-6f924ef540d4 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:23.723258 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d168011d-526c-4eeb-b51d-6f924ef540d4 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:23.723859 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d168011d-526c-4eeb-b51d-6f924ef540d4 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:23.724463 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d168011d-526c-4eeb-b51d-6f924ef540d4 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:23.893202 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell0:SELECT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:06:24.201701 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-bf327ace-ba52-4bbd-880c-0ef637e8629e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968cbe62235f472fb9002171f19e1375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337bc9a50c6846ada58b194c94d0f193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:24.224009 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-bf327ace-ba52-4bbd-880c-0ef637e8629e tempest-ServerActionsTestJSON-415461531 tempest-ServerActionsTestJSON-415461531-project] 10.222.0.67 "GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771" status: 200 len: 1665 microversion: 2.1 time: 1.006126 Sep 16 13:06:24.227164 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1974/4084] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:23 2022] GET /compute/v2.1/servers/af5e660b-de79-42ca-a8de-fe06738b9771 => generated 1665 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:24.260479 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-61ecd2ad-04f4-4c69-b866-ebdf919d774b req-468bf04f-36b1-40a9-a28a-90a3e205b4ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b54b9ae7-c0ae-41e1-8da3-21152fb66aed", "tag": "7ad6d397-6661-44dd-9668-05292dd6a705"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:06:24.277762 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-61ecd2ad-04f4-4c69-b866-ebdf919d774b req-468bf04f-36b1-40a9-a28a-90a3e205b4ef service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:24.278574 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-61ecd2ad-04f4-4c69-b866-ebdf919d774b req-468bf04f-36b1-40a9-a28a-90a3e205b4ef service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:24.279248 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-61ecd2ad-04f4-4c69-b866-ebdf919d774b req-468bf04f-36b1-40a9-a28a-90a3e205b4ef service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:24.322667 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-61ecd2ad-04f4-4c69-b866-ebdf919d774b req-468bf04f-36b1-40a9-a28a-90a3e205b4ef service nova] Creating event network-changed:7ad6d397-6661-44dd-9668-05292dd6a705 for instance b54b9ae7-c0ae-41e1-8da3-21152fb66aed on n-h1-858094-4 Sep 16 13:06:24.334140 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-61ecd2ad-04f4-4c69-b866-ebdf919d774b req-468bf04f-36b1-40a9-a28a-90a3e205b4ef service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081639 Sep 16 13:06:24.335979 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1975/4085] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:06:24.385329 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3d1ebc77-74c8-44bf-97b3-c6b08e6b2676 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:06:24.386582 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3d1ebc77-74c8-44bf-97b3-c6b08e6b2676 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: b76bc3fa-0395-4782-8a87-ec5cfc6da641] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:24.399307 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3d1ebc77-74c8-44bf-97b3-c6b08e6b2676 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:24.400966 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3d1ebc77-74c8-44bf-97b3-c6b08e6b2676 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:24.401888 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3d1ebc77-74c8-44bf-97b3-c6b08e6b2676 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:24.406202 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3d1ebc77-74c8-44bf-97b3-c6b08e6b2676 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:24.407733 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3d1ebc77-74c8-44bf-97b3-c6b08e6b2676 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:24.409103 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3d1ebc77-74c8-44bf-97b3-c6b08e6b2676 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:24.449081 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.objects.instance [None req-3d1ebc77-74c8-44bf-97b3-c6b08e6b2676 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lazy-loading 'flavor' on Instance uuid b76bc3fa-0395-4782-8a87-ec5cfc6da641 {{(pid=128780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:06:24.455672 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d168011d-526c-4eeb-b51d-6f924ef540d4 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74da3fbb98846b69a1fef50a56dddf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487c6b2edfb74e6d91d4443cfeb437a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:24.470584 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d168011d-526c-4eeb-b51d-6f924ef540d4 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] 10.222.0.67 "GET /compute/v2.1/servers/b54b9ae7-c0ae-41e1-8da3-21152fb66aed" status: 200 len: 1318 microversion: 2.1 time: 0.766633 Sep 16 13:06:24.471684 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2111/4086] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:23 2022] GET /compute/v2.1/servers/b54b9ae7-c0ae-41e1-8da3-21152fb66aed => generated 1318 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:24.549303 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-66dea599-7762-4b87-958d-099b4914c2f7 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:24.550753 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-66dea599-7762-4b87-958d-099b4914c2f7 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] [instance: 90c273f5-cec8-4644-90fb-f6ff80af0d77] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:24.560056 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66dea599-7762-4b87-958d-099b4914c2f7 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:24.560917 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66dea599-7762-4b87-958d-099b4914c2f7 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:24.561464 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66dea599-7762-4b87-958d-099b4914c2f7 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:24.562472 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66dea599-7762-4b87-958d-099b4914c2f7 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:24.563194 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66dea599-7762-4b87-958d-099b4914c2f7 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:24.564425 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66dea599-7762-4b87-958d-099b4914c2f7 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:24.740416 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3d1ebc77-74c8-44bf-97b3-c6b08e6b2676 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "POST /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641/action" status: 202 len: 0 microversion: 2.20 time: 0.365378 Sep 16 13:06:24.741509 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1976/4087] 10.222.0.67 () {62 vars in 1319 bytes} [Fri Sep 16 13:06:24 2022] POST /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:06:24.748874 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-378c26e6-48ed-49be-a813-5e5c747fc0b1 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:24.749858 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-378c26e6-48ed-49be-a813-5e5c747fc0b1 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:24.759047 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-378c26e6-48ed-49be-a813-5e5c747fc0b1 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:24.759860 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-378c26e6-48ed-49be-a813-5e5c747fc0b1 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:24.760641 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-378c26e6-48ed-49be-a813-5e5c747fc0b1 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:24.762059 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-378c26e6-48ed-49be-a813-5e5c747fc0b1 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:24.762781 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-378c26e6-48ed-49be-a813-5e5c747fc0b1 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:24.763661 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-378c26e6-48ed-49be-a813-5e5c747fc0b1 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:24.990501 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-378c26e6-48ed-49be-a813-5e5c747fc0b1 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:25.001354 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:06:25.008604 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-378c26e6-48ed-49be-a813-5e5c747fc0b1 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:25.010371 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-378c26e6-48ed-49be-a813-5e5c747fc0b1 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:25.011808 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-378c26e6-48ed-49be-a813-5e5c747fc0b1 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1603 microversion: 2.42 time: 0.269087 Sep 16 13:06:25.012587 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1977/4088] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:06:24 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1603 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:06:25.022387 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-fcd633ba-96cd-4b22-98be-2c63452b65de tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:25.024180 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-fcd633ba-96cd-4b22-98be-2c63452b65de tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: b76bc3fa-0395-4782-8a87-ec5cfc6da641] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:25.034930 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fcd633ba-96cd-4b22-98be-2c63452b65de tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:25.035434 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fcd633ba-96cd-4b22-98be-2c63452b65de tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:25.035875 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fcd633ba-96cd-4b22-98be-2c63452b65de tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:25.036923 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fcd633ba-96cd-4b22-98be-2c63452b65de tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:25.037438 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fcd633ba-96cd-4b22-98be-2c63452b65de tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:25.038044 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-fcd633ba-96cd-4b22-98be-2c63452b65de tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:25.193326 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-66dea599-7762-4b87-958d-099b4914c2f7 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d4e5bc37e4abc8475ff21d44c2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3bf83ac16540a7a1f4e5f4ea13a3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:25.207490 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-66dea599-7762-4b87-958d-099b4914c2f7 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] 10.222.0.67 "GET /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77" status: 200 len: 1528 microversion: 2.1 time: 0.665098 Sep 16 13:06:25.209455 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2112/4089] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:24 2022] GET /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77 => generated 1528 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:06:25.233990 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4b50a342-aa07-4144-bd0e-1f6371be1379 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:25.234925 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4b50a342-aa07-4144-bd0e-1f6371be1379 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] [instance: 90c273f5-cec8-4644-90fb-f6ff80af0d77] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:25.243148 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b50a342-aa07-4144-bd0e-1f6371be1379 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:25.243907 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b50a342-aa07-4144-bd0e-1f6371be1379 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:25.244815 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b50a342-aa07-4144-bd0e-1f6371be1379 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:25.245729 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b50a342-aa07-4144-bd0e-1f6371be1379 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:25.246444 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b50a342-aa07-4144-bd0e-1f6371be1379 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:25.247029 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b50a342-aa07-4144-bd0e-1f6371be1379 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:25.427210 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-fcd633ba-96cd-4b22-98be-2c63452b65de tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:25.437358 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-fcd633ba-96cd-4b22-98be-2c63452b65de tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:25.439210 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-fcd633ba-96cd-4b22-98be-2c63452b65de tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:25.440721 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-fcd633ba-96cd-4b22-98be-2c63452b65de tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641" status: 200 len: 1722 microversion: 2.20 time: 0.427011 Sep 16 13:06:25.441908 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1978/4090] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:06:25 2022] GET /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641 => generated 1722 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:06:25.500522 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-46040ad5-ed9c-425b-b806-ff6ae267d52c tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:25.501384 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-46040ad5-ed9c-425b-b806-ff6ae267d52c tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] [instance: b54b9ae7-c0ae-41e1-8da3-21152fb66aed] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:25.506850 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4b50a342-aa07-4144-bd0e-1f6371be1379 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d4e5bc37e4abc8475ff21d44c2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3bf83ac16540a7a1f4e5f4ea13a3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:25.509491 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-46040ad5-ed9c-425b-b806-ff6ae267d52c tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:25.510347 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-46040ad5-ed9c-425b-b806-ff6ae267d52c tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:25.510999 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-46040ad5-ed9c-425b-b806-ff6ae267d52c tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:25.511982 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-46040ad5-ed9c-425b-b806-ff6ae267d52c tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:25.512690 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-46040ad5-ed9c-425b-b806-ff6ae267d52c tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:25.513341 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-46040ad5-ed9c-425b-b806-ff6ae267d52c tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:25.517328 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4b50a342-aa07-4144-bd0e-1f6371be1379 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] 10.222.0.67 "GET /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77" status: 200 len: 1528 microversion: 2.1 time: 0.286541 Sep 16 13:06:25.523926 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2113/4091] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:25 2022] GET /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77 => generated 1528 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:25.724790 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-46040ad5-ed9c-425b-b806-ff6ae267d52c tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74da3fbb98846b69a1fef50a56dddf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487c6b2edfb74e6d91d4443cfeb437a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:25.739418 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-46040ad5-ed9c-425b-b806-ff6ae267d52c tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] 10.222.0.67 "GET /compute/v2.1/servers/b54b9ae7-c0ae-41e1-8da3-21152fb66aed" status: 200 len: 1318 microversion: 2.1 time: 0.248532 Sep 16 13:06:25.741510 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1979/4092] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:25 2022] GET /compute/v2.1/servers/b54b9ae7-c0ae-41e1-8da3-21152fb66aed => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:06:25.917374 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2de6a941-640b-49fb-9558-6378a3fbe607 tempest-ServersNegativeTestMultiTenantJSON-581963334 tempest-ServersNegativeTestMultiTenantJSON-581963334-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:25.918039 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2de6a941-640b-49fb-9558-6378a3fbe607 tempest-ServersNegativeTestMultiTenantJSON-581963334 tempest-ServersNegativeTestMultiTenantJSON-581963334-project] [instance: 90c273f5-cec8-4644-90fb-f6ff80af0d77] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:25.924344 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2de6a941-640b-49fb-9558-6378a3fbe607 tempest-ServersNegativeTestMultiTenantJSON-581963334 tempest-ServersNegativeTestMultiTenantJSON-581963334-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:25.924849 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2de6a941-640b-49fb-9558-6378a3fbe607 tempest-ServersNegativeTestMultiTenantJSON-581963334 tempest-ServersNegativeTestMultiTenantJSON-581963334-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:25.925320 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2de6a941-640b-49fb-9558-6378a3fbe607 tempest-ServersNegativeTestMultiTenantJSON-581963334 tempest-ServersNegativeTestMultiTenantJSON-581963334-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:25.925989 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2de6a941-640b-49fb-9558-6378a3fbe607 tempest-ServersNegativeTestMultiTenantJSON-581963334 tempest-ServersNegativeTestMultiTenantJSON-581963334-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:25.926439 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2de6a941-640b-49fb-9558-6378a3fbe607 tempest-ServersNegativeTestMultiTenantJSON-581963334 tempest-ServersNegativeTestMultiTenantJSON-581963334-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:25.926858 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2de6a941-640b-49fb-9558-6378a3fbe607 tempest-ServersNegativeTestMultiTenantJSON-581963334 tempest-ServersNegativeTestMultiTenantJSON-581963334-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:25.941753 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-2de6a941-640b-49fb-9558-6378a3fbe607 tempest-ServersNegativeTestMultiTenantJSON-581963334 tempest-ServersNegativeTestMultiTenantJSON-581963334-project] HTTP exception thrown: Instance 90c273f5-cec8-4644-90fb-f6ff80af0d77 could not be found. Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2de6a941-640b-49fb-9558-6378a3fbe607 tempest-ServersNegativeTestMultiTenantJSON-581963334 tempest-ServersNegativeTestMultiTenantJSON-581963334-project] Request method failure captured: Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77 HTTP/1.1 Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHS2yTo4URNzDnoU6mmsup6jUxXRtspBz1WBqPKS47YH_G0TSzQhpoQ-9HQeSgBBcBRNAvFhxOwn6ddlGHFkqxHgBGovXeZ0PSPAssLDQzEN5nv1dadWIUOKijAWVjYGDBxY-fFpUk954NsUyvLtBAbR3d24YkK7qjIY_iY4aakgPSo Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: 17c6cefa9f0245ac98950fb6f8b526c8 Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-581963334 Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/17c6cefa9f0245ac98950fb6f8b526c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/17c6cefa9f0245ac98950fb6f8b526c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_17c6cefa9f0245ac98950fb6f8b526c8", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/17c6cefa9f0245ac98950fb6f8b526c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-581963334 Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: 17c6cefa9f0245ac98950fb6f8b526c8 Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-581963334 Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-ServersNegativeTestMultiTenantJSON-581963334-project Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: 54a846e00df64618b08b75468c46dd12 Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-581963334-project Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance 90c273f5-cec8-4644-90fb-f6ff80af0d77 could not be found. Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': '90c273f5-cec8-4644-90fb-f6ff80af0d77'} Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90c273f5-cec8-4644-90fb-f6ff80af0d77 could not be found. Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:06:25.943382 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:06:25.948553 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90c273f5-cec8-4644-90fb-f6ff80af0d77 could not be found. Sep 16 13:06:25.948553 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:06:25.948553 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:06:25.948553 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:06:25.948553 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:06:25.948553 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:06:25.948553 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:06:25.948553 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:06:25.948553 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:06:25.948553 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90c273f5-cec8-4644-90fb-f6ff80af0d77 could not be found. Sep 16 13:06:25.948553 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:06:25.948553 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2de6a941-640b-49fb-9558-6378a3fbe607 tempest-ServersNegativeTestMultiTenantJSON-581963334 tempest-ServersNegativeTestMultiTenantJSON-581963334-project] Returning 404 to user: Instance 90c273f5-cec8-4644-90fb-f6ff80af0d77 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:06:25.948553 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2de6a941-640b-49fb-9558-6378a3fbe607 tempest-ServersNegativeTestMultiTenantJSON-581963334 tempest-ServersNegativeTestMultiTenantJSON-581963334-project] 10.222.0.67 "DELETE /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77" status: 404 len: 111 microversion: 2.1 time: 0.408945 Sep 16 13:06:25.948553 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2114/4093] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 13:06:25 2022] DELETE /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77 => generated 111 bytes in 410 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:06:25.955057 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-d414ac61-3a0a-4809-a3e0-daa3b6d9ea1f tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:25.955731 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-d414ac61-3a0a-4809-a3e0-daa3b6d9ea1f tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] [instance: 90c273f5-cec8-4644-90fb-f6ff80af0d77] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:25.963211 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d414ac61-3a0a-4809-a3e0-daa3b6d9ea1f tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:25.963628 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d414ac61-3a0a-4809-a3e0-daa3b6d9ea1f tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:25.966205 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d414ac61-3a0a-4809-a3e0-daa3b6d9ea1f tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:25.966969 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d414ac61-3a0a-4809-a3e0-daa3b6d9ea1f tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:25.967434 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d414ac61-3a0a-4809-a3e0-daa3b6d9ea1f tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:25.968002 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-d414ac61-3a0a-4809-a3e0-daa3b6d9ea1f tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:26.043697 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5bcb0479-a5bd-4c4b-a92e-46cfcad0fc1c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:26.044499 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5bcb0479-a5bd-4c4b-a92e-46cfcad0fc1c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:26.053758 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bcb0479-a5bd-4c4b-a92e-46cfcad0fc1c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:26.054776 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bcb0479-a5bd-4c4b-a92e-46cfcad0fc1c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:26.055776 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bcb0479-a5bd-4c4b-a92e-46cfcad0fc1c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:26.056615 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bcb0479-a5bd-4c4b-a92e-46cfcad0fc1c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:26.057242 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bcb0479-a5bd-4c4b-a92e-46cfcad0fc1c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:26.057936 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bcb0479-a5bd-4c4b-a92e-46cfcad0fc1c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:26.164667 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-d414ac61-3a0a-4809-a3e0-daa3b6d9ea1f tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d4e5bc37e4abc8475ff21d44c2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3bf83ac16540a7a1f4e5f4ea13a3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:26.177766 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-d414ac61-3a0a-4809-a3e0-daa3b6d9ea1f tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] 10.222.0.67 "GET /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77" status: 200 len: 1528 microversion: 2.1 time: 0.226985 Sep 16 13:06:26.179253 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1980/4094] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:25 2022] GET /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77 => generated 1528 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:26.181472 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5bcb0479-a5bd-4c4b-a92e-46cfcad0fc1c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:26.192468 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5bcb0479-a5bd-4c4b-a92e-46cfcad0fc1c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:26.194506 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5bcb0479-a5bd-4c4b-a92e-46cfcad0fc1c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:26.195883 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5bcb0479-a5bd-4c4b-a92e-46cfcad0fc1c tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1603 microversion: 2.42 time: 0.159488 Sep 16 13:06:26.196905 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2115/4095] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:06:26 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1603 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:06:26.209215 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7e88a4ad-9a7a-40e0-a53f-31a2b1ceb1d3 tempest-ServersNegativeTestMultiTenantJSON-581963334 tempest-ServersNegativeTestMultiTenantJSON-581963334-project] Action: 'update', calling method: >, body: {"server": {"name": "90c273f5-cec8-4644-90fb-f6ff80af0d77_new"}} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:06:26.212581 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7e88a4ad-9a7a-40e0-a53f-31a2b1ceb1d3 tempest-ServersNegativeTestMultiTenantJSON-581963334 tempest-ServersNegativeTestMultiTenantJSON-581963334-project] [instance: 90c273f5-cec8-4644-90fb-f6ff80af0d77] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:26.218783 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7e88a4ad-9a7a-40e0-a53f-31a2b1ceb1d3 tempest-ServersNegativeTestMultiTenantJSON-581963334 tempest-ServersNegativeTestMultiTenantJSON-581963334-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:26.219272 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7e88a4ad-9a7a-40e0-a53f-31a2b1ceb1d3 tempest-ServersNegativeTestMultiTenantJSON-581963334 tempest-ServersNegativeTestMultiTenantJSON-581963334-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:26.219717 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7e88a4ad-9a7a-40e0-a53f-31a2b1ceb1d3 tempest-ServersNegativeTestMultiTenantJSON-581963334 tempest-ServersNegativeTestMultiTenantJSON-581963334-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:26.220451 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7e88a4ad-9a7a-40e0-a53f-31a2b1ceb1d3 tempest-ServersNegativeTestMultiTenantJSON-581963334 tempest-ServersNegativeTestMultiTenantJSON-581963334-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:26.221081 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7e88a4ad-9a7a-40e0-a53f-31a2b1ceb1d3 tempest-ServersNegativeTestMultiTenantJSON-581963334 tempest-ServersNegativeTestMultiTenantJSON-581963334-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:26.221506 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7e88a4ad-9a7a-40e0-a53f-31a2b1ceb1d3 tempest-ServersNegativeTestMultiTenantJSON-581963334 tempest-ServersNegativeTestMultiTenantJSON-581963334-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:26.237020 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.wsgi [None req-7e88a4ad-9a7a-40e0-a53f-31a2b1ceb1d3 tempest-ServersNegativeTestMultiTenantJSON-581963334 tempest-ServersNegativeTestMultiTenantJSON-581963334-project] HTTP exception thrown: Instance 90c273f5-cec8-4644-90fb-f6ff80af0d77 could not be found. Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7e88a4ad-9a7a-40e0-a53f-31a2b1ceb1d3 tempest-ServersNegativeTestMultiTenantJSON-581963334 tempest-ServersNegativeTestMultiTenantJSON-581963334-project] Request method failure captured: Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: request: PUT /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77 HTTP/1.1 Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: Accept: application/json Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: Accept-Encoding: identity Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: Connection: close Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: Content-Length: 64 Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: Content-Type: application/json Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: Host: 10.222.0.67 Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: Openstack-System-Scope: None Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: User-Agent: python-urllib3/1.26.12 Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: X-Auth-Token: gAAAAABjJHS2yTo4URNzDnoU6mmsup6jUxXRtspBz1WBqPKS47YH_G0TSzQhpoQ-9HQeSgBBcBRNAvFhxOwn6ddlGHFkqxHgBGovXeZ0PSPAssLDQzEN5nv1dadWIUOKijAWVjYGDBxY-fFpUk954NsUyvLtBAbR3d24YkK7qjIY_iY4aakgPSo Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Id: None Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: X-Domain-Name: None Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: X-Identity-Status: Confirmed Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: X-Is-Admin-Project: True Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Id: default Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Domain-Name: Default Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Id: 17c6cefa9f0245ac98950fb6f8b526c8 Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-581963334 Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: X-Role: member,reader Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: X-Roles: member,reader Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/17c6cefa9f0245ac98950fb6f8b526c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/17c6cefa9f0245ac98950fb6f8b526c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_17c6cefa9f0245ac98950fb6f8b526c8", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/17c6cefa9f0245ac98950fb6f8b526c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-581963334 Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Id: 17c6cefa9f0245ac98950fb6f8b526c8 Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-581963334 Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: X-User: tempest-ServersNegativeTestMultiTenantJSON-581963334-project Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Id: default Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: X-User-Domain-Name: Default Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: X-User-Id: 54a846e00df64618b08b75468c46dd12 Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-581963334-project Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: {"server": {"name": "90c273f5-cec8-4644-90fb-f6ff80af0d77_new"}} Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: method: > Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: exception: Instance 90c273f5-cec8-4644-90fb-f6ff80af0d77 could not be found. Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: action_args: {'id': '90c273f5-cec8-4644-90fb-f6ff80af0d77', 'body': {'server': {'name': '90c273f5-cec8-4644-90fb-f6ff80af0d77_new'}}} Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90c273f5-cec8-4644-90fb-f6ff80af0d77 could not be found. Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:06:26.239163 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 16 13:06:26.246099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 16 13:06:26.246099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 16 13:06:26.246099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:06:26.246099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:06:26.246099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:06:26.246099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:06:26.246099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90c273f5-cec8-4644-90fb-f6ff80af0d77 could not be found. Sep 16 13:06:26.246099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:06:26.246099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:06:26.246099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:06:26.246099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:06:26.246099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:06:26.246099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:06:26.246099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:06:26.246099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:06:26.246099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90c273f5-cec8-4644-90fb-f6ff80af0d77 could not be found. Sep 16 13:06:26.246099 n-d-858094-4 devstack@n-api.service[128780]: ERROR nova.api.openstack.wsgi Sep 16 13:06:26.246099 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7e88a4ad-9a7a-40e0-a53f-31a2b1ceb1d3 tempest-ServersNegativeTestMultiTenantJSON-581963334 tempest-ServersNegativeTestMultiTenantJSON-581963334-project] Returning 404 to user: Instance 90c273f5-cec8-4644-90fb-f6ff80af0d77 could not be found. {{(pid=128780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:06:26.246099 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7e88a4ad-9a7a-40e0-a53f-31a2b1ceb1d3 tempest-ServersNegativeTestMultiTenantJSON-581963334 tempest-ServersNegativeTestMultiTenantJSON-581963334-project] 10.222.0.67 "PUT /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77" status: 404 len: 111 microversion: 2.1 time: 0.036634 Sep 16 13:06:26.246099 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1981/4096] 10.222.0.67 () {60 vars in 1256 bytes} [Fri Sep 16 13:06:26 2022] PUT /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:06:26.252441 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3f5c49c2-3c59-45ed-98db-ca1ba0d352d5 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:26.253055 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3f5c49c2-3c59-45ed-98db-ca1ba0d352d5 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] [instance: 90c273f5-cec8-4644-90fb-f6ff80af0d77] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:26.260317 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3f5c49c2-3c59-45ed-98db-ca1ba0d352d5 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:26.260827 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3f5c49c2-3c59-45ed-98db-ca1ba0d352d5 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:26.261278 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3f5c49c2-3c59-45ed-98db-ca1ba0d352d5 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:26.262002 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3f5c49c2-3c59-45ed-98db-ca1ba0d352d5 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:26.262476 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3f5c49c2-3c59-45ed-98db-ca1ba0d352d5 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:26.262924 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3f5c49c2-3c59-45ed-98db-ca1ba0d352d5 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:26.295136 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3f5c49c2-3c59-45ed-98db-ca1ba0d352d5 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] [instance: 90c273f5-cec8-4644-90fb-f6ff80af0d77] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:06:26.402361 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3f5c49c2-3c59-45ed-98db-ca1ba0d352d5 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] 10.222.0.67 "DELETE /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77" status: 204 len: 0 microversion: 2.1 time: 0.153358 Sep 16 13:06:26.407576 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2116/4097] 10.222.0.67 () {58 vars in 1239 bytes} [Fri Sep 16 13:06:26 2022] DELETE /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:06:26.412105 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-7d90af19-9229-4296-a604-01bb3d4d2630 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:26.413337 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-7d90af19-9229-4296-a604-01bb3d4d2630 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] [instance: 90c273f5-cec8-4644-90fb-f6ff80af0d77] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:26.422657 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7d90af19-9229-4296-a604-01bb3d4d2630 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:26.423422 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7d90af19-9229-4296-a604-01bb3d4d2630 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:26.424077 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7d90af19-9229-4296-a604-01bb3d4d2630 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:26.424777 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7d90af19-9229-4296-a604-01bb3d4d2630 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:26.425229 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7d90af19-9229-4296-a604-01bb3d4d2630 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:26.425828 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-7d90af19-9229-4296-a604-01bb3d4d2630 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:26.484816 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c11edd4b-9ea2-4e17-843b-a1823a132cf8 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:26.485541 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c11edd4b-9ea2-4e17-843b-a1823a132cf8 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: b76bc3fa-0395-4782-8a87-ec5cfc6da641] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:26.493586 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c11edd4b-9ea2-4e17-843b-a1823a132cf8 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:26.494310 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c11edd4b-9ea2-4e17-843b-a1823a132cf8 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:26.495032 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c11edd4b-9ea2-4e17-843b-a1823a132cf8 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:26.495943 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c11edd4b-9ea2-4e17-843b-a1823a132cf8 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:26.498616 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c11edd4b-9ea2-4e17-843b-a1823a132cf8 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:26.499103 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c11edd4b-9ea2-4e17-843b-a1823a132cf8 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:26.663262 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-7d90af19-9229-4296-a604-01bb3d4d2630 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d4e5bc37e4abc8475ff21d44c2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3bf83ac16540a7a1f4e5f4ea13a3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:26.687699 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-7d90af19-9229-4296-a604-01bb3d4d2630 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] 10.222.0.67 "GET /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77" status: 200 len: 1534 microversion: 2.1 time: 0.273692 Sep 16 13:06:26.700172 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c11edd4b-9ea2-4e17-843b-a1823a132cf8 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:26.700475 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1982/4098] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:26 2022] GET /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77 => generated 1534 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:06:26.709461 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c11edd4b-9ea2-4e17-843b-a1823a132cf8 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:26.711232 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c11edd4b-9ea2-4e17-843b-a1823a132cf8 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:26.712819 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c11edd4b-9ea2-4e17-843b-a1823a132cf8 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641" status: 200 len: 1722 microversion: 2.20 time: 0.239306 Sep 16 13:06:26.713901 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2117/4099] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:06:26 2022] GET /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641 => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:06:26.767133 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-244a9a4e-fba5-4284-bc0c-6b140c7f8970 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:26.768172 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-244a9a4e-fba5-4284-bc0c-6b140c7f8970 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] [instance: b54b9ae7-c0ae-41e1-8da3-21152fb66aed] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:26.775999 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-244a9a4e-fba5-4284-bc0c-6b140c7f8970 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:26.777134 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-244a9a4e-fba5-4284-bc0c-6b140c7f8970 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:26.777732 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-244a9a4e-fba5-4284-bc0c-6b140c7f8970 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:26.778632 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-244a9a4e-fba5-4284-bc0c-6b140c7f8970 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:26.779466 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-244a9a4e-fba5-4284-bc0c-6b140c7f8970 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:26.780233 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-244a9a4e-fba5-4284-bc0c-6b140c7f8970 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:26.945607 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-244a9a4e-fba5-4284-bc0c-6b140c7f8970 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74da3fbb98846b69a1fef50a56dddf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487c6b2edfb74e6d91d4443cfeb437a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:26.954516 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-244a9a4e-fba5-4284-bc0c-6b140c7f8970 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] 10.222.0.67 "GET /compute/v2.1/servers/b54b9ae7-c0ae-41e1-8da3-21152fb66aed" status: 200 len: 1318 microversion: 2.1 time: 0.191524 Sep 16 13:06:26.955427 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1983/4100] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:26 2022] GET /compute/v2.1/servers/b54b9ae7-c0ae-41e1-8da3-21152fb66aed => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:27.223069 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ecfcd1a1-5e3d-4b41-9137-cd66557dfd99 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:27.223640 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ecfcd1a1-5e3d-4b41-9137-cd66557dfd99 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:27.233686 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecfcd1a1-5e3d-4b41-9137-cd66557dfd99 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:27.234328 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecfcd1a1-5e3d-4b41-9137-cd66557dfd99 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:27.234847 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecfcd1a1-5e3d-4b41-9137-cd66557dfd99 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:27.235731 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecfcd1a1-5e3d-4b41-9137-cd66557dfd99 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:27.236207 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecfcd1a1-5e3d-4b41-9137-cd66557dfd99 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:27.236914 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecfcd1a1-5e3d-4b41-9137-cd66557dfd99 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:27.310005 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ecfcd1a1-5e3d-4b41-9137-cd66557dfd99 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:27.322842 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ecfcd1a1-5e3d-4b41-9137-cd66557dfd99 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:27.324590 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ecfcd1a1-5e3d-4b41-9137-cd66557dfd99 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:27.327028 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ecfcd1a1-5e3d-4b41-9137-cd66557dfd99 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1603 microversion: 2.42 time: 0.108690 Sep 16 13:06:27.340146 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2118/4101] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:06:27 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1603 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:06:27.719280 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3c12f755-d4f0-424b-b0b0-23b26a9f20aa tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:27.720910 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3c12f755-d4f0-424b-b0b0-23b26a9f20aa tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] [instance: 90c273f5-cec8-4644-90fb-f6ff80af0d77] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:27.731236 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3c12f755-d4f0-424b-b0b0-23b26a9f20aa tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:27.731885 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3c12f755-d4f0-424b-b0b0-23b26a9f20aa tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:27.732612 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3c12f755-d4f0-424b-b0b0-23b26a9f20aa tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:27.734397 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3c12f755-d4f0-424b-b0b0-23b26a9f20aa tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:27.735303 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3c12f755-d4f0-424b-b0b0-23b26a9f20aa tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:27.736584 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3c12f755-d4f0-424b-b0b0-23b26a9f20aa tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:27.739878 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c7359fc1-578d-4dac-a420-a8f6aa0126e3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:27.740756 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c7359fc1-578d-4dac-a420-a8f6aa0126e3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: b76bc3fa-0395-4782-8a87-ec5cfc6da641] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:27.753249 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c7359fc1-578d-4dac-a420-a8f6aa0126e3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:27.754792 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c7359fc1-578d-4dac-a420-a8f6aa0126e3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:27.758723 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c7359fc1-578d-4dac-a420-a8f6aa0126e3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:27.759993 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c7359fc1-578d-4dac-a420-a8f6aa0126e3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:27.760746 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c7359fc1-578d-4dac-a420-a8f6aa0126e3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:27.762359 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c7359fc1-578d-4dac-a420-a8f6aa0126e3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:28.006209 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3c12f755-d4f0-424b-b0b0-23b26a9f20aa tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d4e5bc37e4abc8475ff21d44c2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3bf83ac16540a7a1f4e5f4ea13a3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:28.021808 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3c12f755-d4f0-424b-b0b0-23b26a9f20aa tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] 10.222.0.67 "GET /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77" status: 200 len: 1534 microversion: 2.1 time: 0.304255 Sep 16 13:06:28.022716 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1984/4102] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:27 2022] GET /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77 => generated 1534 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:28.034898 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-24fe722b-2edb-4daa-8870-31597323c71e tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:28.037982 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-24fe722b-2edb-4daa-8870-31597323c71e tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] [instance: b54b9ae7-c0ae-41e1-8da3-21152fb66aed] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:28.052717 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-24fe722b-2edb-4daa-8870-31597323c71e tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:28.053261 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-24fe722b-2edb-4daa-8870-31597323c71e tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:28.053706 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-24fe722b-2edb-4daa-8870-31597323c71e tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:28.055685 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-24fe722b-2edb-4daa-8870-31597323c71e tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:28.058285 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-24fe722b-2edb-4daa-8870-31597323c71e tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:28.058981 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-24fe722b-2edb-4daa-8870-31597323c71e tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:28.079464 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c7359fc1-578d-4dac-a420-a8f6aa0126e3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:28.092016 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c7359fc1-578d-4dac-a420-a8f6aa0126e3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:28.095366 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c7359fc1-578d-4dac-a420-a8f6aa0126e3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:28.097229 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c7359fc1-578d-4dac-a420-a8f6aa0126e3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641" status: 200 len: 1722 microversion: 2.20 time: 0.361939 Sep 16 13:06:28.099285 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2119/4103] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:06:27 2022] GET /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641 => generated 1722 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:06:28.272661 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-24fe722b-2edb-4daa-8870-31597323c71e tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74da3fbb98846b69a1fef50a56dddf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487c6b2edfb74e6d91d4443cfeb437a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:28.283088 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-24fe722b-2edb-4daa-8870-31597323c71e tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] 10.222.0.67 "GET /compute/v2.1/servers/b54b9ae7-c0ae-41e1-8da3-21152fb66aed" status: 200 len: 1318 microversion: 2.1 time: 0.258176 Sep 16 13:06:28.284882 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1985/4104] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:28 2022] GET /compute/v2.1/servers/b54b9ae7-c0ae-41e1-8da3-21152fb66aed => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:28.357842 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e19890aa-ac6b-45b0-9443-d2cd6d2c2014 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:28.358480 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e19890aa-ac6b-45b0-9443-d2cd6d2c2014 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:28.365956 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e19890aa-ac6b-45b0-9443-d2cd6d2c2014 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:28.366450 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e19890aa-ac6b-45b0-9443-d2cd6d2c2014 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:28.367721 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e19890aa-ac6b-45b0-9443-d2cd6d2c2014 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:28.368592 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e19890aa-ac6b-45b0-9443-d2cd6d2c2014 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:28.369054 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e19890aa-ac6b-45b0-9443-d2cd6d2c2014 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:28.369824 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e19890aa-ac6b-45b0-9443-d2cd6d2c2014 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:28.412883 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:06:28.430753 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e19890aa-ac6b-45b0-9443-d2cd6d2c2014 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:28.431412 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e19890aa-ac6b-45b0-9443-d2cd6d2c2014 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:28.431957 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e19890aa-ac6b-45b0-9443-d2cd6d2c2014 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:28.432557 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-e19890aa-ac6b-45b0-9443-d2cd6d2c2014 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lazy-loading 'fault' on Instance uuid defaddc3-3750-4d8a-b18a-dd6fdce1dbbf {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:06:28.488449 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e19890aa-ac6b-45b0-9443-d2cd6d2c2014 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:28.510272 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e19890aa-ac6b-45b0-9443-d2cd6d2c2014 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:28.511806 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e19890aa-ac6b-45b0-9443-d2cd6d2c2014 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae41c8e822064e3dad16dbce0a3bcc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbc66ae4c664cd18af4bad57bbf12c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:28.513992 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e19890aa-ac6b-45b0-9443-d2cd6d2c2014 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 200 len: 1608 microversion: 2.42 time: 0.159710 Sep 16 13:06:28.514870 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2120/4105] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:06:28 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 1608 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:06:29.051602 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e0aaeddc-b5cb-41b2-aadc-2eb1b4c5af3a tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:29.052299 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e0aaeddc-b5cb-41b2-aadc-2eb1b4c5af3a tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] [instance: 90c273f5-cec8-4644-90fb-f6ff80af0d77] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:29.059999 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e0aaeddc-b5cb-41b2-aadc-2eb1b4c5af3a tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:29.060524 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e0aaeddc-b5cb-41b2-aadc-2eb1b4c5af3a tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:29.061322 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e0aaeddc-b5cb-41b2-aadc-2eb1b4c5af3a tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:29.062472 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e0aaeddc-b5cb-41b2-aadc-2eb1b4c5af3a tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:29.063010 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e0aaeddc-b5cb-41b2-aadc-2eb1b4c5af3a tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:29.063443 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e0aaeddc-b5cb-41b2-aadc-2eb1b4c5af3a tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:29.129547 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-db3d0500-4171-42b3-ab83-1b6a98dc3c9b tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:29.130354 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-db3d0500-4171-42b3-ab83-1b6a98dc3c9b tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: b76bc3fa-0395-4782-8a87-ec5cfc6da641] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:29.139730 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db3d0500-4171-42b3-ab83-1b6a98dc3c9b tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:29.142604 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db3d0500-4171-42b3-ab83-1b6a98dc3c9b tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:29.143103 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db3d0500-4171-42b3-ab83-1b6a98dc3c9b tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:29.144026 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db3d0500-4171-42b3-ab83-1b6a98dc3c9b tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:29.144610 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db3d0500-4171-42b3-ab83-1b6a98dc3c9b tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:29.156615 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db3d0500-4171-42b3-ab83-1b6a98dc3c9b tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:29.495678 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e0aaeddc-b5cb-41b2-aadc-2eb1b4c5af3a tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d4e5bc37e4abc8475ff21d44c2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3bf83ac16540a7a1f4e5f4ea13a3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:29.516658 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e0aaeddc-b5cb-41b2-aadc-2eb1b4c5af3a tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] 10.222.0.67 "GET /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77" status: 200 len: 1534 microversion: 2.1 time: 0.469343 Sep 16 13:06:29.520039 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1986/4106] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:29 2022] GET /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77 => generated 1534 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:29.532057 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-5dc88ebc-46a4-4a02-bc2c-a7ddbfe7b17c tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:29.534266 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-5dc88ebc-46a4-4a02-bc2c-a7ddbfe7b17c tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] [instance: b54b9ae7-c0ae-41e1-8da3-21152fb66aed] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:29.543488 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5dc88ebc-46a4-4a02-bc2c-a7ddbfe7b17c tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:29.544651 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5dc88ebc-46a4-4a02-bc2c-a7ddbfe7b17c tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:29.545117 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5dc88ebc-46a4-4a02-bc2c-a7ddbfe7b17c tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:29.546228 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5dc88ebc-46a4-4a02-bc2c-a7ddbfe7b17c tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:29.546703 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5dc88ebc-46a4-4a02-bc2c-a7ddbfe7b17c tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:29.547120 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-5dc88ebc-46a4-4a02-bc2c-a7ddbfe7b17c tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:29.588776 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-db3d0500-4171-42b3-ab83-1b6a98dc3c9b tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:29.606520 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-db3d0500-4171-42b3-ab83-1b6a98dc3c9b tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:29.608464 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-db3d0500-4171-42b3-ab83-1b6a98dc3c9b tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:29.609847 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-db3d0500-4171-42b3-ab83-1b6a98dc3c9b tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641" status: 200 len: 1722 microversion: 2.20 time: 0.484943 Sep 16 13:06:29.610406 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2121/4107] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:06:29 2022] GET /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641 => generated 1722 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:06:29.616452 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3095d16d-8fca-4bec-976d-6f368c07e5eb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:29.617253 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3095d16d-8fca-4bec-976d-6f368c07e5eb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] [instance: defaddc3-3750-4d8a-b18a-dd6fdce1dbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:29.624794 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3095d16d-8fca-4bec-976d-6f368c07e5eb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:29.625585 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3095d16d-8fca-4bec-976d-6f368c07e5eb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:29.626102 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3095d16d-8fca-4bec-976d-6f368c07e5eb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:29.626889 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3095d16d-8fca-4bec-976d-6f368c07e5eb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:29.627413 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3095d16d-8fca-4bec-976d-6f368c07e5eb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:29.628038 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3095d16d-8fca-4bec-976d-6f368c07e5eb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:29.648737 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-3095d16d-8fca-4bec-976d-6f368c07e5eb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] HTTP exception thrown: Instance defaddc3-3750-4d8a-b18a-dd6fdce1dbbf could not be found. Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3095d16d-8fca-4bec-976d-6f368c07e5eb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Request method failure captured: Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf HTTP/1.1 Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: Accept: application/json Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: Connection: close Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: Content-Length: 0 Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: Content-Type: application/json Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: Host: 10.222.0.67 Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjJHMUcwVN3Hzn_4utYBqmQqKPjJwbyuTaqsfCW618ADsF2NdMKsJn2rCr2fg4Ts1Dk_DRBTAE5oLmAvWCqdQSFc_gi97nu9uh7-5FnCXfEaBmk_JPrN9MyltdbXkDaQzb1E7IzMI1meOxOS4JZ57wDc1uUolcBy-TfiPPzvqmnNYigTU Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Id: None Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: X-Domain-Name: None Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: X-Openstack-Nova-Api-Version: 2.42 Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Id: bdbc66ae4c664cd18af4bad57bbf12c4 Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2038653902 Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: X-Role: member,reader Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: X-Roles: member,reader Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bdbc66ae4c664cd18af4bad57bbf12c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/bdbc66ae4c664cd18af4bad57bbf12c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_bdbc66ae4c664cd18af4bad57bbf12c4", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bdbc66ae4c664cd18af4bad57bbf12c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2038653902 Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Id: bdbc66ae4c664cd18af4bad57bbf12c4 Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2038653902 Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: X-User: tempest-TaggedBootDevicesTest_v242-2038653902-project Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: X-User-Id: ae41c8e822064e3dad16dbce0a3bcc5b Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2038653902-project Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: method: > Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: exception: Instance defaddc3-3750-4d8a-b18a-dd6fdce1dbbf could not be found. Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: action_args: {'id': 'defaddc3-3750-4d8a-b18a-dd6fdce1dbbf'} Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance defaddc3-3750-4d8a-b18a-dd6fdce1dbbf could not be found. Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance defaddc3-3750-4d8a-b18a-dd6fdce1dbbf could not be found. Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:06:29.650497 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:06:29.654791 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:06:29.654791 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:06:29.654791 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:06:29.654791 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:06:29.654791 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:06:29.654791 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:06:29.654791 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance defaddc3-3750-4d8a-b18a-dd6fdce1dbbf could not be found. Sep 16 13:06:29.654791 n-d-858094-4 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 16 13:06:29.654791 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3095d16d-8fca-4bec-976d-6f368c07e5eb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Returning 404 to user: Instance defaddc3-3750-4d8a-b18a-dd6fdce1dbbf could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:06:29.654791 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3095d16d-8fca-4bec-976d-6f368c07e5eb tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf" status: 404 len: 111 microversion: 2.42 time: 0.040427 Sep 16 13:06:29.654791 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2122/4108] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:06:29 2022] GET /compute/v2.1/servers/defaddc3-3750-4d8a-b18a-dd6fdce1dbbf => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 13:06:29.675638 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-af18b4cd-04c7-4d1e-b9fa-5d9d5ff280b2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] Calling method '.version_select at 0x7f10349c0820>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:29.723354 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-af18b4cd-04c7-4d1e-b9fa-5d9d5ff280b2 tempest-TaggedBootDevicesTest_v242-2038653902 tempest-TaggedBootDevicesTest_v242-2038653902-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-292398918" status: 204 len: 0 microversion: 2.42 time: 0.054246 Sep 16 13:06:29.725374 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2123/4109] 10.222.0.67 () {60 vars in 1259 bytes} [Fri Sep 16 13:06:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-292398918 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 13:06:29.897894 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-ed8f8119-e896-4bb1-92c3-ba08918ba34d req-db2c9a66-acd3-45b4-aceb-4408a336925f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b54b9ae7-c0ae-41e1-8da3-21152fb66aed", "name": "network-vif-plugged", "status": "completed", "tag": "7ad6d397-6661-44dd-9668-05292dd6a705"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:06:29.918190 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ed8f8119-e896-4bb1-92c3-ba08918ba34d req-db2c9a66-acd3-45b4-aceb-4408a336925f service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:29.920435 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-5dc88ebc-46a4-4a02-bc2c-a7ddbfe7b17c tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74da3fbb98846b69a1fef50a56dddf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487c6b2edfb74e6d91d4443cfeb437a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:29.921763 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ed8f8119-e896-4bb1-92c3-ba08918ba34d req-db2c9a66-acd3-45b4-aceb-4408a336925f service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:29.922965 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ed8f8119-e896-4bb1-92c3-ba08918ba34d req-db2c9a66-acd3-45b4-aceb-4408a336925f service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:29.930972 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-5dc88ebc-46a4-4a02-bc2c-a7ddbfe7b17c tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] 10.222.0.67 "GET /compute/v2.1/servers/b54b9ae7-c0ae-41e1-8da3-21152fb66aed" status: 200 len: 1318 microversion: 2.1 time: 0.407623 Sep 16 13:06:29.931574 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1987/4110] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:29 2022] GET /compute/v2.1/servers/b54b9ae7-c0ae-41e1-8da3-21152fb66aed => generated 1318 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:29.941071 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-ed8f8119-e896-4bb1-92c3-ba08918ba34d req-db2c9a66-acd3-45b4-aceb-4408a336925f service nova] Creating event network-vif-plugged:7ad6d397-6661-44dd-9668-05292dd6a705 for instance b54b9ae7-c0ae-41e1-8da3-21152fb66aed on n-h1-858094-4 Sep 16 13:06:29.956656 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-ed8f8119-e896-4bb1-92c3-ba08918ba34d req-db2c9a66-acd3-45b4-aceb-4408a336925f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062385 Sep 16 13:06:29.960007 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2124/4111] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:06:30.553624 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-2c47bb06-a22e-454c-b6ab-38c69eb76fa3 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:30.555517 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-2c47bb06-a22e-454c-b6ab-38c69eb76fa3 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] [instance: 90c273f5-cec8-4644-90fb-f6ff80af0d77] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:30.572714 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c47bb06-a22e-454c-b6ab-38c69eb76fa3 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:30.573626 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c47bb06-a22e-454c-b6ab-38c69eb76fa3 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:30.574245 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c47bb06-a22e-454c-b6ab-38c69eb76fa3 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:30.575342 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c47bb06-a22e-454c-b6ab-38c69eb76fa3 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:30.575960 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c47bb06-a22e-454c-b6ab-38c69eb76fa3 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:30.579145 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-2c47bb06-a22e-454c-b6ab-38c69eb76fa3 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:30.601034 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-c5e05ceb-7abb-4b95-93b1-fa07321f4241 req-e342bd0f-6583-4621-a7c5-d1df3804df97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90c273f5-cec8-4644-90fb-f6ff80af0d77", "name": "network-vif-deleted", "tag": "5d3e13d6-1350-42fb-92c3-316857c47ac8"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:06:30.612372 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c5e05ceb-7abb-4b95-93b1-fa07321f4241 req-e342bd0f-6583-4621-a7c5-d1df3804df97 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:30.621739 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c5e05ceb-7abb-4b95-93b1-fa07321f4241 req-e342bd0f-6583-4621-a7c5-d1df3804df97 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:30.622428 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c5e05ceb-7abb-4b95-93b1-fa07321f4241 req-e342bd0f-6583-4621-a7c5-d1df3804df97 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:30.648034 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-c5e05ceb-7abb-4b95-93b1-fa07321f4241 req-e342bd0f-6583-4621-a7c5-d1df3804df97 service nova] Creating event network-vif-deleted:5d3e13d6-1350-42fb-92c3-316857c47ac8 for instance 90c273f5-cec8-4644-90fb-f6ff80af0d77 on n-h1-858094-4 Sep 16 13:06:30.658917 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-c5e05ceb-7abb-4b95-93b1-fa07321f4241 req-e342bd0f-6583-4621-a7c5-d1df3804df97 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061769 Sep 16 13:06:30.659555 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2125/4112] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:06:30.665341 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cde56762-c869-4ea4-89a8-4869e3ba3679 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:30.666370 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cde56762-c869-4ea4-89a8-4869e3ba3679 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: b76bc3fa-0395-4782-8a87-ec5cfc6da641] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:30.680407 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cde56762-c869-4ea4-89a8-4869e3ba3679 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:30.681124 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cde56762-c869-4ea4-89a8-4869e3ba3679 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:30.681722 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cde56762-c869-4ea4-89a8-4869e3ba3679 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:30.682602 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cde56762-c869-4ea4-89a8-4869e3ba3679 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:30.683203 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cde56762-c869-4ea4-89a8-4869e3ba3679 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:30.683800 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cde56762-c869-4ea4-89a8-4869e3ba3679 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:30.721716 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-2c47bb06-a22e-454c-b6ab-38c69eb76fa3 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d4e5bc37e4abc8475ff21d44c2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3bf83ac16540a7a1f4e5f4ea13a3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:30.736867 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-2c47bb06-a22e-454c-b6ab-38c69eb76fa3 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] 10.222.0.67 "GET /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77" status: 200 len: 1492 microversion: 2.1 time: 0.194067 Sep 16 13:06:30.752428 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1988/4113] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:30 2022] GET /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77 => generated 1492 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:30.900499 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cde56762-c869-4ea4-89a8-4869e3ba3679 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:30.910623 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cde56762-c869-4ea4-89a8-4869e3ba3679 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:30.912493 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cde56762-c869-4ea4-89a8-4869e3ba3679 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:30.915165 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cde56762-c869-4ea4-89a8-4869e3ba3679 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641" status: 200 len: 1722 microversion: 2.20 time: 0.254057 Sep 16 13:06:30.916250 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2126/4114] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:06:30 2022] GET /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641 => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:06:30.958706 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-e52b6b44-2e6a-4d66-9629-96958f397923 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:30.959605 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-e52b6b44-2e6a-4d66-9629-96958f397923 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] [instance: b54b9ae7-c0ae-41e1-8da3-21152fb66aed] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:30.966380 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e52b6b44-2e6a-4d66-9629-96958f397923 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:30.967121 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e52b6b44-2e6a-4d66-9629-96958f397923 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:30.967645 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e52b6b44-2e6a-4d66-9629-96958f397923 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:30.968554 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e52b6b44-2e6a-4d66-9629-96958f397923 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:30.969096 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e52b6b44-2e6a-4d66-9629-96958f397923 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:30.969600 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-e52b6b44-2e6a-4d66-9629-96958f397923 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:31.152548 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-e52b6b44-2e6a-4d66-9629-96958f397923 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74da3fbb98846b69a1fef50a56dddf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487c6b2edfb74e6d91d4443cfeb437a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:31.162222 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-e52b6b44-2e6a-4d66-9629-96958f397923 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] 10.222.0.67 "GET /compute/v2.1/servers/b54b9ae7-c0ae-41e1-8da3-21152fb66aed" status: 200 len: 1318 microversion: 2.1 time: 0.207915 Sep 16 13:06:31.163127 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1989/4115] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:30 2022] GET /compute/v2.1/servers/b54b9ae7-c0ae-41e1-8da3-21152fb66aed => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:31.774083 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b8c135e4-8266-4164-94aa-44764e76ed50 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:31.788238 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b8c135e4-8266-4164-94aa-44764e76ed50 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] [instance: 90c273f5-cec8-4644-90fb-f6ff80af0d77] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:31.794442 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8c135e4-8266-4164-94aa-44764e76ed50 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:31.794942 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8c135e4-8266-4164-94aa-44764e76ed50 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:31.795377 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8c135e4-8266-4164-94aa-44764e76ed50 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:31.796082 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8c135e4-8266-4164-94aa-44764e76ed50 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:31.796573 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8c135e4-8266-4164-94aa-44764e76ed50 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:31.796997 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8c135e4-8266-4164-94aa-44764e76ed50 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:31.956165 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8c135e4-8266-4164-94aa-44764e76ed50 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:31.957117 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8c135e4-8266-4164-94aa-44764e76ed50 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:31.958711 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8c135e4-8266-4164-94aa-44764e76ed50 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:31.962466 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-b8c135e4-8266-4164-94aa-44764e76ed50 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Lazy-loading 'fault' on Instance uuid 90c273f5-cec8-4644-90fb-f6ff80af0d77 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:06:31.963200 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [None req-3bb9cd45-a88e-4e49-8338-416ce0074bf3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Calling method '>' {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:31.964530 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.compute.api [None req-3bb9cd45-a88e-4e49-8338-416ce0074bf3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] [instance: b76bc3fa-0395-4782-8a87-ec5cfc6da641] Fetching instance by UUID {{(pid=128780) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:31.985835 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3bb9cd45-a88e-4e49-8338-416ce0074bf3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:31.986530 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3bb9cd45-a88e-4e49-8338-416ce0074bf3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:31.987801 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3bb9cd45-a88e-4e49-8338-416ce0074bf3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:31.988827 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3bb9cd45-a88e-4e49-8338-416ce0074bf3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:31.989448 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3bb9cd45-a88e-4e49-8338-416ce0074bf3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:31.990021 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [None req-3bb9cd45-a88e-4e49-8338-416ce0074bf3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:32.074432 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b8c135e4-8266-4164-94aa-44764e76ed50 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d4e5bc37e4abc8475ff21d44c2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3bf83ac16540a7a1f4e5f4ea13a3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:32.097240 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b8c135e4-8266-4164-94aa-44764e76ed50 tempest-ServersNegativeTestMultiTenantJSON-2135890862 tempest-ServersNegativeTestMultiTenantJSON-2135890862-project] 10.222.0.67 "GET /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77" status: 200 len: 1318 microversion: 2.1 time: 0.332708 Sep 16 13:06:32.109667 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2127/4116] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:31 2022] GET /compute/v2.1/servers/90c273f5-cec8-4644-90fb-f6ff80af0d77 => generated 1318 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:06:32.190929 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bc088cbe-03c5-495b-8a3b-14060fed3d48 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:06:32.192312 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bc088cbe-03c5-495b-8a3b-14060fed3d48 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] [instance: b54b9ae7-c0ae-41e1-8da3-21152fb66aed] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:06:32.204711 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc088cbe-03c5-495b-8a3b-14060fed3d48 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:32.205391 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc088cbe-03c5-495b-8a3b-14060fed3d48 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:32.206148 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc088cbe-03c5-495b-8a3b-14060fed3d48 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:32.208456 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc088cbe-03c5-495b-8a3b-14060fed3d48 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:32.209668 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc088cbe-03c5-495b-8a3b-14060fed3d48 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:32.210420 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc088cbe-03c5-495b-8a3b-14060fed3d48 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:32.397213 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3bb9cd45-a88e-4e49-8338-416ce0074bf3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:32.411329 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3bb9cd45-a88e-4e49-8338-416ce0074bf3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:32.414496 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.policy [None req-3bb9cd45-a88e-4e49-8338-416ce0074bf3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba5727658d094c049054160852163cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f3ad027f264333a95500ef691b7815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128780) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:32.425961 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [None req-3bb9cd45-a88e-4e49-8338-416ce0074bf3 tempest-AttachVolumeShelveTestJSON-2054141611 tempest-AttachVolumeShelveTestJSON-2054141611-project] 10.222.0.67 "GET /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641" status: 200 len: 1722 microversion: 2.20 time: 0.469601 Sep 16 13:06:32.427519 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1990/4117] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Sep 16 13:06:31 2022] GET /compute/v2.1/servers/b76bc3fa-0395-4782-8a87-ec5cfc6da641 => generated 1722 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:06:32.578135 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bc088cbe-03c5-495b-8a3b-14060fed3d48 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74da3fbb98846b69a1fef50a56dddf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487c6b2edfb74e6d91d4443cfeb437a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:06:32.588148 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bc088cbe-03c5-495b-8a3b-14060fed3d48 tempest-ServerDiskConfigTestJSON-534270472 tempest-ServerDiskConfigTestJSON-534270472-project] 10.222.0.67 "GET /compute/v2.1/servers/b54b9ae7-c0ae-41e1-8da3-21152fb66aed" status: 200 len: 1507 microversion: 2.1 time: 0.405244 Sep 16 13:06:32.589057 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2128/4118] 10.222.0.67 () {58 vars in 1236 bytes} [Fri Sep 16 13:06:32 2022] GET /compute/v2.1/servers/b54b9ae7-c0ae-41e1-8da3-21152fb66aed => generated 1507 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:06:44.555429 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_api:SELECT=35 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:06:44.556245 n-d-858094-4 devstack@n-api.service[128780]: DEBUG dbcounter [-] [128780] Writing DB stats nova_cell1:SELECT=75 {{(pid=128780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:06:44.560427 n-d-858094-4 devstack@n-api.service[128780]: DEBUG nova.api.openstack.wsgi [req-34175256-5d83-408d-9fc5-c223d0d0d681 req-792bfff9-ff08-4094-9586-6dfcad453331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b76bc3fa-0395-4782-8a87-ec5cfc6da641", "name": "network-vif-plugged", "status": "completed", "tag": "8a68040c-b0d1-432e-b8a2-3698222d82ee"}]} {{(pid=128780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:06:44.572313 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-34175256-5d83-408d-9fc5-c223d0d0d681 req-792bfff9-ff08-4094-9586-6dfcad453331 service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:44.572802 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-34175256-5d83-408d-9fc5-c223d0d0d681 req-792bfff9-ff08-4094-9586-6dfcad453331 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:44.573314 n-d-858094-4 devstack@n-api.service[128780]: DEBUG oslo_concurrency.lockutils [req-34175256-5d83-408d-9fc5-c223d0d0d681 req-792bfff9-ff08-4094-9586-6dfcad453331 service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:44.585556 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.compute.server_external_events [req-34175256-5d83-408d-9fc5-c223d0d0d681 req-792bfff9-ff08-4094-9586-6dfcad453331 service nova] Creating event network-vif-plugged:8a68040c-b0d1-432e-b8a2-3698222d82ee for instance b76bc3fa-0395-4782-8a87-ec5cfc6da641 on n-h2-858094-4 Sep 16 13:06:44.593904 n-d-858094-4 devstack@n-api.service[128780]: INFO nova.api.openstack.requestlog [req-34175256-5d83-408d-9fc5-c223d0d0d681 req-792bfff9-ff08-4094-9586-6dfcad453331 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040171 Sep 16 13:06:44.594888 n-d-858094-4 devstack@n-api.service[128780]: [pid: 128780|app: 0|req: 1991/4119] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:06:56.583408 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-73b3afe7-9a3c-4721-8f70-23769eb8ed49 req-be31cd32-c1ff-429e-8acd-102561de47eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b76bc3fa-0395-4782-8a87-ec5cfc6da641", "name": "network-vif-unplugged", "status": "completed", "tag": "8a68040c-b0d1-432e-b8a2-3698222d82ee"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:06:56.595650 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:06:56.596904 n-d-858094-4 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=36 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:06:56.605832 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-73b3afe7-9a3c-4721-8f70-23769eb8ed49 req-be31cd32-c1ff-429e-8acd-102561de47eb service nova] Acquiring lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:06:56.606332 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-73b3afe7-9a3c-4721-8f70-23769eb8ed49 req-be31cd32-c1ff-429e-8acd-102561de47eb service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:06:56.606757 n-d-858094-4 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-73b3afe7-9a3c-4721-8f70-23769eb8ed49 req-be31cd32-c1ff-429e-8acd-102561de47eb service nova] Lock "19bb4c25-c68f-412b-8c46-4f5dc22c63ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:06:56.620877 n-d-858094-4 devstack@n-api.service[128779]: DEBUG nova.api.openstack.compute.server_external_events [req-73b3afe7-9a3c-4721-8f70-23769eb8ed49 req-be31cd32-c1ff-429e-8acd-102561de47eb service nova] Unable to find a host for instance b76bc3fa-0395-4782-8a87-ec5cfc6da641. Dropping event network-vif-unplugged {{(pid=128779) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 16 13:06:56.622261 n-d-858094-4 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-73b3afe7-9a3c-4721-8f70-23769eb8ed49 req-be31cd32-c1ff-429e-8acd-102561de47eb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.045859 Sep 16 13:06:56.622388 n-d-858094-4 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2129/4120] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Sep 16 13:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 47 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0)